Timezone: »
https://sites.google.com/view/hill2019/home
This workshop is a joint effort between the 4th ICML Workshop on Human Interpretability in Machine Learning (WHI) and the ICML 2019 Workshop on Interactive Data Analysis System (IDAS). We have combined our forces this year to run Human in the Loop Learning (HILL) in conjunction with ICML 2019!
The workshop will bring together researchers and practitioners who study interpretable and interactive learning systems with applications in large scale data processing, data annotations, data visualization, human-assisted data integration, systems and tools to interpret machine learning models as well as algorithm designs for active learning, online learning, and interpretable machine learning algorithms. The target audience for the workshop includes people who are interested in using machines to solve problems by having a human be an integral part of the process. This workshop serves as a platform where researchers can discuss approaches that bridge the gap between humans and machines and get the best of both worlds.
We welcome high-quality submissions in the broad area of human in the loop learning. A few (non-exhaustive) topics of interest include:
Systems for online and interactive learning algorithms,
Active/Interactive machine learning algorithm design,
Systems for collecting, preparing, and managing machine learning data,
Model understanding tools (verifying, diagnosing, debugging, visualization, introspection, etc),
Design, testing and assessment of interactive systems for data analytics,
Psychology of human concept learning,
Generalized additive models, sparsity and rule learning,
Interpretable unsupervised models (clustering, topic models, etc.),
Interpretation of black-box models (including deep neural networks),
Interpretability in reinforcement learning.
Fri 8:25 a.m. - 8:30 a.m.
|
Opening Remarks
(Opening remarks)
[ Video]
|
|
Fri 8:30 a.m. - 9:00 a.m.
|
Invited Talk: James Philbin
(Invited talk)
[ Video]
|
|
Fri 9:00 a.m. - 9:30 a.m.
|
Invited Talk: Sanja Fidler
(Invited talk)
[ Video]
|
|
Fri 9:30 a.m. - 10:00 a.m.
|
Invited Talk: Bryan Catanzaro
(Invited talk)
|
|
Fri 10:00 a.m. - 11:30 a.m.
|
IDAS Poster Session & Coffee break
(Poster session and break)
|
|
Fri 11:30 a.m. - 12:00 p.m.
|
Invited Talk: Yisong Yue
(Invited talk)
|
|
Fri 12:00 p.m. - 12:30 p.m.
|
Invited Talk: Vittorio Ferrari
(Invited talk)
|
|
Fri 12:30 p.m. - 2:00 p.m.
|
Lunch Break
(Break)
|
|
Fri 2:00 p.m. - 3:00 p.m.
|
Interpretability Contributed Talks
(Contributed Talk)
[ Video]
|
|
Fri 3:00 p.m. - 3:30 p.m.
|
Coffee Break
(Break)
|
|
Fri 3:30 p.m. - 4:45 p.m.
|
Interpretability Invited Discussion: California's Senate Bill 10 (SB 10) on Pretrial Release and Detention with Solon Barocas and Peter Eckersley
(Discussion)
[ Video]
|
|
Fri 4:45 p.m. - 6:00 p.m.
|
Human in the Loop Learning Panel Discussion
(Discussion)
»
[ Video]
Panelists: Vittorio Ferrari, Marcin Detyniecki, and James Philbin |
Author Information
Xin Wang (UC Berkeley)
Xin Wang (UC Berkeley)
Fisher Yu (University of California, Berkeley)
Shanghang Zhang (Petuum Inc.)
Joseph Gonzalez (University of California, Berkeley)
Yangqing Jia (Facebook)
Sarah Bird (Facebook AI Research)
Sarah Bird leads strategic projects to accelerate the adoption and impact of AI research in products at Facebook. Her current work focused on AI Ethics and developing AI responsibly. She is the one of the co-creators of [ONNX](http://onnx.ai/), an open standard for deep learning models, and a leader in the [Pytorch 1.0](https://pytorch.org/) project. Prior to joining Facebook, she was an AI systems researcher at Microsoft Research NYC and a technical advisor to Microsoft’s Data Group. She is one of the researchers behind [Microsoft’s Decision Service](https://azure.microsoft.com/en-us/services/cognitive-services/custom-decision-service/), one of the first general-purpose reinforcement-learning style cloud systems publicly released. She has a Ph.D. in computer science from UC Berkeley advised by Dave Patterson, Krste Asanovic, and Burton Smith.
Kush Varshney (IBM Research AI)
Been Kim (Google)
Adrian Weller (University of Cambridge, Alan Turing Institute)
Adrian Weller is a Senior Research Fellow in the Machine Learning Group at the University of Cambridge, a Faculty Fellow at the Alan Turing Institute for data science and an Executive Fellow at the Leverhulme Centre for the Future of Intelligence (CFI). He is very interested in all aspects of artificial intelligence, its commercial applications and how it may be used to benefit society. At the CFI, he leads their project on Trust and Transparency. Previously, Adrian held senior roles in finance. He received a PhD in computer science from Columbia University, and an undergraduate degree in mathematics from Trinity College, Cambridge.
More from the Same Authors
-
2021 Workshop: ICML Workshop on Human in the Loop Learning (HILL) »
Trevor Darrell · Xin Wang · Been Kim · Li Erran Li · Fisher Yu · Zeynep Akata · wenwu zhu · Pradeep Ravikumar · Shiji Zhou · Shanghang Zhang · Kalesha Bullard -
2020 Workshop: 2nd ICML Workshop on Human in the Loop Learning (HILL) »
Shanghang Zhang · Xin Wang · Fisher Yu · Jiajun Wu · Trevor Darrell -
2020 Workshop: 5th ICML Workshop on Human Interpretability in Machine Learning (WHI) »
Adrian Weller · Alice Xiang · Amit Dhurandhar · Been Kim · Dennis Wei · Kush Varshney · Umang Bhatt -
2020 Poster: Is There a Trade-Off Between Fairness and Accuracy? A Perspective Using Mismatched Hypothesis Testing »
Sanghamitra Dutta · Dennis Wei · Hazar Yueksel · Pin-Yu Chen · Sijia Liu · Kush Varshney -
2020 Poster: Stochastic Flows and Geometric Optimization on the Orthogonal Group »
Krzysztof Choromanski · David Cheikhi · Jared Quincy Davis · Valerii Likhosherstov · Achille Nazaret · Achraf Bahamou · Xingyou Song · Mrugank Akarte · Jack Parker-Holder · Jacob Bergquist · Yuan Gao · Aldo Pacchiano · Tamas Sarlos · Adrian Weller · Vikas Sindhwani -
2020 Poster: Frustratingly Simple Few-Shot Object Detection »
Xin Wang · Thomas Huang · Joseph Gonzalez · Trevor Darrell · Fisher Yu -
2020 Poster: Invariant Risk Minimization Games »
Kartik Ahuja · Karthikeyan Shanmugam · Kush Varshney · Amit Dhurandhar -
2019 Poster: Unifying Orthogonal Monte Carlo Methods »
Krzysztof Choromanski · Mark Rowland · Wenyu Chen · Adrian Weller -
2019 Oral: Unifying Orthogonal Monte Carlo Methods »
Krzysztof Choromanski · Mark Rowland · Wenyu Chen · Adrian Weller -
2019 Poster: TibGM: A Transferable and Information-Based Graphical Model Approach for Reinforcement Learning »
Tameem Adel · Adrian Weller -
2019 Poster: Topological Data Analysis of Decision Boundaries with Application to Model Selection »
Karthikeyan Ramamurthy · Kush Varshney · Krishnan Mody -
2019 Oral: Topological Data Analysis of Decision Boundaries with Application to Model Selection »
Karthikeyan Ramamurthy · Kush Varshney · Krishnan Mody -
2019 Oral: TibGM: A Transferable and Information-Based Graphical Model Approach for Reinforcement Learning »
Tameem Adel · Adrian Weller -
2018 Poster: Blind Justice: Fairness with Encrypted Sensitive Attributes »
Niki Kilbertus · Adria Gascon · Matt Kusner · Michael Veale · Krishna Gummadi · Adrian Weller -
2018 Oral: Blind Justice: Fairness with Encrypted Sensitive Attributes »
Niki Kilbertus · Adria Gascon · Matt Kusner · Michael Veale · Krishna Gummadi · Adrian Weller -
2018 Poster: Bucket Renormalization for Approximate Inference »
Sungsoo Ahn · Michael Chertkov · Adrian Weller · Jinwoo Shin -
2018 Oral: Bucket Renormalization for Approximate Inference »
Sungsoo Ahn · Michael Chertkov · Adrian Weller · Jinwoo Shin -
2018 Poster: Structured Evolution with Compact Architectures for Scalable Policy Optimization »
Krzysztof Choromanski · Mark Rowland · Vikas Sindhwani · Richard E Turner · Adrian Weller -
2018 Poster: Discovering Interpretable Representations for Both Deep Generative and Discriminative Models »
Tameem Adel · Zoubin Ghahramani · Adrian Weller -
2018 Oral: Discovering Interpretable Representations for Both Deep Generative and Discriminative Models »
Tameem Adel · Zoubin Ghahramani · Adrian Weller -
2018 Oral: Structured Evolution with Compact Architectures for Scalable Policy Optimization »
Krzysztof Choromanski · Mark Rowland · Vikas Sindhwani · Richard E Turner · Adrian Weller -
2017 Workshop: Reliable Machine Learning in the Wild »
Dylan Hadfield-Menell · Jacob Steinhardt · Adrian Weller · Smitha Milli -
2017 Workshop: Workshop on Human Interpretability in Machine Learning (WHI) »
Kush Varshney · Adrian Weller · Been Kim · Dmitry Malioutov -
2017 Poster: Lost Relatives of the Gumbel Trick »
Matej Balog · Nilesh Tripuraneni · Zoubin Ghahramani · Adrian Weller -
2017 Talk: Lost Relatives of the Gumbel Trick »
Matej Balog · Nilesh Tripuraneni · Zoubin Ghahramani · Adrian Weller