Timezone: »
Recent years have witnessed the rising need for learning agents that can interact with humans. Such agents usually involve applications in computer vision, natural language processing, human computer interaction, and robotics. Creating and running such agents call for interdisciplinary research of artificial intelligence, machine learning, and software engineering design, which we abstract as Human in the Loop Learning (HILL). HILL is a modern machine learning paradigm of significant practical and theoretical interest. For HILL, models and humans engage in a two-way dialog to facilitate more accurate and interpretable learning. The workshop aims to bring together researchers and practitioners working on the broad areas of human in the loop learning, ranging from the interactive/active learning algorithm designs for real-world decision making systems (e.g., autonomous driving vehicles, robotic systems, etc.), models with strong explainability, as well as interactive system designs (e.g., data visualization, annotation systems, etc.). In particular, we aim to elicit new connections among these diverse fields, identifying theory, tools and design principles tailored to practical machine learning workflows. The target audience for the workshop includes people who are interested in using machines to solve problems by having a human be an integral part of the learning process. In this year’s HILL workshop, we emphasize on the interactive/active learning algorithms for real-world decision making systems as well as learning algorithms with strong explainability. We continue the previous effort to provide a platform for researchers to discuss approaches that bridge the gap between humans and machines and get the best of both worlds. We believe the theme of the workshop will be interesting to ICML attendees, especially those who are interested in interdisciplinary study.
Sat 11:00 a.m. - 11:30 a.m.
|
Opening Remarks
(
Talk
)
|
Shanghang Zhang 🔗 |
Sat 11:30 a.m. - 12:00 p.m.
|
Invited Talk 1: Prof. Zeynep Akata from University of Tübingen
(
Talk
)
Pre-recorded talk video is available at: https://slideslive.com/38930827/invited-talk-1 |
🔗 |
Sat 12:00 p.m. - 12:10 p.m.
|
Invited Talk 1-QA
(
Discussion Panel
)
|
🔗 |
Sat 12:10 p.m. - 12:40 p.m.
|
Invited Talk 2: Prof. Tom Griffiths from Princeton University
(
Talk
)
SlidesLive Video » Pre-recorded talk video is available at: https://slideslive.com/38930828/predicting-and-understanding-human-decisions |
Thomas Griffiths 🔗 |
Sat 12:40 p.m. - 12:50 p.m.
|
Invited Talk 2-QA
(
Discussion Panel
)
|
🔗 |
Sat 12:50 p.m. - 1:20 p.m.
|
Invited Talk 3: Prof. Christian Lebiere from Carnegie Mellon University
(
Talk
)
|
Christian Lebiere 🔗 |
Sat 1:20 p.m. - 1:30 p.m.
|
Invited Talk 3-QA
(
Discussion Panel
)
|
🔗 |
Sat 1:30 p.m. - 2:10 p.m.
|
Poster Session 1 with Zoom meeting links for the accepted papers
(
Poster Session
)
Zoom meeting links for the poster sessions can be found in the shared Google Doc: https://docs.google.com/spreadsheets/d/1gegBSjv8Sf766Mzh01yczfjf4ExUl4-4X8wUa4mlGxQ/edit?usp=sharing or https://nqfnr2ysmo.feishu.cn/sheets/shtcnXo7d0lGb2NCYBENdzsN8gg (Same content with the google doc) If there are Zoom meetings you cannot access, please comment on the google doc beside these meetings' links |
🔗 |
Sat 2:10 p.m. - 2:40 p.m.
|
Invited Talk 4: Prof. Richard Zemel from University of Toronto
(
Talk
)
SlidesLive Video » Pre-recorded talk video is available at: https://slideslive.com/38930830/wandering-within-a-world-online-contextualized-fewshot-learning |
Richard Zemel 🔗 |
Sat 2:40 p.m. - 2:50 p.m.
|
Invited Talk 4-QA
(
Discussion Panel
)
|
🔗 |
Sat 2:50 p.m. - 3:20 p.m.
|
Invited Talk 5: Prof. Pradeep Ravikumar from Carnegie Mellon University
(
Talk
)
SlidesLive Video » Pre-recorded talk video is available at: https://slideslive.com/38930831/explainable-artificial-intelligence-via-representer-points-infidelities |
🔗 |
Sat 3:20 p.m. - 3:30 p.m.
|
Invited Talk 5-QA
(
Discussion Panel
)
|
🔗 |
Sat 3:30 p.m. - 4:00 p.m.
|
Invited Talk 6: Prof. Raquel Urtasun from University of Toronto
(
Talk
)
SlidesLive Video » Pre-recorded talk video is available at: https://slideslive.com/38930832/human-in-the-loop-for-selfdriving |
🔗 |
Sat 4:00 p.m. - 4:10 p.m.
|
Invited Talk 6-QA
(
Discussion Panel
)
|
🔗 |
Sat 4:10 p.m. - 4:40 p.m.
|
Invited Talk: Dr. Kalesha Bullard from Facebook AI Research
(
Talk
)
Pre-recorded talk video is available at: https://slideslive.com/38930935/invited-talkkalesha |
Kalesha Bullard 🔗 |
Sat 4:40 p.m. - 4:50 p.m.
|
Invited Talk-Kalesha-QA
(
Discussion Panel
)
|
🔗 |
Sat 4:50 p.m. - 5:20 p.m.
|
Invited Talk 7: Prof. Anca Dragan from UC Berkeley
(
Talk
)
SlidesLive Video » Pre-recorded talk video is available at: https://slideslive.com/38930833/humans-in-the-reward-loop |
Anca Dragan 🔗 |
Sat 5:20 p.m. - 5:30 p.m.
|
Invited Talk 7-QA
(
Discussion Panel
)
|
🔗 |
Sat 5:30 p.m. - 6:10 p.m.
|
Poster Session 2 with Zoom meeting links for the accepted papers
(
Poster session
)
Zoom meeting links for the poster sessions can be found in the shared Google Doc: https://docs.google.com/spreadsheets/d/1gegBSjv8Sf766Mzh01yczfjf4ExUl4-4X8wUa4mlGxQ/edit?usp=sharing or https://nqfnr2ysmo.feishu.cn/sheets/shtcnXo7d0lGb2NCYBENdzsN8gg (Same content with the google doc) If there are Zoom meetings you cannot access, please comment on the google doc beside these meetings' links |
🔗 |
Sat 6:10 p.m. - 6:40 p.m.
|
Invited Talk 9: Prof. Sergey Levine from UC Berkeley
(
Talk
)
SlidesLive Video » Pre-recorded talk video is available at: https://slideslive.com/38930835/how-should-we-train-our-robots |
Sergey Levine 🔗 |
Sat 6:40 p.m. - 6:50 p.m.
|
Invited Talk 9-QA
(
Discussion Panel
)
|
🔗 |
Sat 6:50 p.m. - 7:20 p.m.
|
Invited Talk 10: Prof. Wenwu Zhu from Tsinghua University
(
Talk
)
SlidesLive Video » Pre-recorded talk video is available at: https://slideslive.com/38930836/heterogenous-network-representation-across-cyberphysicalhuman-domains |
Wenwu Zhu 🔗 |
Sat 7:20 p.m. - 7:30 p.m.
|
Invited Talk 10-QA
(
Discussion Panel
)
|
🔗 |
Sat 7:30 p.m. - 8:10 p.m.
|
Invited Talk 11: Prof. Chelsea Finn from Stanford University
(
Talk
)
|
Chelsea Finn 🔗 |
Sat 8:10 p.m. - 8:40 p.m.
|
Poster Session 3 with Zoom meeting links for the accepted papers
(
Poster Session
)
Zoom meeting links for the poster sessions can be found in the shared Google Doc: https://docs.google.com/spreadsheets/d/1gegBSjv8Sf766Mzh01yczfjf4ExUl4-4X8wUa4mlGxQ/edit?usp=sharing or https://nqfnr2ysmo.feishu.cn/sheets/shtcnXo7d0lGb2NCYBENdzsN8gg (Same content with the google doc) If there are Zoom meetings you cannot access, please comment on the google doc beside these meetings' links |
🔗 |
Sat 8:40 p.m. - 9:00 p.m.
|
Closing Remarks
(
Discussion Panel
)
|
Shanghang Zhang · Fisher Yu 🔗 |
Author Information
Shanghang Zhang (UC Berkeley)
Xin Wang (UC Berkeley)
Fisher Yu (University of California, Berkeley)
Jiajun Wu (Stanford University)
Jiajun Wu is a Visiting Faculty Researcher at Google Research, New York City. In July 2020, he will join Stanford University as an Assistant Professor of Computer Science. He studies machine perception, reasoning, and its interaction with the physical world, drawing inspiration from human cognition.
Trevor Darrell (University of California at Berkeley)
More from the Same Authors
-
2021 : Explaining Reinforcement Learning Policies through Counterfactual Trajectories »
Julius Frost · Olivia Watkins · Eric Weiner · Pieter Abbeel · Trevor Darrell · Bryan Plummer · Kate Saenko -
2023 : LLM-grounded Text-to-Image Diffusion Models »
Long (Tony) Lian · Boyi Li · Adam Yala · Trevor Darrell -
2023 : Panel on Reasoning Capabilities of LLMs »
Guy Van den Broeck · Ishita Dasgupta · Subbarao Kambhampati · Jiajun Wu · Xi Victoria Lin · Samy Bengio · Beliz Gunel -
2023 : Concept Learning Across Domains and Modalities »
Jiajun Wu -
2023 Poster: Modeling Dynamic Environments with Scene Graph Memory »
Andrey Kurenkov · Michael Lingelbach · Tanmay Agarwal · Emily Jin · Chengshu Li · Ruohan Zhang · Li Fei-Fei · Jiajun Wu · Silvio Savarese · Roberto Martín-Martín -
2023 Poster: Motion Question Answering via Modular Motion Programs »
Mark Endo · Joy Hsu · Jiaman Li · Jiajun Wu -
2022 : Back to the Source: Test-Time Diffusion-Driven Adaptation »
Jin Gao · Jialing Zhang · Xihui Liu · Trevor Darrell · Evan Shelhamer · Dequan Wang -
2022 Poster: Visual Attention Emerges from Recurrent Sparse Reconstruction »
Baifeng Shi · Yale Song · Neel Joshi · Trevor Darrell · Xin Wang -
2022 Spotlight: Visual Attention Emerges from Recurrent Sparse Reconstruction »
Baifeng Shi · Yale Song · Neel Joshi · Trevor Darrell · Xin Wang -
2022 Poster: Zero-Shot Reward Specification via Grounded Natural Language »
Parsa Mahmoudieh · Deepak Pathak · Trevor Darrell -
2022 Spotlight: Zero-Shot Reward Specification via Grounded Natural Language »
Parsa Mahmoudieh · Deepak Pathak · Trevor Darrell -
2022 Poster: DNA: Domain Generalization with Diversified Neural Averaging »
Xu Chu · Yujie Jin · Wenwu Zhu · Yasha Wang · Xin Wang · Shanghang Zhang · Hong Mei -
2022 Spotlight: DNA: Domain Generalization with Diversified Neural Averaging »
Xu Chu · Yujie Jin · Wenwu Zhu · Yasha Wang · Xin Wang · Shanghang Zhang · Hong Mei -
2021 Workshop: ICML Workshop on Human in the Loop Learning (HILL) »
Trevor Darrell · Xin Wang · Li Erran Li · Fisher Yu · Zeynep Akata · Wenwu Zhu · Pradeep Ravikumar · Shiji Zhou · Shanghang Zhang · Kalesha Bullard -
2021 Poster: Compositional Video Synthesis with Action Graphs »
Amir Bar · Roi Herzig · Xiaolong Wang · Anna Rohrbach · Gal Chechik · Trevor Darrell · Amir Globerson -
2021 Spotlight: Compositional Video Synthesis with Action Graphs »
Amir Bar · Roi Herzig · Xiaolong Wang · Anna Rohrbach · Gal Chechik · Trevor Darrell · Amir Globerson -
2020 : Closing Remarks »
Shanghang Zhang · Fisher Yu -
2020 : Opening Remarks »
Shanghang Zhang -
2020 Poster: Video Prediction via Example Guidance »
Jingwei Xu · Harry (Huazhe) Xu · Bingbing Ni · Xiaokang Yang · Trevor Darrell -
2020 Poster: Visual Grounding of Learned Physical Models »
Yunzhu Li · Toru Lin · Kexin Yi · Daniel Bear · Daniel Yamins · Jiajun Wu · Josh Tenenbaum · Antonio Torralba -
2020 Poster: Frustratingly Simple Few-Shot Object Detection »
Xin Wang · Thomas Huang · Joseph E Gonzalez · Trevor Darrell · Fisher Yu -
2019 : Fisher Yu: "Motion and Prediction for Autonomous Driving" »
Fisher Yu · Trevor Darrell -
2019 Workshop: Human In the Loop Learning (HILL) »
Xin Wang · Xin Wang · Fisher Yu · Shanghang Zhang · Joseph Gonzalez · Yangqing Jia · Sarah Bird · Kush Varshney · Been Kim · Adrian Weller -
2019 Poster: Neurally-Guided Structure Inference »
Sidi Lu · Jiayuan Mao · Josh Tenenbaum · Jiajun Wu -
2019 Oral: Neurally-Guided Structure Inference »
Sidi Lu · Jiayuan Mao · Josh Tenenbaum · Jiajun Wu -
2018 Poster: CyCADA: Cycle-Consistent Adversarial Domain Adaptation »
Judy Hoffman · Eric Tzeng · Taesung Park · Jun-Yan Zhu · Philip Isola · Kate Saenko · Alexei Efros · Trevor Darrell -
2018 Oral: CyCADA: Cycle-Consistent Adversarial Domain Adaptation »
Judy Hoffman · Eric Tzeng · Taesung Park · Jun-Yan Zhu · Philip Isola · Kate Saenko · Alexei Efros · Trevor Darrell -
2017 Poster: Curiosity-driven Exploration by Self-supervised Prediction »
Deepak Pathak · Pulkit Agrawal · Alexei Efros · Trevor Darrell -
2017 Talk: Curiosity-driven Exploration by Self-supervised Prediction »
Deepak Pathak · Pulkit Agrawal · Alexei Efros · Trevor Darrell