Workshop
Challenges in Deploying and monitoring Machine Learning Systems
Alessandra Tosi · Nathan Korda · Michael A Osborne · Stephen Roberts · Andrei Paleyes · Fariba Yousefi
Fri 23 Jul, 2 a.m. PDT
Until recently, many industrial Machine Learning applications have been the remit of consulting academics, data scientists within larger companies, and a number of dedicated Machine Learning research labs within a few of the world’s most innovative tech companies. Over the last few years we have seen the dramatic rise of companies dedicated to providing Machine Learning software-as-a-service tools, with the aim of democratizing access to the benefits of Machine Learning. All these efforts have revealed major hurdles to ensuring the continual delivery of good performance from deployed Machine Learning systems. These hurdles range from challenges in MLOps, to fundamental problems with deploying certain algorithms, to solving the legal issues surrounding the ethics involved in letting algorithms make decisions for your business.
This workshop will invite papers related to the challenges in deploying and monitoring ML systems. It will encourage submission on subjects related to: MLOps for deployed ML systems; the ethics around deploying ML systems; useful tools and programming languages for deploying ML systems; specific challenges relating to deploying reinforcement learning in ML systems and performing continual learning and providing continual delivery in ML systems;
and finally data challenges for deployed ML systems.
We will also invite the submission of open problems and encourage the discussion (through two live panels) on topics related to the areas of: "Deploying machine learning applications in the legal system" and "Deploying machine learning on devices or constrained hardware".
These subjects represent a wealth of topical and high-impact issues for the community to work on.
Schedule
Fri 2:00 a.m. - 2:10 a.m.
|
Opening remarks
(
Introduction
)
>
SlidesLive Video |
Alessandra Tosi · Nathan Korda · Fariba Yousefi · Andrei Paleyes · Stephen Roberts 🔗 |
Fri 2:10 a.m. - 2:50 a.m.
|
Deploying end-to-end machine learning systems for social impact
(
Invited Talk
)
>
SlidesLive Video |
Engineer Bainomugisha 🔗 |
Fri 2:50 a.m. - 3:30 a.m.
|
Machine Learning and Legal Decisions
(
Invited Talk
)
>
SlidesLive Video |
John Armour 🔗 |
Fri 3:30 a.m. - 4:30 a.m.
|
Applications in the legal system
(
Panel Discussion
)
>
SlidesLive Video |
Jessica Montgomery · Charles Brecque · Teresa Scantamburlo 🔗 |
Fri 4:30 a.m. - 4:40 a.m.
|
Short Break
|
🔗 |
Fri 4:40 a.m. - 5:30 a.m.
|
Machine Learning for Chip Design
(
Invited Talk
)
>
SlidesLive Video |
Roberto Bondesan 🔗 |
Fri 5:30 a.m. - 6:15 a.m.
|
Machine Learning and Legal Decisions
(
Invited Talk
)
>
SlidesLive Video |
Richard Susskind 🔗 |
Fri 6:15 a.m. - 6:30 a.m.
|
Short Break
|
🔗 |
Fri 6:30 a.m. - 6:39 a.m.
|
Who is Responsible for Adversarial Defense?
(
Contributed Talk
)
>
SlidesLive Video |
Kishor Datta Gupta 🔗 |
Fri 6:39 a.m. - 6:50 a.m.
|
Towards Efficient Machine Unlearning via Incremental View Maintenance
(
Contributed Talk
)
>
SlidesLive Video |
Sebastian Schelter 🔗 |
Fri 6:50 a.m. - 7:00 a.m.
|
DuckDQ: Data Quality Assertions for Machine Learning Pipelines
(
Contributed Talk
)
>
SlidesLive Video |
Till Döhmen 🔗 |
Fri 7:00 a.m. - 7:10 a.m.
|
MLDemon: Deployment Monitoring for Machine Learning Systems
(
Contributed Talk
)
>
SlidesLive Video |
Tony Ginart 🔗 |
Fri 7:10 a.m. - 7:20 a.m.
|
Have the Cake and Eat It Too? Higher Accuracy and Less Expense when Using Multi-label ML APIs Online
(
Contributed Talk
)
>
SlidesLive Video |
Lingjiao Chen 🔗 |
Fri 7:20 a.m. - 7:30 a.m.
|
Competition over data: when does data purchase benefit users?
(
Contributed Talk
)
>
SlidesLive Video |
Yongchan Kwon 🔗 |
Fri 7:30 a.m. - 8:00 a.m.
|
Poster Session ( Poster Session ) > link | Kishor Datta Gupta · Sebastian Schelter · Till Döhmen · Tony Ginart · Lingjiao Chen · Yongchan Kwon 🔗 |
Fri 8:00 a.m. - 9:00 a.m.
|
Deployment and monitoring on constrained hardware and devices
(
Panel Discussion
)
>
SlidesLive Video |
Cecilia Mascolo · Maria Nyamukuru · Ivan Kiskin · Partha Maji · Yunpeng Li · Stephen Roberts 🔗 |
Fri 9:00 a.m. - 9:10 a.m.
|
Short Break
|
🔗 |
Fri 9:10 a.m. - 9:50 a.m.
|
Ethics of developing ML in healthcare
(
Invited Talk
)
>
SlidesLive Video |
Shalmali Joshi 🔗 |
Fri 9:50 a.m. - 10:30 a.m.
|
Model-less Inference Serving for ease-to-use and cost-efficiency
(
Invited Talk
)
>
SlidesLive Video |
Neeraja J Yadwadkar 🔗 |
Fri 10:30 a.m. - 11:30 a.m.
|
Invited Speakers' Panel
(
Panel Discussion
)
>
SlidesLive Video |
Neeraja J Yadwadkar · Shalmali Joshi · Roberto Bondesan · Engineer Bainomugisha · Stephen Roberts 🔗 |