Workshop
Joint Workshop on On-Device Machine Learning & Compact Deep Neural Network Representations (ODML-CDNNR)
Sujith Ravi · Zornitsa Kozareva · Lixin Fan · Max Welling · Yurong Chen · Werner Bailer · Brian Kulis · Haoji Hu · Jonathan Dekhtiar · Yingyan Lin · Diana Marculescu

Fri Jun 14th 08:30 AM -- 06:00 PM @ 203
Event URL: https://sites.google.com/corp/view/icml2019-on-device-compact-dnn »

This joint workshop aims to bring together researchers, educators, practitioners who are interested in techniques as well as applications of on-device machine learning and compact, efficient neural network representations. One aim of the workshop discussion is to establish close connection between researchers in the machine learning community and engineers in industry, and to benefit both academic researchers as well as industrial practitioners. The other aim is the evaluation and comparability of resource-efficient machine learning methods and compact and efficient network representations, and their relation to particular target platforms (some of which may be highly optimized for neural network inference). The research community has still to develop established evaluation procedures and metrics.

The workshop also aims at reproducibility and comparability of methods for compact and efficient neural network representations, and on-device machine learning. Contributors are thus encouraged to make their code available. The workshop organizers plan to make some example tasks and datasets available, and invite contributors to use them for testing their work. In order to provide comparable performance evaluation conditions, the use of a common platform (such as Google Colab) is intended.

08:30 AM Welcome and Introduction (Talk)
08:40 AM Hardware Efficiency Aware Neural Architecture Search and Compression (Invited talk) Song Han
09:10 AM Structured matrices for efficient deep learning (Invited talk) Sanjiv Kumar
09:40 AM DeepCABAC: Context-adaptive binary arithmetic coding for deep neural network compression (Talk) Simon Wiedemann
10:00 AM Poster spotlight presentations (Talk)
10:30 AM Coffee Break AM (Break)
11:00 AM Understanding the Challenges of Algorithm and Hardware Co-design for Deep Neural Networks (Invited talk) Vivienne Sze
11:30 AM Dream Distillation: A Data-Independent Model Compression Framework (Talk) Kartikeya Bhardwaj
11:50 AM The State of Sparsity in Deep Neural Networks (Talk) Trevor Gale
12:10 PM Lunch break (Break)
12:40 PM Poster session (Posters) Cong Hao, Zhongqiu Lin, Chengcheng Li, Lars Ruthotto, Bin Yang, Deepthi Karkada
02:00 PM DNN Training and Inference with Hyper-Scaled Precision (Invited talk) Kailash Gopalakrishnan
02:30 PM Mixed Precision Training & Inference (Invited talk) Jonathan Dekhtiar
03:00 PM Coffee Break PM (Break)
03:30 PM Learning Compact Neural Networks Using Ordinary Differential Equations as Activation Functions (Talk)
03:50 PM Triplet Distillation for Deep Face Recognition (Talk)
04:10 PM Single-Path NAS: Device-Aware Efficient ConvNet Design (Talk) Dimitrios Stamoulis
04:30 PM Panel discussion (Discussion)
05:30 PM Wrap-up and Closing (Talk)

Author Information

Sujith Ravi (Google Research)
Zornitsa Kozareva (Google)
Lixin Fan (JD.com)
Max Welling (University of Amsterdam & Qualcomm)
Yurong Chen (Intel)
Werner Bailer (JOANNEUM RESEARCH)
Brian Kulis (Boston University)
Haoji Hu (Zhejiang University)
Jonathan Dekhtiar (NVIDIA)
Yingyan Lin (Rice University)
Diana Marculescu (Carnegie Mellon University)

More from the Same Authors