Skip to yearly menu bar Skip to main content


(8 events)   Time zone: Conference local time zone  
Show all
The 2021 schedule is still incomplete
Toggle Poster Visibility
Oral
Thu Jul 22 02:00 AM -- 02:20 AM (CEST)
Understanding self-supervised learning dynamics without contrastive pairs
In Deep Learning Optimization
Yuandong Tian · Xinlei Chen · Surya Ganguli
[ Paper ]
Spotlight
Thu Jul 22 02:20 AM -- 02:25 AM (CEST)
Learning by Turning: Neural Architecture Aware Optimisation
In Deep Learning Optimization
Yang Liu · Jeremy Bernstein · Markus Meister · Yisong Yue
[ Paper ]
Spotlight
Thu Jul 22 02:25 AM -- 02:30 AM (CEST)
Consensus Control for Decentralized Deep Learning
In Deep Learning Optimization
Lingjing Kong · Tao Lin · Anastasiia Koloskova · Martin Jaggi · Sebastian Stich
[ Paper ]
Spotlight
Thu Jul 22 02:30 AM -- 02:35 AM (CEST)
Selfish Sparse RNN Training
In Deep Learning Optimization
Shiwei Liu · Decebal Mocanu · Yulong Pei · Mykola Pechenizkiy
[ Paper ]
Spotlight
Thu Jul 22 02:35 AM -- 02:40 AM (CEST)
Catastrophic Fisher Explosion: Early Phase Fisher Matrix Impacts Generalization
In Deep Learning Optimization
Stanislaw Jastrzebski · Devansh Arpit · Oliver Astrand · Giancarlo Kerg · Huan Wang · Caiming Xiong · Richard Socher · Kyunghyun Cho · Krzysztof J Geras
[ Paper ]
Spotlight
Thu Jul 22 02:40 AM -- 02:45 AM (CEST)
Quasi-global Momentum: Accelerating Decentralized Deep Learning on Heterogeneous Data
In Deep Learning Optimization
Tao Lin · Sai Praneeth Reddy Karimireddy · Sebastian Stich · Martin Jaggi
[ Paper ]
Spotlight
Thu Jul 22 02:45 AM -- 02:50 AM (CEST)
Understanding the Dynamics of Gradient Flow in Overparameterized Linear models
In Deep Learning Optimization
Salma Tarmoun · Guilherme Franca · Benjamin Haeffele · Rene Vidal
[ Paper ]
Q&A
Thu Jul 22 02:50 AM -- 02:55 AM (CEST)
Q&A
In Deep Learning Optimization