Skip to yearly menu bar Skip to main content


(8 events)   Timezone:  
Show all
The 2021 schedule is still incomplete
Toggle Poster Visibility
Oral
Thu Jul 22 09:00 AM -- 09:20 AM (KST)
Understanding self-supervised learning dynamics without contrastive pairs
In Deep Learning Optimization
Yuandong Tian · Xinlei Chen · Surya Ganguli
[ Paper ]
Spotlight
Thu Jul 22 09:20 AM -- 09:25 AM (KST)
Learning by Turning: Neural Architecture Aware Optimisation
In Deep Learning Optimization
Yang Liu · Jeremy Bernstein · Markus Meister · Yisong Yue
[ Paper ]
Spotlight
Thu Jul 22 09:25 AM -- 09:30 AM (KST)
Consensus Control for Decentralized Deep Learning
In Deep Learning Optimization
Lingjing Kong · Tao Lin · Anastasiia Koloskova · Martin Jaggi · Sebastian Stich
[ Paper ]
Spotlight
Thu Jul 22 09:30 AM -- 09:35 AM (KST)
Selfish Sparse RNN Training
In Deep Learning Optimization
Shiwei Liu · Decebal Mocanu · Yulong Pei · Mykola Pechenizkiy
[ Paper ]
Spotlight
Thu Jul 22 09:35 AM -- 09:40 AM (KST)
Catastrophic Fisher Explosion: Early Phase Fisher Matrix Impacts Generalization
In Deep Learning Optimization
Stanislaw Jastrzebski · Devansh Arpit · Oliver Astrand · Giancarlo Kerg · Huan Wang · Caiming Xiong · Richard Socher · Kyunghyun Cho · Krzysztof J Geras
[ Paper ]
Spotlight
Thu Jul 22 09:40 AM -- 09:45 AM (KST)
Quasi-global Momentum: Accelerating Decentralized Deep Learning on Heterogeneous Data
In Deep Learning Optimization
Tao Lin · Sai Praneeth Reddy Karimireddy · Sebastian Stich · Martin Jaggi
[ Paper ]
Spotlight
Thu Jul 22 09:45 AM -- 09:50 AM (KST)
Understanding the Dynamics of Gradient Flow in Overparameterized Linear models
In Deep Learning Optimization
Salma Tarmoun · Guilherme Franca · Benjamin Haeffele · Rene Vidal
[ Paper ]
Q&A
Thu Jul 22 09:50 AM -- 09:55 AM (KST)
Q&A
In Deep Learning Optimization