Skip to yearly menu bar Skip to main content


(8 events)   Timezone:  
Show all
The 2021 schedule is still incomplete
Toggle Poster Visibility
Oral
Wed Jul 21 05:00 PM -- 05:20 PM (PDT)
Understanding self-supervised learning dynamics without contrastive pairs
In Deep Learning Optimization
Yuandong Tian · Xinlei Chen · Surya Ganguli
[ Paper ]
Spotlight
Wed Jul 21 05:20 PM -- 05:25 PM (PDT)
Learning by Turning: Neural Architecture Aware Optimisation
In Deep Learning Optimization
Yang Liu · Jeremy Bernstein · Markus Meister · Yisong Yue
[ Paper ]
Spotlight
Wed Jul 21 05:25 PM -- 05:30 PM (PDT)
Consensus Control for Decentralized Deep Learning
In Deep Learning Optimization
Lingjing Kong · Tao Lin · Anastasiia Koloskova · Martin Jaggi · Sebastian Stich
[ Paper ]
Spotlight
Wed Jul 21 05:30 PM -- 05:35 PM (PDT)
Selfish Sparse RNN Training
In Deep Learning Optimization
Shiwei Liu · Decebal Mocanu · Yulong Pei · Mykola Pechenizkiy
[ Paper ]
Spotlight
Wed Jul 21 05:35 PM -- 05:40 PM (PDT)
Catastrophic Fisher Explosion: Early Phase Fisher Matrix Impacts Generalization
In Deep Learning Optimization
Stanislaw Jastrzebski · Devansh Arpit · Oliver Astrand · Giancarlo Kerg · Huan Wang · Caiming Xiong · Richard Socher · Kyunghyun Cho · Krzysztof J Geras
[ Paper ]
Spotlight
Wed Jul 21 05:40 PM -- 05:45 PM (PDT)
Quasi-global Momentum: Accelerating Decentralized Deep Learning on Heterogeneous Data
In Deep Learning Optimization
Tao Lin · Sai Praneeth Reddy Karimireddy · Sebastian Stich · Martin Jaggi
[ Paper ]
Spotlight
Wed Jul 21 05:45 PM -- 05:50 PM (PDT)
Understanding the Dynamics of Gradient Flow in Overparameterized Linear models
In Deep Learning Optimization
Salma Tarmoun · Guilherme Franca · Benjamin Haeffele · Rene Vidal
[ Paper ]
Q&A
Wed Jul 21 05:50 PM -- 05:55 PM (PDT)
Q&A
In Deep Learning Optimization