30 Results

Poster
Tue 7:00 Manifold Identification for Ultimately Communication-Efficient Distributed Optimization
Yu-Sheng Li, Wei-Lin Chiang, Ching-pei Lee
Poster
Tue 7:00 FetchSGD: Communication-Efficient Federated Learning with Sketching
Daniel Rothchild, Ashwinee Panda, Enayat Ullah, Nikita Ivkin, Ion Stoica, Vladimir Braverman, Joseph E Gonzalez, Raman Arora
Poster
Tue 8:00 Distributed Online Optimization over a Heterogeneous Network
Nima Eshraghi, Ben Liang
Poster
Tue 8:00 Is Local SGD Better than Minibatch SGD?
Blake Woodworth, Kumar Kshitij Patel, Sebastian Stich, Zhen Dai, Brian Bullins, Brendan McMahan, Ohad Shamir, Nati Srebro
Poster
Tue 10:00 SCAFFOLD: Stochastic Controlled Averaging for Federated Learning
Praneeth Karimireddy, Satyen Kale, Mehryar Mohri, Sashank Jakkam Reddi, Sebastian Stich, Ananda Theertha Suresh
Poster
Tue 10:00 Fully Parallel Hyperparameter Search: Reshaped Space-Filling
Marie-Liesse Cauwet, Camille Couprie, Julien Dehos, Pauline Luc, Jeremy Rapin, Morgane Riviere, Fabien Teytaud, Olivier Teytaud, Nicolas Usunier
Poster
Tue 10:00 Federated Learning with Only Positive Labels
Felix Xinnan Yu, Ankit Singh Rawat, Aditya Menon, Sanjiv Kumar
Poster
Wed 5:00 Moniqua: Modulo Quantized Communication in Decentralized SGD
Yucheng Lu, Christopher De Sa
Poster
Wed 8:00 The Non-IID Data Quagmire of Decentralized Machine Learning
Kevin Hsieh, Amar Phanishayee, Onur Mutlu, Phil Gibbons
Poster
Wed 8:00 Decoupled Greedy Learning of CNNs
Eugene Belilovsky, Michael Eickenberg, Edouard Oyallon
Poster
Wed 8:00 Communication-Efficient Distributed PCA by Riemannian Optimization
Long-Kai Huang, Sinno Jialin Pan
Poster
Wed 10:00 AdaScale SGD: A User-Friendly Algorithm for Distributed Training
Tyler Johnson, Pulkit Agrawal, Haijie Gu, Carlos Guestrin
Poster
Wed 10:00 Quantized Decentralized Stochastic Learning over Directed Graphs
Hossein Taheri, Aryan Mokhtari, Hamed Hassani, Ramtin Pedarsani
Poster
Wed 11:00 Statistically Preconditioned Accelerated Gradient Method for Distributed Optimization
Hadrien Hendrikx, Lin Xiao, Sebastien Bubeck, Francis Bach, Laurent Massoulié
Poster
Wed 11:00 From Local SGD to Local Fixed-Point Methods for Federated Learning
Grigory Malinovsky, Dmitry Kovalev, Elnur Gasanov, Laurent CONDAT, Peter Richtarik
Poster
Wed 12:00 Acceleration for Compressed Gradient Descent in Distributed and Federated Optimization
Zhize Li, Dmitry Kovalev, Xun Qian, Peter Richtarik
Poster
Wed 13:00 A Unified Theory of Decentralized SGD with Changing Topology and Local Updates
Anastasia Koloskova, Nicolas Loizou, Sadra Boreiri, Martin Jaggi, Sebastian Stich
Poster
Wed 13:00 Estimating the Error of Randomized Newton Methods: A Bootstrap Approach
Miles Lopes, Jessie X.T. Chen
Poster
Wed 15:00 DINO: Distributed Newton-Type Optimization Method
Rixon Crane, Fred Roosta
Poster
Thu 6:00 Linear Convergence of Randomized Primal-Dual Coordinate Method for Large-scale Linear Constrained Convex Programming
Daoli Zhu, Lei Zhao
Poster
Thu 7:00 Simultaneous Inference for Massive Data: Distributed Bootstrap
Yang Yu, Shih-Kang Chao, Guang Cheng
Poster
Thu 8:00 Communication-Efficient Distributed Stochastic AUC Maximization with Deep Neural Networks
Zhishuai Guo, Mingrui Liu, Zhuoning Yuan, Li Shen, Wei Liu, Tianbao Yang
Poster
Thu 8:00 Model Fusion with Kullback--Leibler Divergence
Sebastian Claici, Mikhail Yurochkin, Soumya Ghosh, Justin Solomon
Poster
Thu 8:00 One-shot Distributed Ridge Regression in High Dimensions
Yue Sheng, Edgar Dobriban
Poster
Thu 9:00 Improving the Sample and Communication Complexity for Decentralized Non-Convex Optimization: Joint Gradient Estimation and Tracking
Haoran Sun, Songtao Lu, Mingyi Hong
Poster
Thu 12:00 Composable Sketches for Functions of Frequencies: Beyond the Worst Case
Edith Cohen, Ofir Geri, Rasmus Pagh
Poster
Thu 12:00 Randomized Block-Diagonal Preconditioning for Parallel Learning
Celestine Mendler-D√ľnner, Aurelien Lucchi
Poster
Thu 14:00 Extrapolation for Large-batch Training in Deep Learning
Tao Lin, Lingjing Kong, Sebastian Stich, Martin Jaggi
Poster
Thu 14:00 Parallel Algorithm for Non-Monotone DR-Submodular Maximization
Alina Ene, Huy Nguyen
Poster
Thu 17:00 Projection-free Distributed Online Convex Optimization with $O(\sqrt{T})$ Communication Complexity
Yuanyu Wan, Wei-Wei Tu, Lijun Zhang