Timezone: »
Poster
Delay-agnostic Asynchronous Coordinate Update Algorithm
Xuyang Wu · Changxin Liu · Sindri Magnússon · Mikael Johansson
We propose a delay-agnostic asynchronous coordinate update algorithm (DEGAS) for computing operator fixed points, with applications to asynchronous optimization. DEGAS includes novel asynchronous variants of ADMM and block-coordinate descent as special cases. We prove that DEGAS converges with both bounded and unbounded delays under delay-free parameter conditions. We also validate by theory and experiments that DEGAS adapts well to the actual delays. The effectiveness of DEGAS is demonstrated by numerical experiments on classification problems.
Author Information
Xuyang Wu (KTH Royal Institute of Technology)
Changxin Liu (KTH Royal Institute of Technology)
Sindri Magnússon (Stockholm University)
Mikael Johansson (KTH Royal Institute of Technology)
More from the Same Authors
-
2023 Poster: Generalized Polyak Step Size for First Order Optimization with Momentum »
Xiaoyu Wang · Mikael Johansson · Tong Zhang -
2022 Poster: Delay-Adaptive Step-sizes for Asynchronous Learning »
Xuyang Wu · Sindri Magnússon · Hamid Reza Feyzmahdavian · Mikael Johansson -
2022 Spotlight: Delay-Adaptive Step-sizes for Asynchronous Learning »
Xuyang Wu · Sindri Magnússon · Hamid Reza Feyzmahdavian · Mikael Johansson -
2021 Poster: Stability and Convergence of Stochastic Gradient Clipping: Beyond Lipschitz Continuity and Smoothness »
Vien Mai · Mikael Johansson -
2021 Oral: Stability and Convergence of Stochastic Gradient Clipping: Beyond Lipschitz Continuity and Smoothness »
Vien Mai · Mikael Johansson -
2020 Poster: Anderson Acceleration of Proximal Gradient Methods »
Vien Mai · Mikael Johansson -
2020 Poster: Convergence of a Stochastic Gradient Method with Momentum for Non-Smooth Non-Convex Optimization »
Vien Mai · Mikael Johansson -
2019 Poster: Curvature-Exploiting Acceleration of Elastic Net Computations »
Vien Mai · Mikael Johansson -
2019 Oral: Curvature-Exploiting Acceleration of Elastic Net Computations »
Vien Mai · Mikael Johansson