Timezone: »
We study the emergence of chaotic behavior of Follow-the-Regularized Leader (FoReL) dynamics in games. We focus on the effects of increasing the population size or the scale of costs in congestion games, and generalize recent results on unstable, chaotic behaviors in the Multiplicative Weights Update dynamics to a much larger class of FoReL dynamics. We establish that, even in simple linear non-atomic congestion games with two parallel links and \emph{any} fixed learning rate, unless the game is fully symmetric, increasing the population size or the scale of costs causes learning dynamics to becomes unstable and eventually chaotic, in the sense of Li-Yorke and positive topological entropy. Furthermore, we prove the existence of novel non-standard phenomena such as the coexistence of stable Nash equilibria and chaos in the same game. We also observe the simultaneous creation of a chaotic attractor as another chaotic attractor gets destroyed. Lastly, although FoReL dynamics can be strange and non-equilibrating, we prove that the time average still converges to an \emph{exact} equilibrium for any choice of learning rate and any scale of costs.
Author Information
Jakub Bielawski (Cracow University of Economics)
Thiparat Chotibut (Chulalongkorn university)
Fryderyk Falniowski (Cracow University of Economics)
Grzegorz Kosiorowski (Cracow University of Economics)
Michał Misiurewicz (Indiana University-Purdue University Indianapolis)
Georgios Piliouras (Singapore University of Technology and Design)
Related Events (a corresponding poster, oral, or spotlight)
-
2021 Spotlight: Follow-the-Regularized-Leader Routes to Chaos in Routing Games »
Wed. Jul 21st 02:20 -- 02:25 PM Room
More from the Same Authors
-
2021 : Global Convergence of Multi-Agent Policy Gradient in Markov Potential Games »
Stefanos Leonardos · Will Overman · Ioannis Panageas · Georgios Piliouras -
2022 Poster: AdaGrad Avoids Saddle Points »
Kimon Antonakopoulos · Panayotis Mertikopoulos · Georgios Piliouras · Xiao Wang -
2022 Spotlight: AdaGrad Avoids Saddle Points »
Kimon Antonakopoulos · Panayotis Mertikopoulos · Georgios Piliouras · Xiao Wang -
2021 Poster: Efficient Online Learning for Dynamic k-Clustering »
Dimitris Fotakis · Georgios Piliouras · Stratis Skoulakis -
2021 Spotlight: Efficient Online Learning for Dynamic k-Clustering »
Dimitris Fotakis · Georgios Piliouras · Stratis Skoulakis -
2021 Poster: Online Optimization in Games via Control Theory: Connecting Regret, Passivity and Poincaré Recurrence »
Yun Kuen Cheung · Georgios Piliouras -
2021 Spotlight: Online Optimization in Games via Control Theory: Connecting Regret, Passivity and Poincaré Recurrence »
Yun Kuen Cheung · Georgios Piliouras -
2021 Poster: From Poincaré Recurrence to Convergence in Imperfect Information Games: Finding Equilibrium via Regularization »
Julien Perolat · Remi Munos · Jean-Baptiste Lespiau · Shayegan Omidshafiei · Mark Rowland · Pedro Ortega · Neil Burch · Thomas Anthony · David Balduzzi · Bart De Vylder · Georgios Piliouras · Marc Lanctot · Karl Tuyls -
2021 Spotlight: From Poincaré Recurrence to Convergence in Imperfect Information Games: Finding Equilibrium via Regularization »
Julien Perolat · Remi Munos · Jean-Baptiste Lespiau · Shayegan Omidshafiei · Mark Rowland · Pedro Ortega · Neil Burch · Thomas Anthony · David Balduzzi · Bart De Vylder · Georgios Piliouras · Marc Lanctot · Karl Tuyls -
2020 Poster: From Chaos to Order: Symmetry and Conservation Laws in Game Dynamics »
Sai Ganesh Nagarajan · David Balduzzi · Georgios Piliouras -
2019 Poster: Multiplicative Weights Updates as a distributed constrained optimization algorithm: Convergence to second-order stationary points almost always »
Ioannis Panageas · Georgios Piliouras · xiao wang -
2019 Oral: Multiplicative Weights Updates as a distributed constrained optimization algorithm: Convergence to second-order stationary points almost always »
Ioannis Panageas · Georgios Piliouras · xiao wang