Tutorial
Modern Methods in Associative Memory
Dmitry Krotov · Benjamin Hoover · Parikshit Ram
West Ballroom C
Associative Memories like the famous Hopfield Networks are elegant models for describing fully recurrent neural networks whose fundamental job is to store and retrieve information. In the past few years they experienced a surge of interest due to novel theoretical results pertaining to their information storage capabilities, and their relationship with SOTA AI architectures, such as Transformers and Diffusion Models. These connections open up possibilities for interpreting the computation of traditional AI networks through the theoretical lens of Associative Memories. Additionally, novel Lagrangian formulations of these networks make it possible to design powerful distributed models that learn useful representations and inform the design of novel architectures. This tutorial provides an approachable introduction to Associative Memories, emphasizing the modern language and methods used in this area of research, with practical hands-on mathematical derivations and coding notebooks.
Live content is unavailable. Log in and register to view live content
Schedule
Mon 9:30 a.m. - 10:30 a.m.
|
Introduction and AM Theory
(
Tutorial
)
>
|
Dmitry Krotov 🔗 |
Mon 10:30 a.m. - 11:15 a.m.
|
Let’s build your own AM
(
Tutorial
)
>
|
Benjamin Hoover 🔗 |
Mon 11:15 a.m. - 12:00 p.m.
|
AM and broader AI
(
Tutorial
)
>
|
Parikshit Ram 🔗 |