Tutorials

A collection of computational notebooks and tutorials

Dense Storage in binary networks. A whirlwind tour of the Classical Hopfield Network to Dense Associative Memory.
Energy Transformer. Rederiving the Transformer as a pure associative memory
Diffusion as Memory. Diffusion models try to learn implicitly the energy of data explicitly modeled by AMs.
Distributed memory. A way to encode dense storage capacity in constant parameters.

Note

These tutorials are under construction until July 14, 2025, when this tutorial will be presented at ICML 2025.

Other Formats