Search Results for author: Hamza Tahir Chaudhry

Found 2 papers, 1 papers with code

Infinite Limits of Multi-head Transformer Dynamics

no code implementations24 May 2024 Blake Bordelon, Hamza Tahir Chaudhry, Cengiz Pehlevan

In this work, we analyze various scaling limits of the training dynamics of transformer models in the feature learning regime.

Long Sequence Hopfield Memory

1 code implementation NeurIPS 2023 Hamza Tahir Chaudhry, Jacob A. Zavatone-Veth, Dmitry Krotov, Cengiz Pehlevan

Sequence memory is an essential attribute of natural and artificial intelligence that enables agents to encode, store, and retrieve complex sequences of stimuli and actions.

Attribute

Cannot find the paper you are looking for? You can Submit a new open access paper.