New preprint from the lab! 🚀
Bariscan Kurtkaya, Fatih Dinc & coauthors explore how AI models remember by training 35,000+ RNNs to store numerical values for variable periods of timeðŸ§
They show how learning rate & timing shape memory —offering insights for both AI & neuroscience! 👇
Bariscan Kurtkaya, Fatih Dinc & coauthors explore how AI models remember by training 35,000+ RNNs to store numerical values for variable periods of timeðŸ§
They show how learning rate & timing shape memory —offering insights for both AI & neuroscience! 👇
Reposted from
Nina Miolane
How does AI memorize information? How does ChatGPT remember your name? How do RNNs keep track of simple numbers?
Our new paper led by Bariscan Kurtkaya & Fatih Dinc explores the geometry of short-term memory in neural networks—revealing limits in how information is stored!🧵
arxiv.org/abs/2502.17433
Our new paper led by Bariscan Kurtkaya & Fatih Dinc explores the geometry of short-term memory in neural networks—revealing limits in how information is stored!🧵
arxiv.org/abs/2502.17433
Comments