We’re excited to introduce Transformer², a machine learning system that dynamically adjusts its weights for various tasks!
https://sakana.ai/transformer-squared
Adaptation is a remarkable natural phenomenon, like how the octopus blends into its environment, or how the brain rewires itself after injury.
🧵 1/N
https://sakana.ai/transformer-squared
Adaptation is a remarkable natural phenomenon, like how the octopus blends into its environment, or how the brain rewires itself after injury.
🧵 1/N
Comments
🧵 2/N
Transformer²: Self-adaptive LLMs
Paper: https://arxiv.org/abs/2501.06252
GitHub: https://github.com/SakanaAI/self-adaptive-llms