CAG > RAG
While RAG systems are predominate, researchers have a simpler approach that could work better for many: Cache-augmented Generation (CAG).
Instead of retrieving documents on the fly, CAG preloads all relevant knowledge into the model's extended context window.
https://arxiv.org/abs/2412.15605
While RAG systems are predominate, researchers have a simpler approach that could work better for many: Cache-augmented Generation (CAG).
Instead of retrieving documents on the fly, CAG preloads all relevant knowledge into the model's extended context window.
https://arxiv.org/abs/2412.15605
Comments