CAG > RAG

While RAG systems are predominate, researchers have a simpler approach that could work better for many: Cache-augmented Generation (CAG).

Instead of retrieving documents on the fly, CAG preloads all relevant knowledge into the model's extended context window.

https://arxiv.org/abs/2412.15605

Comments