Collapse of Dense Retrievers: Short, Early, and Literal Biases Outranking Factual Evidence

Reveals that dense retrievers are vulnerable to superficial patterns like prioritizing document beginnings, shorter documents, repeated entities.

📝 https://arxiv.org/abs/2503.05037
👨🏽‍💻 https://huggingface.co/datasets/mohsenfayyaz/ColDeR

Comments