Back to Home
Towards Data Science··Industry Media

RAG Retrieval Lost 40 Points When Distracting Passages Grew to 2.68M

中文摘要

研究表明,当干扰段落增至268万时,RAG检索性能下降40分,揭示了评估方法及答案位置对检索结果的影响。

English Summary

Research shows RAG retrieval performance dropped 40 points with 2.68M distracting passages, highlighting issues with search evaluations and answer positioning.

Original Excerpt

A reproducible test of BM25, embeddings, and parent documents shows why author-written evals overrate search, and why answer position in context matters.