RAG Retrieval Lost 40 Points When Distracting Passages Grew to 2.68M
中文摘要
研究表明,当干扰段落增至268万时,RAG检索性能下降40分,揭示了评估方法及答案位置对检索结果的影响。
English Summary
Research shows RAG retrieval performance dropped 40 points with 2.68M distracting passages, highlighting issues with search evaluations and answer positioning.
Original Excerpt
A reproducible test of BM25, embeddings, and parent documents shows why author-written evals overrate search, and why answer position in context matters.