Your LLM Judge Changes Its Mind When You Swap the Order of the Answers
中文摘要
LLM 评判器可能受答案顺序影响。通过五分钟测试，可检测评估是在衡量质量还是位置偏差。
English Summary
LLM judges can be biased by answer order. A five-minute test helps determine if your evaluation measures actual quality or simply position bias.
Original Excerpt
A five-minute test tells you whether your evaluation pipeline is measuring quality or measuring position. Continue reading on Towards AI »