返回首页
arXiv AI··论文与技术

PRIME: Towards Verifiable Evidence-Grounded Reasoning in LLM Agents

中文摘要

PRIME框架通过可验证的证据溯源,提升了大模型代理在复杂规则核查任务中的推理准确性,有效避免了遗漏或错误决策。

English Summary

PRIME enhances LLM agents with verifiable, evidence-grounded reasoning, improving the accuracy of complex requirement checks and preventing failures in decision-making processes.

原文节选

arXiv:2610.22426v1 Announce Type: new Abstract: LLM agents are used to check records against an organization's requirements, for example whether a vulnerability report is ready for investigation. Requirements often allow several ways to be met, such as a severity rating with a curator-reviewed advisory or a published advisory link. Agents fail by accepting a report after a required check has failed, or by settling for a weaker conclusion without trying another way that could still succeed. We introduce PRIME (Precommitted Rules for Inference from Minimal Evidence). Before checking, it fixes evidence routes specifying how each conclusion may be justified. A separate program records each check result and refuses any conclusion the results do not justify. It also points the agent to checks that could justify a stronger conclusion, or runs them itself. PRIME reports only conclusions authorized by its rules and ledger. With correct requirements, exact checks at known locations, and sufficient budget at stopping, completion reaches the strongest supported conclusion. On 480 public-record tasks, an agent shown the requirements reported unjustified conclusions on 26.7% of tasks, while PRIM…