A Small Model Asks Better: Fine-Tuning Query Clarification for Retrieval-Augmented Generation
中文摘要
该研究通过微调小模型提升RAG系统的查询澄清能力,解决多轮对话中用户输入模糊或存在多重解释的问题。
English Summary
This research fine-tunes small models for query clarification in RAG systems to resolve ambiguous or ill-formed user inputs within multi-turn conversational contexts.
arXiv:2610.28686v1 Announce Type: new Abstract: Query clarification is essential for retrieval-augmented generation (RAG) systems that face ambiguous user queries. We consider multi-turn grounded conversational scenarios where a user query is either ill-formed or ambiguous in the context of the prior dialog or, more interestingly, it may be well-formed but when posed against retrieved documents there are multiple relevant interpretations. The task is to recognize both such cases and then generate an appropriate clarification request to the user. We present ClariEdge, a new dataset of approximately 3,900 examples that include such ambiguous queries along with negative examples that do not require clarification. We also show that a lightweight fine-tuned LoRA achieves 96.6% classification accuracy and outperforms prompted baselines of many larger models on both classification and quality of clarification generation. Our study shows that hard negatives are an essential ingredient to separate out queries that are truly ambiguous from queries that may look ambiguous but are not (i.e., can be resolved from the context). The same LoRA achieves high performance in both pre-retrieval and po…