返回首页
arXiv AI··论文与技术

Graph Visualizations in Prompts for Knowledge Graph Question Answering

中文摘要

研究发现,在大型视觉语言模型中,通过提示词添加图可视化可显著提升知识图谱问答(KGQA)性能,尤其对复杂推理有效。

English Summary

A study shows adding graph visualizations to prompts significantly improves Knowledge Graph Question Answering (KGQA) performance in large vision-language models, especially for complex reasoning.

原文节选

arXiv:2611.12938v1 Announce Type: new Abstract: We study when and how multimodal input improves knowledge graph question answering (KGQA) in large vision--language models. Using a controlled evaluation over 1,500 WebQSP and CWQ questions and six VLMs within a fixed KGQA pipeline, we compare text-only prompting against text-plus-graph visualization at the per-question level and analyze performance changes as a function of reasoning complexity, model size, and image layout. Adding a graph image yields an average gain of 1.85 F1 points, driven by strong precision improvements on low-complexity questions (+4.65 F1). Mixed-effects and regression analyses show that these multimodal gains do not depend strongly on model scale, but are highly sensitive to graph layout: image-only settings sharply degrade performance, hierarchical Graphviz layouts outperform less organized renderings, and decomposing large subgraphs into separated paths yields the largest improvements. Taken together, the results indicate that visual prompting primarily aids KGQA by enhancing prediction precision in low-complexity contexts, provided that visual design respects cognitive and perceptual constraints. To optimi…