GenDSR: Transferring Representations from Video Generation Models for Dynamic Spatial Reasoning
中文摘要
GenDSR框架利用视频生成模型的时空表征能力,提升了视觉语言模型在动态空间推理任务中的表现,有效解析了物体随时间的运动与空间关系演变。
English Summary
GenDSR leverages video generation models to improve dynamic spatial reasoning in vision-language models, enhancing the tracking of object states and spatiotemporal relations over time.
arXiv:2610.41314v1 Announce Type: cross Abstract: Dynamic spatial reasoning is essential for connecting visual intelligence to thephysical world, yet remains challenging for vision-language models (VLMs), which must preserve scene state while tracking how spatial relations evolve over time. Meanwhile, video generation models (VGMs), trained to synthesize temporally coherent world dynamics, offer a rich source of spatiotemporal representations. We present GenDSR, a framework that transfers intermediate representations from VGM into VLM for dynamic spatial reasoning. Rather than treating a VGM feature as a monolithic prior, GenDSR constructs two complementary branches: a raw branch preserving holistic generative context and a delta branch emphasizing temporal variation. Task-conditioned tokenwise gates then fuse both signals and inject the result into the native visual representation. On DSR-Bench, GenDSR achieves 67.2%, surpassing the previous best result and establishing a new state of the art.