Back to Home
arXiv AI··Papers & Tech

Robust Task-Aware State Estimation from Pre-trained Perception

中文摘要

该研究提出任务感知方法,解决预训练模型状态估计的不确定性,避免将预测误认为真值,提升决策的鲁棒性。

English Summary

This research addresses uncertainty in state estimation using pretrained models, proposing task-aware methods to prevent unsafe decisions caused by treating uncertain predictions as ground truth.

Original Excerpt

arXiv:2611.14781v1 Announce Type: new Abstract: Agents that perform state estimation using pretrained perception models, e.g., Vision-Language Models (VLMs), face the fundamental challenge that predictions are uncertain. Still, most approaches determinize these predictions into a single best-guess state and make decisions as if it were ground truth. This is brittle because when the guess is wrong, the agent's decisions may be unsafe or infeasible. At the other extreme, maintaining a full probability distribution over symbolic states is often intractable. We propose a middle path, drawing on the underlying probabilities the perception model already produces (e.g., a VLM's output-layer token distributions) to construct a $\theta$-confidence Minimal Belief Set (MBS$_\theta$), a minimal subset of states whose cumulative probability meets a user-specified belief-mass threshold. The minimality of an MBS$_\theta$ ensures that the agent considers only the most likely states, enhancing robustness in downstream decision-making while maintaining computational tractability. Using a novel three-layered belief system, we efficiently approximate individual state probabilities from per-feature pre…