返回首页
arXiv AI··论文与技术

Risk-Averse Online POMDP Planning via CVaR of the Immediate Cost with Performance Guarantees

中文摘要

该研究提出一种基于即时成本CVaR的风险规避在线POMDP规划方法,解决了信念内风险问题并提供性能保证。

English Summary

This research proposes a risk-averse online POMDP planning method using immediate cost CVaR to address intra-belief risks and provide performance guarantees.

原文节选

arXiv:2609.35874v1 Announce Type: new Abstract: Online POMDP planners optimize the expected cumulative cost, which can mask dangerous states when the belief places significant mass on high-cost states. Existing risk-averse methods apply static or dynamic Conditional Value at Risk (CVaR) to the value function, capturing trajectory-level risk, but share two gaps: (i) by retaining the immediate cost as an expectation of a state-dependent cost over the belief, the risk \emph{within} the belief is left unaddressed; and (ii) by modifying the value function, they require new tailored algorithms rather than reusing existing expectation-based planners. We instead apply CVaR to the immediate cost over the belief at each step, directly targeting per-step uncertainty about the current state. The standard expected cumulative return is retained as the objective, so the resulting problem has a standard MDP structure: any expectation-based POMDP planner can be made risk-sensitive by changing only the cost computation. We inherit finite-time guarantees for policy evaluation and sparse sampling---with estimation error independent of the risk level---and, as our central theoretical result, prove a fi…