返回首页
arXiv AI··论文与技术

Self-Supervised Keyframe Discovery for Horizon-Invariant Behavior Cloning

中文摘要

这项研究引入了一种自我监督关键帧发现方法,有效解决了长视界行为克隆中上下文推理的复杂性与长期依赖难题。

English Summary

This research introduces a self-supervised keyframe discovery method to address long-horizon behavior cloning challenges and effectively capture complex contextual dependencies for improved policy learning.

原文节选

arXiv:2610.10857v1 Announce Type: new Abstract: Behavior cloning (BC) in non-Markovian environments is a challenging problem because policies have to reason over contextual information over long horizons. Existing policy architectures rely on recurrent or attention-based mechanisms to capture long-term dependencies. However, recurrent models suffer from hidden-state collapse and gradient instability under backpropagation through time, while attention-based models are fundamentally limited by context length. To address these issues, we propose Keyframe Mnemonics, a novel self-supervised method that $\textit{discovers}$ a set of information-critical observations ($\textit{mnemonics}$) by learning an objective from randomly sampled past observations and using it as a reward for keyframe selection. We then train a BC policy that conditions on the discovered keyframes to model the action distribution. Under certain task-structure assumptions, our formulation provides context retention guarantees over an infinite horizon, while maintaining a small set of decision-relevant keyframes in the policy's working memory. We evaluate our method on synthetic memory domains, where mnemonic-conditio…