Back to Home
Towards Data Science··Industry Media

The Reversal Curse: Why a Language Model That Knows “A Is B” Can’t Tell You “B Is A”

中文摘要

AI 仅能按学习方向理解事实,知“A是B”却难推“B是A”,因仅按学习方向记忆,反向检索失败。此为“反转诅咒”。

English Summary

A language model knowing "A is B" struggles with "B is A" due to a "reversal curse". It recalls facts in the learned direction, failing in the reverse.

Original Excerpt

A model can recall a fact in the direction it learned it and fail in the other. Here's a toy version of why