LLMs Can Have Earworms — How Repeating a Sentence Can Make Its Next Repetition More Likely
中文摘要
重复句子会增加模型重复它的几率。
English Summary
Repeating sentences increases the model's likelihood of repeating them.
Original Excerpt
The mathematics of self-reinforcing repetition, with measured results from a small GPT-2 experiment. Continue reading on The Quantastic Journal »