Text Degeneration: A Production Failure Mode That Most Benchmarks Do Not Track
中文摘要
自回归模型存在文本退化问题，多数基准未监测且影响推理成本。
English Summary
Text degeneration is a self-reinforcing failure mode in autoregressive language models that impacts inference cost and throughput but remains untracked by most current benchmarks.
Original Excerpt
A self-reinforcing failure mode of autoregressive language models, with measurable consequences for inference cost and throughput, and a… Continue reading on Medium »