返回首页
vLLM Releases··论文与技术

v0.34.0rc1

中文摘要

v0.34.0rc1版本修复了XPU推理中贪婪搜索将NaN误判的漏洞,提升了模型数值稳定性。

English Summary

v0.34.0rc1 fixes a bug in greedy search for XPU, correctly treating NaN as -inf to improve numerical stability.

原文节选

[Bugfix][Spec Decode][XPU] greedy_argmax: treat NaN as -inf on the to…