Back to Home
vLLM Releases··Papers & Tech

v0.34.0rc3

中文摘要

v0.34.0rc3版本更新,在利用率测试中对device_memory_info进行了模拟处理。

English Summary

v0.34.0rc3 release mocks device_memory_info within utilization tests to improve system testing accuracy.

Original Excerpt

[Release][Tests] Mock device_memory_info in the #66704 utilization-wa…