Back to Home
vLLM Releases··Papers & Tech

v0.34.0rc2

中文摘要

v0.34.0rc2 更新了文档与测试,在大多数可扩展组件中停止默认设置 gpu_memory_utilization。

English Summary

v0.34.0rc2 updates documentation and tests, removing default gpu_memory_utilization settings in most extensible components.

Original Excerpt

[Doc][Tests] Stop setting gpu_memory_utilization in most extensible…