返回首页
vLLM Releases··论文与技术

v0.33.0

中文摘要

v0.33.0版本发布,汇集389位贡献者,新增Reflection Beam、Yandex Alice等多个前沿大模型及视觉模型,大幅提升模型多样性与性能。

English Summary

Version 0.33.0 features 927 commits from 389 contributors, introducing diverse new models like Reflection Beam-1.0, Yandex AliceAI-Foundation-80B, and various specialized visual and language engines.

原文节选

v0.33.0 Highlights This release features 927 commits from 389 contributors (122 new)! New models: Reflection Beam-1.0 (501B MoE, 23B active) with its DFlash2 drafter (#62074), Yandex AliceAI-Foundation-80B-A3B (#57963), Recursive Flint (40B MoE, 2.5B active) (#62938), Muse Spark Open (#61879), Step-5 Preview (#61727, #63147), NVIDIA Alpamayo 2 Super (#62957), Nemotron-Labs Dory1.0-4B (#60149), Nemotron Parse 3.5 (#61651), MiniCPM-OCR 1.0 (#63095), Domyn Edge (#62544) and the ColUltraVBERT visual document retriever (#62237). PyTorch 2.14: vLLM is upgraded to PyTorch 2.14.0, with torchvision 0.29.0 and Triton 3.8.0 (#52183). CUDA 12.9 dropped: release wheels and images are CUDA 13.0 only. The CUDA 12.9 wheels and the -cu129 / -cu129-ubuntu2404 images are no longer published (#62575); use the default CUDA 13.0 artifacts instead. libtorch ABI stable CUDA wheel: the CUDA wheel is now ABI stable with libtorch. AWS EFA image: a new vllm/vllm-openai:v0.33.0-efa image (x86_64 and aarch64) bundles the AWS EFA libraries and the EFA build of the Mooncake transfer engine, for KV transfer and multi-node serving on EFA-enabled EC2 instances (#58768). vllm/vllm image alias: every release image is …