Back to Home
RadarAI··Papers & Tech

DeepSeek 完全开源自研推理框架 DeepInfer

中文摘要

DeepSeek开源自研推理框架DeepInfer,旨在通过高吞吐与低延迟技术降低算力成本,推动模型降价。

English Summary

DeepSeek open-sourced its DeepInfer inference framework, using high throughput and low latency to reduce computing costs and energy consumption, aiming to lower model prices.

Original Excerpt

DeepSeek 宣布将自研推理框架 DeepInfer 完全开源,代码地址 github.com/deepseek-ai/DeepInfer。官方称 DeepInfer 在生产环境中支撑 DeepSeek-V4.1-Flash,实现高吞吐和低延迟,开源旨在帮助社区降低算力成本与能耗。作者认为这将推动所有模型降价。