DeepSeek: Further Open-Sourcing Its Internal Inference Framework DeepInfer
21/10/2569 01:10:01
Bollcoin reported on October 20, citing CLS, that DeepSeek stated it has achieved high-throughput, low-latency large-scale inference services for DeepSeek V4.1 Flash based on DeepInfer. Going forward, the inference code for DeepSeek's new models and subsequent optimizations will also be continuously updated here.