DeepSeek open-sourced DeepInfer, the inference system it uses to serve its AI models. The company reports extremely high throughput and says caching helps make serving efficient. The figures are not independently audited and do not prove the claimed profits.
ORIGINAL LINK: https://www.latent.space/p/ainews-deepseek-deepinfer-open-source
