Paper & weights releaseCritical global significanceConfirmed confidence
DeepSeek publishes the sparse architecture behind its later models
DeepSeekMoE uses fine-grained experts and shared expert isolation to improve sparse-model efficiency, with 16B weights and training code released.
What happened
Event details
The DeepSeekMoE paper split experts more finely and isolated shared experts so that a large model could route each token through a smaller, more specialized subset of parameters. DeepSeek reported that its 16B model approached the performance of 7B dense baselines while using about 40% of the computation. Base and chat weights plus fine-tuning code were released, turning an architecture paper into a reproducible starting point for the later V2 and V3 systems.
Assessment
Why it matters
DeepSeekMoE made sparse activation a durable engineering direction rather than a one-off cost claim.
91/100Global significance score. Regional effects are recorded only when the evidence supports a meaningful difference.