DeepSeek's new model MODEL1 code has been leaked, suggesting a completely new architecture.

Code differences indicate that the model has been optimized in areas such as KV cache layout, sparsity handling, and FP8 decoding, and may be officially released around the Spring Festival. Combined with the recently disclosed mHC residual connection mechanism and Engram memory module, MODEL1 is expected to integrate several self-developed innovations.