DeepSeek: DeepSeek v4.1 Flash 1017
DeepSeek released V4.1 Flash 1017, a sparse mixture-of-experts model built on a new Causal Encoder-Decoder (CED) architecture. The model activates only 8B parameters on input and 16B on output from a 552B-parameter backbone, keeping per-token compute low relative to total model size. Image understanding is native, with visual and text embeddings trained jointly from the start of pre-training rather than bolted on afterward.
Why it matters This is a genuine architectural departure, not just a scaled-up checkpoint: the asymmetric input/output activation split and jointly-trained multimodal embeddings suggest DeepSeek is optimizing for cheap, fast inference without sacrificing a very large effective capacity. Coming from an open-weight lab, it keeps pressure on closed labs' pricing and gives developers a frontier-adjacent model they can self-host and fine-tune, reinforcing the open-weight ecosystem's role in setting the pace for efficient multimodal architectures.
What to watch Watch for independent benchmarks on CED's real-world latency/quality tradeoffs and whether other labs adopt asymmetric encoder-decoder activation schemes.