← Back to Research

Interactive Research Report

DeepSeek V4: Architecture & Performance Deep Dive

By Yumei Dou ·

This report is based on publicly available open-source information from DeepSeek. All architectural analysis represents reasonable inference and research based on the DeepSeek-V4-Pro model card on Hugging Face and the published config.json.

Executive Summary

On April 24, 2026, DeepSeek released V4, its fourth-generation large language model, representing a significant leap in efficient AI architecture design. The model introduces a hybrid attention mechanism combining Chunked Shared Attention (CSA) and Hash-based Chunked Attention (HCA), a novel Mixture-of-Experts configuration with 384 experts, and aggressive KV cache compression that enables 1 million token context windows on commodity hardware.

V4-Pro Parameters

1.6T total

49B active per forward pass

V4-Flash Parameters

284B total

13B active per forward pass

Context Window

1M tokens

Both Pro and Flash variants

V4-Pro Pricing

$1.74/M input

$6.94/M output tokens

V4-Flash Pricing

$0.14/M input

$0.55/M output tokens

Launch Date

Apr 24, 2026

Open-weight release

Key Innovations

CSA/HCA Hybrid Attention mHC Residual Connection Muon Optimizer 384 MoE Experts (6+1 active) TileLang Kernel DSL GRPO Post-Training FP4 Quantization Multi-Latent Attention (MLA)

Subscriber Content

Continue reading with a subscription.

You are reading a free preview. The full interactive research report is available to Research and Full Quant Intelligence subscribers.

← Back to Research