The insane engineering of Deepseek V4 (opens in new tab)

Deepseek V4 explained\. \#ai \#aitools \#ainews \#llm \#agi \#deepseek \#claude \#agi Thanks to our sponsor Abacus AI\. Try ChatLLM & DeepAgent today: Deepseek v4: LLMs explained: Residual connections: 0:00 Deepseek V4 intro 1:00 Deepseek V4 specs 2:06 The challenge of 1M context 4:16 Hybrid attention 5:11 CSA & sparse selection 6:50 HCA 8:22 Sliding window attention 10:44 Insane efficiency gains 12:02 Signal explosion 13:00 Residual connections 13:52 mHC 14:17 ChatLLM 15:24 mHC continued...