⚡ Productivity🔬 Science & Research
I took Qwen3.8-27B apart to see how it works inside. The plan was to carve a MoE out of it.
Every ffn neuron tapped, all 1,114,112 of them. 3.92M tokens pushed through. 87 minutes on the 4x3090.
The result surprised me. Neurons that fire on more than 90% of tokens: 2.
Thats what youre looking at,...
Aug 23, 2026
