Everyone says “LLMs are black boxes.”
This paper "How Do LLMs Use Their Depth?” just opened one and showed how intelligence forms layer by layer.
They follow a “Guess → Refine” strategy:
• Early layers make statistical guesses using frequent tokens (“the”, “of”, “and”)
• Middle layers pull in con...
Oct 29, 2025