Attention is a lookup. Each token builds a query, compares it...

Name: Attention is a lookup. Each token builds a query, compares it...
Uploaded: 2026-07-02T16:40:35.504031+00:00
Channel: @tetsuoai
Description: Attention is a lookup. Each token builds a query, compares it against every key in the sequence, and pulls value vectors weighted by the match. Stack that 96 layers deep and you get a frontier model. Video covers the full pipeline: Q/K/V,... — Thread by @tetsuoai

tetsuo@tetsuoai

17 views Jul 02, 2026 ~1 min read

Attention is a lookup. Each token builds a query, compares it against every key in the sequence, and pulls value vectors weighted by the match. Stack that 96 layers deep and you get a frontier model.

Video covers the full pipeline: Q/K/V, attention scores, encoder blocks.

Actions

Related Threads