64:05
Anthropic and Andrew Ng built an agent that uses 90% fewer tokens...
codila@0xCodila
124 views
Jul 14, 2026
~1 min read
Anthropic and Andrew Ng built an agent that uses 90% fewer tokens from scratch:
they dropped the entire book of Frankenstein into a prompt - 108,000 tokens asked one question
the input dropped from 108,000 tokens to 11
here's how:
step 1 → put everything that never changes at the top - tools, then system, then docs
step 2 → mark where the static part ends. everything above it gets cached
step 3 → one stray space breaks it - and you pay full price again
step 4 → the cache dies in 5 min - every read resets the clock
step 5 → cached tokens don't count against your rate limits. free headroom
most people never touch this - it pays for itself on day one
watch & bookmark - this 1-hour brilliant course ↓
they dropped the entire book of Frankenstein into a prompt - 108,000 tokens asked one question
the input dropped from 108,000 tokens to 11
here's how:
step 1 → put everything that never changes at the top - tools, then system, then docs
step 2 → mark where the static part ends. everything above it gets cached
step 3 → one stray space breaks it - and you pay full price again
step 4 → the cache dies in 5 min - every read resets the clock
step 5 → cached tokens don't count against your rate limits. free headroom
most people never touch this - it pays for itself on day one
watch & bookmark - this 1-hour brilliant course ↓
