19:43
Prime Intellect engineer: "everyone's bragging about a million-...
Carnage@0xCarnagee
107 views
Jul 12, 2026
~1 min read
Prime Intellect engineer:
"everyone's bragging about a million-token context. here's what they don't tell you.
at 256k tokens GPT-5.5 scores 80% on retrieval. push it to a million and it drops to 36%. the model accepts the context, it just can't reason across it. people call it context rot."
in a 20-minute talk he explains why bigger context windows won't save your agents.
continual learning + training on your own traces + real environments - that's the fix.
Watch the talk, then save!
x.com/0xCarnagee/sta…
"everyone's bragging about a million-token context. here's what they don't tell you.
at 256k tokens GPT-5.5 scores 80% on retrieval. push it to a million and it drops to 36%. the model accepts the context, it just can't reason across it. people call it context rot."
in a 20-minute talk he explains why bigger context windows won't save your agents.
continual learning + training on your own traces + real environments - that's the fix.
Watch the talk, then save!
x.com/0xCarnagee/sta…
