🔥 MIT just exposed every top AI model and it’s not pretty. They...

@AlexanderFYoung
Dr Alex Young ⚡️@AlexanderFYoung
9 views Oct 30, 2025 ~1 min read
Advertisement
1
🔥 MIT just exposed every top AI model and it’s not pretty.

They built a new test called WorldTest to see if AI actually understands the world… and the results are brutal.

It doesn’t just check how well a model predicts the next frame or maximizes reward it tests whether it can build an internal model of reality and use it to handle new situations.

They built AutumnBench 43 interactive worlds, 129 tasks where AIs must:

• Predict hidden parts of the world (masked-frame prediction)
• Plan sequences of actions to reach a goal
• Detect when the environment’s rules suddenly change

Then they tested 517 humans vs. Claude, Gemini 2.5 Pro, and o3.

Humans crushed every model. Even massive compute scaling barely helped.

The takeaway is wild.. today’s AIs don’t understand environments; they just pattern-match inside them.

They don’t explore strategically, revise beliefs, or run experiments like humans do.

WorldTest might be the first benchmark that actually measures understanding, not memorization.

The gap it reveals isn’t small it’s the next grand challenge in AI cognition.

(Comment “Send” I’ll DM you the paper)
Media image
2
AutumnBench is just the start.

The framework can expand to physics-rich worlds, robotics, even multi-agent systems.

If AI ever wants true understanding not memorization it’ll have to pass WorldTest.

arxiv.org/abs/2510.19788
3
I built something you don't want to miss out on...

Here it is:

We built ClipYard for ruthless performance marketers.

→ Better ROAS
→ 10x faster content ops
→ Full creative control

You’ve never seen AI avatars like this before → clipyard.ai
Actions
What You Can Do
  • Export as PDF or Markdown
  • Batch Export to Notion
  • Bookmark & Highlight
  • Screenshot Tweet
Create Free Account

Includes 7-day Premium trial

Advertisement