🤖 AI & Machine Learning
(1/N) Pencil Puzzle Bench is out!
51 LLMs tested on pencil puzzles (multi-step, logical reasoning, verifiable at each step)
Dataset: 62k unique puzzles, 94 types.
Evaluation: covers 300 puzzles across 20 types
Best score: GPT 5.2@xhigh 56%, half the puzzles are still unsolved...
Mar 12, 2026