Can LLMs generate proofs of basic undergrad maths? More or less......

@doomslide
doomslide@doomslide
13 views Jul 04, 2025 ~1 min read
Advertisement
1
Can LLMs generate proofs of basic undergrad maths? More or less... The Devil is in the details though! LLMs store a memoized proof which they linearly unfold upon request. A human mathematician, in contrast, stores a tiny program that generates the proof (and many others in fact)
2
How do we teach LLMs these programs? Following the current trend they will either learn them by themselves or never. Certainly no one is collecting these tiny programs in parquet files.
3
This is not to say they *can't* learn it but *how*? Humans learn these programs almost entirely through the active recursive process of trying compress the knowledge using everything at their disposal.
youtu.be/9qlqVEUgdgo?si…
4
But if math representations are idiosyncratic the LLMs must learn their own. Human articulated ones may be as useful to LLMs as to humans (not much). It's not impossible that LLMs may learn them autonomously but how could they with such tiny context!
5
Mathlib is ≈1.5M loc. It just doesn't fit. Even your favorite narrow shallow subject would choke Gemini's context window. To believe in LLMs is to believe against odds. It is a romantic idea. But low K complexity strings are extremely rare and aren't owed to us by default.
6
Amortize! Push it all into the weights! Well people tired and will continue to try using ever more sophisticated methods. Can LLMs learn the ebb and flow of mathematical inquiry with none of the social queues? Sit back and relax in the blue chair. We have much to look forward to.
Actions
What You Can Do
  • Export as PDF or Markdown
  • Batch Export to Notion
  • Bookmark & Highlight
  • Screenshot Tweet
Create Free Account

Includes 7-day Premium trial

Advertisement