Article out @TheEconomist today on AI transforming economics,...

@ben_golub
Ben Golub@ben_golub
2 views Nov 20, 2026 ~1 min read
Advertisement
1
Article out @TheEconomist today on AI transforming economics, featuring a collaboration with @RefineDotInk.

We worked on our specific obsession:

How fragile is the economics literature, and will AI make it more or less reliable?
Media image
2
AI is accelerating the production of economic analysis everywhere. It's also helping identify and detect mistakes.

Will error or rigor win as AI scales up?

Our audit aimed to establish the baseline error rates today in the most selective outlets.

2/
Media image
3
Referees judge originality and method, and sometimes intuit gaps in quality.

They don't check as thoroughly as AI can.

We took 100 top-5 econ papers from this year.

AI checked every claim, table, and proof, and an expert rater assessed claimed big errors.

3/
Media image
4
The review raised about 54 issues per paper, most of them valid.

46% concern interpretation, where claims outrun the evidence. 29% are objective, checkable errors in derivations, numbers, or internal consistency.

4/
Media image
5
Most errors are minor.

But 1 in 10 papers has a serious error in an important result: a duplicated table panel omitting key estimates, a headline number 50× too large, a broken proof.

These are careful, peer-reviewed papers -- our gold standard.

5/
Media image
6
Fully AI-written papers are already appearing. @TheEconomist reports an AI verifier found a severe error in 842 of 1,000 automated economics papers (APE by @YanagizawaD).

If output grows, checking has to grow with it.

6/
7
Research verification belongs as a standard step before publication.

The same applies much more broadly: our human processes are too fragile.

We need more rigor in all economic analysis in every domain.

7/

Gift article link:

economist.com/finance-and-ec…
8
Read more about the details in our blog post!

refine.ink/blog/top-five-…
Actions
What You Can Do
  • Export as PDF or Markdown
  • Batch Export to Notion
  • Bookmark & Highlight
  • Screenshot Tweet
Create Free Account

Includes 7-day Premium trial

Advertisement