Excited to finally announce what I've been up to since leaving...

@khoomeik
Rohan Pandey@khoomeik
29 views Oct 01, 2025 ~2 min read
Advertisement
1
Excited to finally announce what I've been up to since leaving OpenAI: autonomous science at @PeriodicLabs

Why? Because I Take the Bitter Lesson Seriously

To accelerate AI, we must enable it to hill-climb compute & energy through experimentally verifiable science 🧵
@LiamFedus
Liam Fedus@LiamFedus
Today, @ekindogus and I are excited to introduce @periodiclabs.

Our goal is to create an AI scientist.

Science works by conjecturing how the world might be, running experiments, and learning from the results.

Intelligence is necessary, but not sufficient. New knowledge is created when ideas are found to be consistent with reality. And so, at Periodic, we are building AI scientists and the autonomous laboratories for them to operate.

Until now, scientific AI advances have come from models trained on the internet. But despite its vastness — it’s still finite (estimates are ~10T text tokens where one English word may be 1-2 tokens). And in recent years the best frontier AI models have fully exhausted it.

Researchers seek better use of this data, but as any scientist knows: though re-reading a textbook may give new insights, they eventually need to try their idea to see if it holds.

Autonomous labs are central to our strategy. They provide huge amounts of high-quality data (each experiment can produce GBs of data!) that exists nowhere else. They generate valuable negative results which are seldom published. But most importantly, they give our AI scientists the tools to act.
We’re starting in the physical sciences.

Technological progress is limited by our ability to design the physical world.

We’re starting here because experiments have high signal-to-noise and are (relatively) fast, physical simulations effectively model many systems, but more broadly, physics is a verifiable environment. AI has progressed fastest in domains with data and verifiable results - for example, in math and code. Here, nature is the RL environment.

One of our goals is to discover superconductors that work at higher temperatures than today's materials. Significant advances could help us create next-generation transportation and build power grids with minimal losses. But this is just one example — if we can automate materials design, we have the potential to accelerate Moore’s Law, space travel, and nuclear fusion.

We’re also working to deploy our solutions with industry. As an example, we're helping a semiconductor manufacturer that is facing issues with heat dissipation on their chips. We’re training custom agents for their engineers and researchers to make sense of their experimental data in order to iterate faster.

Our founding team co-created ChatGPT, DeepMind’s GNoME, OpenAI’s Operator (now Agent), the neural attention mechanism, MatterGen; have scaled autonomous physics labs; and have contributed to some of the most important materials discoveries of the last decade. We’ve come together to scale up and reimagine how science is done.

We’re fortunate to be backed by investors who share our vision, including @a16z who led our $300M round, as well as @Felicis, DST Global, NVentures (NVIDIA’s venture capital arm), @Accel and individuals including @JeffBezos , @eladgil , @ericschmidt, and @JeffDean. Their support will help us grow our team, scale our labs, and develop the first generation of AI scientists.
Media image
2
“The biggest lesson from 70 years of AI research is that general methods that leverage compute are ultimately the most effective.

The reason for this is Moore's law, i.e. the continued exponentially falling cost per unit of compute.”

- Richard Sutton, The Bitter Lesson
3
In February 2025 at OpenAI, I got RL-pilled.

RL allows LLMs to hill-climb any problem where verification is easier than generation, and by scaling up RL compute, Strawberry was saturating all their environments every few weeks.

What might the highest value RL environment be?
4
We, AI researchers, continue to go about our work on algorithms, architecture, and data as if it were still 2019 and scaling laws were yet to be discovered.

But now it’s 2025, and we know that more compute & more energy is the most reliable path to advancing AI.
Media image
5
The dream at many frontier labs is recursive self-improvement: AI good enough to code a better n+1 version of itself, which codes a better n+2, …, until the Universe is overflowing with intelligence.
6
But the notion that AI will *algorithmically* self-improve ad infinitum forgets the Bitter Lesson and that research is compute-bound.

Kick off a few agents to run pretraining experiments and see how quickly you run out of H100s.
7
Is it hopeless then? Does the Bitter Lesson doom us to be compute-bound, waiting for Nvidia to ship GB300, for ASML to perfect High-NA EUV, and for nuclear fusion to be solved?

No.
8
If you Take the Bitter Lesson Seriously, recursive self-improvement means freeing AI to accelerate compute & energy—technologies bottlenecked by real-world science.
Media image
9
At Periodic Labs, we’re building the highest value RL environment: an autonomous laboratory for matter.

Our first lab in Menlo Park gives AI the robotic & scientific tools to spark an exponential scale-up of compute & energy through breakthroughs in advanced materials.
10
For example, to discover a high temp superconductor, we run RL, rewarding higher critical temperature.

In each iteration, the LLM proposes novel materials which are synthesized & analyzed by robots in the lab.

Verifiability makes physics as hill-climbable as math or coding.
Media image
11
Autonomous Science is thus the most worthy problem for a bitterlessonpilled AI researcher, and comes loaded with questions about RL, synthetic data, & supercomputing that Periodic Labs is actively hiring for.
jobs.ashbyhq.com/periodic-labs
12
I’m incredibly lucky to work on such a talented team with >$300M in funding led by Liam (ex-VP of Post-training at OpenAI) & Dogus (ex-Head of Quantum Materials at Google DeepMind) who pioneered ChatGPT & GNoME.

I hope you’ll join us as we ascend the Kardashev scale.
Actions
What You Can Do
  • Export as PDF or Markdown
  • Batch Export to Notion
  • Bookmark & Highlight
  • Screenshot Tweet
Create Free Account

Includes 7-day Premium trial

Advertisement