The power of generative models — now embodied in humanoids....

@akapoor_av8r
Ashish Kapoor@akapoor_av8r
19 views Sep 18, 2025 ~3 min read
Advertisement
1
The power of generative models — now embodied in humanoids.

Announcing DreamControl –– After a year-long research effort at General Robotics — we present a scalable framework for whole-body humanoid control that fuses diffusion priors with reinforcement learning to unlock real-world scene interaction.

Diffusion + RL → natural whole-body skills on real robots.

DreamControl enables humanoids to move beyond locomotion demos → performing natural, human-like skills such as ––
Picking & lifting objects, Opening drawers & doors, Precise punching, kicking, and jumping, Bimanual manipulation tasks

Our key innovation: a diffusion prior over human motion that guides RL, eliminating the need for massive teleoperation datasets, and producing motions that look human while transferring to real hardware.

Trained purely in simulation, deployed on the @UnitreeRobotics G1 humanoid, DreamControl policies run in real time, bridging sim-to-real with unprecedented naturalness.

We leverage a novel hybrid edge + cloud infrastructure that runs RL-trained policies on the edge backed by powerful AI models running in the cloud

This is the next step in General Robotics’ journey toward general-purpose humanoid assistants that interact, adapt, and assist autonomously.

Paper: genrobo.github.io/DreamControl/s…
Blog: generalrobotics.company/post/dreamcont…

1/n
1:54
2
Humanoids today walk, dance, and even do kung-fu.

But true usefulness requires whole-body interaction with the environment:
- Stooping to pick up objects
- Bracing to open doors/drawers
- Precise pushing, punching, or bimanual lifting

These tasks remain unsolved.

2/n
3
Why are building skills for humanoids challenging?

They combine multiple time scales:
- Fast sub-second balance & stability
- Slow long-horizon planning for coordinated grasping, pushing, lifting

RL alone struggles here and teleoperation datasets are scarce.

3/n
4
Enter DreamControl ––

A two-stage recipe combining human motion diffusion priors with reinforcement learning.
- Stage 1: Generate realistic human-like motion trajectories (from OmniControl).
- Stage 2: Train an RL policy to track + complete tasks with these priors.

4/n
Media image
5
Why diffusion?
- Provides natural, human-like motion plans
- Reduces reward engineering
- Bridges sim-to-real (avoids “robotic” jerky motions)
- Leverages abundant human motion data, not scarce teleop

5/n
0:11
6
Results ––
DreamControl masters a library of challenging AI skills on the Unitree G1 humanoid:

Pick & Lift, Bimanual pick, Open drawer / door, Button press, Precise punch & kick, Jump

All with high success rates across 1000 random environments.

6/n
0:08
7
Crucially ––
DreamControl’s motions are rated as more human-like –– lower FID, jerk, user preference.
Humanoid actions that look natural have better human-robot interaction and safer sim2real transfer.

7/n
0:09
8
Hybrid Edge + Cloud deployment ––

Our novel architecture for DreamControl augments RL policy on the edge with powerful AI models that run on cloud. We demonstrate DreamControl on a real @UnitreeRobotics G1 with Inspire hands, completing:

Object pick, Button press, Squat, Bimanual lifting (with different weights), Precise punching, Drawer Opening

All without relying on privileged sim-only information.

8/n
0:16
9
Why does this matter?
It pushes humanoids from teleop puppets → autonomous assistants.
From dancing for YouTube to lifting boxes, pressing buttons, and opening drawers in the real world.

9/n
10
DreamControl =
- Diffusion priors (the “Dream”)
- RL execution (the “Control”)

A scalable recipe for building whole-body humanoid skills.

10/n
11
More information on this research ––

Paper link: genrobo.github.io/DreamControl/s…
Blog: generalrobotics.company/post/dreamcont…
Website: genrobo.github.io/DreamControl/

11/n
12
Thank you to a number of researchers and engineers who contributed to this effort led by @jonathanhuang11:

@DvijKalaria, @sudarshan_s_h , @pushkalkatara, Sangkyung Kwak, @sarthak__bhagat, Shankar Sastry, Srinath Sridhar, @saihv
Actions
What You Can Do
  • Export as PDF or Markdown
  • Batch Export to Notion
  • Bookmark & Highlight
  • Screenshot Tweet
Create Free Account

Includes 7-day Premium trial

Advertisement