Motus2 Team September 2026

Motus2

Motus2: A Self-Evolving General World Model for Dexterous Manipulation

Hongzhe Bi1,2*†, Zihao Zhou1,3*, Yihang Tang1,4*, Jingrui Pang1,2*, Shuhe Huang1,2*, Haitian Liu1,2, Runqing Wang1,4, Shuai Huang1,
Yichen Wang1, Yiming Cheng2, Ruowen Zhao1,2, Zhenghua Li2, Hengkai Tan1,2, Xiaolong Liu1, Jinhui Wan1, Jiabao Liu1, Min Zhao1,2, Fan Bao1, Jun Zhu1,2✉

1GensPI 2Tsinghua University 3BUAA 4BIT

Project lead. *Joint first authors. Corresponding author.

Motus2 is a self-evolving General World Model for dexterous manipulation, advanced through model scaling and data scaling. A single shared-parameter model exposes a policy, a simulator, and an evaluator, coupling action proposal, consequence prediction, and outcome evaluation into a closed decision-and-learning loop for policy improvement. Egocentric pretraining progresses from monocular egocentric data to synchronized stereo egocentric data, followed by robot-domain adaptation, while tactile feedback supports contact-aware control.

Motus2 overview video. An overview of the General World Model and its real-robot dexterous manipulation capabilities. Published by the Motus2 Team on September 1, 2026.

TL;DR

  • General World Model — one shared video-action model exposes a policy (world-action model), a simulator (action-conditioned world model), and an evaluator (value model).
  • Human Data Pyramid — 130K hours of data support progressive pretraining from monocular egocentric video to synchronized stereo egocentric data, followed by robot-domain mid-training.
  • Self-evolving via MBRL — predicted consequences and value estimates are converted into policy updates, while the same three interfaces support Best-of-N planning.
  • Working Memory — sliding-window autoregression provides the default streaming-inference path, while variable-length full-episode training supports two extensions: global autoregression and Hybrid Memory.
  • Tactile sensing — a lightweight tactile expert supports tactile-conditioned action refinement and auxiliary future-force prediction.

Explore the Demos

Choose an embodiment and capability, then select a task. For the complete list of every rollout, visit the Motus2 robot demonstration catalog.

Embodiment
Capability
Task
0:00 / 0:00
WuJi-1 Normal 1× · Real Inference

Screw Bulb

Align, rotate, and secure a light bulb.

General World Model

Motus2 instantiates a General World Model for dexterous manipulation. Rather than learning separate systems for action generation, future simulation, and outcome evaluation, one shared-parameter video-action model exposes all three as control interfaces.

The policy proposes executable action chunks, the simulator predicts their visual consequences with an action-conditioned world model, and the evaluator assesses the predicted outcomes with a value model. Their coupling supports planning and model-based policy improvement.

01

Policy

World-action model that proposes executable action chunks.

02

Simulator

Action-conditioned world model that predicts future visual consequences.

03

Evaluator

Value model that assesses predicted outcomes for selection and learning.

Motus2 General World Model and closed policy-simulator-evaluator loop
Figure 1: Motus2 overview. A single General World Model with one shared parameter set exposes three control interfaces. The policy generates action chunks, the simulator predicts future visual states under candidate actions, and the evaluator assesses the resulting branches for planning and policy optimization.

Stage-Specific Chunk Masks

Motus2 uses two stage-specific visibility patterns. Joint pretraining on synchronized stereo egocentric data uses a joint mask with bidirectional video-action interaction inside each chunk. Mid-training and post-training use an action-first mask: actions cannot read the current future-video tokens or the read-only value query, while future video may condition on the action and the value query may read both.

Policy, simulation, and evaluation are supervision modes under the shared action-first layout rather than separate attention masks. Both masks remain causal across chunks. Tactile signals are handled by the separate tactile expert and do not enter these masks.

Joint pretraining attention mask
Joint mask. Stereo video-action pretraining.
Action-first attention mask
Action-first mask. Mid-training and post-training.

Figure 2: Stage-specific chunk masks. Context (C), video (Z), and action (A) tokens share one backbone. The U row and column in the joint panel are shown only for layout alignment; value queries are inactive during joint pretraining. From mid-training onward, the action-first layout activates a read-only value query: future video may condition on the action, and U may read both action and future video. Both masks remain causal across chunks.

Human Data Pyramid

Motus2 scales through a hierarchical human data pyramid: approximately 130K raw recording hours progress from low- and high-resolution monocular egocentric video to synchronized stereo egocentric data. Robot-domain mid-training then uses more than 100 hours of robot trajectories and supplementary human-robot alignment data. Together, these stages provide shared experience for the policy, simulator, and evaluator before target-task post-training.

Egocentric data pyramid from web and monocular video to stereo human, alignment, and robot data
Human Data Pyramid. Monocular egocentric video provides broad visual and semantic coverage; synchronized stereo egocentric data provides implicit depth cues and more accurate 3D hand-pose estimates; robot trajectories and alignment data bridge to deployment.

Human Data Scaling Laws

Increasing stereo egocentric human data consistently reduces held-out action-prediction error. Across subsets constructed from 2K, 4K, 10K, and 20K raw recording hours, larger datasets converge to lower validation error within the measured range.

L = 0.101 - 0.005 · ln(D)
Stereo egocentric human-action validation error and log-linear data scaling trend
Human Data Scaling Laws. Held-out action-prediction error across training epochs and the fitted log-linear trend over raw stereo recording hours. The effective processed training duration is smaller after filtering and segmentation.

Value-Guided Closed-Loop Self-Evolution

Pretraining gives Motus2 a shared interaction prior; model-based reinforcement learning closes the decision-and-learning loop on robot data. Under a bounded sliding-window context, the policy proposes candidate action chunks, the simulator predicts their visual consequences, and the evaluator estimates their task progress. DiffusionNFT uses the same value signal to improve the policy distribution during post-training.

Curated demonstrations provide action-learning targets. Failed and suboptimal interactions provide valuable evidence for dynamics modeling and value learning.

Motus2 closed decision-and-learning loop
Model-Based Reinforcement Learning. The policy proposes actions, the simulator predicts consequences, and the evaluator provides the signal used for policy improvement.

Test-Time Scaling

Best-of-N planning spends additional inference compute without changing the model weights. The policy samples candidate action chunks, the simulator predicts a future for each candidate, and the evaluator ranks the branches before one action is executed.

Planning - search across imagined rollouts

Increasing the number of candidates broadens the search over predicted outcomes. The highest-value branch is selected for execution, after which planning is repeated from the next real observation.

Motus2 Best-of-N planning
Test-Time Planning. Candidate action chunks are compared through their predicted futures and values before execution.

Qualitative Value Trajectories

Predicted task progress is visualized throughout successful and failed executions across four tasks. All trajectories are evaluated by the same value model.

Predicted task progress for successful and failed Cut Reeds and Make Tea executions
Cut Reeds and Make Tea. Successful and failed executions.
Predicted task progress for successful and failed Multi-Finger and Put Phone executions
Multi-Finger and Put Phone. Successful and failed executions.

Working Memory

Motus2 uses a bounded sliding window as its default context and evaluates two extensions: full-history global autoregression and a MemoryWAM-style Hybrid Memory with recent frames, initial anchor frames, and compressed memory tokens. Their task performance is compared on long-context simulation and real-robot probes; the MBRL experiments use the sliding-window setting.

Sliding WindowBounded recent visual context
Global AutoregressionFull observation history
Hybrid MemoryRecent frames, anchors, and compressed tokens

Lightweight Tactile Expert

Visual and tactile observations are acquired continuously. The backbone denoises the complete action chunk to an intermediate state and produces a detached layer-wise KV cache. Immediately before each short sub-chunk is executed, a lightweight tactile expert uses the latest tactile window to complete its final denoising update. During training, auxiliary future-force prediction supervises contact evolution; Sharpa deformation images are conditioning inputs only and are not predicted. Deployment outputs only refined actions.

01

Intermediate action

The backbone denoises the complete action chunk to a fixed intermediate state.

02

Detached KV cache

Layer-wise backbone features are reused across rolling sub-chunk updates.

03

Action refinement

Recent tactile measurements refine each short action sub-chunk.

04

Future-force prediction

During training, the expert predicts the real force window following each action sub-chunk.

Robot Platforms and Alignment Collection

Three bimanual robot configurations are used for data collection and post-training. The separate human-robot alignment collection uses Wuji Human Gloves and does not command a robot.

Core Contributors

  • Hongzhe Bi: Base Model, Pre-Training, MBRL, Memory, Tactile Sensing, Sharpa & WuJi-2 Hardware, Real Robot Post-Training, Ego Data, Writing
  • Zihao Zhou: MBRL, Memory, Simulation, Real Robot Post-Training, Sharpa & WuJi-2 Hardware, Writing
  • Yihang Tang: Sharpa & WuJi-2 Hardware, Tactile Sensing, Real Robot Post-Training
  • Jingrui Pang: WuJi-1 Hardware, Human Data Collection, Real Robot Post-Training
  • Shuhe Huang: MBRL, Simulation, Writing

Acknowledgments

Hardware Partners

WuJi · Sharpa · Tianji

Data Partners

Ropedia · EgoScale · LightWheel · JD-Group · CyberOrigin

Motus, MotuBrain, and Motus2

Motus2 is a distinct 2026 research project in a broader line of world-action models developed by overlapping collaborators from GensPI and Tsinghua University. It extends the research direction represented by Motus and is technically related to MotuBrain, while introducing its own general-world-model interfaces, closed-loop self-evolution, working memory, and tactile expert.

The official project names are Motus, MotuBrain, and Motus2. “Motu” by itself is not the name of a separate model in this research family; references should use the complete project name to avoid ambiguity.

Motus2 robotics model vs. mOTUs2 profiler

This Motus2 is a robotics and embodied-AI model for dexterous manipulation. It is unrelated to mOTUs2, the similarly spelled bioinformatics profiler for microbial taxonomy.

2025

Motus

A unified latent action world model with understanding, action, and video-generation experts.

2026

MotuBrain

An advanced world-action model for robot control and a separate research project.

2026

Motus2

A self-evolving General World Model for dexterous manipulation with memory and touch.

Citation

arXiv preprint: Motus2: A Self-Evolving General World Model for Dexterous Manipulation · Read and discuss on alphaXiv

@misc{bi2026motus2,
  title  = {Motus2: A Self-Evolving General World Model for Dexterous Manipulation},
  author = {Hongzhe Bi and Zihao Zhou and Yihang Tang and Jingrui Pang and
            Shuhe Huang and Haitian Liu and Runqing Wang and Shuai Huang and
            Yichen Wang and Yiming Cheng and Ruowen Zhao and Zhenghua Li and
            Hengkai Tan and Xiaolong Liu and Jinhui Wan and Jiabao Liu and Min Zhao and
            Fan Bao and Jun Zhu},
  year   = {2026},
  eprint = {2608.30237},
  archivePrefix = {arXiv},
  primaryClass  = {cs.RO},
  url    = {https://arxiv.org/abs/2608.30237}
}