Movens-Zero scaled humanoid motion foundation models to 15 million human sequences and 5 million robot-executable ones
AspireAI community · arXiv
A humanoid motion foundation model is limited by how much training data actually describes something a robot can do. Movens-5M is built from raw internet video through clip generation, quality filtering, semantic annotation, motion recovery and physical refinement with humanoid retargeting, giving 15 million human-motion sequences and 5 million physically executable humanoid-motion sequences spanning over 10,000 hours, aligned with text, RGB video, speech and music. On top of that, Movens-Zero trains one action expert jointly across seven generation tasks with flow matching, and Multimodal Real-Time Chunking stitches overlapping chunks under updated instructions for closed-loop control. Gains held up consistently across all four modalities as execution-verified data scaled from 1 percent to 100 percent and action-expert capacity from 64M to 911M parameters. The honest limitation is that this is a technical report rather than a peer-reviewed paper, and the released motion data is filtered from human video rather than measured robot execution, so quality depends on the retargeting and verification pipeline.
Read the story and explore more from the AspireAI community.
Two sparse-autoencoder analyses have resisted scaling: matching semantically similar features across layers, and compressing large feature circuits into interpretable supernodes. This paper argues both are the same underlying problem, estimating semantic distances between SAE features that sit on different activation manifolds. Its representation treats each feature not as a single decoder vector but as an activation-weighted distribution over the hidden states expressing it, projects those distributions into a shared reference space, and compares them with Wasserstein distance. The representation is proved invariant to activation rescaling and stable under perturbation, and recovers true matches under finite-sample margin conditions. Empirically it outperformed decoder-vector and LLM-based baselines and captured subtle functional distinctions between related features, and it compressed large feature circuits into interpretable supernodes automatically. The limitation is that this is interpretability tooling: the paper demonstrates better feature matching and circuit compression, not that downstream interpretability claims become more accurate.