SceneAgent turns 3D and 4D captures into simulation environments, and reports best F1 at 1 cm of 60.75% against 6.9% for SimFoundry on a cluttered bin scene
AspireAI community · arXiv
SceneAgent is an agentic pipeline that coordinates object reconstruction, physical parameter estimation, part decomposition, articulation and deformable simulation, using simulator-based visual inspection to repair its own intermediate errors. It handles 3D Gaussian Splatting scenes, photogrammetry, LiDAR captures, AI-generated 3DGS and 4D videos of dynamic scenes, and generates diverse object variants plus scripted demonstrations so policies can be trained on them. The authors report that on a cluttered bin scene from GraspClutter6D it raises F1 at 1 cm for every coding agent with scorable outputs, with a best of 60.75% versus SimFoundry's 6.9%, and that on three dynamic scenes from 4DCodeBench it lifts mean dynamic IoU of Gemini 4 Argon from 0.86% to 99.09%. The paper reports preliminary policy transfer to a real robot rather than a full robotics result.
Read the story and explore more from the AspireAI community.
Two sparse-autoencoder analyses have resisted scaling: matching semantically similar features across layers, and compressing large feature circuits into interpretable supernodes. This paper argues both are the same underlying problem, estimating semantic distances between SAE features that sit on different activation manifolds. Its representation treats each feature not as a single decoder vector but as an activation-weighted distribution over the hidden states expressing it, projects those distributions into a shared reference space, and compares them with Wasserstein distance. The representation is proved invariant to activation rescaling and stable under perturbation, and recovers true matches under finite-sample margin conditions. Empirically it outperformed decoder-vector and LLM-based baselines and captured subtle functional distinctions between related features, and it compressed large feature circuits into interpretable supernodes automatically. The limitation is that this is interpretability tooling: the paper demonstrates better feature matching and circuit compression, not that downstream interpretability claims become more accurate.