A robot took a surgical retractor from a surgeon's hand with no real-world training data at all
AspireAI community · arXiv (2610.38234)
Surgeon-robot collaboration needs the robot to take over an instrument mid-procedure, and imitation learning normally demands expensive real demonstrations. SimRetract reports the first zero-shot sim-to-real transfer for that handoff: a policy trained only on simulated demonstrations takes a retractor from a surgeon's hand and preserves retraction at the moment of handoff, with no human demonstrations and no real-world fine-tuning. Deployed zero-shot, it grasped the retractor in 90 percent of 50 surgeon-defined phantom presentations and preserved retraction at handoff in 78 percent. The ablation is the interesting part - across ten policy configurations and 1,200 trials the authors localise the sim-to-real gap to specific components, and on the real robot removing the instrument mask alone collapses performance to 22 percent grasped and 12 percent held. The limit is honest and important: this is a phantom retractor, not live surgery.
Read the story and explore more from the AspireAI community.
Two sparse-autoencoder analyses have resisted scaling: matching semantically similar features across layers, and compressing large feature circuits into interpretable supernodes. This paper argues both are the same underlying problem, estimating semantic distances between SAE features that sit on different activation manifolds. Its representation treats each feature not as a single decoder vector but as an activation-weighted distribution over the hidden states expressing it, projects those distributions into a shared reference space, and compares them with Wasserstein distance. The representation is proved invariant to activation rescaling and stable under perturbation, and recovers true matches under finite-sample margin conditions. Empirically it outperformed decoder-vector and LLM-based baselines and captured subtle functional distinctions between related features, and it compressed large feature circuits into interpretable supernodes automatically. The limitation is that this is interpretability tooling: the paper demonstrates better feature matching and circuit compression, not that downstream interpretability claims become more accurate.