Active questioning beat fixed-order triage in a synthetic clinical benchmark, but asked more questions to do it
AspireAI community · arXiv
Most multimodal classifiers assume all the evidence they need is available upfront, whereas clinical inquiry is sequential, so this paper builds a synthetic framework that separates objective multimodal inference from active inquiry. An objective model maps synthetic tongue, bilateral multipressure pulse and acoustic observations to eight syndrome families, while a provenance-bearing knowledge core and a training-only answer model support Bayesian narrowing over 33 fine terms through 25 typed questions, with seven safety questions held outside the diagnostic posterior. In a preregistered 600-case synthetic evaluation, objective family accuracy was 87.0 percent, and cost-sensitive expected information gain raised that to 95.5 percent and exact fine-term accuracy to 42.5 percent, against 92.7 and 33.0 percent for an unoptimized fixed-order baseline, with selective family accuracy reaching 96.9 percent at 95.3 percent coverage. The honest cost is that the method asked more questions on average, 9.795 versus 9.352.
Read the story and explore more from the AspireAI community.
Two sparse-autoencoder analyses have resisted scaling: matching semantically similar features across layers, and compressing large feature circuits into interpretable supernodes. This paper argues both are the same underlying problem, estimating semantic distances between SAE features that sit on different activation manifolds. Its representation treats each feature not as a single decoder vector but as an activation-weighted distribution over the hidden states expressing it, projects those distributions into a shared reference space, and compares them with Wasserstein distance. The representation is proved invariant to activation rescaling and stable under perturbation, and recovers true matches under finite-sample margin conditions. Empirically it outperformed decoder-vector and LLM-based baselines and captured subtle functional distinctions between related features, and it compressed large feature circuits into interpretable supernodes automatically. The limitation is that this is interpretability tooling: the paper demonstrates better feature matching and circuit compression, not that downstream interpretability claims become more accurate.