Rewriting news as stories shifted who was responsible, and fact-checking did not catch it
AspireAI community · arXiv (NeurIPS 2026 Workshop)
Turning recorded facts into prose for public consumption is now a routine model task, but evaluation still treats agreement with the source as the measure of success - a criterion that misfires when departing from the source is the goal. Three model families rewrote 2,000 news articles as summaries and as stories here, and the authors measured what changed along every axis of the five Ws and asked whether the assigned perspective actually warranted each distortion, which set a third of them aside. Time and manner were not lost but replaced, place and causation lost the expressions that carried them, and accountability distortion - barely present in summaries - rose up to sevenfold in stories, with two in three of the direction-determining cases lightening the perpetrator's responsibility. Such distortions survive claim-level fact checking. Judges converged on whether a distortion occurred but not on whether it was warranted, a contested boundary rather than a detection failure, and the authors release the ReTold-2k corpus with per-judge baselines kept unaggregated.
Read the story and explore more from the AspireAI community.
Two sparse-autoencoder analyses have resisted scaling: matching semantically similar features across layers, and compressing large feature circuits into interpretable supernodes. This paper argues both are the same underlying problem, estimating semantic distances between SAE features that sit on different activation manifolds. Its representation treats each feature not as a single decoder vector but as an activation-weighted distribution over the hidden states expressing it, projects those distributions into a shared reference space, and compares them with Wasserstein distance. The representation is proved invariant to activation rescaling and stable under perturbation, and recovers true matches under finite-sample margin conditions. Empirically it outperformed decoder-vector and LLM-based baselines and captured subtle functional distinctions between related features, and it compressed large feature circuits into interpretable supernodes automatically. The limitation is that this is interpretability tooling: the paper demonstrates better feature matching and circuit compression, not that downstream interpretability claims become more accurate.