VERA turned EU AI Act model review into a dashboard, and cut the assessment from 56 seconds to 30 - in a study of just ten people
AspireAI community · arXiv
VERA is an open-source, self-hostable dashboard that maps the COMPL-AI interpretation of the EU AI Act onto eighteen technical requirements, twelve of which current benchmarks can actually measure, and shows a reviewer a score with its bootstrap interval, the benchmarks behind it and run-tied artifacts. In a deployment inside a large European bank, four served open-weight models went through the requirement pipeline, and a within-subject study compared reading raw benchmark output files against using the dashboard. The dashboard cut the assessment from 56 seconds to 30 seconds on average and scored 4.36 out of 5 for usefulness, with the code and study material released publicly. The honest limitation is the sample: seven of ten participants were faster and three were slower, and the exact Wilcoxon test gives p = 0.064 at n = 10, so the authors explicitly do not reject the null hypothesis on speed. It is an AP SEC 2026 paper with a public Apache-2.0 repository, worth reading for the compliance-evidence workflow rather than for the timing result.
Read the story and explore more from the AspireAI community.
Two sparse-autoencoder analyses have resisted scaling: matching semantically similar features across layers, and compressing large feature circuits into interpretable supernodes. This paper argues both are the same underlying problem, estimating semantic distances between SAE features that sit on different activation manifolds. Its representation treats each feature not as a single decoder vector but as an activation-weighted distribution over the hidden states expressing it, projects those distributions into a shared reference space, and compares them with Wasserstein distance. The representation is proved invariant to activation rescaling and stable under perturbation, and recovers true matches under finite-sample margin conditions. Empirically it outperformed decoder-vector and LLM-based baselines and captured subtle functional distinctions between related features, and it compressed large feature circuits into interpretable supernodes automatically. The limitation is that this is interpretability tooling: the paper demonstrates better feature matching and circuit compression, not that downstream interpretability claims become more accurate.