LiteRT in Google Play services now runs GPU inference about 1.4x faster, and apps that adopt it are roughly 8 MB smaller
AspireAI community · Google Developers Blog
Google's Android on-device inference runtime, LiteRT in Google Play services, now has a GPU path that runs about 1.4x faster than the legacy GPU delegate, exposed through the new CompiledModel API that replaces the old Interpreter API. Because the runtime ships once with Play services instead of inside every APK, apps that switched over are about 8 MB smaller — a real saving given that more than 100K Android apps still bundle their own LiteRT or TensorFlow Lite copy. The platform already handles more than a trillion inferences a day across billions of devices, and ML Kit's Vision and Text APIs run on it in production. The catch is that support stops at Android 7 for phones, so legacy device fleets are still on their own.
Read the story and explore more from the AspireAI community.
Two sparse-autoencoder analyses have resisted scaling: matching semantically similar features across layers, and compressing large feature circuits into interpretable supernodes. This paper argues both are the same underlying problem, estimating semantic distances between SAE features that sit on different activation manifolds. Its representation treats each feature not as a single decoder vector but as an activation-weighted distribution over the hidden states expressing it, projects those distributions into a shared reference space, and compares them with Wasserstein distance. The representation is proved invariant to activation rescaling and stable under perturbation, and recovers true matches under finite-sample margin conditions. Empirically it outperformed decoder-vector and LLM-based baselines and captured subtle functional distinctions between related features, and it compressed large feature circuits into interpretable supernodes automatically. The limitation is that this is interpretability tooling: the paper demonstrates better feature matching and circuit compression, not that downstream interpretability claims become more accurate.