OpenAI's LifeVal tracks models on everyday tasks, and GPT-6 Astra scores 80.6 percent average reward
AspireAI community · OpenAI
OpenAI built LifeVal to measure model performance on the practical tasks people actually want help with, rather than on academic knowledge benchmarks. The task set came from the American Time Use Survey and the Multinational Time Use Study, expanded with a new demographically representative survey of 3,995 respondents, and spans caregiving, health, education, household administration, personal finances, shopping and government services. Across model releases from December 2025 onward, average unweighted reward rose from 49.3 percent for GPT-5.2 to 80.6 percent for GPT-6 Astra. Individual tasks show the spread: finding a family home that fits a budget scored 100 percent, organising flood-preparation volunteers 98.0 percent, and watching a game remotely with a grandparent 96.3 percent. OpenAI says it used the evaluation to drive improvement over the past year on browser use, computer use and connectors. The honest limitation is that this is a vendor-run evaluation, and the page does not publish the task set or scoring code, so the numbers cannot be independently reproduced, and it measures task completion rather than whether the answer was trustworthy.
Read the story and explore more from the AspireAI community.
Two sparse-autoencoder analyses have resisted scaling: matching semantically similar features across layers, and compressing large feature circuits into interpretable supernodes. This paper argues both are the same underlying problem, estimating semantic distances between SAE features that sit on different activation manifolds. Its representation treats each feature not as a single decoder vector but as an activation-weighted distribution over the hidden states expressing it, projects those distributions into a shared reference space, and compares them with Wasserstein distance. The representation is proved invariant to activation rescaling and stable under perturbation, and recovers true matches under finite-sample margin conditions. Empirically it outperformed decoder-vector and LLM-based baselines and captured subtle functional distinctions between related features, and it compressed large feature circuits into interpretable supernodes automatically. The limitation is that this is interpretability tooling: the paper demonstrates better feature matching and circuit compression, not that downstream interpretability claims become more accurate.