Tencent released Hy-Nomas, an open-weight video world model you can steer with text and camera moves, and it runs on one RTX 4090
AspireAI community · Tencent Hunyuan (Hugging Face)
Hy-Nomas generates a world one video segment at a time and lets you keep directing it: text instructions for subjects, actions, style and environment, plus camera trajectories for viewpoint. The architecture is a segment-autoregressive diffusion transformer with 54 dual-stream MMDiT blocks, a Qwen2.5-VL-7B-Instruct text encoder, camera-conditioning modules and a fine-tuned PixelUMM video decoder, with a persistent KV cache carrying context between segments. The distilled inference configuration runs 8 denoising steps at 720x1280 and 24 FPS; a separate configuration uses INT8 DiT weights, an INT8 KV cache, an FP8 decoder and CPU offload to run on a single NVIDIA GeForce RTX 4090. Alongside it, Tencent released Hy-Nomas-Bench, four benchmarks with 280 test cases covering multi-turn free-form text interaction, camera navigation, interleaved text and camera control, and spatial memory. The weights are Apache-2.0 and the code, project site and benchmark dataset are public, but the technical report is still marked 'coming soon', so the capability claims currently rest on the model card and the benchmark suite rather than on a published paper.
Read the story and explore more from the AspireAI community.
Two sparse-autoencoder analyses have resisted scaling: matching semantically similar features across layers, and compressing large feature circuits into interpretable supernodes. This paper argues both are the same underlying problem, estimating semantic distances between SAE features that sit on different activation manifolds. Its representation treats each feature not as a single decoder vector but as an activation-weighted distribution over the hidden states expressing it, projects those distributions into a shared reference space, and compares them with Wasserstein distance. The representation is proved invariant to activation rescaling and stable under perturbation, and recovers true matches under finite-sample margin conditions. Empirically it outperformed decoder-vector and LLM-based baselines and captured subtle functional distinctions between related features, and it compressed large feature circuits into interpretable supernodes automatically. The limitation is that this is interpretability tooling: the paper demonstrates better feature matching and circuit compression, not that downstream interpretability claims become more accurate.