Taobao's generative search model reads a query image and a free-form instruction and writes the product's Semantic ID, and a controlled A/B test put page views up 17.90 percent
AspireAI community · arXiv (Taobao & Tmall Group, Alibaba)
PailitaoMMSearch2.0 removes the usual couplings that tie an industrial generative retrieval model to one fixed online scenario, scaling along three axes: data scaling via a reusable toolset composed into intent- and lifecycle-specific workflows for cold-start synthesis, quality control and real-traffic refinement; intent scaling through continual pre-training, mixed-budget supervised fine-tuning and a unified RL stage that pairs intent-balanced optimization with Sample-Beam rollouts aligned to multi-candidate serving; and scenario scaling that exposes quality-cost operating points across model capacity and reasoning budget. Deployed in multimodal search on Taobao Pailitao, a controlled online A/B test reports item page views up 17.90 percent, transactions up 27.04 percent and gross merchandise value up 8.94 percent. The honest limit is that this is a vendor technical report: the A/B test is described but not independently reproducible, and the numbers come from one commerce domain rather than general search.
Read the story and explore more from the AspireAI community.
Two sparse-autoencoder analyses have resisted scaling: matching semantically similar features across layers, and compressing large feature circuits into interpretable supernodes. This paper argues both are the same underlying problem, estimating semantic distances between SAE features that sit on different activation manifolds. Its representation treats each feature not as a single decoder vector but as an activation-weighted distribution over the hidden states expressing it, projects those distributions into a shared reference space, and compares them with Wasserstein distance. The representation is proved invariant to activation rescaling and stable under perturbation, and recovers true matches under finite-sample margin conditions. Empirically it outperformed decoder-vector and LLM-based baselines and captured subtle functional distinctions between related features, and it compressed large feature circuits into interpretable supernodes automatically. The limitation is that this is interpretability tooling: the paper demonstrates better feature matching and circuit compression, not that downstream interpretability claims become more accurate.