Reddit
Qwen-Scope: Official Sparse Autoencoders Released for Qwen 3.5 Models — Interpretability Across 2B to 35B MoE
The Qwen team released Qwen-Scope, a collection of Sparse Autoencoders (SAEs) mapping internal features for the residual stream across all layers of the Qwen 3.5 family, from the 2B dense model to the 35B MoE. This enables mechanistic interpretability research on one of the most widely deployed open-weight model families. 133 upvotes on r/LocalLLaMA. This is significant because SAE releases from the original model team provide ground-truth feature mappings that third-party researchers can't easily replicate.
Source
↳ Follow the thread