GigaChat 3.1 Ultra: 702B MoE Model Released Under MIT License with Native FP8 Training

r/LocalLLaMA / Hugging Face·medium signal

Sber released GigaChat-3.1-Ultra-702B (36B active params) and Lightning-10B-A1.8B under MIT license. Unlike the preview, 3.1 Ultra includes a full DPO stage redesigned for MoE and was trained natively in FP8 (not post-quantized). Features Multi-head Latent Attention for compressed KV cache and Multi-Token Prediction for up to 40% faster inference via speculative decoding. First serious Russian open-weights competitor at the 702B scale.