OpenVINO 2026.4 adds CPU and GPU support for Qwen3.8 27B, Gemma 4 12B, and DeepSeek OCR-2

GitHub / openvinotoolkit (via r/LocalLLaMA)·medium signalXBlueskyLinkedInCopy link

Intel shipped OpenVINO 2026.4 on 2026-09-16. New CPU/GPU model support covers Kokoro-82M, Qwen3-VL-4B with EAGLE-3 speculative decoding, Qwen3-ASR, Muse Glimmer 30B, Qwen3.8 27B, Gemma 4 12B, Hy-MT2-1.8B, DeepSeek OCR-2, and Granite 4.0 H Micro, with Gemma-3n on CPU and FLUX.2-Klein 4B plus Kokoro-82M on NPUs. Early-release CPU/GPU enablement adds Qwen-Image, Z-Image-Turbo, Granite 4.0 H Tiny, Fun-ASR-Nano, LFM2.5-8B-A1B, MiniCPM5-2B, RF-DETR, and BGE Reranker-V2-M3. The NPU line is the one that matters for anyone shipping local inference on Intel laptops rather than on a discrete GPU.