Reddit
Liquid AI's LFM2-24B Runs at 50 tok/s in a Web Browser via WebGPU — 24B MoE with 2B Active Params
Liquid AI demonstrated their LFM2-24B-A2B running natively in a web browser using WebGPU (Transformers.js), achieving ~50 tokens/second on M4 Max, with the smaller 8B-A1B variant hitting 100+ tok/s. The MoE model uses a hybrid architecture blending attention with convolutions for linear-time inference. A Hugging Face Space (LiquidAI/LFM2-WebGPU) provides an in-browser demo with tool-calling support. This is a meaningful milestone for on-device inference — a 24B parameter model running in a browser tab with no installation opens new deployment patterns for privacy-first applications.
↳ Follow the thread