Tools
LiteLLM's router can now mirror live traffic to several shadow models at once
v1.103.0-dev.2 (2026-09-18 02:42 UTC) adds streaming shadow traffic and fans `silent_model` out to multiple targets (#41368), so you can evaluate two or three candidate models against real production prompts without serving their output. The same release authorizes JWT OAuth credential persistence for MCP (#41314), bounds the content filter to a per-chunk window instead of rescanning (#41407), recounts tokens when a streamed Responses call completes without usage (#41337), and tolerates Anthropic `message_delta` events with no usage field while streaming (#41336).
Source
↳ Follow the thread