NVIDIA's SoL-Pi claims 45-49% fewer tokens for Pi agents, but the first community smoke test didn't reproduce it

NVIDIA Research (github.com/NVlabs/SoL-Pi; via r/LocalLLaMA, 259 upvotes)·medium signalXBlueskyLinkedInCopy link

NVlabs published an MIT-licensed Pi extension (first release September 7, blog added September 9) with four opt-in mechanisms that came out of its auto-research loops: Action Fusion merges an edit with its validation command, ObservationPack pages large tool outputs, a reducer compresses logs into receipts, and online compaction retires finished plan steps. NVIDIA reports 45-49% fewer tokens and about a third lower cost than stock Pi while keeping roughly 94% of Pi's EdgeBench score. An r/LocalLLaMA user who ran it on a few DeepSWE tasks called the results "not promising", and another warned that it would cause cache misses on local setups.