Sources
Brood War Bench runs a full round-robin of coding agents playing StarCraft, and publishes dollars per game
Ben Swerdlow built a version of StarCraft: Brood War playable only through agent interfaces, then had every model and effort configuration play every other in a round-robin on parallel Freestyle VMs. Codex Astra at xhigh effort went 18-0 at $10.54 per game, Codex Astra medium went 16-2 at $15.11, Claude Fable went 15-3 at $12.24, and Codex 5.6 Sol at medium went 13-5 at $5.12. Publishing cost alongside win rate is the useful move here, since the cheapest configuration in the top five costs a third of the second-place one for a 16-percentage-point drop.
↳ Follow the thread