DevRev launches Enterprise-Bench, an open benchmark for agents in messy enterprise conditions

ITBrief·medium signal

On July 10 DevRev released Enterprise-Bench, an open benchmark that scores AI agents on accuracy, efficiency, and safety under fragmented data, siloed systems, and permission boundaries rather than simple consumer tasks, publishing the dataset, methodology, results, and evaluation traces with a public leaderboard. In its first tests DevRev's own 'Computer' product recorded 94.3% accuracy vs. 63.6% for Claude Code, using ~5,598 tokens per correct response against ~24,461 — figures worth independent scrutiny given the vendor ran its own benchmark. Still, an open, submittable enterprise-conditions leaderboard is a useful counterweight to consumer-task agent evals.