Test your agent against messy requirement histories, not the consolidated ticket.

SpecPath found 35 of 100 passing implementations broke when only the revision path changed, with aggregate accuracy looking identical across paths. Build your eval set from real multi-turn clarification threads with amendments and reversals. Path sensitivity is invisible to standard benchmarking and will bite you in production, where every requirement arrives sideways.