Parsimony

Open-source benchmark that compares how much net code AI coding models add when solving tasks, using patches from public benchmarks such as SWE-bench.

Visit website(opens in a new tab)