eval: add commit0 benchmark (#5153)

Co-authored-by: Xingyao Wang <xingyao6@illinois.edu>
Co-authored-by: Xingyao Wang <xingyao@all-hands.dev>
This commit is contained in:
Nan Jiang
2024-11-22 14:49:45 -05:00
committed by GitHub
parent 1021e0c416
commit 463d4e9a46
7 changed files with 1933 additions and 1046 deletions

1
.gitignore vendored
View File

@@ -175,6 +175,7 @@ evaluation/gaia/data
evaluation/gorilla/data
evaluation/toolqa/data
evaluation/scienceagentbench/benchmark
evaluation/commit0_bench/repos
# openhands resolver
output/