Niels Mündler 4b124d5906

Add inference for SWT-Bench (#7201) ...

Co-authored-by: Xingyao Wang <xingyao@all-hands.dev>
Co-authored-by: Graham Neubig <neubig@gmail.com>
Co-authored-by: Engel Nyst <enyst@users.noreply.github.com>
Co-authored-by: Calvin Smith <email@cjsmith.io>

2025-04-17 14:49:42 -06:00

..

agent_bench

[Refactor] split runtime initialization (create, connect, init) in cli scripts (#7036)

2025-03-03 00:19:25 +01:00

aider_bench

Update SWE-Bench README.md about RemoteRuntime (#7108)

2025-03-05 23:00:54 +08:00

biocoder

[Refactor] split runtime initialization (create, connect, init) in cli scripts (#7036)

2025-03-03 00:19:25 +01:00

bird

[Refactor] split runtime initialization (create, connect, init) in cli scripts (#7036)

2025-03-03 00:19:25 +01:00

browsing_delegation

[Refactor] split runtime initialization (create, connect, init) in cli scripts (#7036)

2025-03-03 00:19:25 +01:00

commit0

[Refactor] Rename codeact_* agent options to simple name (#7853)

2025-04-15 00:14:13 +02:00

discoverybench

[Refactor] Rename codeact_* agent options to simple name (#7853)

2025-04-15 00:14:13 +02:00

EDA

Replace use of requests with httpx (#7354)

2025-03-26 13:37:10 +00:00

gaia

Fix missing 'fi' statement in GAIA benchmark scripts/run_infer.sh (#7465)

2025-03-24 16:04:25 +00:00

gorilla

Replace use of requests with httpx (#7354)

2025-03-26 13:37:10 +00:00

gpqa

[Refactor] split runtime initialization (create, connect, init) in cli scripts (#7036)

2025-03-03 00:19:25 +01:00

humanevalfix

[Refactor] split runtime initialization (create, connect, init) in cli scripts (#7036)

2025-03-03 00:19:25 +01:00

lca_ci_build_repair

Jetbrains CI Benchmark (#7811)

2025-04-17 15:10:20 +00:00

logic_reasoning

[Refactor] split runtime initialization (create, connect, init) in cli scripts (#7036)

2025-03-03 00:19:25 +01:00

miniwob

Update SWE-Bench README.md about RemoteRuntime (#7108)

2025-03-05 23:00:54 +08:00

mint

[Refactor] split runtime initialization (create, connect, init) in cli scripts (#7036)

2025-03-03 00:19:25 +01:00

ml_bench

[Refactor] split runtime initialization (create, connect, init) in cli scripts (#7036)

2025-03-03 00:19:25 +01:00

scienceagentbench

[Refactor] split runtime initialization (create, connect, init) in cli scripts (#7036)

2025-03-03 00:19:25 +01:00

swe_bench

Add inference for SWT-Bench (#7201)

2025-04-17 14:49:42 -06:00

testgeneval

[Refactor] Rename codeact_* agent options to simple name (#7853)

2025-04-15 00:14:13 +02:00

the_agent_company

[Evaluation] Fix sandbox config in TAC (#7684)

2025-04-03 08:19:10 +00:00

toolqa

Replace use of requests with httpx (#7354)

2025-03-26 13:37:10 +00:00

visualwebarena

[Refactor] split runtime initialization (create, connect, init) in cli scripts (#7036)

2025-03-03 00:19:25 +01:00

webarena

[Refactor] split runtime initialization (create, connect, init) in cli scripts (#7036)

2025-03-03 00:19:25 +01:00