Kevin Musgrave 12d6da8130

feat(evaluation): Filter task ids by difficulty for SWE Gym rollouts (#11490) ...

Co-authored-by: Graham Neubig <neubig@gmail.com>
Co-authored-by: openhands <openhands@all-hands.dev>

2025-10-30 02:30:19 +00:00

..

agent_bench

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

aider_bench

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

algotune

Add a new benchmark: AlgoTune (#10724)

2025-09-04 18:08:50 +00:00

biocoder

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

bird

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

browsing_delegation

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

commit0

Replace All-Hands-AI references with OpenHands (#11287)

2025-10-26 01:52:45 +02:00

discoverybench

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

EDA

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

gaia

Implement model routing support (#9738)

2025-09-08 16:19:34 +07:00

gorilla

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

gpqa

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

humanevalfix

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

lca_ci_build_repair

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

logic_reasoning

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

miniwob

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

mint

Mint security eval fix (#11273)

2025-10-16 01:42:05 +00:00

ml_bench

Replace All-Hands-AI references with OpenHands (#11287)

2025-10-26 01:52:45 +02:00

multi_swe_bench

feat(evaluation): Filter task ids by difficulty for SWE Gym rollouts (#11490)

2025-10-30 02:30:19 +00:00

nocode_bench

Replace All-Hands-AI references with OpenHands (#11287)

2025-10-26 01:52:45 +02:00

scienceagentbench

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

swe_bench

Bugfix: respect config.tom system_prompt_filename when running swe-bench (#11091)

2025-10-27 21:55:05 +00:00

swe_perf

Replace All-Hands-AI references with OpenHands (#11287)

2025-10-26 01:52:45 +02:00

terminal_bench

Add README for terminal_bench evaluation harness (#9700)

2025-07-15 09:48:34 -04:00

testgeneval

Replace All-Hands-AI references with OpenHands (#11287)

2025-10-26 01:52:45 +02:00

the_agent_company

Fixes to unblock frontend (#11488)

2025-10-23 14:43:45 -06:00

toolqa

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

versicode

chore(lint): Apply comprehensive linting and formatting fixes (#10287)

2025-08-13 21:13:19 +02:00

visual_swe_bench

Replace All-Hands-AI references with OpenHands (#11287)

2025-10-26 01:52:45 +02:00

visualwebarena

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

webarena

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00