Xingyao Wang b082ccc0fb

feat(llm): add support for deepseek and gpt-5-mini, util for token count (#10626) ...

Co-authored-by: openhands <openhands@all-hands.dev>

2025-08-27 11:03:35 +08:00

..

agent_bench

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

aider_bench

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

biocoder

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

bird

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

browsing_delegation

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

commit0

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

discoverybench

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

EDA

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

gaia

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

gorilla

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

gpqa

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

humanevalfix

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

lca_ci_build_repair

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

logic_reasoning

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

miniwob

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

mint

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

ml_bench

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

multi_swe_bench

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

nocode_bench

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

scienceagentbench

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

swe_bench

feat(llm): add support for deepseek and gpt-5-mini, util for token count (#10626)

2025-08-27 11:03:35 +08:00

terminal_bench

Add README for terminal_bench evaluation harness (#9700)

2025-07-15 09:48:34 -04:00

testgeneval

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

the_agent_company

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

toolqa

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

versicode

chore(lint): Apply comprehensive linting and formatting fixes (#10287)

2025-08-13 21:13:19 +02:00

visual_swe_bench

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

visualwebarena

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00

webarena

Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

2025-08-22 13:34:02 +00:00