github/OpenHands
1
0
Fork 0
mirror of https://github.com/OpenHands/OpenHands.git synced 2025-12-26 05:48:36 +08:00
Code Issues Packages Projects Releases Wiki Activity

[Evaluation] Improve patch apply in SWE-Bench (#2684)

Browse Source 
* add newline after patch to fix patch apply

* only add newline if not empty
This commit is contained in:
Xingyao Wang 2024-06-29 14:11:07 +08:00 committed by GitHub
parent 7d31057904
commit e8cb6803df
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 3 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
evaluation/swe_bench/scripts/eval/convert_od_output_to_swe_json.py
View File

@ -17,7 +17,9 @@ model_name = os.path.basename(os.path.dirname(args.od_output_file))
def convert_row_to_swebench_format(row):
return {
'instance_id': row['instance_id'],
'model_patch': row['git_patch'].replace('\r\n', '\n'),
'model_patch': row['git_patch'].replace('\r\n', '\n').rstrip() + '\n'
if row['git_patch'].strip()
else '',
'model_name_or_path': model_name,
}