406 Commits

Author	SHA1	Message	Date
zch-cc	cfefc47439	Move regression tests to evaluation/ (#86) ... * Move regression tests to evaluation/ * use pythnon instead of docker in the script * add model para * change python to python3 * bug fix	2024-03-22 23:26:37 +08:00
libowen2121	40a3614e80	Add a roadmap for eval (#92)	2024-03-22 20:27:30 +08:00
Xingyao Wang	2d5c8f1060	change to OpenDevin fork (#89)	2024-03-22 18:30:12 +08:00
Xingyao Wang	5ff96111f0	A starting point for SWE-Bench Evaluation with docker (#60) ... * a starting point for SWE-Bench evaluation with docker * fix the swe-bench uid issue * typo fixed * fix conda missing issue * move files based on new PR * Update doc and gitignore using devin prediction file from #81 * fix typo * add a sentence * fix typo in path * fix path --------- Co-authored-by: Binyuan Hui <binyuan.hby@alibaba-inc.com>	2024-03-22 12:43:49 +08:00
Jiaxin Pei	dc88dac296	adding a script to fetch and convert devin's output for evaluation (#81) ... * adding code to fetch and convert devin's output for evaluation * update README.md * update code for fetching and processing devin's outputs * update code for fetching and processing devin's outputs	2024-03-22 01:33:01 +08:00
Binyuan Hui	f99f4ebdaa	fix: typo in the evaluation folder name. (#66)	2024-03-20 23:00:09 +08:00