Robert Brennan 1eade7d188
First pass at a control loop (#35)
* initialize control loop

* add todo

* more todo

* add dockerignore

* add notes to prompt

* encourage llm to finish

* add debug env

* update prompts a bit

* fix task prompts

* add basic regression framework

* add hello-world regression case

* add hello-name test case

* fix workspace ignore

* document regression script

* add python-cli test case

* add default git config

* add help regression test

* add node rewrite test case

* add react-todo test case

* fix dockerfile

* add ability to run background commands

* add client-server test case

* update regression readme

* better support for background commands

* update tests

* fix bug in command removal
2024-03-20 18:44:50 +08:00
..
2024-03-20 18:44:50 +08:00
2024-03-20 18:44:50 +08:00
2024-03-20 18:44:50 +08:00
2024-03-20 18:44:50 +08:00

Regression Tests

These files demonstrate how OpenDevin currently handles certain scenarios.

To add a new regression case:

name="hello-script"

# The start directory contains the initial state of the project the agent will work on
# Add any files you'd like here.
mkdir -p ./agent/regression/cases/$name/start

# task.txt contains the task to be accomplished
echo "write a hello world script" >> ./agent/regression/cases/$name/task.txt

# Single out your test case using the TEST_CASE environment variable
TEST_CASE=$name ./agent/regression/run.sh