mirror of https://github.com/OpenHands/OpenHands.git synced 2025-12-26 13:52:43 +08:00

History

Feat: Add Vision Input Support for LLM with Vision Capabilities (#2848 )

* add image feature

* fix-linting

* check model support for images

* add comment

* Add image support to other models

* Add images to chat

* fix linting

* fix test issues

* refactor variable names and import

* fix tests

* fix chat message tests

* fix linting

* add pydantic class message

* use message

* remove redundant comments

* remove redundant comments

* change Message class

* remove unintended change

* fix integration tests using regenerate.sh

* rename image_bas64 to images_url, fix tests

* rename Message.py to message, change reminder append logic, add unit tests

* remove comment, fix error to merge

* codeact_swe_agent

* fix f string

* update eventstream integration tests

* add missing if check in codeact_swe_agent

* update integration tests

* Update frontend/src/components/chat/ChatInput.tsx

* Update frontend/src/components/chat/ChatInput.tsx

* Update frontend/src/components/chat/ChatInput.tsx

* Update frontend/src/components/chat/ChatInput.tsx

* Update frontend/src/components/chat/ChatMessage.tsx

---------

Co-authored-by: tobitege <tobitege@gmx.de>
Co-authored-by: Xingyao Wang <xingyao6@illinois.edu>
Co-authored-by: sp.wack <83104063+amanape@users.noreply.github.com>

2024-08-04 02:26:22 +08:00

__init__.py

[Feat] A competitive Web Browsing agent (#1856 )

2024-05-21 19:20:33 +00:00

browsing_agent.py

Feat: Add Vision Input Support for LLM with Vision Capabilities (#2848 )

2024-08-04 02:26:22 +08:00

prompt.py

docs: updated docstrings using ruff's autofix feature (#2923 )

2024-07-16 01:35:33 +00:00

README.md

Improve browsing agent prompts, allowing agent to properly finish when done (#1993 )

2024-05-24 00:02:19 -07:00

response_parser.py

docs: updated docstrings using ruff's autofix feature (#2923 )

2024-07-16 01:35:33 +00:00

utils.py

docs: updated docstrings using ruff's autofix feature (#2923 )

2024-07-16 01:35:33 +00:00

README.md

Browsing Agent Framework

This folder implements the basic BrowserGym demo agent that enables full-featured web browsing.

Test run

Note that for browsing tasks, GPT-4 is usually a requirement to get reasonable results, due to the complexity of the web page structures.

poetry run python ./opendevin/core/main.py \
           -i 10 \
           -t "tell me the usa's president using google search" \
           -c BrowsingAgent \
           -m gpt-4o-2024-05-13