github/OpenHands
1
0
Fork 0
mirror of https://github.com/OpenHands/OpenHands.git synced 2025-12-26 05:48:36 +08:00
Code Issues Packages Projects Releases Wiki Activity

fix: set tool_choice to none for non-fncall models (#6652)

Browse Source
This commit is contained in:
Xingyao Wang 2025-02-07 12:49:08 -05:00 committed by GitHub
parent 5fa2634d60
commit 52ac2729f7
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 3 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
openhands/llm/llm.py
View File

@ -232,6 +232,9 @@ class LLM(RetryMixin, DebugMixin):
kwargs['stop'] = STOP_WORDS
mock_fncall_tools = kwargs.pop('tools')
kwargs['tool_choice'] = (
'none' # force no tool calling because we're mocking it - without it, it will cause issue with sglang
)
# if we have no messages, something went very wrong
if not messages: