github/OpenHands
1
0
Fork 0
mirror of https://github.com/OpenHands/OpenHands.git synced 2025-12-26 05:48:36 +08:00
Code Issues Packages Projects Releases Wiki Activity
OpenHands/docs/modules/usage/llms/google-llms.md
mamoodi 4de6c782cc
Add doc style guide and make docs adhere to it (#5983) 
Co-authored-by: Engel Nyst <enyst@users.noreply.github.com>
2025-01-03 12:14:14 -05:00

1.4 KiB
Raw Blame History

Google Gemini/Vertex

OpenHands uses LiteLLM to make calls to Google's chat models. You can find their documentation on using Google as a provider:

Gemini - Google AI Studio Configs

When running OpenHands, you'll need to set the following in the OpenHands UI through the Settings:

  • LLM Provider to Gemini
  • LLM Model to the model you will be using. If the model is not in the list, toggle Advanced Options, and enter it in Custom Model (e.g. gemini/<model-name> like gemini/gemini-1.5-pro).
  • API Key to your Gemini API key

VertexAI - Google Cloud Platform Configs

To use Vertex AI through Google Cloud Platform when running OpenHands, you'll need to set the following environment variables using -e in the docker run command:

GOOGLE_APPLICATION_CREDENTIALS="<json-dump-of-gcp-service-account-json>"
VERTEXAI_PROJECT="<your-gcp-project-id>"
VERTEXAI_LOCATION="<your-gcp-location>"

Then set the following in the OpenHands UI through the Settings:

  • LLM Provider to VertexAI
  • LLM Model to the model you will be using. If the model is not in the list, toggle Advanced Options, and enter it in Custom Model (e.g. vertex_ai/<model-name>).