github/OpenHands
1
0
Fork 0
mirror of https://github.com/OpenHands/OpenHands.git synced 2025-12-26 05:48:36 +08:00
Code Issues Packages Projects Releases Wiki Activity
OpenHands/docs/guides/AzureLLMs.md
மனோஜ்குமார் பழனிச்சாமி 0356f6ec89
Azure LLM fix (#1227) 
* azure embedding fix

* corrected embedding config

* fixed doc
2024-04-20 01:05:14 +02:00

1.2 KiB
Raw Blame History

Azure OpenAI LLM Guide

1. Completion

OpenDevin uses LiteLLM for completion calls. You can find their documentation on Azure here

azure openai configs

When running the OpenDevin Docker image, you'll need to set the following environment variables using -e:

LLM_BASE_URL="<azure-api-base-url>"          # e.g. "https://openai-gpt-4-test-v-1.openai.azure.com/"
LLM_API_KEY="<azure-api-key>"
LLM_MODEL="azure/<your-gpt-deployment-name>"
LLM_API_VERSION = "<api-version>"          # e.g. "2024-02-15-preview"

2. Embeddings

OpenDevin uses llama-index for embeddings. You can find their documentation on Azure here

azure openai configs

The model used for Azure OpenAI embeddings is "text-embedding-ada-002". You need the correct deployment name for this model in your Azure account.

When running OpenDevin in Docker, set the following environment variables using -e:

LLM_EMBEDDING_MODEL="azureopenai"
LLM_EMBEDDING_DEPLOYMENT_NAME = "<your-embedding-deployment-name>"        # e.g. "TextEmbedding...<etc>"
LLM_API_VERSION = "<api-version>"         # e.g. "2024-02-15-preview"