mirror of
https://github.com/OpenHands/OpenHands.git
synced 2025-12-26 05:48:36 +08:00
7c3ea9fa08
* Update LOCAL_LLM_GUIDE.md * Create WINDOWS_WSL_GUIDE.md * update docs * Update docs/Agents.md * update windows docs --------- Co-authored-by: Engel Nyst <enyst@users.noreply.github.com>
1.2 KiB
1.2 KiB
Azure OpenAI LLM Guide
1. Completion
OpenDevin uses LiteLLM for completion calls. You can find their documentation on Azure here
azure openai configs
When running the OpenDevin Docker image, you'll need to set the following environment variables using -e:
LLM_BASE_URL="<azure-api-base-url>" # e.g. "https://openai-gpt-4-test-v-1.openai.azure.com/"
LLM_API_KEY="<azure-api-key>"
LLM_MODEL="azure/<your-gpt-deployment-name>"
AZURE_API_VERSION = "<api-version>" # e.g. "2024-02-15-preview"
2. Embeddings
OpenDevin uses llama-index for embeddings. You can find their documentation on Azure here
azure openai configs
The model used for Azure OpenAI embeddings is "text-embedding-ada-002". You need the correct deployment name for this model in your Azure account.
When running OpenDevin in Docker, set the following environment variables using -e:
LLM_EMBEDDING_MODEL="azureopenai"
DEPLOYMENT_NAME = "<your-embedding-deployment-name>" # e.g. "TextEmbedding...<etc>"
LLM_API_VERSION = "<api-version>" # e.g. "2024-02-15-preview"