From 19dcddd86546dd2475de492cbf1e60a69a1c9867 Mon Sep 17 00:00:00 2001 From: vekoada Date: Sat, 8 Feb 2025 16:39:30 -0700 Subject: [PATCH] Expand local LLM instructions --- README.md | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/README.md b/README.md index 5066a85..86b1efe 100644 --- a/README.md +++ b/README.md @@ -102,6 +102,10 @@ FIRECRAWL_KEY="your_firecrawl_key" OPENAI_KEY="your_openai_key" ``` +To use local LLM, comment out `OPENAI_KEY` and instead uncomment `OPENAI_ENDPOINT` and `OPENAI_MODEL`: +- Set `OPENAI_ENDPOINT` to the address of your local server (eg."http://localhost:1234/v1") +- Set `OPENAI_MODEL` to the name of the model loaded in your local server. + ### Docker 1. Clone the repository