added note about concurrency

This commit is contained in:
David Zhang 2025-02-06 09:41:51 -08:00
parent b1b26a8ab9
commit a9891c263c

View File

@ -2,7 +2,7 @@
An AI-powered research assistant that performs iterative, deep research on any topic by combining search engines, web scraping, and large language models. If you like this project, please consider starring it and giving me a follow on [X](https://x.com/dzhng).
The goal of this repo is to provide the simplest implementation of a deep research agent - e.g. an agent that can refine its research direction overtime and deep dive into a topic. It'll always be kept at <500 LoC so it is easy to understand and build on top of.
The goal of this repo is to provide the simplest implementation of a deep research agent - e.g. an agent that can refine its research direction overtime and deep dive into a topic. Goal is to keep the repo size at <500 LoC so it is easy to understand and build on top of.
## How It Works
@ -122,6 +122,12 @@ The system will then:
The final report will be saved as `output.md` in your working directory.
### Concurrency
If you have a paid version of Firecrawl or a local version, feel free to increase the `ConcurrencyLimit` in `deep-research.ts` so it runs a lot faster.
If you have a free version, you may sometime run into rate limit errors, you can reduce the limit (but it will run a lot slower).
## How It Works
1. **Initial Setup**