RAG tools that work with Ollama
Tools whose listing data mentions Ollama as a model backend. Others may work too; we only list what the data says. 8 tools, sorted by GitHub stars.
📬 Get the weekly list of new local RAG tools and releases. Free, one email a week.
| Tool | Hardware | Fully offline |
|---|---|---|
| Open WebUI Active Difficulty: Medium Vendor guide | Light server; LLM via Ollama | ✅ Yes |
| RAGFlow Active Difficulty: Medium Community report | 4 cores, 16GB RAM, 50GB disk recommended (Docker) | ✅ Yes |
| Open Notebook Active Difficulty: Medium Community report | Docker | ✅ Yes |
| LocalGPT No tracked release Docs only | GPU recommended | ✅ Yes |
| DocsGPT Active Difficulty: Medium Docs only | Docker (installer runs Docker Compose; pip, Kubernetes and air-gapped installs documented) | ✅ Yes |
| Verba Stale (no release in 12+ months) Difficulty: Medium Docs only | Docker + Weaviate | ✅ Yes |
| RAG Web UI Active Difficulty: Medium Docs only | Docker | ✅ Yes |
| paperless-gpt Active Docs only | Needs Paperless-ngx + LLM | ✅ Yes |
How we know: Docs only = taken from the project's own README/docs, not tested by us. Community report = an owner published a working (or problem) report; links to the source. Vendor guide = an official NVIDIA playbook exists. We have not hands-on tested any tool yet, so nothing here says "Tested by RAGShelf".
Comparisons
- AnythingLLM vs Open WebUI
- AnythingLLM vs RAGFlow
- RAGFlow vs Dify
- Open WebUI vs LibreChat
- Khoj vs Open Notebook
Groupings use only what each listing's data supports. Last updated 2026-10-26.
The RAGShelf weekly
New local RAG tools, releases, and tested setups. One email a week, no spam.