ryan/simbarag
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Replace Ollama with llama-server (OpenAI-compatible API) #14

Merged
ryan merged 1 commits from feature/llama-cpp-integration into main 2026-01-31 21:41:19 -05:00
Conversation 0 Commits 1 Files Changed 7 +35 -71

1 Commits

Author SHA1 Message Date
Ryan Chen
32020a6c60 Replace Ollama with llama-server (OpenAI-compatible API) 
- Update llm.py to use OpenAI client with custom base_url for llama-server
- Update agents.py to use ChatOpenAI instead of ChatOllama
- Remove unused ollama imports from main.py, chunker.py, query.py
- Add LLAMA_SERVER_URL and LLAMA_MODEL_NAME env vars
- Remove ollama and langchain-ollama dependencies

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
 2026-01-31 21:39:23 -05:00