admin/stonks-oracle
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

fix: thesis rewriter now routes to vLLM when provider is vllm

Browse Source 
- thesis_llm.py: add _call_vllm_thesis() using /v1/chat/completions
- thesis_llm.py: check resolved model_provider and route accordingly
- values.yaml: set OLLAMA_BASE_URL to http://10.1.1.12:2701
This commit is contained in:
Celes Renata
2026-04-29 05:42:10 +00:00
parent a36702e5f3
commit f264e924f0
2 changed files with 88 additions and 17 deletions
Download Patch File Download Diff File Expand all files Collapse all files
infra/helm/stonks-oracle/values.yaml
+1 -1
View File
@@ -174,7 +174,7 @@ config:
REDIS_DB: "0"
MINIO_ENDPOINT: "minio.minio-service.svc.cluster.local:80"
MINIO_SECURE: "false"
OLLAMA_BASE_URL: "http://ollama.ollama-service.svc.cluster.local:11434"
OLLAMA_BASE_URL: "http://10.1.1.12:2701"
OLLAMA_MODEL: "qwen3.5:9b-fast"
OLLAMA_TIMEOUT: "240"
OLLAMA_MAX_RETRIES: "2"