Celes Renata
a322e00659
- Ollama scaled to 0 — vLLM gets entire 16GB GPU - NuExtract3 (9B) running at 80% GPU utilization - Both OLLAMA_BASE_URL and VLLM_BASE_URL point to vLLM service - Fixed gremlin-1 missing default route (no internet access) - Removed GPU resource limit (time-slicing handles allocation) - Removed init container (direct download works with internet fix)
30 lines
513 B
YAML
30 lines
513 B
YAML
apiVersion: v1
|
|
kind: Service
|
|
metadata:
|
|
name: nuextract
|
|
namespace: vllm-service
|
|
spec:
|
|
ports:
|
|
- name: http
|
|
port: 8000
|
|
targetPort: 8000
|
|
selector:
|
|
app: vllm
|
|
type: ClusterIP
|
|
---
|
|
# External access via NodePort (like ollama's port 2701 pattern)
|
|
apiVersion: v1
|
|
kind: Service
|
|
metadata:
|
|
name: nuextract-external
|
|
namespace: vllm-service
|
|
spec:
|
|
ports:
|
|
- nodePort: 31508
|
|
name: vllm-api
|
|
port: 2701
|
|
targetPort: 8000
|
|
selector:
|
|
app: vllm-metrics
|
|
type: LoadBalancer
|