Celes Renata
ebea70573b
- Repository structure for all services, infra, lakehouse, dashboards - K8s manifests targeting stonks-oracle namespace with GHCR images - Ingress via Traefik with ca-issuer TLS for internal services - ConfigMap wired to existing cluster services (pg, redis, minio, ollama) - GitHub Actions workflow for lint, test, multi-service container builds - Dockerfile with build-arg CMD per service - Makefile for local build/push/deploy - Steering rules for TDD workflow, K8s conventions, project context - Agent hooks for lint-on-save, test-on-save, k8s-validate, phase-commit - Ruff linter config, all lint issues fixed - 14 passing tests for schemas, config, redis keys - PostgreSQL migrations, Trino catalogs, Superset config, MinIO lifecycle
34 lines
2.0 KiB
Markdown
34 lines
2.0 KiB
Markdown
# Stonks Oracle — Project Context
|
|
|
|
## Overview
|
|
Stonks Oracle is a Kubernetes-native AI market intelligence and paper-trading platform.
|
|
Python monorepo with services under `services/`, infrastructure under `infra/`, lakehouse schemas under `lakehouse/`, and dashboards under `dashboards/`.
|
|
|
|
## Infrastructure
|
|
- Kubernetes cluster: 4x NixOS nodes (gremlin-1 through gremlin-4), reachable via `kubectl`, `virtctl`, `ssh root@gremlin-{1,2,3,4}`
|
|
- NixOS configs stored at `/etc/nixos` on gremlin-1, git-pushed to other hosts
|
|
- Ingress: Traefik, domain `*.celestium.life`
|
|
- Cert-Manager: `ca-issuer` (local CA) for internal services, `celestium-le-production` (Let's Encrypt) for public-facing
|
|
- Container registry: `ghcr.io/celesrenata/stonks-oracle`
|
|
- CI: GitHub Actions builds containers, cluster pulls from GHCR
|
|
|
|
## Existing Cluster Services (do NOT redeploy these)
|
|
- PostgreSQL: `postgresql-rw.postgresql-service.svc.cluster.local:5432`
|
|
- Redis: `redis-master.redis-service.svc.cluster.local:6379`
|
|
- MinIO: `minio.minio-service.svc.cluster.local:80` (API), console at `minio-crawler-console.minio-service.svc.cluster.local:9090`
|
|
- Ollama: `ollama.ollama-service.svc.cluster.local:11434` (cluster-internal), also at `http://10.1.1.12:2701` (external), GPU: 4070 Ti Super 16GB
|
|
|
|
## Development Process
|
|
- Test-Develop-Debug (TDD) cycle
|
|
- After each phase: commit, push, build via GitHub Actions, deploy to cluster
|
|
- Local builds for dev iteration, GitHub workflows for CI/CD
|
|
- Python 3.12, NixOS dev environment
|
|
|
|
## Key Conventions
|
|
- All services use `services/shared/config.py` for configuration via env vars
|
|
- Redis queues defined in `services/shared/redis_keys.py`
|
|
- Pydantic schemas in `services/shared/schemas.py`
|
|
- K8s manifests in `infra/k8s/`, all in `stonks-oracle` namespace
|
|
- Lakehouse DDL in `lakehouse/schemas/`
|
|
- Crawler patterns inspired by Noctipede (`~/sources/splinterstice/noctipede`): BeautifulSoup + requests with retry adapters, content hashing, boilerplate stripping, quality scoring
|