Files

T

Celes Renata ebea70573b phase 0+1: project scaffold, k8s manifests, CI pipeline, steering, hooks, tests

- Repository structure for all services, infra, lakehouse, dashboards
- K8s manifests targeting stonks-oracle namespace with GHCR images
- Ingress via Traefik with ca-issuer TLS for internal services
- ConfigMap wired to existing cluster services (pg, redis, minio, ollama)
- GitHub Actions workflow for lint, test, multi-service container builds
- Dockerfile with build-arg CMD per service
- Makefile for local build/push/deploy
- Steering rules for TDD workflow, K8s conventions, project context
- Agent hooks for lint-on-save, test-on-save, k8s-validate, phase-commit
- Ruff linter config, all lint issues fixed
- 14 passing tests for schemas, config, redis keys
- PostgreSQL migrations, Trino catalogs, Superset config, MinIO lifecycle

2026-04-11 03:25:08 -07:00

2.0 KiB

Raw Blame History

Stonks Oracle — Project Context

Overview

Stonks Oracle is a Kubernetes-native AI market intelligence and paper-trading platform. Python monorepo with services under services/, infrastructure under infra/, lakehouse schemas under lakehouse/, and dashboards under dashboards/.

Infrastructure

Kubernetes cluster: 4x NixOS nodes (gremlin-1 through gremlin-4), reachable via kubectl, virtctl, ssh root@gremlin-{1,2,3,4}
NixOS configs stored at /etc/nixos on gremlin-1, git-pushed to other hosts
Ingress: Traefik, domain *.celestium.life
Cert-Manager: ca-issuer (local CA) for internal services, celestium-le-production (Let's Encrypt) for public-facing
Container registry: ghcr.io/celesrenata/stonks-oracle
CI: GitHub Actions builds containers, cluster pulls from GHCR

Existing Cluster Services (do NOT redeploy these)

PostgreSQL: postgresql-rw.postgresql-service.svc.cluster.local:5432
Redis: redis-master.redis-service.svc.cluster.local:6379
MinIO: minio.minio-service.svc.cluster.local:80 (API), console at minio-crawler-console.minio-service.svc.cluster.local:9090
Ollama: ollama.ollama-service.svc.cluster.local:11434 (cluster-internal), also at http://10.1.1.12:2701 (external), GPU: 4070 Ti Super 16GB

Development Process

Test-Develop-Debug (TDD) cycle
After each phase: commit, push, build via GitHub Actions, deploy to cluster
Local builds for dev iteration, GitHub workflows for CI/CD
Python 3.12, NixOS dev environment

Key Conventions

All services use services/shared/config.py for configuration via env vars
Redis queues defined in services/shared/redis_keys.py
Pydantic schemas in services/shared/schemas.py
K8s manifests in infra/k8s/, all in stonks-oracle namespace
Lakehouse DDL in lakehouse/schemas/
Crawler patterns inspired by Noctipede (~/sources/splinterstice/noctipede): BeautifulSoup + requests with retry adapters, content hashing, boilerplate stripping, quality scoring

2.0 KiB Raw Blame History