06e1e7ea0f
fix: reclassify script reads DB/Redis creds from pod env vars
...
No more hardcoded passwords — pulls POSTGRES_HOST, POSTGRES_USER,
POSTGRES_PASSWORD, POSTGRES_DB, and REDIS_URL from the pod's
environment (injected by k8s secrets).
2026-04-17 08:19:23 +00:00
1842b2039c
ops: add SQL query test script and macro reclassify/reaggregate runner
...
- scripts/test_saved_queries.py: tests all 24 saved SQL explorer queries
against the live Trino API (all 24 pass)
- scripts/run_reclassify_and_reaggregate.sh: self-contained script to
re-classify macro events with updated prompts and re-aggregate all
tickers. Scales aggregation to 16 pods, monitors queues, scales back.
2026-04-17 08:03:14 +00:00
357e68a764
feat: add database and Redis backup/restore scripts
...
- scripts/backup-db.sh: pg_dump compressed backup with table count
verification, optional MinIO upload, auto-prune keeping last 7
- scripts/restore-db.sh: restore from backup with safety confirmation,
scales down services during restore, re-grants permissions, scales
back up with correct replica counts
- scripts/backup-redis.sh: triggers BGSAVE, copies RDB dump locally,
shows key stats
2026-04-16 00:10:27 +00:00
527be42f82
phase 17: restore script — per-bucket size reporting, full DB row count verification
2026-04-12 14:53:19 -07:00
85e0ef7580
phase 17: backup script now reports per-bucket sizes and file counts
2026-04-12 14:46:47 -07:00
dd13045ca6
phase 17: fix backup/restore scripts — use postgres:18-alpine for pg_dump version match
2026-04-12 14:41:08 -07:00
3f5b4adcec
phase 17: add backup/restore scripts — PostgreSQL + MinIO → NFS
2026-04-12 14:21:59 -07:00
a3e8009fa9
phase 17: revert to qwen3.5:9b (9b-fast was removed from Ollama), add retry script
2026-04-12 10:58:53 -07:00
7ee1d0f050
phase 17: switch to qwen3.5:9b-fast (32k context), add queue management scripts
2026-04-12 10:19:28 -07:00
66ed38bf18
phase 17: switch to gemma4:e4b, rewrite prompts for fill-the-fields style with forced ticker inclusion
2026-04-12 10:05:31 -07:00
2e42310f07
phase 17: fix SEC EDGAR 403 — use descriptive User-Agent with contact email per fair access policy
2026-04-12 09:50:29 -07:00
311d76dc0b
phase 17: enrich SEC EDGAR filings with URLs, titles, dedupe by accession number, skip XML fragments
2026-04-12 09:42:12 -07:00
28b3361833
phase 17: remove embedded JSON schema from user prompt (4.7KB saved), Ollama format param handles it
2026-04-12 09:28:28 -07:00
57d0fc7d33
phase 17: pass all tracked tickers to extractor, soften prompt for macro-to-company relevance
2026-04-12 09:18:08 -07:00
Celes Renata