phase 17: fix Polygon article_url and published_utc field mapping in metadata persistence

This commit is contained in:
Celes Renata
2026-04-12 02:58:30 -07:00
parent 0ac4493bd4
commit 264b83ea56
2 changed files with 5 additions and 5 deletions
+3 -3
View File
@@ -182,7 +182,7 @@
- Verify companies and sources appear in the dashboard and via `curl https://stonks-registry.celestium.life/companies`
- _Requirements: 1.1, 1.2, 1.3, 2.1_
- [-] 17.2 Wire the scheduler to enqueue ingestion jobs for active sources
- [x] 17.2 Wire the scheduler to enqueue ingestion jobs for active sources
- Verify the scheduler service reads active companies and sources from PostgreSQL
- Verify it enqueues Redis jobs for each source on its polling interval
- Check scheduler logs: `kubectl logs -n stonks-oracle deployment/scheduler --tail=50`
@@ -190,7 +190,7 @@
- Fix any issues with the scheduler → source → Redis queue flow
- _Requirements: 3.1, 3.2_
- [ ] 17.3 Validate ingestion workers pull data from Polygon and persist to MinIO/PostgreSQL
- [x] 17.3 Validate ingestion workers pull data from Polygon and persist to MinIO/PostgreSQL
- Check ingestion worker logs for successful API calls to Polygon
- Verify raw market data artifacts land in MinIO `stonks-raw-market` bucket
- Verify document metadata rows appear in PostgreSQL `documents` table
@@ -198,7 +198,7 @@
- Debug and fix any adapter errors (auth, rate limits, response parsing)
- _Requirements: 4.1, 4.2, 4.3_
- [ ] 17.4 Validate parser normalizes documents and extractor produces intelligence
- [-] 17.4 Validate parser normalizes documents and extractor produces intelligence
- Check parser worker logs for document processing
- Verify normalized text appears in MinIO `stonks-normalized` bucket
- Verify `parse_quality_score` and `parse_confidence` are set on documents