phase 17: fix Polygon article_url and published_utc field mapping in metadata persistence
This commit is contained in:
@@ -182,7 +182,7 @@
|
||||
- Verify companies and sources appear in the dashboard and via `curl https://stonks-registry.celestium.life/companies`
|
||||
- _Requirements: 1.1, 1.2, 1.3, 2.1_
|
||||
|
||||
- [-] 17.2 Wire the scheduler to enqueue ingestion jobs for active sources
|
||||
- [x] 17.2 Wire the scheduler to enqueue ingestion jobs for active sources
|
||||
- Verify the scheduler service reads active companies and sources from PostgreSQL
|
||||
- Verify it enqueues Redis jobs for each source on its polling interval
|
||||
- Check scheduler logs: `kubectl logs -n stonks-oracle deployment/scheduler --tail=50`
|
||||
@@ -190,7 +190,7 @@
|
||||
- Fix any issues with the scheduler → source → Redis queue flow
|
||||
- _Requirements: 3.1, 3.2_
|
||||
|
||||
- [ ] 17.3 Validate ingestion workers pull data from Polygon and persist to MinIO/PostgreSQL
|
||||
- [x] 17.3 Validate ingestion workers pull data from Polygon and persist to MinIO/PostgreSQL
|
||||
- Check ingestion worker logs for successful API calls to Polygon
|
||||
- Verify raw market data artifacts land in MinIO `stonks-raw-market` bucket
|
||||
- Verify document metadata rows appear in PostgreSQL `documents` table
|
||||
@@ -198,7 +198,7 @@
|
||||
- Debug and fix any adapter errors (auth, rate limits, response parsing)
|
||||
- _Requirements: 4.1, 4.2, 4.3_
|
||||
|
||||
- [ ] 17.4 Validate parser normalizes documents and extractor produces intelligence
|
||||
- [-] 17.4 Validate parser normalizes documents and extractor produces intelligence
|
||||
- Check parser worker logs for document processing
|
||||
- Verify normalized text appears in MinIO `stonks-normalized` bucket
|
||||
- Verify `parse_quality_score` and `parse_confidence` are set on documents
|
||||
|
||||
Reference in New Issue
Block a user