Module 5 · Data engineering
Data Quality Monitor
Data Quality Monitor description.
DWT found
Pending
Coverage at last checkpoint
DWT missing
Pending
Requires new search
Manual review
Pending
Flagged records
Sources
DNV · VesselFinder
Provenance tracked
Completeness by port
Share of port calls with each field filled, per port. Computed from the harmonised call records at every pipeline run.
| Port | Calls | Berthing hours | Valid DWT | Cargo nature | CO₂ estimated |
|---|
Data quality indicators
Family D — computed from the vessel master and enrichment log.
| Indicator | Definition | Status |
|---|---|---|
| % vessels with DWT found | Share of IMO with a DWT value | Pending |
| % without DWT | Vessels needing a new search | Pending |
| Sources used | DNV, VesselFinder, dwt_cache, other | Tracked |
| Source divergence | Two sources with different DWT | To compute |
| Duplicate IMO | Same IMO, different names | To compute |
| Duplicate name | Same name, different IMO | To compute |
Validation workflow
Each record carries a validation status: found, not_found, manual_review, conflict. The enrichment log feeds the coverage figures above.