Add Mol multi-zone operational validation
This commit is contained in:
@@ -227,6 +227,21 @@ the first 1000-feature page. Generated reference GeoJSON records
|
||||
`reference_max_features` and `source_urls` for auditability. The application
|
||||
itself still does not perform live provider fetching.
|
||||
|
||||
### Mol operational validation pack
|
||||
|
||||
The operator registry includes a Mol-first validation pack: Mol center,
|
||||
Achterbos residential, Gompel mixed settlement, Donk canal/industrial and
|
||||
Postel rural village. The four new zones are marked as validation holdouts so
|
||||
future training exports cannot silently consume the operational benchmark.
|
||||
Postel-bos is evaluated separately as a background control.
|
||||
|
||||
`run_mol_operational_validation.sh` composes the existing positive multi-sample
|
||||
quality matrix and background detection matrix. Positive runs use persisted GRB
|
||||
`vector_features` and create real `QualityCheck`/`Metric` rows; background runs
|
||||
only report persisted detection pressure and never synthesize QA metrics. AOI
|
||||
bounds from the operator manifest are persisted as EPSG:4326 `Area` records so
|
||||
every generated project opens as a complete map context.
|
||||
|
||||
For confidence-threshold calibration, use the sweep wrapper:
|
||||
|
||||
```bash
|
||||
|
||||
@@ -7267,3 +7267,23 @@ Open:
|
||||
- Live Mol context contains a ready EPSG:31370 1024x1024 orthophoto and `1,993` ready EPSG:4326 GRB reference buildings.
|
||||
- Persisted detection QA remains unchanged: precision `0.6011`, recall `0.5891`, F1 `0.5950`, mean IoU `0.4554`, `779` false positives and `819` false negatives.
|
||||
- In-app browser verification selected the Mol project, Mol AOI and Mol reference dataset automatically. MapLibre rendered the existing `1,953`-feature detection layer over the road basemap with one canvas, zero browser warnings/errors and no horizontal document overflow at `1265x720`.
|
||||
|
||||
# Sprint 178 - Mol multi-zone operational validation
|
||||
|
||||
## Implementation
|
||||
|
||||
- Added Mol center, Achterbos, Gompel, Donk and Postel as explicit operator contexts with municipality and operational-zone provenance.
|
||||
- Marked Achterbos, Gompel, Donk and Postel as validation holdouts to keep them outside future training exports unless the split policy is deliberately changed.
|
||||
- Kept Postel-bos as a separate background control, so an empty/sparse context is never assigned fabricated precision, recall or F1.
|
||||
- Extended the existing real-data workflow with optional project region and EPSG:4326 AOI bounds; manifest-backed positive and background projects now open map-ready with persisted Areas.
|
||||
- Added `run_mol_operational_validation.sh` to compose the existing positive QA matrix and background detection-pressure matrix and emit one evidence summary.
|
||||
- Included the new runner in the all-in-one runtime and release-readiness syntax gate. No API route, ORM model, migration, model activation or frontend behavior changed.
|
||||
|
||||
## Initial validation
|
||||
|
||||
- Focused Mol/operator/workflow/Docker regressions: `43 passed`.
|
||||
- Changed Python operator preparer compiled successfully.
|
||||
- All five affected shell workflows passed `bash -n`.
|
||||
- `git diff --check`: clean apart from the existing Windows line-ending notice for the all-in-one Dockerfile.
|
||||
- `bash scripts/run_readiness_check.sh`: passed with `485` backend tests, contract audit, single Alembic head, frontend typecheck and production build.
|
||||
- Frontend bundle sizes are unchanged: app `217.69 kB`, React vendor `140.74 kB` and MapLibre `801.82 kB` before gzip.
|
||||
|
||||
@@ -19,6 +19,7 @@ This file now starts with the current implementation status. Older preparation/b
|
||||
## Current implementation status
|
||||
|
||||
- [x] Make Mol the primary workbench, AOI and operator-sample context while preserving broader Kempen coverage.
|
||||
- [x] Add a Mol multi-zone operational pack with independent positive holdouts, background control and persisted map-ready AOIs.
|
||||
- [x] Backend FastAPI foundation, health endpoint and service structure.
|
||||
- [x] React/TypeScript frontend foundation and MapLibre workbench.
|
||||
- [x] Map layer visibility, opacity and feature property inspection.
|
||||
|
||||
Reference in New Issue
Block a user