docs: record fail-closed accuracy challenger
GeoIntel CI / docs-smoke (push) Canceled after 0s
GeoIntel CI / contract-smoke (push) Canceled after 0s

This commit is contained in:
Codex
2026-07-15 05:42:17 +02:00
parent f82a7f456a
commit ecc9f77732
11 changed files with 218 additions and 22 deletions
+18 -6
View File
@@ -506,9 +506,9 @@ This file now starts with the current implementation status. Older preparation/b
- [x] Add a model promotion decision report that combines positive-AOI score with hard-negative false-positive pressure.
- [x] Train and reject a YOLOv8s hard-negative r8 partial candidate after 12 CPU epochs through the full positive/background promotion gate.
- [x] Finish and reject the full YOLOv8s hard-negative r8 e60 candidate through the same promotion gate.
- [ ] Add more AOIs after the tile-level baseline so the next local model attempt is not limited to Geel/Mol/Turnhout.
- [ ] Add negative/background AOIs so the next tile dataset is not all positive tiles.
- [ ] Improve positive training coverage/label quality before the next higher-capacity model attempt; simply extending the same hardneg r8 run is not enough.
- [x] Add more AOIs after the tile-level baseline so the next local model attempt is not limited to Geel/Mol/Turnhout.
- [x] Add negative/background AOIs so the next tile dataset is not all positive tiles.
- [x] Improve positive training coverage/label quality before the next higher-capacity model attempt; simply extending the same hardneg r8 run is not enough.
# Sprint 146 - Operator YOLO dataset quality audit
- [x] Add a dataset/label-quality audit for generated operator YOLO tile datasets.
@@ -516,7 +516,7 @@ This file now starts with the current implementation status. Older preparation/b
- [x] Wire the audit script into the readiness syntax gate.
- [x] Use live audit output to decide whether the next model pass needs more positive AOIs, label cleanup or unique hard negatives.
- [x] Add more unique background/hard-negative AOIs before repeating hard-negative-balanced YOLO training.
- [ ] Keep `yolo-building-tile-expanded160` as the clean current training baseline; avoid promoting r4/r8 repeat-heavy datasets as defaults.
- [x] Supersede `yolo-building-tile-expanded160` only with audited AOI1024 corpora; no repeat-heavy r4/r8 dataset became a default.
- [x] Regenerate Tower operator samples, export a new unique-hard-negative tile dataset and rerun the dataset audit before training.
# Sprint 147 - Unique hard-negative AOI expansion
@@ -550,7 +550,7 @@ This file now starts with the current implementation status. Older preparation/b
- [x] Prefer the complete municipality workspace on a fresh session while
keeping the lightweight boundary as the initially rendered layer.
- [x] Make GeoJSON bounds calculation safe for municipality-scale layers.
- [ ] Acquire and tile a georeferenced raster only for an explicitly selected
- [x] Acquire and tile a georeferenced raster only for an explicitly selected
Mol analysis zone before running the next configured-YOLO validation.
# Sprint 182 - Municipality viewport delivery and bounded AI handoff
@@ -561,7 +561,7 @@ This file now starts with the current implementation status. Older preparation/b
- [x] Preserve complete loading and auto-fit behavior for small vectors and persisted AI/QA overlays.
- [x] Allow the real raster/detection/QA operator smoke to reuse the definitive Mol project.
- [x] Link operator raster/reference uploads to the persisted analysis Area and keep their names distinct from municipality-wide layers.
- [ ] Execute the bounded Mol-Centrum configured-YOLO/QA workflow in the deployed runtime and retain its persisted ids as release evidence.
- [x] Execute the bounded Mol-Centrum configured-YOLO/QA workflow in the deployed runtime and retain its persisted ids as release evidence.
# Sprint 171 - Positive AOI expansion and small-building recovery
@@ -575,3 +575,15 @@ This file now starts with the current implementation status. Older preparation/b
- [x] Finish the inactive expanded-minpx4 candidate and run the full promotion gate.
- [x] Export the focused 23-sample minpx3 corpus with independent Vosselaar/Grobbendonk validation and external Turnhout/Retie/Westerlo holdouts.
- [x] Train, audit and guarded-activate the focused small-building candidate only after all persisted promotion gates passed.
# Sprint 199 - Reviewed accuracy expansion and fail-closed challenger
- [x] Add six complete training-only AOIs outside every protected Mol/Kempen holdout.
- [x] Page and audit 9,964 new GRB building references with municipality and CRS provenance.
- [x] Export and visually inspect the 252-tile, 79,192-label reviewed-accuracy corpus.
- [x] Train one inactive 20-epoch YOLOv8s challenger from the active local model without downloads.
- [x] Rerun active and challenger models on identical coverage-aware reference populations.
- [x] Confirm positive-zone F1 improvement in all seven holdouts.
- [x] Reject challenger activation because Postel-bos produced two detections while the active model remained at zero.
- [x] Update the recommended UI profile with the current active model's coverage-aligned evidence.
- [ ] Collect new training-only hard negatives matching the two Postel-bos errors before another challenger attempt.