Make dataset audit mandatory for training loop
This commit is contained in:
@@ -79,3 +79,5 @@ The active production model remains unchanged while any gate fails.
|
||||
|
||||
Every failed assessment returns `continue_training_loop`. Only a report with
|
||||
`training_complete` may proceed to final human review and guarded activation.
|
||||
The orchestrator refuses to start unless the frozen dataset audit is `ok` and
|
||||
contains zero blank/low-variance positive tiles.
|
||||
|
||||
@@ -11570,3 +11570,20 @@ Next gate:
|
||||
became Brussels `0.566`, Wallonia `0.427`, Flanders `0.222`. The generic-base
|
||||
iteration did not beat it. Both remained rejected, and iteration 4 started
|
||||
from the stronger candidate on the dated 75-AOI corpus.
|
||||
|
||||
## 2026-07-27 - Positive-imagery gate and complete SPW campaign
|
||||
|
||||
- Visual inspection caught 20 positive Walloon tiles with labels over white
|
||||
no-data imagery. SPW 2024 is an official but partial campaign, so that
|
||||
training run was stopped and its candidate is invalid.
|
||||
- Dataset QA now fails whenever any positive tile is blank/low-variance. The
|
||||
checkpointed training orchestrator also refuses to start unless this audit
|
||||
is `ok` with zero affected positive tiles.
|
||||
- Replaced the partial product with the official, territory-complete SPW summer
|
||||
2023 campaign (27 May through 25 June, 25 cm). The frozen replacement corpus
|
||||
`building-be-v5-dated-20260727-r1` retains 75 AOIs and 13,765 accepted labels.
|
||||
Manifest SHA-256 is
|
||||
`eade90d3ba22b426b72a300fcaa9a01f6eb1d18567c4a53413b72b8048f5f021`.
|
||||
- The v5 tile audit passed with zero blank positive tiles. The automated CUDA
|
||||
loop started from the strongest prior candidate and will checkpoint every
|
||||
train/calibrate/test/background assessment without promoting failed models.
|
||||
|
||||
+2
-1
@@ -953,4 +953,5 @@ This file now starts with the current implementation status. Older preparation/b
|
||||
- [x] Freeze the objective train/evaluate/error-analysis loop and regional exit gates.
|
||||
- [x] Expand the second corpus wave to 60 independent AOIs and 10,262 accepted labels.
|
||||
- [ ] Resolve the v3 Flanders and Wallonia generalisation failures through additional training-only evidence and retraining.
|
||||
- [x] Replace rolling-mosaic training inputs with governed dated 2025 Flanders/Brussels and 2024 SPW imagery; retain exact flight-day limitations.
|
||||
- [x] Replace rolling-mosaic training inputs with governed dated 2025 Flanders/Brussels and complete 2023 SPW imagery; retain exact flight-day limitations.
|
||||
- [x] Reject positive labels over blank/no-data imagery and replace partial SPW 2024 coverage with the complete dated SPW 2023 campaign.
|
||||
|
||||
Reference in New Issue
Block a user