correct overlapping checkpoint evaluation
GeoIntel release gates / Compile, test, contracts and builds (push) Canceled after 0s
GeoIntel release gates / Python and npm vulnerability policy (push) Canceled after 0s
GeoIntel release gates / GIS image, SBOM and container scan (push) Canceled after 0s

This commit is contained in:
Jens
2026-08-09 20:41:54 +02:00
parent 2de438b9cc
commit 48084799c9
11 changed files with 539 additions and 10 deletions
+33
View File
@@ -12671,3 +12671,36 @@ Open:
- The min-4px corpus is preferred for future experimental work, but remains
explicitly training/release-ineligible until real human review and governed
release evidence exist. The active GPU model was not changed.
## 2026-08-09 - Non-overlapping checkpoint correction
### Corrected
- Traced the prior 36-image checkpoint matrix to four AOIs tiled at 512/256.
The same interiors were repeated and nine Arendonk-heide tiles were visually
blank no-data, despite being counted as background observations.
- Added a deterministic non-overlap evaluation-view builder. It selects four
complete 512 px grid tiles per 1024 px AOI, excludes low-variance no-data
with reason codes, creates empty train directories and writes a hashed
`NO_TRAINING.json` marker.
- Added a fail-fast marker check to the operator YOLO training wrapper before
release verification, model loading or CUDA allocation.
- Corrected checkpoint overlap semantics: zero pixel overlap is reported, but
statistical independence is explicitly not established for adjacent tiles.
### GPU evidence
- The clean r2 view contains 12 images: eight positive Turnhout/Westerlo tiles
and four real Postel backgrounds. It has 2,551 labels, 2,384 unique interior
objects, 167 edge labels and zero repeated interior objects.
- Active: precision 0.542632, recall 0.435317, mAP50 0.342034, mAP50-95
0.141316. Challenger: 0.581715, 0.462300, 0.368364 and 0.155318.
- At confidence 0.15 the active model has zero Postel detections and the
challenger one; at 0.25 both have zero. The threshold-sensitive relative
challenger advantage is confirmed without changing production.
### Remaining limitations
- Two adjacent positive AOIs and one real background AOI are not representative
release evidence. Human review, broader independent geography and exact
challenger provenance remain blocking.