docs: record fail-closed accuracy challenger
This commit is contained in:
+22
-3
@@ -421,9 +421,10 @@ false positives block default promotion.
|
||||
The focused small-building local model asset,
|
||||
`geointel-building-yolov8s-smallbld-minpx3-img640-ft30-pt`, is the current
|
||||
recommended Detection Lab operator profile. Use tile size `512`, overlap `64`
|
||||
and confidence threshold `0.15`. Persisted QA/QC at match IoU `0.25` across
|
||||
seven positive AOIs measured mean precision `0.5898`, recall `0.5770` and F1
|
||||
`0.5825`; minimum per-AOI F1 was `0.5528`. The strict three-sample pure-empty
|
||||
and confidence threshold `0.15`. Its original promotion evidence at match IoU
|
||||
`0.25` across seven positive AOIs measured mean precision `0.5898`, recall
|
||||
`0.5770` and F1 `0.5825`; minimum per-AOI F1 was `0.5528`. The strict
|
||||
three-sample pure-empty
|
||||
background gate produced zero detections. Compared with the previous balanced
|
||||
profile, the same persisted reference populations contain 1,571 fewer false
|
||||
negatives, including 745 fewer misses in the 25-100 m2 bucket and 181 fewer
|
||||
@@ -443,6 +444,24 @@ produced zero detections in the pure-empty Postel forest control. The active
|
||||
confidence therefore remains `0.15`. This result does not claim production
|
||||
perfection and does not justify another model-training run by itself.
|
||||
|
||||
A coverage-aligned July 2026 rerun supersedes the older displayed profile
|
||||
averages above without changing the active model or threshold. On the exact
|
||||
current pipeline, the seven independent Mol/Kempen zones measured mean
|
||||
precision `0.6141`, recall `0.6062` and F1 `0.6069`; the minimum zone F1 was
|
||||
`0.4749` in Mol Postel. The active model again produced zero detections in
|
||||
Postel-bos, Lommel-heide and Arendonk-heide. These are the values shown in the
|
||||
Detection Lab operator profile.
|
||||
|
||||
The reviewed-accuracy experiment added six training-only AOIs from Arendonk,
|
||||
Dessel, Meerhout, Laakdal, Nijlen and Hulshout. The paged GRB export contained
|
||||
9,964 complete reference features. Its audited `512`-tile corpus retained 252
|
||||
tiles and 79,192 labels with no invalid or missing labels. The inactive
|
||||
`geointel-building-yolov8s-reviewedexp6-minpx3-img640-ft20-pt` challenger
|
||||
improved mean seven-zone F1 to `0.6248`, but produced two detections in the
|
||||
explicitly empty Postel-bos control. The formal fail-closed promotion report
|
||||
therefore retained the current active model. Positive-score gains never
|
||||
override a failed pure-empty background gate.
|
||||
|
||||
False-positive and false-negative evidence from persisted detection QA can be
|
||||
classified through `detection_reviews`. The queue derives from quality-check
|
||||
evidence ids and resolves persisted Detection and reference VectorFeature rows.
|
||||
|
||||
Reference in New Issue
Block a user