Prevent calibration evidence response overwrite
GeoIntel CI / docs-smoke (push) Has been cancelled
GeoIntel CI / contract-smoke (push) Has been cancelled

This commit is contained in:
Codex
2026-07-08 14:30:37 +02:00
parent 51b7d1eec7
commit 5314f16383
5 changed files with 48 additions and 2 deletions
+16
View File
@@ -5495,3 +5495,19 @@ Limitations:
Next recommended pass:
- Continue with V1 usability work that reduces operator confusion without expanding frozen product scope.
## Sprint 142 Calibration evidence response uniqueness (2026-07-08)
Changed:
- Hardened `scripts/export_detection_calibration_evidence.sh` so calibration evidence response files include both confidence threshold and quality-check id.
- Prevented same-threshold runs from different model assets or calibration jobs from overwriting each other before portfolio assembly.
- Extended the multi-AOI calibration evidence portfolio regression test with two Geel runs at the same threshold and distinct quality checks.
Tested:
- Red step: `python -m pytest backend\tests\test_sprint139_multi_aoi_calibration_evidence_portfolio.py -q` failed because only two evidence features were retained when three same-threshold responses were expected.
- `python -m pytest backend\tests\test_sprint139_multi_aoi_calibration_evidence_portfolio.py backend\tests\test_sprint138_calibration_evidence_bundle_smoke.py backend\tests\test_sprint137_browser_calibration_summary_evidence_script.py backend\tests\test_sprint125_detection_calibration_evidence_bundle.py -q` (`4 passed`)
- `bash -n scripts/export_detection_calibration_evidence.sh`
- `bash -n scripts/assemble_detection_calibration_evidence_portfolio.sh`
Open:
- Regenerate the expanded Tower calibration evidence portfolio after deploying this fix so same-threshold model comparisons are represented correctly.
+1
View File
@@ -429,5 +429,6 @@ This file now starts with the current implementation status. Older preparation/b
- [x] Run the first live multi-AOI calibration evidence portfolio on Tower for Geel, Mol and Turnhout.
- [x] Run fresh positive-AOI matrix coverage for Balen, Herentals and Westerlo.
- [x] Preserve model/tile provenance in calibration evidence bundle summaries.
- [x] Prevent same-threshold calibration evidence responses from overwriting each other in multi-model portfolios.
- [ ] Add more AOIs after the tile-level baseline so the next local model attempt is not limited to Geel/Mol/Turnhout.
- [ ] Add negative/background AOIs so the next tile dataset is not all positive tiles.