Add detection calibration sweep

2026-07-07 02:19:28 +02:00
parent 673efd7a9d
commit 590e5975f5
9 changed files with 348 additions and 0 deletions
@@ -189,6 +189,24 @@ operationally only when the selected model genuinely returns no usable
 detections after class filtering; it must be interpreted as model/data quality
 evidence rather than as a successful building extraction result.

+Run a confidence-threshold calibration sweep against the same real-data path:
+
+```bash
+REAL_RASTER_PATH=/mnt/user/appdata/geointel/storage/operator-data/geel_orthophoto_wms_512.tif \
+REAL_REFERENCE_VECTOR_PATH=/mnt/user/appdata/geointel/storage/operator-data/geel_grb_gbg_buildings.geojson \
+CALIBRATION_THRESHOLDS="0.50 0.35 0.25 0.15" \
+bash scripts/run_detection_calibration_sweep.sh http://192.168.10.150:1202
+```
+
+The sweep reuses `verify_real_data_detection_qa_workflow.sh` once per
+threshold, so every row is backed by persisted Project, Dataset, AnalysisRun,
+Detection, QualityCheck, Metric and export records. It writes per-threshold
+logs plus `calibration_summary.json` under
+`artifacts/detection-calibration/<timestamp>` unless
+`CALIBRATION_OUTPUT_DIR` is set. This is a calibration/benchmarking tool only:
+it does not seed demo data, enable fixture detections, fetch external data or
+download model weights.
+
 Docker images install only the GIS runtime by default. To build a local/Tower
 image with PyTorch/Ultralytics available for the configured-YOLO preflight and
 runtime path, set: