Add detection calibration sweep

2026-07-07 02:19:28 +02:00
parent 673efd7a9d
commit 590e5975f5
9 changed files with 348 additions and 0 deletions
@@ -374,6 +374,21 @@ manifests generated for AI handoff include source CRS metadata so pixel-space
 model outputs can be transformed to WGS84 GeoJSON coordinates. Current V1 upload
 support is limited to GeoTIFF-style rasters and GeoJSON/JSON reference vectors.

+For model-quality calibration, run the confidence sweep wrapper:
+
+```bash
+REAL_RASTER_PATH=/mnt/user/appdata/geointel/storage/operator-data/geel_orthophoto_wms_512.tif \
+REAL_REFERENCE_VECTOR_PATH=/mnt/user/appdata/geointel/storage/operator-data/geel_grb_gbg_buildings.geojson \
+CALIBRATION_THRESHOLDS="0.50 0.35 0.25 0.15" \
+bash scripts/run_detection_calibration_sweep.sh http://192.168.10.150:1202
+```
+
+The sweep creates one real persisted workflow run per threshold, fetches the
+persisted `QualityCheck`/`Metric` rows and writes a `calibration_summary.json`
+with detection count, score, precision, recall, F1, mean IoU and false
+positive/negative counts. It is intended to tune confidence/IoU/model choices,
+not to add new inference behavior.
+
 ### Run backend

 ```bash