Add multi-sample detection quality calibration

scripts/README.md

@@ -171,6 +171,20 @@ Those files are runtime artifacts generated from Digitaal Vlaanderen's
 OMWRGBMRVL WMS `Ortho` layer and GRB OGC API Features `GBG` building collection
 for a small Geel AOI. They are intentionally not repository fixtures.
 
+To prepare the documented operator samples reproducibly inside the all-in-one
+runtime container, run:
+
+```bash
+docker exec -it geointel python /app/scripts/prepare_operator_real_data_samples.py --samples geel,mol,turnhout
+```
+
+This writes GeoTIFF/GeoJSON pairs and `operator_samples_manifest.json` under
+`/app/storage/operator-data` inside the container, which maps to
+`storage/operator-data` in the Tower appdata checkout. The helper fetches only
+the explicit documented AOIs, records Digitaal Vlaanderen attribution and
+reuses existing files by default. Use `--force` only when the local runtime
+artifacts should be regenerated.
+
 The real-data smoke is intentionally mutating and refuses to run without
 operator-supplied files. Current V1 upload support expects a georeferenced
 `.tif`, `.tiff` or `.geotiff` raster and a `.geojson` or `.json` reference
@@ -229,6 +243,24 @@ set. The summary ranks `best_by_score`, `best_by_recall` and
 `QualityCheck`/`Metric` evidence rather than visual guesses. It does not create
 provider data, use fixtures or download model weights.
 
+Run the same matrix across every prepared operator sample:
+
+```bash
+OPERATOR_SAMPLE_MANIFEST_PATH=storage/operator-data/operator_samples_manifest.json \
+QUALITY_MODEL_ASSET_IDS="yolov8n-building-segmentation-pt yolov8n-pt" \
+QUALITY_TILE_SIZES="512 640" \
+QUALITY_TILE_OVERLAPS="64" \
+QUALITY_THRESHOLDS="0.50 0.15" \
+bash scripts/run_multi_sample_detection_quality_matrix.sh http://192.168.10.150:1202
+```
+
+The multi-sample wrapper writes one per-sample `quality_matrix_summary.json`
+plus a combined `multi_sample_quality_summary.json` with
+`best_overall_by_score`, `best_overall_by_recall`,
+`best_overall_by_precision` and `best_by_sample` rankings. It resolves
+container-style `/app/storage/...` manifest paths to repo-relative
+`storage/...` paths when run from the Tower host checkout.
+
 Export calibration QA evidence for visual review:
 
 ```bash