Add multi-AOI calibration evidence portfolio
This commit is contained in:
@@ -461,6 +461,39 @@ exporter and verifies that `calibration_evidence.geojson`,
|
||||
`calibration_evidence_summary.json` and `calibration_evidence_review.html` are
|
||||
written correctly.
|
||||
|
||||
Assemble multiple AOI evidence bundles into one model-review portfolio:
|
||||
|
||||
```bash
|
||||
bash scripts/assemble_detection_calibration_evidence_portfolio.sh \
|
||||
http://192.168.10.150:1202 \
|
||||
./calibration-evidence-portfolio-manifest.json
|
||||
```
|
||||
|
||||
Example `calibration-evidence-portfolio-manifest.json`:
|
||||
|
||||
```json
|
||||
{
|
||||
"portfolio_name": "Kempen building model calibration",
|
||||
"model_asset_id": "geointel-building-yolov8s-hardneg160r4e50-pt",
|
||||
"model_sha256": "optional-model-checksum",
|
||||
"notes": "Operator comparison notes.",
|
||||
"samples": [
|
||||
{
|
||||
"sample_slug": "geel",
|
||||
"aoi_label": "Geel center",
|
||||
"summary_path": "/path/to/detection-calibration-summary.json",
|
||||
"operator_notes": "Dense urban validation sample."
|
||||
}
|
||||
]
|
||||
}
|
||||
```
|
||||
|
||||
The portfolio assembler copies each summary into a deterministic sample folder,
|
||||
runs the existing evidence exporter per AOI and writes
|
||||
`calibration_evidence_portfolio.json` plus
|
||||
`calibration_evidence_portfolio.md`. It is evidence packaging only: it does not
|
||||
run inference, create QA checks or mutate application data.
|
||||
|
||||
The evidence export reads each persisted `quality_check_id`, calls the existing
|
||||
QA evidence GeoJSON endpoint, writes `calibration_evidence.geojson`,
|
||||
`calibration_evidence_summary.json` and a standalone
|
||||
|
||||
Reference in New Issue
Block a user