Record live model promotion report
This commit is contained in:
@@ -15,10 +15,27 @@ Changed:
|
||||
Tested:
|
||||
- Red step: `python -m pytest backend\tests\test_sprint143_detection_model_promotion_report.py -q` failed because the report script did not exist.
|
||||
- `python -m pytest backend\tests\test_sprint143_detection_model_promotion_report.py -q` (`1 passed`)
|
||||
- `python -m pytest backend\tests\test_sprint143_detection_model_promotion_report.py backend\tests\test_sprint139_multi_aoi_calibration_evidence_portfolio.py -q` (`2 passed`)
|
||||
- `python -m py_compile scripts\build_detection_model_promotion_report.py`
|
||||
- `python scripts\smoke_docs.py`
|
||||
- `bash scripts/run_readiness_check.sh` (`419 passed`; frontend typecheck/build passed; Alembic head `202606120900`)
|
||||
- Tower pulled commit `c2fba67` and generated:
|
||||
- `/mnt/user/appdata/geointel/artifacts/detection-model-promotion/positive-expanded-vs-hard-negative-20260708/detection_model_promotion_report.json`
|
||||
- `/mnt/user/appdata/geointel/artifacts/detection-model-promotion/positive-expanded-vs-hard-negative-20260708/detection_model_promotion_report.md`
|
||||
- Live promotion report evaluated 15 model/tile/threshold candidates and recommended `none`.
|
||||
- Best current positive candidate `geointel-building-yolov8n-expanded160e50-pt|640|64|0.15` was rejected by gates:
|
||||
- `positive_mean_f1_below_gate`
|
||||
- `background_false_positive_pressure`
|
||||
- positive samples `7`
|
||||
- background samples `3`
|
||||
- mean F1 `0.19718007234060198`
|
||||
- max background detections `46`
|
||||
- total background detections `46`
|
||||
- Tower container remained healthy on `0.0.0.0:1202->80/tcp`.
|
||||
|
||||
Open:
|
||||
- Run the report against the regenerated 7-AOI positive portfolio and live hard-negative summaries on Tower.
|
||||
- Use the report as a promotion gate only; it must not mutate the active YOLO model configuration.
|
||||
- No evaluated model/threshold is ready for default promotion.
|
||||
- Next model work should improve positive recall/F1 while preserving a strict hard-negative false-positive gate.
|
||||
|
||||
## Sprint 141 Expanded positive-AOI matrix and portfolio metadata hardening (2026-07-08)
|
||||
|
||||
|
||||
Reference in New Issue
Block a user