Document operator YOLO training benchmark

2026-07-07 05:34:31 +02:00
parent 39367684d8
commit 404b37fa07
3 changed files with 27 additions and 3 deletions
@@ -15,6 +15,10 @@
 - Added readiness coverage for the exporter Python compile check and training wrapper shell syntax.
 - Added regression coverage in `backend/tests/test_sprint129_operator_yolo_training_dataset.py`.
 - Updated operator documentation for dataset export, training smoke usage and the requirement to benchmark any trained model through the existing real-data Detection + QA matrix before treating it as useful.
+- Live Tower export produced a YOLO dataset with 3 operator samples and 1427 labels; a clean 8-epoch CPU training smoke produced `/app/models/geointel-building-yolov8n-operator8.pt`.
+- Live preflight loaded `geointel-building-yolov8n-operator8-pt` successfully with `will_download_models=false` and `will_run_inference=false`.
+- Live multi-sample QA matrix showed the 8-epoch operator model is not useful yet: it produced zero detections at thresholds `0.15`-`0.50`, and the low-threshold `0.01` run produced mostly false positives with best F1 `0.003798670465337132`.
+- `yolov8s-building-segmentation-pt` remains the best tested model, with best overall F1 `0.04195804195804196` on Mol at tile `640`, threshold `0.15`; still not sufficient for V1 default extraction.
 - No Training Studio UI, API contract change, provider fetching, model auto-provisioning or app-side model training behavior was introduced.

 ## Sprint 128 Stronger building model runtime benchmark (2026-07-07)