Harden demo golden QA smoke
This commit is contained in:
@@ -1563,3 +1563,30 @@ Limitations:
|
||||
|
||||
Next recommended pass:
|
||||
- Continue with broader QA/QC golden demo coverage or frontend export preview decomposition.
|
||||
|
||||
## Sprint 34 browser-facing golden QA demo hardening (2026-06-17)
|
||||
|
||||
Changed:
|
||||
- Hardened `scripts/verify_demo_export_workflow.sh` so the browser-facing demo/export smoke loads `fixtures/golden/expected_qa_metrics.json`.
|
||||
- The smoke now verifies persisted QA/QC status, F1 score, precision, recall, mean IoU, false positives, false negatives and match counts against the golden baseline.
|
||||
- Corrected the offline demo AOI to cover the golden fixture geometries instead of an older broad Kempen placeholder outside the fixture coordinates.
|
||||
- Made existing demo workflows self-heal stale/unsupported QA checks by syncing the demo AOI and persisting a fresh golden QA/QC result.
|
||||
- Added regression checks in backend tests so the demo/export smoke cannot regress back to key-existence-only QA/QC validation.
|
||||
- Updated script documentation, TODO and changelog.
|
||||
|
||||
Tested:
|
||||
- `python -m compileall backend/app`
|
||||
- `cd backend && python -m pytest tests/test_sprint15_demo_workflow.py tests/test_sprint21_demo_workflow_smoke.py tests/test_readiness_gate.py -q`
|
||||
- `cd backend && python -m pytest -W error::DeprecationWarning`
|
||||
- `cd frontend && npm run typecheck`
|
||||
- `cd frontend && npm run build`
|
||||
- `bash scripts/run_readiness_check.sh`
|
||||
|
||||
Open:
|
||||
- Tower redeploy and browser-facing smoke are still pending after this edit.
|
||||
|
||||
Limitations:
|
||||
- The demo/export smoke remains intentionally fixture-based and idempotent. It does not fetch live providers and does not run AI inference.
|
||||
|
||||
Next recommended pass:
|
||||
- Run the full release-readiness gate and then rebuild/deploy to Tower for browser-facing verification.
|
||||
|
||||
Reference in New Issue
Block a user