Harden golden QA readiness gate

2026-06-17 05:56:03 +02:00
parent 82cdf5df0c
commit a28e516e17
10 changed files with 150 additions and 6 deletions
@@ -310,6 +310,12 @@ Machine-readable output:
 python scripts/run_golden_qa_benchmark.py --json
 ```

+Shell wrapper used by release-readiness checks:
+
+```bash
+bash scripts/verify_golden_qa_benchmark.sh
+```
+
 The benchmark compares `fixtures/golden/predicted_buildings.geojson` against `fixtures/golden/reference_buildings.geojson` and fails on metric drift. Expected baseline:

 - precision: `0.5`
@@ -321,6 +327,10 @@ The benchmark compares `fixtures/golden/predicted_buildings.geojson` against `fi

 The command uses existing QA/QC service logic and verifies `QualityCheck`/`Metric` persistence through an in-memory test session. It does not require live providers, AI models, Docker or PostGIS.

+`scripts/run_readiness_check.sh` runs this benchmark automatically, so any
+change that alters the golden QA/QC metric baseline must update the fixture and
+expected metrics deliberately.
+
 ### Demo workflow seed

 Sprint 15 adds an explicit offline demo workflow seed. It creates or returns a