Jens/geointel
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Expand golden QA benchmark scenarios
GeoIntel CI / docs-smoke (push) Has been cancelled
Details
GeoIntel CI / contract-smoke (push) Has been cancelled
Details

Browse Source
This commit is contained in:
Codex
2026-06-18 21:46:19 +02:00
parent 5128b9ced0
commit c85953f389
14 changed files with 417 additions and 28 deletions
Download Patch File Download Diff File Expand all files Collapse all files
scripts/README.md
+4 -2
View File
@@ -86,8 +86,10 @@ python scripts/run_golden_qa_benchmark.py --json
The benchmark uses only explicit local fixtures under `fixtures/golden`,
executes the existing QA/QC matching logic, verifies the expected precision,
recall, F1, mean IoU and false-positive/false-negative counts, and checks that
`QualityCheck` plus `Metric` rows would be persisted. The main readiness gate
runs this benchmark so QA metric drift fails before a release.
`QualityCheck` plus `Metric` rows would be persisted. Scenarios are listed in
`fixtures/golden/golden_qa_benchmarks.json` and currently cover partial match,
perfect match, no-overlap and MultiPolygon building comparisons. The main
readiness gate runs this benchmark so QA metric drift fails before a release.
Verify a configured local YOLO model without running inference: