docs: record Mol benchmark decision
GeoIntel CI / docs-smoke (push) Canceled after 0s
GeoIntel CI / contract-smoke (push) Canceled after 0s

This commit is contained in:
Codex
2026-07-14 12:40:11 +02:00
parent 9f61037794
commit 5db93a9530
7 changed files with 57 additions and 7 deletions
+5 -2
View File
@@ -267,12 +267,15 @@ the canonical footprint-IoU metrics.
The runner also writes `mol_operational_benchmark_report.json` and `.md`. The
default operational gates require four positive holdouts, one background
control, coverage provenance for every positive run, at least 95% reference
control, coverage provenance for every positive run, at least 90% reference
coverage in every zone, mean F1 at least `0.25`, per-zone F1 at least `0.10`
and zero detections in each pure-empty control. Override the numeric gates only
through the documented `MOL_MIN_MEAN_F1`, `MOL_MIN_ZONE_F1`,
`MOL_MIN_REFERENCE_COVERAGE` and `MOL_MAX_BACKGROUND_DETECTIONS` variables.
An `accepted` report records bounded operational evidence; it does not mutate
Source bbox queries retain complete edge features and can intentionally
over-cover the exact projected raster polygon, so the coverage gate detects a
gross source/raster mismatch rather than scoring the model. An `accepted`
report records bounded operational evidence; it does not mutate
the active model. A `review_required` report is still a successful benchmark
execution but explicitly blocks a promotion recommendation.
@@ -327,7 +327,7 @@ def parse_args() -> argparse.Namespace:
parser.add_argument("--min-background-samples", type=int, default=1)
parser.add_argument("--min-mean-f1", type=float, default=0.25)
parser.add_argument("--min-zone-f1", type=float, default=0.10)
parser.add_argument("--min-reference-coverage-ratio", type=float, default=0.95)
parser.add_argument("--min-reference-coverage-ratio", type=float, default=0.90)
parser.add_argument("--max-background-detections", type=int, default=0)
args = parser.parse_args()
if args.min_positive_samples < 1 or args.min_background_samples < 1:
+2 -2
View File
@@ -19,7 +19,7 @@ Optional environment:
REAL_IOU_THRESHOLD Default: 0.25.
MOL_MIN_MEAN_F1 Operational gate, default: 0.25.
MOL_MIN_ZONE_F1 Per-zone collapse gate, default: 0.10.
MOL_MIN_REFERENCE_COVERAGE Minimum evaluated/raw reference ratio, default: 0.95.
MOL_MIN_REFERENCE_COVERAGE Minimum evaluated/raw reference ratio, default: 0.90.
MOL_MAX_BACKGROUND_DETECTIONS Maximum detections per pure-empty control, default: 0.
The runner never downloads weights, fetches product providers or uses fixture
@@ -47,7 +47,7 @@ QUALITY_THRESHOLDS="${QUALITY_THRESHOLDS:-0.15}"
REAL_IOU_THRESHOLD="${REAL_IOU_THRESHOLD:-0.25}"
MOL_MIN_MEAN_F1="${MOL_MIN_MEAN_F1:-0.25}"
MOL_MIN_ZONE_F1="${MOL_MIN_ZONE_F1:-0.10}"
MOL_MIN_REFERENCE_COVERAGE="${MOL_MIN_REFERENCE_COVERAGE:-0.95}"
MOL_MIN_REFERENCE_COVERAGE="${MOL_MIN_REFERENCE_COVERAGE:-0.90}"
MOL_MAX_BACKGROUND_DETECTIONS="${MOL_MAX_BACKGROUND_DETECTIONS:-0}"
if [ "${BASE_URL}" = "-h" ] || [ "${BASE_URL}" = "--help" ]; then