docs: record Mol benchmark decision
This commit is contained in:
+5
-2
@@ -267,12 +267,15 @@ the canonical footprint-IoU metrics.
|
||||
|
||||
The runner also writes `mol_operational_benchmark_report.json` and `.md`. The
|
||||
default operational gates require four positive holdouts, one background
|
||||
control, coverage provenance for every positive run, at least 95% reference
|
||||
control, coverage provenance for every positive run, at least 90% reference
|
||||
coverage in every zone, mean F1 at least `0.25`, per-zone F1 at least `0.10`
|
||||
and zero detections in each pure-empty control. Override the numeric gates only
|
||||
through the documented `MOL_MIN_MEAN_F1`, `MOL_MIN_ZONE_F1`,
|
||||
`MOL_MIN_REFERENCE_COVERAGE` and `MOL_MAX_BACKGROUND_DETECTIONS` variables.
|
||||
An `accepted` report records bounded operational evidence; it does not mutate
|
||||
Source bbox queries retain complete edge features and can intentionally
|
||||
over-cover the exact projected raster polygon, so the coverage gate detects a
|
||||
gross source/raster mismatch rather than scoring the model. An `accepted`
|
||||
report records bounded operational evidence; it does not mutate
|
||||
the active model. A `review_required` report is still a successful benchmark
|
||||
execution but explicitly blocks a promotion recommendation.
|
||||
|
||||
|
||||
@@ -327,7 +327,7 @@ def parse_args() -> argparse.Namespace:
|
||||
parser.add_argument("--min-background-samples", type=int, default=1)
|
||||
parser.add_argument("--min-mean-f1", type=float, default=0.25)
|
||||
parser.add_argument("--min-zone-f1", type=float, default=0.10)
|
||||
parser.add_argument("--min-reference-coverage-ratio", type=float, default=0.95)
|
||||
parser.add_argument("--min-reference-coverage-ratio", type=float, default=0.90)
|
||||
parser.add_argument("--max-background-detections", type=int, default=0)
|
||||
args = parser.parse_args()
|
||||
if args.min_positive_samples < 1 or args.min_background_samples < 1:
|
||||
|
||||
@@ -19,7 +19,7 @@ Optional environment:
|
||||
REAL_IOU_THRESHOLD Default: 0.25.
|
||||
MOL_MIN_MEAN_F1 Operational gate, default: 0.25.
|
||||
MOL_MIN_ZONE_F1 Per-zone collapse gate, default: 0.10.
|
||||
MOL_MIN_REFERENCE_COVERAGE Minimum evaluated/raw reference ratio, default: 0.95.
|
||||
MOL_MIN_REFERENCE_COVERAGE Minimum evaluated/raw reference ratio, default: 0.90.
|
||||
MOL_MAX_BACKGROUND_DETECTIONS Maximum detections per pure-empty control, default: 0.
|
||||
|
||||
The runner never downloads weights, fetches product providers or uses fixture
|
||||
@@ -47,7 +47,7 @@ QUALITY_THRESHOLDS="${QUALITY_THRESHOLDS:-0.15}"
|
||||
REAL_IOU_THRESHOLD="${REAL_IOU_THRESHOLD:-0.25}"
|
||||
MOL_MIN_MEAN_F1="${MOL_MIN_MEAN_F1:-0.25}"
|
||||
MOL_MIN_ZONE_F1="${MOL_MIN_ZONE_F1:-0.10}"
|
||||
MOL_MIN_REFERENCE_COVERAGE="${MOL_MIN_REFERENCE_COVERAGE:-0.95}"
|
||||
MOL_MIN_REFERENCE_COVERAGE="${MOL_MIN_REFERENCE_COVERAGE:-0.90}"
|
||||
MOL_MAX_BACKGROUND_DETECTIONS="${MOL_MAX_BACKGROUND_DETECTIONS:-0}"
|
||||
|
||||
if [ "${BASE_URL}" = "-h" ] || [ "${BASE_URL}" = "--help" ]; then
|
||||
|
||||
Reference in New Issue
Block a user