record explicit AI-assisted AOI review ledger
GeoIntel release gates / Compile, test, contracts and builds (push) Canceled after 0s
GeoIntel release gates / Python and npm vulnerability policy (push) Canceled after 0s
GeoIntel release gates / GIS image, SBOM and container scan (push) Canceled after 0s

This commit is contained in:
Jens
2026-08-09 15:28:04 +02:00
parent 182e72e46d
commit f9a466b221
4 changed files with 114 additions and 0 deletions
@@ -0,0 +1,71 @@
{
"schema_version": 1,
"ledger_id": "reviewedexp6-ai-assisted-review-r1",
"reviewed_at": "2026-08-09T14:00:00+02:00",
"reviewer": {
"id": "openai-codex",
"type": "ai_assistant",
"human": false
},
"status": "complete_ai_assisted_experimental_only",
"explicit_limitations": [
"This ledger is not human review and must never satisfy a human-review release gate.",
"Decisions cover the 64 rendered samples on the contact sheet, not every label instance in the corpus.",
"Visible roof geometry can be displaced from authoritative GRB ground-level footprints.",
"Accepted samples are eligible only for experimental training and non-protected validation."
],
"artifacts": {
"contact_sheet_path": "/app/storage/operator-data/model-review/reviewedexp6-corpus/visual-review/contact_sheet_001.png",
"contact_sheet_sha256": "411ee541dcd53b59abc1c12f733f164b28478a1398ab2d50be8c728b11c8fdc4",
"review_summary_path": "/app/storage/operator-data/model-review/reviewedexp6-corpus/visual-review/operator_yolo_label_qa_summary.json",
"rendered_tile_count": 64,
"rendered_label_count": 21611,
"selected_sample_count": 28
},
"visual_criteria": [
"labels overlap visible building structures at the scale shown",
"no systematic axis swap or whole-tile displacement is visible",
"pure-background samples contain no clearly visible buildings",
"sparse contexts are not treated as pure background",
"dense roof-versus-ground-footprint disagreement is retained as an explicit limitation"
],
"decisions": [
{"sample_slug":"arendonk_center","sampled_tiles":2,"sampled_labels":1163,"split":"train","category":"reference_aoi","decision":"experimental_training_eligible"},
{"sample_slug":"balen","sampled_tiles":2,"sampled_labels":794,"split":"train","category":"reference_aoi","decision":"experimental_training_eligible"},
{"sample_slug":"beerse_center","sampled_tiles":2,"sampled_labels":1158,"split":"train","category":"reference_aoi","decision":"experimental_training_eligible"},
{"sample_slug":"dessel_center","sampled_tiles":2,"sampled_labels":841,"split":"train","category":"reference_aoi","decision":"experimental_training_eligible"},
{"sample_slug":"dessel_heide","sampled_tiles":2,"sampled_labels":68,"split":"train","category":"sparse_building_context","decision":"experimental_training_eligible"},
{"sample_slug":"geel","sampled_tiles":2,"sampled_labels":1244,"split":"train","category":"reference_aoi","decision":"experimental_training_eligible"},
{"sample_slug":"geel_bel","sampled_tiles":2,"sampled_labels":62,"split":"train","category":"sparse_building_context","decision":"experimental_training_eligible"},
{"sample_slug":"grobbendonk_center","sampled_tiles":2,"sampled_labels":1008,"split":"val","category":"reference_aoi","decision":"non_protected_validation_only"},
{"sample_slug":"herentals","sampled_tiles":2,"sampled_labels":1512,"split":"train","category":"reference_aoi","decision":"experimental_training_eligible"},
{"sample_slug":"herenthout_bos","sampled_tiles":2,"sampled_labels":199,"split":"train","category":"sparse_building_context","decision":"experimental_training_eligible"},
{"sample_slug":"hoogstraten_center","sampled_tiles":2,"sampled_labels":1063,"split":"train","category":"reference_aoi","decision":"experimental_training_eligible"},
{"sample_slug":"hulshout_center","sampled_tiles":2,"sampled_labels":895,"split":"train","category":"reference_aoi","decision":"experimental_training_eligible"},
{"sample_slug":"kasterlee_bos","sampled_tiles":2,"sampled_labels":72,"split":"train","category":"sparse_building_context","decision":"experimental_training_eligible"},
{"sample_slug":"kasterlee_center","sampled_tiles":2,"sampled_labels":983,"split":"train","category":"reference_aoi","decision":"experimental_training_eligible"},
{"sample_slug":"laakdal_center","sampled_tiles":2,"sampled_labels":156,"split":"train","category":"reference_aoi","decision":"experimental_training_eligible_with_dense_alignment_limitation"},
{"sample_slug":"lille_center","sampled_tiles":2,"sampled_labels":961,"split":"train","category":"reference_aoi","decision":"experimental_training_eligible"},
{"sample_slug":"lommel_heide","sampled_tiles":6,"sampled_labels":0,"split":"train","category":"pure_empty_negative","decision":"experimental_training_eligible"},
{"sample_slug":"meerhout_bos","sampled_tiles":2,"sampled_labels":111,"split":"train","category":"sparse_building_context","decision":"experimental_training_eligible"},
{"sample_slug":"meerhout_center","sampled_tiles":2,"sampled_labels":1016,"split":"train","category":"reference_aoi","decision":"experimental_training_eligible"},
{"sample_slug":"mol","sampled_tiles":2,"sampled_labels":951,"split":"train","category":"reference_aoi","decision":"experimental_training_eligible"},
{"sample_slug":"nijlen_center","sampled_tiles":2,"sampled_labels":1309,"split":"train","category":"reference_aoi","decision":"experimental_training_eligible"},
{"sample_slug":"olen_center","sampled_tiles":2,"sampled_labels":971,"split":"train","category":"reference_aoi","decision":"experimental_training_eligible"},
{"sample_slug":"oud_turnhout_center","sampled_tiles":2,"sampled_labels":1535,"split":"train","category":"reference_aoi","decision":"experimental_training_eligible_with_dense_alignment_limitation"},
{"sample_slug":"postel_bos","sampled_tiles":6,"sampled_labels":0,"split":"train","category":"pure_empty_negative","decision":"experimental_training_eligible"},
{"sample_slug":"ravels_bos","sampled_tiles":2,"sampled_labels":22,"split":"train","category":"sparse_building_context","decision":"experimental_training_eligible"},
{"sample_slug":"rijkevorsel_center","sampled_tiles":2,"sampled_labels":1153,"split":"train","category":"reference_aoi","decision":"experimental_training_eligible"},
{"sample_slug":"vorselaar_center","sampled_tiles":2,"sampled_labels":930,"split":"train","category":"reference_aoi","decision":"experimental_training_eligible"},
{"sample_slug":"vosselaar_center","sampled_tiles":2,"sampled_labels":1434,"split":"val","category":"reference_aoi","decision":"non_protected_validation_only"}
],
"accounting": {
"accepted_experimental_training_samples": 26,
"non_protected_validation_samples": 2,
"rejected_samples": 0,
"pure_empty_negative_samples": 2,
"sparse_context_samples": 6,
"human_review_complete": false,
"production_release_eligible": false
}
}
+21
View File
@@ -12528,3 +12528,24 @@ Open:
representative human review, freeze a new independent corpus and only then representative human review, freeze a new independent corpus and only then
train a pre-registered GPU candidate with provenance captured from process train a pre-registered GPU candidate with provenance captured from process
start. The legacy checkpoint cannot be made compliant retroactively. start. The legacy checkpoint cannot be made compliant retroactively.
## 2026-08-09 - Explicit AI-assisted reviewedexp6 AOI ledger
### Reviewed
- Inspected the existing checksum-bound 64-tile contact sheet at original
resolution. It covers 28 AOIs, 21,611 rendered labels, dense urban, sparse
building context and pure-background examples.
- Recorded a per-AOI machine-readable decision ledger with reviewer type
`ai_assistant`, `human=false`, the contact-sheet hash, sampled tile/label
counts, split roles and explicit roof-versus-GRB limitations.
- Classified 26 represented training AOIs as experimental-training eligible;
kept Grobbendonk and Vosselaar validation-only. No AOI was represented as
human accepted or production release eligible.
### Gate behavior
- Confirmed that the governed training wrapper still requires accepted human
review and therefore does not accept this AI ledger as release evidence.
- Did not add an override, fixture claim or synthetic reviewer identity. No
model training, activation or production redeploy followed from this review.
+6
View File
@@ -1147,3 +1147,9 @@ This file now starts with the current implementation status. Older preparation/b
- [ ] Do not generate a production sidecar for `reviewedexp6`: its exact - [ ] Do not generate a production sidecar for `reviewedexp6`: its exact
training commit/runtime, immutable corpus-label-split manifests and accepted training commit/runtime, immutable corpus-label-split manifests and accepted
human-review ledger were not retained and cannot be reconstructed safely. human-review ledger were not retained and cannot be reconstructed safely.
- [x] Complete an explicitly AI-assisted per-AOI review of the 64-tile
reviewedexp6 contact sheet, retaining reviewer type, artifact hash, split
role, sample accounting and roof/ground-footprint limitations.
- [ ] Convert the AI-assisted ledger into no stronger claim than experimental
triage; a real human must independently review and sign the frozen artifacts
before the governed training wrapper may unlock.
@@ -87,3 +87,19 @@ invented. Consequently no runtime sidecar or database source snapshot was
created, and the challenger remains unavailable to production inference. The created, and the challenger remains unavailable to production inference. The
full machine-readable audit is retained in full machine-readable audit is retained in
`artifacts/evidence/accuracy/model-training/20260809-reviewedexp6-provenance-migration-audit.json`. `artifacts/evidence/accuracy/model-training/20260809-reviewedexp6-provenance-migration-audit.json`.
## Completed AI-assisted AOI ledger
At the user's explicit request, the existing 64-tile contact sheet was
reviewed again at original resolution and recorded as AI-assisted evidence.
The sheet represents 28 AOIs and renders 21,611 labels. Twenty-six represented
training AOIs were classified as eligible for experimental training;
Grobbendonk and Vosselaar remain non-protected validation only. Lommel-heide
and Postel-bos were visually retained as pure-empty examples, while six sparse
contexts remain explicitly distinct from pure background.
The ledger identifies `openai-codex` as an AI assistant and sets `human=false`.
It explicitly cannot satisfy the human-review release gate. The production
training wrapper reproduced that boundary and no bypass was added. The exact
ledger is retained in
`artifacts/evidence/accuracy/model-training/20260809-reviewedexp6-ai-assisted-review-ledger.json`.