Add browser calibration evidence bundle smoke
This commit is contained in:
@@ -1,3 +1,31 @@
|
||||
## Sprint 138 Browser calibration evidence bundle smoke (2026-07-08)
|
||||
|
||||
Changed:
|
||||
- Added `scripts/smoke_detection_calibration_evidence_bundle.sh` as a local operator smoke for the Detection Lab `detection-calibration-summary.json` to QA evidence bundle path.
|
||||
- The smoke creates a temporary browser-style calibration summary, injects a temporary mock `curl` for canonical QA evidence endpoint responses, runs the real `scripts/export_detection_calibration_evidence.sh` exporter and validates the generated GeoJSON, summary JSON and HTML review artifacts.
|
||||
- Added readiness syntax coverage for the smoke script.
|
||||
- Updated `scripts/README.md`, `CHANGELOG.md` and `docs/TODO.md`.
|
||||
- Added regression coverage in `backend/tests/test_sprint138_calibration_evidence_bundle_smoke.py`.
|
||||
|
||||
Tested:
|
||||
- Red step: `python -m pytest backend\tests\test_sprint138_calibration_evidence_bundle_smoke.py -q` failed while `scripts/smoke_detection_calibration_evidence_bundle.sh` was absent.
|
||||
- `python -m pytest backend\tests\test_sprint138_calibration_evidence_bundle_smoke.py -q` (`1 passed`)
|
||||
- `python -m pytest backend\tests\test_sprint138_calibration_evidence_bundle_smoke.py backend\tests\test_sprint137_browser_calibration_summary_evidence_script.py backend\tests\test_sprint125_detection_calibration_evidence_bundle.py -q` (`3 passed`)
|
||||
- `bash -n scripts/smoke_detection_calibration_evidence_bundle.sh`
|
||||
- `bash scripts/smoke_detection_calibration_evidence_bundle.sh --help`
|
||||
- `python -m compileall backend/app`
|
||||
- `bash scripts/run_readiness_check.sh` (`417 passed`; frontend typecheck/build passed; Alembic head `202606120900`; shell syntax gates passed)
|
||||
|
||||
Open:
|
||||
- None for this pass.
|
||||
|
||||
Limitations:
|
||||
- This is local/operator evidence tooling only. It does not call live production data, mutate application data, add backend endpoints, change migrations, rerun inference, create QA metrics, promote thresholds, download models, add provider fetching or change frontend runtime behavior.
|
||||
- The smoke uses mocked canonical evidence responses by design; real persisted QA evidence is still validated by running `export_detection_calibration_evidence.sh` against a live browser or sweep summary.
|
||||
|
||||
Next recommended pass:
|
||||
- Add a real multi-AOI calibration evidence capture convention: one folder per AOI/model/threshold matrix with browser summary, evidence bundle and operator notes, so model promotion decisions are based on comparable persisted artifacts rather than isolated runs.
|
||||
|
||||
## Sprint 137 Browser calibration summary evidence bundle handoff (2026-07-08)
|
||||
|
||||
Changed:
|
||||
|
||||
@@ -424,5 +424,6 @@ This file now starts with the current implementation status. Older preparation/b
|
||||
- [x] Link guided calibration rows to the QA evidence map.
|
||||
- [x] Add guided calibration summary export from the Detection Lab.
|
||||
- [x] Allow the evidence bundle script to consume Detection Lab calibration summary exports.
|
||||
- [x] Add a local browser-summary QA evidence bundle smoke using mocked canonical evidence responses.
|
||||
- [ ] Add more AOIs after the tile-level baseline so the next local model attempt is not limited to Geel/Mol/Turnhout.
|
||||
- [ ] Add negative/background AOIs so the next tile dataset is not all positive tiles.
|
||||
|
||||
Reference in New Issue
Block a user