1.3 KiB
M7 Model Comparison and Advisor Evidence
M7 adds candidate evaluation without changing the production capability binding.
CapabilityExperimentRoute is an opaque, authenticated lab route to one non-production
CapabilityDeployment. It preserves the rag.embedding@1 contract, applies RuntimeProfile-owned
query/document semantics, and writes a distinct EmbeddingSpace. Input semantics are part of the
space identity: changing a query instruction therefore requires a new space and full reindex.
ModelComparison references a project, capability contract, immutable suite revision and current
run. Evaluated candidates reference their EvaluationRun; blocked candidates preserve their exact
blocker and unknown metrics. AdvisorRecommendation contains structured deltas, critical
regressions, resources, migration, security, policy and evidence confidence. Recommendations are
advisory and dismissible but never executable.
The ExampleRAG M7 comparison uses dense embeddings only, unchanged sparse encoding/RRF, unchanged filters, candidate limit 40, top 10 and no reranker. This isolates the embedding variable.
The latency trace API is admin-only and returns at most 500 summary records. Input content and input digests are not exposed. Gateway database retention remains bounded by operator retrieval limits; M7 does not introduce an unbounded span store.