Initial public ModelForge release

This commit is contained in:
Jens
2026-09-01 21:30:16 +02:00
commit 7082ab955a
490 changed files with 104252 additions and 0 deletions
+17
View File
@@ -0,0 +1,17 @@
# Reranking Capability
`rag.reranking@1` is a first-class capability, never a public model or worker endpoint. A caller
submits one query, 140 bounded `{id,text}` documents and `top_n` 110. The response contains only
stable IDs, finite scores and ranks. ModelForge resolves the experiment deployment, acquires a GPU
lease and dispatches to the private GPU Node runtime worker.
Query and document text exist only in the bounded Redis payload exchange and worker memory. They
are deleted after completion or timeout and never enter PostgreSQL, audit payloads, metrics or
request history. IDs, timings, counts and failure codes may be persisted. There is no network
egress, cloud fallback or `trust_remote_code` path.
The M8 implementation supports the Qwen3 causal-LM reranker adapter with immutable runtime-profile,
artifact-set, exact-revision and probe evidence. Typed failures include `RERANKER_NOT_AVAILABLE`,
`RERANK_REQUEST_TOO_LARGE`, queue/capacity failures and invalid/non-finite output.
The M8 deployment is experiment-only. No stable route or production promotion was created.