18 lines
1.1 KiB
Markdown
18 lines
1.1 KiB
Markdown
# Reranking Capability
|
||
|
||
`rag.reranking@1` is a first-class capability, never a public model or worker endpoint. A caller
|
||
submits one query, 1–40 bounded `{id,text}` documents and `top_n` 1–10. The response contains only
|
||
stable IDs, finite scores and ranks. ModelForge resolves the experiment deployment, acquires a GPU
|
||
lease and dispatches to the private GPU Node runtime worker.
|
||
|
||
Query and document text exist only in the bounded Redis payload exchange and worker memory. They
|
||
are deleted after completion or timeout and never enter PostgreSQL, audit payloads, metrics or
|
||
request history. IDs, timings, counts and failure codes may be persisted. There is no network
|
||
egress, cloud fallback or `trust_remote_code` path.
|
||
|
||
The M8 implementation supports the Qwen3 causal-LM reranker adapter with immutable runtime-profile,
|
||
artifact-set, exact-revision and probe evidence. Typed failures include `RERANKER_NOT_AVAILABLE`,
|
||
`RERANK_REQUEST_TOO_LARGE`, queue/capacity failures and invalid/non-finite output.
|
||
|
||
The M8 deployment is experiment-only. No stable route or production promotion was created.
|