Initial public ModelForge release

2026-09-01 21:30:16 +02:00
commit 7082ab955a
490 changed files with 104252 additions and 0 deletions
@@ -0,0 +1,13 @@
+# Residency Manager
+
+Residency is distinct from a request lease. M10's full multi-resident identity and recovery contract
+is specified in `docs/architecture/MULTI_CAPABILITY_RESIDENCY.md`. The state machine is cold → loading → warm/busy →
+draining/unloading → cold, with explicit failed states. A cold request creates exactly one serialized
+load job; later requests reuse the resident adapter at its measured concurrency of one.
+
+Policies are `always_warm`, `keep_warm`, `load_on_demand` and `lab_only`. The production embedding deployment
+uses `keep_warm` with a 901-second TTL. Unload is allowed only without active leases. Model-owned
+VRAM reclaim is measured with the PyTorch CUDA allocator; NVML total memory remains the independent
+external-pressure signal. Workers report the complete deployment inventory and generation.
+Exact immutable identities can be adopted after a control-plane restart; absent identities are
+reconciled cold and unknown GPU processes remain external.