Initial public ModelForge release

2026-09-01 21:30:16 +02:00
commit 7082ab955a
490 changed files with 104252 additions and 0 deletions
@@ -0,0 +1,22 @@
+# GPU Pressure and Hysteresis
+
+M10 derives memory pressure from schedulable headroom after physical use, unmaterialized leases and
+the dynamic reserve. Temperature and utilization are health signals, not memory-pressure aliases.
+
+The states are `NORMAL`, `ELEVATED`, `HIGH`, and `CRITICAL`. Worsening pressure applies immediately.
+Recovery crosses a lower threshold and must remain stable for 30 seconds; a cooldown prevents an
+immediate new speculative load. This asymmetric state machine prevents external-use oscillation
+from repeatedly loading and unloading models.
+
+- `NORMAL`: normal placement and residency policy.
+- `ELEVATED`: no new speculative heavy residency.
+- `HIGH`: background and LAB heavy loads queue or reject.
+- `CRITICAL`: no new admission; eligible idle ModelForge residency may drain.
+
+External GPU memory is always unmanaged. ModelForge observes it, recalculates headroom and protects
+its own admission boundary. It exposes no PID, container, Docker or process-control operation and
+never kills, pauses, restarts or reconfigures external workloads.
+
+Missing/stale telemetry or uncertain attribution becomes conservative placement evidence. The same
+pure hysteresis transition function is used in service decisions and deterministic oscillation,
+sustained-pressure, recovery and cooldown tests.