1.3 KiB
GPU Pressure and Hysteresis
M10 derives memory pressure from schedulable headroom after physical use, unmaterialized leases and the dynamic reserve. Temperature and utilization are health signals, not memory-pressure aliases.
The states are NORMAL, ELEVATED, HIGH, and CRITICAL. Worsening pressure applies immediately.
Recovery crosses a lower threshold and must remain stable for 30 seconds; a cooldown prevents an
immediate new speculative load. This asymmetric state machine prevents external-use oscillation
from repeatedly loading and unloading models.
NORMAL: normal placement and residency policy.ELEVATED: no new speculative heavy residency.HIGH: background and LAB heavy loads queue or reject.CRITICAL: no new admission; eligible idle ModelForge residency may drain.
External GPU memory is always unmanaged. ModelForge observes it, recalculates headroom and protects its own admission boundary. It exposes no PID, container, Docker or process-control operation and never kills, pauses, restarts or reconfigures external workloads.
Missing/stale telemetry or uncertain attribution becomes conservative placement evidence. The same pure hysteresis transition function is used in service decisions and deterministic oscillation, sustained-pressure, recovery and cooldown tests.