23 lines
1.3 KiB
Markdown
23 lines
1.3 KiB
Markdown
# GPU Pressure and Hysteresis
|
|
|
|
M10 derives memory pressure from schedulable headroom after physical use, unmaterialized leases and
|
|
the dynamic reserve. Temperature and utilization are health signals, not memory-pressure aliases.
|
|
|
|
The states are `NORMAL`, `ELEVATED`, `HIGH`, and `CRITICAL`. Worsening pressure applies immediately.
|
|
Recovery crosses a lower threshold and must remain stable for 30 seconds; a cooldown prevents an
|
|
immediate new speculative load. This asymmetric state machine prevents external-use oscillation
|
|
from repeatedly loading and unloading models.
|
|
|
|
- `NORMAL`: normal placement and residency policy.
|
|
- `ELEVATED`: no new speculative heavy residency.
|
|
- `HIGH`: background and LAB heavy loads queue or reject.
|
|
- `CRITICAL`: no new admission; eligible idle ModelForge residency may drain.
|
|
|
|
External GPU memory is always unmanaged. ModelForge observes it, recalculates headroom and protects
|
|
its own admission boundary. It exposes no PID, container, Docker or process-control operation and
|
|
never kills, pauses, restarts or reconfigures external workloads.
|
|
|
|
Missing/stale telemetry or uncertain attribution becomes conservative placement evidence. The same
|
|
pure hysteresis transition function is used in service decisions and deterministic oscillation,
|
|
sustained-pressure, recovery and cooldown tests.
|