Files

1.1 KiB

Resource classes

Resource classes provide an operator-facing scheduling expectation; measured CapabilityResourceEnvelope evidence remains authoritative.

Class Meaning
LIGHT Usually CPU or a small GPU footprint; may coexist when measured budgets allow.
MEDIUM Material GPU residency; serialized when current envelopes require it.
HEAVY Requires an explicit measured envelope and conservative shared-GPU admission.
EXCLUSIVE_GPU Intended to occupy the schedulable GPU budget alone.

Admission uses current accelerator telemetry minus external/unmanaged use, active ModelForge residents and leases, and the fixed safety reserve. It rejects unsafe work with INSUFFICIENT_SCHEDULABLE_VRAM instead of attempting an OOM. The label never overrides the byte budget.

GPU Node remains a single shared NVIDIA GPU. Ollama, Tdarr and Plex are observed as external pressure only; ModelForge does not stop, restart or reconfigure them. Load, invoke and unload jobs share the existing database-backed lease and residency coordinator, so OCR, Whisper, image generation and assistants cannot bypass contention controls.