15 lines
1.1 KiB
Markdown
15 lines
1.1 KiB
Markdown
# Resource classes
|
|
|
|
Resource classes provide an operator-facing scheduling expectation; measured `CapabilityResourceEnvelope` evidence remains authoritative.
|
|
|
|
| Class | Meaning |
|
|
| --- | --- |
|
|
| LIGHT | Usually CPU or a small GPU footprint; may coexist when measured budgets allow. |
|
|
| MEDIUM | Material GPU residency; serialized when current envelopes require it. |
|
|
| HEAVY | Requires an explicit measured envelope and conservative shared-GPU admission. |
|
|
| EXCLUSIVE_GPU | Intended to occupy the schedulable GPU budget alone. |
|
|
|
|
Admission uses current accelerator telemetry minus external/unmanaged use, active ModelForge residents and leases, and the fixed safety reserve. It rejects unsafe work with `INSUFFICIENT_SCHEDULABLE_VRAM` instead of attempting an OOM. The label never overrides the byte budget.
|
|
|
|
GPU Node remains a single shared NVIDIA GPU. Ollama, Tdarr and Plex are observed as external pressure only; ModelForge does not stop, restart or reconfigure them. Load, invoke and unload jobs share the existing database-backed lease and residency coordinator, so OCR, Whisper, image generation and assistants cannot bypass contention controls.
|