Files
ModelForge/docs/operations/RUNBOOK_GATEWAY_ERRORS.md
T

819 B

Runbook: gateway errors or capability unavailable

Trigger

GATEWAY_ERROR_RATE, CAPABILITY_UNAVAILABLE, a breached gateway SLO or fast burn.

Diagnose

Check valid population, sample minimum, short/long burn, capability, priority and bounded failure class. Separate authentication/rate-limit rejection from runtime, queue, scheduler and node failure. Use correlation IDs in structured logs; metrics contain no request content.

Act and recover

Acknowledge without marking the SLO healthy. Stop unsafe LAB traffic if it is the source; do not change production routing, model identity or project binding without M12 authority. Confirm a later rolling-window evaluation, normal request outcomes and explicit alert resolution. For rag.embedding@1, verify the ExampleRAG Ollama baseline remains unchanged.