14 lines
839 B
Markdown
14 lines
839 B
Markdown
# Latency profiling
|
|
|
|
ModelForge records bounded, content-free timing evidence for capability invocations. Local spans use
|
|
monotonic clocks; cross-process totals are correlated by request ID and are not calculated by
|
|
subtracting wall-clock timestamps.
|
|
|
|
The M7 live profile showed that one-second worker polling dominated the M6 path. Bounded server-side
|
|
long polling (maximum five seconds), a one-second worker wait and a short retry path reduced warm
|
|
Gateway p50 from 1144.46 ms to 194.66 ms across 20 requests. Median contributors after the change
|
|
were dispatch 49.18 ms, response transport 47.62 ms, inference 38.14 ms, scheduler 30.13 ms, payload
|
|
persistence 9.43 ms, resolution 5.05 ms and result retrieval 3.80 ms. Correctness and security gates
|
|
remain in the request path. Detailed evidence is in `docs/quality/M7_VERIFICATION.md`.
|
|
|