Files
ModelForge/docs/architecture/SPEECH_CONSUMER_INTEGRATION.md
T

22 lines
1.1 KiB
Markdown

# Speech consumer integration
ExampleVision spoken card search is the first operational consumer of `speech.transcription@1`. It is a
small, useful local flow adjacent to the scanner and does not require persisted audio. The dedicated
interactive client is bound only to the speech contract; ExampleVision knows no Whisper model, revision,
runtime, worker or node.
```text
ExampleVision WAV upload -> transient consumer buffer -> ModelForge Gateway -> M10 scheduler
-> GPU Node offline speech runtime -> text -> ExampleVision response
```
The consumer rejects unsupported or oversized input, removes temporary audio after the call, exposes
typed unavailable/auth/capacity failures and has no cloud fallback. ModelForge telemetry stores
dimensions, timing and state, never audio.
Live acceptance used four representative NL/EN Windows TTS samples. All four completed through the
consumer and Gateway with zero errors; consumer p50/p95 latency was 319.622/393.442 ms and the small
suite's normalized WER was 0.380952. This proves the integration but not natural-microphone quality,
so the project recommendation remains `KEEP_LAB`.