Files
ModelForge/docs/architecture/SPEECH_CONSUMER_INTEGRATION.md

1.1 KiB

Speech consumer integration

ExampleVision spoken card search is the first operational consumer of speech.transcription@1. It is a small, useful local flow adjacent to the scanner and does not require persisted audio. The dedicated interactive client is bound only to the speech contract; ExampleVision knows no Whisper model, revision, runtime, worker or node.

ExampleVision WAV upload -> transient consumer buffer -> ModelForge Gateway -> M10 scheduler
-> GPU Node offline speech runtime -> text -> ExampleVision response

The consumer rejects unsupported or oversized input, removes temporary audio after the call, exposes typed unavailable/auth/capacity failures and has no cloud fallback. ModelForge telemetry stores dimensions, timing and state, never audio.

Live acceptance used four representative NL/EN Windows TTS samples. All four completed through the consumer and Gateway with zero errors; consumer p50/p95 latency was 319.622/393.442 ms and the small suite's normalized WER was 0.380952. This proves the integration but not natural-microphone quality, so the project recommendation remains KEEP_LAB.