Realtime WebSocket reference
Message-level AsyncAPI reference for every AllModels WebSocket channel.
Explore every AllModels WebSocket channel, the frames clients send and receive, their payload schemas, and examples.
Channels
Native streaming TTS
Stream text in, receive binary audio out, using a simple JSON command protocol.
Native streaming STT
Stream binary audio in and receive normalized, sequenced STT events.
ElevenLabs SDK-compatible streaming-input TTS
ElevenLabs stream-input protocol across supported TTS providers.
ElevenLabs SDK-compatible realtime STT
ElevenLabs realtime STT protocol across supported STT providers.
OpenAI SDK-compatible realtime transcription
GA OpenAI Realtime transcription events across supported STT providers.
ElevenLabs-compatible Speech Engine conversation
Direct client STT, application response, and streamed TTS conversation.
AllModels Realtime voice session
Direct client audio, normalized transcription, application text, and synthesized audio.
Reference documents
- The raw AsyncAPI document is available at
/asyncapi.yaml. - The API also serves its own copy at
https://api.allmodels.io/asyncapi.yaml. - HTTP upgrade parameters, headers, and error responses are covered in the API reference.
Using WebSockets
See the streaming and realtime guide for complete SDK examples and message flows.
OpenAI SDK-compatible realtime transcription GET
Streams input audio and receives OpenAI realtime transcription events. Set `intent=transcription`; use `/oai/audio/speech` to stream generated speech. Node and Python clients use Bearer authentication. Browser clients can pass `realtime` and `openai-insecure-api-key.<allmodels-key>` as WebSocket subprotocols. Send OpenAI's nested `session.update` before audio. `turn_detection: null`, `server_vad`, and `semantic_vad` translate to portable manual, acoustic, and semantic intent for the selected provider. Unsupported configurations arrive as official OpenAI `error` events. Query-level `provider_options[...]` remains the native override extension. The message-level protocol is documented at [the realtime WebSocket reference](/realtime-reference) (AsyncAPI spec: [/asyncapi.yaml](/asyncapi.yaml)).
Native TTS client frames RECEIVE
Next Page