Concepts
Live Voice
Explains how a stub holds a live AI voice call on webchat, WhatsApp or the phone, and where to find the tasks, notifications, feedback, models and voices involved.
Overview
A live voice call puts a caller in a real-time spoken conversation with an AI voice assistant. The call belongs to a stub: the stub starts it, steers it while it's live, and hears back from it during and after the call. A stub can have one live voice call at a time.
The voice assistant talks; the stub does the work. When the assistant needs something it can't answer on its own, such as account details, it hands the request to the stub. The stub handles it, for example with a GPT Chat Task and its tools, and sends the answer back for the assistant to tell the caller.
Channels
A call from start to end
- An action runs Start Voice Chat with the model, instructions and voice. The caller's channel joins the call.
- While the call is live, the stub steers it with voice notifications or the Voice Command task: answer the assistant's requests, give it new instructions, mute the caller, or hang up.
- The call reports back with the
_update_from_voicefeedback action: when the assistant delegates a request, at a regular interval with the latest transcript, and when the call ends. - Every call is recorded. The recording arrives with one more
_update_from_voiceshortly after the call ends.
Related tasks
- Start Voice Chat: start a live voice call.
- Voice Command: send a command to a live call.
- Voice Session Transfer: take a live call over from another stub without ending it.
- Answer Call, Reject Call, Make Call, Transfer Call and Collect Call Digits: phone calls through your phone system.
- Answer WhatsApp Call and Reject WhatsApp Call: WhatsApp calls.
Models
Live voice calls use a live voice model, such as gpt-live-1. Use the stubber-default-voice model alias to always get the model Stubber recommends. See Live Voice Models for the full list.
Voices
Choose the assistant's voice with audio.output.voice on Start Voice Chat. The default is marin.
For the voices available on gpt-live-1, with the language and regional accent of each, see OpenAI's GPT-Live voice options.
The voice is set when the call starts and can't be changed during the call. Each voice has its own timbre, pitch and pacing built in. Use the call's instructions to shape how the assistant speaks, eg its tone, speed or accent.