Azure Speech STT
Azure Speech STT is one of the components that act as the hearing of a voice agent: it turns what the caller says into text so the agent can understand it. It uses Microsoft’s Azure Speech recognition service. It transcribes while the caller speaks, so the word-based interruption settings of the Voice Agent, such as Minimum Words To Interrupt, work with it.
It plugs into the STT connector of the Voice Agent node. It holds the speech recognition settings the agent uses on every call.
When to use it
- Your company already works with Microsoft Azure and you want the audio processed in your own Azure resource.
- You take calls in Catalan, Galician or Basque, languages NappAI’s local STTs do not understand.
- Callers switch language mid-call and you want the agent to follow them.
- You want callers to be able to interrupt the agent with a few words.
Configuration
You need an Azure Speech credential with your Azure speech resource key and its region. See Credentials.
| Field | What it does |
|---|---|
| Credential (required) | The Azure Speech credential used to connect to the service. |
| Language | Code of the language the caller is expected to speak, for example es, en or ca. Default: es. |
| Detect Language | When on, Azure keeps identifying the caller’s language among those in Supported Languages and the agent switches language with them. Adds a little wait to each turn. Off by default. |
Advanced options
| Field | What it does |
|---|---|
| Supported Languages | Languages detection can switch between. Default: es and en. Only used when Detect Language is on. |
Output
The STT output holds the speech recognition settings. It connects to the STT connector of the Voice Agent node, or to Fallback STT when you turn on Fallback Engines and want it as a backup. The editor will not let you plug it into a TTS connector by mistake.
Example
A Catalan cooperative takes its members’ calls in Catalan and Spanish.
- Add Azure Speech STT and connect it to the STT connector of the Voice Agent.
- In Credential, choose the cooperative’s Azure Speech credential.
- Type
cain Language, turn on Detect Language and leavecaandesin Supported Languages. - Test the agent in the playground speaking both languages.
Good practices
- Turn on Detect Language only if you really get calls in several languages: every turn takes a little longer.
- Azure bills the usage to your own Azure account. Check your usage there.
Related components
- Voice Agent: the node this component connects to.
- Azure Speech TTS: the agent’s voice with the same provider and credential.
- Parakeet (local, multilingual): local speech recognition, no credential needed.