What is an AI voice agent?

An AI voice agent is software that holds phone conversations on its own: it understands the caller, decides what to answer and speaks with a synthetic voice — and hands over to a person when needed.

Illustration: Illustration: one turn of a call with measured times
Caller
SIP gateway
Speech recognition
Language model + tools
Voice
answered in 0.14–0.31 s first audio 136 ms (median) end of speech → first sound 1.4 s (median, test calls) Illustration

Key terms

AI voice agent
Software that conducts phone calls using speech recognition, a language model and voice synthesis, and can use your systems through tools.
On-premises (local) AI voice agent
An AI voice agent whose speech recognition, voice and recordings run on the customer's own servers instead of a vendor's cloud.
AI call centre
A contact centre where AI voice agents handle part of the calls, with human staff for complex cases.
Speech recognition (STT/ASR)
Turns the caller's speech into text. AI Fortis uses its own speech recognition on the customer's GPU server.
Text-to-speech (TTS)
Turns the answer text into a voice. AI Fortis uses its own neural voices.
Language model (LLM)
Decides what to say and when to use a tool; your provider via API or a local model.
Turn-taking and barge-in
Deciding who speaks when, and letting the caller interrupt the agent naturally.
SIP trunk
The connection between your phone numbers and the internet-telephony gateway.
AI disclosure
The agent says it is an AI at the start of the call, as required by the EU AI Act, Art. 50.

Frequently asked questions

Can an AI voice agent replace a call centre?

It can take over the repetitive calls with a clear goal (reminders, bookings, status questions, surveys) and hand complex cases to people. Most companies start by augmenting the call centre, then extend.

What does an on-premises AI voice agent need?

A GPU server in your data centre (we supply it), a SIP trunk or PBX connection and API access to the systems the agent should use.

See it working on your own scenario

Book a 20-minute call, listen to the agent, or let us build a free sample agent for one of your call types. No commitment.

  • GDPR by design
  • Runs on your own servers
  • 24/7 operation and support
  • A team of 5 in Sofia, EU

Already running in production at organisations in Bulgaria — names under NDA.

How we prove it →