---
title: "What is an AI voice agent? Definitions for call centres"
description: "What is an AI voice agent? Clear definitions for call centres: on-premises agents, AI call centre, speech recognition, text-to-speech, barge-in, SIP trunk."
url: https://aifortis.com/en/enterprise-ai-callcenter/what-is-an-ai-voice-agent/
language: en
last_updated: 2026-11-08
publisher: AI Fortis Ltd. (Sofia, Bulgaria)
---

# What is an AI voice agent?

An AI voice agent is software that holds phone conversations on its own: it understands the caller, decides what to answer and speaks with a synthetic voice — and hands over to a person when needed.

## Key terms

- **AI voice agent**: Software that conducts phone calls using speech recognition, a language model and voice synthesis, and can use your systems through tools.
- **On-premises (local) AI voice agent**: An AI voice agent whose speech recognition, voice and recordings run on the customer's own servers instead of a vendor's cloud.
- **AI call centre**: A contact centre where AI voice agents handle part of the calls, with human staff for complex cases.
- **Speech recognition (STT/ASR)**: Turns the caller's speech into text. AI Fortis uses its own speech recognition on the customer's GPU server.
- **Text-to-speech (TTS)**: Turns the answer text into a voice. AI Fortis uses its own neural voices.
- **Language model (LLM)**: Decides what to say and when to use a tool; your provider via API or a local model.
- **Turn-taking and barge-in**: Deciding who speaks when, and letting the caller interrupt the agent naturally.
- **SIP trunk**: The connection between your phone numbers and the internet-telephony gateway.
- **AI disclosure**: The agent says it is an AI at the start of the call, as required by the EU AI Act, Art. 50.

## Frequently asked questions

### Can an AI voice agent replace a call centre?

It can take over the repetitive calls with a clear goal (reminders, bookings, status questions, surveys) and hand complex cases to people. Most companies start by augmenting the call centre, then extend.

### What does an on-premises AI voice agent need?

A GPU server in your data centre (we supply it), a SIP trunk or PBX connection and API access to the systems the agent should use.

## See it working on your own scenario

Book a 20-minute call, listen to the agent, or let us build a free sample agent for one of your call types. No commitment.

- GDPR by design
- Runs on your own servers
- 24/7 operation and support
- A team of 5 in Sofia, EU

Already running in production at organisations in Bulgaria — names under NDA.

[How we prove it →](https://aifortis.com/en/how-we-prove-it/)

---
Source: https://aifortis.com/en/enterprise-ai-callcenter/what-is-an-ai-voice-agent/
