Speaker intelligence API

Speaker intelligence API

Speaker diarization API

Speaker diarization API

Speaker diarization API

Send audio, get back who spoke when and how: speaker labels with precise timestamps, in batch or in real-time.

Send audio, get back who spoke when and how: speaker labels with precise timestamps, in batch or in real-time.

Send audio, get back who spoke when and how: speaker labels with precise timestamps, in batch or in real-time.

No credit card required

Built by the team behind the most-used diarization model: pyannote.audio - 1B+ download.

In production in 500+ enterprises - Synthesia, Descript, SmallestAI, Notta, Gladia, UpMeet...

Diarization output

Live-1 · 300 ms

SPEAKER_00

SPEAKER_01

SPEAKER_02

{ "speaker": "SPEAKER_01", "start": 7.412, "end": 11.089, "confidence": 0.97}

Overlap marked at 00:14 — two speakers active in the same instant.

Voice AI is production infrastructure now. The hard part is no longer “what was said.” It is who said it, when.
Power your voice AI workflows with best-of-breed speaker diarization.

Voice AI is production infrastructure now. The hard part is no longer “what was said.” It is who said it, when.
Power your voice AI workflows with best-of-breed speaker diarization.

A speaker diarization API takes an audio file or a live stream and returns structured segments: a speaker label, start and end timestamps, and a confidence score for each turn. It identifies speakers, even in the most complex conversations, and pairs with any Speech-to-Text model to produce speaker-attributed transcripts.

A speaker diarization API takes an audio file or a live stream and returns structured segments: a speaker label, start and end timestamps, and a confidence score for each turn. It identifies speakers, even in the most complex conversations, and pairs with any Speech-to-Text model to produce speaker-attributed transcripts.

Twelve years of diarization research

Choose the model that fits the workload

Choose the model
that fits the workload

Precision-3: highest accuracy, batch or streaming

The commercial model, for teams shipping diarization to end users.

Batch mode

Post-call analytics, compliance archives, and any workload where you hold the full recording

Streaming mode

Live-1, so speaker labels arrive as the audio does at 300 ms latency

Voiceprints and speaker identification

Confidence scores at turn and sample level, input parameters, and output scores to tune detection and interpret results

We respect your privacy by design

No customer data has ever been used to train our models.

Available as a Cloud API, and On-Premise

On-devices, or air-gapped when the audio cannot leave your infrastructure

Community-1: Open-Source, cost-efficient at volume

The open-source model, self-hosted and free.

Batch diarization

Running on your own hardware

Fine-tune on your own data

The only version you can fine-tune on your own annotated data

pyannote.audio

Backed by the pyannote.audio ecosystem and its community

Precision-3

Precision-3

Commercial, Highest Accuracy

Commercial, Highest Accuracy

Community-1

Community-1

Open source

Open source

Processing

Processing

Batch and Streaming: 300 ms with Live-1

Batch and Streaming: 300 ms with Live-1

Batch

Batch

Deployment

Deployment

Cloud API, on-premises, on-device

Cloud API, on-premises, on-device

Self-hosted

Self-hosted

Features

Features

Voiceprints and speaker identification, confidence scores, STT orchestration, VAD and cross-talk tuning

Voiceprints and speaker identification, confidence scores, STT orchestration, VAD and cross-talk tuning

Fine-tuning on your annotated data

Fine-tuning on your annotated data

Optimized for

Optimized for

Accuracy on hard audio, latency, production reliability

Accuracy on hard audio, latency, production reliability

Full control

Full control

Typical use

Typical use

Transcription and indexing, healthcare scribing, regulated recording, training data…

Transcription and indexing, healthcare scribing, regulated recording, training data…

Research, internal tooling

Research, internal tooling

The open-source model gives you the model. The commercial one gives you the production system around it: Precision-3 delivers a 34% lower diarization error rate and 6.3 times faster throughput.

The open-source model gives you the model. The commercial one gives you the production system around it: Precision-3 delivers a 34% lower diarization error rate and 6.3 times faster throughput.

Already using an STT provider with diarization built in?

Already using an STT provider with diarization built in?

Keep it. pyannote is a layer on top of your STT, not a replacement for it.

Keep it. pyannote is a layer on top of your STT, not a replacement for it.

Bundled diarization is a feature of a transcription API: it ships on the ASR roadmap, returns anonymous labels that only hold within a single request, and gives you little to tune. That is enough for clean two-party audio. It stops being enough when speaker attribution and accuracy is what your product sells.

Bundled diarization is a feature of a transcription API: it ships on the ASR roadmap, returns anonymous labels that only hold within a single request, and gives you little to tune. That is enough for clean two-party audio. It stops being enough when speaker attribution and accuracy is what your product sells.

Bundled in an STT API

Bundled in an STT API

pyannote

pyannote

Works with

Works with

That vendor's ASR

That vendor's ASR

Any STT, TTS or Voice AI model

Any STT, TTS or Voice AI model

Identity across sessions

Identity across sessions

Identity across sessions

No, labels reset each request

No, labels reset each request

Voiceprints, enrolled once and reusable

Voiceprints, enrolled once and reusable

Real-time

Real-time

Latency set by the ASR stream

Latency set by the ASR stream

300 ms with Live-1, independent of your STT

300 ms with Live-1, independent of your STT

Confidence scores

Confidence scores

Usually not exposed

Usually not exposed

Turn level and sample level

Turn level and sample level

Overlapping speech

Overlapping speech

Not tunable

Not tunable

End-to-end segmentation, VAD and cross-talk tuning

End-to-end segmentation, VAD and cross-talk tuning

Deployment

Deployment

Follows the transcription vendor

Follows the transcription vendor

Cloud, on-premises, on-device

Cloud, on-premises, on-device

In production today

What developers build

What developers build

What developers build

Meeting intelligence. Financial services compliance. Healthcare AI scribing. Voice agent evaluation. Media, dubbing and subtitling. Training data for speech models. Sales and support coaching.

Meeting intelligence. Financial services compliance. Healthcare AI scribing. Voice agent evaluation. Media, dubbing and subtitling. Training data for speech models. Sales and support coaching.

Meeting intelligence

Readable, speaker-attributed transcripts that hold up in overlapping or noisy audio, so summaries and action items land on the right person.

Financial services compliance

Timestamped, speaker-attributed records that support audits, risk review, and dispute resolution.

Healthcare AI scribing

Clean separation of clinician, patient, and third parties, so clinical notes are attributed correctly and need less manual repair.

Voice agent evaluation

Turn-taking, latency and interruption patterns measured from the audio itself, to tell where an agent talks over its user.

Media and podcast production

Voice-aligned segments for editing, subtitling, dubbing and multilingual delivery.

Training data for speech models

Segmented and speaker-labelled audio for training, fine-tuning and evaluation.

Start in minutes

Start in minutes

Create an API key, send your first request, and read back segments with speaker labels, timestamps, and confidence scores.

Create an API key, send your first request, and read back segments with speaker labels, timestamps, and confidence scores.

1

Create an API key from the dashboard.

2

Send your first request with the audio you want to process.

3

Read back a list of segments: speaker label, start, end, confidence.

Language-agnostic

Precise timestamps

Batch, streaming, on-device

Sovereign

curl

1


2


3


4


5


6

1


2


3


4


5


6

Curl --request POST
--url https://api.pyannote.ai/v1/diarize \


--header ‘Authorisation: Bearer <token>’ \
--data ‘{
“url”: "https://files.pyannote.ai/marklex1min.wav",
}’

Curl --request POST
--url https://api.pyannote.ai/v1/diarize \


--header ‘Authorisation: Bearer <token>’ \
--data ‘{
“url”: "https://files.pyannote.ai/marklex1min.wav",
}’

Pricing

Pricing

Every plan includes audio hours. Developer covers up to 170 hours per month, Starter up to 1,030, Enterprise is priced on volume.

What does a speaker diarization API do?

What does a speaker diarization API do?

What does a speaker diarization API do?

It partitions audio by speaker. You send a file or a stream, and it returns who spoke, when they started, when they stopped, and how confident the model is. It estimates the speaker count on its own, which is what separates diarization from channel splitting.


Diarization does not transcribe: it answers "who spoke when", and speech-to-text answers "what was said". Run both, and you get a speaker-attributed transcript. Diarization also does not name people. It returns anonymous labels such as SPEAKER_00. Attaching a real identity is speaker identification, and it needs an enrolled voiceprint.

How diarization works

How diarization works

01

Voice activity detection separates speech from silence, music, and noise.

02

Segmentation cuts speech where the active speaker changes. Overlap handling happens here: end-to-end models can mark two speakers as active at the same instant.

03

Speaker embeddings project each segment into a space where distance reflects voice similarity, not words or language.

04

Clustering groups those embeddings. Each cluster is one speaker, and the cluster count is the estimated speaker count.

How is diarization accuracy measured?

How is diarization accuracy measured?

The standard metric is diarization error rate (DER): the share of speech time attributed to the wrong speaker. It sums false alarms (non-speech labelled as speech), missed speech (usually the quieter voice in an overlap), and speaker confusion (right speech, wrong label). Lower is better, and it is time-weighted, so one mislabelled monologue costs more than several mislabelled interjections.

Published numbers are a screening tool, not a verdict. Benchmark datasets are not your audio. Run your own recordings through the model before you commit.

FAQ

FAQ

Frequently
asked questions

Frequently
asked questions

Frequently

asked questions

Explore the ways in which pyannote users incorporate our technologies

Explore the ways in which pyannote users incorporate our technologies

How many speakers can diarization detect?

Yes, absolutely! You can sign up for a free trial and enjoy 150 hours of identification and 10 voiceprints for one month. You will have access to our latest premium models to ensure accuracy and precision for your speech processing needs.

Does diarization include transcription?

Yes, absolutely! You can sign up for a free trial and enjoy 150 hours of identification and 10 voiceprints for one month. You will have access to our latest premium models to ensure accuracy and precision for your speech processing needs.

Can diarization run in real time?

Yes, absolutely! You can sign up for a free trial and enjoy 150 hours of identification and 10 voiceprints for one month. You will have access to our latest premium models to ensure accuracy and precision for your speech processing needs.

My STT provider already includes diarization. Why add pyannote?

Yes, absolutely! You can sign up for a free trial and enjoy 150 hours of identification and 10 voiceprints for one month. You will have access to our latest premium models to ensure accuracy and precision for your speech processing needs.

Does diarization work in my language?

Yes, absolutely! You can sign up for a free trial and enjoy 150 hours of identification and 10 voiceprints for one month. You will have access to our latest premium models to ensure accuracy and precision for your speech processing needs.