Langfuse for voice agents: where the trace stops

Langfuse is a strong open-source LLM observability tool, and Vapi, Pipecat and LiveKit can all send it traces. But a voice agent fails on calls, not on spans. Here is what Langfuse covers for a voice team, what it leaves to you, and how Zelto Observability differs.

Langfuse vs Zelto for voice agents

Both take OpenTelemetry traces and run LLM judges. The difference is the unit: Langfuse is built around the LLM trace, Zelto around the call. Features as of November 2026; check each vendor's docs before you commit.

LangfuseZelto Observability
Built forLLM applications of any kind: chatbots, RAG, agents. The trace and its observations are the core object.Voice and text agents. The conversation (recording, transcript, tool calls, outcome) is the core object, and traces attach to it.
Getting voice data inVapi through its built-in Langfuse integration. Pipecat and LiveKit Agents through their OpenTelemetry support. Elsewhere you instrument with the Langfuse SDK.Native connectors bring in calls from Vapi, Retell, ElevenLabs, LiveKit, Telnyx and Speechify. OTLP/HTTP for traces from any stack, and one REST call (calls.ingest) for custom stacks.
AudioSupported as media attachments on traces. Your code uploads them.The call recording comes in with the conversation. A player sits beside the span tree, so you hear the turn you're inspecting.
EvaluationLLM-as-a-judge evaluators on production traces, datasets and experiments, and annotation queues for human review.Monitors: yes/no AI judges plus tool checks that read whether a tool actually ran, on every conversation, with threshold alerts to Slack or email.
Finding what breaksFilter and score traces. Grouping failures across thousands of calls is left to you.Findings: calls that fail for the same reason grouped into one issue, ranked by call volume, with a drafted fix and an optional Linear ticket.
HostingMIT-licensed core. Self-host for free, or use Langfuse Cloud.Managed cloud with a free tier. Traces are kept up to 90 days.
Best fitTeams that want self-hosted LLM tracing, prompt management and evals across several kinds of LLM apps.Teams whose product is the phone call and who need to know which calls fail, why, and how often.

What a trace alone won't show you

These are the voice failures we see most when we grade every production call. In a trace, each one shows up as green spans.

The agent confirmed something that never happened

The booking tool errored or timed out and the LLM told the caller it was done. The LLM span looks fine. You only catch it by checking the tool result against what was said, on every call.

Turn-taking problems

The agent talks over callers, waits too long, or answers background noise. STT and TTS spans report normal latency. The problem is in the audio and the transcript, so you have to be able to hear the moment.

Failures you can only see in aggregate

One failed transfer looks like bad luck. Forty failed transfers after Tuesday's prompt change is a regression. Scoring traces one at a time doesn't surface that; grouping calls by cause and ranking by volume does.

Calls that never produced a trace

Hosted platforms only send traces where an integration exists, and your own exporter drops batches under load. Ingesting the calls themselves from the platform means you're grading every call, not every trace that arrived.

Keep your traces, grade the calls

  1. Step 01

    Connect your voice platform

    Paste an API key for Vapi, Retell, ElevenLabs, LiveKit or Telnyx, or send calls with one REST call (calls.ingest). Every completed call arrives with its recording, transcript and tool calls. No changes to your agent.

  2. Step 02

    Send traces to Zelto too

    Point an OpenTelemetry exporter at ingest.zelto.ai and set session.id to the call's ID. Each trace links to its conversation. An OTel collector can send the same spans to Langfuse and Zelto, so you don't have to pick one yet.

  3. Step 03

    Every call graded, failures grouped

    Monitors judge every conversation. Calls that fail for the same reason become one Finding, ranked by volume, with example calls, a drafted fix, Slack alerts, and an optional Linear ticket.

Langfuse for voice agents: common questions

What voice teams ask us when they already run Langfuse, or are about to.

Built for voice agents. Catch. Fix. Measure.