Skip to content

[Suggestion] Voice agent end-to-end latency profiling with per-component TTFB breakdown dashboard (Python + TypeScript) #293

Description

@deepgram-robot

What to build

A voice agent example that profiles and visualizes end-to-end latency by measuring Time-to-First-Byte (TTFB) for each component in the pipeline: STT recognition time, LLM response time, and TTS generation time — displayed in a real-time dashboard.

Why this matters

Voice agent developers need to understand where latency originates in their STT → LLM → TTS pipeline to optimize the conversation experience. Deepgram's STT and TTS are among the fastest in the industry (247ms median TTFB on independent benchmarks), but developers have no easy way to measure and visualize this advantage. A latency profiling example helps developers optimize their pipeline and makes Deepgram's speed advantage tangible and measurable.

Suggested scope

  • Python backend: Deepgram STT + Voice Agent API with per-component timing instrumentation
  • TypeScript frontend: React dashboard showing per-turn latency waterfall chart
  • Measure: STT TTFB, LLM TTFB, TTS TTFB, and total round-trip time
  • Display: real-time waterfall chart, rolling average, percentile distribution
  • Deepgram APIs: streaming STT and Aura TTS

Acceptance criteria

  • Runnable with minimal setup (clone, add API key, run)
  • README explains the pattern clearly
  • Uses current SDK version
  • Measures and displays per-component TTFB for at least 3 pipeline stages
  • Includes a visual latency waterfall chart

Raised by the DX intelligence system.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions