Phone Based Voice Agent with Web Search

A production-ready voice agent that answers phone calls through Twilio, engages in natural interruptible conversations, and performs real-time web searches using tool calling. The agent bridges Twilio Media Streams to a voice AI backend using G.711 mu-law audio passthrough without transcoding.

No demo yetView source Fork template

The numbers

latency—

cost / min—

frameworkCustom

The stack

telephonyTwilio Voice

speech-to-textAssemblyAI Universal-2

llmGPT-4o

text-to-speechAzure Neural TTS

System prompt

No prompt published.

Config

config.json

{
  "voice_id": "oliver",
  "barge_in": true,
  "tools": [
    {
      "name": "search_web",
      "description": "Search the web for current information using Tavily API",
      "type": "function"
    }
  ],
  "encoding": "G.711 mu-law",
  "sample_rate": 8000,
  "audio_format": "audio/pcmu"
}

Tools

search_webSearch the web for current information using Tavily API

Voice AI recipes, picks, and analysis.

Get the useful new templates plus the occasional teardown of what’s working in production voice AI.