SpeechStack
Submit a template
← All templatestemplates / phone-based-voice-agent-with-web-search
Customupdated May 22, 2025 · other · support

Phone Based Voice Agent with Web Search

A production-ready voice agent that answers phone calls through Twilio, engages in natural interruptible conversations, and performs real-time web searches using tool calling. The agent bridges Twilio Media Streams to a voice AI backend using G.711 mu-law audio passthrough without transcoding.

No demo yetView sourceFork template
The numbers
latency
cost / min
frameworkCustom
The stack
telephonyTwilio Voice
speech-to-textAssemblyAI Universal-2
llmGPT-4o
text-to-speechAzure Neural TTS
System prompt
No prompt published.
Config
config.json
{
  "voice_id": "oliver",
  "barge_in": true,
  "tools": [
    {
      "name": "search_web",
      "description": "Search the web for current information using Tavily API",
      "type": "function"
    }
  ],
  "encoding": "G.711 mu-law",
  "sample_rate": 8000,
  "audio_format": "audio/pcmu"
}
Tools
  • search_webSearch the web for current information using Tavily API
Tags
twiliotelephonytool-callingweb-searchfastapiwebsocketrailwaytavilybarge-ing711
Voice Notes

Voice AI recipes, picks, and analysis.

Get the useful new templates plus the occasional teardown of what’s working in production voice AI.

contributed by @dlange-aai · MIT · source: github discoverylanguages: en-US