SpeechStack
Submit a template
← All templatestemplates / multi-agent-in-app-voice-assistant-with-web-search-knowledge-base-and-account-ac
Customupdated May 27, 2025 · ecommerce · triage

Multi-Agent In-App Voice Assistant with Web Search, Knowledge Base, and Account Actions

A modular voice assistant built with OpenAI Agents SDK that routes user queries to specialized agents for web search, product knowledge retrieval, or account management. Demonstrates orchestrating multiple agents with the Responses API, FileSearchTool, WebSearchTool, and custom function calling, plus voice optimization with TTS model instructions.

No demo yetView sourceFork template
The numbers
latency
cost / min
frameworkCustom
The stack
telephonyWeb Only
speech-to-textOpenAI Whisper
llmGPT-4o
text-to-speechOpenAI gpt-4o-mini-tts
System prompt
raw_prompt
You are the virtual assistant for Acme Shop. Welcome the user and ask how you can help. Based on the user's intent, route to: AccountAgent for account-related queries, KnowledgeAgent for product FAQs, SearchAgent for anything requiring real-time web search.
Config
config.json
{
  "search_agent": {
    "tools": [
      "WebSearchTool"
    ]
  },
  "triage_agent": {
    "handoffs": [
      "AccountAgent",
      "KnowledgeAgent",
      "SearchAgent"
    ]
  },
  "account_agent": {
    "tools": [
      "get_account_info"
    ]
  },
  "voice_pipeline": {
    "tts_instructions": "Personality: upbeat, friendly, persuasive guide. Tone: Friendly, clear, and reassuring. Pronunciation: Clear, articulate, and steady. Tempo: Speak relatively fast, include brief pauses before questions. Emotion: Warm and supportive."
  },
  "knowledge_agent": {
    "tools": [
      "FileSearchTool"
    ],
    "max_num_results": 3
  }
}
Tags
multi-agentorchestrationweb-searchfile-searchfunction-callingtriageroutingragvector-store
Voice Notes

Voice AI recipes, picks, and analysis.

Get the useful new templates plus the occasional teardown of what’s working in production voice AI.

contributed by @rupert-openai · MIT · source: github discoverylanguages: en-US