Concepts
Path to production
A checklist for taking an agent from first test to live traffic with confidence.
Build
- Write the prompt against real calls you want to handle. List the top ten reasons customers contact you and make sure the prompt covers each.
- Attach a knowledge base for facts that change (prices, policies, hours) instead of hard-coding them in the prompt.
- Turn on only the tools the agent needs. Every tool is one more thing the model can call at the wrong time.
Test
- 1
Talk to it
Use the browser test call and the website preview. Try to break it: interrupt, mumble, change your mind, ask off-topic questions.
- 2
Run quality checks
Create test cases in Evals and quality for the conversations that matter most, and rerun them after every prompt change.
- 3
Test tools for real
Use Test tool in the builder with real sample arguments. Check your endpoint answers in under 800 ms.
- 4
Check the money
Make a 30-second test call, then confirm it appears in Calls and the expected credits were charged.
Launch
- Assign the production number and set business hours behavior in the prompt.
- Set a monthly spend cap and, if you want, auto top-up. See Auto top-up and suspension.
- Turn on recording only with a consent message where the law requires it. See Recording and compliance.
Monitor
- Review Calls daily for the first two weeks: read transcripts, not just summaries.
- Watch end reasons. A rise in
silence-timed-outor customer hang-ups usually means a prompt or latency problem. - Track tool failures in Traces. A tool that times out often is a tool that needs to become asynchronous.
Tip
Change one thing at a time and rerun your quality checks after each change. It is the fastest way to learn what actually improves calls.
Last updated November 2026 · Found a problem? Email support@katexs.com
