Observability

Monitoring

Dashboards for the numbers that predict a bad customer experience โ€” answer rate, response latency, error rate, and tool health โ€” plus alerts so you hear about problems before your customers do.


The four signals

โšก

Latency

End of caller speech to first agent audio, p50 and p95, broken down by pipeline stage.

๐Ÿ“ž

Availability

Answer rate for inbound and connect rate for outbound, per number and per agent.

โš ๏ธ

Error rate

Share of calls ending in a pipeline, tool, or carrier error.

๐Ÿ› 

Tool health

Success rate and p95 duration for every configured tool.

Healthy baselines

MetricHealthyInvestigateIncident
Response latency p95< 1.0s1.0โ€“1.8s> 1.8s
Inbound answer rate> 99%97โ€“99%< 97%
Pipeline error rate< 0.5%0.5โ€“2%> 2%
Tool success rate> 98%95โ€“98%< 95%
Webhook delivery rate> 99.5%98โ€“99.5%< 98%

Latency breakdown

The latency panel splits each turn into transcriber endpointing, model first token, tool wait, and TTS first byte. Optimize the largest bar โ€” teams routinely rewrite prompts when the real cost is a 900ms CRM lookup.

Alerts

  1. 1

    Open Data โ†’ Monitoring โ†’ Alerts

    Alerts are workspace-scoped and can be filtered to a single agent or number.

  2. 2

    Pick a metric and threshold

    Choose a window long enough to avoid noise โ€” five minutes is a good default.

  3. 3

    Choose channels

    Email, in-app notification, Slack, or a webhook to your on-call system.

  4. 4

    Set severity

    Warning routes to notifications; critical pages your on-call channel.

json
{
  "alert": {
    "name": "Agent latency degraded",
    "metric": "response_latency_p95",
    "condition": "> 1800",
    "window_minutes": 5,
    "scope": { "agent_id": "agt_123" },
    "severity": "critical",
    "channels": ["slack:#oncall", "webhook:pagerduty"]
  }
}
  • Error rate > 2% for 5 minutes โ€” Catches model and carrier outages before they cost you a morning of calls.
  • Answer rate < 97% for 10 minutes โ€” Usually a number or trunk problem, not an agent problem.
  • Any tool below 95% success โ€” Your calendar or CRM is failing and the agent is improvising.
  • Webhook delivery failures โ€” Your own endpoint is down and downstream systems are silently missing data.
  • Credit balance below one day of usage โ€” Prevents insufficient-credit endings mid-campaign.

Status and uptime

Platform-wide incidents are published on the Katexs status page, linked from the docs header. Workspace-level dashboards show your own uptime separately, so you can tell a platform incident from a misconfiguration on your side.

Alerts fire on your data, not ours. If your workspace is quiet overnight, use rate-based conditions with a minimum call volume so a single failed call at 3am does not page anyone.