AI resolution rate: how to measure it without fooling yourself
AI resolution rate is the share of answered tickets the AI solved without your team replying, and that stayed solved. Many dashboards count something looser.
By Andreas Du Rietz, founder of Replyful ·
The formula
AI resolution rate = tickets the AI resolved on its own ÷ resolved tickets that got a reply
- "Stayed solved" needs a window, such as 72 hours.
- Leave spam and unanswered tickets out of the bottom half.
- Count tickets, not chats or messages.
A worked example
- All tickets1,000
- Got a replyDivide by this960
- The AI repliedNot this700
- No one on your team replied440
- Still resolved 72 hours laterAI resolved400
Four mistakes that inflate it
- Counting tickets a person finished. Some tools still count it when a teammate takes over after the AI answered. That's a handover.
- Calling it resolved when the chat ends. Customers close the tab, then email you the next morning.
- Treating silence as success. A customer who stops answering may have given up. Count silence only if they don't come back within your window.
- Shrinking the bottom half. Divide by the 700 tickets the AI took part in and the same month reads 57%. Dividing by chat only does the same.
Track the handovers too
One rate hides where the AI helps. Split answered tickets four ways: AI only, AI then a person, a person sending an AI draft, and a person alone. A team moving from "person alone" to "AI draft" is getting faster even if the headline rate stays put.
Put customer satisfaction next to it. A higher rate bought with angrier customers is a loss.
How Replyful counts it
Replyful records who wrote every message, so it shows this split without anyone tagging tickets. Any reply from your team, in any channel, makes the ticket a handover. We only charge for AI resolutions that meet the definition above.