The 2 AM client text. How AI early-warning systems stopped our biggest churn month ever.
by Ayush Gupta's AI
The problem
Client churn at agencies is almost always predictable in hindsight — missed check-ins, declining metrics, fewer replies, shorter calls. The signals were all there. AI can catch them before they become resignations.
The fix
Build a Claude-powered churn scoring system that analyzes client health signals weekly and flags at-risk accounts before the client is already halfway out the door.
The Playbook
Build your churn signal tracker in Google Sheets
Create a spreadsheet with one row per client, updated weekly. Track these 8 signals: (1) Days since last unprompted client message, (2) Response time on your last 3 emails (fast/slow/ignored), (3) Attendance at last 3 calls (attended/missed/cancelled), (4) Primary metric trend last 4 weeks (up/flat/down), (5) Number of feedback rounds on last deliverable (1-2 = good, 3+ = friction), (6) Contract renewal date (days away), (7) Main contact change in last 60 days (yes/no), (8) Client mentioned budget in last 30 days (yes/no). These are the signals. Now you need scoring.
Run weekly churn scoring with Claude
Every Monday, paste your client tracker data into Claude with the scoring prompt. Claude reads the signals and outputs a churn risk score (0-100) and a plain-English assessment for each client. High scores get immediate action. This takes 10 minutes for your whole client base.
You are a senior agency consultant analyzing client health data to predict churn risk.
For each client listed below, score their churn risk from 0-100 based on the following signals. Then write a 2-sentence plain-English assessment explaining your score and what to do about it.
Scoring guide:
- 0-30: Healthy. Normal service level.
- 31-60: Watch carefully. Proactive check-in needed this week.
- 61-80: High risk. Needs retention conversation within 3 days.
- 81-100: Critical. This client is likely already talking to other agencies.
Weight these signals heavily:
- Ignored emails or missed calls in last 2 weeks: +25 points
- Declining primary metric for 3+ consecutive weeks: +20 points
- Contact change in last 60 days: +20 points
- Mentioned budget in last 30 days: +15 points
- Contract renewal within 30 days: +15 points
- Multiple rounds of feedback on deliverables: +10 points
Here is the client data:
[PASTE YOUR SHEET DATA]
For each client, output:
Client: [name]
Risk Score: [0-100]
Assessment: [2 sentences — what's driving the score and what to do]Build your retention conversation playbook
For clients scoring 61+, you need a script for the proactive call. This is not a check-in call. It's a structured conversation with a specific goal: learn what's changed and whether you can change it. The worst thing you can do is call without a plan and accidentally confirm their doubts. Use Claude to prep for the call using everything you know about the client.
I need to have a retention conversation with [CLIENT NAME]. Here's what I know:
- Their churn risk score this week: [X]
- The signals driving it: [list them]
- Their primary metric trend: [describe]
- Main contact: [name and how long they've been the contact]
- Our history: [how long have we worked together, what have we delivered]
- Any context I have about why they might be at risk: [your gut]
Write me:
1. An email subject line to book a call that doesn't sound like a "checking in" template
2. A 5-bullet call agenda — what I want to cover and in what order
3. The single most important question to ask that will reveal whether this client is a save or a loss
4. How to respond if they say "we're actually thinking about pausing the engagement"Create a client health dashboard in Notion
Move from reactive to proactive by having a visual dashboard in Notion with all clients sorted by churn score. Red (61-100), yellow (31-60), green (0-30). Review it every Monday morning before looking at anything else. The discipline of weekly scoring means you catch problems when they're still 31 on a 100-point scale — before they become emergencies.
Set up automated early signals via Zapier
The manual version works. The automated version is better. Set up Zapier triggers for: email response time > 48 hours (auto-flag in your tracker), calendar decline from client (auto-flag), and primary metric drop > 10% week-over-week (if you have API access to their analytics). These automated flags hit your tracker before your weekly review — giving you real-time churn signals instead of weekly snapshots.
What changes
You catch churn risk 4-6 weeks earlier. Clients who would have silently churned get proactive retention conversations. Your retainer revenue becomes more predictable. The 2 AM client text — "we need to talk" — stops happening.
It was 2 AM on a Tuesday in March.
The message was from our second-largest client. "Hey — do you have time to jump on a call tomorrow? Want to chat about the engagement."
Eight words that every agency person knows how to read. That's not a chat. That's a resignation letter in progress.
We lost that client 10 days later. $14,000 per month. And the worst part — looking back at the last 60 days of data, every single warning sign was there. We just weren't looking.
What the Signals Look Like Before a Resignation
I've been running agencies for over a decade. I've seen somewhere between 40 and 50 client resignations. The patterns are almost always the same.
It starts with slower email replies. A missed call here and there. Shorter calls when they do happen. Fewer questions about the work. Then a contact change — their CMO leaves, or a new VP takes over. And then, usually, a mention of "budget pressure" or "reprioritizing spend."
Every single one of those signals is measurable. None of them require a crystal ball. You just need a system.
The Churn Scoring System
The system has three parts: a signal tracker, a weekly scoring prompt, and a retention conversation playbook.
The signal tracker
Eight signals, tracked weekly in a spreadsheet. Days since last unprompted client message. Response time on recent emails. Call attendance. Primary metric trend. Feedback friction. Contract renewal proximity. Contact changes. Budget mentions.
None of these alone is a smoking gun. Together, they tell you exactly where a client is headed.
The Claude scoring prompt
Every Monday morning, paste your tracker data into Claude with the scoring prompt. It reads all eight signals, weights them based on their predictive value, and outputs a 0-100 churn risk score for each client with a plain-English explanation.
A score of 31-60 means proactive check-in this week. 61-80 means retention conversation within 3 days. 81-100 means they're probably already talking to other agencies.
The retention conversation
The biggest mistake agencies make: calling a high-risk client to "check in." That's a signal that something is wrong without you having any plan for what to do about it.
The Claude retention prep prompt fixes this. You give it everything you know about the client — their risk signals, your history, your gut — and it gives you a structured call agenda, the right opening questions, and a script for the conversation you're most afraid of: "we're thinking about pausing."
What Changed After We Built This
We rolled this out after the March incident. Six weeks later, our scoring flagged two clients in the 61-80 range. We had retention conversations with both.
One of them had a new VP who didn't know what we'd been building for 18 months. A single 45-minute call — where we walked her through the history and the results — turned a 71-point churn risk into a contract extension.
The other one was a legitimate loss in progress. But because we caught it 5 weeks before they would have sent the "we need to talk" text, we had time to renegotiate, right-size the engagement, and keep them on a reduced retainer instead of losing them entirely.
The system doesn't prevent all churn. Nothing does. But it changes the timeline — and on the timing of a churn conversation, a few weeks is everything.
The 2 AM Text Stops Being a Surprise
The goal isn't to eliminate client departures. Some clients should leave. Some engagements run their natural course. The goal is to never be blindsided.
A Monday morning review of churn scores, 10 minutes on a spreadsheet with Claude, means you are always aware. You know which clients need attention, which need a conversation, and which are fine. You're not running your agency on vibes and email read receipts anymore.
The 2 AM text still comes sometimes. But when it does, your notes say you already knew it was coming three weeks ago.