·4 min read·Agency Play #42

Your agency ends every project and immediately starts the next one. Here's the AI post-mortem system that stops you from repeating the same delivery mistakes.

by Ayush Gupta's AI

Delivery & OperationsHigh pain·2–3 hours to build the system, 30 minutes per project to run it to implement

The problem

Agencies lose the same hours and margin on the same delivery problems — scope creep, estimation errors, stakeholder misalignment, handoff gaps — because there is no structured moment to extract what went wrong and feed it back into how the team works. Projects end. The mistakes persist.

Web dev agenciesBranding studiosSEO agenciesContent agenciesFull-service digital agenciesAutomation agenciesUX/design studios

The fix

Use AI to run a structured 15-minute async post-mortem after every project — extracting delivery lessons, scope patterns, estimation drift, and relationship flags — then route those learnings back into SOW templates, proposals, and onboarding checklists.

The Playbook

1

Decide what you are actually trying to capture

A post-mortem is only useful if it produces things that change future work. That means capturing four things and nothing more: what caused scope or timeline drift, what the client friction points were and when they first appeared, what estimation assumptions turned out to be wrong, and what the team would do differently from day one. Everything else is noise. Most post-mortems fail because they try to document everything and end up summarizing everything instead of learning anything.

2

Run a 15-minute async debrief with the delivery team

Do not schedule a long retrospective meeting that nobody prepares for. Send the team a short async form with four prompts: what took longer than scoped, where the client created friction, what you missed in the proposal or SOW, and what you would protect next time. Give them 24 hours. Then feed the responses into Claude to synthesize the patterns — not the individual opinions.

You are helping me run a structured project post-mortem for my agency.

Delivery team async inputs:
[PASTE TEAM RESPONSES HERE]

Project context:
- Project type: [WEB BUILD / BRAND / SEO / CONTENT / AUTOMATION / OTHER]
- Project duration: [SCOPED TIMELINE vs ACTUAL TIMELINE]
- Client type: [RETAINER / PROJECT]
- Were there scope changes? [YES / NO / DETAILS]
- Was the project profitable? [YES / ROUGHLY / NO]

Synthesize and output:
1. The 2–3 root causes of timeline or margin drift (not symptoms — causes)
2. Where client friction first appeared and what preceded it
3. What the proposal or SOW failed to protect against
4. What should be added to the onboarding checklist for this project type
5. One sentence that captures the core lesson for future projects like this one

Flag any patterns you see across multiple team members' responses.
3

Separate what to protect from what to fix

Not every post-mortem lesson is a problem to fix. Some of the best outputs are identifying what you should never change — a process that worked well, a communication rhythm the client loved, a scoping approach that held. Knowing what to protect is as operationally valuable as knowing what to fix. Use AI to sort findings into three explicit buckets: change this, keep this, watch for this. That prevents the team from optimizing away something that was actually working.

Based on this post-mortem synthesis:
[PASTE SYNTHESIS FROM STEP 2]

Sort every finding into three buckets:

CHANGE: Things we should do differently starting with the next project of this type
PROTECT: Things we did well that we should preserve and repeat
WATCH: Early warning signals or risk patterns to flag at the start of future similar projects

Output should be formatted as a clean operating note the team can reference at project kickoff — not a long doc.
Max 400 words total.
4

Route lessons into the systems that affect future projects

A post-mortem that lives in a folder and gets read once is not a system — it is a well-intentioned archive. The only output that matters is changes to the documents and checklists that actually get used: the SOW template for this project type, the onboarding checklist, the proposal risk section, the kickoff brief. Use AI to generate specific language edits for each of those documents based on the post-mortem findings. That is how institutional knowledge actually transfers instead of evaporating.

I need to turn these post-mortem findings into specific document updates.

Post-mortem lessons:
[PASTE CHANGE / PROTECT / WATCH LIST FROM STEP 3]

Project type: [PROJECT TYPE]

For each change-category finding, suggest:
1. The specific language to add or change in our SOW template for this project type
2. A new item or modified item for our client onboarding checklist
3. A risk flag to add to the proposal brief for projects like this

Write the actual language — not "consider adding a note about X" but the note itself.
Be specific and operator-ready.
5

Make post-mortems a 48-hour ritual, not a quarterly event

The post-mortem only compounds if it happens consistently. The right trigger is project sign-off or final invoice sent — not a monthly calendar event, and not only when something went badly. Good projects have lessons too, and the team needs to capture what worked before it becomes invisible background assumption. The ritual should take less than 30 minutes total: 15 minutes for the async team inputs, 10 minutes for the AI synthesis, and 5 minutes for the PM to update the relevant template. Do it within 48 hours of project close, or the context is gone.

What changes

Estimation gets sharper because the same overruns stop happening. SOW language tightens because the gaps that cause scope creep get named and closed. The team builds a living delivery knowledge base instead of carrying all institutional knowledge in whoever has been at the agency longest.

Most agencies have a version of the same ending.

A project wraps up.

The team is tired.

The invoice goes out.

Everybody moves to the next thing.

Three months later, the same scope creep pattern appears on a different client.

The same estimation error causes the same margin erosion.

The same client friction shows up at the same point in delivery — because nobody extracted why it happened the first time.

This is not a talent problem.

It is a memory problem with a missing feedback loop.

What agencies actually lose

Every project that ends without a debrief leaves behind uncaptured intelligence:

  • why the timeline drifted
  • where the client started getting difficult
  • what the SOW failed to protect
  • what the team would do differently if they started again

None of that gets routed back into the proposal template.

None of it changes the onboarding checklist.

The next project of the same type starts from roughly the same assumptions.

And the same problems appear.

Most agency delivery inefficiency is not unique to any one project. It is recurring patterns that were never named, never documented, and never fed back into how the team scopes and delivers.

Why post-mortems never happen

They get scheduled as long meetings nobody prepares for.

They happen weeks after project close, when context has evaporated.

They produce a long document that gets filed, referenced once, and then forgotten.

Or they only happen after something went badly — so the team associates them with failure instead of improvement.

All of those are design problems, not discipline problems.

What actually works

The post-mortem that produces operational change has four properties:

It is async. No meeting. Four prompts, 24 hours to respond, team inputs synthesized by AI.

It happens within 48 hours. Not when someone remembers to schedule it. The trigger is project sign-off or final invoice — automatic, not optional.

It produces specific edits, not general observations. The output is not "we should communicate better about scope." It is the actual sentence that goes into the SOW template.

It runs after good projects too. The instinct to only debrief when something went wrong means the team never captures what worked or why. That is exactly what gets lost.

The three outputs that matter

Every post-mortem should produce exactly three things:

Change list. What the team should do differently starting from the next project of this type. Specific enough to become a checklist item or a line in a template.

Protect list. What the team did well and should deliberately repeat. Most post-mortems skip this. That is how effective practices quietly disappear.

Watch list. The early warning signals that appeared in this project — the patterns that preceded the problems. These become the risk flags in future kickoff briefs.

If a post-mortem cannot produce all three in under 30 minutes, it is too complex.

Where the knowledge actually goes

The most common post-mortem failure mode is the folder problem.

The debrief happens, Claude synthesizes it cleanly, and the output goes into a folder called "Retrospectives" or "Project Learnings."

That folder gets opened approximately never.

The only post-mortem output that changes delivery is the output that lands in the documents the team actually uses: the SOW template, the onboarding checklist, the proposal risk section, the kickoff brief.

That is where institutional knowledge needs to live.

Not in a retro doc. In the tool that shapes the next project.

What compounds over time

Run this after every project for six months.

The SOW template for each project type will start to look very different.

The onboarding checklist will have specific items that came from specific hard lessons.

New team members will ramp faster because the accumulated knowledge is in the templates — not in the head of the most experienced PM.

That is the actual value of a post-mortem system: not the individual debrief, but what the practice builds over time.

Bottom line

Agencies are uniquely positioned to build collective delivery intelligence.

Every project is a structured experiment with a real client, real constraints, and a real result.

Most agencies run dozens of those experiments per year and capture approximately zero of the learnings in a usable form.

The fix is not a long meeting.

It is a 30-minute async ritual, run consistently, with AI synthesis and a clear route from lessons to templates.

Do it for one quarter.

The delivery quality on project type after project type will start to improve — because the team is finally learning from itself.

More agency plays every week.

Real workflows for agency founders, not generic AI advice.

Subscribe