Inside a 3× Velocity Turnaround
A deep dive into our methodology with one of our clients (under NDA): from audit to deployment, and the real productivity numbers.
Every case study suffers from the same problem: the company that succeeded looks, in hindsight, like it was always going to. To push back against that, here's a real engagement we ran in late 2025 — names withheld under NDA, but the numbers are exactly as we recorded them.
The starting point
Our client was a Series B SaaS with 30 engineers split across three product squads. Eighteen months earlier, they were shipping fast. By the time they reached out, PR cycle time had drifted from 1.6 days to 4.2, the on-call rotation was visibly burning people out, and two senior engineers had given notice in the previous quarter. Leadership knew something was wrong. They couldn't agree on what.
The audit (week 1)
We spent a week shadowing standups, reading the last hundred PRs, and interviewing every engineer for forty-five minutes. Three patterns emerged.
- Code review was the bottleneck. Reviewers were senior, overloaded, and slow. A typical PR sat 36 hours waiting for first review.
- Onboarding was tribal. New hires took 7 weeks to ship their first non-trivial feature, mostly because nothing was documented.
- Tests were a graveyard. The suite was 9 minutes long, flaky, and quietly skipped half of the critical paths.
The plan (week 2)
We chose three interventions, sequenced for compounding effect:
- Roll out an AI-assisted code review layer that pre-flagged style issues, missing tests, and obvious bugs before a human reviewer ever opened the PR.
- Build a small RAG system over the codebase, the runbooks, and the last two years of architecture decisions, exposed as an internal chat tool to the whole company.
- Pair every engineer with Claude Code for two weeks of structured exercises focused on test generation and refactoring.
The deploy (weeks 3 to 8)
We don't believe in flag days. The AI review layer went out behind a feature flag and ran in shadow mode for five days while we tuned the noise level. The internal RAG started as a Slack bot used by two squads, and only opened to the whole company once we'd validated retrieval quality on 200 questions. Training was scheduled in 90-minute blocks across two weeks, never blocking sprint commitments.
Three things surprised us:
- The RAG system got its biggest usage from the support team, not engineering. They started self-serving on questions that had been escalating to senior engineers for months.
- The AI review layer caught a cluster of subtle race conditions in week 4 that had been quietly causing production incidents for half a year.
- Two senior engineers who had been openly skeptical at week 1 became the loudest internal advocates by week 6, after seeing their review queue drop by half.
The numbers (week 12)
Twelve weeks after the engagement started, we measured the same metrics we'd captured in week 1.
- PR cycle time: 4.2 days → 1.3 days (−69%)
- First-review latency: 36 hours → 8 hours
- New-hire time-to-first-feature: 7 weeks → 3 weeks
- Test suite duration: 9 minutes → 4 minutes (with broader coverage)
- Production incidents: 11 / month → 4 / month
- Engineer net promoter score: 6 → 32
Pitfalls we avoided (and one we didn't)
What we avoided: replacing human review entirely. The AI layer sits before a human reviewer, never instead of one. Teams that skip the human reviewer for AI-flagged “clean” PRs lose architectural coherence within a quarter. Don't do this.
What we didn't avoid: under-investing in observability for the AI tools themselves. Six weeks in, we realized we had no telemetry on the RAG system's retrieval failures and had to retrofit it. If we ran this engagement again, instrumentation would be in week 2, not week 8.
What to take away
- Velocity gains compound fastest when you target the bottleneck, not the brightest tool.
- Adoption is a social problem. Find your skeptics-turned-advocates early.
- Measure before, during, and after. Vanity metrics will not survive the conversation with your CFO.
- AI augmentation works best when it sits next to humans, not in their place.
This engagement wasn't a moonshot. It was a sequence of small, well-instrumented decisions, repeated for twelve weeks. That's the playbook. The tools change every six months; the playbook doesn't.
Continue reading
Rebuilding your buying group's management system without a big bang
Replacing the tool that runs supplier approvals, revenue declarations and rebates is not a weekend cutover. Here is the sequencing that actually works.
Rebates and year-end bonuses: why your spreadsheets have hit their limit
The rebate spreadsheet works until the day two people are the only ones who understand it. Here are the failure modes we see, and what replaces them.