We Built an AI-Augmented Agency. Here's What Actually Changed.
Every agency is talking about AI. Few say what it actually changed. Here's Shift Lab's honest accounting of what shifted in our day-to-day work, what didn't, and the Humans in the Loop principle behind it.
Jeremy Jackson
Every agency is talking about AI right now. Fewer are willing to say what it actually changed in the day-to-day work. So here's our honest accounting — what shifted at Shift Lab after we built AI into how we operate, what didn't, and why we made the choices we did.
We call the operating model behind it Humans in the Loop. The name is the whole point. We didn't set out to automate our agency. We set out to remove the work no one should be doing by hand, so the people doing the work could spend more of their time on the parts that actually require a person.
Why we did this
Fourteen years of building products teaches you where time really goes. It's rarely the interesting problems. It's the renaming, the reformatting, the second pass on documentation, the hunt for the right reference, the fourth round of regression testing before a release. These tasks are necessary, but they don't need a senior engineer's judgment — they need to get done well and consistently.
That's the work we pointed AI at first. Not the craft. The connective tissue around the craft.
What actually changed
Across our projects, the change shows up in five places.
Discovery moves faster
Early-stage research — competitive landscapes, technical option analysis, summarizing a client's existing codebase or content model — used to eat days. We now get to a defensible first draft in hours, then spend our time pressure-testing it instead of assembling it. The thinking is still ours. The legwork is faster.
Design systems maintain themselves more
Keeping a component library consistent — naming, token alignment, documentation — is exactly the kind of tedious, high-discipline work that quietly degrades over a long engagement. AI handles the housekeeping so our designers stay focused on the parts of a system that need taste and intent.
Code review gets a second set of eyes
Every pull request now gets an automated first pass against the project's own spec and acceptance criteria before a human reviewer looks at it. It catches the obvious things — missed cases, scope drift, gaps against the ticket — so our engineers review for architecture and judgment rather than typos. Nothing merges on the machine's say-so. A person still owns every approval.
QA covers more ground
Automated checks run earlier and more often across our projects: performance, accessibility, and regressions. We catch more before it reaches a client, and our QA people spend their time on the subtle, experience-level issues that automation will never feel.
Documentation keeps pace with the build
Technical summaries, architecture briefs, and stakeholder-ready specs are the writing that always slips when a team is heads-down shipping. Now it keeps pace with the build instead of trailing it by weeks.
Add these up and the change isn't that we do the same work faster. It's that the balance of where our people spend their hours shifted toward the work that's worth their attention.
What didn't change
This is the part we're most deliberate about.
Judgment didn't change. The decision about whether a technical approach is right for a client, whether a design solves the actual problem, whether something is ready to ship: that still belongs to a person, and it always will.
Design intent didn't change. We've spent fourteen years learning how to execute on a creative vision without flattening it. No tool gets a vote on that.
Client relationships didn't change. Our clients stay with us for seven, ten years because they trust the people, not the pipeline. Accountability for the work sits with named humans on our team. That's non-negotiable, and our partners know it.
The principle underneath it
Humans in the Loop isn't a feature we bolted on. It's a rule we hold ourselves to: AI does the work that benefits from speed and consistency, and a person owns every decision that benefits from judgment. The machine drafts; the human decides. The machine flags; the human approves. Done still means a person signed off, not that a process ran to completion.
We're wary of the version of the "AI agency" that quietly moves the human out of the loop and hopes the client doesn't notice. That's not a faster agency. It's a less accountable one. We went the other direction on purpose.
What this means if you partner with us
Most of our work runs through other agencies. We're the technical partner behind creative shops that need to deliver complex builds without standing up their own engineering team. For those partners, the practical effect is simple: you get more of our senior people's attention on your project, faster turnarounds on the connective work, and the same human accountability you've always had. The intent you hand us still comes back the way you meant it.
AI didn't change what we are. We're still a tech-first agency that speaks design and stays with clients for the long haul. It changed how much of our time we get to spend being exactly that.
If you're an agency owner thinking through where AI actually fits in your own shop, the honest answer is simple: start with the work no one should be doing by hand, keep a person on every real decision, and be suspicious of anything that asks you to remove the human to get the speed. That's the approach that's held up for us.
Expertise + thinking
Contact us
Need a tech partner who speaks design?
Shift Lab is purpose-built to work well with design teams, solving complex business problems while creating long-term, lasting relationships.