We ran a 3-month experiment. The results surprised even us. Spoiler: it's not man vs machine — it's both vs mediocrity.
We'll be honest with you. When we started this experiment, half our team was convinced AI would replace copywriters within the year. The other half was equally convinced it was glorified autocomplete. Three months later, we're somewhere more nuanced — and a lot more useful — than either camp.
Here's what we actually found.
For 90 days, we ran parallel content campaigns for three client types: an e-commerce brand, a B2B SaaS company, and a local service business. Every piece of content — ads, landing pages, email sequences, social posts — was produced two ways: once by our human writers, and once by AI tools (we used a mix of Claude, ChatGPT, and Jasper).
We measured click-through rates, time on page, conversion rates, and something harder to quantify but obvious when you see it: does this actually sound like a human wrote it?
"The best-performing content from this entire experiment was neither purely AI nor purely human. It was AI-drafted, human-revised copy that took about 40% of the usual production time."
For volume content — product descriptions, FAQ pages, meta descriptions, basic social captions — AI was genuinely excellent. Not "good enough." Actually good. It maintained brand voice when prompted correctly, hit SEO targets consistently, and never got tired at 11pm before a campaign launch.
It also doesn't get writer's block. That alone is worth something.
The moment content needed real stakes, things shifted fast.
A landing page for a fintech client had identical structure in both versions. The AI copy was technically correct. The human copy mentioned a specific fear — "what happens if the market drops right before you need the money" — that came from a 20-minute conversation with the client. That version converted 31% better.
AI doesn't have conversations. It processes prompts. There's a real difference.
Humor was another one. AI copy trying to be funny usually lands like a joke someone explained before telling it. Human writers — when they're good — can read a room in a way that doesn't have a technical explanation.
We expected a clear winner. What we got instead was a clear workflow.
The clients who saw the biggest results weren't the ones who chose AI or human. They were the ones who let AI do the structural heavy lifting — keyword research, draft generation, variation testing — and brought in human writers to add the layer that tools can't: real perspective, genuine voice, and the small moments of specificity that make someone feel like content was written for them specifically.
The worst-performing content was pure AI copy with no human pass. Not because it was inaccurate. Because it was forgettable. It said the right things in the right order and left no trace.
If you're running a digital marketing strategy in 2025 and you haven't figured out how AI and human writers fit together in your workflow, you're probably spending too much on one and not getting enough from the other.
Our recommendation: stop thinking of this as a budget question (AI = cheap, humans = expensive) and start thinking of it as a talent allocation question. AI is now a capable junior team member that never sleeps. Your human writers are strategists. Act accordingly.
That means using AI to handle volume, speed, and consistency — product pages, social calendars, email sequences. And it means saving your human writers for the work that actually moves people: brand campaigns, high-value landing pages, anything where the goal is a feeling, not just a click.
The title of this piece asks who wins. After three months and a lot of data, the honest answer is: neither, on their own.
The real mediocrity in content marketing isn't AI copy or even bad human writing. It's generic. Forgettable. Safe. The combination of AI speed and human specificity is the thing that actually beats that.
Which is good news, because "both" is something most agencies can figure out. Pure AI fluency or pure creative brilliance is rarer. Knowing how to combine them? That's a workflow problem. Those are solvable.
Aloftz Marketing Agency builds AI-assisted, human-led content strategies for brands that want results — not just volume.