Why revenue per visitor was never a one-person job, and why that shapes the CRO agency vs in-house team decision

If your brand is doing millions of dollars a year on Shopify, you've probably had the CRO agency vs in-house team debate at least once, usually right after you've asked one ecommerce manager to "optimise the website" and realised that's not really a job for one person.

That's the real question underneath the job-title confusion: not who should own optimisation, but whether you build that capability in-house or bring it in through an agency. Get the timing wrong in either direction and it's an expensive mistake , either a bloated team you can't easily unwind, or years of underinvestment in the thing that actually determines whether your ad spend pays off.

Why revenue per visitor was never a one-person job — and why that shapes the CRO agency vs in-house team decision

If you're still relying on one ecommerce manager to "optimise the website," you're not understaffed. You're asking one person to be six different experts at once — and setting them up to fail before they've touched a single page.

That's not a hiring problem. You won't fix it by finding a better generalist, or a more senior one. It's a structural problem, and it's exactly why the choice isn't "hire one more person" — it's whether that structure lives in-house or with an agency.

Real website optimisation, the kind that moves revenue per visitor, not just the kind that makes the site "look nicer", touches at least six distinct skill sets:

• Copywriting — the words that actually move someone from browsing to buying
• Brand — how the site builds trust and perceived value
• User experience — how easily someone can find what they want and act on it
• Design — how the site looks and feels, and whether that supports the sale
• Development — building it properly on Shopify, without breaking something else
• Testing and analytics — proving whether a change actually made money, instead of guessing

Expecting one ecommerce manager to be genuinely expert across all six isn't ambitious. It's unrealistic. You can hire the best generalist on the market and they will still only be strong in one or two of these areas, because nobody is deeply expert in all six at once. That's not a knock on your ecommerce manager. It's just what the role actually requires once you're past a certain size.

The three stages of website optimisation, and where CRO agency vs in-house team decisions actually apply

Most Shopify brands go through three distinct phases, and the right structure is different at each one.

Early stage — building the site.

When you're first setting up a Shopify store, you likely bring in an agency or developer to build the initial site, then hand day-to-day changes to whoever's around. This is fine. At this stage, the stakes on any single change are low, and "good enough" website changes are a reasonable way to move fast.

Scaling stage — roughly $1M to $30–50M in annual revenue.

This is where true conversion rate optimisation (CRO) matters most, and where the maths clearly favours an agency over an in-house team. Building a genuine in-house CRO function , a strategist, a UX researcher, a data analyst, a developer, and a designer, typically runs somewhere between $450,000 and $500,000+ a year in fully loaded salaries. At this revenue stage, that's an enormous fixed cost to carry before you've proven the team can deliver a return. An agency gives you the same six skill sets, already assembled and already experienced, without the hiring risk or the ramp-up time.

Enterprise stage — beyond roughly $50M.

Once you're running high testing volume with dedicated product lines, the economics shift. The fixed cost of an in-house team gets absorbed across a much higher volume of experiments, and there's a real case for keeping that expertise permanently in-house and tightly integrated with your broader product and engineering roadmap. Most brands that get here didn't skip the earlier stage, they used an agency to build the testing culture and prove the model first, then transitioned in-house once the numbers justified it.

CRO agency vs in-house team: the real cost and risk comparison below $30–50M

Below that revenue threshold, hiring a full in-house CRO team isn't just expensive. It's a worse bet on several fronts at once.

In-house CRO team cost and risk.

You're paying $450,000+ a year in salaries for a team that may or may not perform, and if it doesn't, unwinding six hires is a genuinely painful process. A CRO agency operates on a contract. If the results aren't there, you can end the relationship on your terms, not spend months managing out a team you built.

Accountability.

An agency's fee is tied to results it's expected to deliver. That's a very different incentive structure to a salaried team, where underperformance is far harder to see, prove, and act on quickly.

Breadth of experience.

An agency working across many Shopify brands brings pattern recognition your in-house team simply can't build on your website alone. Every test run for another client is a lesson that shows up in your results too. An in-house team's learning is capped by what happens on your site, and only your site, which means it's slower to build the same depth of expertise, if it ever fully does.

What's actually at stake in a "small" website change

Here's the part that's easy to underestimate once you're doing millions of dollars a year: a change that takes ten minutes to make can cost or make you hundreds of thousands of dollars over a year, depending on whether it's the right change.

A headline swap, a button colour, a layout tweak, at $100,000 a year in revenue, these are genuinely small decisions. At $5M or $10M a year, the exact same kind of change is not small anymore. The dollar value behind every visitor is higher, so the cost of getting it wrong scales right along with your revenue.

And the uncomfortable part is you often won't know when it's gone wrong. You don't see the revenue you didn't make, you only see what came in. A change that quietly cost you conversions for six months looks, from the inside, like nothing happened at all.

This is exactly why untested, gut-feel changes are a luxury that belongs to smaller or newer businesses, not to brands doing millions a year. Constantly tweaking your site because it feels productive is a habit worth keeping for your marketing, where the cost of experimenting is lower. Your website, once it's working, deserves a different level of discipline, every change treated as the financial decision it actually is, tested before it's rolled out, not after.

So: CRO agency, in-house team, or something else?

Once you strip away the job titles, the decision usually comes down to three roles working together, and where each one should sit:

If you're a Shopify brand doing over $1M a year and your website optimisation still rests on one person's shoulders, the gap isn't your ecommerce manager. It's the structure around them.

Book a free RPV Opportunity Call — a 60-minute walkthrough where we identify 3–5 specific revenue opportunities on your store.

FAQ

CRO agency vs in-house team: which is right for my Shopify store?

It depends on revenue and testing volume. Below roughly $50M in annual revenue, a CRO agency typically delivers the same skill set — copywriting, brand, UX, design, development, and testing — at lower cost and lower risk than building a $450,000+ a year in-house team. Above that, once testing volume is high enough, an in-house team can pay for itself and keep expertise tightly integrated with your product roadmap.

How much does an in-house CRO team cost compared to an agency?

A fully staffed in-house CRO team — strategist, UX researcher, data analyst, developer, and designer — typically costs $450,000 to $500,000+ a year in salaries alone. A CRO agency delivering the same skill set generally runs a fraction of that as a monthly retainer, without the hiring and severance risk.

Should I hire an ecommerce manager or a CRO agency?

They're not interchangeable. An ecommerce manager typically handles day-to-day store operations — catalogue, content, coordinating with developers or agencies. A CRO agency brings the full team required for true conversion rate optimisation. Most $1M+ Shopify brands need both, doing different jobs.

At what revenue should I switch from a CRO agency to an in-house team?

Industry data generally puts the break-even point somewhere between $50M and $100M in annual revenue, once testing volume is high enough to justify a team costing $450,000+ a year. Below that, a CRO agency typically delivers the same skill set with lower cost and lower risk.

Can a Shopify developer do conversion rate optimisation?

A developer can build what's designed and tested, but CRO also requires copywriting, UX research, brand strategy, and statistical testing — skill sets outside typical development work. A developer is one piece of the team a real CRO process needs, not the whole team.