In this 2016 State of Conversion Optimization Report, we gave a 48 question survey to 722 people who work in the optimization space.
Of course, a lot of what we learned was expected. For instance, many optimizers have little to no budget (sadly).
But we also learned some surprising things, like how many companies are still operating without a structured process, and how little experience many optimizers have.
Without further ado, here are our findings from the 2016 State of Conversion Optimization Report.
What Does an Optimizer Look Like? (Demographics)
Here are some demographics from our survey, just to give you perspective on some of the insights we gained.
58% work in-house, meaning they work on their own employer’s site. 39% work for an agency or do freelancing.
In addition, most of those who work in-house optimize for eCommerce sites (33.9% of total respondents). In-house optimizers at SaaS companies only clocked in at 13.8% of our respondents.
The average salary of conversion optimizers was $71,340. [Tweet it!]
Those in the US had the highest average salary ($87,926). The following four countries had the most respondents:
There was also a difference in salary based on company size. The average salary of optimizers in companies with less than 500 employees was $69,469/year, while those in larger companies (500+) make an average of $78,120/year.
It’s Still a Very Young Industry
When you meet a stranger in a bar or coffee shop and start talking about what you do, how many people actually know what “conversion optimization” is?
It’s a young industry, and there are still a lot of misconceptions around it. Still, it’s growing steadily…
While it’s exciting being a part of a nascent industry, there are some problems that arise from that as well. Notably:
- Lack of optimization knowledge (and don’t know where to learn)
- Lack of experience
Lack of CRO Knowledge
Where do you learn about CRO? Many courses are incomplete or outdated. Also, you need to know a lot of things really well to be good at optimization:
- Qualitative Research
- Technical Skills
- Heuristic Frameworks
- User Experience
- And more
Of course, you can have a team with specialists for each role, but if you’ve got one person owning the process, they need to know a little bit about each of these (at least enough to QA others’ work).
But still, it’s tough to find a good place to really learn analytics, not to mention all the other things. So where do people go? Mainly, blogs.
We’re happy to note that CXL in particular came up quite often.
Lack of Conversion Optimization Experience
In a young industry, it’s expected that not many people have a lot of experience. But according to our survey, 20% of optimizers have been working in the industry for less than one year. 50% have been working in optimization for less than 3 years. [Tweet it!]
Some of these people may have been working in a fundamental role of CRO previously (UX or analytics), but few have been working specifically in CRO for very long.
What Do You Call an Optimizer?
When we have casual conversations about the conversion optimization space (while A/B testing adult beverages of course), it’s hard for us to come up with a close estimate as to the size of the industry. Why? People go by different job titles. Here are some titles that our respondents go by:
- Conversion Optimizer
- Conversion Specialist/Consultant/Strategist
- CRO Specialist
- Director of Optimization
- Director of Marketing
- eCommerce Manager
- Digital Marketing Analyst
- Growth Hacker / Head of Growth
- Marketing Manager
- Online Marketing Specialist
- Optimization Specialist
- UX Analyst
- Product Manager
- Web Analyst
And there are so many more. See, even if one person ‘owns’ optimization at their company, they still might operate under a different title than you’re used to. And some, say a Director of Marketing, will own optimization efforts, but will also be tasked with other acquisition, retention, etc tasks.
Optimizers go by many names, but they’re all focused on data-driven growth.
Many Companies Still Don’t Have a Structured Optimization Process
Another testament to the youth of our industry: many teams are still very unstructured. In our survey, 26% of small companies (less than 500 employees) and 20% of large companies (more than 500) said they don’t have a structured process at all.
We also found that a large amount of respondents rarely meet with others on their optimization team to discussion CRO. In fact, 26% said they meet “only when necessary.” [Tweet it!]
Though, at the other end of that spectrum, 19% meet daily and 32% meet weekly. Regular meetings provide structure and lend credence to the organization taking optimization seriously. As Morgan Brown said at CXL Live, “how would you feel if finance met only when needed?”
Another thing we found is that only 29% of people said that there’s a single dedicated person who does optimization. 30% more said there’s a team in charge of optimization, but 41% of respondents had no one in particular that was accountable for optimization efforts.
A large part of our respondents (53%) said that there’s no documented budget for CRO in their companies either. [Tweet it!]
A majority of our respondents run less than 5 tests a month, many of them (43%) only running 1-2 a month. Only a few respondents said they were running 21+ tests a month.
Tracking Organizational Efficiency
How are people tracking their own efforts? If you can’t measure it, you can’t manage it, the saying goes. As data-driven as we are with decisions regarding elements on our sites, sometimes that level of empiricism doesn’t make it to the macro-organizational-level.
For instance, only 48% of respondents said they’re tracking lift per successful experiment, and only 37% said they track their percentage of winning tests.
A bit more rigor in that area could do wonders for tracking the effectiveness of a testing program over time.
In good news though, people are communicating results with their teams. Even if most aren’t meeting regularly, 79% of respondents said they share CRO results across their team (though a surprising number of teams don’t have standardized stopping rules for tests):
“What to Test” Still an Issue
While a substantial portion of our respondents stated they used data, user testing, or other conversion research methods to uncover testing opportunities, an astonishing amount still look to blog posts for “conversion optimization tactics” for their inspiration.
75% of respondents also said they rely on blog posts to increase their conversion optimization know-how. While that’s flattering if they’re reading CXL’s blog, there’s a lot of bad content out there designed simply to get shares or rank higher on Google. There’s definitely no shortage of these types of posts…
That’s what Peep meant when he said CRO is becoming SEO-ified – and Google results are filled with blogs not written by professional optimizers, but rather bloggers repeating the same ‘best practices’.
While I believe you can learn a ton from data-rich, well-thought-out blog posts, you have to be careful. Think about who’s writing the post, what their agenda is, and how much experience they have optimizing websites.
Hope For the Future of Optimization
Things are looking hopeful for the future, in two ways:
- Budget allocation
First, budget allocation. 55.5% of respondents say they’ll be increasing the budget this year. Similarly, 68.5% of people will place a higher priority on conversion optimization in 2016 [Tweet it!]
There was also a difference in companies that have a structured process and those that don’t.
Companies who follow a conversion optimization process are increasing their conversion optimization budgets 3% more than companies who don’t follow a conversion optimization process.
Follow a process. You get better results (and more budget from the boss).
On the education front (pitch time), we have CXL Institute. We’re taking original research and combining it with academic insights, laser-focused mini-courses, and office hours with professional optimizers. Also, we’ll have a forum for optimizers to ask, answer, and discuss CRO things.
Conversion optimization is still a young industry, but it is steadily growing and maturing.
One huge opportunity area is building a structured approach into your optimization team. This means an approach to research and testing, as well as documentation, communication, budget allocation, and assigning someone to be accountable for your testing program within your organization.
Full survey results available here: