THE BUSINESS CRITICAL IMPACT OF EXPERIMENTATION
Introduction
Measuring the true influence of your marketing initiatives on business growth has always been
a tricky undertaking, especially in today’s multi-touch, hyper-competitive, lightning-paced digital
marketplace. The practice of experimentation has helped companies to test, iterate, and ultimately
double-down on the tactics that are most impactful. eTail, the global e-commerce event series,
partnered with Optimizely, the world’s leading experimentation platform in Q1 2017 to survey 136
leading retail executives representing a broad range of company sizes and industries to explore
these concepts more deeply.
The survey revealed some ground-breaking insight around how retailers are resourcing
their experimentation program, allocating their testing budgets, how experimentation results
are improving their businesses, and the barriers they face in implementing a purposeful
testing strategy.
Retailers with low experimentation maturity tend to experience lower sales than their
counterparts who have built a culture of testing and experimentation. As you read the report
you see a clear link between investment in testing and revenue generation. However, budget
is still currently the greatest barrier to implementing a purposeful testing/experimentation
strategy, which is reliant on having to right evidence to achieve stakeholder buy-in.
+
+
3
THE BUSINESS CRITICAL IMPACT OF EXPERIMENTATION
Key Findings
Experimentation plays a major role in revenue growth within organizations of all sizes and
stages of maturity. There’s no such thing as outgrowing the need to test. A strong experimentation
program will continue to produce results within both growing retailers and their more
mature counterparts.
Continuous optimization is what experimentation is all about, and that practice of fine-tuning
pays off in real dollars. Half of respondents saw greater than 5% commerce growth that they
attribute to testing year-over-year. Only one in five respondents saw less than 1% growth. 64%
of respondents are also allocating testing-related head count to Marketing.
Early adopters are seeing major dividends from their testing program. Currently, a leading 6% of
respondents attribute over 20% of their commerce growth to their experimentation programs.
Within a leading group of digital retailers, key business stakeholders and their teams recognize a
link between experimentation and the creation of actionable insights that can lead to increased
revenue. Out of respondents who are growing their testing investments in 2017, 36% are growing
their testing budgets by over 20% year-over-year. On the other hand, when it comes to the barriers
that are holding the majority of respondents back from implementing winning tests, budget
was the most commonly cited issue, indicating that those who have taken a lead in investing
in experimentation are reaping the rewards as early adopters, while their peers are held back
from their full potential.
+
+
Early adopters
are seeing major
dividends from their
testing program.
Currently, a leading
6% of respondents
attribute over 20%
of their commerce
growth to their
experimentation
programs.
4
Please complete the form to gain access to this content