Dick Sterry
Oct 17, 2016
(5 votes)

A/B Testing Feature Beta

The Episerver A/B testing feature is now officially in beta and is available on the Episerver NuGet feed. Current support is for the CMS and a single KPI (page or block winner). Commerce support and more KPI's are in development and will be available in beta soon. The new User Guide which includes a section on A/B testing will be available shortly as well - In the mean time you can access the beta doc here: A/B Testing Beta Doc Give it a try and let us know what you think.

Oct 17, 2016


valdis Oct 17, 2016 09:40 PM

This is nice! btw, typo: first sentence -"om".

K Khan
K Khan Oct 18, 2016 09:37 AM

ommm :) glad to hear!

Oct 18, 2016 10:22 AM


K Khan
K Khan Oct 18, 2016 01:03 PM

Will Conversion goal be extendable in future release (expanding the scope to commerce, where conversion goal can be product added into cart)?
Will A/B testing be available at IContent level (expanding the scope to commerce/blocks)?
Will we be able to specify visitor percentage for A or B?

Aria Zanganeh
Aria Zanganeh Oct 18, 2016 01:25 PM

Wow .. this is cool .. is that possible to define custom  target .. for exmple clicking on each item in menu is  our target!? So find which version of menu is attract more people to click!?

Oct 18, 2016 06:41 PM


It already supports blocks, I believe commerce products is next. Not sure about the rest! 


I believe this is in the roadmap.

There will be technical session in Ascend Europe and Ascend Nordics about this. So register if you haven't already and you can ask more questions there :)! 

Oct 18, 2016 11:30 PM

A question: How much would the A/B testing be dependant on having Session activated? If so, is it possible to change where the information should be stored (such as cookies?)

Thomas Schmidt
Thomas Schmidt Oct 19, 2016 08:20 AM

This looks good, a few questions and comments from me also:

Will this deprecate the self optimizing block for instance or do you still see a future for this?

I am guessing that CMO will finally be killed of right?

I wold also prefer that you do not rely on any session storage as that kills this functionality in load balanced environments(friends do not let friends use sticky load balancing) not to mention kills performance in general because of locks.

Also, could all the internal EPiServer solution architects please align on what data access strategy to use, some EPiServer addons use DDS while others use Entity Framework, it really is a mess. Decide on one and go with that. DDS is easy to use but has serious performance issues when you need to save/retrieve even simple object graphs and EntityFramework has its own issues but works for better in for example Azure because of the retrying capabilities.

Oct 19, 2016 03:30 PM

@Alf, we are using cookies to do storage so LB scenario shouldnt matter. 

@Thomas, we use DDS for simple storage and configurations but we are using other forms of storage for other things. We often look at aligning our future technology choices and appreciate your feedback. As you are stating there are advantages to either method and for AB testing we are currently using this architecture. 

Vincent Nov 23, 2016 12:59 AM

Hi Sterry

Is it possible to link two separate AB Page Testing together? 



Dick Sterry
Dick Sterry Nov 23, 2016 03:05 PM

The current implementation is for a single A - B test. We may extend to do multi-variant in the future but it's not part of the product now.

Daniel Sandberg
Daniel Sandberg Aug 14, 2018 10:51 AM

A nice read, unfortunatly the link to the PDF document is broken.

Asa Sundin
Asa Sundin Aug 14, 2018 11:12 AM

@Daniel Sandberg, A/B testing is no longer in Beta and the official documentation can be found here: http://webhelp.episerver.com/latest/cms-edit/ab-testing.htm.

Please login to comment.
Latest blogs
Optimizely Web Experimentation Metrics

Within the domain of Optimizely Web Experimentation Metrics, the emphasis is on objective key performance indicators (KPIs) selected to assess an...

Matthew Dunn | Sep 23, 2023 | Syndicated blog

Optimizely For you Intranet

Having been at Optimizely and in the CMS industry for nearly 16 years I have seen clients’ intranet requirements go from a simple site just to hous...

Robert Folan | Sep 22, 2023

Vulnerability in EPiServer.GoogleAnalytics v3 and v4

Introduction A potential security vulnerability was detected for Optimizely Google Analytics addon (including EPiServer.GoogleAnalytics and...

Bien Nguyen | Sep 20, 2023

Overriding Optimizely’s Content Recommendations Block to Implement Custom Recommendations

Introduction The Content Recommendations add-on for Optimizely CMS dynamically recommends content from your site tailored to the interests of each...

abritt | Sep 13, 2023 | Syndicated blog

Developer contest! Install the AI Assistant and Win Bose QC45 Headphones!

We are thrilled to announce a developer contest where you have the chance to win a pair of Bose Headphones. The goal is to be the first developer t...

Luc Gosso (MVP) | Sep 7, 2023 | Syndicated blog

Send Optimizely notifications with SendGrid API, not SMTP

If your Optimizely site already sends transaction emails through an email platform API, why not do the same with Optimizely notification emails?

Stefan Holm Olsen | Sep 6, 2023 | Syndicated blog