Dick Sterry
Oct 17, 2016
  4419
(5 votes)

A/B Testing Feature Beta

The Episerver A/B testing feature is now officially in beta and is available on the Episerver NuGet feed. Current support is for the CMS and a single KPI (page or block winner). Commerce support and more KPI's are in development and will be available in beta soon. The new User Guide which includes a section on A/B testing will be available shortly as well - In the mean time you can access the beta doc here: A/B Testing Beta Doc Give it a try and let us know what you think.

Oct 17, 2016

Comments

valdis
valdis Oct 17, 2016 09:40 PM

This is nice! btw, typo: first sentence -"om".

K Khan
K Khan Oct 18, 2016 09:37 AM

ommm :) glad to hear!

Oct 18, 2016 10:22 AM

Great!!

K Khan
K Khan Oct 18, 2016 01:03 PM

Will Conversion goal be extendable in future release (expanding the scope to commerce, where conversion goal can be product added into cart)?
Will A/B testing be available at IContent level (expanding the scope to commerce/blocks)?
Will we be able to specify visitor percentage for A or B?

Aria Zanganeh
Aria Zanganeh Oct 18, 2016 01:25 PM

Wow .. this is cool .. is that possible to define custom  target .. for exmple clicking on each item in menu is  our target!? So find which version of menu is attract more people to click!?

Oct 18, 2016 06:41 PM

@Khurram

It already supports blocks, I believe commerce products is next. Not sure about the rest! 

@Aria

I believe this is in the roadmap.

There will be technical session in Ascend Europe and Ascend Nordics about this. So register if you haven't already and you can ask more questions there :)! 

Oct 18, 2016 11:30 PM

A question: How much would the A/B testing be dependant on having Session activated? If so, is it possible to change where the information should be stored (such as cookies?)

Thomas Schmidt
Thomas Schmidt Oct 19, 2016 08:20 AM

This looks good, a few questions and comments from me also:

Will this deprecate the self optimizing block for instance or do you still see a future for this?

I am guessing that CMO will finally be killed of right?

I wold also prefer that you do not rely on any session storage as that kills this functionality in load balanced environments(friends do not let friends use sticky load balancing) not to mention kills performance in general because of locks.

Also, could all the internal EPiServer solution architects please align on what data access strategy to use, some EPiServer addons use DDS while others use Entity Framework, it really is a mess. Decide on one and go with that. DDS is easy to use but has serious performance issues when you need to save/retrieve even simple object graphs and EntityFramework has its own issues but works for better in for example Azure because of the retrying capabilities.

Oct 19, 2016 03:30 PM

@Alf, we are using cookies to do storage so LB scenario shouldnt matter. 

@Thomas, we use DDS for simple storage and configurations but we are using other forms of storage for other things. We often look at aligning our future technology choices and appreciate your feedback. As you are stating there are advantages to either method and for AB testing we are currently using this architecture. 

Vincent
Vincent Nov 23, 2016 12:59 AM

Hi Sterry

Is it possible to link two separate AB Page Testing together? 

Regards,

Vincent

Dick Sterry
Dick Sterry Nov 23, 2016 03:05 PM

The current implementation is for a single A - B test. We may extend to do multi-variant in the future but it's not part of the product now.

Daniel Sandberg
Daniel Sandberg Aug 14, 2018 10:51 AM

A nice read, unfortunatly the link to the PDF document is broken.

Asa Sundin
Asa Sundin Aug 14, 2018 11:12 AM

@Daniel Sandberg, A/B testing is no longer in Beta and the official documentation can be found here: http://webhelp.episerver.com/latest/cms-edit/ab-testing.htm.

Please login to comment.
Latest blogs
How Optimizely Web Experimentation enables fast validation of design and UX changes

Ever wondered how to increase conversion rates and quickly validate design/UX alternatives to find the most impactful changes? I wrote a practical...

Jacob Pretorius | Jan 31, 2023

What’s next after Google Optimize’s sunsetting?

Google has announced that it is sunsetting the Google Optimize and Optimize 360 services, forcing customers to explore new platforms and invest in...

Ynze | Jan 31, 2023 | Syndicated blog

What’s next after Google Optimize’s sunsetting?

Google has announced that it is sunsetting the Google Optimize and Optimize 360 services, forcing customers to explore new platforms and invest in...

Ynze | Jan 31, 2023 | Syndicated blog

Migrating from Providers to CMS 12 ASP.NET Identity with cookie tweaks

Notes on migrating a multi-site from Membership and Role Providers to ASP.NET Identity and changing cookie options dynamically.

Johan Kronberg | Jan 30, 2023 | Syndicated blog