Optimizer Reports: The Red & The Green

Be sure to read my last post on the traffic that is used for Goggle Website Optimizer as well as the method used - clearing up some myths floating around out there: here.

So I'm getting some "Color" in my reports. What does this mean? It means that Google Optimizer is getting closer to determining ultimate winners and losers. For now it is only on the individual test sections report, lets have a look:



note: click on the images to enlarge


"old sale picture" and "Limited time Sale" both have some color. I believe the threshold is 75% for a winning Green variant (ie it has a 75% chance of beating the others - see column headings) and 25% for the Red losers(25% or less chance of beating the others.) When everything is at 100%, this experiment will be over and I will change my site around permanently, based on the results.

This is again based on statistical "confidence" metrics...at some point there will be enough samples taken, and conversions from those samples, to say "ok your done - this variant will beat the others most of the time".

To review what these two were: the "old sale picture" used an higher price crossed out above the actual price. the "limited time sale" just added text to that effect under the price.

The combinations haven't changed a lot from this post.

As far as the other other larger test goes, I'm still waiting on a few more conversions to post some detail.

I also have some "lessons learned" form that experiment and from doing a full-site variant test with Google Optimizer...problem is the site is old and really want to re-vamp the full front page so that would mean a major experiment overhaul...oh well we'll see.