Saturday, February 17, 2007

Website Optimizer: Some of My First Results

Now that I have enough variations and a decent Experiment setup, we can take a look at some results.

As mentioned previously, I have three Test Sections with two Variations each setup on my Test Page:

1.) Full Table (makes the 3 book package look like one book w/ 2 Free bonus books)
2.) Old Sale Price (shows an original, higher price crossed out above real price - not in original page))
3.) "Limited Time Price" (mentions this text - not in original)

So this gives me 2 x 2 x 2 = 8 variations ('2' being the original + the new variation)

The reports give you two primary views:

Page Sections: shows each page section w/ impressions and conversions for each variation of each section.

Combinations: Showing the best combination of variations.

After about a day or so, my Page Sections looks like this:



What this is showing me, on the right, is that the conversions are all over the board for this time period...no clear cut single, stand-alone Test Section Variation really stands out.

The best performer on a stand alone basis was the "Bonus Table" which was changing a large table to display the 3 book package as a primary book w/ 2 free bonus books (basically testing the idea of a 'free bonus')

The combination results are what is really important...out of the 8 possible combinations, which did the best? That is how I will change my page when the Experiment is done.

I'll post the combination results this afternoon...

*feel free to ask questions via comments - I'll answer them asap!

0 Comments:

Post a Comment

Links to this post:

Create a Link

<< Home