Multi Factorial Testing Arrays

Multi Factorial Arrays are used to split test among 3+ different test versions of the same page. The goal is to identify which combination of variables will give the best overall resutls.

This example test arrau has 11 page elements (A-K) , with two
versions of each ( 1 & 2). Using this test array, you
can compress 2,048 test pages into 12 pages.

Test Page
Design Elements Tested
A B C D E F G H I J K
Page 1 1 2 1 1 1 1 2 1 2 1 1
Page 2 1 2 1 1 1 2 1 2 1 2 2
Page 3 1 2 2 2 2 1 2 1 1 2 2
Page 4 1 1 1 2 2 1 1 2 2 1 2
Page 5 1 1 2 1 2 2 2 2 2 2 1
Page 6 1 1 2 2 1 2 1 1 1 1 1
Page 7 2 2 2 2 1 1 1 2 2 2 1
Page 8 2 2 2 1 2 2 1 1 2 1 2
Page 9 2 2 1 2 2 2 2 2 1 1 1
Page 10 2 1 2 1 1 1 2 2 1 1 2
Page 11 2 1 1 2 1 2 2 1 2 2 2
Page 12 2 1 1 1 2 1 1 1 1 2 1

In this example, assign a page element to each variable.
Eg:

A=Headline: Version 1-Simple Test Arrays, Version 2- Simple
Test Arrays On Sale Now

B=Background Color: Version 1-Purple, Version 2 Gray

C=Font Size: Version 1-12 pt, Version 2-14 pt

D=Warranty : Version 1-No Warranty, Version 2-Lifetime Warranty

E= Free Bonus: Version 1-No Free Bonus, Version 2-Free Bonus
with order

F= Copy Length: Version 1-Short copy, Version 2-Long copy

G=Image type: Version 1-Man at computer, Version 2-Woman
at computer

I=Price: Version 1-$29.95, Version 2- $39.95

J=Free Shipping: Version 1-No Free Shipping, Version 2-Free
Shipping

K: Secure Server Logo: Version 1-No Logo, Version 2-Secure
Server Logo

Test page 1 would have :

Simple Test Array Headline

Gray Background

12 pt. font size

No Warranty

No Free Bonus

Short copy length

Woman at computer image

Price: 39.95

No Free Shipping

No Secure Server Logo

After running this test for the appropriate time, you can determine a winner. The results can be astonishing.

This entry was posted in Split Testing. Bookmark the permalink.