Split Testing - Part 3

8 minutes
Share the link to this page
Copied
  Completed
You need to have access to the item to view this lesson.
One-time Fee
$69.99
List Price:  $99.99
You save:  $30
€64.98
List Price:  €92.84
You save:  €27.85
£55.64
List Price:  £79.48
You save:  £23.84
CA$95.72
List Price:  CA$136.74
You save:  CA$41.02
A$105.61
List Price:  A$150.88
You save:  A$45.27
S$94.51
List Price:  S$135.02
You save:  S$40.51
HK$546.96
List Price:  HK$781.40
You save:  HK$234.44
CHF 63.39
List Price:  CHF 90.57
You save:  CHF 27.17
NOK kr759.29
List Price:  NOK kr1,084.75
You save:  NOK kr325.45
DKK kr484.72
List Price:  DKK kr692.49
You save:  DKK kr207.76
NZ$116.27
List Price:  NZ$166.11
You save:  NZ$49.83
د.إ257.06
List Price:  د.إ367.25
You save:  د.إ110.18
৳7,668.91
List Price:  ৳10,956.06
You save:  ৳3,287.14
₹5,843.17
List Price:  ₹8,347.75
You save:  ₹2,504.57
RM331.68
List Price:  RM473.85
You save:  RM142.17
₦86,437.65
List Price:  ₦123,487.65
You save:  ₦37,050
₨19,439.77
List Price:  ₨27,772.29
You save:  ₨8,332.52
฿2,571.29
List Price:  ฿3,673.43
You save:  ฿1,102.14
₺2,259.44
List Price:  ₺3,227.91
You save:  ₺968.47
B$355.04
List Price:  B$507.22
You save:  B$152.18
R1,290.39
List Price:  R1,843.50
You save:  R553.10
Лв127.12
List Price:  Лв181.60
You save:  Лв54.48
₩94,866.43
List Price:  ₩135,529.28
You save:  ₩40,662.85
₪261.89
List Price:  ₪374.14
You save:  ₪112.25
₱3,999.98
List Price:  ₱5,714.50
You save:  ₱1,714.52
¥10,762.93
List Price:  ¥15,376.28
You save:  ¥4,613.34
MX$1,185.03
List Price:  MX$1,692.97
You save:  MX$507.94
QR254.87
List Price:  QR364.12
You save:  QR109.24
P951.97
List Price:  P1,360.02
You save:  P408.04
KSh9,396.15
List Price:  KSh13,423.65
You save:  KSh4,027.50
E£3,355.96
List Price:  E£4,794.44
You save:  E£1,438.47
ብር4,011.08
List Price:  ብር5,730.37
You save:  ብር1,719.28
Kz58,466.37
List Price:  Kz83,526.97
You save:  Kz25,060.59
CLP$65,872.48
List Price:  CLP$94,107.58
You save:  CLP$28,235.10
CN¥495.49
List Price:  CN¥707.87
You save:  CN¥212.38
RD$4,060.47
List Price:  RD$5,800.92
You save:  RD$1,740.45
DA9,414.39
List Price:  DA13,449.71
You save:  DA4,035.31
FJ$157.07
List Price:  FJ$224.39
You save:  FJ$67.32
Q543.15
List Price:  Q775.96
You save:  Q232.81
GY$14,618.48
List Price:  GY$20,884.44
You save:  GY$6,265.96
ISK kr9,767.80
List Price:  ISK kr13,954.60
You save:  ISK kr4,186.80
DH704.80
List Price:  DH1,006.90
You save:  DH302.10
L1,237.78
List Price:  L1,768.33
You save:  L530.55
ден4,001.09
List Price:  ден5,716.08
You save:  ден1,714.99
MOP$562.43
List Price:  MOP$803.50
You save:  MOP$241.07
N$1,293.49
List Price:  N$1,847.92
You save:  N$554.43
C$2,572.34
List Price:  C$3,674.94
You save:  C$1,102.59
रु9,329.91
List Price:  रु13,329.02
You save:  रु3,999.10
S/260.85
List Price:  S/372.66
You save:  S/111.80
K270.11
List Price:  K385.89
You save:  K115.77
SAR262.50
List Price:  SAR375.01
You save:  SAR112.51
ZK1,884.87
List Price:  ZK2,692.78
You save:  ZK807.91
L323.24
List Price:  L461.79
You save:  L138.55
Kč1,626.08
List Price:  Kč2,323.07
You save:  Kč696.99
Ft25,316.43
List Price:  Ft36,167.88
You save:  Ft10,851.45
SEK kr757.73
List Price:  SEK kr1,082.52
You save:  SEK kr324.79
ARS$61,503.14
List Price:  ARS$87,865.40
You save:  ARS$26,362.25
Bs483.90
List Price:  Bs691.31
You save:  Bs207.41
COP$271,944.94
List Price:  COP$388,509.43
You save:  COP$116,564.48
₡35,713.67
List Price:  ₡51,021.71
You save:  ₡15,308.04
L1,726.17
List Price:  L2,466.06
You save:  L739.89
₲523,116.65
List Price:  ₲747,341.53
You save:  ₲224,224.88
$U2,673.86
List Price:  $U3,819.97
You save:  $U1,146.10
zł281
List Price:  zł401.45
You save:  zł120.44
Already have an account? Log In

Transcript

All right, welcome to Module Three. In this module, our expert will teach you about analyzing the split test results. So get ready to take some notes. And let's jump right in. Alright, so in this lesson, we're going to be going over some real world examples of split test results, and how to sort of analyze them and what to do with those results. So let's have a look at this one first.

This is the page the original page that we're looking at, okay. Very basic page, minimalist, headline, logo at the top and the button. And it doesn't really say anything about what it is. In fact, it's it's, this would be called a blind headline. Okay, it's blinder than blind actually. So this was the original and then it was split tested against a couple of other variants.

And let's have a look here. So, variation. Let's see here. Let's make sure I got that right. This is the original variation a, and they're out of order and that line there. Okay, that's the original.

That makes more sense. So this is the original. And it has a little bit of information about the product. Variation B, presumably was the blind one. Yep. And variations C was sort of similar to variation a, but the main headline was a little bit smaller, but with more text in it.

So start making money online with 200 plus free video lessons, start making money online with our internet marketing Academy. So this one has a little bit more detail in it. Let's have a look at what actually was the winner. So variation, a As many of us probably could have guessed, did in fact do a little bit better. It had the highest rate, it was 44.7% conversions. So out of 47 visitors to that variation, 21 of them converted.

And that's a pretty solid conversion rate. And there's not much of a difference though between that, surprisingly and the blind one. Whereas this one here, surprisingly, did the worst 30% 11.5% less. Now even though we have what most would agree is a reasonable amount of traffic per variation to come to some conclusions. This is pretty low, we would really want to follow that and see if variation see which is very similar to variation a is in fact that much worse and doesn't affect perform that much worse. One might say that this one performs better because it gets the tangible there are the specifics out in the main headline 200 plus free video lessons while this One variation beat performs well because it's the opposite extreme.

And blind headlines do, in fact, sort of galvanize people sometimes, depending on who you're targeting, if you're targeting people in the MMO niche to make money online niche, for example, and they can't make any money online, and they see a blind headline that literally just says, start making money online right now. Maybe that's maybe that's the factor that made this one almost as successful as, as the counterpart with the more detailed headline, you know, so the only way to know for sure, would be to send more traffic to it. However, if you're running a live operation, you're not just split testing for fun. Remember, you're actually running a business with dollars and cents. It's hard to do that it's hard to keep throwing money into something that after this much traffic seems to have a lower conversion rate. So rather than just keep it going equally, some might say it's better to just slowly dial it down.

So that you can have a little bit of traffic going there which will be useful for you know, checking Back up on that split test and seeing if the results changed, let's say a month from now, but you're not wasting too much money by losing that if in fact, it is objectively true that it performs less. And the way that you do that is just adjusting the traffic split. Now again, depending on what software you're utilizing, this may or may not be an option, or it might look a little bit different. But on Insta page, it's called traffic split. And you can manually set the traffic split to whatever you want. Absolutely, whatever you want.

So if we want 15% going to variation, see because it's not doing great, but we want to continue accumulating some more traffic and evidence over the course of the coming months and then check again, we can do that. But because these ones are making us the highest number of leads or the highest amount of money right now. We want most of our traffic going there at the moment. That kind of makes sense. Now let's have another look at a similar real world example here. And let's see we'll load up the first Okay, so as you can see, there's a pretty significant difference between these.

There's no neck and neck like on the previous example. 79.4% is an insane conversion rate for a lead page, let's have a look at what the difference was. There's this, this and this. You'll notice the headline is the same, the size of the box might change a little bit, you know, the text is a little bit wider, and that one but the headlines the same and all of these the sub headline is exactly the same. And the button is exactly the same. Now this is what's called a bridge page.

Okay, so this is a lead page where you capture a lead, but what you're really pitching is a video. And in this case, if I recall, the visitor was then just sent to a sales video for an affiliate offer. Okay, but variation See, excuse me, variation a didn't perform terrible by any means. 38% is still a respectable conversion rate. But it's the lowest of these as a little bit odd because this is kind of a cool looking image. But I think a meteorite striking the earth seemed to resonate.

I mean, this is a great looking image. But maybe it resonate a little bit more directly being in the center of the screen and having a lot of focus on it, a lot of contrast there and the colors, and it resonated a lot or I should say, it worked well with the red words, earth shattering, earth shattering video changes everything. You know, now, that was the whole point of all three images. There's a picture of earth shattering. This one, it's debatable whether Earth is actually shattering. It looks like Yeah, it looks like some type of a planet is colliding into Earth.

Shout out to all those. What do they call neat Nibiru people out there. But For some reason, this one was astronomically, more popular. And here's the deal. When you're analyzing split test results, you're not always going to have an answer, you're not always going to have a why, you know, you're not always going to be able to understand why this one and honestly, many of the people who come to the page won't be able to tell you why. You know, there's just psychological phenomenon sometimes that are very difficult to nail down and enunciate your job.

However, unless you're a research scientist or something isn't necessarily to worry and stress out about the why. Well you're interested in it's the what, and the what in this case, is that you're going to get 80%, eight out of 10 of the people who you send to this variation, right here are going to opt in. So let's definitely use that variation more. So that kind of makes sense. So we would want to take you know, we were talking about dialing it down and dialing it up. We would probably call this one good.

It's a lot of traffic, huge difference in conversion, same traffic source for all these pages. You know, one traffic source To one landing page with three variations. I mean, you might as well just do this, you know, or even just 100% variation B, you know, you could turn these ones off. That's a clear winner. So again, sometimes it's going to be a little bit mysterious. Don't stress out too much about the why.

Although the y can be useful for future endeavors. So if you can and unsaved it and can nail down then by all means do so. But don't stress out about too much because you don't really need to know the why you just want to know which one's performing best. And put all of your marketing efforts into that one from that point forward.

Sign Up

Share

Share with friends, get 20% off
Invite your friends to LearnDesk learning marketplace. For each purchase they make, you get 20% off (upto $10) on your next purchase.