When A/B Tests Attack!

We went back to one of our most successful optimization projects to see if we could further improve on the high standards we had already set.

Previously we had embedded a landing page video for TutorVista and experienced tremendous success. With clear confirmation that the video was key to boosting their conversion we decided to experiment further. When we have a clear champion like with that first test which increased conversion by over 80%, we test new alternatives in the hope that we can squeeze even higher conversion rates from the incoming traffic.

This time we tested a graphic element that was part of the call to action at the end of the video. The video was embedded next to a call to action button that said Subscribe in the panel to the right. In the first version (below on the left) we finished the video with a giant arrow on the player pointing towards the Subscribe button to reinforce the closing words of the video’s voiceover.

The competing version of the video went one stage further with a dynamic arrow shooting out of the confines of the video player and coming to rest right next to the Subscribe button (below on the right). The idea was to drag the viewers’ eyes as close as possible to the conversion goal for the page.

Whenever we run a new test for a site we always try to predict which way the test will go, but this one surprised us all. The arrow on the left that stayed within the player and gently insisted on directing attention to the Subscribe button converted at a significantly higher rate than the dynamic flying arrow that left the player.

There may be more tests to run for this kind of element that gleefully breaks the fourth wall of online video, but for now the “old school” version remains on top.