Archive for December, 2008
A/B Testing Calculators
Posted by: | CommentsDo you need an A/B split testing calculator to determine which sample or page is the winner of your test, to see if your test is statistically significant, or to calculate how many impressions or conversions you will need to run your A/B Test?
Here are four A/B testing calculators for you to use to determine your test results:
- SplitTestCalculator.com’s Split Test A/B Testing Calculator:
My easy-to-use online split test and A/B test calculator to determine if you have a statistically significant winner from your landing page, ppc, email, or direct mail split A/B test.
- Bulldog Solutions’ Simple A/B Testing Calculator and Advanced A/B Testing Calculator: (update: looks like they have taken it down)
Two different excel spreadsheets with video demos on how to use them. The first spreadsheet, the Simple A/B Testing Calculator has a preset 90% significance level. The Advanced A/B Testing Calculator allows you to set your significance level and provided a separate tab to calculate the sample size needed. You can also view their PDF on What’s Under the Hood of their A/B Testing Calculators. - PPC G-Test Calculator by SEOTools:
This online split testing calculator will let you uncover the results to a 2 sample test. It tells you the winner of the test with the confidence level. Be careful though as it’s not based on a preset significance level nor can you set one. But reading the test analysis you can easily see what the confidence level of your results are and decide for yourself if there is enough statistical significance. - UserEffects’ Split Test Calculator & Decision Tool:
A simple to use online testing calculator, however this one gives you an analysis of your test including an estimate of how many more visitors you might need to reach a 90% confidence level in your test.
Google Testing their Business Solutions Page
Posted by: | CommentsThis morning I went to log into my Google Analytics account and noticed when I first went to Google’s Business Solutions page I had entered into one of their Google Website Optimizer tests on that page.
It looks like they are testing only the top portion of the page and testing the following:
- Layout of the top paragraphs (3 paragraphs straight down vs. 1 paragraph on top and 2 below side by side)
- Position/Placement of the Get Started button on the page
- Background box around the button (visible vs. not visible)
- Google Analytics paragraph healdine (Increase website conversions and marketing ROI vs. Increase website conversions and marketing ROI with Analytics)
Here are screen shots from the test 5 pages displaying in their test (click thumnail for full size):
I should note that these screenshots only show the top of the actual page where I noticed the different test elements, to see the entire page you will need to visit their Business Solutions page.
Blogging Optimization Best Practices?
Posted by: | CommentsMost likely you have a blog or have thought about creating a blog for your business. There is minimal financial cost involved in starting a blog if you don’t have access to a lot of capital, but the time and thought investment can be equally as “expensive” as other marketing objectives if not more so. Either way, you might learn a thing or two from the top audience acquiring and retaining blogs in the blogosphere if you are trying to create a profitable business blog.
Technorati, the leading blog search engine, recently completed their 2008 State of the Blogosphere report which has been released annually since 2004 reporting on their analysis on the trends of blogging.
The 2008 report consists of the who, the what, and the how of blogging; blogging for profit; and the brands entering the blogosphere.
In The How of Blogging section of their 2008 State of the Blogosphere they nicely break down what the top bloggers are doing compared to their blogging counterparts based on Technorati indexing data.
Audience Building Strategies – listing, commenting, linking, and tagging.
“Top audience-building strategies include: listing their blog on Technorati and Google, commenting or linking to other blogs, and tagging blog posts so that they are more easily searchable. Active bloggers have learned a variety of techniques for attracting visitors to their blog, conducting an average of five different activities to attract visitors. 28% do at least seven activities.
Posting -The top blogs post daily and post multiple times per day.
“Technorati Top 100 bloggers are twice as likely to post ten or more time daily compared to the next 500, and 14 times as likely than the next 5000. Looking again at Technorati’s tracking data shows how often the Top 100 bloggers post each day compared to the next 500 and the next 5000. The Technorati Top 100 are prolific, with 43% posting ten times per day or more often. Only 8% post once a day or less frequently, compared to 13% of the next 500 bloggers, and 22% of the next 5000 bloggers.”
Linking Strategy – The top blogs consistently link from their website to other blogs.
“Bloggers are also adept at linking to and from other sites – they have a median of 29 links from their blog to other web sites (with a mean of 3400), and a median of 30 links from other web sites to their blog (with a mean of 4800).”
Reader Loyalty – The top blogs actively pursue ways to create reader loyalty.
“To build loyalty with readers, bloggers create events for their readership. In order to retain visitors to their blogs, sophisticated bloggers are creating readership events.”
In Conclusion – Should you adopt ALL of these blogging strategies?
Although these may sound like good ideas or no-brainers, are these strategies the right choice for your blog? Technorati has an obviously large user base, but at the same time they are also a “technically advanced” audience. The average consumer, be it B2B or B2C doesn’t visit their site or possibly even know who they are.
Does your audience need 5 posts per day, or will it annoy them enough that they delete you from their RSS feed or stop reading your blog. Is your blog’s goal to convert visitors to purchase your products, think of you as a thought leader, or to increase page views so that you can sell more ads or increase your advertising rates? These are three totally different strategies that require strategic planning that comes from different angles. As with anything in internet marketing optimization, no one strategy is right for every website or blog so you will definitely need to test to uncover what works best for your readers and your blogs goals with the least amount of compromise.
For the business bloggers out there reading this, check out LinkedIn’s corporate blog editor Mario Sundar’s post on 7 Habits of Highly Effective Business Bloggers that are takeaways and a slideshow from a presentation he did with Lionel Menchaca from Dell, Nicki Dugan from Yahoo!, Carolyn Abram from Facebook and Thomas Hoehn from Kodak. This will help get your mind on the right track.
PPC Landing Page Optimization – Keeping the Continuity in Your Message
Posted by: | CommentsIf you’re investing in Paid Search then it will most certainly and profitably make your wallet happy if you clearly understand how to optimize your landing pages that visitors arrive at after clicking on your PPC display ads to increase conversions.
Of course you will need to perform testing on your landing pages to determine the best page combination of elements statistically speaking-but it’s important to understand or to at least be reminded of the importance of carrying your message through in landing page optimization. Understanding this concept will help you in choosing initial test elements to test.
IMPORTANT: Your message needs to be carried over from your display ad to your landing page.
If someone is on Google or any other search engine doing a search on Apple products and your display ad copy influences them to click based on its references to your special deals on Apple products, but the landing page features and talks about Microsoft products, the visitor in most instances won’t spend the time to find out where you have that information placed or hidden, it’s just too easy for them to use the back button. Additionally, if you are presenting information on your special deals (your offer) as I mentioned above, and your landing page has the right products, but no mention of the special deals (offer) you can also lose the visitor for many other reasons such as the frustration of feeling they were mislead.
Remember the visitor clicked on your ad because it drew them in by what it had to say, be it a specific product, your offer, your brand, your verbiage, etc. You don’t want to let the visitor bounce and go back and click on the next display ad. And unfortunately, in most cases that next ad will be your competitors’ ad. You wouldn’t have a sign on your brick and mortar store that says Tire Sale and only have toothbrushes on the shelves.
When you don’t carry over the message, you’re throwing a good portion of your PPC money away on unproductive clicks that won’t convert as often as those who carry over their message from PPC to their landing page.
Therefore it’s extremely important to keep the continuity of your message all the way from your display ad through to the landing page to increase your chances of influencing a conversion.
On a final note, you should know that just carrying over the message isn’t the magic bullet where you don’t have to worry about anything else. You still have to be concerned with your page layout and presentation, your offer, your images, the style and content of your copy and so on. Carrying over your message is just one major but important factor in the process of landing page and landing page optimization success.
A/B Testing Low Traffic Web Pages
Posted by: | CommentsSometimes the website or the page you want to test just doesn’t have enough traffic to really perform an large multi-panel A/B or multivariate test on it with multiple elements or variations. But perhaps you still want to improve upon its performance. Maybe you just recently launched a website and it’s receiving some traffic but you still really believe that you could influence the current traffic better to get better results. Maybe you aren’t getting 100 orders per week, but you are getting 10, and you believe that you should be able to get to 20 orders with improvements to the page without an increase in traffic.
Lower traffic shouldn’t stop you from still performing a small A/B test as you can still learn a great deal of information with the web traffic that you do receive. But the key is to test the high impact elements on the page that are easily noticeable either consciously or subconsciously by the visiting traffic rather than the minutia that would allow you to see incremental improvements with higher traffic pages.
High impact elements will vary according to your page design, but think along the lines of your:
- Main Headline
- Page Background Color
- Main Hero Image
- Drastically reducing or increasing your registration form fields
- Your Offer
Of course with less traffic you will only be able to test a few variations due to the fact that you don’t have the traffic to get statistically significant results with lots of variations. However, this shouldn’t stop you from creating a list, sorted by priority of impact to continue testing over time. Maybe you can’t test 6 different page variations right now in the first round of testing, but it might be viable for you to test 2 page variations, and then continue testing your other ideas with the winner of the first round of tests.
Want to learn more about A/B testing your low traffic pages? Check out How to Do A/B Split-Testing on Lower Traffic Sites with Bryan Eisenberg at Dr. Ralph Wilson’s Web Marketing Today blog.
Good luck and remember although you might not be able to test everything you want to right now, anything you can do to statistically improve your results is a good thing!





