Classic GI=GO Equation Holds True for Web Analytics

Garbage In = Garbage Out. People who spend their working hours analyzing numbers generally come to this realization. It is true for modeling, it is true for forecasting, and it is completely true when it comes to website analytics.

The chain of events looks something like this:

1. Someone visits a website integrated with a web analytics platform like Google Analytics, Webtrends or Omniture.
2. A web page visitor either navigates to a tracked page or performs a tracked action.
3. A script is executed in the browser, sending data to the analytics platform.
4. The data is added to the datastore.
5. The data is summarized and analyzed.

Problems arise when you assume that steps 1 through 4 are happening correctly, and you move right on to looking at reports and data that come out of the process. Oddly, most site developers I have met who are instrumenting a site for web analytics consider their job done and successful if tags fire when they are expected to. They don’t look at the data as it is passed with the tags and they don’t look and see what made it into the web analytics platform’s datastore. Anything you don’t check in software development is frequently going to be wrong. If your data is wrong, then all your analysis of it will be just as wrong as the data. Again, there’s the classic equation describing this relationship:

Garbage In = Garbage Out

How do you prevent your data from being garbage? QA and debug the data, that’s how.

Before you use information coming from a web analytics solution, you should (or someone should) do these two tests:

1. Web Analytics Data Test Number One: Is the data being passed correctly?

Use a header tool of some kind to see what tags are being invoked and what kind of data they are passing to the web analytics platform. I use WASP. It shows you what kind of tag is fired when you click on navigation and site functions, and then it lists the data values the tag passes. The test is this:

Step 1: Navigate to every page in the site. A pageview should be generated for every pageview you generate and it should have the correct page name passed with it. Implementation of this is usually OK for standard HTML sites, but is error-prone for Flash sites.

Step 2: Click every function you are tracking as an action or event. See that an action or event is generated for each one you click, and that it is firing a tag that classifies it correctly – as an event, not a page view, and that the name and category that are assigned to the action are what they should be.

(Steps 3-n): Anything else you have tagged for measurement, like ad placements for an ad server, should also be clicked systematically to see that everything that is supposed to be captured about ad impressions is actually captured and passed when the tag is fired.

2. Web Analytics Data Test Number Two: Is the data making it into the database(s) correctly?

Set up your full site in staging so it will have a recognizable hostname that you can filter by in your reporting tool. Tell everyone else not to play with the version in staging for a while.

Step 1: Navigate to every page in the site in a systematic order. Do this several times. Make sure you keep track of how many times each page is viewed.

Step 2: Click every function you are tracking as an action or event. Do this several times. Make sure you keep track of how many times each action is done.

(Steps 3a-3n): Anything else you have tagged for measurement, like ad placements for an ad server, should also be clicked systematically – count the impressions and count the clicks.

Step 4: Click through every funnel you have set up, several times, all the way to the goal. If you have goals like time on site or number of pages viewed, make sure you stay long enough and look at enough pages to meet these goals.
If there are required pages in your funnels, make sure you pass through them. Again keep updating the tallies of page views and actions as you do all this.

Step 5: Wait until the data is likely to be available for reporting. Latency varies by platform. Pull reports, filtering for your hostname. You should see that the numbers of page views, actions, ad impressions, ad clicks, goals/conversions, and funnel stages matches what you did in steps 1-3. If they do not, you probably either have:
a. a tagging problem (wrong tag, misimplemented tag, redundant tags, etc.)
b. a setup problem (e.g. definitions for goals/conversions, funnels)
c. other users muddying up your data by hitting the site in staging while you are testing.
d. a more exotic and difficult problem

If this all sounds like a pain in the hindquarters, compare it to the pain of realizing that you have been reporting erroneous numbers and making business decisions based on them for months or years. Believe me, they could be so far off that you’d have been better off guessing or making numbers up. Do not trust what you cannot verify with test results, or you will have much pain and sadness in your future.

141 Responses to “Classic GI=GO Equation Holds True for Web Analytics”

  1. wascally vibrators Says:

    I will put a link to this blog on my site. I’m sure my visitors will find dis post really interesting

  2. Kredyty Says:

    You certainly deserve a round of applause for your post and more specifically, your blog in general. Very high quality material.

  3. Horoskop Panna Says:

    Good info

  4. Sharika Sheesley Says:

    Great Post. Thanks for sahring!!

  5. contraceptive pills Says:

    I dont know what to say. This web site is amazing. Thats not seriously a genuinely massive statement, but its all I could appear up with right after reading this. You know a great deal about this theme. So much so that you manufactured me need to understand more about this. Your web site is my stepping stone, my close friend. Many thanks for the heads up on this subject matter.

  6. Celena Strupp Says:

    Yo i love your blog, found it while randomly surving a couple days ago, will keep checking up please do visti mine if you wish :). Btw yesterday i was having troubles opening the site. Cya…

  7. Charlie Nini Says:

    Its Pleasure to understand your weblog.The above articles is very outstanding, and I truly enjoyed reading your blog and points that you expressed. I love to appear back on the standard basis,post more for the subject.Thanks for sharing…keep writing!!!

  8. Saliva Drug Tests Says:

    Hey exactly where did you obtain this wp design from? Is it custom made? If so mind sharing your designers get in touch with info?

  9. Outdoor Water Features Says:

    Hey this is a great post, thanks for the share.

  10. Clothes Stand Says:

    Found your blog on LinkedIN, and I just wanted to say that I appreciated the information!

  11. admin Says:

    I altered a WP template called dailypress.

  12. Luigi Fulk Says:

    good morning there,I found your site on google and yahoo,I wanted to comment about this software that Im using to get backlinks and everybody is talking about it.Im gonna come back soon to let you know a little more about it.great site by the way! have a great day!

  13. mozaiek tegels Says:

    How do you come up with all of this? You must have some good foundation on the subject right?

  14. forex trading Says:

    When I read a good article I usually do three things:1.Forward it to my relevant contacts.2.Bookmark it in some of the best bookmarking websites.3.Be sure to return to the site where I read the article.After reading this post I’m seriously thinking of doing all 3.

  15. cary sell home Says:

    Thanks for posting and sharing with all – Cheers

  16. flat fee mls listing Says:

    Wow, this was a really quality post. In theory I’d like to write like this too – taking time and real effort to make a good article… but what can I say… I procrastinate a lot and never seem to get something done.

  17. cna schools Says:

    Great article! I’ve been looking thru google for hours searching for appropriate info on this, they absolutely should rank your site on page 1!

  18. Keith Buysse Says:

    This is a good blog. Keep up all the work. I too love to blog. This is great everyone sharing opinions

  19. China wholesale Belts Says:

    Well, really happy to read this article, I have bookmarked your website and will turn back to read your new articles.

  20. baby and pregnancy Says:

    Just wanna commentabout this article, after reading whole of this it make me to have new thinking about one important event, hope I can read more quality news again from you so I bookmark your website.

  21. cna certification Says:

    Great information, I just bookmarked this.

  22. dubuque flat fee real estate Says:

    Great Blog I love the lay out and the color scheme is it possible to get a copy of your theme?

  23. truth about abs Says:

    I find it difficult to subscribe RSS feeds, bookmark this site anyway I have is a very useful and complete information.

  24. chicago fsbo Says:

    Wonderful learn, I simply passed this onto a colleague who was in search of this info. I’ve you bookmarked on Digg.

  25. Silverfish Bug Says:

    Hey… It looks like there’s a problem with the layout of the page. For some reason the text block is running into the edge. I don’t know if it’s just me or are others reporting the same thing? Just wanted to let you know in case you’ve been updating the site. Thanks!

  26. Wilfredo Nunmaker Says:

    “Yo i really like your blog, discovered it while randomly surving a couple days ın the past, will keep checking up please do…”

  27. Danielle Ostroff Says:

  28. thomas sabo Says:

    This topic is very unique, and I appreciate it very much!

  29. Orlando Lepak Says:

    I found your website on yahoo.
    It is very informative. Good job, keep this site alive.
    Thank you

    Best regards

  30. Andres Guttormson Says:

    Really great thread!

  31. get content Says:

    […] Classic GI=GO Equation Holds True for Web Analytics | Practical Marketing Analytics […]

  32. Garretot Says:

    Bravo, que palabras adecuadas…, el pensamiento excelente

  33. Tyisha Morici Says:

    Good site! I really love how it is simple on my eyes and the data are well written. I’m wondering how I might be notified when a new post has been made. I’ve subscribed to your RSS feed which must do the trick! Have a great day!

  34. john Says:

    Thanks for the interffesting information. Subscribe to rss

  35. Mike Says:

    Nice job, very good article

  36. Shortness of breath Says:

    Nice job, very good article Thank a alot

  37. Search Engine Says:

    Thanks for your personal marvelous posting! I quite enjoyed reading it, you happen to be a great author.
    I will be sure to bookmark your blog and will often come back in the foreseeable future.

    I want to encourage yourself to continue your great job, have a nice morning!

  38. Dorothy Says:

    I blog quite often and I genuinely appreciate your content.
    The article has truly peaked my interest. I am
    going to take a note of your site and keep checking for new information about
    once a week. I subscribed to your Feed too.

    Here is my site; JOe PAntel (Dorothy)

  39. Says:

    I’m really impressed with your writing skills as
    well as with the layout on your blog. Is this a paid theme
    or did you customize it yourself? Anyway keep up the nice quality writing, it’s rare to see
    a great blog like this one these days.

    My web site – inventions during the industrial revolution (

  40. bingo på svenska spel Says:

    Hello there! This is my first visit to your blog!
    We are a group of volunteers and starting a new project in a community in the same niche.
    Your blog provided us valuable information to work on. You have done a marvellous job!

    my web page – bingo på svenska spel

  41. Issac Maez Says:

    I simply want to tell you that I am all new to weblog and actually savored your web site. Probably I’m going to bookmark your blog . You actually have really good articles and reviews. Thanks for sharing with us your blog site.

Leave a Reply

XHTML: You can use these tags: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong>