Classic GI=GO Equation Holds True for Web Analytics
Aug 20, 2010 Statistics, Web Analytics
Garbage In = Garbage Out. People who spend their working hours analyzing numbers generally come to this realization. It is true for modeling, it is true for forecasting, and it is completely true when it comes to website analytics.
The chain of events looks something like this:
1. Someone visits a website integrated with a web analytics platform like Google Analytics, Webtrends or Omniture.
2. A web page visitor either navigates to a tracked page or performs a tracked action.
3. A script is executed in the browser, sending data to the analytics platform.
4. The data is added to the datastore.
5. The data is summarized and analyzed.
Problems arise when you assume that steps 1 through 4 are happening correctly, and you move right on to looking at reports and data that come out of the process. Oddly, most site developers I have met who are instrumenting a site for web analytics consider their job done and successful if tags fire when they are expected to. They don’t look at the data as it is passed with the tags and they don’t look and see what made it into the web analytics platform’s datastore. Anything you don’t check in software development is frequently going to be wrong. If your data is wrong, then all your analysis of it will be just as wrong as the data. Again, there’s the classic equation describing this relationship:
Garbage In = Garbage Out
How do you prevent your data from being garbage? QA and debug the data, that’s how.
Before you use information coming from a web analytics solution, you should (or someone should) do these two tests:
1. Web Analytics Data Test Number One: Is the data being passed correctly?
Use a header tool of some kind to see what tags are being invoked and what kind of data they are passing to the web analytics platform. I use WASP. It shows you what kind of tag is fired when you click on navigation and site functions, and then it lists the data values the tag passes. The test is this:
Step 1: Navigate to every page in the site. A pageview should be generated for every pageview you generate and it should have the correct page name passed with it. Implementation of this is usually OK for standard HTML sites, but is error-prone for Flash sites.
Step 2: Click every function you are tracking as an action or event. See that an action or event is generated for each one you click, and that it is firing a tag that classifies it correctly – as an event, not a page view, and that the name and category that are assigned to the action are what they should be.
(Steps 3-n): Anything else you have tagged for measurement, like ad placements for an ad server, should also be clicked systematically to see that everything that is supposed to be captured about ad impressions is actually captured and passed when the tag is fired.
2. Web Analytics Data Test Number Two: Is the data making it into the database(s) correctly?
Set up your full site in staging so it will have a recognizable hostname that you can filter by in your reporting tool. Tell everyone else not to play with the version in staging for a while.
Step 1: Navigate to every page in the site in a systematic order. Do this several times. Make sure you keep track of how many times each page is viewed.
Step 2: Click every function you are tracking as an action or event. Do this several times. Make sure you keep track of how many times each action is done.
(Steps 3a-3n): Anything else you have tagged for measurement, like ad placements for an ad server, should also be clicked systematically – count the impressions and count the clicks.
Step 4: Click through every funnel you have set up, several times, all the way to the goal. If you have goals like time on site or number of pages viewed, make sure you stay long enough and look at enough pages to meet these goals.
If there are required pages in your funnels, make sure you pass through them. Again keep updating the tallies of page views and actions as you do all this.
Step 5: Wait until the data is likely to be available for reporting. Latency varies by platform. Pull reports, filtering for your hostname. You should see that the numbers of page views, actions, ad impressions, ad clicks, goals/conversions, and funnel stages matches what you did in steps 1-3. If they do not, you probably either have:
a. a tagging problem (wrong tag, misimplemented tag, redundant tags, etc.)
b. a setup problem (e.g. definitions for goals/conversions, funnels)
c. other users muddying up your data by hitting the site in staging while you are testing.
d. a more exotic and difficult problem
If this all sounds like a pain in the hindquarters, compare it to the pain of realizing that you have been reporting erroneous numbers and making business decisions based on them for months or years. Believe me, they could be so far off that you’d have been better off guessing or making numbers up. Do not trust what you cannot verify with test results, or you will have much pain and sadness in your future.
Tags: Data Validation, Debugging, Debugging Web Analytics Data, Google Analytics, Omniture, Web Analytics, Webtrends
September 9th, 2010 at 9:57 pm
I will put a link to this blog on my site. I’m sure my visitors will find dis post really interesting
September 10th, 2010 at 12:14 am
You certainly deserve a round of applause for your post and more specifically, your blog in general. Very high quality material.
September 10th, 2010 at 5:06 am
Good info
September 10th, 2010 at 6:13 am
Great Post. Thanks for sahring!!
September 10th, 2010 at 7:13 am
I dont know what to say. This web site is amazing. Thats not seriously a genuinely massive statement, but its all I could appear up with right after reading this. You know a great deal about this theme. So much so that you manufactured me need to understand more about this. Your web site is my stepping stone, my close friend. Many thanks for the heads up on this subject matter.
September 11th, 2010 at 9:06 am
Yo i love your blog, found it while randomly surving a couple days ago, will keep checking up please do visti mine if you wish :). Btw yesterday i was having troubles opening the site. Cya…
September 11th, 2010 at 11:19 am
Its Pleasure to understand your weblog.The above articles is very outstanding, and I truly enjoyed reading your blog and points that you expressed. I love to appear back on the standard basis,post more for the subject.Thanks for sharing…keep writing!!!
September 12th, 2010 at 1:46 am
Hey exactly where did you obtain this wp design from? Is it custom made? If so mind sharing your designers get in touch with info?
September 12th, 2010 at 4:01 am
Hey this is a great post, thanks for the share.
September 12th, 2010 at 9:59 am
Found your blog on LinkedIN, and I just wanted to say that I appreciated the information!
September 12th, 2010 at 6:49 pm
I altered a WP template called dailypress.
September 13th, 2010 at 9:13 am
good morning there,I found your site on google and yahoo,I wanted to comment about this software that Im using to get backlinks and everybody is talking about it.Im gonna come back soon to let you know a little more about it.great site by the way! have a great day!
September 14th, 2010 at 6:45 am
How do you come up with all of this? You must have some good foundation on the subject right?
September 15th, 2010 at 1:52 am
When I read a good article I usually do three things:1.Forward it to my relevant contacts.2.Bookmark it in some of the best bookmarking websites.3.Be sure to return to the site where I read the article.After reading this post I’m seriously thinking of doing all 3.
September 15th, 2010 at 6:20 am
Thanks for posting and sharing with all – Cheers
September 15th, 2010 at 11:08 am
Wow, this was a really quality post. In theory I’d like to write like this too – taking time and real effort to make a good article… but what can I say… I procrastinate a lot and never seem to get something done.
September 16th, 2010 at 3:21 pm
Great article! I’ve been looking thru google for hours searching for appropriate info on this, they absolutely should rank your site on page 1!
September 17th, 2010 at 2:56 pm
This is a good blog. Keep up all the work. I too love to blog. This is great everyone sharing opinions
September 17th, 2010 at 8:38 pm
Well, really happy to read this article, I have bookmarked your website and will turn back to read your new articles.
September 18th, 2010 at 6:42 am
Just wanna commentabout this article, after reading whole of this it make me to have new thinking about one important event, hope I can read more quality news again from you so I bookmark your website.
September 18th, 2010 at 7:45 am
Great information, I just bookmarked this.
September 18th, 2010 at 6:20 pm
Great Blog I love the lay out and the color scheme is it possible to get a copy of your theme?
September 18th, 2010 at 6:44 pm
I find it difficult to subscribe RSS feeds, bookmark this site anyway I have is a very useful and complete information.
September 18th, 2010 at 7:09 pm
Wonderful learn, I simply passed this onto a colleague who was in search of this info. I’ve you bookmarked on Digg.
September 18th, 2010 at 8:26 pm
Hey… It looks like there’s a problem with the layout of the page. For some reason the text block is running into the edge. I don’t know if it’s just me or are others reporting the same thing? Just wanted to let you know in case you’ve been updating the site. Thanks!
September 20th, 2010 at 8:46 am
“Yo i really like your blog, discovered it while randomly surving a couple days ın the past, will keep checking up please do…”
November 1st, 2010 at 9:37 am
http://www.facebook.com/trendygift
I love it~~~
November 2nd, 2010 at 6:11 pm
This topic is very unique, and I appreciate it very much!
November 22nd, 2010 at 1:36 pm
Hey,
I found your website on yahoo.
It is very informative. Good job, keep this site alive.
Thank you
Best regards
December 10th, 2010 at 12:52 pm
Really great thread!
December 25th, 2010 at 2:34 am
[…] Classic GI=GO Equation Holds True for Web Analytics | Practical Marketing Analytics […]
January 12th, 2011 at 10:23 am
Greatings,
Bravo, que palabras adecuadas…, el pensamiento excelente
Garretot
June 26th, 2011 at 3:55 am
Good site! I really love how it is simple on my eyes and the data are well written. I’m wondering how I might be notified when a new post has been made. I’ve subscribed to your RSS feed which must do the trick! Have a great day!
July 25th, 2011 at 1:04 pm
Thanks for the interffesting information. Subscribe to rss
July 26th, 2011 at 2:09 am
Nice job, very good article
October 5th, 2011 at 11:52 am
Nice job, very good article Thank a alot
October 28th, 2013 at 6:47 am
Thanks for your personal marvelous posting! I quite enjoyed reading it, you happen to be a great author.
I will be sure to bookmark your blog and will often come back in the foreseeable future.
I want to encourage yourself to continue your great job, have a nice morning!
March 26th, 2014 at 7:19 pm
I blog quite often and I genuinely appreciate your content.
The article has truly peaked my interest. I am
going to take a note of your site and keep checking for new information about
once a week. I subscribed to your Feed too.
Here is my site; JOe PAntel (Dorothy)
April 19th, 2014 at 6:45 pm
I’m really impressed with your writing skills as
well as with the layout on your blog. Is this a paid theme
or did you customize it yourself? Anyway keep up the nice quality writing, it’s rare to see
a great blog like this one these days.
My web site – inventions during the industrial revolution (darealjoepantel.beeplog.com)
June 12th, 2014 at 1:24 pm
Hello there! This is my first visit to your blog!
We are a group of volunteers and starting a new project in a community in the same niche.
Your blog provided us valuable information to work on. You have done a marvellous job!
my web page – bingo på svenska spel
June 20th, 2014 at 4:59 am
I simply want to tell you that I am all new to weblog and actually savored your web site. Probably I’m going to bookmark your blog . You actually have really good articles and reviews. Thanks for sharing with us your blog site.