On browser “statistics”

browser wars

Every time I come across tweets about browser stats I get a bit twitchy. First of all because they always try to paint a picture in one direction or another but mostly as I am not sure about the data they are based on.

What are the sources?

Whenever there is talk about browser stats a few companies crop up: Counter.com, Statcounter.com and Netapplications.com, all of which are hitcounter solutions.

I personally use Statcounter – but only on a few of my pages that I specifically want monitored. So if I compare the stats of Statcounter to the overall stats of the Urchin that comes with my server, there are discrepancies:

Statcounter statistics

urchin stats

( I have no clue what Pipes is doing there – I guess there are some RSS syndicators at work 🙂 )

This, of course is to be expected. But if I now said that Safari only makes up 6.1% of my stats and use the overall hit numbers of the server in another sentence people wouldn’t blink an eye about that wrong connection.

Now, as most of the official sources constantly mentioned are companies that make money with selling statistics software it makes you wonder if those numbers could not be doctored to show some cool trends so people want to know if as many cool kids on iPads come to their site or not. Even without my tinfoil hat on I feel that there should be a better way of collecting information from sources closer to the, err, source. You know, like server logs.

Our fetish for web site statistics

It seems that people really need numbers. All the big web shows have keynotes with lots of massive numbers in them. So and so many million Android devices at Google IO and so and so many iOS devices at WWDC. So many people upgrading to IE9 at Mix (hey, no Windows XP users though, sorry about that) and of course a lot of people using Blackberries and Nokia phones and and and…

I have never had a client that didn’t want a statistics package and when you offer them (the aformentioned companies or Google Diagnostics) it is always amazing to see what people look for: the success stories.

  • How many users did we have more than last month (regardless of them being visitors or spam bots trying to inject code)?
  • Which are the most successful parts of the site?
  • What are the main screen resolutions?
  • How many users have JS disabled so that we can pat our back and proclaim that hashbang URLs are not an issue?

We take statistics as a means of validating our success, not as an opportunity to analyse what could be improved. It is another example of the “like” culture that has taken over our market in the recent years.

An aside: Your statistics have much more interesting data in them. Check the form submission data on your stats to see what people tried to inject code and where to see which parts of your sites should need some extra security love. Check which parts of your site perform badly or stop people going further and find out what made that happen. Where are broken links and how hurtful to the site navigation are they? Analyse the search bot behaviour on your site and see where they get stuck. And and and…

Back to browsers though:

The “only stat that matters” myth

You probably have seen those talks: someone shows one or another browser statistic and the incredibly uplifting story for us web developers that this data represents and then ends with “of course the only real statistic that matters is the one of the site you work on”.

This most of the time translates to “if most of your users are stuck on IE < 9 none of the cool stuff really matters to you”. This is dangerous thinking. First of all – using progressive enhancement you can use all of the cool new stuff:

Supporting old browsers is to me a given when you put things on the web. Read my lips: you can not dictate what browser your users should have. If you do that, you hurt the web, you lock yourself in to a monoculture and you build yet another piece of the web that will block innovation in the future. I do not care if your browser of need is IE, Safari, Chrome or Firefox. All should get something that works – no matter how cool a new version of a certain browser is. This thinking gave us all the apps that now only work in IE6.

Using polyfills you can even make those less fortunate browsers do the same things the new, cool ones do. I am not a big fan of polyfills but that’s for another post.

Whilst it is obvious that you should cater to the largest part of your visitors you should not see that as a reason not to improve the experience for those who can get more. Using local storage and offline storage in browsers that support it can significantly reduce your traffic. Using CSS3 and responsive design wisely means that you cater for the web and new, cool tablet and mobile devices without changing the experience for IE6 users.

It is no wonder that you won’t see many mobile browsers in your stats when you concentrate on supporting only old browsers and desktop machines. Your stats should be a guideline to remind you that you have a diversified audience, not a blocker meaning that you will never get others.

Also, what happens when you start a new project from scratch? Then there is no “one stat that matters”…

I tell you what I want, what I really, really want…

What I’d really want is an open, free and editable resource where you can find statistics of big web sites out there. You could see the stats by market, by nature of the sites and get real information from the server logs rather than some software that relies on tracking and might be blocked (and needs to be installed in the first place).

Inside Yahoo we had a great resource that showed our statistics. This was never published to the outside though (although I frequently requested it). I do think that every big company does the same. Wouldn’t it be awesome to get the statistics of Facebook, Yahoo, Google, AOL, The Guardian, CNN… ? If the server log data gets stripped of all the information that is not browser specific none of these companies would give out any competitive advantage data. All we would get is a real world view of what people really use.

Do you know of any such stats? Do you work for a large corporation? Ask now if you could do a dump of your data and show some stats – I promise you’d get a lot of hits by a very selective group of web developers who need the real information!

View full post on Christian Heilmann’s blog – Wait till I come!

4 thoughts on “On browser “statistics”

  1. Aaln

    “you can not dictate what browser your users should have.
    If you do that, you hurt the web, you lock yourself in to a monoculture
    and you build yet another piece of the web that will block innovation
    in the future.”

    I totally disagree here. You CAN dictate the direction of browser preference for your website. Moreover, I think it’s almost a moral imperative to ensure that people embrace web standards and endorse browsers that meet these standards. Firefox, Chrome, and Opera should be promoted by developers at every opportunity to ensure a homogeneous user experience. Besides, people only get viruses with IE.

    Encourage the disillusion of IE as a browser and save the Internet.

  2. Rob Crowther

    > Using local storage and offline storage in browsers that support it can significantly reduce your traffic

    Isn’t this also going to make your server logs less accurate?

  3. darkyndy

    Browser statistics are useful, but you need to interpret them and compare them for different period of times. Usually they are made public to influence the market, personally this is why I make them public, to make people switch from IE. People that come to my sites have from 40 to 60% FireFox then 40 to 50% Google Chrome that makes at least 85% of all visits.

    Regarding old browsers I suggest to make people realize that is not good for them and educate them to have last version.

  4. Anonymous

    I agree with your analysis.
    It’s clear that stats are misused, and most of times they are decoys.
    As you said, we rely on stats to put medals on our (clients) jackets, or to have a good reason to leave the support of a browser, and yes, it’s against the web culture and it’s purely dictatorship and manipulation.

    Now, I think that the real problem is that most of the time we don’t really know what to do with the huge bunch of informations and tools that we discover every day.
    It’s amazing and also frightening.
    We lack of wisdom (and I’m surely one of the first), in the use of all these stuffs and that’s (in my opinion) a problem of interpretation and perspective. And maybe of time also.

    All this turmoil creates trends that some of us follow, sometimes blindly.
    Because (but not only) of these frequent announcements and endless sources of data, we have clients that want to have fun effects, cool animations, HTML5 website, because they woke up one morning and listened or saw that it was cool. Or because it’s “à la mode” as we said in french.
    And the consequence is that we probably neglect the most important part of our environment  : users; and the real targets of the websites we built. 

    For example, in an e-commerce perspective (as I work in agency specialized in that field), it’s absolutely stupid to leave a part of the users, because it’s a potential loss of, let’s say the word, money.
    And it’s absolutely useful to know if some of our users are stuck in the checkout process, or if they are unable to reach one crucial page… We can’t let people outside the field.

    I think that, as we could find designers, developpers, web-marketers, etc… We now must find strong web-analysts in our teams, with a “cold eye”. Or new tools, as you mentioned, to bring more effective stats, that could be clearly interpretated.
    This could be really helpful for us all. Users and “Webdesigners”.

    In a way, stats are like knives. It’s a simple neutral piece that you can use as you want (to eat, kill or sculpt).

Leave a Reply