2014-03-01 Domains per page over time
A few days ago, I read an interesting blog post by Peter Bengtsson . Peter is sampling web pages and computing basic statistic on the number of domains ( RFC 3986 Host ) required to completely render the page. Not surprisingly, the mean is quite high: 33. Also not surprisingly, he has found pages that depend on more than 100 different domains. This started me thinking about how this has changed over time. Over the course of my research I have acquired a corpus of composite mementos (archived web pages and all their embedded images, CSS, etc.) dating from 1996 to 2013. So, I did a little number crunching. What I suspected and confirmed is that the number of domains has increased over time and that the rate of increase has also increased. This is reflected in the median domains data show in Figure 1. Note that the median shown (3) is a fraction of Peter's (25). I believe there are two major reasons for this. First, our current process for recompo...