Link Graph Encyclopedia

PageRank in depth

A short history of PageRank

From a Stanford research project to Google's founding idea, a 0–10 number on millions of toolbars, a market in links, and finally a retired public metric that Google says it still uses internally.

PageRank began as an academic idea, became the technical story of the world’s largest search engine, and spent sixteen years as a public number that website owners obsessed over. Its history explains why so many link metrics exist today, and why the industry still talks about “link juice” and 0–10 scores long after Google stopped showing them.

Origins at Stanford, 1996–1998

Larry Page and Sergey Brin started the project in 1996 as Stanford graduate students, crawling the web with a system first called BackRub. The idea drew on citation analysis, where a paper cited by influential papers is itself influential, and on earlier work such as Katz’s 1953 status index (see Katz centrality). In April 1998 they presented “The Anatomy of a Large-Scale Hypertextual Web Search Engine” at the WWW7 conference, describing Google and its use of PageRank. A companion technical report with Rajeev Motwani and Terry Winograd, “The PageRank Citation Ranking: Bringing Order to the Web”, gave the mathematics, including the random surfer interpretation and personalisation. Jon Kleinberg’s HITS appeared the same year, independently, at IBM.

The patent

Page filed US patent 6,285,999, “Method for node ranking in a linked database”, on 9 January 1998; it was granted on 4 September 2001. The patent belonged to Stanford, not Google, which held an exclusive licence. Stanford received 1.8 million Google shares for the licence and sold them in 2005 for about $336 million, one of the most lucrative university licensing deals ever. The patent ran for twenty years from filing and has expired; the method has been free to use for years, and graph libraries ship it as a standard function.

Toolbar PageRank, 2000–2016

On 11 December 2000 Google released the Google Toolbar, a browser add-on that, among other features, displayed a green bar scoring the current page from 0 to 10. This Toolbar PageRank (TBPR) was a coarse, roughly logarithmic bucketing of the page’s internal PageRank, updated only every few months. Google never published the bucket boundaries.

The number became a currency. Site owners checked it obsessively, link sellers priced links by the TBPR of the selling page, and expired domains were valued by the TBPR they had accumulated (see expired domains). Google’s response was a series of steps away from the public number:

Still in use, says Google

Retiring the public number did not retire the algorithm. In 2017, Google’s Gary Illyes wrote that Google still used PageRank, among hundreds of other signals, in ranking. How it is computed today, on what graph, with which spam filtering and link weighting, is not public. Google has published patents describing variants, such as weighting links by how likely a reader is to click them (the “reasonable surfer”) and computing scores by distance from trusted seed pages, but patents describe possibilities, not confirmed practice.

After the toolbar: third-party metrics

The demand that Toolbar PageRank created did not go away when it did. SEO software companies built their own link indexes and their own 0–100 or 0–10 scores to fill the gap: Moz’s Domain Authority, Ahrefs’ Domain Rating, Majestic’s Trust Flow and Citation Flow, and Semrush’s Authority Score. Each is computed from its vendor’s own crawl, with its own definitions and, usually, without disclosed formulas. Several free services also publish 0–10 “PageRank-style” scores derived from open data such as Common Crawl’s graph (see Common Crawl web graph).

None of these numbers is Google’s PageRank, and none should be read as a prediction of how Google ranks a site. The metric audit entry compares several of them against Common Crawl’s open centralities on one day’s auction inventory and finds large disagreements.

What the history teaches

References

Edit this entry on GitHub