A uniform approach to accelerated PageRank computation

ABSTRACT

In this note we consider a simple reformulation of the traditional power iteration algorithm for computing the stationary distribution of a Markov chain. Rather than communicate their current probability values to their neighbors at each step, nodes instead communicate only changes in probability value. This reformulation enables a large degree of flexibility in the manner in which nodes update their values, leading to an array of optimizations and features, including faster convergence, efficient incremental updating, and a robust distributed implementation.While the spirit of many of these optimizations appear in previous literature, we observe several cases where this unification simplifies previous work, removing technical complications and extending their range of applicability. We implement and measure the performance of several optimizations on a sizable (34M node) web subgraph, seeing significant composite performance gains, especially for the case of incremental recomputation after changes to the web graph.

References

1. Arvind Arasu, Jasmine Novak, Andrew Tomkins, and John Tomlin, Pagerank computation and the structure of the web: Experiments and algorithms. WWW 2002 poster.
2. Sergey Brin and Lawrence Page, The Anatomy of a Large-Scale Hypertextual Web Search Engine. Computer Networks 30(1-7): 107--117 (1998).
3. Steve Chien, Cynthia Dwork, Ravi Kumar, Dan Simon, and D. Sivakumar, Link evolution: Analysis and algorithms. Internet Mathematics: Volume 1, No. 3, pp. 277--304.
4. Nadav Eiron, Kevin McCurley, and John Tomlin, Ranking the web frontier. WWW 2004.
5. Sepandar Kamvar, Taher Haveliwala, and Gene Golub, Adaptive Methods for the Computation of PageRank. Stanford University Technical Report, 2003.
6. Sepandar Kamvar, Taher Haveliwala, Christopher Manning, and Gene Golub, Exploiting the Block Structure of the Web for Computing PageRank. Stanford University Technical Report, 2003.
7. Sepandar Kamvar, Taher Haveliwala, Christopher Manning, and Gene Golub, Extrapolation Methods for Accelerating PageRank Computations. WWW 2003.
8. Taher Haveliwala, Topic-Sensitive PageRank. WWW 2002.
9. Glen Jeh and Jennifer Widom, Scaling Personalized Web Search. WWW 2003.
10. Amy Langville and Carl Meyer, A Reordering for the PageRank problem. NCSU CRSC Technical Report #CRSC-TR04-16. March 2004.

Index Terms

• Information systems

  • Information retrieval