Sciweavers

Share
PAKDD
2011
ACM

Spectral Analysis for Billion-Scale Graphs: Discoveries and Implementation

8 years 1 months ago
Spectral Analysis for Billion-Scale Graphs: Discoveries and Implementation
Abstract. Given a graph with billions of nodes and edges, how can we find patterns and anomalies? Are there nodes that participate in too many or too few triangles? Are there close-knit near-cliques? These questions are expensive to answer unless we have the first several eigenvalues and eigenvectors of the graph adjacency matrix. However, eigensolvers suffer from subtle problems (e.g., convergence) for large sparse matrices, let alone for billion-scale ones. We address this problem with the proposed HEIGEN algorithm, which we carefully design to be accurate, efficient, and able to run on the highly scalable MAPREDUCE (HADOOP) environment. This enables HEIGEN to handle matrices more than 1000× larger than those which can be analyzed by existing algorithms. We implement HEIGEN and run it on the M45 cluster, one of the top 50 supercomputers in the world. We report important discoveries about near-cliques and triangles on several real-world graphs, including a snapshot of the Twitter ...
U. Kang, Brendan Meeder, Christos Faloutsos
Added 16 Sep 2011
Updated 16 Sep 2011
Type Journal
Year 2011
Where PAKDD
Authors U. Kang, Brendan Meeder, Christos Faloutsos
Comments (0)
books