Sciweavers

SC
2009
ACM

Evaluating use of data flow systems for large graph analysis

13 years 10 months ago
Evaluating use of data flow systems for large graph analysis
Large graph analysis has become increasingly important and is widely used in many applications such as web mining, social network analysis, biology, and information retrieval. The usually high computational complexity of the commonly-used graph algorithms and large volume of data frequently encountered in these applications, however, make scalable graph analysis a non-trivial task. Recently, more and more of these graph algorithms are implemented as dataflow applications, where many tasks perform assigned operations in parallel independent of other tasks. These applications are run on large-scale computing platforms to combine the advantages of the data parallelism enabled by dataflow model and the high computing power and large storage capacity offered by increasingly affordable high-end computers. In this paper, we evaluate the potentials of many-tasks concept in a form of dataflow system for large graph analysis applications by studying the performance of complicated graph alg...
Andy Yoo, Ian Kaplan
Added 19 May 2010
Updated 19 May 2010
Type Conference
Year 2009
Where SC
Authors Andy Yoo, Ian Kaplan
Comments (0)