Sciweavers

ICDT
2016
ACM

Worst-Case Optimal Algorithms for Parallel Query Processing

7 years 12 months ago
Worst-Case Optimal Algorithms for Parallel Query Processing
In this paper, we study the communication complexity for the problem of computing a conjunctive query on a large database in a parallel setting with p servers. In contrast to previous work, where upper and lower bounds on the communication were specified for particular structures of data (either data without skew, or data with specific types of skew), in this work we focus on worst-case analysis of the communication cost. The goal is to find worst-case optimal parallel algorithms, similar to the work of [17] for sequential algorithms. We first show that for a single round we can obtain an optimal worst-case algorithm. The optimal load for a conjunctive query q when all relations have size equal to M is O(M/p1/ψ∗ ), where ψ∗ is a new query-related quantity called the edge quasi-packing number, which is different from both the edge packing number and edge cover number of the query hypergraph. For multiple rounds, we present algorithms that are optimal for several classes of q...
Paraschos Koutris, Paul Beame, Dan Suciu
Added 04 Apr 2016
Updated 04 Apr 2016
Type Journal
Year 2016
Where ICDT
Authors Paraschos Koutris, Paul Beame, Dan Suciu
Comments (0)