Sciweavers

ESCIENCE
2007
IEEE

Community Training: Partitioning Schemes in Good Shape for Federated Data Grids

13 years 9 months ago
Community Training: Partitioning Schemes in Good Shape for Federated Data Grids
In federated Data Grids, individual institutions share their data sets within a community to enable collaborative data analysis. Data access needs to be provided in a scalable fashion since in most e-science communities, data sets do not only grow exponentially but also experience an increasing popularity. If data autonomy is retained, each individual institution has to ensure efficient access to its data. Analyzing application-specific data properties (such as data skew) or query characteristics (query patterns) and distributing data within Data Grids accordingly, allows for improved throughput for data-intensive applications and enables better load-balancing between shared resources. We propose a framework for investigating application-specific index structures for creating suitable partitioning schemes. We evaluate two variants of the well-known Quadtree data structure as well as the Zones approach, an index structure from the astrophysics domain, according to several criteria. ...
Tobias Scholl, Richard Kuntschke, Angelika Reiser,
Added 02 Jun 2010
Updated 02 Jun 2010
Type Conference
Year 2007
Where ESCIENCE
Authors Tobias Scholl, Richard Kuntschke, Angelika Reiser, Alfons Kemper
Comments (0)