Exploiting data compression in collective I/O techniques

13 years 10 months ago

Download www.arcos.inf.uc3m.es

This paper presents Two-Phase Compressed I/O (TPC I/O,) an optimization of the Two-Phase collective I/O technique from ROMIO, the most popular MPI-IO implementation. In order to reduce network trafﬁc, TPC I/O employs LZO algorithm to compress and decompress exchanged data in the inter-node communication operations. The compression algorithm has been fully implemented in the MPI collective technique, allowing to dynamically use (or not) compression. Compared with Two-Phase I/O, Two-Phase Compressed I/O obtains important improvements in the overall execution time for many of the considered scenarios.

Rosa Filgueira, David E. Singh, Juan Carlos Pichel

Real-time Traffic

CLUSTER 2008 | Cluster Computing | TPC I/O | Two-phase Collective I/o | Two-Phase Compressed I/O |

claim paper

» Optimizing positional index structures for versioned document collections

» Data Acquisition through Joint Compressive Sensing and Principal Component Analysis

» Exploiting Recurring Usage Patterns to Enhance Filesystem and Memory Subsystem Performance

» Efficient SpaceTime Compression to Reduce Test Data Volume and Testing Time for IP Cores

» Sharing large data collections between mobile peers

» Efficient search in large textual collections with redundancy

» Compressing Historical Information in Sensor Networks

» Compressed classification of observation sets with linear subspace embeddings

Post Info
More Details (n/a)

Added	29 May 2010
Updated	29 May 2010
Type	Conference
Year	2008
Where	CLUSTER
Authors	Rosa Filgueira, David E. Singh, Juan Carlos Pichel, Jesús Carretero

Comments (0)

Sciweavers

Exploiting data compression in collective I/O techniques

CLUSTER 2008 | Cluster Computing | TPC I/O | Two-phase Collective I/o | Two-Phase Compressed I/O |

Explore & Download

Productivity Tools

Document Tools

Image Tools

Sciweavers