Adaptive I/O Scheduling for Distributed Multi-applications Environments

The aIOLi project aims at optimizing the I/O accesses within the cluster by providing a simple POSIX API, thus avoiding the constraints to use a dedicated parallel I/O library. This paper introduces an extension of aIOLi to address the issue of disjoint accesses generated by different concurrent applications in a cluster. In such a context, performance, fairness and response time are the criteria for which good tradeoffs have to be assessed. A test composed of two concurrent IOR benchmarks showed improvements on read accesses by a factor ranging from 3.5 to 35 with POSIX calls and from 3.3 to 5 with ROMIO. 1 Overview I/O bottlenecks have always been a major issue in Computer Science , it is likely to continue as I/O hardware performance increases slower than the one of CPU and memory. Furthermore, this gap is amplified by the increasing use of clusters of workstations or SMPs as well as the growing number of scientific application developments with more demanding I/O requirements us...

• Type: Conference
• Year: 2006
• Where: HPDC
• Authors: Adrien Lebre, Yves Denneulin, Guillaume Huard, Przemyslaw Sowa
• Keywords: Distributed And Parallel Computing, HPDC 2006, I/O Accesses, Parallel I/o, Parallel I/o Library