Gather-arrange-scatter: Node-level request reordering for parallel file systems on multi-core clusters

—Multiple processors or multi-core CPUs are now in common, and the number of processes running concurrently is increasing in a cluster. Each process issues contiguous I/O requests individually, but they can be interrupted by the requests of other processes if all the processes enter the I/O phase together. Then, I/O nodes handle these requests as non-contiguous. This increases the disk seek time, and causes performance degradation. To overcome this problem, a node-level request reordering architecture, called Gather-Arrange-Scatter (GAS) architecture, is proposed. In GAS, the I/O requests in the same node are gathered and buffered locally. Then, those are arranged and combined to reduce the I/O cost at I/O nodes, and finally they are scattered to the remote I/O nodes in parallel. A prototype is implemented and evaluated using the BTIO benchmark. This system reduces up to 84.3% of the lseek() calls and reduces up to 93.6% of the number of requests at I/O nodes. This results in up to ...

• Type: Conference
• Year: 2008
• Where: CLUSTER
• Authors: Kazuki Ohta, Hiroya Matsuba, Yutaka Ishikawa
• Keywords: CLUSTER 2008, Cluster Computing, Contiguous I/o Requests, I/O Nodes, I/O Requests