File Creation Strategies in a Distributed Metadata File System

13 years 10 months ago

Download www.cecs.uci.edu

As computing breaches petascale limits both in processor performance and storage capacity, the only way that current and future gains in performance can be achieved is by increasing the parallelism of the system. Gains in storage performance remain low due to the use of traditional distributed ﬁle systems such as NFS, where although multiple clients can access ﬁles at the same time, only one node can serve ﬁles to the clients. New ﬁle systems that distribute load across multiple data servers are being developed; however, most implementations concentrate all the metadata load at a single server still. Distributing metadata load is important to accommodate growing numbers of more powerful clients. Scaling metadata performance is more complex than scaling raw I/O performance, and with distributed metadata the complexity increases further. In this paper we present strategies for ﬁle creation in distributed metadata ﬁle systems. Using the PVFS distributed ﬁle system as our te...

Ananth Devulapalli, Pete Wyckoff

Real-time Traffic