ECHOFS: a scheduler-guided temporary filesystem to leverage node-local NVMS
Document typeConference report
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Rights accessOpen Access
European Commisision's projectEC-H2020-671951
The growth in data-intensive scientific applications poses strong demands on the HPC storage subsystem, as data needs to be copied from compute nodes to I/O nodes and vice versa for jobs to run. The emerging trend of adding denser, NVM-based burst buffers to compute nodes, however, offers the possibility of using these resources to build temporary file systems with specific I/O optimizations for a batch job. In this work, we present echofs, a temporary filesystem that coordinates with the job scheduler to preload a job's input files into node-local burst buffers. We present the results measured with NVM emulation, and different FS backends with DAX/FUSE on a local node, to show the benefits of our proposal and such coordination.
© 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes,creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
CitationMiranda, A.; Nou, R.; Cortés, A. ECHOFS: a scheduler-guided temporary filesystem to leverage node-local NVMS. A: International Symposium on Computer Architecture and High Performance Computing. "2018 30th International Symposium on Computer Architecture and High Performance Computing: SBAC-PAD 2018: proceedings: Lyon, France, 24-27 September 2018". Institute of Electrical and Electronics Engineers (IEEE), p. 225-228.
|echofs A Scheduler-guided Temporary Filesystem.pdf||144,9Kb||View/