ECHOFS: a scheduler-guided temporary filesystem to leverage node-local NVMS
Visualitza/Obre
Cita com:
hdl:2117/133676
Tipus de documentText en actes de congrés
Data publicació2018
EditorInstitute of Electrical and Electronics Engineers (IEEE)
Condicions d'accésAccés obert
Tots els drets reservats. Aquesta obra està protegida pels drets de propietat intel·lectual i
industrial corresponents. Sense perjudici de les exempcions legals existents, queda prohibida la seva
reproducció, distribució, comunicació pública o transformació sense l'autorització del titular dels drets
ProjecteCOMPUTACION DE ALTAS PRESTACIONES VII (MINECO-TIN2015-65316-P)
NEXTGenIO - Next Generation I%2FO for Exascale (EC-H2020-671591)
NEXTGenIO - Next Generation I%2FO for Exascale (EC-H2020-671591)
Abstract
The growth in data-intensive scientific applications poses strong demands on the HPC storage subsystem, as data needs to be copied from compute nodes to I/O nodes and vice versa for jobs to run. The emerging trend of adding denser, NVM-based burst buffers to compute nodes, however, offers the possibility of using these resources to build temporary file systems with specific I/O optimizations for a batch job. In this work, we present echofs, a temporary filesystem that coordinates with the job scheduler to preload a job's input files into node-local burst buffers. We present the results measured with NVM emulation, and different FS backends with DAX/FUSE on a local node, to show the benefits of our proposal and such coordination.
Descripció
© 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes,creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
CitacióMiranda, A.; Nou, R.; Cortés, A. ECHOFS: a scheduler-guided temporary filesystem to leverage node-local NVMS. A: International Symposium on Computer Architecture and High Performance Computing. "2018 30th International Symposium on Computer Architecture and High Performance Computing: SBAC-PAD 2018: proceedings: Lyon, France, 24-27 September 2018". Institute of Electrical and Electronics Engineers (IEEE), p. 225-228.
ISBN978-1-5386-7769-8
Versió de l'editorhttps://ieeexplore.ieee.org/document/8645894
Fitxers | Descripció | Mida | Format | Visualitza |
---|---|---|---|---|
echofs A Scheduler-guided Temporary Filesystem.pdf | 144,9Kb | Visualitza/Obre |