Mostra el registre d'ítem simple
Workflow environments for advanced cyberinfrastructure platforms
dc.contributor.author | Badia Sala, Rosa Maria |
dc.contributor.author | Ejarque Artigas, Jorge |
dc.contributor.author | Lordan Gomis, Francesc |
dc.contributor.author | Lezzi, Daniele |
dc.contributor.author | Conejero Bañón, Javier |
dc.contributor.author | Álvarez Cid-Fuentes, Javier |
dc.contributor.author | Becerra Fontal, Yolanda |
dc.contributor.author | Queralt Calafat, Anna |
dc.contributor.other | Universitat Politècnica de Catalunya. Departament d'Arquitectura de Computadors |
dc.contributor.other | Barcelona Supercomputing Center |
dc.date.accessioned | 2020-06-12T13:04:16Z |
dc.date.available | 2020-06-12T13:04:16Z |
dc.date.issued | 2019 |
dc.identifier.citation | Badia, R.M. [et al.]. Workflow environments for advanced cyberinfrastructure platforms. A: IEEE International Conference on Distributed Computing Systems. "2019 39th IEEE International Conference on Distributed Computing Systems, ICDCS 2019: Richardson, Texas, United States, 7-9 July 2019: proceedings". Institute of Electrical and Electronics Engineers (IEEE), 2019, p. 1720-1729. |
dc.identifier.isbn | 978-1-7281-2519-0 |
dc.identifier.other | http://arxiv.org/abs/2006.07066 |
dc.identifier.uri | http://hdl.handle.net/2117/190641 |
dc.description.abstract | Progress in science is deeply bound to the effective use of high-performance computing infrastructures and to the efficient extraction of knowledge from vast amounts of data. Such data comes from different sources that follow a cycle composed of pre-processing steps for data curation and preparation for subsequent computing steps, and later analysis and analytics steps applied to the results. However, scientific workflows are currently fragmented in multiple components, with different processes for computing and data management, and with gaps in the viewpoints of the user profiles involved. Our vision is that future workflow environments and tools for the development of scientific workflows should follow a holistic approach, where both data and computing are integrated in a single flow built on simple, high-level interfaces. The topics of research that we propose involve novel ways to express the workflows that integrate the different data and compute processes, dynamic runtimes to support the execution of the workflows in complex and heterogeneous computing infrastructures in an efficient way, both in terms of performance and energy. These infrastructures include highly distributed resources, from sensors and instruments, and devices in the edge, to High-Performance Computing and Cloud computing resources. This paper presents our vision to develop these workflow environments and also the steps we are currently following to achieve it. |
dc.description.sponsorship | This work has been supported by the Spanish Government (SEV2015-0493), by the Spanish Ministry of Science and Innovation (contract TIN2015-65316-P), by Generalitat de Catalunya (contract 2014-SGR-1051). Javier Conejero postdoctoral contract is co-financed by the Ministry of Economy and Competitiveness under Juan de la Cierva Formacion´ postdoctoral fellowship number FJCI-2015-24651. This work is supported by the H2020 mF2C project (730929) and the CLASS project (780622). The participation of Rosa M Badia in the BDEC2 meetings is supported by the EXDCI project (800957). The dislib library developments are partially funded under the project agreement between BSC and FUJITSU. |
dc.format.extent | 10 p. |
dc.language.iso | eng |
dc.publisher | Institute of Electrical and Electronics Engineers (IEEE) |
dc.subject | Àrees temàtiques de la UPC::Informàtica::Arquitectura de computadors::Arquitectures distribuïdes |
dc.subject.lcsh | Cloud computing |
dc.subject.lcsh | High performance computing |
dc.subject.lcsh | Big data |
dc.subject.other | Scientific workflows |
dc.subject.other | Computing continuum platforms |
dc.subject.other | Big data and high-performance computing convergence |
dc.subject.other | Intelligent runtimes |
dc.title | Workflow environments for advanced cyberinfrastructure platforms |
dc.type | Conference report |
dc.subject.lemac | Computació en núvol |
dc.subject.lemac | Macrodades |
dc.contributor.group | Universitat Politècnica de Catalunya. CAP - Grup de Computació d'Altes Prestacions |
dc.identifier.doi | 10.1109/ICDCS.2019.00171 |
dc.description.peerreviewed | Peer Reviewed |
dc.relation.publisherversion | https://ieeexplore.ieee.org/abstract/document/8885062 |
dc.rights.access | Open Access |
local.identifier.drac | 28657388 |
dc.description.version | Postprint (author's final draft) |
dc.relation.projectid | info:eu-repo/grantAgreement/EC/H2020/730929/EU/Towards an Open, Secure, Decentralized and Coordinated Fog-to-Cloud Management Ecosystem/mF2C |
dc.relation.projectid | info:eu-repo/grantAgreement/MINECO//TIN2015-65316-P/ES/COMPUTACION DE ALTAS PRESTACIONES VII/ |
dc.relation.projectid | info:eu-repo/grantAgreement/AGAUR/V PRI/2014 SGR 1051 |
dc.relation.projectid | info:eu-repo/grantAgreement/EC/H2020/780622/EU/Edge and CLoud Computation: A Highly Distributed Software Architecture for Big Data AnalyticS/CLASS |
dc.relation.projectid | info:eu-repo/grantAgreement/MINECO//SEV-2015-0493/ES/BARCELONA SUPERCOMPUTING CENTER - CENTRO. NACIONAL DE SUPERCOMPUTACION/ |
local.citation.author | Badia, R.M.; Ejarque, J.; Lordan, F.; Lezzi, D.; Conejero, J.; Álvarez, J.; Becerra, Y.; Queralt, A. |
local.citation.contributor | IEEE International Conference on Distributed Computing Systems |
local.citation.publicationName | 2019 39th IEEE International Conference on Distributed Computing Systems, ICDCS 2019: Richardson, Texas, United States, 7-9 July 2019: proceedings |
local.citation.startingPage | 1720 |
local.citation.endingPage | 1729 |