Now showing items 1-20 of 22

    • A programming model for hybrid workflows: combining task-based workflows and dataflows all-in-one 

      Ramón Cortés, Cristian; Lordan Gomis, Francesc; Ejarque Artigas, Jorge; Badia Sala, Rosa Maria (Elsevier, 2020-12)
      Article
      Open Access
      In the past years, e-Science applications have evolved from large-scale simulations executed in a single cluster to more complex workflows where these simulations are combined with High-Performance Data Analytics (HPDA). ...
    • A survey on the distributed computing stack 

      Ramón Cortés, Cristian; Alvarez Vecino, Pol; Lordan Gomis, Francesc; Álvarez Cid-Fuentes, Javier; Ejarque Artigas, Jorge; Badia Sala, Rosa Maria (Elsevier, 2021-11)
      Article
      Open Access
      In this paper, we review the background and the state of the art of the Distributed Computing software stack. We aim to provide the readers with a comprehensive overview of this area by supplying a detailed big-picture of ...
    • Accelerated execution via eager-release of dependencies in task-based workflows 

      Elshazly, Hatem Mohamed Abdelfattah Eid; Lordan Gomis, Francesc; Ejarque Artigas, Jorge; Badia Sala, Rosa Maria (Sage, 2021-07-01)
      Article
      Open Access
      Task-based programming models offer a flexible way to express the unstructured parallelism patterns of nowadays complex applications. This expressive capability is required to achieve maximum possible performance for ...
    • Automatic, efficient and scalable provenance registration for FAIR HPC workflows 

      Sirvent Pardell, Raül; Conejero Bañón, Francisco Javier; Lordan Gomis, Francesc; Ejarque Artigas, Jorge; Rodríguez Navas, Laura; Fernández González, José María; Capella Gutiérrez, Salvador; Badia Sala, Rosa Maria (Institute of Electrical and Electronics Engineers (IEEE), 2022)
      Conference report
      Open Access
      Provenance registration is becoming more and more important, as we increase the size and number of experiments performed using computers. In particular, when provenance is recorded in HPC environments, it must be efficient ...
    • Automatizing the creation of specialized high-performance computing containers 

      Ejarque Artigas, Jorge; Badia Sala, Rosa Maria (SAGE publishing, 2023-07)
      Article
      Open Access
      With Exascale computing already here, supercomputers are systems every time larger, more complex, and heterogeneous. While expert system administrators can install and deploy applications in the systems correctly, this is ...
    • AutoParallel: Automatic parallelisation and distributed execution of affine loop nests in Python 

      Ramón Cortés, Cristian; Amela Milian, Ramon; Ejarque Artigas, Jorge; Clauss, Philippe; Badia Sala, Rosa Maria (Sage, 2020)
      Article
      Open Access
      The last improvements in programming languages and models have focused on simplicity and abstraction; leading Python to the top of the list of the programming languages. However, there is still room for improvement when ...
    • Block size estimation for data partitioning in HPC applications using machine learning techniques 

      Cantini, Riccardo; Marozzo, Fabrizio; Orsino, Alessio; Talia, Domenico; Trunfio, Paolo; Badia Sala, Rosa Maria; Ejarque Artigas, Jorge; Vázquez-Novoa, Fernando (Springer Nature, 2024-01-16)
      Article
      Open Access
      The extensive use of HPC infrastructures and frameworks for running data-intensive applications has led to a growing interest in data partitioning techniques and strategies. In fact, application performance can be heavily ...
    • DDS: integrating data analytics transformations in task-based workflows [version 1; peer review: 1 approved, 2 approved with reservations] 

      Mammadli, Nihad; Ejarque Artigas, Jorge; Álvarez Cid-Fuentes, Javier; Badia Sala, Rosa Maria (2022-05-25)
      Article
      Open Access
      High-performance data analytics (HPDA) is a current trend in e-science research that aims to integrate traditional HPC with recent data analytic frameworks. Most of the work done in this field has focused on improving data ...
    • Dynamic resource allocation for efficient parallel CFD simulations 

      Houzeaux, Guillaume; Badia Sala, Rosa Maria; Borrell Pol, Ricard; Dosimont, Damien; Ejarque Artigas, Jorge; García Gasulla, Dario; López Herrero, Víctor (Elsevier, 2022-09-15)
      Article
      Restricted access - publisher's policy
      CFD users of supercomputers usually resort to rule-of-thumb methods to select the number of subdomains (partitions) when relying on MPI-based parallelization. One common approach is to set a minimum number of elements or ...
    • Enabling dynamic and intelligent workflows for HPC, data analytics, and AI convergence 

      Ejarque Artigas, Jorge; Badia Sala, Rosa Maria; Becerra Fontal, Yolanda; Rodrigo Berlín, Julián; Folch Duran, Arnau; Lordan Gomis, Francesc; Monterrubio Velasco, Marisol; de la Puente, Josep; Queralt Calafat, Anna; Rodríguez Rodríguez, Juan E.; Rossi, Riccardo (Elsevier, 2022-09)
      Article
      Restricted access - publisher's policy
      The evolution of High-Performance Computing (HPC) platforms enables the design and execution of progressively larger and more complex workflow applications in these systems. The complexity comes not only from the number ...
    • Enabling system wide shared memory for performance improvement in PyCOMPSs applications 

      Foyer, Clément; Conejero Bañón, Francisco Javier; Ejarque Artigas, Jorge; Badia Sala, Rosa Maria; Tate, Adrian; McIntosh-Smith, Simon (Institute of Electrical and Electronics Engineers (IEEE), 2020)
      Conference report
      Open Access
      Python has been gaining some traction for years in the world of scientific applications. However, the high-level abstraction it provides may not allow the developer to use the machines to their peak performance. To address ...
    • Energy-aware self-adaptation for application execution on heterogeneous parallel architectures 

      Kavanagh, Richard; Djemame, Karim; Ejarque Artigas, Jorge; Badia Sala, Rosa Maria; Garcia Perez, David (Institute of Electrical and Electronics Engineers (IEEE), 2020-01)
      Article
      Open Access
      Hardware in High Performance Computing environments in recent years have increasingly become more heterogeneous in order to improve computational performance. An additional aspect of such systems is the management of power ...
    • Heterogeneous hierarchical workflow composition 

      Yildiz, Orcun; Ejarque Artigas, Jorge; Chan, Henry; Sankaranarayanan, Subramanian; Badia Sala, Rosa Maria; Peterka, Tom (2019-07)
      Article
      Open Access
      Workflow systems promise scientists an automated end-to-end path from hypothesis to discovery. However, expecting any single workflow system to deliver such a wide range of capabilities is impractical. A more practical ...
    • Hierarchical management of extreme-scale task-based applications 

      Lordan Gomis, Francesc; Puigdemunt Schmolling, Gabriel; Vergés Boncompte, Pere; Conejero Bañón, Francisco Javier; Ejarque Artigas, Jorge; Badia Sala, Rosa Maria (Springer Cham, 2023)
      Conference report
      Restricted access - publisher's policy
      The scale and heterogeneity of exascale systems increment the complexity of programming applications exploiting them. Task-based approaches with support for nested tasks are a good-fitting model for them because of the ...
    • Performance meets programmabilty: Enabling native Python MPI tasks in PyCOMPSs 

      Elshazly, Hatem Mohamed Abdelfattah Eid; Lordan Gomis, Francesc; Ejarque Artigas, Jorge; Badia Sala, Rosa Maria (Institute of Electrical and Electronics Engineers (IEEE), 2020)
      Conference report
      Open Access
      The increasing complexity of modern and future computing systems makes it challenging to develop applications that aim for maximum performance. Hybrid parallel programming models offer new ways to exploit the capabilities ...
    • PyCOMPSs as an instrument for translational computer science 

      Badia Sala, Rosa Maria; Conejero Bañón, Francisco Javier; Ejarque Artigas, Jorge; Lezzi, Daniele; Lordan Gomis, Francesc (2022-03-01)
      Article
      Open Access
      With the advent of distributed computing, the need for frameworks that facilitate its programming and management has also appeared. These tools have typically been used to support the research on application areas that ...
    • Semantic resource management and interoperability between distributed computing platforms 

      Ejarque Artigas, Jorge (Universitat Politècnica de Catalunya, 2015-12-14)
      Doctoral thesis
      Open Access
      Distributed Computing is the paradigm where the application execution is distributed across different computers connected by a communication network. Distributed Computing platforms have evolved very fast during the las ...
    • Storage-heterogeneity aware task-based programming models to optimize I/O intensive applications 

      Elshazly, Hatem Mohamed Abdelfattah Eid; Ejarque Artigas, Jorge; Badia Sala, Rosa Maria (2022-12-01)
      Article
      Open Access
      Task-based programming models have enabled the optimized execution of the computation workloads of applications. These programming models can take advantage of large-scale distributed infrastructures by allowing the parallel ...
    • Task-level checkpointing system for task-based parallel workflows 

      Vergés Boncompte, Pere; Lordan Gomis, Francesc; Ejarque Artigas, Jorge; Badia Sala, Rosa Maria (Springer Nature, 2022)
      Conference report
      Restricted access - publisher's policy
      Scientific applications are large and complex; task-based programming models are a popular approach to developing these applications due to their ease of programming and ability to handle complex workflows and distribute ...
    • The BioExcel methodology for developing dynamic, scalable, reliable and portable computational biomolecular workflows 

      Ejarque Artigas, Jorge; Andrio Balado, Pau; Hospital Gasch, Adam; Conejero Bañón, Francisco Javier; Lezzi, Daniele; Badia Sala, Rosa Maria; Gelpi Buchaca, Josep Lluís (Institute of Electrical and Electronics Engineers (IEEE), 2022)
      Conference report
      Open Access
      Developing complex biomolecular workflows is not always straightforward. It requires tedious developments to enable the interoperability between the different biomolecular simulation and analysis tools. Moreover, the need ...