Heterogeneous programming using OpenMP and CUDA/HIP for hybrid CPU-GPU scientific applications
Visualitza/Obre
Cita com:
hdl:2117/395515
Tipus de documentArticle
Data publicació2023-01-01
EditorSAGE publishing
Condicions d'accésAccés obert
Tots els drets reservats. Aquesta obra està protegida pels drets de propietat intel·lectual i
industrial corresponents. Sense perjudici de les exempcions legals existents, queda prohibida la seva
reproducció, distribució, comunicació pública o transformació sense l'autorització del titular dels drets
Abstract
Hybrid computer systems combine compute units (CUs) of different nature like CPUs, GPUs and FPGAs. Simultaneously exploiting the computing power of these CUs requires a careful decomposition of the applications into balanced parallel tasks according to both the performance of each CU type and the communication costs among them. This paper describes the design and implementation of runtime support for OpenMP hybrid GPU-CPU applications, when mixed with GPU-oriented programming models (e.g. CUDA/HIP). The paper describes the case for a hybrid multi-level parallelization of the NPB-MZ benchmark suite. The implementation exploits both coarse-grain and fine-grain parallelism, mapped to compute units of different nature (GPUs and CPUs). The paper describes the implementation of runtime support to bridge OpenMP and HIP, introducing the abstractions of Computing Unit and Data Placement. We compare hybrid and non-hybrid executions under state-of-the-art schedulers for OpenMP: static and dynamic task schedulings. Then, we improve the set of schedulers with two additional variants: a memorizing-dynamic task scheduling and a profile-based static task scheduling. On a computing node composed of one AMD EPYC 7742 @ 2.250 GHz (64 cores and 2 threads/core, totalling 128 threads per node) and 2 × GPU AMD Radeon Instinct MI50 with 32 GB, hybrid executions present speedups from 1.10× up to 3.5× with respect to a non-hybrid GPU implementation, depending on the number of activated CUs.
CitacióGonzalez, M.; Morancho, E. Heterogeneous programming using OpenMP and CUDA/HIP for hybrid CPU-GPU scientific applications. "The international journal of high performance computing applications (IJHPCA)", 1 Gener 2023, vol. 37, núm. 5, p. 626-646.
ISSN1741-2846
Versió de l'editorhttps://journals.sagepub.com/doi/10.1177/10943420231188079
Col·leccions
Fitxers | Descripció | Mida | Format | Visualitza |
---|---|---|---|---|
ijhpca2022_Runtime.pdf | 545,7Kb | Visualitza/Obre |