Performance comparison of multi-container deployment schemes for HPC workloads: an empirical study
Visualitza/Obre
Cita com:
hdl:2117/334383
Tipus de documentArticle
Data publicació2021-06
Condicions d'accésAccés obert
Tots els drets reservats. Aquesta obra està protegida pels drets de propietat intel·lectual i
industrial corresponents. Sense perjudici de les exempcions legals existents, queda prohibida la seva
reproducció, distribució, comunicació pública o transformació sense l'autorització del titular dels drets
Abstract
The high-performance computing (HPC) community has recently started to use containerization to obtain fast, customized, portable, flexible, and reproducible deployments of their workloads. Previous work showed that deploying an HPC workload into a single container can keep bare-metal performance. However, there is a lack of research on multi-container deployments that partition the processes belonging to each application into different containers. Partitioning HPC applications has shown to improve their performance on virtual machines by allowing to set affinity to a non-uniform memory access (NUMA) domain for each of them. Consequently, it is essential to understand the performance implications of distinct multi-container deployment schemes for HPC workloads, focusing on the impact of the container granularity and its combination with processor and memory affinity. This paper presents a systematic performance comparison and analysis of multi-container deployment schemes for HPC workloads on a single-node platform, which considers different containerization technologies (including Docker and Singularity), two different platform architectures (UMA and NUMA), and two application subscription modes (exact subscription and over-subscription). Our results indicate that finer-grained multi-container deployments, on the one side, can benefit the performance of some applications with low interprocess communication, especially in over-subscribed scenarios and when combined with affinity, but, on the other side, they can incur some performance degradation for communication-intensive applications when using containerization technologies that deploy isolated network namespaces.
CitacióLiu, P.; Guitart, J. Performance comparison of multi-container deployment schemes for HPC workloads: an empirical study. "Journal of supercomputing", Juny 2021, vol. 77, núm. 6, p. 6273-6312.
ISSN0920-8542
Versió de l'editorhttps://link.springer.com/article/10.1007/s11227-020-03518-1
Fitxers | Descripció | Mida | Format | Visualitza |
---|---|---|---|---|
JSUP-revision-nocomments.pdf | 1,286Mb | Visualitza/Obre |