Prediction of the impact of network switch utilization on application performance via active measurement
10.1016/j.parco.2017.06.005
Inclou dades d'ús des de 2022
Cita com:
hdl:2117/107213
Tipus de documentArticle
Data publicació2017-09
EditorElsevier
Condicions d'accésAccés obert
Llevat que s'hi indiqui el contrari, els
continguts d'aquesta obra estan subjectes a la llicència de Creative Commons
:
Reconeixement-NoComercial-SenseObraDerivada 3.0 Espanya
Abstract
Although one of the key characteristics of High Performance Computing (HPC) infrastructures are their fast interconnecting networks, the increasingly large computational capacity of HPC nodes and the subsequent growth of data exchanges between them constitute a potential performance bottleneck. To achieve high performance in parallel executions despite network limitations, application developers require tools to measure their codes’ network utilization and to correlate the network’s communication capacity with the performance of their applications.
This paper presents a new methodology to measure and understand network behavior. The approach is based in two different techniques that inject extra network communication. The first technique aims to measure the fraction of the network that is utilized by a software component (an application or an individual task) to determine the existence and severity of network contention. The second injects large amounts of network traffic to study how applications behave on less capable or fully utilized networks. The measurements obtained by these techniques are combined to predict the performance slowdown suffered by a particular software component when it shares the network with others. Predictions are obtained by considering several training sets that use raw data from the two measurement techniques. The sensitivity of the training set size is evaluated by considering 12 different scenarios. Our results find the optimum training set size to be around 200 training points. When optimal data sets are used, the proposed methodology provides predictions with an average error of 9.6% considering 36 scenarios.
CitacióCasas, M.; Bronevetsky, G. Prediction of the impact of network switch utilization on application performance via active measurement. "Parallel Computing", Setembre 2017, vol. 67, p. 38-56.
ISSN0167-8191
Versió de l'editorhttp://www.sciencedirect.com/science/article/pii/S016781911730090X
Col·leccions
Fitxers | Descripció | Mida | Format | Visualitza |
---|---|---|---|---|
Prediction of t ... ork Switch Utilization.pdf | 2,925Mb | Visualitza/Obre |