Energy Efficient Ethernet on MapReduce Clusters: Packet Coalescing To Improve 10GbE Links
Visualitza/Obre
Cita com:
hdl:2117/110155
Tipus de documentArticle
Data publicació2017-10
EditorIEEE
Condicions d'accésAccés obert
Llevat que s'hi indiqui el contrari, els
continguts d'aquesta obra estan subjectes a la llicència de Creative Commons
:
Reconeixement-NoComercial-SenseObraDerivada 3.0 Espanya
ProjecteEUROSERVER - Green Computing Node for European micro-servers (EC-FP7-610456)
COMPUTACION DE ALTAS PRESTACIONES VII (MINECO-TIN2015-65316-P)
COMPUTACION DE ALTAS PRESTACIONES VII (MINECO-TIN2015-65316-P)
Abstract
An important challenge of modern data centers is to reduce energy consumption, of which a substantial proportion is due to the network. Switches and NICs supporting the recent energy efficient Ethernet (EEE) standard are now available, but current practice is to disable EEE in production use, since its effect on real world application performance is poorly understood. This paper contributes to this discussion by analyzing the impact of EEE on MapReduce workloads, in terms of performance overheads and energy savings. MapReduce is the central programming model of Apache Hadoop, one of the most widely used application frameworks in modern data centers. We find that, while 1GbE links (edge links) achieve good energy savings using the standard EEE implementation, optimum energy savings in the 10 GbE links (aggregation and core links) are only possible, if these links employ packet coalescing. Packet coalescing must, however, be carefully configured in order to avoid excessive performance degradation. With our new analysis of how the static parameters of packet coalescing perform under different cluster loads, we were able to cover both idle and heavy load periods that can exist on this type of environment. Finally, we evaluate our recommendation for packet coalescing for 10 GbE links using the energy-delay metric. This paper is an extension of our previous work [1], which was published in the Proceedings of the 40th Annual IEEE Conference on Local Computer Networks (LCN 2015).
CitacióFischer e Silva, R.; Carpenter, P. M. Energy Efficient Ethernet on MapReduce Clusters: Packet Coalescing To Improve 10GbE Links. "IEEE/ACM Transactions on Networking", Octubre 2017, vol. 25, núm. 5, p. 2731-2742.
ISSN1063-6692
Versió de l'editorhttp://ieeexplore.ieee.org/document/7945287/
Col·leccions
Fitxers | Descripció | Mida | Format | Visualitza |
---|---|---|---|---|
Energy Efficien ... on MapReduce Clusters.pdf | 1,466Mb | Visualitza/Obre |