Exploring interconnect energy savings under East-West traffic pattern of MapReduce clusters
Document typeConference report
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Rights accessOpen Access
European Commission's projectEUROSERVER - Green Computing Node for European micro-servers (EC-FP7-610456)
An important challenge of modern data centers is to reduce energy consumption, of which a substantial proportion is due to the network. Energy Efficient Ethernet (EEE) is a recent standard that aims to reduce network power consumption, but current practice is to disable it in production use, since it has a poorly understood impact on real world application performance. An important application framework commonly used in modern data centers is Apache Hadoop, which implements the MapReduce programming model. This paper is the first to analyse the impact of EEE on MapReduce workloads, in terms of performance overheads and energy savings. We find that optimum energy savings are possible if the links use packet coalescing. Packet coalescing must, however, be carefully configured in order to avoid excessive performance degradation.
CitationFischer e Silva, Renan; Carpenter, Paul M. Exploring interconnect energy savings under East-West traffic pattern of MapReduce clusters. A: 2015 IEEE 40th Conference on Local Computer Networks (LCN), Clearwater Beach, FL, 26-29 Oct. 2015. "Local Computer Networks (LCN), 2015 IEEE 40th Conference on". Institute of Electrical and Electronics Engineers (IEEE), 2015, p. 10-18.
All rights reserved. This work is protected by the corresponding intellectual and industrial property rights. Without prejudice to any existing legal exemptions, reproduction, distribution, public communication or transformation of this work are prohibited without permission of the copyright holder