Mostra el registre d'ítem simple
ALOJA: a systematic study of Hadoop deployment variables to enable automated characterization of cost-effectiveness
dc.contributor.author | Poggi Mastrokalo, Nicolas |
dc.contributor.author | Carrera Pérez, David |
dc.contributor.author | Call, Aaron |
dc.contributor.author | Mendoza, Sergio |
dc.contributor.author | Becerra Fontal, Yolanda |
dc.contributor.author | Torres Viñals, Jordi |
dc.contributor.author | Ayguadé Parra, Eduard |
dc.contributor.author | Gagliardi, Fabrizio |
dc.contributor.author | Labarta Mancho, Jesús José |
dc.contributor.author | Reinauer, Rob |
dc.contributor.author | Vujic, Nikola |
dc.contributor.author | Green, Daron |
dc.contributor.author | Blakeley, Jose |
dc.contributor.other | Universitat Politècnica de Catalunya. Departament d'Arquitectura de Computadors |
dc.contributor.other | Barcelona Supercomputing Center |
dc.date.accessioned | 2015-06-03T07:19:10Z |
dc.date.available | 2015-06-03T07:19:10Z |
dc.date.created | 2014 |
dc.date.issued | 2014 |
dc.identifier.citation | Poggi, N. [et al.]. ALOJA: a systematic study of Hadoop deployment variables to enable automated characterization of cost-effectiveness. A: IEEE International Conference on Big Data. "2014 IEEE International Conference on Big Data: 27-30 October 2014, Washington DC, USA: proceedings". Washington DC: Institute of Electrical and Electronics Engineers (IEEE), 2014, p. 905-913. |
dc.identifier.isbn | 978-1-4799-5665-4 |
dc.identifier.uri | http://hdl.handle.net/2117/28152 |
dc.description.abstract | This article presents the ALOJA project, an initiative to produce mechanisms for an automated characterization of cost-effectiveness of Hadoop deployments and reports its initial results. ALOJA is the latest phase of a long-term collaborative engagement between BSC and Microsoft which, over the past 6 years has explored a range of different aspects of computing systems, software technologies and performance profiling. While during the last 5 years, Hadoop has become the de-facto platform for Big Data deployments, still little is understood of how the different layers of the software and hardware deployment options affects its performance. Early ALOJA results show that Hadoop's runtime performance, and therefore its price, are critically affected by relatively simple software and hardware configuration choices e.g., number of mappers, compression, or volume configuration. Project ALOJA presents a vendor-neutral repository featuring over 5000 Hadoop runs, a test bed, and tools to evaluate the cost-effectiveness of different hardware, parameter tuning, and Cloud services for Hadoop. As few organizations have the time or performance profiling expertise, we expect our growing repository will benefit Hadoop customers to meet their Big Data application needs. ALOJA seeks to provide both knowledge and an online service to with which users make better informed configuration choices for their Hadoop compute infrastructure whether this be on-premise or cloud-based. The initial version of ALOJA's Web application and sources are available at http://hadoop.bsc.es. |
dc.description.sponsorship | This work is partially supported by the Ministry of Science and Technology of Spain under contracts TIN2012-34557 and 2014SGR1051. |
dc.format.extent | 9 p. |
dc.language.iso | eng |
dc.publisher | Institute of Electrical and Electronics Engineers (IEEE) |
dc.subject | Àrees temàtiques de la UPC::Informàtica::Arquitectura de computadors::Arquitectures paral·leles |
dc.subject.lcsh | Big data |
dc.subject.lcsh | Cloud computing |
dc.subject.lcsh | Parallel processing (Electronic computers) |
dc.title | ALOJA: a systematic study of Hadoop deployment variables to enable automated characterization of cost-effectiveness |
dc.type | Conference report |
dc.subject.lemac | Macrodades |
dc.subject.lemac | Computació en núvol |
dc.subject.lemac | Processament en paral·lel (Ordinadors) |
dc.contributor.group | Universitat Politècnica de Catalunya. CAP - Grup de Computació d'Altes Prestacions |
dc.identifier.doi | 10.1109/BigData.2014.7004322 |
dc.description.peerreviewed | Peer Reviewed |
dc.relation.publisherversion | http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=7004322 |
dc.rights.access | Open Access |
local.identifier.drac | 15626111 |
dc.description.version | Postprint (author’s final draft) |
local.citation.author | Poggi, N.; Carrera, D.; Call, A.; Mendoza, S.; Becerra, Y.; Torres, J.; Ayguade, E.; Gagliardi, F.; Labarta, J.; Reinauer, R.; Vujic, N.; Green, D.; Blakeley, J. |
local.citation.contributor | IEEE International Conference on Big Data |
local.citation.pubplace | Washington DC |
local.citation.publicationName | 2014 IEEE International Conference on Big Data: 27-30 October 2014, Washington DC, USA: proceedings |
local.citation.startingPage | 905 |
local.citation.endingPage | 913 |