Show simple item record

dc.contributor.authorBaig, Shuja-ur-Rehman
dc.contributor.authorIqbal, Waheed
dc.contributor.authorBerral García, Josep Lluís
dc.contributor.authorErradi, Abdelkarim
dc.contributor.authorCarrera Pérez, David
dc.contributor.otherUniversitat Politècnica de Catalunya. Departament d'Arquitectura de Computadors
dc.contributor.otherBarcelona Supercomputing Center
dc.date.accessioned2020-05-05T12:33:26Z
dc.date.available2020-05-05T12:33:26Z
dc.date.issued2019-12
dc.identifier.citationBaig, S. [et al.]. Real-time data center's telemetry reduction and reconstruction using Markov chain models. "IEEE systems journal", Desembre 2019, vol. 13, núm. 4, p. 4039-4050.
dc.identifier.issn1932-8184
dc.identifier.urihttp://hdl.handle.net/2117/186371
dc.description.abstractLarge-scale data centers are composed of thousands of servers organized in interconnected racks to offer services to users. These data centers continuously generate large amounts of telemetry data streams (e.g., hardware utilization metrics) used for multiple purposes, including resource management, workload characterization, resource utilization prediction, capacity planning, and real-time analytics. These telemetry streams require costly bandwidth utilization and storage space, particularly at medium-long term for large data centers. This paper addresses this problem by proposing and evaluating a system to efficiently reduce bandwidth and storage for telemetry data through real-time modeling using Markov chain based methods. Our proposed solution was evaluated using real telemetry datasets and compared with polynomial regression methods for reducing and reconstructing data. Experimental results show that data can be lossy compressed up to 75% for bandwidth utilization and 95.33% for storage space, with reconstruction accuracy close to 92%.
dc.description.sponsorshipThis work was supported in part by the European Research Council (ERC) under the EU Horizon 2020 programme under Grant GA 639595, in part by the Spanish Ministry of Economy, Industry and Competitiveness under Grant TIN2015-65316-P and Grant IJCI2016-27485, in part by the Generalitat de Catalunya under Grant 2014-SGR-1051, in part by the University of the Punjab, Pakistan, and in part by the Qatar National Research Fund (a member of Qatar Foundation) under NPRP Grant # NPRP9-224-1-049.
dc.format.extent12 p.
dc.language.isoeng
dc.subjectÀrees temàtiques de la UPC::Informàtica::Arquitectura de computadors
dc.subject.lcshReal-time data processing
dc.subject.lcshMarkov processes
dc.subject.lcshData processing service centers
dc.subject.otherData center monitoring
dc.subject.otherData reconstruction
dc.subject.otherData reduction
dc.subject.otherMarkov chain models (MMs)
dc.subject.otherPolynomial regression (PR)
dc.subject.otherTelemetry
dc.titleReal-time data center's telemetry reduction and reconstruction using Markov chain models
dc.typeArticle
dc.subject.lemacTemps real (Informàtica)
dc.subject.lemacMarkov, Processos de
dc.subject.lemacCentres informàtics
dc.contributor.groupUniversitat Politècnica de Catalunya. CAP - Grup de Computació d'Altes Prestacions
dc.identifier.doi10.1109/JSYST.2019.2918430
dc.description.peerreviewedPeer Reviewed
dc.relation.publisherversionhttps://ieeexplore.ieee.org/document/8734756
dc.rights.accessOpen Access
local.identifier.drac28083974
dc.description.versionPostprint (author's final draft)
dc.relation.projectidinfo:eu-repo/grantAgreement/EC/H2020/639595/EU/Holistic Integration of Emerging Supercomputing Technologies/Hi-EST
dc.relation.projectidinfo:eu-repo/grantAgreement/MINECO//TIN2015-65316-P/ES/COMPUTACION DE ALTAS PRESTACIONES VII/
dc.relation.projectidinfo:eu-repo/grantAgreement/AGAUR/V PRI/2014 SGR 1051
dc.relation.projectidinfo:eu-repo/grantAgreement/MINECO/1PE/IJCI-2016-27485
local.citation.authorBaig, S.; Iqbal, W.; Berral, J.; Erradi, A.; Carrera, D.
local.citation.publicationNameIEEE systems journal
local.citation.volume13
local.citation.number4
local.citation.startingPage4039
local.citation.endingPage4050


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record