Automatic Generation of Workload Profiles Using Unsupervised Learning Pipelines
Tipo de documentoArtículo
Fecha de publicación2018-03
Condiciones de accesoAcceso abierto
Proyecto de la Comisión EuropeaHi-EST - Holistic Integration of Emerging Supercomputing Technologies (EC-H2020-639595)
The complexity of resource usage and power consumption on cloud-based applications makes the understanding of application behavior through expert examination difficult. The difficulty increases when applications are seen as “black boxes,” where only external monitoring can be retrieved. Furthermore, given the different amount of scenarios and applications, automation is required. Here, we examine and model application behavior by finding behavior phases. We use conditional restricted Boltzmann machines (CRBMs) to model time-series containing resources traces measurements like CPU, memory, and IO. CRBMs can be used to map a given historic window of trace behavior into a single vector. This low dimensional and time-aware vector can be passed through clustering methods, from simplistic ones like k -means to more complex ones like those based on hidden Markov models. We use these methods to find phases of similar behavior in the workloads. Our experimental evaluation shows that the proposed method is able to identify different phases of resource consumption across different workloads. We show that the distinct phases contain specific resource patterns that distinguish them.
CitaciónBuchaca Prats, D.; Berral, J. L.; Carrera, D. Automatic Generation of Workload Profiles Using Unsupervised Learning Pipelines. "IEEE Transactions on Network and Service Management", Març 2018, vol. 15, núm. 1, p. 142-155.
Versión del editorhttp://ieeexplore.ieee.org/document/8240924/