Final master project developed in Barcelona Supercomputing Centre. This project focuses on the virtualization of Hadoop environments and the design of a piece of software for automatizing the configuration of the shared resources for Hadoop environments. In addition, this project uses a modified internal Hadoop scheduler that adapts the available resources in the cluster for running jobs according to time restrictions. With the adapted internal scheduler and the virtualization capabilities the software developed in this project provides a flexible and self-adaptive service for Hadoop enviroments. In this report I introduce the context of the technology, the specifications of the system, the design of the solution integrated with EMOTIVE Cloud platform and the testing for showing the performance of the product.
All rights reserved. This work is protected by the corresponding intellectual and industrial property rights. Without prejudice to any existing legal exemptions, reproduction, distribution, public communication or transformation of this work are prohibited without permission of the copyright holder. If you wish to make any use of the work not provided for in the law, please contact: firstname.lastname@example.org