Multivariate Regression with Incremental Learning of Gaussian Mixture Models
Document typeConference report
Rights accessOpen Access
Within the machine learning framework, incremental learning of multivariate spaces is of special interest for on-line applications. In this work, the regression problem for multivariate systems is solved by implementing an efficient probabilistic incremental algorithm. It allows learning high-dimensional redundant non-linear maps by the cumulative acquisition of data from input-output systems. The proposed model is aimed at solving prediction and inference problems. The implementation introduced in this work allows learning from data batches without the need of keeping them in memory afterwards. The learning architecture is built using Incremental Gaussian Mixture Models. The Expectation-Maximization algorithm and general geometric properties of Gaussian distributions are used to train the models. Our current implementation can produce accurate results fitting models in real multivariate systems. Results are shown from testing the algorithm for both situations, one where the incremental learning is demonstrated and the second where the performance to solve the regression problem is evaluated on a toy example.
La publicació definitiva d'aquest treball està disponible a IOS Press a través de http://dx.doi.org/10.3233/978-1-61499-806-8-196
CitationAcevedo-Valle, J. M., Trejo, K., Angulo, C. Multivariate Regression with Incremental Learning of Gaussian Mixture Models. A: International Conference of the Catalan Association for Artificial Intelligence. "Recent Advances in Artificial Intelligence Research and Development: Proceedings of the 20th International Conference of the Catalan Association for Artificial Intelligence, Deltebre, Terres de l'Ebre, Spain, October 25–27, 2017". Deltebre: IOS Press, 2017, p. 196-205.