An evolutionary approach to constraint-regularized learning

Abstract

The success of machine learning methods for inducing models from data crucially depends on the proper incorporation of background knowledge about the model to be learned. The idea of constraint-regularized learning is to em- ploy fuzzy set-based modeling techniques in order to express such knowl- edge in a flexible way, and to formalize it in terms of fuzzy constraints. Thus, background knowledge can be used to appropriately bias the learn- ing process within the regularization framework of inductive inference. After a brief review of this idea, the paper offers an operationalization of constraint- regularized learning. The corresponding framework is based on evolutionary methods for model optimization and employs fuzzy rule bases of the Takagi- Sugeno type as flexible function approximators.