Show simple item record

dc.contributor.authorRomero Merino, Enrique
dc.contributor.authorMàrquez Villodre, Lluís
dc.contributor.authorCarreras Pérez, Xavier
dc.contributor.otherUniversitat Politècnica de Catalunya. Departament de Ciències de la Computació
dc.identifier.citationRomero, E., Marquez, L., Carreras, X. "Margin maximization with feed-forward neural networks: a comparative study with support vector machines and AdaBoost". 2003.
dc.description.abstractFeed-forward Neural Networks (FNN) and Support Vector Machines (SVM) are two machine learning frameworks developed from very different starting points of view. In this work a new learning model for FNN is proposed such that, in the linearly separable case, it tends to obtain the same solution as SVM. The key idea of the model is a weighting of the sum-of-squares error function, which is inspired by the AdaBoost algorithm. As in SVM, the hardness of the margin can be controlled, so that this model can be also used for the non-linearly separable case. In addition, it is not restricted to the use of kernel functions, and it allows to deal with multiclass and multilabel problems as FNN usually do. Finally, it is independent of the particular algorithm used to minimize the error function. Theoretic and experimental results, on synthetic and real-world problems, are shown to confirm these claims. Several empirical comparisons among this new model, SVM and AdaBoost have been made in order to study the agreement between the predictions made by the respective classifiers. The results obtained show that similar performance does not imply similar predictions, suggesting that different models can be combined leading to better performance.
dc.format.extent35 p.
dc.subjectÀrees temàtiques de la UPC::Informàtica::Intel·ligència artificial
dc.subject.otherFeed-forward neural networks
dc.subject.otherSupport vector machines
dc.titleMargin maximization with feed-forward neural networks: a comparative study with support vector machines and AdaBoost
dc.typeExternal research report
dc.contributor.groupUniversitat Politècnica de Catalunya. GPLN - Grup de Processament del Llenguatge Natural
dc.contributor.groupUniversitat Politècnica de Catalunya. SOCO - Soft Computing
dc.rights.accessOpen Access
dc.description.versionPostprint (published version)
local.citation.authorRomero, E.; Marquez, L.; Carreras, X.

Files in this item


This item appears in the following Collection(s)

Show simple item record

All rights reserved. This work is protected by the corresponding intellectual and industrial property rights. Without prejudice to any existing legal exemptions, reproduction, distribution, public communication or transformation of this work are prohibited without permission of the copyright holder