SemEval-2007 Task 16: evaluation of wide coverage knowledge resources
Document typeConference report
PublisherAssociation for Computational Linguistics
Rights accessOpen Access
All rights reserved. This work is protected by the corresponding intellectual and industrial property rights. Without prejudice to any existing legal exemptions, reproduction, distribution, public communication or transformation of this work are prohibited without permission of the copyright holder
This task tries to establish the relative quality of available semantic resources (derived by manual or automatic means). The quality of each large-scale knowledge resource is indirectly evaluated on a Word Sense Disambiguation task. In particular, we use Senseval-3 and SemEval-2007 English Lexical Sample tasks as evaluation bechmarks to evaluate the relative quality of each resource. Furthermore, trying to be as neutral as possible with respect the knowledge bases studied, we apply systematically the same disambiguation method to all the resources. A completely different behaviour is observed on both lexical data sets (Senseval-3 and SemEval-2007).
CitationCuadros, M.; Rigau, G. SemEval-2007 Task 16: evaluation of wide coverage knowledge resources. A: International Workshop on Semantic Evaluations. "Fourth International Workshop on Semantic Evaluations". Praga: Association for Computational Linguistics, 2007, p. 1-6.