Segmentation strategies to face morphology challenges in Brazilian-Portuguese/English statistical machine translation and its integration in cross-language information retrieval
Visualitza/Obre
Cita com:
hdl:2117/81165
Tipus de documentArticle
Data publicació2015-06-01
Condicions d'accésAccés obert
Llevat que s'hi indiqui el contrari, els
continguts d'aquesta obra estan subjectes a la llicència de Creative Commons
:
Reconeixement 3.0 Espanya
Abstract
The use of morphology is particularly interesting in the context of statistical machine translation in order to reduce data sparseness and compensate any lack of training corpus. In this work, we propose several approaches to introduce morphology knowledge into a standard phrase-based machine translation system. We provide word segmentation using two different tools
(COGROO and MORFESSOR) which allow to reduce the vocabulary and data sparseness. Then, we add to these segmentations the morphological information of a POS language model. We combine all these approaches using a Minimum Bayes Risk strategy. Experiments show significant improvements from the enhanced system over the baseline system on Brazilian Portuguese/English language pair. Finally, we report a case study about the impact of enhancing the statistical machine translation system with morphology in a cross-language application system such as ONAIR
which allows users to look for information in video fragments through queries in natural language.
CitacióCosta-jussà, M. R. Segmentation strategies to face morphology challenges in Brazilian-Portuguese/English statistical machine translation and its integration in cross-language information retrieval. "Computacion y sistemas", 01 Juny 2015, vol. 19, núm. 2, p. 357-370.
ISSN2007-9737
Col·leccions
Fitxers | Descripció | Mida | Format | Visualitza |
---|---|---|---|---|
morphologypten-v2.pdf | 254,5Kb | Visualitza/Obre |