Holaaa!! Writin like u talk is kewl but kinda hard 4 NLP
Visualitza/Obre
Estadístiques de LA Referencia / Recolecta
Inclou dades d'ús des de 2022
Cita com:
hdl:2117/102469
Tipus de documentComunicació de congrés
Data publicació2012
Condicions d'accésAccés obert
Llevat que s'hi indiqui el contrari, els
continguts d'aquesta obra estan subjectes a la llicència de Creative Commons
:
Reconeixement-NoComercial-SenseObraDerivada 3.0 Espanya
Abstract
We present work in progress aiming to build tools for the normalization of User-Generated Content (UGC). As we will see, the task requires the revisiting of the initial steps of NLP processing, since UGC (micro-blog, blog, and, generally, Web 2.0 user texts) presents a number of non-standard communicative and linguistic characteristics, and is in fact much closer to oral and colloquial language than to edited text. We present and characterize a corpus of UGC text in Spanish from three different sources: Twitter, consumer reviews and blogs. We motivate the need for UGC text normalization by analyzing the problems found when processing this type of text through a conventional language processing pipeline, particularly in the tasks of lemmatization and morphosyntactic tagging, and finally we propose a strategy for automatically normalizing UGC using a selector of correct forms on top of a pre-existing spell-checker.
CitacióMelero, M., Ruiz, M., Domingo, J., Marquina, M., Quixal, M. Holaaa!! Writin like u talk is kewl but kinda hard 4 NLP. A: International Conference on Language Resources and Evaluation. "Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC'12)". Istanbul: 2012, p. 3794-3800.
ISBN978-2-9517408-7-7
Versió de l'editorhttp://www.lrec-conf.org/proceedings/lrec2012/index.html
Fitxers | Descripció | Mida | Format | Visualitza |
---|---|---|---|---|
lrec2.pdf | 480,0Kb | Visualitza/Obre |