Mostra el registre d'ítem simple
Continual lifelong learning in natural language processing: a survey
dc.contributor.author | Biesialska, Magdalena Marta |
dc.contributor.author | Biesialska, Katarzyna |
dc.contributor.author | Ruiz Costa-Jussà, Marta |
dc.contributor.other | Universitat Politècnica de Catalunya. Doctorat en Teoria del Senyal i Comunicacions |
dc.contributor.other | Universitat Politècnica de Catalunya. Doctorat en Computació |
dc.contributor.other | Universitat Politècnica de Catalunya. Departament de Ciències de la Computació |
dc.date.accessioned | 2021-03-08T13:46:02Z |
dc.date.available | 2021-03-08T13:46:02Z |
dc.date.issued | 2020 |
dc.identifier.citation | Biesialska, M.; Biesialska, K.; Costa-jussà, M.R. Continual lifelong learning in natural language processing: a survey. A: International Conference on Computational Linguistics. "COLING 2020, The 28th International Conference on Computational Linguistics: December 8-13, 2020, Barcelona, Spain (online): proceedings of the conference". Stroudsburg, PA: Association for Computational Linguistics, 2020, p. 6523-6541. ISBN 978-1-952148-27-9. DOI 10.18653/v1/2020.coling-main.574. |
dc.identifier.isbn | 978-1-952148-27-9 |
dc.identifier.uri | http://hdl.handle.net/2117/341126 |
dc.description.abstract | Continual learning (CL) aims to enable information systems to learn from a continuous data stream across time. However, it is difficult for existing deep learning architectures to learn a new task without largely forgetting previously acquired knowledge. Furthermore, CL is particularly challenging for language learning, as natural language is ambiguous: it is discrete, compositional, and its meaning is context-dependent. In this work, we look at the problem of CL through the lens of various NLP tasks. Our survey discusses major challenges in CL and current methods applied in neural network models. We also provide a critical review of the existing CL evaluation methods and datasets in NLP. Finally, we present our outlook on future research directions. |
dc.description.sponsorship | This work is supported in part by the Catalan Agencia de Gestión de Ayudas Universitarias y de Investigación (AGAUR) through the FI PhD grant; the Spanish Ministerio de Ciencia e Innovación and by the Agencia Estatal de Investigación through the Ramón y Cajal grant and the project PCIN-2017-079; and by the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No. 947657). |
dc.format.extent | 19 p. |
dc.language.iso | eng |
dc.publisher | Association for Computational Linguistics |
dc.rights | Attribution 4.0 International |
dc.rights.uri | https://creativecommons.org/licenses/by/4.0/ |
dc.subject | Àrees temàtiques de la UPC::Informàtica::Intel·ligència artificial::Llenguatge natural |
dc.subject | Àrees temàtiques de la UPC::Informàtica::Intel·ligència artificial::Aprenentatge automàtic |
dc.subject.lcsh | Machine learning |
dc.subject.lcsh | Natural language processing (Computer science) |
dc.subject.other | Continual learning |
dc.subject.other | CL |
dc.subject.other | Deep learning |
dc.subject.other | Neural networks |
dc.title | Continual lifelong learning in natural language processing: a survey |
dc.type | Conference lecture |
dc.subject.lemac | Aprenentatge automàtic |
dc.subject.lemac | Tractament del llenguatge natural (Informàtica) |
dc.contributor.group | Universitat Politècnica de Catalunya. inSSIDE - integrated Software, Service, Information and Data Engineering |
dc.contributor.group | Universitat Politècnica de Catalunya. VEU - Grup de Tractament de la Parla |
dc.identifier.doi | 10.18653/v1/2020.coling-main.574 |
dc.description.peerreviewed | Peer Reviewed |
dc.relation.publisherversion | https://www.aclweb.org/anthology/2020.coling-main.574/ |
dc.rights.access | Open Access |
local.identifier.drac | 30613195 |
dc.description.version | Postprint (published version) |
dc.relation.projectid | info:eu-repo/grantAgreement/EC/H2020/947657/EU/Lifelong UNiversal lAnguage Representation/LUNAR |
dc.relation.projectid | info:eu-repo/grantAgreement/AEI/Plan Estatal de Investigación Científica y Técnica y de Innovación (PEICTI) 2013-2016/PCIN-2017-079/ES/AUTONOMOUS LIFELONG LEARNING INTELLIGENT SYSTEMS/ |
local.citation.author | Biesialska, M.; Biesialska, K.; Costa-jussà, M. R. |
local.citation.contributor | International Conference on Computational Linguistics |
local.citation.pubplace | Stroudsburg, PA |
local.citation.publicationName | COLING 2020, The 28th International Conference on Computational Linguistics: December 8-13, 2020, Barcelona, Spain (online): proceedings of the conference |
local.citation.startingPage | 6523 |
local.citation.endingPage | 6541 |