L'àmbit de recerca del grup 'VEU' és el tractament de la parla. Investiguem tecnologies que permeten l'extracció d'informació que la veu conté: reconeixement del que es diu, l'idioma o el dialecte, característiques del parlant -qui és, la seva edat, el sexe, l'estat emocional-, la direcció del so. També treballem en la caracterització general de l'àudio, per determinar quan hi ha veu i quan hi ha altres esdeveniments acústics com música o sorolls diversos. Les tecnologies de la parla possibiliten generar veu -síntesis de veu- o modificar les seves

Recent Submissions

  • Wav2Pix: speech-conditioned face generation using generative adversarial networks 

    Cardoso Duarte, Amanda; Roldan, Francisco; Tubau, Miquel; Escur, Janna; Pascual de la Puente, Santiago; Salvador Aguilera, Amaia; Mohedano, Eva; McGuinness, Kevin; Torres Viñals, Jordi; Giró Nieto, Xavier (Institute of Electrical and Electronics Engineers (IEEE), 2019)
    Conference lecture
    Restricted access - publisher's policy
    Speech is a rich biometric signal that contains information about the identity, gender and emotional state of the speaker. In this work, we explore its potential to generate face images of a speaker by conditioning a ...
  • Chinese-Catalan: A neural machine translation approach based on pivoting and attention mechanisms 

    Ruiz Costa-Jussà, Marta; Casas Manzanares, Noé; Escolano Peinado, Carlos; Rodríguez Fonollosa, José Adrián (2019-01-01)
    Article
    Open Access
    This article innovatively addresses machine translation from Chinese to Catalan using neural pivot strategies trained without any direct parallel data. The Catalan language is very similar to Spanish from a linguistic point ...
  • Unemployment expectations: A socio-demographic analysis of the effect of news 

    Soric, Petar; Lolic, Ivana; Claveria González, Oscar; Monte Moreno, Enrique; Torra Porras, Salvador (2019-10-01)
    Article
    Restricted access - publisher's policy
    In this study, we evaluate the effect of news on consumer unemployment expectations for sixteen socio-demographic groups. To this end, we construct an unemployment sentiment indicator and extract news about several economic ...
  • Corpus for cyberbullying prevention 

    Moreno Bilbao, M. Asunción; Bonafonte Cávez, Antonio; Jauk, Igor; Tarrés, Laia; Pereira, Victor (International Speech Communication Association (ISCA), 2018)
    Conference report
    Open Access
    Cyberbullying is the use of digital media to harass a person or group of people, through personal attacks, disclosure of confidential or false information, among other means. That is to say, it ...
  • Incorporation of acoustic sensors in the regulation of a mobile robot 

    Luna Aguilar, Christian Alejandro; Morales Diaz, América; Castelán, Mario; Nadeu Camprubí, Climent (2019-01-17)
    Article
    Restricted access - publisher's policy
    This article introduces the incorporation of acoustic sensors for the localization of a mobile robot. The robot is considered as a sound source and its position is located applying a Time Delay of Arrival (TDOA) method. ...
  • UPC multimodal speaker diarization system for the 2018 Albayzin challenge 

    India Massana, Miquel Àngel; Sagastiberri, Itziar; Palau Puigdevall, Ponç; Sayrol Clols, Elisa; Morros Rubió, Josep Ramon; Hernando Pericás, Francisco Javier (International Speech Communication Association (ISCA), 2018)
    Conference report
    Open Access
    This paper presents the UPC system proposed for the Multimodal Speaker Diarization task of the 2018 Albayzin Challenge. This approach works by processing individually the speech and the image signal. In the speech domain, ...
  • Restricted Boltzmann Machine vectors for speaker clustering 

    Khan, Umair; Safari, Pooyan; Hernando Pericás, Francisco Javier (International Speech Communication Association (ISCA), 2018)
    Conference lecture
    Open Access
    Restricted Boltzmann Machines (RBMs) have been used both in the front-end and backend of speaker verification systems. In this work, we apply RBMs as a front-end in the context of speaker clustering. Speakers' utterances ...
  • Knowledge sharing in the health scenario 

    LLuch Ariet, Magi; Brugues de la Torre, Albert; Vallverdú Bayés, Sisco; Pegueroles Vallés, Josep R. (2014-11-28)
    Article
    Open Access
    The understanding of certain data often requires the collection of similar data from different places to be analysed and interpreted. Interoperability standards and ontologies, are facilitating data interchange around the ...
  • End-to-end speech translation with the transformer 

    Cross Vila, Laura; Escolano Peinado, Carlos; Rodríguez Fonollosa, José Adrián; Ruiz Costa-Jussà, Marta (Antonio Bonafonte, Jordi Luque and Francesc Alías Pujol, 2018)
    Conference lecture
    Restricted access - publisher's policy
    Speech Translation has been traditionally addressed with the concatenation of two tasks: Speech Recognition and Machine Translation. This approach has the main drawback that errors are concatenated. Recently, neural ...
  • The TALP-UPC machine translation systems for WMT18 news translation shared task 

    Casas, Noe; Escolano Peinado, Carlos; Ruiz Costa-Jussà, Marta; Rodríguez Fonollosa, José Adrián (Association for Computational Linguistics, 2018)
    Conference lecture
    Restricted access - publisher's policy
    In this article we describe the TALP-UPC research group participation in the WMT18 news shared translation task for FinnishEnglish and Estonian-English within the multi-lingual subtrack. All of our primary submissions ...
  • Neural machine translation with the transformer and multi-source romance languages for the biomedical WMT 2018 task 

    Tubay, Brian; Ruiz Costa-Jussà, Marta (2018)
    Conference lecture
    Restricted access - publisher's policy
  • A neural approach to language variety translation 

    Ruiz Costa-Jussà, Marta; Zampieri, Marcos; Pal, Santanu (Association for Computational Linguistics, 2018)
    Conference lecture
    Restricted access - publisher's policy
    In this paper we present the first neural-based machine translation system trained to translate between standard national varieties of the same language. We take the pair Brazilian - European Portuguese as an example and ...

View more