Mostra el registre d'ítem simple

dc.contributor.authorFerrer Cancho, Ramon
dc.contributor.authorDebowski, Lukasz
dc.contributor.authorMoscoso del Prado Martín, Fermín
dc.contributor.otherUniversitat Politècnica de Catalunya. Departament de Ciències de la Computació
dc.date.accessioned2020-02-13T10:38:41Z
dc.date.available2020-02-13T10:38:41Z
dc.date.issued2013-07-04
dc.identifier.citationFerrer-i-Cancho, R.; Debowski, L.; Moscoso del Prado Martin, F. Constant conditional entropy and related hypotheses. "Journal of statistical mechanics: Theory and experiment", 4 Juliol 2013, vol. 2013, núm. 7, article L07001, p. 1-8.
dc.identifier.issn1742-5468
dc.identifier.urihttp://hdl.handle.net/2117/177613
dc.description.abstractConstant entropy rate (conditional entropies must remain constant as the sequence length increases) and uniform information density (conditional probabilities must remain constant as the sequence length increases) are two information theoretic principles that are argued to underlie a wide range of linguistic phenomena. Here we revise the predictions of these principles in the light of Hilberg's law on the scaling of conditional entropy in language and related laws. We show that constant entropy rate (CER) and two interpretations for uniform information density (UID), full UID and strong UID, are inconsistent with these laws. Strong UID implies CER but the reverse is not true. Full UID, a particular case of UID, leads to costly uncorrelated sequences that are totally unrealistic. We conclude that CER and its particular cases are incomplete hypotheses about the scaling of conditional entropies.
dc.format.extent8 p.
dc.language.isoeng
dc.publisherInstitute of Physics (IOP)
dc.rightsAttribution-NonCommercial-NoDerivs 3.0 Spain
dc.rights.urihttp://creativecommons.org/licenses/by-nc-nd/3.0/es/
dc.subjectÀrees temàtiques de la UPC::Informàtica::Intel·ligència artificial::Llenguatge natural
dc.subject.lcshComputational linguistics
dc.subject.otherConstant entropy rate
dc.subject.otherUniform information density
dc.subject.otherHilberg’s law
dc.titleConstant conditional entropy and related hypotheses
dc.typeArticle
dc.subject.lemacLingüística computacional
dc.contributor.groupUniversitat Politècnica de Catalunya. GPLN - Grup de Processament del Llenguatge Natural
dc.identifier.doi10.1088/1742-5468/2013/07/L07001
dc.description.peerreviewedPeer Reviewed
dc.relation.publisherversionhttp://iopscience.iop.org/1742-5468/2013/07/L07001/article
dc.rights.accessOpen Access
local.identifier.drac12824767
dc.description.versionPostprint (author's final draft)
local.citation.authorFerrer-i-Cancho, R.; Debowski, L.; Moscoso del Prado Martin, F.
local.citation.publicationNameJournal of statistical mechanics: Theory and experiment
local.citation.volume2013
local.citation.number7, article L07001
local.citation.startingPage1
local.citation.endingPage8


Fitxers d'aquest items

Thumbnail

Aquest ítem apareix a les col·leccions següents

Mostra el registre d'ítem simple