Mostra el registre d'ítem simple
Constant conditional entropy and related hypotheses
dc.contributor.author | Ferrer Cancho, Ramon |
dc.contributor.author | Debowski, Lukasz |
dc.contributor.author | Moscoso del Prado Martín, Fermín |
dc.contributor.other | Universitat Politècnica de Catalunya. Departament de Ciències de la Computació |
dc.date.accessioned | 2020-02-13T10:38:41Z |
dc.date.available | 2020-02-13T10:38:41Z |
dc.date.issued | 2013-07-04 |
dc.identifier.citation | Ferrer-i-Cancho, R.; Debowski, L.; Moscoso del Prado Martin, F. Constant conditional entropy and related hypotheses. "Journal of statistical mechanics: Theory and experiment", 4 Juliol 2013, vol. 2013, núm. 7, article L07001, p. 1-8. |
dc.identifier.issn | 1742-5468 |
dc.identifier.uri | http://hdl.handle.net/2117/177613 |
dc.description.abstract | Constant entropy rate (conditional entropies must remain constant as the sequence length increases) and uniform information density (conditional probabilities must remain constant as the sequence length increases) are two information theoretic principles that are argued to underlie a wide range of linguistic phenomena. Here we revise the predictions of these principles in the light of Hilberg's law on the scaling of conditional entropy in language and related laws. We show that constant entropy rate (CER) and two interpretations for uniform information density (UID), full UID and strong UID, are inconsistent with these laws. Strong UID implies CER but the reverse is not true. Full UID, a particular case of UID, leads to costly uncorrelated sequences that are totally unrealistic. We conclude that CER and its particular cases are incomplete hypotheses about the scaling of conditional entropies. |
dc.format.extent | 8 p. |
dc.language.iso | eng |
dc.publisher | Institute of Physics (IOP) |
dc.rights | Attribution-NonCommercial-NoDerivs 3.0 Spain |
dc.rights.uri | http://creativecommons.org/licenses/by-nc-nd/3.0/es/ |
dc.subject | Àrees temàtiques de la UPC::Informàtica::Intel·ligència artificial::Llenguatge natural |
dc.subject.lcsh | Computational linguistics |
dc.subject.other | Constant entropy rate |
dc.subject.other | Uniform information density |
dc.subject.other | Hilberg’s law |
dc.title | Constant conditional entropy and related hypotheses |
dc.type | Article |
dc.subject.lemac | Lingüística computacional |
dc.contributor.group | Universitat Politècnica de Catalunya. GPLN - Grup de Processament del Llenguatge Natural |
dc.identifier.doi | 10.1088/1742-5468/2013/07/L07001 |
dc.description.peerreviewed | Peer Reviewed |
dc.relation.publisherversion | http://iopscience.iop.org/1742-5468/2013/07/L07001/article |
dc.rights.access | Open Access |
local.identifier.drac | 12824767 |
dc.description.version | Postprint (author's final draft) |
local.citation.author | Ferrer-i-Cancho, R.; Debowski, L.; Moscoso del Prado Martin, F. |
local.citation.publicationName | Journal of statistical mechanics: Theory and experiment |
local.citation.volume | 2013 |
local.citation.number | 7, article L07001 |
local.citation.startingPage | 1 |
local.citation.endingPage | 8 |
Fitxers d'aquest items
Aquest ítem apareix a les col·leccions següents
-
Articles de revista [1.046]
-
Articles de revista [97]