Fast calculation of entropy with Zhang's estimator
View/Open
Capítol de llibre (160,2Kb) (Restricted access)
Request copy
Què és aquest botó?
Aquest botó permet demanar una còpia d'un document restringit a l'autor. Es mostra quan:
- Disposem del correu electrònic de l'autor
- El document té una mida inferior a 20 Mb
- Es tracta d'un document d'accés restringit per decisió de l'autor o d'un document d'accés restringit per política de l'editorial
Document typePart of book or chapter of book
Defense date2016-12-01
PublisherRAM - Verlag
Rights accessRestricted access - publisher's policy
Abstract
Entropy is a fundamental property of a repertoire. Here, we present an efficient algorithm to estimate the entropy of types with the help of Zhang’s estimator. The algorithm takes advantage of the fact that the number of different frequencies in a text is in general much smaller than the number of types. We justify the convenience of the algorithm by means of an analysis of the statistical properties of texts from more than 1000 languages. Our work opens up various possibilities for future research.
CitationLozano, A., Casas, B., Bentz, C., Ferrer-i-Cancho, R. Fast calculation of entropy with Zhang's estimator. A: "Issues in quantitative linguistics 4". Lüdenscheid: RAM - Verlag, 2016, p. 273-285.
ISBN978-3-942303-44-6
Files | Description | Size | Format | View |
---|---|---|---|---|
21 Lozanorfast_Zhang_entropy_estimation_V5.pdf![]() | Capítol de llibre | 160,2Kb | Restricted access |
All rights reserved. This work is protected by the corresponding intellectual and industrial
property rights. Without prejudice to any existing legal exemptions, reproduction, distribution, public
communication or transformation of this work are prohibited without permission of the copyright holder