Show simple item record

Quantitative delimitation of the core of a language
dc.contributor.authorCvrček, Václav
dc.description.abstractThe exploitation of hapax legomena, i.e. word or lemma types which occur in a corpus only once, is usually overlooked in language description. These types cannot be systematically used for a vast majority of analyses as they do not provide a basis for any type of generalization. On the other hand, the overall number of hapaxes can be used as an indicator of the lexical periphery of the language system. This paper suggests that the ratio between the number of hapaxes and the number of all types in relation to the growing corpus size (hapax-type ratio, HTR) can be used for delimitation of the lexical core of a language. It has been shown by previous research (Fengxiang 2010) that HTR in English has the shape of a pipe or chibouque, which means that the rates of the emergence of new hapaxes and new types in the process of building a corpus differ before and after reaching a certain size. In a hypothetical small corpus (a few sentences) the hapax-type ratio will be equal to one (each wordtype is also a hapax). As texts are added to the corpus (up to a few million words), the hapax-type ratio decreases (the number of new words including hapaxes is continuously increasing but the majority of added tokens are new instances of words already present in the corpus) from its maximal value (=1) to a local minimum. After reaching this turning point, extending the corpus increases the ratio because the number of hapaxes grows at a faster pace than the number of non-hapaxes (i.e. types with a frequency higher than one). This empirical finding tested on corpora of Czech and English brings us closer to the exact determination of the range of the core lexicon. Subsequently, we can deduce the approximate size of a corpus sufficient for compiling a dictionary that covers the core lexicon.en
dc.publisherUniverzita Karlova, Filozofická fakulta
dc.sourceČasopis pro moderní filologii (Journal for Modern Philology), 2014, 96, 1, 9-26
dc.titleKvantitativní určení lexikálního jádra jazykacs
dc.typeVědecký článekcs
dc.title.translatedQuantitative delimitation of the core of a languageen
dcterms.isPartOf.nameČasopis pro moderní filologii (Journal for Modern Philology)cs
dc.subject.keywordkvantitativní lingvistikacs
dc.subject.keywordhapax legomenoncs
dc.subject.keywordtoken-type poměrcs
dc.subject.keywordquantitative linguisticsen
dc.subject.keywordhapax legomenonen
dc.subject.keywordtoken-type ratioen

Files in this item


This item appears in the following Collection(s)

Show simple item record

© 2017 Univerzita Karlova, Ústřední knihovna, Ovocný trh 560/5, 116 36 Praha 1; email: admin-repozitar [at]

Za dodržení všech ustanovení autorského zákona jsou zodpovědné jednotlivé složky Univerzity Karlovy. / Each constituent part of Charles University is responsible for adherence to all provisions of the copyright law.

Upozornění / Notice: Získané informace nemohou být použity k výdělečným účelům nebo vydávány za studijní, vědeckou nebo jinou tvůrčí činnost jiné osoby než autora. / Any retrieved information shall not be used for any commercial purposes or claimed as results of studying, scientific or any other creative activities of any person other than the author.

DSpace software copyright © 2002-2015  DuraSpace
Theme by 
@mire NV