Difference between revisions of "Ngram frequency"

From Glottopedia
Jump to: navigation, search
m
Line 1: Line 1:
 
 
The mean, or summed, frequency of all fragments of a word of a given length. Most commonly used is bigram frequency, using fragments of length 2. The word 'dog' will contain 2 bigrams: 'do' and 'og'. Bigram frequency is considered to be a measure of orthographic regularity and normally has a negative correlation with response times in psycho-linguistic experiments.
 
The mean, or summed, frequency of all fragments of a word of a given length. Most commonly used is bigram frequency, using fragments of length 2. The word 'dog' will contain 2 bigrams: 'do' and 'og'. Bigram frequency is considered to be a measure of orthographic regularity and normally has a negative correlation with response times in psycho-linguistic experiments.
  
Line 7: Line 6:
  
 
In the auditory domain the equivalent of bigram is diphone, a group of two phonemes. Mean diphone frequency could be considered a crude measure of phonological regularity.
 
In the auditory domain the equivalent of bigram is diphone, a group of two phonemes. Mean diphone frequency could be considered a crude measure of phonological regularity.
 +
 +
[[Category: EN]]
 +
[[Category: DICT]]
 +
[[Category:Quantitative Linguistics]]

Revision as of 15:06, 28 November 2007

The mean, or summed, frequency of all fragments of a word of a given length. Most commonly used is bigram frequency, using fragments of length 2. The word 'dog' will contain 2 bigrams: 'do' and 'og'. Bigram frequency is considered to be a measure of orthographic regularity and normally has a negative correlation with response times in psycho-linguistic experiments.

It is not unusual to extend the word with a couple of 'space' characters, to give the first and last character in the word a special status. The word 'dog' will then become '_dog_' and now contains 4 bigrams: '_d', 'do', 'og' and 'g_'.

Ngram frequency of length 1 is equal to the character frequency, and using length 3 is commonly referred to as trigram frequency. Larger values for N are rare.

In the auditory domain the equivalent of bigram is diphone, a group of two phonemes. Mean diphone frequency could be considered a crude measure of phonological regularity.