Statistical Properties of Text

• Token occurrences in text are not uniformly distributed

• They are also not normally distributed

• They do exhibit a Zipf distribution

  • (in-class demonstration of distribution types)

Previous slide

Next slide

Back to first slide

View graphic version