What perplexity tells you about a language model

Define perplexity and explain how to read it: what a lower or higher number means, how it relates to cross-entropy, how it is used for today's large language models, and where it stops being a good measure.