perplexity

A metric commonly used to evaluate language models, measuring how well a probability distribution predicts a sample. A lower perplexity indicates better predictive performance and evokes clarity in language generation tasks.

13 papers