Temperature

A setting that widens or narrows the model's choice of next token. Zero picks the most likely continuation every time, which is what a deterministic task needs.

Back to the glossary