Temperature
Why does AI phrase the answer differently when I ask the same question again?
Why does AI phrase the answer differently when I ask the same question again?
Teaching example, not a measurement: lower temperature often concentrates candidates, but does not make every word identical.
First check API support: For models and APIs that support it, lower values usually concentrate sampling and higher values usually add variation. Check the relevant documentation for supported ranges.
Constrain a required format separately: A low setting can still produce missing or incorrect fields. Define the structure and validate the actual output.
First check whether this model and API support temperature. Compare candidates for the same naming request at different settings, treating them as a trend in randomness rather than a guarantee that low temperature repeats every word. If the format must be fixed, define it separately and validate the result.