What is temperature in LLM APIs? When to use low vs high?

Answer preview

How it works: Adjusts probability distribution — low temp = always pick most likely token; high = sample from wider distribution.…