· 1 min read
temperature zero is not determinism
I pinned an eval to exact-match at temp 0 and it flaked anyway. Where the wobble actually comes from and what to assert instead.
#evals#sampling#testing
Evaluations
2 articles
· 2 min read
Write the eval before the prompt, you animal
Prompt engineering without an eval set is interior decorating in the dark. Twenty labeled examples beat two hundred vibes.
#evals#testing#workflow