· 1 min read
temperature zero is not determinism
I pinned an eval to exact-match at temp 0 and it flaked anyway. Where the wobble actually comes from and what to assert instead.
#evals#sampling#testing
Tagged: sampling
1 article
1 article
· 1 min read
I pinned an eval to exact-match at temp 0 and it flaked anyway. Where the wobble actually comes from and what to assert instead.
#evals#sampling#testing
get new writeups by email
no schedule, no spam. the next writeup, when it exists.