SIGN IN SIGN UP

llama : fix top-p sampling to match the canonical definition (#1953)

* Fix top-p sampling to match the standard definition (smallest set that has probability mass at least p, not largest set with probability mass less than p)

* top-p: correct gt to gte

* add test for correct top-p behavior
A
Alex Renda committed
b061ba9e2a7a2c335a200df8c11aed5e31e4ccbb
Parent: 527b6fb
Committed by GitHub <noreply@github.com> on 6/24/2023, 10:15:01 AM