llama : fix top-p sampling to match the canonical definition (#1953)
* Fix top-p sampling to match the standard definition (smallest set that has probability mass at least p, not largest set with probability mass less than p) * top-p: correct gt to gte * add test for correct top-p behavior
A
Alex Renda committed
b061ba9e2a7a2c335a200df8c11aed5e31e4ccbb
Parent: 527b6fb
Committed by GitHub <noreply@github.com>
on 6/24/2023, 10:15:01 AM