sampling : avoid expensive softmax during greedy sampling (#9605)
* sampling : avoid expensive softmax during greedy sampling ggml-ci * speculative : fix default RNG seed + set sparams.n_probs * Update tests/test-sampling.cpp Co-authored-by: slaren <slarengh@gmail.com> * sampling : add clarifying comment [no ci] --------- Co-authored-by: slaren <slarengh@gmail.com>
G
Georgi Gerganov committed
b0f27361f3539a81d983a8b045f3c61e682d9fc0
Parent: c087b6f
Committed by GitHub <noreply@github.com>
on 9/24/2024, 6:03:17 AM