starcoder : add GPU offloading (#3827)
* starcoder : do not GPU split 1D bias tensors * starcoder : offload layers to GPU ggml-ci
G
Georgi Gerganov committed
fdee152e4eebb78c191df0b074857111d7f2aba7
Parent: 41aee4d
Committed by GitHub <noreply@github.com>
on 10/28/2023, 9:06:08 AM