Add an option to build without CUDA VMM (#7067)
Add an option to build ggml cuda without CUDA VMM resolves https://github.com/ggerganov/llama.cpp/issues/6889 https://forums.developer.nvidia.com/t/potential-nvshmem-allocated-memory-performance-issue/275416/4
W
William Tambellini committed
858f6b73f6e57a62523d16a955d565254be889b4
Parent: b3a995b
Committed by GitHub <noreply@github.com>
on 5/6/2024, 6:12:14 PM