Allow multiple copy function pointers for CUDA graph kernel param updates (#7565)
CUDA graphs require parameter updates to kernels associated with GGML_OP_CPY nodes. Previously the implementation only checked for a single CUDA kernel in such nodes, but this caused a bug in cases where 2 such kernels exist. This fixes the issue by using a vector to allow multiple function pointers to be stored and checked against. Fixes #7942
A
agray3 committed
197c00681b80f9dea17d11a4436b6b8ef1be0ce8
Parent: 95f84d5
Committed by GitHub <noreply@github.com>
on 5/27/2024, 5:33:42 PM