cuda : use CUDA memory pool with async memory allocation/deallocation when available (#3903)
* Using cuda memory pools for async alloc/dealloc. * If cuda device doesnt support memory pool than use old implementation. * Removed redundant cublasSetStream --------- Co-authored-by: Oleksii Maryshchenko <omaryshchenko@dtis.com>
O
Oleksii Maryshchenko committed
d6069051de7165a4e06662c89257f5d2905bb156
Parent: 4ff1046
Committed by GitHub <noreply@github.com>
on 11/2/2023, 5:10:39 PM