0 0 0 C++

update HIP_UMA #7399 (#7414)

* update HIP_UMA #7399

add use of hipMemAdviseSetCoarseGrain when LLAMA_HIP_UMA is enable.
- get x2 on prompte eval and x1.5 on token gen with rocm6.0 on ryzen 7940HX iGPU (780M/gfx1103)

* simplify code, more consistent style

---------

Co-authored-by: slaren <slarengh@gmail.com>

Djip007 committed 2y ago

852aafb163d32d5bad63c10bc323a02c28fec59d

Parent: 0136966

Committed by GitHub <noreply@github.com> on 5/27/2024, 11:40:47 PM