Extend llama_kv_cache_seq_rm to allow matching any sequence (#3843)
* Extend llama_kv_cache_seq_rm to allow matichng any sequence * Replace llama_kv_cache_tokens_rm with llama_kv_cache_clear Use llama_kv_cache_clear for cache clearing Change calls to llama_kv_cache_tokens_rm that want to delete by position to use llama_kv_cache_seq_rm functionality
K
Kerfuffle committed
6e08281e588bbba1a5d180290a94a43f167f3a1a
Parent: 2046eb4
Committed by GitHub <noreply@github.com>
on 10/29/2023, 5:31:40 PM