SIGN IN SIGN UP

Extend llama_kv_cache_seq_rm to allow matching any sequence (#3843)

* Extend llama_kv_cache_seq_rm to allow matichng any sequence

* Replace llama_kv_cache_tokens_rm with llama_kv_cache_clear

Use llama_kv_cache_clear for cache clearing

Change calls to llama_kv_cache_tokens_rm that want to delete by position to use llama_kv_cache_seq_rm functionality
K
Kerfuffle committed
6e08281e588bbba1a5d180290a94a43f167f3a1a
Parent: 2046eb4
Committed by GitHub <noreply@github.com> on 10/29/2023, 5:31:40 PM