SIGN IN SIGN UP

A high-throughput and memory-efficient inference and serving engine for LLMs

0 0 122 Python

[Attention] Fix FlashMLA metadata builder arguments for q_len > 1 (#27368)

Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
M
Matthew Bonanni committed
dbfbf9f32445ffadcbb731adef00b4a393612be9
Parent: ca76486
Committed by GitHub <noreply@github.com> on 10/23/2025, 7:58:15 PM