SIGN IN SIGN UP

launcher: correctly get the head dimension for VLMs (#3116)

* launcher: correctly get the head dimension for VLMs

For most (?) VLMs, the head dimension is in the `text_config`
configuration section. However, since we only queried the top-level
`head_dim` (which typically doesn't exist in VLMs), we would never use
flashinfer. This change adds a method that gets the head dimension from
the top-level `Config` struct or `text_config` when that fails.

* fix: bump org name in gemma3 test

---------

Co-authored-by: drbh <david.richard.holtz@gmail.com>
D
Daniël de Kok committed
095775e05cf97234c7249e73de445541348e05c0
Parent: 0b3e3db
Committed by GitHub <noreply@github.com> on 3/17/2025, 5:19:37 PM