SIGN IN SIGN UP

FlashInfer: Kernel Library for LLM Serving

0 0 188 Python

test: enable bmm_mxfp8 cutlass backend coverage on SM12x (#3183)

## ๐Ÿ“Œ Description

`test_bmm_mxfp8.py` only parametrizes `backend=["cudnn"]` and skips
`cap[0] in [11, 12]` outright, so the cutlass backend (which is the one
actually supported on SM12x โ€” see `gemm_base.py:7570`) was never
exercised. The cudnn backend is supported on `[100, 103]` only, so
simply removing the skip would have failed on SM12x.

This adds `cutlass` to the backend parametrize and replaces the
unconditional skip with per-backend CC gating that mirrors the
`@supported_compute_capability` decorators:

  - `cudnn` backend: `cap[0] != 10` โ†’ skip
  - `cutlass` backend: `cap[0] != 12` โ†’ skip

  After the change:
  - SM10x: runs cudnn (unchanged), skips cutlass
  - SM12x: skips cudnn, runs cutlass (newly covered)
  - SM110: skipped on both (separate gap, not addressed here)

  Verified on RTX Pro 6000 (sm_120, CUDA 12.9):
  - cutlass backend: **288 passed, 0 failed**
  - cudnn backend: 288 skipped (as expected on sm_120)

  ## ๐Ÿ” Related Issues

  Refs #3170 (Action Item 7 / T3).

  ## ๐Ÿš€ Pull Request Checklist

  ### โœ… Pre-commit Checks

- [x] I have installed `pre-commit` by running `pip install pre-commit`
(or used your preferred method).
  - [x] I have installed the hooks with `pre-commit install`.
- [x] I have run the hooks manually with `pre-commit run --all-files`
and fixed any reported issues.

  ## ๐Ÿงช Tests

  - [ ] Tests have been added or updated as needed.
  - [x] All tests are passing (`unittest`, etc.).

  ## Reviewer Notes



<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

* **Tests**
* Expanded test coverage to include an additional GPU computation
backend, validating batch matrix multiplication across backends.
* Strengthened GPU compatibility checks with backend-specific
requirements and added conditions for a particular memory layout,
ensuring tests run only on supported hardware/configurations.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Ka-Hyun Nam <knam@nvidia.com>
L
leonardHONG committed
7b83d0c54941afefa5ab1a0e0ac418aa55ee4f41
Parent: 9a463df
Committed by GitHub <noreply@github.com> on 5/18/2026, 9:21:55 PM