feat(autotuner): enable per-op autotune bypass for faster framework warmup (#3396)
Add skip_ops to let frameworks exclude specific ops from autotuning, falling back to heuristic tactics without kernel compilation overhead. addresses #3295: mm_fp4 cute-dsl autotuning is slow due to compilation. <!-- .github/pull_request_template.md --> ## ๐ Description <!-- What does this PR do? Briefly describe the changes and why theyโre needed. --> ## ๐ Related Issues <!-- Link any related issues here --> ## ๐ Pull Request Checklist Thank you for contributing to FlashInfer! Before we review your pull request, please make sure the following items are complete. ### โ Pre-commit Checks - [ ] I have installed `pre-commit` by running `pip install pre-commit` (or used your preferred method). - [ ] I have installed the hooks with `pre-commit install`. - [ ] I have run the hooks manually with `pre-commit run --all-files` and fixed any reported issues. > If you are unsure about how to set up `pre-commit`, see [the pre-commit documentation](https://pre-commit.com/). ## ๐งช Tests - [ ] Tests have been added or updated as needed. - [ ] All tests are passing (`unittest`, etc.). ## Reviewer Notes <!-- Optional: anything you'd like reviewers to focus on, concerns, etc. --> <!-- This is an auto-generated comment: release notes by coderabbit.ai --> ## Summary by CodeRabbit * **New Features** * Added an option to exclude specific custom operations from profiling via the tuning context, with nested contexts combining exclusions and restoring prior state on exit. * Excluded operations immediately use fallback behavior and bypass profiling and cache writes. * **Tests** * Added tests validating skip behavior, nesting/restore semantics, fallback selection, and that skipped ops donโt affect profiling cache. <!-- review_stack_entry_start --> [](https://app.coderabbit.ai/change-stack/flashinfer-ai/flashinfer/pull/3396?utm_source=github_walkthrough&utm_medium=github&utm_campaign=change_stack) <!-- review_stack_entry_end --> <!-- end of auto-generated comment: release notes by coderabbit.ai --> --------- Co-authored-by: Albert Cheng (Engrg-Hardware 1) <albecheng@login-lyris01.lyris.clusters.nvidia.com>
A
Albert Cheng committed
8eb61546e82169759801c7895537f3c09ec423f9
Parent: b7181ce
Committed by GitHub <noreply@github.com>
on 5/28/2026, 4:07:00 PM