SIGN IN SIGN UP

FlashInfer: Kernel Library for LLM Serving

0 0 188 Python

fix typo llama routing issue in trtllm-gen moe (#3303)

<!-- .github/pull_request_template.md -->

## ๐Ÿ“Œ Description

Fix the typo in the
[trtllm_fused_moe_runner.cu:582](https://github.com/flashinfer-ai/flashinfer/blob/v0.6.11/csrc/trtllm_fused_moe_runner.cu#L582).
Before, the FC2 kernels are incorrectly dropped.

## ๐Ÿ” Related Issues

<!-- Link any related issues here -->

## ๐Ÿš€ Pull Request Checklist

Thank you for contributing to FlashInfer! Before we review your pull
request, please make sure the following items are complete.

### โœ… Pre-commit Checks

- [ ] I have installed `pre-commit` by running `pip install pre-commit`
(or used your preferred method).
- [ ] I have installed the hooks with `pre-commit install`.
- [ ] I have run the hooks manually with `pre-commit run --all-files`
and fixed any reported issues.

> If you are unsure about how to set up `pre-commit`, see [the
pre-commit documentation](https://pre-commit.com/).

## ๐Ÿงช Tests

- [ ] Tests have been added or updated as needed.
- [ ] All tests are passing (`unittest`, etc.).

## Reviewer Notes

<!-- Optional: anything you'd like reviewers to focus on, concerns, etc.
-->


<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

* **Bug Fixes**
* Fixed per-token scaling configuration in the mixture of experts
inference engine to use the correct settings for optimal performance.

[![Review Change
Stack](https://storage.googleapis.com/coderabbit_public_assets/review-stack-in-coderabbit-ui.svg)](https://app.coderabbit.ai/change-stack/flashinfer-ai/flashinfer/pull/3303)

<!-- end of auto-generated comment: release notes by coderabbit.ai -->

Signed-off-by: Siyuan Fu <siyuanf@nvidia.com>
L
Lain committed
ef983122507d38d807d81b99e486ce5006cd4782
Parent: d625ed4
Committed by GitHub <noreply@github.com> on 5/15/2026, 1:30:50 AM