SIGN IN SIGN UP

feat(glm): add cuDNN DSA backend for GLM-5.2 (#3127)

* feat(glm): add cuDNN DSA kernels for GLM-5.2

Signed-off-by: HuiyingLi <willwin.lee@gmail.com>

* fix(moe): use reentrant checkpoint ordering

Signed-off-by: HuiyingLi <willwin.lee@gmail.com>

* fix(loss): bound long-context cross entropy memory

Signed-off-by: HuiyingLi <willwin.lee@gmail.com>

* fix(glm): bound TileLang top-k workspace

Restore the established masked cross-entropy path after the recompute loss changed the CP8 cuDNN optimizer trajectory. Chunk TileLang top-k across query rows only for large score matrices so CP8 fits without changing CP1 selection semantics.

Signed-off-by: HuiyingLi <willwin.lee@gmail.com>

* fix(thd): derive packed padding masks from lengths

Signed-off-by: HuiyingLi <willwin.lee@gmail.com>

* fix(glm): exclude packed padding from cuDNN DSA

Signed-off-by: HuiyingLi <willwin.lee@gmail.com>

* chore(distributed): drop unrelated comment change

Signed-off-by: HuiyingLi <willwin.lee@gmail.com>

* docs(glm): add Tulu3 cuDNN recipe

Replace the validation-only mock benchmark recipes with a public Tulu3 4K
cuDNN example matching the validated topology. Document the recipe and
exclude it from release execution until the standard image includes FlashMLA.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Signed-off-by: HuiyingLi <willwin.lee@gmail.com>

* chore(glm): drop mock validation plumbing

Signed-off-by: HuiyingLi <willwin.lee@gmail.com>

* refactor(glm): narrow PP mask handling

Signed-off-by: HuiyingLi <willwin.lee@gmail.com>

* chore(glm): drop mock collater support

Remove the pre-batched THD collater branch after dropping the validation-only
mock recipes and dataset plumbing from this PR.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Signed-off-by: HuiyingLi <willwin.lee@gmail.com>

* chore(glm): defer lock updates to CI

Restore the checked-in lockfiles and let the repository lock-generation bot
produce the dependency updates from pyproject.toml.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Signed-off-by: HuiyingLi <willwin.lee@gmail.com>

* Update uv lock

Signed-off-by: NeMo Bot <nemo-bot@nvidia.com>

* chore(glm): note PP mask capability follow-up

Document that the model-type exceptions should move to a shared mask-ownership
capability once that contract is standardized.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Signed-off-by: HuiyingLi <willwin.lee@gmail.com>

* Update docs/model-coverage/llm/thudm/glm5-moe-dsa.mdx

Co-authored-by: jgerh <163925524+jgerh@users.noreply.github.com>

* Update docs/model-coverage/llm/thudm/glm5-moe-dsa.mdx

Co-authored-by: jgerh <163925524+jgerh@users.noreply.github.com>

* Update docs/model-coverage/llm/thudm/glm5-moe-dsa.mdx

Co-authored-by: jgerh <163925524+jgerh@users.noreply.github.com>

* Update docs/model-coverage/llm/thudm/glm5-moe-dsa.mdx

Co-authored-by: jgerh <163925524+jgerh@users.noreply.github.com>

* Update docs/model-coverage/llm/thudm/glm5-moe-dsa.mdx

Co-authored-by: jgerh <163925524+jgerh@users.noreply.github.com>

* Update docs/model-coverage/llm/thudm/glm5-moe-dsa.mdx

Co-authored-by: jgerh <163925524+jgerh@users.noreply.github.com>

* Update docs/model-coverage/llm/thudm/glm5-moe-dsa.mdx

Co-authored-by: jgerh <163925524+jgerh@users.noreply.github.com>

* Update docs/model-coverage/llm/thudm/glm5-moe-dsa.mdx

Co-authored-by: jgerh <163925524+jgerh@users.noreply.github.com>

* Update docs/model-coverage/llm/thudm/glm5-moe-dsa.mdx

Co-authored-by: jgerh <163925524+jgerh@users.noreply.github.com>

* Update docs/model-coverage/llm/thudm/glm5-moe-dsa.mdx

Co-authored-by: jgerh <163925524+jgerh@users.noreply.github.com>

* Update docs/model-coverage/llm/thudm/glm5-moe-dsa.mdx

Co-authored-by: jgerh <163925524+jgerh@users.noreply.github.com>

* Update docs/model-coverage/llm/thudm/glm5-moe-dsa.mdx

Co-authored-by: jgerh <163925524+jgerh@users.noreply.github.com>

* test(glm): configure IndexShare for cuDNN PP carry

The pipeline metadata contract only includes the top-k carry for models
with shared indexers. Make the cuDNN fixed-width carry test opt into that
configuration explicitly, matching the TileLang coverage.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Signed-off-by: HuiyingLi <willwin.lee@gmail.com>

---------

Signed-off-by: HuiyingLi <willwin.lee@gmail.com>
Signed-off-by: NeMo Bot <nemo-bot@nvidia.com>
Co-authored-by: Alexandros Koumparoulis <153118171+akoumpa@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: NeMo Bot <nemo-bot@nvidia.com>
Co-authored-by: jgerh <163925524+jgerh@users.noreply.github.com>
H
Huiying committed
3674dff81a66c6aa2908a36a0f123e872a3311a2
Parent: 1d0a030
Committed by GitHub <noreply@github.com> on 8/20/2026, 11:14:24 PM