Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
removing unused RoPE parameters (#590)
* removing unused RoPE parameters * remove redundant context_length in GQA --------- Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
C
casinca committed
152a087a3753ce06977bb2ebba749117d5b44f68
Parent: 2228037
Committed by GitHub <noreply@github.com>
on 3/31/2025, 10:10:39 PM