Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
COMMITS
February 19, 2026
S
Use correct input in layernorm example (#960)
Sebastian Raschka committed
February 18, 2026
S
Readability and code quality improvements (#959)
Sebastian Raschka committed
February 9, 2026
S
Fix flex attention in PyTorch 2.10 (#957)
Sebastian Raschka committed
January 29, 2026
D
Fix docstring parameter names in compute_dpo_loss function (#953)
Dawid Woźniak committed
January 27, 2026
S
Update unit tests for CI (#952)
Sebastian Raschka committed
January 19, 2026
P
chore: Update outdated GitHub Actions versions (#951)
Pádraic Slattery committed
January 18, 2026
S
link GRPO notebook (#950)
Sebastian Raschka committed
January 14, 2026
C
Optional weight tying for Qwen3 and Llama3.2 pretraining (#949)
casinca committed
January 10, 2026
M
Fix encoding of multiple preceding spaces in BPE tokenizer. (#945)
Maxwell De Jong committed
January 9, 2026
S
Chapter 5 with alternative LLMs (Qwen3, Llama 3) (#943)
Sebastian Raschka committed
January 8, 2026
H
Correct batch_idx in appendix A logging (#942)
Henry committed
January 4, 2026
G
Fix Olmo3 YaRN RoPE implementation bug (#940)
Gerardo Moreno committed
January 2, 2026
M
Correct 'pix' to 'pixi' in README.md (#935)
Maheshkumar P committed
S
Clean up native-uv.md documentation (#938)
Sebastian Raschka committed
S
Fix GitHub CI timeout issue for link checker (#937)
Sebastian Raschka committed
R
yearly update
rasbt committed
December 27, 2025
S
Cover Python 3.12 (#933)
Sebastian Raschka committed
December 21, 2025
R
upload saved nb
rasbt committed
R
Update memory efficient loading nb
rasbt committed
December 20, 2025
R
update submodule
rasbt committed
December 19, 2025
S
Add some appendix E runtimes (#927)
Sebastian Raschka committed
S
Gated DeltaNet updates (#926)
Sebastian Raschka committed
December 16, 2025
T
Sliding window KV Cache bug fix (#925)
talentJay-ux committed
November 25, 2025
S
Remove persistent flag from cache buffers (#916)
Sebastian Raschka committed
November 23, 2025
S
Add Olmo 3 README (#915)
Sebastian Raschka committed
S
Olmo 3 from scratch (#914)
Sebastian Raschka committed
November 17, 2025
S
RoPE decay plot (#910)
Sebastian Raschka committed
S
Update README wrt multi-query attention
Sebastian Raschka committed
November 13, 2025
S
Write-up on how to get the most out of this book (#909)
Sebastian Raschka committed
November 9, 2025
C
fix(GatedDeltaNet): Init param A from log of a uniform distrib (#906)
casinca committed