🚀🚀 「大模型」2小时完全从0训练64M的小参数GPT！🌏 Train a 64M-parameter GPT from scratch in just 2h!
[update] fp16 inference
J
jingyaogong committed
6b0b0c5e2fd492e0f8c05eb27466790ed0f2894c
Parent: 88e675d
🚀🚀 「大模型」2小时完全从0训练64M的小参数GPT！🌏 Train a 64M-parameter GPT from scratch in just 2h!