🚀🚀 「大模型」2小时完全从0训练64M的小参数GPT！🌏 Train a 64M-parameter GPT from scratch in just 2h!
[update] shuffle data
J
jingyaogong committed
f7ffdf1fdb4fb4acb40f27d22150fb05bae7e283
Parent: 3a5aba8
🚀🚀 「大模型」2小时完全从0训练64M的小参数GPT！🌏 Train a 64M-parameter GPT from scratch in just 2h!