🚀🚀 「大模型」2小时完全从0训练64M的小参数GPT!🌏 Train a 64M-parameter GPT from scratch in just 2h!
[feat] reduce RL memory
J
jingyaogong committed
802c15b2b4fa1658c1ca5a2fe8414a5b052028f0
Parent: e73a407
🚀🚀 「大模型」2小时完全从0训练64M的小参数GPT!🌏 Train a 64M-parameter GPT from scratch in just 2h!