🚀🚀 「大模型」2小时完全从0训练64M的小参数GPT！🌏 Train a 64M-parameter GPT from scratch in just 2h!
[update] align loss
J
jingyaogong committed
c090b69c4d41a2288301b600c9ca040127db0134
Parent: e119db8
🚀🚀 「大模型」2小时完全从0训练64M的小参数GPT！🌏 Train a 64M-parameter GPT from scratch in just 2h!