🚀🚀 「大模型」2小时完全从0训练64M的小参数GPT!🌏 Train a 64M-parameter GPT from scratch in just 2h!
[update] tie embedding
J
jingyaogong committed
5704766352e5a835c2ea90e0f9832186ecbc5711
Parent: 1ea113e
🚀🚀 「大模型」2小时完全从0训练64M的小参数GPT!🌏 Train a 64M-parameter GPT from scratch in just 2h!