SIGN IN SIGN UP

feat: fix transformers 5.x compat, dtype mismatch, add wandb logging

- Fix post_init() always called (required by transformers >=5.x for
  all_tied_weights_keys)
- Fix dtype mismatch: cast fusion layers and heads to float32 after
  from_pretrained loads everything as bfloat16
- Add wandb logging (project/entity/run-name) to training loop
- Add wandb config fields and CLI args
Y
Your Name committed
809cef182ea5392170ce059c4491ff68a8fc9720
Parent: bcb5a15