--added lora from peft
--added: --load_only_compatible_weights --lora_checkpoint_peft --train_lora_peft --train_lora_loralib --lora_checkpoint_peft --lora_checkpoint_loralib --new logic with schedulers --added linear_scheduler --get_scheduler() --get_lora() --all DDP logic was moved from train_ddp.py to train.py
K
Kisel committed
ccf0561603eac4d5fcfa8becbcbe54a015efc7db
Parent: 60ab8df