training commands

[sahilqure]

Thanks for such a awesome work. Can you please release the detail commands for sft training and pretraining. It wAould be really helpful.

[MatthewMih]

Hello! To start the training you should slightly modify configs (add path to your data) config-sft.json and run python3 train_sft.py. (pretrain launch is similar)