Converting hf weights to mds: unable to find latest file #464
Description
After converting weights on 4 nodes for pipeline parallelism, when starting finetuning llama2:
The latest file is generated only on the master node. Is it expected behavior?
{{ message }}