GPU Memory Requirements

[LKyra]

Thank you for your exciting work and open-source models！

May I ask how much GPU memory is required to perform model fine-tuning at a resolution of 256 * 256 or 512 * 512?

[shiml20]

A configuration of 8×80GB memory is more than enough to meet the requirements of model fine-tuning. For fine-tuning tasks in low-memory scenarios, two practical solutions are recommended: one is to set a smaller batch size, and the other is to adopt the LoRA fine-tuning method.

[LKyra]

A configuration of 8×80GB memory is more than enough to meet the requirements of model fine-tuning. For fine-tuning tasks in low-memory scenarios, two practical solutions are recommended: one is to set a smaller batch size, and the other is to adopt the LoRA fine-tuning method.

Thank you for your reply. I will give it a try. : )