默认使用LoRA训练,每个stage的LoRA模型权重都需要合并到base model中,使用以下命令合并,下一个stage的model_name_or_path指定为合并后的模型文件夹。 LoRA layers were using at all stages to reduce memory requirements. At each stage the peft adapter layers ...