lora initialisation missing from builder.py

[adrielkuek]

Hi, currently peft is supported in train.py with lora_enable flag, however during inference when loading model.builder, there seems to be a mismatch if the model was trained with lora or qlora. Wondering whether the team would be updating builder code base from LlaVA to include peft support?

[yanwei-li]

Hi, all our models are fully finetunded. Actually, I did not try LoRA. This could be checked and supported soon.

[TuuSiwei]

Whether lora is supported