Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Query for training with lora #31

Open
sterzhang opened this issue Nov 7, 2024 · 1 comment
Open

Query for training with lora #31

sterzhang opened this issue Nov 7, 2024 · 1 comment

Comments

@sterzhang
Copy link

Hi, how can I finetune the model using lora.
Is it the same as LLaVA-1.5 like adding an extra line below?
--lora_enable True --lora_r 128 --lora_alpha 256 --mm_projector_lr 2e-5 \

@jzhang38
Copy link
Collaborator

I believe you are right. But I have not run with lora.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants