Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Stage 2 training #101

Open
samueleruffino99 opened this issue Nov 30, 2023 · 7 comments
Open

Stage 2 training #101

samueleruffino99 opened this issue Nov 30, 2023 · 7 comments

Comments

@samueleruffino99
Copy link

Hello! I would like to train stage 2 only, where can I find the pertained model for stage 1? Apparently on the drive there are online models only for convmae.
Thank you!

@yutaocui
Copy link
Collaborator

yutaocui commented Dec 4, 2023

Hi, there are all models of MixViT/MixViT(ConvMAE) and MixCvT on https://drive.google.com/drive/folders/1C0oECsbTB3uWk2MjrxDuVhIazcT975xb.

@samueleruffino99
Copy link
Author

But under MixViT-ConvMAE I can download online models only (already with SPM integrated).

@yutaocui
Copy link
Collaborator

yutaocui commented Dec 5, 2023

You can just drop the SPM module since this module is trained on a separate stage with other weights getting detached.

@samueleruffino99
Copy link
Author

samueleruffino99 commented Dec 5, 2023

Ok, but then at stage 2 SPM only has been trained ? No more training on backbone and box head ?

@yutaocui
Copy link
Collaborator

yutaocui commented Dec 5, 2023

Yes.

@samueleruffino99
Copy link
Author

samueleruffino99 commented Dec 5, 2023

But in this way the SPM would be already pretrained or everything is already implemented in the proper way?

@yutaocui
Copy link
Collaborator

yutaocui commented Dec 6, 2023

We think finetuning the SPM module (excepting for backbone) is enough for filtering reliable samples.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants