Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

dropout strategy #144

Open
ryancll opened this issue Nov 19, 2024 · 0 comments
Open

dropout strategy #144

ryancll opened this issue Nov 19, 2024 · 0 comments

Comments

@ryancll
Copy link

ryancll commented Nov 19, 2024

          We adopt the same dropping strategy ("we randomly drop image only (zero image) for 5% of samples, drop text only (empty string) for 5% of samples, drop both of them for 5% of samples for dual-cross-attention.") in all training phases.

"We did not drop image conditional latent in VDG" means the concatenated frame latent with noise will not be dropped.

Originally posted by @Doubiiu in #8 (comment)

Have you ever trid randomly drop image conditional latent(concated latent) for training? I'm curious why you think this strategy is unnecessary.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant