RumtimeError: Expected to have have finished reduction in the prior iteration before starting a new one

[ge35tay]

Hi interVideo Team, I try to run the pretrain and use 1B-41 as pretrained model but I meet this following error, how can I solve this?

[ge35tay]

I try to set find_unused_parameter as true but meet another issue

[ge35tay]

Besides, in readme it's said that CLIP teacher is necessary in pretrain, but how to set the readme to set this? I can not solve this problem using the provided config

[ge35tay]

I finally got pretrain running with this config. But if I just want to finetune with VTC and VTM error for retrieval task, what should I do?