Does show-o support multimodal-in multimodal-out?

[URRealHero]

Like what I said, does it support the title? does it multimodal-in, multimodal-out(with multi images)?

[URRealHero]

I've noticed that Mixed-modal generation is a pending requested feature, so can I write script to do that? or the model do not have the ability now.

[Sierkinhane]

Hi, we have explored mixed-modality generation. However, we still have not uploaded such a pre-trained weight to this version. We consider it in the next update but we are not sure about the timeline.

[URRealHero]

thx very much！so is this process instruction tunning part or I have to pretrain it again？

[Sierkinhane]

Hey, it is included in the instruction tuning stage.

[URRealHero]

Thx a lot! I'll try to do that~

[URRealHero]

Hi there, I don't understand how to use a new dataset to finetune the model.
1.Do I need to pretrain from the beginning to get the checkpoint for stage2? if not, where can I get the pretrained params
2. For a new dataset, do I have to create a similar instruction-tuning yaml like yours for LLava-tuning?