Can I use ESM and MSA inputs in chai-1 simultaneously?

[ASIWU]

Description

I have a question regarding the interaction between MSA input and ESM embeddings in the chai-1 model.

Current Understanding

The model supports both MSA input and ESM embeddings
There is a parameter use_esm_embeddings to control the usage of ESM embeddings

Question

When providing MSA input to the model, does the use_esm_embeddings parameter have any effect on the model's behavior? I would like to understand:

• If MSA and ESM embeddings can be used simultaneously
• If there is any priority between these two input types
• Whether the use_esm_embeddings parameter is ignored when MSA input is provided

Thank you for any clarification on this matter.

[joshim5]

Yes, MSA and ESM embeddings can be used simultaneously.

[arogozhnikov]

Model can receive both, and makes decision about their importance. More MSAs -> higher weight of this information source.

use_esm_embeddings works the same, doesn't matter if MSAs were provided or not