How much RAM needed ?

[kuronico59]

Hi, i have 32 gb RAM, and a 4060 ti 16g, I cant load the model, my ram is at 100%, and takes too long, is it "normal" ? must I have more Ram ?

[bubbliiiing]

Currently, you may need some swap memory. We are currently trying to develop a smaller model to meet the low memory limit (30GB)

[kuronico59]

Thanks for the reply, even with swap memory it crashes. I will wait patiently

[bubbliiiing]

Thank you, we will hurry up.

[nitinmukesh]

Thank you @bubbliiiing, you are looking into possibility of reducing the memory requirements.

It would be helpful if you can provide fp8, quantized or GGUF model (not sure if possible for this). I have seen the requirement for some tools was 4xH100 for inference now running on consumer GPU's with as low as 12 GB VRAM.

1 such example is
https://huggingface.co/Kijai/Mochi_preview_comfy/tree/main

[bubbliiiing]

30GB RAM will be support in #154