Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DEISMultistepScheduler not working on FLUX #9971

Open
PromeAIpro opened this issue Nov 20, 2024 · 3 comments
Open

DEISMultistepScheduler not working on FLUX #9971

PromeAIpro opened this issue Nov 20, 2024 · 3 comments
Labels
bug Something isn't working

Comments

@PromeAIpro
Copy link
Contributor

PromeAIpro commented Nov 20, 2024

Describe the bug

DEISMultistepScheduler not working on FLUX

Reproduction

import torch
from diffusers import FluxPipeline
from diffusers.schedulers import DEISMultistepScheduler

pipe = FluxPipeline.from_pretrained("black-forest-labs/FLUX.1-dev", torch_dtype=torch.bfloat16)
pipe.scheduler = DEISMultistepScheduler.from_config(pipe.scheduler.config, timestep_spacing="linspace")

prompt = "A cat holding a sign that says hello world"
image = pipe(
prompt,
height=1024,
width=1024,
guidance_scale=3.5,
num_inference_steps=50,
max_sequence_length=512,
generator=torch.Generator("cpu").manual_seed(0)
).images[0]
image.save("flux-dev.png")

Logs

ValueError: The current scheduler class <class 'diffusers.schedulers.scheduling_deis_multistep.DEISMultistepScheduler'>'s `set_timesteps` does not support custom sigmas schedules. Please check whether you are using the correct scheduler.

System Info

  • 🤗 Diffusers version: 0.31.0
  • Platform: Linux-5.10.0-28-amd64-x86_64-with-glibc2.31
  • Running on Google Colab?: No
  • Python version: 3.10.14
  • PyTorch version (GPU?): 2.4.0+cu121 (True)
  • Flax version (CPU?/GPU?/TPU?): not installed (NA)
  • Jax version: not installed
  • JaxLib version: not installed
  • Huggingface_hub version: 0.24.6
  • Transformers version: 4.45.1
  • Accelerate version: 0.34.0
  • PEFT version: 0.12.0
  • Bitsandbytes version: 0.43.3
  • Safetensors version: 0.4.4
  • xFormers version: not installed
  • Accelerator: NVIDIA A100-SXM4-80GB, 81920 MiB
    NVIDIA A100-SXM4-80GB, 81920 MiB
  • Using GPU in script?:
  • Using distributed or parallel set-up in script?:

Who can help?

No response

@PromeAIpro PromeAIpro added the bug Something isn't working label Nov 20, 2024
@vladmandic
Copy link
Contributor

not a bug - flux and sd3x require use of flow-matching type of schedulers, use of standard schedulers is not possible.
see #9924 and #9607

@sayakpaul
Copy link
Member

Cc: @yiyixuxu as well.

@PromeAIpro
Copy link
Contributor Author

PromeAIpro commented Nov 21, 2024

But I think comfyui supports it
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants