Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merge changes #162

Merged
merged 31 commits into from
Jun 19, 2024
Merged

Merge changes #162

merged 31 commits into from
Jun 19, 2024

Conversation

Skquark
Copy link
Owner

@Skquark Skquark commented Jun 19, 2024

ControlNet SD3 looks like fun..

DN6 and others added 30 commits June 13, 2024 18:29
remove prepare mask fn

Co-authored-by: yiyixuxu <yixu310@gmail,com>
Co-authored-by: Sayak Paul <[email protected]>
* add `sentencepiece` requirement for SD3

add `sentencepiece` requirement

* Empty-Commit

---------

Co-authored-by: Sayak Paul <[email protected]>
* pin accelerate to 0.31.0

* update dep table

* empty
* Add lognorm and cosmap weighting

* Implement mode sampling

* Update examples/dreambooth/train_dreambooth_lora_sd3.py

* Update examples/dreambooth/train_dreambooth_lora_sd3.py

* Update examples/dreambooth/train_dreambooth_sd3.py

* Update examples/dreambooth/train_dreambooth_sd3.py

* Update examples/dreambooth/train_dreambooth_sd3.py

* Update examples/dreambooth/train_dreambooth_lora_sd3.py

* Update examples/dreambooth/train_dreambooth_sd3.py

* Update examples/dreambooth/train_dreambooth_sd3.py

* Update examples/dreambooth/train_dreambooth_lora_sd3.py

* keep timestamp sampling fully on cpu

---------

Co-authored-by: Kashif Rasul <[email protected]>
Co-authored-by: Sayak Paul <[email protected]>
… the text encoders are not being trained (#8536)

* Update train_dreambooth_sd3.py to fix TE garbage collection

* Update train_dreambooth_lora_sd3.py to fix TE garbage collection

---------

Co-authored-by: Kashif Rasul <[email protected]>
Co-authored-by: Sayak Paul <[email protected]>
* fix

* up

---------

Co-authored-by: yiyixuxu <yixu310@gmail,com>
Update controlnet.md

Syntax error pipe -> pipeline
* initial commit

* default back to 77

* better text

* text correction

---------

Co-authored-by: Sayak Paul <[email protected]>
…o logit_normal (#8592)

Co-authored-by: bghira <[email protected]>
Co-authored-by: Kashif Rasul <[email protected]>
refactor the density and weighting utilities.
…8460)

fix the position of param casting when loading them
* tased3 docs

* apply suggestion

---------

Co-authored-by: Sayak Paul <[email protected]>
…elerate` isn't installed. (#8462)

* update

* update

* update

* update

* update

---------

Co-authored-by: YiYi Xu <[email protected]>
Co-authored-by: Sayak Paul <[email protected]>
* Fix sharding when no device_map is passed

* style

* add tests

* align

* add docstring

* format

---------

Co-authored-by: Sayak Paul <[email protected]>
* max_sequence_length for the T5

* updated img2img

* apply suggestions

---------

Co-authored-by: Sayak Paul <[email protected]>
Co-authored-by: YiYi Xu <[email protected]>
* shift factor argument to tiny

* remove shift factor rejigging from the sd3 docs
* [LoRA] text encoder: read the ranks for all the attn modules

 * In addition to out_proj, read the ranks of adapters for q_proj, k_proj, and  v_proj

 * Allow missing adapters (UNet already supports this)

* ruff format loaders.lora

* [LoRA] add tests for partial text encoders LoRAs

* [LoRA] update test_simple_inference_with_partial_text_lora to be deterministic

* [LoRA] comment justifying test_simple_inference_with_partial_text_lora

* style

---------

Co-authored-by: Sayak Paul <[email protected]>
…with" (#8602)

[SD3 Docs] Corrected title about loading model with T5

Corrected the documentation title to "Loading the single file checkpoint with T5" Previously, it incorrectly stated "Loading the single file checkpoint without T5" which contradicted the code snippet showing how to load the SD3 checkpoint with the T5 model
Making self.upsample actually be Upsample1D
…ror during training (#8606)

* add sd1.5 compatibility to controlnet-xs

* set use_linear_projection by base_block

* refine code style
…out T5 (text_encoder_3=None) (#8558)

* fix shape mismatch when num_images_per_prompt > 1 and text_encoder_3=None

* style

* fix copies

---------

Co-authored-by: YiYi Xu <[email protected]>
Co-authored-by: yiyixuxu <yixu310@gmail,com>
* sd3 controlnet



---------

Co-authored-by: haofanwang <[email protected]>
@Skquark Skquark merged commit 5b3ba6d into Skquark:main Jun 19, 2024
5 of 8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.