Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Train New Voice Conversion Model #28

Open
HRNPH opened this issue Apr 19, 2023 · 6 comments
Open

Train New Voice Conversion Model #28

HRNPH opened this issue Apr 19, 2023 · 6 comments
Labels
enhancement New feature or request help wanted Extra attention is needed

Comments

@HRNPH
Copy link
Owner

HRNPH commented Apr 19, 2023

basically current model of Voice Conversion(SoVits) pushed on #26 #27 are SHIT due to a low amount of training
currently stored in Huggingface https://huggingface.co/openwaifu/SoVits-VC-Chtholly-Nota-Seniorious-0.1
which made it sound shitter than our old pipeline what we need to do is just train it more
and maybe add more VC model
Todo:

@HRNPH HRNPH converted this from a draft issue Apr 19, 2023
@HRNPH HRNPH added enhancement New feature or request help wanted Extra attention is needed labels Apr 19, 2023
@andri-jpg
Copy link
Contributor

Instead of using TTS and Sovits together, why don't we just use TTS Vits?

@HRNPH
Copy link
Owner Author

HRNPH commented Apr 24, 2023

The reason is when you want to train your own custom Voice TTS Model is hard to train
Voice Conversion is easier to train since you only need an audio sample and not an audio-text pair

@andri-jpg
Copy link
Contributor

andri-jpg commented Apr 24, 2023

okay, I understand, right now I'm trying to retrain the model. Maybe I'll try with a pretrained model, then I'll fine tune with the existing dataset.

@HRNPH
Copy link
Owner Author

HRNPH commented Apr 27, 2023

I have pre-trained model and dataset if you need one

@andri-jpg
Copy link
Contributor

I have pre-trained model and dataset if you need one

OK, I'll give it a try, can you send me the link?

@HRNPH
Copy link
Owner Author

HRNPH commented Apr 27, 2023

This for datasets: https://drive.google.com/file/d/102PVFeKrYu8Pfo-4NBC5jsgVbHNiP_Uc/view?usp=share_link
This for SoVits model: https://drive.google.com/drive/folders/1-5YkGLEmLvfFEE1x5cG08KdDrrIWf8pL?usp=share_link
(this is the same model that was used as current base model)

@HRNPH HRNPH closed this as not planned Won't fix, can't repro, duplicate, stale Jun 23, 2024
@github-project-automation github-project-automation bot moved this from Todo to Done in Waifu Experience Jun 23, 2024
@HRNPH HRNPH reopened this Jun 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
Status: Done
Development

No branches or pull requests

2 participants