Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to train with Indian Accent #227

Open
Jainu-s opened this issue Apr 3, 2024 · 2 comments
Open

How to train with Indian Accent #227

Jainu-s opened this issue Apr 3, 2024 · 2 comments

Comments

@Jainu-s
Copy link

Jainu-s commented Apr 3, 2024

Hi, your repo was very much helpful for TTS. I want to train model with custom Indian voice as I have Indian voice (.wav) dataset along with transcription. I want to train custom model with single voice will this repo capable of doing it? because I don't have any Indian phonotics so still can I achieve Indian accent with the dataset I have? can you please help me?

Thank You

@Lakhjeet1082
Copy link

yes you can do that for Indian language. You can use MFA to create your phonetic dictionary and TextGrids or if pre-trained dictionary for your language is not available you can use phonemizer to make the dictionary.Then train your acoustic model using MFA and align the data to generate TextGrids. And then you can go ahead with the repo for further procedure

@Lakhjeet1082
Copy link

Use mfa or phonemizer to generate pronounciation dictionary .Then validate your corpus and check for OOV words using ( mfa validate ~/mfa_data/my_corpus ~/mfa_data/my_dictionary.txt ) this command. If the pretrained acoustic model for your language is not available then use ( mfa train ~/mfa_data/my_corpus ~/mfa_data/my_dictionary.txt ~/mfa_data/new_acoustic_model.zip ) use this command to train acoustic model. Then use (mfa align ~/mfa_data/my_corpus english_us_arpa english_us_arpa ~/mfa_data/my_corpus_aligned) mfa align command to generate textgrids. And then you are ready to use Fastspeech2 . For more info you can refer https://montreal-forced-aligner.readthedocs.io/en/latest/first_steps/index.html this documentation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants