Synthesized voice does not correspond to the speaker id about mellotron HOT 4 CLOSED

Hi,

Training using a pre-trained model can lead to faster convergence
By default, the speaker embedding layer is ignored

from mellotron.

the pre-trained model does have speaker embedding as you can load the model and see that layer.
But it does seem to be quite picth/rythm related. you can try to extract pitch and rythm from a different wav to see/test

from mellotron.

Nevermind, I think there was a bug in loading the speaker dictionary in the inference on my end. Although for some speakers, the voice does not quite match the data. Maybe because of fewer corresponding speaker samples during training.

from mellotron.

@paarthneekhara - I am also facing this similar issue. I am using libritts pretrained model and trying to generate voice for a custom text using a reference style wav file. Though I specify a different speake_rid (in the example_filelists.txt along with style wav, its transcript), the voice generated is always same of a female voice. Do you know how to generate voice of a different speaker that is present in the pre-trained model?

from mellotron.