hetpandya / youtube_tts_data_generator Goto Github PK

Hi Pandya, thanks for creating great resource. Everything works great apart from the fact that this package removes punctuation in the subtitles which I suppose you could understand is very bad things for training as without punctuations attention model will fail to converge hence bad output. Do you know any fix for that?

I am generating dataset for a Spanish video with lang='es'

@hetpandya

Hi, I have found two more issue that I have fixed in your code. I will be sending PR for those too.

Lack of webvtt-py package before installing is not handled in setup.py. Added the dependency.

Hi everyone!

I have just published this project on GitHub: https://github.com/davidmartinrius/speech-dataset-generator/

Now you can create datasets automatically with any audio or lists of audios.

I hope you can find it useful.

Here are the key functionalities of the project:

1. Dataset Generation: Creation of multilingual datasets with Mean Opinion Score (MOS).

2. Silence Removal: It includes a feature to remove silences from audio files, enhancing the overall quality.

3. Sound Quality Improvement: It improves the quality of the audio when needed.

4. Audio Segmentation: It can segment audio files within specified second ranges.

5. Transcription: The project transcribes the segmented audio, providing a textual representation.

6. Gender Identification: It identifies the gender of each speaker in the audio.

7. Pyannote Embeddings: Utilizes pyannote embeddings for speaker detection across multiple audio files.

8. Automatic Speaker Naming: Automatically assigns names to speakers detected in multiple audios.

9. Multiple Speaker Detection: Capable of detecting multiple speakers within each audio file.

10. Store speaker embeddings: The speakers are detected and stored in a Chroma database, so you do not need to assign a speaker name.

11. Syllabic and words-per-minute metrics

12. Multiple input sources: You can either use your own files or download content by pasting URLs from sources such as YouTube, LibriVox and TED Talks.

Feel free to explore the project at https://github.com/davidmartinrius/speech-dataset-generator

Changelog:

• Added fix to #1 by adding support for downloading subtitles with punctuations.
• Added option to change default sample rate (#2)
• Fixed bug for duplicate text entries in metadata.
• The default subtitle format has been changed to json. If srt or vtt subtitles are detected, they will automatically be converted to json.