YouTube-Mix dataset possibly leaks training data to validation and testing #47
Description
Hi, I got aware of the youtube mix dataset, which is proposed in this work, via the following papers
- It's Raw! Audio Generation with State-Space Models
- Mamba: Linear-Time Sequence Modeling with Selective State Spaces
In these works, they use 88% of the files as training, and 6% respectively for validation and testing. At least for the current version of the youtube video referenced https://www.youtube.com/watch?v=EhO_MrRfftU, the video is about 45 min of pieces which are repeated 6 times and cut at 4 hours. The 88/6/6% strategy hence yields validation and test sets that are completely contained in the training dataset.
Since this repo is referenced by their works, it might be valuable for future researchers to be made aware of this issue with the YouTube-Mix dataset proposed in this repo.