Unsupervised Music Source Separation Using Differentiable Parametric Source Models - Télécom Paris
Article Dans Une Revue IEEE/ACM Transactions on Audio, Speech and Language Processing Année : 2023

Unsupervised Music Source Separation Using Differentiable Parametric Source Models

Kilian Schulze-Forster
Liam Kelley
  • Fonction : Auteur
Clement Doire

Résumé

Supervised deep learning approaches to underdetermined audio source separation achieve state-of-the-art performance but require a dataset of mixtures along with their corresponding isolated source signals. Such datasets can be extremely costly to obtain for musical mixtures. This raises a need for unsupervised methods. We propose a novel unsupervised model-based deep learning approach to musical source separation. Each source is modelled with a differentiable parametric source-filter model. A neural network is trained to reconstruct the observed mixture as a sum of the sources by estimating the source models' parameters given their fundamental frequencies. At test time, soft masks are obtained from the synthesized source signals. The experimental evaluation on a vocal ensemble separation task shows that the proposed method outperforms learning-free methods based on nonnegative matrix factorization and a supervised deep learning baseline. Integrating domain knowledge in the form of source models into a data-driven method leads to high data efficiency: the proposed approach achieves good separation quality even when trained on less than three minutes of audio. This work makes powerful deep learning based separation usable in scenarios where training data with ground truth is expensive or nonexistent
Fichier principal
Vignette du fichier
Unsupervised_Music_Source_Separation_Using_Differentiable_Parametric_Source_Models-3.pdf (1.84 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04038023 , version 1 (28-03-2023)

Identifiants

Citer

Kilian Schulze-Forster, Gaël Richard, Liam Kelley, Clement Doire, Roland Badeau. Unsupervised Music Source Separation Using Differentiable Parametric Source Models. IEEE/ACM Transactions on Audio, Speech and Language Processing, 2023, 31, pp.1276-1289. ⟨10.1109/TASLP.2023.3252272⟩. ⟨hal-04038023⟩
89 Consultations
220 Téléchargements

Altmetric

Partager

More