Partial Generation Demo (Slakh)

MGE-LDM: Simultaneous Music Generation and Extraction via Joint Latent Modeling

Home Total Generation (Slakh) Source Extraction (Slakh)

Partial Generation Samples

Bass Imputation

Given Mixture MSDM[1] MSG-LD[2] MGE-LDM (ours)
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel

Gen: generated bass
Mix: given mixture + generated bass

Drums Imputation

Given Mixture MSDM[1] MSG-LD[2] MGE-LDM (ours)
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel

Gen: generated drums
Mix: given mixture + generated drums

Guitar Imputation

Given Mixture MSDM[1] MSG-LD[2] MGE-LDM (ours)
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel

Gen: generated guitar
Mix: given mixture + generated guitar

Piano Imputation

Given Mixture MSDM[1] MSG-LD[2] MGE-LDM (ours)
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel
Mel Gen Mel Mel Mel
Mix Mel Mel Mel

Gen: generated piano
Mix: given mixture + generated piano

[1] Giorgio Mariani, et al., "Multi-Source Diffusion Models for Simultaneous Music Generation and Separation."
ICLR 2024. [Paper]
[2] Tornike Karchkhadze, et al., "Simultaneous music separation and generation using multi-track latent diffusion models."
ICASSP 2025. [Paper]