Audio morphing using matrix decomposition and optimal transport

Gerard Roma, Owen Green, Pierre Alexandre Tremblay

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

This paper presents a system for morphing between audio recordings in a continuous parameter space. The proposed approach combines matrix decompositions used for audio source separation with displacement interpolation enabled by 1D optimal transport. Using NMF decompositions, the system allows varying the timbre of a sound in real time, while reproducing the temporal activations of its main components. Using HPSS as a preprocessing step, the system affords more detailed control of the interpolation in perceptually meaningful dimensions.
Original languageEnglish
Title of host publicationProceedings of the 23rd International Conference on Digital Audio Effects
EditorsGianpaolo Evangelista
Pages147-154
Number of pages8
Publication statusPublished - 4 Sep 2020
Externally publishedYes
Event23rd International Conference on Digital Audio Effects - Vienna, Austria
Duration: 9 Sep 202111 Sep 2021

Conference

Conference23rd International Conference on Digital Audio Effects
Country/TerritoryAustria
CityVienna
Period9/09/2111/09/21

Keywords

  • Audio Morphing
  • Matrix Decomposition
  • Optimal Transport

Fingerprint

Dive into the research topics of 'Audio morphing using matrix decomposition and optimal transport'. Together they form a unique fingerprint.

Cite this