Audio morphing using matrix decomposition and optimal transport

Gerard Roma; Owen Green; Pierre Alexandre Tremblay

Audio morphing using matrix decomposition and optimal transport

Gerard Roma, Owen Green, Pierre Alexandre Tremblay

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

4 Citations (Scopus)

Abstract

This paper presents a system for morphing between audio recordings in a continuous parameter space. The proposed approach combines matrix decompositions used for audio source separation with displacement interpolation enabled by 1D optimal transport. Using NMF decompositions, the system allows varying the timbre of a sound in real time, while reproducing the temporal activations of its main components. Using HPSS as a preprocessing step, the system affords more detailed control of the interpolation in perceptually meaningful dimensions.

Original language	English
Title of host publication	Proceedings of the 23rd International Conference on Digital Audio Effects
Editors	Gianpaolo Evangelista
Pages	147-154
Number of pages	8
Publication status	Published - 4 Sept 2020
Externally published	Yes
Event	23rd International Conference on Digital Audio Effects - Vienna, Austria Duration: 9 Sept 2021 → 11 Sept 2021

Academic conference

Academic conference	23rd International Conference on Digital Audio Effects
Country/Territory	Austria
City	Vienna
Period	9/09/21 → 11/09/21

Keywords

Audio Morphing
Matrix Decomposition
Optimal Transport

Access to Document

https://dafx2020.mdw.ac.at/proceedings/DAFx2020Proceedings.pdfLicence: Unspecified

Cite this

@inproceedings{ca1782a8bef94dae85373e3c035ffae6,

title = "Audio morphing using matrix decomposition and optimal transport",

abstract = "This paper presents a system for morphing between audio recordings in a continuous parameter space. The proposed approach combines matrix decompositions used for audio source separation with displacement interpolation enabled by 1D optimal transport. Using NMF decompositions, the system allows varying the timbre of a sound in real time, while reproducing the temporal activations of its main components. Using HPSS as a preprocessing step, the system affords more detailed control of the interpolation in perceptually meaningful dimensions.",

keywords = "Audio Morphing, Matrix Decomposition, Optimal Transport",

author = "Gerard Roma and Owen Green and Tremblay, {Pierre Alexandre}",

note = "Conference code: 23; 23rd International Conference on Digital Audio Effects ; Conference date: 09-09-2021 Through 11-09-2021",

year = "2020",

month = sep,

day = "4",

language = "English",

pages = "147--154",

editor = "Gianpaolo Evangelista",

booktitle = "Proceedings of the 23rd International Conference on Digital Audio Effects",

}

TY - GEN

T1 - Audio morphing using matrix decomposition and optimal transport

AU - Roma, Gerard

AU - Green, Owen

AU - Tremblay, Pierre Alexandre

N1 - Conference code: 23

PY - 2020/9/4

Y1 - 2020/9/4

N2 - This paper presents a system for morphing between audio recordings in a continuous parameter space. The proposed approach combines matrix decompositions used for audio source separation with displacement interpolation enabled by 1D optimal transport. Using NMF decompositions, the system allows varying the timbre of a sound in real time, while reproducing the temporal activations of its main components. Using HPSS as a preprocessing step, the system affords more detailed control of the interpolation in perceptually meaningful dimensions.

AB - This paper presents a system for morphing between audio recordings in a continuous parameter space. The proposed approach combines matrix decompositions used for audio source separation with displacement interpolation enabled by 1D optimal transport. Using NMF decompositions, the system allows varying the timbre of a sound in real time, while reproducing the temporal activations of its main components. Using HPSS as a preprocessing step, the system affords more detailed control of the interpolation in perceptually meaningful dimensions.

KW - Audio Morphing

KW - Matrix Decomposition

KW - Optimal Transport

M3 - Conference contribution

SP - 147

EP - 154

BT - Proceedings of the 23rd International Conference on Digital Audio Effects

A2 - Evangelista, Gianpaolo

T2 - 23rd International Conference on Digital Audio Effects

Y2 - 9 September 2021 through 11 September 2021

ER -

Audio morphing using matrix decomposition and optimal transport

Abstract

Academic conference

Keywords

Access to Document

Fingerprint

Cite this