RIR-in-a-Box: Estimating Room Acoustics from 3D Mesh Data through Shoebox Approximation - Télécom Paris Access content directly
Conference Papers Year : 2024

RIR-in-a-Box: Estimating Room Acoustics from 3D Mesh Data through Shoebox Approximation

Abstract

This paper describes a method for estimating the room impulse response (RIR) for a microphone and a sound source located at arbitrary positions from the 3D mesh data of the room. Simulat- ing realistic RIRs with pure physics-driven methods often fails the balance between physical consistency and computational ef- ficiency, hindering application to real-time speech processing. Alternatively, one can use MESH2IR, a fast black-box estima- tor that consists of an encoder extracting latent code from mesh data with a graph convolutional network (GCN) and a decoder generating the RIR from the latent code. Combining these two approaches, we propose a fast yet physically coherent estimator with interpretable latent code based on differentiable digital sig- nal processing (DDSP). Specifically, the encoder estimates a vir- tual shoebox room scene that acoustically approximates the real scene, accelerating physical simulation with the differentiable image-source model in the decoder. Our experiments showed that our method outperformed MESH2IR for real mesh data ob- tained with the depth scanner of Microsoft HoloLens 2, and can provide correct spatial consistency for binaural RIRs.
Fichier principal
Vignette du fichier
Interspeech_RIR_in_a_Box.pdf (859.17 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-04632526 , version 1 (02-07-2024)

Identifiers

  • HAL Id : hal-04632526 , version 1

Cite

Liam Kelley, Diego Di Carlo, Aditya Arie Nugraha, Mathieu Fontaine, Yoshiaki Bando, et al.. RIR-in-a-Box: Estimating Room Acoustics from 3D Mesh Data through Shoebox Approximation. INTERSPEECH, Sep 2024, Kos International Convention Center, Kos Island, Greece. ⟨hal-04632526⟩
0 View
0 Download

Share

Gmail Mastodon Facebook X LinkedIn More