(3D) Audio MoCap

"AudioMocap" fits in the broader context of an investigation into the possibilities of 3D audio in relation to 360 Film, VR and in extension Volumetric video where the use of visual spatial information is used to make a determination of audio in a spatial context.
The correspondence between image and sound is pursued with particular attention to the positioning in the 3D space that is simulated in a 360° environment. Not only is a one-to-one approach sought, or as faithful a reconstruction of reality as possible, but also the creative possibilities and solutions for the problems that arise in the production and post-production of 360 video for cinema and VR.
The intention is to arrive at one (or more) workflows by means of various test set-ups in which 360 audio and video are recorded and processed in different ways, resulting in a workflow package and potentially an audiovisual end product or work-in-progress.

Research unit: LABOpro

Duration: 2021 - 2023

Kasper Jordaens

Jürgen De Blonde

Marc Van De Walle