Envelopment in Immersive Sound Reinforcement
Envelopment in Immersive Sound Reinforcement
Disciplines
Electrical Engineering, Electronics, Information Engineering (50%); Computer Sciences (10%); Physics, Astronomy (40%)
Keywords
-
Envelopment,
Psychoacoustic Experiments,
Sound Reinforcement,
6DoF acoustic virtualization,
Progressively Curved Line Sources,
Immersive Audio
Immersion denotes the perceived dive into a fictional world. Surround audio system is an essential contribution and has therefore been employed , e.g., in cinemas, for a long time. However, the sense of auditory envelopment only works convincingly at a few centred seats of the hall. The EnImSo project will advance the fundamental psychological-acoustical and technical understanding of the matter and investigate design criteria and technical solutions that are urgently needed. In the future these shall enable to enlarge the high-quality zone in the audience substantially, and it shall provide useful tools for sound engineers and sound artists. In the close proximity of a loudspeaker, the sound is much louder than further away. This holds for every single loudspeaker of a surround audio system. On a seat at the boundaries of the audience area, nearby loudspeakers will therefore be louder than the ones from the opposite side. This causes a loss of the balance in the auditory image and in part, sounds will be directionally drawn to the closest loudspeakers, or such from more distant directions might not be heard anymore and get lost, inadvertently altering the mix. Similarly, while reproduced reverberation may be heard as enveloping at the central seat, it sticks to the closest side at outer seats, which is not enveloping. Large-scale sound reinforcement employs optimally-curved line-source arrays for the frontal sound. These arrays are suspended from the top of the stage, can be nearly ten meters tall, and they are configured such that the whole audience area, from the stage to the most rear seats, is covered with a barely noticeable loss in sound level. This technology requires a lot of hardware, but serves as a starting point for new, more compact solutions. EnImSo investigates how surround systems need to be designed in order to provide all seats with an enveloping reverberation, but also how the balance between instruments and voices from different directions is maintained across the whole, extended audience area. Therefore, an extensive series of listening experiments will be conducted in the acoustics laboratory, with participating listeners and surrounding loudspeakers. The goal is to find out how specific conditions isolated from each other and combined affect what we hear. What are the effects on the perceived envelopment of changing levels, arrival times, and directional parallax, at which the surround loudspeakers appear for different seats? Which technical optimizations to the loudspeakers achieve successful improvements? Knowledge from the laboratory shall be tested in a listening experiment employing a large sound reinforcement system. Newly developed acoustic virtualization technology allows to digitally archive the extensive experimental setup for future use in research, accessible per virtual reality, also to other laboratories. Moreover, loudspeaker prototypes shall be built that advance rendering of envelopment for mid-sized audiences.
EnImSo (Envelopment in Immersive Sound Reinforcement) investigated how the auditory sensation of envelopment changes over listening positions in surround sound reinforcement, why its magnitude changes, and which improvements could be possible. Laboratory experiments with loudspeakers in the anechoic room revealed that simple point sources arranged for surround sound from the horizon are insufficient, despite they are common in cinemas or concert venues for electro-acoustic music, nowadays. Along the direct path, the sound of point sources get softer with 1 over the distance r, or audio-technically speaking: with a distance attenuation of -6dB/dod (decibels per doubling of the distance). As first central finding, contrary to point sources, our laboratory experiments showed surround reinforcement for diffuse sound (e.g. reverberation) to be optimal with -3dB/dod distance attenuation, whereas for surround reinforcement of different direct voices/instruments (without reverberation) requires -0dB/dod. As second key result, since distance attenuation that is only simulated for one dedicated listening position in the lab is not yet a loudspeaker type applicable in an event venue, the EnImSo project devised a design theory for progressively curved and phased line-source arrays. This loudspeaker type and the design theory enable to freely configure a -6 beta dB/dod distance attenuation via a design parameter beta. In the project, 3D printing technology was used to design and print small loudspeaker housings, out of which 8 such line arrays were built with 8 elements each, and therefore a total length of 64cm each. As third key result, listening experiments were carried out at the IEM CUBE, a venue for electroacoustic music, using the mini line arrays. Despite additional room acoustic influences, experiments clearly validated the laboratory experiments. Moreover, the benefit of a dual-target design was indeed confirmed, which meets both the -3dB/dod for diffuse, enveloping components in a mix, while direct single voice/instrument components use 0dB/dod. In another experiment, listeners found -1.5dB/dod an acceptable compromise with high quality. Within a master's thesis, the results and knowledge underwent further validation on professional, high-quality line-source and point-source loudspeakers in comparison in the L-ISA laboratory of the company L-Acoustics in London. The project moreover investigated the virtualisation of the loudspeaker types and auditory impressions regarded, and validated them in virtual acoustic reality, came up with a more detailed description of localisation properties, and investigated envelopment and engulfment regarding the required temporal and spatial event densities. And a mathematical theory on diffuse field synthesis could be published. The EnImSo team reached a true improvement in psychoacoustic and technical understanding of professional immersive sound reinforcement. It is going to improve technology in the upcoming decade and provides the relevant design criteria. Electroacoustic music and cinema sound will benefit from the improved means of artistic expression.
Research Output
- 3 Citations
- 30 Publications
- 1 Policies
- 5 Methods & Materials
- 3 Datasets & models
- 5 Software
- 12 Disseminations
- 5 Scientific Awards
- 1 Fundings
-
2024
Title Dual-target design for large-scale sound reinforcement: Simulation and evaluation Type Conference Proceeding Abstract Author Gölles L Conference AES 2024 International Conference on Acoustics & Sound Reinforcement Link Publication -
2024
Title Simulating the sweet area of immersive sound reinforcement with surrounding mini line arrays Type Conference Proceeding Abstract Author Frank M Conference Fortschritte der Akustik, DAGA Link Publication -
2024
Title Improving surround sound reinforcement at off-center listening positions with miniature line arrays Type Conference Proceeding Abstract Author Frank M Conference 156th AES Convention Link Publication -
2024
Title Evaluating a dual-target line-array design for medium-scale surround sound reinforcement Type Conference Proceeding Abstract Author Frank M Conference 156th AES Convention Link Publication -
2024
Title MCPyPan3D: mixing console's python-based panning tool for 3D audio at live events Type Conference Proceeding Abstract Author Gölles L Conference LEaTcon Science Talks -
2024
Title Curvature and Delay-Based Line-Array Design Type Conference Proceeding Abstract Author Gölles L Conference Fortschritte der Akustik, DAGA Link Publication -
2024
Title Simulating the Direct-Sound Coverage from the Directivity Measurement of a fully assembled Mini Line Array Type Conference Proceeding Abstract Author Gölles L Conference Fortschritte der Akustik, DAGA Link Publication -
2024
Title Spatial Perception of Multi-Source Scenarios in Real and Virtual Loudspeaker Arrangements Type Conference Proceeding Abstract Author Matthias Frank Conference DAGA Hannover Link Publication -
2024
Title A Study on Loudspeaker SPL Decays for Envelopment and Engulfment across an Extended Audience Area Type Conference Proceeding Abstract Author Matthias Frank Conference AES SIA Le Mans Link Publication -
2025
Title Spatial Resolution of Late Reverberation in Ambisonic Loudspeaker Playback Type Conference Proceeding Abstract Author Frank M Conference Fortschritte der Akustik, DAGA Link Publication -
2025
Title Design of a continuous line-source loudspeaker prototype Type Conference Proceeding Abstract Author Gölles L Conference Fortschritte der Akustik, DAGA Link Publication -
2025
Title Immersive Sound Reinforcement Type Other Author Gölles L Link Publication -
2025
Title Effect of HRTFs and head motion on auditory-visual localization in real and virtual studio environments DOI 10.1051/aacus/2025005 Type Journal Article Author Frank M Journal Acta Acustica -
2025
Title Localization, Envelopment, and Engulfment in Real and Virtual Loudspeaker Environments Type PhD Thesis Author Stefan Riedel Link Publication -
2025
Title Immersive Sound Reinforcement Type PhD Thesis Author Lukas Gölles Link Publication -
2025
Title Localization, Envelopment, and Engulfment in Real and Virtual Loudspeaker Environments DOI 10.13140/rg.2.2.35135.01440 Type Other Author Riedel S Link Publication -
2025
Title Towards Models for Listener Envelopment based on Binaural Multi-Source Localization Type Conference Proceeding Abstract Author Matthias Frank Conference DAS|DAGA Link Publication -
2025
Title Perceptual evaluation of professional point and line sources for immersive audio applications Type Conference Proceeding Abstract Author Franz Zotter Conference AES EUROPE 2025 Link Publication -
2024
Title Evaluation of Compressed Higher-Order Ambisonics at Off-Center Listening Positions DOI 10.1109/is262782.2024.10704209 Type Conference Proceeding Abstract Author Frank M Pages 1-7 -
2023
Title Theory of continuously curved and phased line sources for sound reinforcement DOI 10.1051/aacus/2023045 Type Journal Article Author Gölles L Journal Acta Acustica -
2023
Title The Effect of Temporal and Directional Density on Listener Envelopment DOI 10.17743/jaes.2022.0088 Type Journal Article Author Frank M Journal Journal of the Audio Engineering Society -
2022
Title Virtual Acoustics under Variable Ambisonic Perspectives Type Postdoctoral Thesis Author Franz Zotter Link Publication -
2022
Title Surrounding line sources optimally reproduce diffuse envelopment at off-center listening positions DOI 10.1121/10.0014168 Type Journal Article Author Riedel S Journal JASA Express Letters Pages 094404 Link Publication -
2023
Title Perceptual evaluation of listener envelopment using spatial granular synthesis DOI 10.48550/arxiv.2301.10210 Type Other Author Frank M Link Publication -
2023
Title Equalizing the coloration of different Ambisonic order weightings Type Conference Proceeding Abstract Author Frank M Conference Fortschritte der Akustik, DAGA Link Publication -
2023
Title Acceptable Imbalance of Sound-Object Levels for Off-Center Listeners in Immersive Sound Reinforcement Type Conference Proceeding Abstract Author Riedel S Conference Fortschritte der Akustik, DAGA Link Publication -
2023
Title Miniature line array for immersive sound reinforcement Type Conference Proceeding Abstract Author Gölles L Conference AES Conference on Spatial and Immersive Audio Link Publication -
2023
Title Modeling the Listening Area of Envelopment Type Conference Proceeding Abstract Author Gölles L Conference Fortschritte der Akustik, DAGA Link Publication -
2022
Title The Effect of Temporal and Directional Density on Perceived Envelopment Type Conference Proceeding Abstract Author Franz Zotter Conference DAGA Stuttgart Link Publication -
2022
Title Amplitude decorrelation avoiding spectral artifacts of sound field synthesis in the anechoic chamber or free sound field Type Conference Proceeding Abstract Author Franz Zotter Conference Internoise Glasgow Link Publication
-
2023
Title Sound Reinforcement and 3D Audio Lecturing Material Type Influenced training of practitioners or researchers
-
2025
Link
Title Prototype of a line source with waveguide Type Improvements to research infrastructure Public Access Link Link -
2023
Link
Title Miniature Line Arrays (8x8 channels) Type Improvements to research infrastructure Public Access Link Link -
2023
Link
Title Granular Encoder Type Improvements to research infrastructure Public Access Link Link -
2022
Link
Title PyMIMOIR Measurement Software Type Improvements to research infrastructure Public Access Link Link -
0
Link
Title PyMIMOIR Measurement Software Type Improvements to research infrastructure Public Access Link Link
-
2024
Link
Title Coverage Measurement of a Miniature Line Array Type Database/Collection of data Public Access Link Link -
2023
Link
Title Miniature Line Array CAD Model Type Database/Collection of data Public Access Link Link -
2023
Link
Title Directivity Measurement of a Miniature Line Array Type Database/Collection of data Public Access Link Link
-
2024
Link
Title Mixed Line Array Designer with iterative gain calculation Link Link -
2023
Link
Title Granular Encoder VST Plugin Link Link -
2023
Link
Title Line Array Designer Link Link -
2023
Link
Title Line Array Designer considering Two Targets Link Link -
2023
Link
Title Line Array Designer for Phased Arrays Link Link
-
2025
Link
Title DEGEM Symposium Type A talk or presentation Link Link -
2025
Title Tonmeistertagung Type A talk or presentation -
2023
Link
Title Workshop/Lecture at Ottosonics Festival Type Participation in an activity, workshop or similar Link Link -
2025
Link
Title SMC Summer School Type Participation in an activity, workshop or similar Link Link -
2025
Title Article in VDT Magazine Type A magazine, newsletter or online publication -
2023
Link
Title Surround-Beschallung mit Line Arrays Type A talk or presentation Link Link -
2024
Title Lange Nacht der Forschung 2024, Lab Tours, Open Days for Students Type Participation in an open day or visit at my research institution -
2023
Link
Title Räumliche Granularsynthese: Von der Psychoakustik zum GranularEncoder Type A talk or presentation Link Link -
2022
Title Workshop for Holoplot Type Participation in an activity, workshop or similar -
2024
Link
Title ARI Guest Talk Type A talk or presentation Link Link -
2024
Link
Title Was hat Newton'sche Kugelschalentheorem mit Schallfeldreproduktion zu tun? Type A talk or presentation Link Link -
2025
Link
Title Enhancing the spatial resolution of first-order Ambisonic room impulse responses Type A talk or presentation Link Link
-
2025
Title WKO Forschungsstipendium 2025 Type Poster/abstract prize Level of Recognition Regional (any country) -
2025
Title AES EUROPE Best Technical Paper Award, 2025 Type Poster/abstract prize Level of Recognition Continental/International -
2024
Title Best Student Contributions Award, Silver at LEaTcon, Hamburg Type Poster/abstract prize Level of Recognition Continental/International -
2024
Title AES Board of Governors Award Type Awarded honorary membership, or a fellowship, of a learned society Level of Recognition Continental/International -
2023
Title AES SIA Best Student Paper Award 2023 Type Poster/abstract prize Level of Recognition Continental/International
-
2023
Title Interaktive audiovisuelle Digital Twins von Aufführungsorten Type Capital/infrastructure (including equipment) Start of Funding 2023 Funder Federal Ministry of Science, Research and Economy (BMWFW)