| Project Detail |
CROWDMERSE enables real-time capture, processing, and reproduction of an immersive audio experience to the user of any event of interest, focusing on “crowded” acoustic events. Acoustic scenes with large audiences, such as sports events or music concerts, present significant challenges for immersive reproduction which have not been so far adequately considered in the signal processing community. Technological breakthrough in sports events broadcasting has a strong potential impact on media providers, and consequently on the European and global economy. The challenges of capturing and reproducing crowded acoustic events include the need to spatially capture and reproduce numerous sound sources, such as the applause and yells of the spectators, in addition to the “main” sounds of the event. Concerns regarding the privacy of the spectators must not be overlooked: the conversations of the audience members sitting near the microphone sensors must be eliminated. In order to spatially sample large venues, the acoustic sensors should be low-cost, small-sized, and support wireless operation. The developed algorithms should respect the limited sensor resources, while operating in real-time to enable commercial applications. Our final objective is to enable real-time delivery of crowded acoustic events so that the designed platform can be integrated with today’s High-Definition TV programs. CROWDMERSE focuses on sound capturing using multiple closely placed microphones forming a microphone array. The audio content is rendered through a home entertainment system equipped with multiple loudspeakers, accompanying the content of a typical HDTV broadcast. Addressing the scientific challenges and proposing a solution which can be integrated with current broadcasting principles is guaranteed given the previous involvement of the experienced researcher in sports broadcasting projects. The proposed methods are expected to have impact in the general area of immersive sound environments. |
