Robert HupkeLeibniz Universität Hannover · Institute of Communications Technology
Robert Hupke
Master of Science
About
26
Publications
2,235
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
77
Citations
Citations since 2017
Introduction
Publications
Publications (26)
Networked Music Performances (NMP) are of increasing importance for musical enthusiasts, amateurs and professionals exploring new solutions and opportunities to rehearse or perform together at geographically distant locations. The use of public cellular connectivity to access wide area networks for such purposes can provide unique flexibility in pl...
This paper presents an Extended Reality Environment (XRE) for Immersive Networked Music Performances (INMP) called Immersive Room ExtensioN Environment (IRENE). The design of the IRENE-system includes a position-dependent visual and auditory representation of the users within a Virtual Room Extension (VRE). Early reflections and diffuse reverberati...
Networked Music Performances (NMPs) are of increasing importance for creative and cultural professionals exploring new solutions and opportunities to perform at geographically distant locations. Although latency is one of the most important parameters for the transmission of audio information, it is rarely possible to obtain insights into the indiv...
Modern communication networks enable audiovisual interaction between geographically distant locations in near real time, leading to an increasing interest in networked music performance (NMP) and growing availability of related tools and applications. An important point of such distributed performances is the nature of interaction between the perfo...
Training convolutional recurrent neural networks (CRNNs) on first-order Ambisonics signals is a well-known approach for estimating the direction of speech/sound arrival. In this work, we investigate whether increasing the order of Ambisonics signals up to the fourth order further improves the estimation performance of CRNNs. While our results on da...
Knowledge of room acoustic parameters such as frequency-and direction-dependent reflection coefficients, room volume, or geometric characteristics is important for the mod-eling of acoustic environments, e. g. to improve the plausibility of immersive audio in mixed reality applications or to transfer a physical acoustic environment into a completel...
Achieving synchronicity and tempo stability during a Network Music Performance (NMP) is not straightforward under heavy network latency conditions. Previous work on Global Metronomes has shown that it is possible to provide a universal time-reference signal to the connected nodes of an NMP. This paper illustrates the effects of using a global metro...
Distributed performances of musicians at distant locations are recently enjoying increasing interest due to the availability of larger bandwidths in network and mobile communication. Modern spatial audio capturing and multichannel reproduction techniques could make these performances an immersive and more realistic experience. But a bidirectional a...
The research project �LIPS� (Live Interactive PMSE Services 1)� aims at enabling tele-conferencing and distributed music performances in a most natural and im-mersive way. To provide a most plausible acoustic environment for the distributed interacting participants the Institut für Kommunikationstechnik (IKT) is working on Immersively Connected Roo...
The New York University and the Leibniz University Hannover are working on future immersive Networked Music Performances. One of the biggest challenges of audio data transmission over IP-based networks is latency, which can affect the interplay of the participants. In this contribution, two metronomes, utilizing the Global Positioning System to gen...
Several rhythmic experiments with pairs drawn from a group of 23 subjects were performed to investigate the effect of a global metronome on the ensemble accuracy in Networked Music Performance (NMP). Artificial delays up to 91 ms were inserted into the audio transmission between the subjects. To investigate the dependencies between delay times, ens...
Im Rahmen des vom Bundesministerium für Wirtschaft und Energie geförderten Projekts "LIPS-Live Interactive PMSE Services" arbeiten die Projektpartner aus Industrie und Forschung an einer immersiven audiovi-suellen Verbindung zwischen entfernten Räumlichkeiten, die es Menschen erlaubt in einer möglichst natürlichen Art und Weise miteinander kommuniz...
Within the project "Live Interactive PMSE Services" (LIPS) the Institute of Communication Technology (IKT) is investigating novel interactive concepts for the immersive audiovisual linking of live events at different geographic locations. The project has the aim to develop solutions to improve access and participation of rural areas in the creative...
The emerging production of 3D audio content results in new challenges regarding the optimization of the production processes for VR/AR applications as well as for 3D music or film productions. This contribution presents a novel approach of a virtual audiovisual environment for 3D audio production based on a real listening room with different loudsp...
The equalization of room acoustic influences on the sound transmission from a source (loudspeaker) to a receiver (listener/microphone) is a well known problem in audio engineering and academia that led to various equalization methods. However, many highly effective approaches lack of either robustness, practicability or usability. This paper thus p...
With the usage of future 4G+/5G technologies in wireless equipment for “Programme Making and Special Events” (PMSE) new innovative live services and applications are possible. In this paper our novel “Assistive Live Listening Service” is presented. The service provides individualized additional augmented audio content to every single listener at a...
In the course of the project PMSE-xG an audience service for live events – the Assistive Live Listening Service – was developed. The service uses supplementary augmented audio content presented through transparent headphones to enhance the traditional audio playback of a PA loudspeaker system. Augmented audio content and ambient sound are temporall...
Our novel audience service for live events uses supplementary audio content presented through transparent
headphones to enhance the traditional audio playback of a PA loudspeaker system. The service requires to estimate
the propagation delay of sound waves from the PA loudspeakers to the listener in order to individually delay the
supplementary aud...
This engineering brief presents the novel multichannel audio laboratory for immersive media applications of the Institut für Kommunikationstechnik (IKT) with its varying multichannel loudspeaker arrangements and acoustical transparent projection screens of nearly 270°. We address the construction process and setup of the laboratory called Immersive...
In augmented reality audio applications a superposition of environmental sounds and supplementary audio content is used to create auditory enhancements for the listener in a broad range of use cases. In some use cases environmental sounds and supplementary content may be highly correlated, for example in audience services at live events, where a li...
![Figure 1: Summary of Use Cases [1].](profile/Robert-Hupke/publication/325153628/figure/fig1/AS:626552161202176@1526393084057/Summary-of-Use-Cases-1_Q320.jpg)
PMSE-xG is a research project studying 4G+/5G technologies and their usage in wireless equipment for "Programme Making and Special Events" (PMSE) applications. The PMSE-xG project has the vision of delivering important advancements in the creative industry ecosystem, focusing on audio and video applications as well as potential new audience service...
Im Rahmen der Sanierung des Kuppelsaals, einem Konzertsaal im Congress Centrum Hannover mit Raum für 3600 Personen, wurde in Zusammenarbeit mit der Universität Hannover und der Firma Sennheiser electronic im Vorfeld der Sanierungsarbeiten ein raumakustisches Modell gebaut. Aufgrund der runden Primärform des Kuppelsaals und den daraus resultierenden...
Projects
Projects (2)
- Solutions to improve access and participation of rural areas in the creative, cultural and political operation of metropolitan areas (basic cultural services) and vice versa.
- Development and demonstration of novel, smart services for the interactive and immersive linking of and to events of the CCI.
- Introduction of smart, innovative services based on new technologies of event and production technology, taking advantage of technological convergence of production and distribution networks for live production and live distribution (e.g. participation in events via AV immersion).
LIPS also provides solutions to enable people with disabilities who are unable to travel to a political or cultural event due to disability or illness to participate holistically and immersively. LIPS makes significant contributions to inclusion and participation.
With the immersive participation in events in the city by participants from the countryside, and vice versa, the cultural attractiveness and effectiveness of rural areas is increased.
http://www.lips-project.de/
