Joyce Horn Fonteles

Vanderbilt University | Vander Bilt · Department of Electrical Engineering and Computer Science

Embodied learning represents a natural and immersive approach to education, where the physical engagement of learners plays a critical role in how they perceive and internalize concepts. This allows students to actively embody and explore knowledge through interaction with their environment, significantly enhancing retention and understanding of co...

Recent advances in generative artificial intelligence (AI) and multimodal learning analytics (MMLA) have allowed for new and creative ways of leveraging AI to support K12 students' collaborative learning in STEM+C domains. To date, there is little evidence of AI methods supporting students' collaboration in complex, open‐ended environments. AI syst...

Recent technological advancements have enhanced our ability to collect and analyze rich multimodal data (e.g., speech, video, and eye gaze) to better inform learning and training experiences. While previous reviews have focused on parts of the multimodal pipeline (e.g., conceptual models and data fusion), a comprehensive literature review on the me...

This study presents a novel framework for 3D gaze tracking tailored for mixed-reality settings, aimed at enhancing joint attention and collaborative efforts in team-based scenarios. Conventional gaze tracking, often limited by monocular cameras and traditional eye-tracking apparatus, struggles with simultaneous data synchronization and analysis fro...

There is a potential for immersive tools that can teach some basic aspects of conducting in a constructive way. This work presents a Kinect-based conducting system that uses a gestural interface for visualization of musical structures, aimed towards educational purpose. The system provides a solution that enables students to practice conducting wit...

This work presents an interactive musical game for health using MIDI files and the Leap Motion controller to detect gesture input from the users' hands and fingers. The musical notes of each song determine when specific hand gestures should be performed, creating physical activities that stimulate the hand motor development, as well as the learning...

In this work, we present and evaluate an interactive simulation of 3D particles conducted by the Leap Motion, for an orchestral arrangement. A real-time visual feedback during gesture entry is generated for the conductor and the audience, through a set of particle emitters displayed on the screen and the path traced by the captured gesture. We use...

In this work, we present a visual and interactive performance of particles conducted by the Leap Motion, for an orchestral arrangement. A visual and gestural feedback in real-time is generated for the conductor and the audience, through the display of a set of particle emitters and the path travelled by the captured gesture. The system we have deve...

We present a 3D particle system and a mapping algorithm to generate real-time animations of virtual emitter fountains, choreographed by music. Adittionally, we included two different examples of use to demonstrate the main system's aspects, its functionality and feasibility. In particular, we show that is possible to identify different visual patte...

In this paper, we present a simplified 3D particle system and fast translation algorithm we have designed and implemented to generate real-time animated particle emitter fountains choreographed by a classical music. The approach we used to translate and map the controlling information into the musical fountain animation is also introduced, as well...