About
214
Publications
72,134
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
4,078
Citations
Introduction
Algorithm transparency
Immersive Analytics
Current institution
Additional affiliations
September 2016 - February 2017
January 2011 - March 2016
Publications
Publications (214)
We propose a half-day workshop at IEEE VIS 2025 on addressing the emerging challenges in data-rich multimodal remote collaboration. We focus on synchronous, remote, and hybrid settings where people take part in tasks such as data analysis, decision-making, and presentation. With this workshop, we continue successful prior work from the first MERCAD...
This research explores the design and evaluation of a webcam-based presentation tool that enables presenters to directly interact with web content via free-hand gestures. Our approach consists of overlaying the webcam video feed on top of web browser content to enable live presentations of any webpage. To support interactive presentations, we desig...
This paper presents an investigation into the development of generic Quick Access Recorder (QAR) fuel flow regression models applied to Automatic Dependent Surveillance-Broadcast (ADS-B) data, with the aim of improving the accuracy of fuel flow estimates for various aircraft operations. Given the critical need for accurate fuel consumption estimate...
This article explores how the ability to recall information in data visualizations depends on the presentation technology. Participants viewed 10 Isotype visualizations on a 2D screen, in 3D, in Virtual Reality (VR) and in Mixed Reality (MR). To provide a fair comparison between the three 3D conditions, we used LIDAR to capture the details of the p...
Although mind-wandering decreases processing of external information, it remains understudied in air traffic controllers (ATCOs), who must constantly attend to external information. Using autobiographical memory retrieval, we propose an innovative protocol to mimic the moment when ATCOs start mind-wandering. A total of 16 participants performed an...
A significant increase in air traffic is expected in the coming years. Air traffic controllers (ATCOs) will play a pivotal role in ensuring the efficient management of this growing traffic by optimizing flight paths and addressing various constraints , including environmental concerns. Consequently, they bear a high level of responsibility, as huma...
It is common to look away while trying to remember specific information, for example during autobiographical memory retrieval, a behavior referred to as gaze aversion. Given the competition between internal and external attention, gaze aversion is assumed to play a role in visual decoupling, i.e., suppressing environmental distractors during intern...
Deriving general rules to estimate a neural network sample complexity is a difficult problem. Therefore, in practice, datasets are often large to ensure sufficient class samples representation. This comes at the cost of high power consumption and long training time. This paper introduces a novel data reduction method for Deep Learning classifiers,...
Social networks have become important objects of study in recent years. Social media marketing has, for example, greatly benefited from the vast literature developed in the past two decades. The study of social networks has taken advantage of recent advances in machine learning to process these immense amounts of data. Automatic emotional labeling...
Episodic autobiographical memory (AM) retrieval consists of remembering and mentally reliving memories such as last Saturday’s dinner. It involves a complex cascade of cognitive operations, including the creation of a temporary internal mental space where the episode can be re-instantiated. We are re-appraising this cascade as current models appear...
Remembering and mentally reliving yesterday’s lunch is a typical example of episodic autobiographical memory retrieval. In the present review, we reappraised the complex cascade of cognitive processes involved in memory retrieval, by highlighting one particular phase that has received little interest so far: attentional switch to memory (ASM). As a...
We present a novel, web-based visual eye-tracking analytics tool called Gazealytics. Our open-source toolkit features a unified combination of gaze analytics features that support flexible exploratory analysis, along with annotation of areas of interest (AOI) and filter options based on multiple criteria to visually analyse eye tracking data across...
Aviation incidents resulting from attentional failures continue to occur. Attention is a limited resource and perceptual decoupling occurs when the attention switches away from the outside world to focus on the inner mental world. This phenomenon dramatically decreases visual perception, but is common and frequent since human beings spend nearly ha...
Recently, Artificial intelligence (AI) algorithms have received increasable interest in various application domains including in Air Transportation Management (ATM). Different AI in particular Machine Learning (ML) algorithms are used to provide decision support in autonomous decision-making tasks in the ATM domain e.g., predicting air transportati...
Autobiographical memory retrieval is initiated by an attentional switch from the outside world to a temporary internal mental space. Gaze aversion is assumed to play a role during this phase, but has received very limited attention thus far. We designed a protocol where 33 participants answered 48 autobiographical questions while their eye movement...
We present Target Netgrams as a visualization technique for radial layouts of graphs. Inspired by manually created target sociograms, we propose an annulus-constrained stress model that aims to position nodes onto the annuli between adjacent circles for indicating their radial hierarchy, while maintaining the network structure (clusters and neighbo...
Electro-oculography (EOG)-based brain–computer interface (BCI) is a relevant technology influencing physical medicine, daily life, gaming and even the aeronautics field. EOG-based BCI systems record activity related to users’ intention, perception and motor decisions. It converts the bio-physiological signals into commands for external hardware, an...
Moving object analysis is a constantly growing field with numerous concrete applications in terms of traffic understanding, prediction and simulation. While many algorithms and analytic processes exist, there are still areas of investigation with novel trajectory analysis methods. As such, the geometric information analyses data with respect to its...
Remembering and mentally reliving yesterday’s lunch is a typical example of episodic autobiographical memory retrieval. In the present review, we reappraised the complex cascade of cognitive processes involved in memory retrieval, by highlighting one particular phase that has received little interest so far: attentional switch to memory (AStoM). As...
Eye tracking is growing in popularity for multiple application areas, yet analysing and exploring the large volume of complex data remains difficult for most users. We present a comprehensive eye tracking visual analytics system to enable the exploration and presentation of eye-tracking data across time and space in an efficient manner. The applica...
Air Traffic Management (ATM) will be more complex in the coming decades due to the growth and increased complexity of aviation and has to be improved in order to maintain aviation safety. It is agreed that without significant improvement in this domain, the safety objectives defined by international organisations cannot be achieved and a risk of mo...
Recent studies on covert attention suggested that the visual processing of information in front of us is different, depending on whether the information is present in front of us or if it is a reflection of information behind us (mirror information). This difference in processing suggests that we have different processes for directing our attention...
We developed a Spiking Neural Network composed of two layers that processes event-based data capturedby a dynamic vision sensor during navigation conditions. The training of the network was performed usinga biologically plausible and unsupervised learning rule, Spike-Timing-Dependent Plasticity. With such anapproach, neurons in the network naturall...
Thermography-based physiological measurement is an active re-search topic. Using such contact-free approach can be particularly helpful for detecting pilots’ mental state in operational settings. In particular, thermal infrared imaging of the face is a powerful and non-invasive tool that enables rapid and automatic analysis of changes in regional f...
Behavioral performance metrics employed to assess the usability of visual displays are increasingly coupled with eye tracking measures to provide additional insights into the decision-making processes supported by visual displays. Eye tracking metrics can be coupled with users' neural data to investigate how human cognition interplays with emotions...
In this paper, a complete tool for real-time detection of atypical energy behaviors of airplanes is presented. The methodology extends in real time an existing offline process using Dubins trajectories as a predictor of the remaining distance to the runway threshold. Two major contributions are presented in this paper. First, a real-time measure of...
Creating simplified visualizations of large 3D trail sets with limited occlusion and preservation of the main structures in the data is challenging. We address this challenge for the specific context of 3D fiber trails created by DTI tractography. For this, we propose to jointly simplify trails in both the geometric space (by extending and adapting...
Pervasive data have become a key source of information for mobility and transportation analyses. However, as a secondary source, it has a different methodological origin than travel survey data, usually relying on unsupervised algorithms, and so it requires to be assessed as a dataset. This assessment is challenging, because, in general, there is n...
Extended Reality (XR) systems (which encapsulate AR, VR and MR) is an emerging field which enables the development of novel visualization and interaction techniques. To develop and to assess such techniques, researchers and designers have to face choices in terms of which development tools to adopt, and with very little information about how such t...
A fundamental part of data visualization is transforming data to map abstract information onto visual attributes. While this abstraction is a powerful basis for data visualization, the connection between the representation and the original underlying data (i.e., what the quantities and measurements actually correspond with in reality) can be lost....
A fundamental part of data visualization is transforming data to map abstract information onto visual attributes. While this abstraction is a powerful basis for data visualization, the connection between the representation and the original underlying data (i.e., what the quantities and measurements actually correspond with in reality) can be lost....
Animated visualizations are one of the methods for finding and understanding complex structures of time‐dependent vector fields. Many visualization designs can be used to this end, such as streamlines, vector glyphs, and image‐based techniques. While all such designs can depict any vector field, their effectiveness in highlighting particular field...
Self-tracking feedback with engaging and persuasive visualizations not only helps convey data but can also affect people's attitudes and behaviors. We investigate persuasive self-tracking feedback by augmenting data videos (DVs)-novel, engaging storytelling media. We introduce a new class of DVs, called Persuasive Data Videos (PDVs), by incorporati...
We investigated the contribution of specific HCI concepts to provide multimodal information to Air Traffic Controlers in the context of Remote Control Towers (i.e. when an airport is controlled from a distant location). We considered interactive spatial sound, tactile stimulation and body movements to design four different interaction and feedback...
This book constitutes thoroughly revised and selected papers from the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, VISIGRAPP 2019, held in Prague, Czech Republic, in February 2019. The 25 thoroughly revised and extended papers presented in this volume were carefully reviewed and sele...
The position and optionally speed and/or size of an entity such as a vehicle in an environment such as an airport, motorway, shipping port or the like may be determined by monitoring a plurality of light sources for occlusion. These light sources may be arbitrary light sources as provided in the environment for unrelated purposes. On the basis of t...
Traffic status feedback is provided by a driveradapted to interface with a human perceptible vibrationtransducer either as a haptic or audio signal, by causingthe transducer to emit a vibration having one or morecharacteristics defined in proportion to traffic data. Thetraffic data may relate to a particular space, and be mod-ulated as a function o...
New solutions in operational environments are often, among objective measurements, evaluated by using subjective assessment and judgment from experts. Anyhow, it has been demonstrated that subjective measures suffer from poor resolution due to a high intra and inter-operator variability. Also, performance measures, if available, could provide just...
A graphics processor in which vertex records additionally comprise a texture index, referring to a position in a texture index table. This position is used to store a dynamic characterising value for that vertex. When a render target processes the vertices to render a respective image, it does so in a manner modulated by the corresponding dynamic c...
User implementations for the selection of vertices in an image space are provided where the coincidence between a container defined in the image space and other vertices is determined, and vertices falling within the container are considered to have been selected. In certain variants, multiple containers may be provided, and selections determined o...
Recent technological advances in immersive devices open up many opportunities for users to visualize data in their environments. However, current interactive solutions fail at providing a convenient approach to manipulate such complex immersive visualizations. In this article, we present a new approach to interact in these environments, that we cal...
We present a new technique to enable the creation of shape-bounded Wordles, we call ShapeWordle, in which we fit words to form a given shape. To guide word placement within a shape, we extend the traditional Archimedean spirals to be shape-aware by formulating the spirals in a differential form using the distance field of the shape. To handle non-c...
Many edge bundling techniques (i.e., data simplification as a support for data visualization and decision making) exist but they are not directly applicable to any kind of dataset and their parameters are often too abstract and difficult to set up. As a result, this hinders the user ability to create efficient aggregated visualizations. To address...
We investigate the mechanisms of attentional orienting in a 360-degree virtual environments. Through the use of Posner's paradigm, we study the effects of different attentional guidance techniques designed to improve information processing. The most efficient technique will be applied to a procedure learning tool in virtual reality and a remote air...
We investigate the smooth pursuit eye movement based interaction using an unmodified off-the-shelf RGB camera. In each pair of sequential video frames, we compute the indicative direction of the eye movement by analyzing flow vectors obtained using the Lucas-Kanade optical flow algorithm. We discuss how carefully selected low vectors could replace...
The virtual reality (VR) has nowadays numerous applications in training, education, and rehabilitation. To efficiently present the immersive 3D stimuli, we need to understand how spatial attention is oriented in VR. The efficiency of different cues can be compared using the Posner paradigm. In this study, we designed an ecological environment where...
The virtual reality (VR) has nowadays numerous applications in training, education, and rehabilitation. To efficiently present the immersive 3D stimuli, we need to understand how spatial attention is oriented in VR. The efficiency of different cues can be compared using the Posner paradigm. In this study, we designed an ecological environment where...
In an effort to simplify human resource management and reduce costs, control towers are now more and more designed to not be implanted directly on the airport but remotely. This concept, known as Remote Control Tower, offers a “digital” working context because the view on the runways is broadcast remotely via cameras, which are located on the physi...
We introduce IATK, the Immersive Analytics Toolkit, a software package for Unity that allows interactive authoring and exploration of data visualisation in immersive environments. The design of IATK was informed by interdisciplinary expert-collaborations as well as visual analytics applications and iterative refinement over several years. IATK allo...
Eye tracking systems have recently experienced a diversity of novel calibration procedures, including smooth pursuit and vestibulo-ocular reflex based calibrations. These approaches allowed collecting more data compared to the standard 9-point calibration. However, the computation of the mapping function which provides planar gaze positions from pu...
This dataset contains the calibration error per participant in x- and y-axis for marker calibration using standard regression.
The data were used to prepare Table 3.
(XLSX)
This dataset contains the calibration error per participant in x- and y-axis for marker calibration using symbolic regression after 1s, 10s, and 30s.
The data were used to prepare Table 4.
(XLSX)
This dataset contains the calibration error per participant in x- and y-axis for finger calibration using symbolic regression after 1s, 10s, and 30s.
The data were used to prepare Table 6.
(XLSX)
This dataset contains the calibration error per participant in x- and y-axis for finger calibration using standard regression.
The data were used to prepare Table 5.
(XLSX)
Also published as: CN108874335 (A) EP3404620 (A1)
Recent technological advancements in augmented and mixed reality devices opened up many opportunities to users to interact in their environments. However, there are many unanswered questions about the definition of these interaction paradigms. In this article, we present a new approach to interact in these environments: using the body as a physical...
While visual cues are traditionally used for visual analytics, multimodal interaction technologies offer many new possibilities. This chapter explores the opportunities and challenges for developers and users to utilize and represent data through non-visual sensory channels to help them understand and interact with data. Users are able to experienc...
We present PathWord (PATH passWORD), a multimodal digit entry method for ad-hoc authentication based on known digits shape and user relative eye movements. PathWord is a touch-free, gaze-based input modality, which attempts to decrease shoulder surfing attacks when unlocking a system using PINs. The system uses a modified web camera to detect the u...
Occlusion is an issue in volumetric visualization as it prevents direct visualization of the region of interest. While many techniques such as transfer functions, volume segmentation or view distortion have been developed to address this, there is still room for improvement to better support the understanding of objects' vicinity. However, most exi...
Visualizing 3D trajectories to extract insights about their similarities and spatial configuration is a critical task in several domains. Air traffic controllers for example deal with large quantities of aircrafts routes to optimize safety in airspace and neuroscientists attempt to understand neuronal pathways in the human brain by visualizing bund...
Imaging photoplethysmography (iPPG) is a powerful set of methods for measuring physiological signals from video. Recent advances have shown that a low-cost webcam can be used to measure heart rate, blood flow, respiration, blood oxygen levels and stress. While these methods have many beneficial applications, the unobtrusive and ubiquitous nature of...
This study aims at investigating the possibility to employ neurophysiological measures to assess the humanmachine interaction effectiveness. Such a measure can be used to compare new technologies or solutions, with the final purpose to enhance operator's experience and increase safety. In the present work, two different interaction modalities (Norm...
While fixation distribution is conventionally visualized using heat maps, there is still a lack of a commonly accepted technique to visualize saccade distributions. Inspired by wind maps and the Oriented Line Integral Convolution (OLIC) technique, we visualize saccades by drawing ink droplets which follow the direction indicated by a flow direction...
We propose a set of techniques leveraging mobile devices as lenses to explore, interact and annotate n-dimensional data visualizations. The democratization of mobile devices, with their arrays of integrated sensors, opens up opportunities to create experiences for anyone to explore and interact with large information spaces anywhere. In this paper,...
US2018032836A1; EP3279868A1; CN107679642A
In this paper, we investigate how visualization assets can support the qualitative evaluation of gaze estimation uncertainty. Although eye tracking data are commonly available, little has been done to visually investigate the uncertainty of recorded gaze information. This paper tries to fill this gap by using innovative uncertainty computation and...
We demonstrate the use of different visual aggregation techniques to obtain non-cluttered visual representations of scanpaths. First, fixation points are clustered using the mean-shift algorithm. Second, saccades are aggregated using the Attribute-Driven Edge Bundling (ADEB) algorithm that handles a saccades direction, onset timestamp, magnitude or...
Cardiography, quantitative measurement of the functioning of the heart, traditionally requires customized obtrusive contact sensors. Using new methods photoplethysmography and ballistocardiography signals can be captured using ubiquitous sensors, such as webcams and accelerometers. However, these signals are not visible to the unaided eye. We prese...
In this paper, we investigate how visualization assets can support the qualitative evaluation of gaze estimation uncertainty. Although eye tracking data are commonly available, little has been done to visually investigate the uncertainty of recorded gaze information. This paper tries to fill this gap by using innovative uncertainty computation and...
To better explore a virtual 3d computer generated environment comprised of objects which may be voxels, polygons or any other construct are selectively not displayed so as to better reveal underlying objects. The objects are each associated with a metadata value which contributes to determining their visibility such as a density or opacity value. T...
Datasets such as two dimensional raster images or three dimensional voxel based representations are often processed for representation using a transfer function defined by a curve. A mechanism for manually adjusting such curves is described, whereby a user adds a second curve. The transfer curve is recalculated so as to draw closer to the second cu...
Bundling visually aggregates curves to reduce clutter and help finding important patterns in trail-sets or graph drawings. We propose a new approach to bundling based on functional decomposition of the underling dataset. We recover the functional nature of the curves by representing them as linear combinations of piecewise-polynomial basis function...
Understanding large multidimensional datasets is one of the most challenging problems in visual data exploration. One key challenge that increases the size of the exploration space is the number of views that one can generate from a single dataset, based on the use of multiple parameter values and exploration paths. Often, no such single view conta...
Numerous vital signs can be captured through the measurement of blood flow; however, these signals are not visible to the unaided eye and measurement traditionally requires customized contact sensors. We present Cardiolens - a mixed reality application that enables real-time hands-free measurement and visualization of blood flow and vital signs. Th...
Bundling techniques provide a visual simplification of a graph drawing or trail set, by spatially grouping similar graph edges or trails. This way, the structure of the visualization becomes simpler and thereby easier to comprehend in terms of assessing relations that are encoded by such paths, such as finding groups of strongly interrelated nodes...