Nelson Silva

Nelson Silva
  • PhD in CS
  • Senior Lecturer and Researcher at IT:U (interdisciplinary transformation university Austria)

XR Research | Eye-tracking Research in Neurosciences

About

29
Publications
23,389
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
242
Citations
Introduction
A senior researcher focused on the development of eye-tracking based support techniques and on the creation of innovative adaptive and assistive user interfaces, e.g. AR IUIs, and visual analytics systems. Some challenges include the continuous sensing of user’s behaviors and the inference of potential interests while providing constant support to the users in their analytical tasks. Business Development and establishment of new cooperations are also part of the activities description.
Current institution
IT:U (interdisciplinary transformation university Austria)
Current position
  • Senior Lecturer and Researcher
Additional affiliations
May 2020 - present
Medical University of Graz
Position
  • PostDoc Position
Description
  • Project: Observing the Observer Eye-tracking based support systems Early Detection and Classification of Neuromotor Impairments Pose Estimation Machine and Deep Learning
November 2016 - present
Know-Center
Position
  • Research Staff
Description
  • Research in Visual Analytics and AR Proposal Writing Business Development
January 2013 - August 2016
Fraunhofer Austria Research GmbH
Position
  • Researcher (and PhD Student)

Publications

Publications (29)
Conference Paper
Full-text available
Visual analytics (VA) research provides helpful solutions for interactive visual data analysis when exploring large and complex datasets. Due to recent advances in eye tracking technology, promising opportunities arise to extend these traditional VA approaches. Therefore, we discuss foundations for eye tracking support in VA systems. We first revie...
Conference Paper
Full-text available
We developed a new concept to improve the efficiency of visual analysis through visual recommendations. It uses a novel eye-gaze based recommendation model that aids users in identifying interesting time-series patterns. Our model combines time-series features and eye-gaze interests, captured via an eye-tracker. Mouse selections are also considered...
Conference Paper
Full-text available
Effective visual exploration of large data sets is an important problem. A standard tech- nique for mapping large data sets is to use hierarchical data representations (trees, or dendrograms) that users may navigate. If the data sets get large, so do the hierar- chies, and effective methods for the naviga- tion are required. Traditionally, users na...
Poster
Full-text available
Open Source Framework for the Exploration and Visualization of Eye-tracking Data
Thesis
Full-text available
Master Thesis (Dissertação de Mestrado): Master in Design and Product Development Engineering (Mestrado em Engenharia da Concepção e Desenvolvimento de Produto) Optimal Forms Generative Modeling Techniques in Optimization Preview in Slideshare: http://www.slideshare.net/njss/optimal-forms
Article
Full-text available
The Prechtl General Movements Assessment (GMA) has become a clinician and researcher toolbox for evaluating neurodevelopment in early infancy. Given that it involves the observation of infant movements from video recordings, utilising smartphone applications to obtain these recordings seems like the natural progression for the field. In this review...
Cover Page
Full-text available
Short CV and List of Publications 2011 - 2020
Preprint
Full-text available
The Prechtl General Movements Assessment (GMA) has become a clinician and researcher tool-box for evaluating neurodevelopment in early infancy. Given it involves observation of infant movements from video recordings, utilising smartphone applications to obtain these recordings seems like the natural progression for the field. In this review, we loo...
Article
Full-text available
Background The clinical and scientific value of Prechtl general movement assessment (GMA) has been increasingly recognised, which has extended beyond the detection of cerebral palsy throughout the years. With advancing computer science, a surging interest in developing automated GMA emerges. Aims In this scoping review, we focused on video-based a...
Chapter
Full-text available
Internet of Things (IoT) enables the creation of sensing and computing machines to enhance the level of continuous adaptation and support provided by intelligent systems to humans. Nevertheless, these systems still depend on human intervention, for example, in maintenance and (re)configuration tasks. To this measure, the development of an Adaptive...
Thesis
Full-text available
Traditionally, Visual Analytics (VA) encompasses interactive data visualisations and analysis algorithms to uncover actionable insights in large, complex datasets. VA builds on multiple disciplines combining analytical reasoning and human cognition, decision making, visual representations, machine learning, among others. Nevertheless, many times, e...
Article
Full-text available
Strategic Intelligence addresses the needs of high-level decision makers, and it mainly focuses on proactive activities. It is possible to observe that Strategic Intelligence can support Strategic Management, especially by contributing to the collection, analysis and distribution of information. https://www.yumpu.com/pt/document/read/62731361/scme...
Conference Paper
https://dl.gi.de/handle/20.500.12116/16823 The project Flexible Intralogistics for Future Factories (FlexIFF) conducts research into human robot collaboration for intralogistics teams in the electronics manufacturing industry. These teams are creating a cyber-physical system out of human workers, mobile manipulators, manufacturing machinery, and m...
Article
The generative modeling paradigm is a shift from static models to flexible models. It describes a modeling process using functions, methods and operators. The result is an algorithmic description of the construction process. Each evaluation of such an algorithm creates a model instance, which depends on its input parameters (width, height, volume,...
Conference Paper
Full-text available
[http://dl.acm.org/citation.cfm?id=3038463] The Scatter Plot Matrix (SPLOM) is a well-known technique for visual analysis of high-dimensional data. However, one problem of large SPLOMs is that typically not all views are potentially relevant to a given analysis task or user. The matrix itself may contain structured patterns across the dimensions, w...
Article
Full-text available
(URL: http://ns2.thinkmind.org/index.php?view=article&articleid=intsys_v9_n34_2016_15). Value stream mapping is a lean management method for analyzing and optimizing a series of events for production or services. Even today the first step in value stream analysis – the acquisition of the current state map – is still created using pen & paper by phys...
Data
Full-text available
We present a new open-source prototype framework to explore and visualize eye-tracking experiments data. Firstly, standard eyetrackers are used to record raw eye gaze data-points on user experiments. Secondly, the analyst can configure gaze analysis parameters, such as, the definition of areas of interest, multiple thresholds or the labeling of spe...
Conference Paper
Full-text available
Value stream mapping is a lean management method for analyzing and optimizing a series of events for production or services. Even today the first step in value stream analysis - the acquisition of the current state - is still created using pen & paper by physically visiting the production place. We capture a digital representation of how manufactur...
Technical Report
Full-text available
https://goo.gl/28wK5P This report describes an example implementation of a faceted user interface. The implementation makes a large-scale open government dataset from the Austrian parliament accessible and explorable by means of facets. Facets include information about the speech (such as text or date) and about the speaker (such as name and politi...
Technical Report
Full-text available
https://goo.gl/28wK5P Faceted search user interfaces support users of information systems in the process of searching and exploring information spaces. Thanks to their ease of use, they have become one of the most important strategies used to guide users through large item collections. Examples of faceted search interfaces can be found on a variety...
Conference Paper
Full-text available
The project Sixth Sense postulates that the users body language is different at “good” and “bad” decisions. Therefore, in Sixth Sense we are looking for patterns or hidden data signs that allow us to detect moments of bad and good decisions that could be incorporated in an automated system in order to detect and predict the next actions of a user....
Technical Report
[http://www.fraunhofer.at/content/dam/austria/documents/cgrafik/Projects/6thSense/D4_2_Verification%20Report.pdf] The project Sixth Sense follows the idea of using the whole body language of a user (using sensor fusion) for communicating with a machine. In our case it is an Air Traffic Controller (ATCO) with an Air Traffic Tower CWP. Specifically...
Poster
Full-text available
Automated error detection through sensor augmentation, while keeping the human in the main decision loop of ATC
Poster
Full-text available
In Sixth Sense we want to record and analyse user interactions together with body language. Using Data Stream Analysis with Machine Learning, we want to predict future actions, identify stress situations and detect unusual behavior in the context of Air Traffic Control.
Conference Paper
Full-text available
This paper is focused on the fault tolerance of Human Machine Interfaces in the field of air traffic control (ATC) by accepting the overall user's body language as input. We describe ongoing work in progress in the project called Sixth Sense. Interaction patterns are reasoned from the combination of a recommendation and inference engine, the analys...
Conference Paper
This paper is focused on the fault tolerance of Human Machine Interfaces in the field of air traffic control (ATC) by accepting the overall user's body language as input. We describe ongoing work in progress in the project called Sixth Sense. Interaction patterns are reasoned from the combination of a recommendation and inference engine, the analys...
Article
A procedural model is a script, which generates a geometric object. The script's input parameters offer a simple way to specify and modify the scripting output. Due to its algorithmic character, a procedural model is perfectly suited to describe geometric shapes with well-organized structures and repetitive forms. In this paper, we interpret a gene...
Poster
Full-text available
Introduction The 6th Sense project concentrates on improved fault tolerances of the human machine interface by accepting the overall user’s body language as input. This means that we make use of multiple user interface sensors and actors and we fuse them into one most likely interaction, eventually, also supported by a decision workflow system to j...

Questions

Question (1)
Question
I am interested in more details about:
- real time eye fixations, saccades and AOI calculation and analysis
- how to predict next actions of the user
- metrics for eye control of user interfaces
- adaptive user interfaces in general
Thank you so much!

Network

Cited By