Fillia Makedon

Fillia Makedon
University of Texas at Arlington | UTA · Department of Computer Sciences & Engineering

About

451
Publications
64,866
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
5,462
Citations

Publications

Publications (451)
Preprint
Full-text available
Fatigue is a loss in cognitive or physical performance due to various physiological factors such as insufficient sleep, long work hours, stress, and physical exertion. It has an adverse effect on the human body and can slow down reaction times, reduce attention, and limit short-term memory. Hence, there is a need to monitor a person's state to avoi...
Article
Full-text available
In this paper, a robotic Multitasking Intelligent Nurse Aid (MINA) is proposed to assist nurses with everyday object fetching tasks. MINA consists of a manipulator arm on an omni-directional mobile base. Before the operation, an augmented reality interface was used to place waypoints. Waypoints can indicate the location of a patient, supply shelf,...
Article
Full-text available
Physical activities, according to the embodied cognition theory, are an important manifestation of cognitive functions. As a result, in this paper, the Activate Test of Embodied Cognition (ATEC) system is proposed to assess various cognitive measures. It consists of physical exercises with different variations and difficulty levels designed to prov...
Article
Full-text available
Training on simulation data has proven invaluable in applying machine learning in robotics. However, when looking at robot vision in particular, simulated images cannot be directly used no matter how realistic the image rendering is, as many physical parameters (temperature, humidity, wear-and-tear in time) vary and affect texture and lighting in w...
Conference Paper
This paper showcases a developed end-user framework for a human-robot collaborative system for common tasks, such as pick and place. The system is designed for semi-automated pick and place tasks as well as manual operation making it flexible for multiple use-case scenarios. The goal of the system is to make the robot multi-functional, easy to use...
Conference Paper
Nurses have to carry out a myriad of tasks, which is one of the main reasons for burnout. In this paper, a robotic Multitasking Intelligent Nurse Aid (MINA) is proposed to assist nurses with everyday tasks and tackle nurse burnout. MINA uses Simultaneous Localization And Mapping (SLAM) to map shelves in a storage room and pointcloud using an RGB-De...
Conference Paper
Full-text available
In this paper, we present a novel method to learn end-to-end visuomotor policies for robotic manipulators. The method computes state-action mappings in a supervised learning manner from video demonstrations and robot trajectories. We show that the robot learns to perform different tasks by associating image features with the corresponding movement...
Conference Paper
As mobile technologies have become ubiquitous in recent years, computer-based cognitive tests have become more popular and efficient. In this work, we focus on assessing motor function in children by analyzing their gait movements. Although there has been a lot of research on designing automated assessment systems for gait analysis, most of these e...
Conference Paper
This article proposes a novel approach for augmenting generative adversarial network (GAN) with a self-supervised task in order to improve its ability for encoding video representations that are useful in downstream tasks such as human activity recognition. In the proposed method, input video frames are randomly transformed by different spatial tra...
Preprint
Full-text available
Functional magnetic resonance imaging (fMRI) is a neuroimaging technique that records neural activations in the brain by capturing the blood oxygen level in different regions based on the task performed by a subject. Given fMRI data, the problem of predicting the state of cognitive fatigue in a person has not been investigated to its full extent. T...
Preprint
Full-text available
Multi-modal sentiment analysis plays an important role for providing better interactive experiences to users. Each modality in multi-modal data can provide different viewpoints or reveal unique aspects of a user's emotional state. In this work, we use text, audio and visual modalities from MOSI dataset and we propose a novel fusion technique using...
Preprint
Full-text available
Robotic nursing aid is one of the heavily researched areas in robotics nowadays. Several robotic assistants exist that only focus on a specific function related to nurses assistance or functions related to patient aid. There is a need for a unified system that not only performs tasks that would assist nurses and reduce their burden but also perform...
Conference Paper
Full-text available
Robotic nursing aid is one of the heavily researched areas in robotics nowadays. Several robotic assistants exist that only focus on a specific function related to nurses' assistance or functions related to patient aid. There is a need for a unified system that not only performs tasks that would assist nurses and reduce their burden but also perfor...
Article
Full-text available
In recent years, with the current advancements in Robotics and Artificial Intelligence (AI), robots have the potential to support the field of healthcare. Robotic systems are often introduced in the care of the elderly, children, and persons with disabilities, in hospitals, in rehabilitation and walking assistance, and other healthcare situations....
Article
Full-text available
Self-supervised learning has gained popularity because of its ability to avoid the cost of annotating large-scale datasets. It is capable of adopting self-defined pseudolabels as supervision and use the learned representations for several downstream tasks. Specifically, contrastive learning has recently become a dominant component in self-supervise...
Preprint
Full-text available
As mobile technologies have become ubiquitous in recent years, computer-based cognitive tests have become more popular and efficient. In this work, we focus on assessing motor function in children by analyzing their gait movements. Although there has been a lot of research on designing automated assessment systems for gait analysis, most of these e...
Article
Full-text available
Recently, the use of extended reality (XR) systems has been on the rise, to tackle various domains such as training, education, safety, etc. With the recent advances in augmented reality (AR), virtual reality (VR) and mixed reality (MR) technologies and ease of availability of high-end, commercially available hardware, the manufacturing industry ha...
Article
Full-text available
Storytelling has been established as a proven method to effectively communicate and assist in knowledge transfer. In recent years, there has been growing interest in improving the training and learning domain by using advanced technology such as Virtual Reality (VR). However, a gap exists between storytelling and VR, and it is as yet unclear how th...
Conference Paper
Chronic Obstructive Pulmonary Disease (COPD) is one of the major pulmonary diseases and a leading cause of morbidity and mortality worldwide. Although there is no cure for COPD, it can be managed by medication and rehabilitation. Therefore, it is important to monitor the progression of the disease. In this paper, we propose a framework to detect an...
Preprint
Full-text available
Self-supervised learning has gained popularity because of its ability to avoid the cost of annotating large-scale datasets. It is capable of adopting self-defined pseudo labels as supervision and use the learned representations for several downstream tasks. Specifically, contrastive learning has recently become a dominant component in self-supervis...
Conference Paper
Robots are increasingly present in environments shared with humans. Robots can cooperate with their human teammates to achieve common goals and complete tasks. This paper focuses on developing a real-time framework that assesses the cognitive load of a human while cooperating with a robot to complete a collaborative assembly task. The framework use...
Conference Paper
Full-text available
Executive Functions are very important mental skills that help us to coordinate, plan, pay attention, organize, and multitask, among others. Weak executive functions may affect school or work performance. Therefore, there is a need of identifying executive function deficits early during childhood and enable interventions that could improve executiv...
Preprint
Full-text available
This article proposes a novel approach for augmenting generative adversarial network (GAN) with a self-supervised task in order to improve its ability for encoding video representations that are useful in downstream tasks such as human activity recognition. In the proposed method, input video frames are randomly transformed by different spatial tra...
Conference Paper
Full-text available
Safe and efficient Human-Robot Collaboration (HRC) requires recognizing human collaborators intention. Hand pose kinematics early on an ongoing movement can provide information for predicting future human actions. Accurate state-of-the-art methods used for human hand pose estimation are either marker-based or make use of multiple cameras set around...
Article
Full-text available
In this work, we present CogBeacon, a multi-modal dataset designed to target the effects of cognitive fatigue in human performance. The dataset consists of 76 sessions collected from 19 male and female users performing different versions of a cognitive task inspired by the principles of the Wisconsin Card Sorting Test (WCST), a popular cognitive te...
Conference Paper
Full-text available
It is generally accepted in the field of human-robot interaction (HRI) that the role of a human teacher is critical for robot environmental adaptation. As such, the ability of a robot to adapt in a novel environment is based on the capabilities of the human teacher. In this paper, we propose a metric for robots to evaluate the quality of a human te...
Conference Paper
Objective: In this paper, we present a multimodal robot-based framework to investigate how physical and mental fatigue affect task performance, and how it relates to subjective self-reports. Methodology: In this pilot study, seven healthy participants underwent the robot-based assessment. In each session, the participants performed a series of reac...
Conference Paper
This paper provides an overview of a mood detection system using the Fitbit Ionic wearable smart watch. Wearable technologies have become more easily accessible and widely used in daily activities and even work settings. The proposed application uses heart rate and steps to capture mood from the individual. This knowledge can be used for health int...
Conference Paper
Mood has a large impact on people's behavior and even health. Thus, detecting and monitoring mood can potentially benefit users, researchers, clinicians, and content providers. In recent years, advancements in affective computing have enabled the development of various mood detection systems based on self-reported data, speech, facial expressions,...
Conference Paper
Full-text available
Physical fatigue due to muscle exhaustion is a symptom that can be very common in daily life. However fatigue can sometimes be suspect of more severe diseases such as multiple sclerosis and needs to be assessed appropriately. Despite the need to monitor fatigue, describing it in an objective and quantifiable manner is still an open problem due to t...
Conference Paper
Training and assessment of a new worker is the most vital part of any vocational industry. The landscape of jobs and work is changing rapidly, thanks to the emerging new technology and the advancement of knowledge in the scientific fields. This technological and scientific revolution presents an opportunity in the creation of new industries and occ...
Conference Paper
This paper explores types of wearable heart rate sensors and their reliability. An overview of data collection, brands, and recent findings are included. Wearable sensors, especially those on the wrist in activity trackers and smartwatches are a non-invasive way to track heart rate and receive other measurements of health and activity. Heart rate i...
Article
Full-text available
Multiple sclerosis (MS) is a disease that affects the central nervous system, which consists of the brain and spinal cord. Although this condition cannot be cured, proper treatment of persons with MS (PwMS) can help control and manage the relapses of several symptoms. In this survey article, we focus on the different technologies used for the asses...
Article
Full-text available
In this article, we present a taxonomy in Robot-Assisted Training; a growing body of research in Human–Robot Interaction which focuses on how robotic agents and devices can be used to enhance user’s performance during a cognitive or physical training task. Robot-Assisted Training systems have been successfully deployed to enhance the effects of a t...
Conference Paper
Full-text available
Recent developments in computer vision and the emergence of wearable sensors have opened opportunities for the development of advanced and sophisticated techniques to enable multi-modal user assessment and personalized training which is important in educational , industrial training and rehabilitation applications. They have also paved way for the...
Chapter
Full-text available
In this paper, we focus on estimating the forward kinematic equation of robots with multilayer feed-forward neural networks. The effectiveness of this approach is tested on a simulated kinematic model of the 7-DOF Sawyer Robotic Arm. In the initial sections of the paper, we discuss related work that associates with the creation of model agnostic co...
Conference Paper
This paper outlines the development of a task-driven framework for multimodal fatigue analysis during physical and cognitive tasks. While fatigue is a common symptom across several neurological chronic diseases, such as multiple sclerosis (MS), traumatic brain injury (TBI), cerebral palsy (CP) and others, it remains poorly understood, due to variou...
Conference Paper
Full-text available
Considerable amount of research is being carried out in robot based rehabilitation techniques. One of the main focus when building a smart rehabilitation system is its ability to adapt based on the user experience. In this poster we attempt to build such a smart rehabilitation system that recognizes the strain/ negative emotions from the participan...
Conference Paper
Full-text available
In recent years robots have been replacing human workers in many industries. As robot manufacturing becomes more optimized and cost effective, the use of robots is going to evolve in various fields. Thus, it is essential to prepare workers to operate robots and work collaboratively with them side by side. In this paper, we are proposing a human-rob...