Xianta Jiang

Xianta Jiang
Memorial University of Newfoundland · Department of Computer Science

PhD

About

61
Publications
14,668
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
887
Citations
Citations since 2016
44 Research Items
812 Citations
2016201720182019202020212022050100150
2016201720182019202020212022050100150
2016201720182019202020212022050100150
2016201720182019202020212022050100150
Additional affiliations
February 2015 - February 2016
Simon Fraser University
Position
  • PostDoc Position
January 2012 - February 2015
University of Alberta
Position
  • Eye tracking in Surgical Training
Description
  • Ph.D. Student under Dr. Bin Zheng's supervision
January 2011 - January 2015
Simon Fraser University
Position
  • Eye-tracking in Surgery Training
Description
  • Ph.D Candidate Dr. M. Stella Atkins' supervision

Publications

Publications (61)
Conference Paper
Full-text available
Pupil size is known to correlate with the changes of cognitive task workloads, but how the pupil responds to requirements of basic goal-directed motor tasks involved in human-machine interactions is not yet clear. This work conducted a user study to investigate the pupil dilations during aiming in a tele-operation setting, with the purpose of bette...
Article
Full-text available
The vertical ground reaction force (vGRF) and its passive and active peaks are important gait parameters and of great relevance for musculoskeletal injury analysis and prevention, the detection of gait abnormities, and the evaluation of lower-extremity prostheses. Most currently available methods to estimate the vGRF require a force plate. However,...
Article
Full-text available
This paper describes a study that explores the force exertion effect on the classification of grasps using force myography (FMG) technology. Nine participants were recruited to the study; each performed a set of 16 different grasps from a grasp taxonomy using 8 different levels of force respectively. Their wrist muscle pressure was recorded using a...
Article
Full-text available
(1) Background: Quantitative evaluation of gait parameters can provide useful information for constructing individuals’ gait profile, diagnosing gait abnormalities, and better planning of rehabilitation schemes to restore normal gait pattern. Objective determination of gait phases in a gait cycle is a key requirement in gait analysis applications;...
Article
Full-text available
Gesture recognition using surface electromyography (sEMG) serves many applications, from human–machine interfaces to prosthesis control. Many features have been adopted to enhance recognition accuracy. However, studies mostly compare features under a prechosen feature window size or a classifier, biased to a specific application. The bias is eviden...
Article
Full-text available
The myoelectric prosthesis is a promising tool to restore the hand abilities of amputees, but the classification accuracy of surface electromyography (sEMG) is not high enough for real-time application. Researchers proposed integrating sEMG signals with another feature that is not affected by amputation. The strong coordination between vision and h...
Article
Full-text available
Machine learning can discern meaningful information from large datasets. Applying machine learning techniques to raw sensor data from instrumented walkways could automatically detect subtle changes in walking and balance. Multiple sclerosis (MS) is a neurological disorder in which patients report varying degrees of walking and balance disruption. T...
Article
We examined whether human operators move their eyes earlier to a target before hands when the level of task difficulty increases. We hypothesized that participants would perform less proactive eye movements in the difficult task than in the easy one, as they would need to focus more on their current hand movements. Sixteen university students were...
Article
Full-text available
Many studies have explored divergent deep neural networks in human activity recognition (HAR) using a single accelerometer sensor. Multiple types of deep neural networks, such as convolutional neural networks (CNN), long short-term memory (LSTM), or their hybridization (CNN-LSTM), have been implemented. However, the sensor orientation problem poses...
Article
Full-text available
Recognizing applied hand forces using force myography (FMG) biosignals requires adequate training data to facilitate physical human-robot interactions (pHRI). But in practice, data is often scarce, and labels are usually unavailable or time consuming to generate. Synthesizing FMG biosignals can be a viable solution. Therefore, in this paper, we pro...
Article
Full-text available
Identifying objects during the early phases of robotic grasping in unstructured environments is a crucial step toward successful dexterous robotic manipulation. Underactuated hands are versatile and quickly conform to unknown object surfaces to ensure a firm grasp. The trade-off of using such hands is that extracting information and recognizing obj...
Article
This work studies the influence of slice permutations on tensor recovery, which is derived from a reasonable assumption about algorithm, i.e. changing data order should not affect the effectiveness of the algorithm. However, as we will discussed in this paper, this assumption is not satisfied by tensor recovery under some cases. We call this intere...
Preprint
The task of grasp pattern recognition aims to derive the applicable grasp types of an object according to the visual information. Current state-of-the-art methods ignore category information of objects which is crucial for grasp pattern recognition. This paper presents a novel dual-branch convolutional neural network (DcnnGrasp) to achieve joint le...
Article
Full-text available
Ankle joint power is usually determined by a complex process that involves heavy equipment and complex biomechanical models. Instead of using heavy equipment, we proposed effective machine learning (ML) and deep learning (DL) models to estimate the ankle joint power using force myography (FMG) sensors. In this study, FMG signals were collected from...
Article
Full-text available
Background Using embedded sensors, instrumented walkways provide clinicians with important information regarding gait disturbances. However, because raw data are summarized into standard gait variables, there may be some salient features and patterns that are ignored. Multiple sclerosis (MS) is an inflammatory neurodegenerative disease which predom...
Preprint
Facial image inpainting is a task of filling visually realistic and semantically meaningful contents for missing or masked pixels in a face image. Although existing methods have made significant progress in achieving high visual quality, the controllable diversity of facial image inpainting remains an open problem in this field. This paper introduc...
Article
Full-text available
Pattern recognition using surface Electromyography (sEMG) applied on prosthesis control has attracted much attention in these years. In most of the existing methods, the sEMG signal during the firmly grasped period is used for grasp classification because good performance can be achieved due to its relatively stable signal. However, using the only...
Article
Full-text available
Background: Eye-tracking offers a new list of performance measures for surgeons. Previous studies of eye-tracking have reported that action-related fixation is a good measuring tool for elite task performers. Other measures, including early eye engagement to target and early eye disengagement from the previous subtask, were also reported to distin...
Article
Full-text available
Estimating ankle joint power can be used to identify gait abnormities, which is usually achieved by employing a complicated biomechanical model using heavy equipment settings. This paper demonstrates deep learning approaches to estimate ankle joint power from two Inertial Measurement Unit (IMU) sensors attached at foot and shank. The purpose of thi...
Article
Full-text available
ForceMyography (FMG) is an emerging competitor to surface ElectroMyography (sEMG) for hand gesture recognition. Most of the state-of-the-art research in this area explores different machine learning algorithms or feature engineering to improve hand gesture recognition performance. This paper proposes a novel signal processing pipeline employing a m...
Article
Full-text available
Background: Modern surgery crucially relies on teamwork between surgeons and assistants. The science of teamwork has been and is being studied extensively although the use of specific objective methodologies such as shared pupil dilations has not been studied as sufficiently as subjective methods. In this study, we investigated team members' share...
Conference Paper
Full-text available
Grasping objects are common phenomenon in daily human activities. Force myography (FMG) signal, a non-invasive technique can record muscle movements while a human participant grasps different objects and be categorized using machine learning (ML) algorithms. In this paper, a popular deep learning technique is presented for hand grasp recognition. A...
Article
Full-text available
Augmented Reality has been utilized for surgical training. During the implementation, displaying instructional information at the right moment is critical for skill acquisition. We built a new surgical training platform combining augmented reality system (HoloLens, Microsoft) with an eye-tracker (Pupil labs, Germany). Our goal is to detect the mome...
Article
The three-dimensional trajectory of the body's centre of mass (COM) is useful to determine a number of biomechanical outcomes in running research. Previous studies have used the COM to calculate measures such as overstriding, vertical stiffness, and vertical oscillation. The COM is traditionally computed using the segmental analysis method, though...
Article
Full-text available
Hand force estimation is critical for applications that involve physical human-machine interactions for force monitoring and machine control. Force Myography (FMG) is a potential technique to be used for estimating hand force/torque. The FMG signals reflect the volumetric changes in the arm muscles due to muscle contraction or expansion. This paper...
Article
Full-text available
(1) Background: Ankle joint power, as an indicator of the ability to control lower limbs, is of great relevance for clinical diagnosis of gait impairment and control of lower limb prosthesis. However, the majority of available techniques for estimating joint power are based on inverse dynamics methods, which require performing a biomechanical analy...
Article
Full-text available
Hand gesture recognition is important for interactions under VR environment. Traditional vision-based approaches encounter occlusion problems, and thus, wearable devices could be an effective supplement. This study presents a hand grasps recognition method in virtual reality settings, by fusing signals acquired using force myography (FMG), a muscul...
Article
Full-text available
Introduction: Step counting can be used to estimate the activity level of people in daily life; however, commercially available accelerometer-based step counters have shown inaccuracies in detection of low-speed walking steps (<2.2 km/h), and thus are not suitable for older adults who usually walk at low speeds. This proof-of-concept study explore...
Conference Paper
Full-text available
Step counting is a practical way for evaluating the activity level of people in daily life. However, the widely used accelerometer-based step-counters are not able to accurately detect low-speed steps (<0.6 m/s). Our earlier study used supervised machine learning to achieved a very high performance (error rate <1.5%) in low speed step detection bas...
Conference Paper
In this paper, a wearable sensory system is proposed for lower leg swelling detection during sitting, standing and walking. This sensor potentially can be used to trigger controllable compression modalities that are used for vanous insufficiency disorders in the lower leg particularly, edema and orthostatic intolerance. The proposed sensory system...
Article
Full-text available
There is increasing research interest in technologies that can detect grasping, to encourage functional use of the hand as part of daily living, and thus promote upper-extremity motor recovery in individuals with stroke. Force myography (FMG) has been shown to be effective for providing biofeedback to improve fine motor function in structured rehab...
Conference Paper
Full-text available
3D reconstruction has been shown to be a successful method for creating accurate 3D models out of video data with moving objects. Typically, videos are captured by ordinary cameras; however, more egocentric video footage will be taken by wearable cameras. In this work, we present a 3D reconstruction pipeline that implements content awareness for co...
Conference Paper
Full-text available
Hand gesture recognition is a popular topic of many research studies, and force myography (FMG) has recently emerged for this application. This work investigates a novel sensor system based on electrical resistance strain gages that is fully wearable and easy-to-use. This system consists of eight strain gages embedded in a transparent flexible plas...
Article
Full-text available
Pressure sensors increasingly have received attention as a non-invasive interface for hand gesture recognition; whereas, their performance has not been comprehensively evaluated. This work examined the performance of hand gesture classification using Force Myography (FMG) and surface Electromyography (sEMG) technologies by performing 3 sets of 48 h...
Article
Mobile and wearable devices based activity recognition systems utilize built-in sensors to identify the activities performed by users pervasively. However, most of these systems do not explicitly present the sensing process to users and are prone to uncertainty. The presence of uncertainty makes users feel confused about the behaviors of activity r...
Article
Full-text available
The tracking and prediction of hand and finger movements along with gesture recognition is an active subject of research due to its vast applications in many fields, such as prosthetic control and robotic telemanipulation of rehabilitation and assistive devices. The common challenge in all of these fields is developing a control interface for opera...
Conference Paper
Full-text available
A novel fully wearable system based on a smart wristband equipped with stretchable strain gauge sensors and readout electronics have been assembled and tested to detect a set of movements of a hand crucial in rehabilitation procedures. The high sensitivity of the active devices embedded on the wristband do not need a direct contact with the skin, t...
Article
Full-text available
Pupillary response is associated with perceptual and cognitive loads in visual and cognitive tasks, but no quantitative link between pupil response and the task workload in visual-motor tasks has been confirmed. The objective of this study is to investigate how the changes of task requirement of a visual-motor task are reflected by the changes of p...
Article
Full-text available
Assessing the workload of surgeons requires technology to continuously monitor surgeons' behaviors without interfering with their performance. We investigated the feasibility of using eye-tracking to reveal surgeons' response to increasing task difficulty. A controlled study was conducted in a simulated operating room, where 14 subjects were requir...
Article
Full-text available
Introduction: Trajectories of surgical instruments in laparoscopic surgery contain rich information about surgeons' performance. In a simulation environment, instrument trajectories can be taken by motion sensors attached to the instruments. This method is not accepted by surgeons working in the operating room due to safety concerns. In this study...
Conference Paper
Full-text available
Pupil size is known to correlate with changes of cognitive task workloads, but the pupillary response to requirements of basic goaldirected motor tasks is not yet clear, although pointing with tools is a ubiquitous human task. This work describes a user study to investigate the pupil dilations during aiming in two tele-operation tasks with differen...
Conference Paper
Full-text available
Novices were trained to perform a unimanual peg transport task in a laparoscopic training box with an illuminated interior displayed on a monitor. Subjects were divided into two groups; one group was verbally instructed to direct their gaze at distant targets, while the other group had their gaze behaviour implicitly manipulated using distant targe...
Article
Full-text available
Task-evoked pupil response (TEPR) has been extensively studied and well proven to be sensitive to mental workload changes. We aimed to explore how TEPR reflects mental workload changes in a surgical environment. We conducted a simulated surgical task that has 3 different subtasks with different levels of motor precision and different mental workloa...
Article
Full-text available
During a laparoscopic operation, the surgical team should have a common understanding of the action plan which can be aided by focusing on the same surgical site. We show how measuring the overlap between two spatially and temporally aligned gaze recordings can be used to identify periods during which the primary operator and assistant were focused...
Article
Full-text available
Blinks are related to several emotional states, and the present report describes a simple, reliable way to measure blinks from the video stream of an eye obtained during eyetracking, where the source of the eye video is a video camera attached to a head-mounted eyetracker. Computer vision techniques are employed to determine the moments that a blin...
Article
Full-text available
To observe whether there is a difference in eye gaze between doing a task, and watching a video of the task, we recorded the gaze of 17 subjects performing a simple surgical eye-hand coordination task. We also recorded eye gaze of the same subjects later while they were watching videos of their performance. We divided the task into 9 or more sub-ta...
Article
To study the relationship between movie plot and the physiological signals of audience, a physiological signals based emotional state recognition model of movie audience was proposed. Features were extracted from physiological signals, and sequential forward selection (SFS) method was used for feature selection purpose. The emotional state recognit...
Article
Full-text available
Blinks are known as an indicator of visual attention and mental stress. In this study, surgeons' mental workload was evaluated utilizing a paper assessment instrument (National Aeronautics and Space Administration Task Load Index, NASA TLX) and by examining their eye blinks. Correlation between these two assessments was reported. Surgeons' eye moti...
Article
k Nearest Neighbor (kNN) search is one of the most important operations in spatial and spatio-temporal databases. Although it has received considerable attention in the database literature, there is little prior work on kNN retrieval for moving object trajectories. Motivated by this observation, this paper studies the problem of efficiently process...