Honghai Liu

Honghai Liu
University of Portsmouth

PhD at King's College London

About

375
Publications
63,087
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
7,047
Citations

Publications

Publications (375)
Article
Simultaneous prediction of wrist and hand motions is essential for the natural interaction with hand prostheses. In this paper, we propose a novel multi-out Gaussian process (MOGP) model and a multi-task deep learning (MTDL) algorithm to achieve simultaneous prediction of wrist rotation (pronation/ supination)1 and finger gestures for transradial a...
Chapter
Autism spectrum disorders is a range of neurodevelopmental conditions primarily characterized by difficulties in social interactions, differences in communication, and presentations of rigid and repetitive behavior. The evidence shows that the functional social behavior of children with autism can be enhanced by early intervention. However, traditi...
Chapter
Human visual focus is a vital feature to uncover subjects’ underlying cognitive processes. To predict the subject’s visual focus, existing deep learning methods learn to combine the head orientation, location, and scene content for estimating the visual focal point. However, these methods mainly face three problems: the visual focal point predictio...
Chapter
Fatigue monitoring is significant during movement process to avoid body injury cased by excessive exercise. To address this issue, we developed an automated framework to recognize human fatigue states based on electrocardiogram (ECG) collected by a smart wearable device. After preprocessing on the raw ECG data, both machine learning solution and de...
Chapter
Autism Spectrum Disorder (ASD) is a congenital neurodevelopmental disorder, and the number of ASD has been increasing in recent decades worldwide. Early screening is essential for proper treatment and intervention in toddlers with ASD. However, manual early screening methods for ASD are costly and inefficient. Stereotyped behavior is one of the cli...
Chapter
To sense and represent electrotactile perceptual properties is a crucial milestone in order to achieve intuitive haptics. However, electrotactile perceptual properties are very poorly studied. This study presented an experimental study on the electrotactile perceptual properties of fingertips. A series of experimental paradigms were designed based...
Chapter
Stroke is a common global health-care problem that has had serious negative impact on the life quality of the patients. Motor impairment after stroke typically affects one side of the body. The main focus of stroke rehabilitation is the recovery of the affected neuromuscular functions and the achievement of independent body control. This paper prop...
Chapter
Robots with tactile sensors can distinguish the tactile property of the object, such as the spatial shape, in many robotic applications. The neuromorphic approach offers a new solution for information processing to encode tactile signals. Vision-based tactile sensing has gradually attracted attention in recent years. Although some work has been don...
Chapter
Stroke has been one of the diseases with high incidence in the world, which is the main reason for adult deformity. It’s significant to diagnose stroke quickly and accurately. Currently the main diagnostic method of acute ischemic stroke is also Computed Tomography. Meanwhile, electroencephalogram (EEG) is an electrophysiological manifestation that...
Chapter
IS (Interpersonal Synchrony), where the follower (participant) tries to behave the same action along with the raiser (human or metronome), is an essential social interaction skill. The evaluation of interpersonal synchronization is valuable for early autism screening. However, the research on IS evaluation is limited, and the current approaches usu...
Chapter
Face alignment has been an important focus of vision research because it is the most fundamental step in face analysis, reconstruction, and applications of emotion and attention. However, face alignment still suffers from some problems, such as lack of stability and poor performance in practical applications due to occlusion, illumination, and high...
Chapter
In the diagnosis and rehabilitation of motor function for stroke patients, the combination of motor function assessment based on Muscle Synergy Analysis (MSA) and rehabilitation using Functional Electrical Stimulation (FES) is a new strategy, which has been validated its feasibility and superiority in clinical rehabilitation. However, it is difficu...
Chapter
At present, due to the limited information, the single man-machine interface control has some defects in human motion prediction, such as low accuracy and poor robustness. In this work, a multi-modal real-time acquisition system that combines surface electromyography (sEMG), inertial measurement (IMU) and A-mode ultrasound (AUS) information is used...
Chapter
Ultrasound can non-invasively detect muscle deformations, which has great potential applications in prosthetic hand control. This research developed a miniaturized ultrasound device that could be integrated into a prosthetic hand socket. This compact system included four A-mode ultrasound transducers, a signal processing module, and a prosthetic ha...
Chapter
In recent years, gaze estimation has been applied to numerous application areas, such as driver monitor system, autism assessment, and so on. However, current practical gaze estimation algorithms require a large amount of data to obtain better results. The collection of gaze data requires specific equipment, and the collection process is cumbersome...
Chapter
To explore the potential of gesture recognition based on the A-mode ultrasound (AUS) interface in human-computer interaction (HCI), according to the characteristics of AUS signal, a novel preprocessing approach is designed, feature extraction is performed by the window analysis method, and four methods, Linear Discriminant Analysis (LDA), k-Nearest...
Chapter
The sEMG (surface electromyogram signal) reflects the degree of muscle activity, which contains a large amount of motion information about the human body. It has important research significance and application value in sports science, rehabilitation medicine, and so on. There are more and more products related to sEMG acquisition, which are mainly...
Chapter
Insufficient analgesia during resuscitation of postoperative children may lead to sequelae such as atelectasis and worsening respiratory function, so timely and accurate detection of pain status in children is essential. At present, the pain status of children is mainly judged by nurses based on facial pain expression scales, which is highly subjec...
Chapter
Autism is a childhood developmental disorder characterized by impairments in social interaction, verbal and nonverbal communication, narrow interests, and repetitive stereotypes, starting in infancy and early childhood. Children’s Response to Instruction (RTI) is an important protocol in the diagnosis of children with autism. The so-called verbal r...
Chapter
Multi-object tracking (MOT) is an important problem in computer vision which has a wide range of applications. Formulating MOT as multi-task learning of object detection and re-Identification (re-ID) in a single network is appealing since it achieves real-time but effective inference on detection and tracking. However, in crowd scenes, the existing...
Article
Full-text available
Isokinetic exercise is considered as one of the most effective ways for rehabilitation and muscle strength enhancement. As rehabilitation equipment, the isokinetic exercise device assists isokinetic movement using a single fixed axis and relevant joint adapters, and it requires high stability and safety performances to cooperate with human. In this...
Article
Full-text available
With the increased demands of human-machine interaction, haptic feedback is becoming increasingly critical. However, the high cost, large size and low efficiency of current haptic systems severely hinder further development. As a portable and efficient technology, cutaneous electrotactile stimulation has shown promising potential for these issues....
Article
Objective: Transcranial magnetic stimulation (TMS) is an experimental therapy for promoting motor recovery from hemiparesis. At present, hemiparesis patients' responses to TMS are variable. To maximize its therapeutic potential, we need an approach that relates the electrophysiology of motor recovery and TMS. To this end, we propose Corticomuscula...
Article
The muscle synergy hypothesis assumes that the nervous system controls muscles in groups to simplify behavioral tasks, which makes it possible for modularizing motor function assessment. This paper presents a new assessment method based on muscle synergy space (MSS) model to assess motor functions after stroke. It consists of spatiotemporal feature...
Article
Brain networks allow a topological understanding into the pathophysiology of stroke-induced motor deficits, and have been an influential tool for investigating brain functions. Unfortunately, currently applied methods generally lack in the recognition of the dynamic changes in the cortical networks related to muscle activity, which is crucial to cl...
Chapter
Adaptive behavioural assessments are useful in the diagnosis of autism. This research proposes a strategy of assessing autistic children’s adaption skills through the change of hand behaviour complexity based on deep learning and complex systems. Specifically, we implement a sparse representation of high-dimensional features of hand movements utili...
Article
The hypothesis of muscle synergy has been dominantly accepted in research due to the evidence of being well investigated its existence in multiple disciplines such as health science. Motor function assessment using muscle synergy provides a quantitative approach from the physiological features of muscles. Given the synergy coordinating multiple mus...
Article
Though physiological signal based human-machine interfaces (HMIs) have recently developed rapidly, their practical use is restricted by many real-world environmental factors, one of which is muscle fatigue. This paper explores the sensitivities between surface electromyography (sEMG) and A-mode ultrasound (AUS) sensing modalities subject to muscle...
Article
Motion estimation plays an important role in motor coordination exploration and optimal control of human-machine interaction. Muscular strength training, such as isokinetic exercise, aims to improve one’s muscular strength and endurance with adjustable resistance at a constant speed. To explore motion estimation and muscle coordination, this paper...
Article
The acoustic nonlinearity parameter of skeletal muscles changes with their contractions and has the potential to be utilized for exoskeleton control. In our previous work, a system comprising a wearable ultrasound probe was developed to estimate the acoustic nonlinearity parameter in vivo by measuring amplitudes of second-harmonic ultrasound. The e...
Chapter
It is evident that surface electromyography (sEMG) based prosthesis is constrained due to sensitivity to muscle fatigue. This paper investigated the muscle fatigue robustness for sEMG, ultrasound and the fusion sEMG/ultrasound signals towards the proportional force prediction. The linear regression model is developed, and evaluated on the non-fatig...
Chapter
Early screening of autism spectrum disorder is essential since early intervention can enhance the functional social behavior of autistic children. Among the behavior characteristics of autism, pointing is strongly related to human communicative interaction and cognitive development. To improve the efficiency and accuracy of autism screening, this p...
Chapter
This paper proposed learning from demonstration control policy that permits an industrial robotic arm to generalise in an unstructured and dynamic environment. The approach combines a probabilistic model with a reactive approach that learns the cost function of an unknown state of the environmental constraints. The approach redefines the robot’s be...
Article
Accurate force control plays a crucial role but still faces many challenges in functional electrical stimulation (FES) based neuroprosthesis applications. This study proposes an surface electromyography (sEMG) driven solution for FES sequential parameter estimation including its amplitude and pulsewidth (PW). The algorithm forms the mapping relatio...
Article
The existing slope safety monitoring studies mainly focus on long-term monitoring of slowly evolving horizontal deformations. However, during the practical applications, sudden deformations may also lead to landslides due to the natural and man-made trigger factors. This paper first proposes a reusable and distributed FBG inclinometer for simultane...
Article
Objective: While the corticomuscular coupling between motor cortex and muscle tissue has received considerable attention, which is typically quantitative measure to evaluate neural signals synchronization in the motor control system, little work has been published regarding the effect of underlying delay of two coupled physiological signals on coh...
Article
The greatest challenge in autism spectrum disorder (ASD) detection and treatment arises from the elusive etiological origins and heterogeneity of ASD. ET-EEG correlative analytics refers to correlating simultaneously recorded Eye tracking (ET) and Electroencephalography (EEG) data or combining them to yield diagnostic biomarkers. This approach was...
Article
In recent years, the prevalence of autism spectrum disorder (ASD) has been proliferating rapidly around the world. This paper aims to provide a comprehensive survey of the diagnosis and intervention for autistic children. Two assessment framework are introduced first to provide theoretical support for autistic engineering technologies: internationa...
Article
Vision-based tactile sensor is a promising solution for tactile sensing. In this paper, we customized FingerVision sensor with multi-layer structure and biomimetic features, and used it to verify a two-step spatial surface sensing method. For the custom sensor, the multi-layer structure imitated the skin and tissue, and the sensing area and frequ...
Article
Full-text available
Objective: While neuroplasticity and functional reorganization during motor recovery can be indirectly reflected and evaluated by functional corticomuscular coupling (fCMC), little work has been published regarding the cortical origin of abnormal muscle synergy and compensatory mechanism in the separation movement of stroke patients. Methods: In...
Article
This paper proposes a novel method for offline outlier detection in nonlinear dynamical systems using an input–output dataset of a Topical Negative Pressure Wound Therapy Device, NPWT. The fundamental characteristics of an NPWT describe a chaotic system whose states vary over time and may result in unpredictable and possibly anomalous divergent beh...
Chapter
Surface electromyography (sEMG) based gesture recognition as an important role in Muscle-Computer interface has been researched for decades. Recently, deep learning based method has had a profound impact on this field. CNN, RNN and RNN-CNN based methods were studied by many researchers. Motivated by Bidirectional Long short-term memory (Bi-LSTM) an...
Chapter
Surface electromyography (sEMG) can provide a novel control method for human machine interface (HMI) with the improvement of signal decoding technology. sEMG-based hand gesture recognition is the key part of HMI control strategy. However, unstable and complex daily used scenarios hinder the further development of sEMG-based control strategy. In thi...
Chapter
In this paper, we considered the task of the robot learning low-level trajectory task in a novel clustered constraint environment. We propose a novel adaptive trajectory algorithm used to generate the necessary trajectory which satisfies the constraint of avoiding collision with an obstacle. Our approach is based on Gaussian mixture model which dec...
Article
The learning of inter-day representation of electromyographic (EMG) signals across multiple days remains a challenging topic and not fully accommodated yet. This study aims to improve the inter-day hand motion classification accuracy via convolutional neural network (CNN)-based data feature fusion. An EMG database (ISRMyo-I) was recorded from six s...
Article
Tactile feedback is beneficial to improve the hand prosthesis performance, alleviate phantom pain, reduce muscle fatigue, etc. During the manipulation process, muscle fatigue not only causes discomfort to prosthesis users but also disturbs the surface electromyographic (sEMG)-based motion recognition, which significantly deteriorates the prosthesis...
Article
Full-text available
In the current development and design of sports rehabilitation equipment or biomimetic prostheses, in addition to pay attention to the development and design of the structure, the more core is how to realize the accurate and effective control of the rehabilitation equipment or intelligent prosthesis, and the current research is based on data proces...
Article
Full-text available
With the rapid development of Internet of things technology, the interaction between people and things has become increasingly frequent. Using simple gestures instead of complex operations to interact with the machine, the fusion of smart data feature information and so on has gradually become a research hotspot. Considering that the depth image of...
Article
Early screening of autism spectrum disorder (ASD) is crucial since early intervention evidently confirms significant improvement of functional social behavior in toddlers. This article attempts to bootstrap the response-to-instructions (RTIs) protocol with vision-based solutions in order to assist professional clinicians with an automatic autism di...
Article
The advancement in artificial hands challenges the development of human-machine interface. In this study, we present a wearable ultrasound based interface for decoding simultaneous and proportional (SP) wrist/hand kinematics. Different from traditional velocity-based SP control, this study focuses on position-based SP control that aligns with human...
Article
Full-text available
We present a dataset of behavioral data recorded from 61 children diagnosed with Autism Spectrum Disorder (ASD). The data was collected during a large-scale evaluation of Robot Enhanced Therapy (RET). The dataset covers over 3000 therapy sessions and more than 300 hours of therapy. Half of the children interacted with the social robot NAO supervise...
Article
Gaze is an important non-verbal cue for speculating human’s attention, which has been widely employed in many human–computer interaction-based applications. In this paper, we propose an improved Itracker to predict the subject’s gaze for a single image frame, as well as employ a many-to-one bidirectional Long Short-Term Memory (bi-LSTM) to fit the...
Article
It is practically crucial to estimate dexterous hand movement for applications such as prosthetics and rehabilitation, especially scenarios actively assisted with functional electrical stimulation (FES). This paper attempts to estimate hand finger movement through forearm muscle deformation for both clinical scenarios with voluntary and FES-induced...
Article
Full-text available
Precise measurement of tailor-welded blanks is crucial for quality control of laser welding. The difficulty in measuring the seam profile of similar gage tailor–welded blanks lies in lacking of solutions to locate their feature points such as those representing the laser stripe. A laser sensor–based method is proposed to measure tailor-welded blank...
Article
This paper presents a fiber Bragg grating (FBG)-based six-dimensional (6-D) force/torque (F/T) sensor that can be mounted on robot joints for the detection of comprehensive force/torque information. The sensor is designed based on a new concept of multilayer measurement in which the elastic structure is divided into four layers. A single optical fi...
Article
The ability to predict wrist and hand motions simultaneously is essential for natural controls of hand protheses. In this paper, we propose a novel method that includes subclass discriminant analysis (SDA) and principal component analysis for the simultaneous prediction of wrist rotation (pronation/ supination) and finger gestures using wearable ul...
Article
This paper introduces a progressive assist-as-needed (pAAN) controller into our custom-made lower limb exoskeleton system. This control strategy can enhance the active participation of subjects. The controller can dynamically estimate a subject’s input (voluntary joint torque) based on electromyography (EMG) without calibrations. The EMG-torque rel...
Article
Full-text available
This work presents a fiber Bragg grating (FBG) wide-range tilt sensor based on a cam structure. Two FBGs are fixed on a specially-designed sensor shell. When one FBG is stretched by the rotating cam driven by tilt, the other FBG moves along a standard semicircle with a constant radius, and compensates for temperature variations of the stretched FBG...
Article
Full-text available
Although a large number of surface electromyography (sEMG) features have been proposed to improve hand gesture recognition accuracy, it is still hard to achieve acceptable performance in inter-session and inter-subject tests. To promote the application of sEMG-based human machine interaction, a convolutional neural network based feature extraction...
Chapter
Full-text available
At present, vision-based hand gesture recognition is very important in human-robot interaction (HRI). This non-contact method enables natural and friendly interaction between people and robots. Aiming at this technology, a two-stream CNN framework (2S-CNN) is proposed to recognize the American sign language (ASL) hand gestures based on multimodal (...
Book
This 2-volume set constitutes the refereed proceedings of 1st International Conference on Robotics and Rehabilitation Intelligence, ICRRI 2020, held in Fushun, China, in September 2020. The 56 full and 4 short papers were carefully reviewed and selected from 188 submissions. The papers are divided into the following topical sections. In the first v...
Book
This 2-volume set constitutes the refereed proceedings of 1st International Conference on Robotics and Rehabilitation Intelligence, ICRRI 2020, held in Fushun, China, in September 2020. The 56 full and 4 short papers were carefully reviewed and selected from 188 submissions. The papers are divided into the following topical sections. In the first v...
Article
Objective: While surface electromyography (sEMG) is still dominant in the field of muscle-computer interface, ultrasound (US) sensing has been regarded as a promising alternative to sEMG, owing to its ability to precisely monitor muscle deformations. Among different US modalities, A-mode US is more compact and cost-effective for wearable applicati...
Article
Incidence of children with autism spectrum disorder (ASD) has increased with an average rate of 1% worldwide. Clinical ASD screening, especially for children screening is a laborious and skilled task, there is however no objective and effective method automating ASD children screening. Analysing children ASD characteristics in predefined motion beh...
Article
Surface electromyography (sEMG) has dominated upper-limb prosthesis control for decades due to its simplicity and effectiveness [1-3]. However, the inherent variability of EMG signal hinders the flexible and accurate control of advanced multi-functional prosthesis. This study is an attempt to use ultrasonography (US) as an alternative for prostheti...
Article
This article presents a state-of-the-art survey on the robotic systems, sensors, actuators, and collaborative strategies for physical human-robot collaboration (pHRC). This article starts with an overview of some robotic systems with cutting-edge technologies (sensors and actuators) suitable for pHRC operations and the intelligent assist devices em...