
A.J. Ijspeert- PhD
- Swiss Federal Institute of Technology in Lausanne
A.J. Ijspeert
- PhD
- Swiss Federal Institute of Technology in Lausanne
About
553
Publications
187,434
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
27,210
Citations
Introduction
Current institution
Publications
Publications (553)
Rehabilitation robotics aims to promote activity-dependent reorganization of the nervous system. However, people with paralysis cannot generate sufficient activity during robot-assisted rehabilitation and, consequently, do not benefit from these therapies. Here, we developed an implantable spinal cord neuroprosthesis operating in a closed loop to p...
Animals have to navigate complex environments and perform intricate swimming maneuvers in the real world. To conquer these challenges, animals evolved a variety of motion control strategies. While it is known that many factors contribute to motion control, we specifically focus on the role of stretch sensory feedback. We investigate how stretch fee...
Hip exoskeletons are known for their versatility in assisting users across varied scenarios. However, current assistive strategies often lack the flexibility to accommodate for individual walking patterns and adapt to diverse locomotion environments. In this work, we present a novel control strategy that adapts the mechanical impedance of the human...
Hip exoskeletons are increasing in popularity due to their effectiveness across various scenarios and their ability to adapt to different users. However, personalizing the assistance often requires lengthy tuning procedures and computationally intensive algorithms, and most existing methods do not incorporate user feedback. In this work, we propose...
Despite recent advances in learning-based controllers for legged robots, deployments in human-centric environments remain limited by safety concerns. Most of these approaches use position-based control, where policies output target joint angles that must be processed by a low-level controller (e.g., PD or impedance controllers) to compute joint tor...
Robots have to adjust their motor behavior to changing environments and variable task requirements to successfully operate in the real world and physically interact with humans. Thus, robotics strives to enable a broad spectrum of adjustable motor behavior, aiming to mimic the human ability to function in unstructured scenarios. In humans, motor be...
This study introduces a novel neuromechanical model employing a detailed spiking neural network to explore the role of axial proprioceptive sensory feedback, namely stretch feedback, in salamander locomotion. Unlike previous studies that often oversimplified the dynamics of the locomotor networks, our model includes detailed simulations of the clas...
Humans can perform movements in various physical environments and positions (corresponding to different experienced gravity), requiring the interaction of the musculoskeletal system, the neural system and the external environment. The neural system is itself comprised of several interactive components, from the brain mainly conducting motor plannin...
Despite their potential, exoskeletons have not reached widespread adoption in daily life, partly due to the challenge of seamlessly adapting assistance across various tasks and environments. Task-specific designs, reliance on complex sensing and extensive data-driven training often limit the practicality of the existing control strategies. To addre...
All brains evolve within specific sensory and physical environments. Traditionally, neuroscience has focused on studying neural circuits in isolation, yet holistic characterization of their function requires integrative brain-body testing. To investigate the neural and biomechanical mechanisms of sensorimotor transformations, we constructed realist...
Animals must coordinate multiple body parts to perform important tasks such as grooming, or locomotion. How this movement synchronization is achieved by the nervous system remains largely unknown. Here, we uncover the neural basis of body part coordination during goal-directed antennal grooming in the fly, Drosophila melanogaster . We find that uni...
Neuromuscular controllers (NMCs) offer a promising approach to adaptive and task-invariant control of exoskeletons for walking assistance, leveraging the bioinspired models based on the peripheral nervous system. This article expands on our previous development of a novel structure for NMCs with modifications to the virtual muscle model and reflex...
Most birds can navigate seamlessly between aerial and terrestrial environments. Whereas the forelimbs evolved into wings primarily for flight, the hindlimbs serve diverse functions such as walking, hopping and leaping, and jumping take-off for transitions into flight¹. These capabilities have inspired engineers to aim for similar multimodality in a...
Most birds can navigate seamlessly between aerial and terrestrial environments. Whereas the forelimbs evolved into wings primarily for flight, the hindlimbs serve diverse functions such as walking, hopping, and leaping, and jumping take-off for transitions into flight. These capabilities have inspired engineers to aim for similar multi-modality in...
This paper is associated with a video winner of a 2023 American Physical Society's Division of Fluid Dynamics (DFD) Gallery of Fluid Motion Award for work presented at the DFD Gallery of Fluid Motion. The original video is available online at the Gallery of Fluid Motion, marker GFM.
Published by the American Physical Society 2024
Accurate detection of locomotion transitions, such as walk to sit, walk to stair ascent, and descent, is crucial to effectively control robotic assistive devices, such as lower-limb exoskeletons, as each locomotion mode requires specific assistance. Variability in collected sensor data introduced by user- or system-specific characteristics makes it...
We present a framework for learning a single policy capable of producing all quadruped gaits and transitions. The framework consists of a policy trained with deep reinforcement learning (DRL) to modulate the parameters of a system of abstract oscillators (i.e. Central Pattern Generator), whose output is mapped to joint commands through a pattern fo...
Typical legged locomotion controllers are designed or trained offline. This is in contrast to many animals, which are able to locomote at birth, and rapidly improve their locomotion skills with few real-world interactions. Such motor control is possible through oscillatory neural networks located in the spinal cord of vertebrates, known as Central...
This paper presents a framework for dynamic object catching using a quadruped robot's front legs while it stands on its rear legs. The system integrates computer vision, trajectory prediction, and leg control to enable the quadruped to visually detect, track, and successfully catch a thrown object using an onboard camera. Leveraging a fine-tuned YO...
Perching with winged Unmanned Aerial Vehicles has often been solved by means of complex control or intricate appendages. Here, we present a method that relies on passive wing morphing for crash-landing on trees and other types of vertical poles. Inspired by the adaptability of animals’ and bats’ limbs in gripping and holding onto trees, we design d...
Quadruped robots are showing impressive abilities to navigate the real world. If they are to become more integrated into society, social trust in interactions with humans will become increasingly important. Additionally, robots will need to be adaptable to different humans based on individual preferences. In this work, we study the social interacti...
Humans have many redundancies in their bodies and can make effective use of them to adapt to changes in the environment while walking. They can also vary their walking speed in a wide range. Human-like walking in simulation or by robots can be achieved through imitation learning. However, the walking speed is typically limited to a scale similar to...
Despite their potential, exoskeletons have not reached widespread adoption in daily life, partly due to the challenge of seamlessly adapting assistance across various tasks and environments. Task-specific designs, reliance on complex sensing and extensive data-driven training often limit the practicality of the existing control strategies. To addre...
A bstract
Neuromuscular controllers (NMCs) offer a promising approach to adaptive and task-invariant control of exoskeletons for walking assistance, leveraging the bioinspired models based on the peripheral nervous system. This article expands on our previous development of a novel structure for NMCs with modifications to the virtual muscle model a...
Animals have evolved highly effective locomotion capabilities in terrestrial, aerial, and aquatic environments. Over life’s history, mass extinctions have wiped out unique animal species with specialized adaptations, leaving paleontologists to reconstruct their locomotion through fossil analysis. Despite advancements, little is known about how exti...
This study introduces a novel neuromechanical model employing a detailed spiking neural network to explore the role of axial proprioceptive sensory feedback in salamander locomotion. Unlike previous studies that often oversimplified the dynamics of the locomotor networks, our model includes detailed simulations of the classes of neurons that are co...
Humans can perform movements in various physical environments and positions (corresponding to different experienced gravity), requiring the interaction of the musculoskeletal system, the neural system and the external environment. The neural system is itself comprised of several interactive components, from the brain mainly conducting motor plannin...
Quadruped animals are capable of seamless transitions between different gaits. While energy efficiency appears to be one of the reasons for changing gaits, other determinant factors likely play a role too, including terrain properties. In this article, we propose that viability, i.e., the avoidance of falls, represents an important criterion for ga...
Background: Efficient gait assistance by augmentative exoskeletons depends on reliable control strategies. While numerous control methods and their effects on the metabolic cost of walking have been explored in the literature, the use of different exoskeletons and dissimilar protocols limit direct comparisons. In this article, we present and compar...
Animals have evolved highly effective locomotion capabilities in terrestrial, aerial, and aquatic environments. Over life’s history, mass extinctions have wiped out unique animal species with specialized adaptations, leaving paleontologists to reconstruct their locomotion through fossil analysis. Despite advancements, little is known about how exti...
Complex interactions between brain regions and the spinal cord (SC) govern body motion, which is ultimately driven by muscle activation. Motor planning or learning are mainly conducted at higher brain regions, whilst the SC acts as a brain-muscle gateway and as a motor control centre providing fast reflexes and muscle activity regulation. Thus, hig...
Gait phase (GP) estimation is a critical component in control of exoskeletons and prostheses, enabling seamless user interaction in various controllers. In recent years, methods based on machine learning and sensor fusion have offered advances in GP estimation, but their high computational costs and reliance on training and numerous sensors present...
In early 2016, we had the opportunity to test a pair of sprawling posture robots, one designed to mimic a crocodile and another designed to mimic a monitor lizard, along the banks of the Nile River in Uganda, Africa. These robots were developed uniquely for a documentary by the BBC called Spy in the Wild and fell at the intersection of our interest...
Objective. Studying the neural components regulating movement in human locomotion is obstructed by the inability to perform invasive experimental recording in the human neural circuits. Neuromechanical simulations can provide insights by modeling the locomotor circuits. Past neuromechanical models proposed control of locomotion either driven by cen...
People with late-stage Parkinson’s disease (PD) often suffer from debilitating locomotor deficits that are resistant to currently available therapies. To alleviate these deficits, we developed a neuroprosthesis operating in closed loop that targets the dorsal root entry zones innervating lumbosacral segments to reproduce the natural spatiotemporal...
The study of animal locomotion and neuromechanical control offers valuable insights for advancing research in neuroscience, biomechanics, and robotics. We have developed FARMS (Framework for Animal and Robot Modeling and Simulation), an open-source, interdisciplinary framework, designed to facilitate access to neuromechanical simulations for modeli...
Exoskeletons intended for partial assistance of walking should be able to follow the gait pattern of their users, via online adaptive control strategies rather than imposing predefined kinetic or kinematic profiles. NeuroMuscular Controllers (NMCs) are adaptive strategies inspired by the neuromuscular modeling methods that seek to mimic and replica...
The growing demand for online gait phase (GP) estimation, driven by advancements in exoskeletons and prostheses, has prompted numerous approaches in the literature. Some approaches explicitly use time, while others rely on state variables to estimate the GP. In this article, we study two novel GP estimation methods: a State-based Method (SM) which...
Accurate real-time estimation of the gait phase (GP) is crucial for many control methods in exoskeletons and prostheses. A class of approaches to GP estimation construct the phase portrait of a segment or joint angle, and use the normalized polar angle of this diagram to estimate the GP. Although several studies have investigated such methods, quan...
Anguilliform swimmers, like eels or lampreys, are highly efficient swimmers. Key to understanding their performances is the relationship between the body’s kinematics and resulting swimming speed and efficiency. But, we cannot prescribe kinematics to living fish, and it is challenging to measure their power consumption. Here, we characterise the sw...
Robot motor skills can be acquired by deep reinforcement learning as neural networks to reflect state–action mapping. The selection of states has been demonstrated to be crucial for successful robot motor learning. However, because of the complexity of neural networks, human insights and engineering efforts are often required to select appropriate...
Animal locomotion is the result of complex and multi-layered interactions between the nervous system, the musculo-skeletal system and the environment. Decoding the underlying mechanisms requires an integrative approach. Comparative experimental biology has allowed researchers to study the underlying components and some of their interactions across...
For people with limited mobility, navigating in cluttered indoor environment is challenging. In this work, we propose a mobile assistive furniture suite that is designed to ease the life of people with special needs in indoor movement. To enable intelligent coordination of this system, a key component is the localization of each mobile furniture. T...
Robot motor skills can be learned through deep reinforcement learning (DRL) by neural networks as state-action mappings. While the selection of state observations is crucial, there has been a lack of quantitative analysis to date. Here, we present a systematic saliency analysis that quantitatively evaluates the relative importance of different feed...
Quadruped animals seamlessly transition between gaits as they change locomotion speeds. While the most widely accepted explanation for gait transitions is energy efficiency, there is no clear consensus on the determining factor, nor on the potential effects from terrain properties. In this article, we propose that viability, i.e. the avoidance of f...
Robotics and neuroscience are sister disciplines that both aim to understand how agile, efficient, and robust locomotion can be achieved in autonomous agents. Robotics has already benefitted from neuromechanical principles discovered by investigating animals. These include the use of high-level commands to control low-level central pattern generato...
Anguilliform swimmers, like eels or lampreys, are highly efficient swimmers. Key to understanding their performances is the relationship between the body's kinematics and resulting swimming speed and efficiency. But, we cannot prescribe kinematics to living fish, and it is challenging to measure their power consumption. Here, we characterise the sw...
Complex interactions between brain regions and the spinal cord (SC) govern body motion, which is ultimately driven by muscle activation. Motor planning or learning are mainly conducted at higher brain regions, whilst the SC acts as a brain-muscle gateway and as a motor control centre providing fast reflexes and muscle activity regulation. Thus, hig...
Quadruped animal locomotion emerges from the interactions between the spinal central pattern generator (CPG), sensory feedback, and supraspinal drive signals from the brain. Computational models of CPGs have been widely used for investigating the spinal cord contribution to animal locomotion control in computational neuroscience and in bio-inspired...
Studying the neural components regulating movement in human locomotion is obstructed by the inability to perform invasive experimental recording. Neuromechanical simulations can provide insights by modeling the locomotor circuits. Past neuromechanical models proposed control of locomotion either driven by central pattern generators (CPGs) with simp...
In this paper, we present a framework for learning quadruped navigation by integrating central pattern generators (CPGs), i.e. systems of coupled oscillators, into the deep reinforcement learning (DRL) framework. Through both exteroceptive and proprioceptive sensing, the agent learns to modulate the intrinsic oscillator setpoints (amplitude and fre...
In this letter, we present a method for integrating central pattern generators (CPGs), i.e. systems of coupled oscillators, into the deep reinforcement learning (DRL) framework to produce robust and omnidirectional quadruped locomotion. The agent learns to directly modulate the intrinsic oscillator setpoints (amplitude and frequency) and coordinate...
In this letter, we present a method for integrating central pattern generators (CPGs), i.e. systems of coupled oscillators, into the deep reinforcement learning (DRL) framework to produce robust and omnidirectional quadruped locomotion. The agent learns to directly modulate the intrinsic oscillator setpoints (amplitude and frequency) and coordinate...
This study investigates the pathological toe and heel gaits seen in human locomotion using neuromusculoskeletal modelling and simulation. In particular, it aims to investigate potential cause–effect relationships between biomechanical or neural impairments and pathological gaits. Toe and heel gaits are commonly present in spinal cord injury, stroke...
Animal behavior emerges from an interaction between neural network dynamics, musculoskeletal properties and the physical environment. Accessing and understanding the interplay between these elements requires the development of integrative and morphologically realistic neuromechanical simulations. Here we present NeuroMechFly, a data-driven model of...
New technologies and the increasing integration of biological and engineering approaches are revealing fundamental new insights into how animals actuate and control movement to achieve agility, stability and economy while manoeuvring and navigating through complex environments. As a result, new information is emerging about how flying, swimming and...
Controlling wearable exoskeletons to interact with people suffering from locomotion disabilities due to lesions of the central nervous system is a complex challenge since it entails fulfillment of many concurrent objectives: versatility in different applications (assistance and rehabilitation), user-specific adaptation to residual motor functions,...
Animal locomotion results from a combination of power modulation and cyclic appendage trajectories, but combining these two properties in small-sized robots is difficult. Here, we introduce and characterize a new elastic actuation system based on an inverted cam that is capable of generating cyclic locomotion with controlled elastic energy charge a...
Neural control of movement cannot be fully understood without careful consideration of interactions between the neural and biomechanical components. Recent advancements in mouse molecular genetics allow for the identification and manipulation of constituent elements underlying the neural control of movement. To complement experimental studies and i...
Central pattern generator (CPG) models have long been used to investigate both the neural mechanisms that underlie animal locomotion, as well as for robotic research. In this work we propose a spiking central pattern generator (SCPG) neural network and its implementation on neuromorphic hardware as a means to control a simulated lamprey model. To c...
Oscillators have two main limitations: their synchronization properties are limited (i.e they have a finite synchronization region) and they have no memory of past interactions (i.e. they return to their intrinsic frequency whenever the entraining signal disappears). We previously proposed a general mechanism to transform an oscillator into an adap...
Undulatory swimming represents an ideal behavior to investigate locomotion control and the role of the underlying central and peripheral components in the spinal cord. Many vertebrate swimmers have central pattern generators and local pressure-sensitive receptors that provide information about the surrounding fluid. However, it remains difficult to...
Background
Many lower-limb exoskeletons have been developed to assist gait, exhibiting a large range of control methods. The goal of this paper is to review and classify these control strategies, that determine how these devices interact with the user.
Methods
In addition to covering the recent publications on the control of lower-limb exoskeleton...
Deciphering how quadrupeds coordinate their legs and other body parts, such as the trunk, head, and tail (i.e., body–limb coordination), can provide informative insights to improve legged robot mobility. In this study, we focused on sprawling locomotion of the salamander and aimed to understand the body–limb coordination mechanisms through mathemat...
The central nervous system of humans and other animals modulates spinal cord activity to achieve several locomotion behaviors. Previous neuromechanical models investigated the modulation of human gait changing selected parameters belonging to CPGs (Central Pattern Generators) feedforward oscillatory structures or to feedback reflex circuits. CPG-ba...
Animal behavior emerges from a seamless interaction between musculoskeletal elements, neural network dynamics, and the environment. Accessing and understanding the interplay between these intertwined systems requires the development of integrative neuromechanical simulations. Until now, there has been no such simulation framework for the widely stu...
Gait analysis has traditionally been carried out in a laboratory environment using expensive equipment, but, recently, reliable, affordable, and wearable sensors have enabled integration into clinical applications as well as use during activities of daily living. Real-time gait analysis is key to the development of gait rehabilitation techniques an...
There are currently many quadruped robots suited to a wide range of applications, but traversing some terrains, such as vertical ladders, remains an open challenge. There is still a need to develop adaptive robots that can walk and climb efficiently. This paper presents an adaptive quadruped robot that, by mimicking feline structure, supports sever...
This article examines the importance of integrating locomotion and cognitive information for achieving dynamic locomotion from a viewpoint combining biology and ecological psychology. We present a mammalian neuromusculoskeletal model from external sensory information processing to muscle activation, which includes: 1) a visual-attention control mec...
Central Pattern Generators (CPGs) models have been long used to investigate both the neural mechanisms that underlie animal locomotion as well as a tool for robotic research. In this work we propose a spiking CPG neural network and its implementation on neuromorphic hardware as a means to control a simulated lamprey model. To construct our CPG mode...
Quadruped animals achieve agile and highly adaptive locomotion owing to the coordination between their legs and other body parts, such as the trunk, head, and tail, that is, body–limb coordination. This study aims to understand the sensorimotor control underlying body–limb coordination. To this end, we adopted sprawling locomotion in vertebrate ani...
In this paper, we present the design, control, and preliminary evaluation of the Symbitron exoskeleton, a lower limb modular exoskeleton developed for people with a spinal cord injury. The mechanical and electrical configuration and the controller can be personalized to accommodate differences in impairments among individuals with spinal cord injur...
Diverse locomotor behaviors emerge from the interactions between the spinal central pattern generator (CPG), descending brain signals and sensory feedback. Salamander motor behaviors include swimming, struggling, forward underwater stepping, and forward and backward terrestrial stepping. Electromyographic and kinematic recordings of the trunk show...
The central nervous system of humans and animals is able to modulate the activity in the spinal cord to achieve several locomotion behaviors. Previous neuromechanical models investigated the modulation of human gait changing selected parameters belonging to the CPGs (Central Pattern Generators) feedforward oscillatory structures or to the feedback...
Sprawling locomotion is a quadruped walking gait with lateral body bending used by salamanders, lizards, and crocodiles and so on. It presents an interesting example of how quadrupeds coordinate their legs and other body parts such as the trunk, head, and tail for adaptive locomotion, i.e., an interesting example of body–limb coordination. A better...