Achim J. LilienthalÖrebro University | oru · Center for Applied Autonomous Sensor Systems (AASS)
Achim J. Lilienthal
Ph.D.
About
496
Publications
158,938
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
9,498
Citations
Introduction
I am professor of Computer Science at Örebro University and head of the Mobile Robotics and Olfaction (MRO) Lab, a research group at the AASS Research Centre.
My primary research interest is on perception systems for mobile robots that operate in unconstrained, dynamic environments. A major aim is to integrate research results timely in industrial demonstrators. More specifically, my research addresses Rich 3D Perception, Robot Vision and Mobile Robot Olfaction.
Additional affiliations
June 2013 - present
July 2005 - January 2008
February 2012 - May 2013
Publications
Publications (496)
Scan registration is an essential subtask when building maps based on range finder data from mobile robots. The problem is to deduce how the robot has moved between con- secutive scans, based on the shape of overlapping portions of the scans. This paper pre- sents a new algorithm for registration of 3D data. The algorithm is a generalization and im...
Roboticists often take inspiration from animals for designing sensors, actuators, or algorithms that control the behavior of robots. Bio-inspiration is motivated with the uncanny ability of animals to solve complex tasks like recognizing and manipulating objects, walking on uneven terrains, or navigating to the source of an odor plume. In particula...
Gas distribution modelling constitutes an ideal application area for mobile robots, which - as intelligent mobile gas sensors - offer several advantages compared to stationary sensor networks. In this paper we propose the Kernel DM+V algorithm to learn a statistical 2-d gas distribution model from a sequence of localized gas sensor measurements. Th...
We present a new algorithm for scan registration of colored 3D point data which is an extension to the normal distributions transform (NDT). The probabilistic approach of NDT is extended to a color-aware registration algorithm by modeling the point distributions as Gaussian mixture-models in color space. We discuss different point cloud registratio...
Eye tracking is getting increasingly popular in mathematics education research. Studies predominantly rely on the so-called eye-mind hypothesis (EMH), which posits that what persons fixate on closely relates to what they process. Given that the EMH was developed in reading research, we see the risk that implicit assumptions are tacitly adopted in m...
This work introduces a novel detector, bounded false-alarm rate (BFAR), for distinguishing true detections from noise in radar data, leading to improved accuracy in radar odometry estimation. Scanning frequency-modulated continuous wave (FMCW) radars can serve as valuable tools for localization and mapping under low visibility conditions. However,...
Adverse weather (rain, snow, and fog) can negatively impact computer vision tasks by introducing noise in sensor data; therefore, it is essential to recognize weather conditions for building safe and robust autonomous systems in the agricultural and autonomous driving/drone sectors. The performance degradation in computer vision tasks due to advers...
We present a new large dataset of indoor human and robot navigation and interaction, called THÖR-MAGNI, that is designed to facilitate research on social human navigation: for example, modeling and predicting human motion, analyzing goal-oriented interactions between humans and robots, and investigating visual attention in a social interaction cont...
Maps of dynamics are effective representations of motion patterns learned from prior observations, with recent research demonstrating their ability to enhance performance in various downstream tasks such as human-aware robot navigation, long-term human motion prediction, and robot localization. Current advancements have primarily concentrated on me...
Social robots, owing to their embodied physical presence in human spaces and the ability to directly interact with the users and their environment, have a great potential to support children in various activities in education, healthcare and daily life. Child–Robot Interaction (CRI), as any domain involving children, inevitably faces the major chal...
Robots and other intelligent systems navigating in complex dynamic environments should predict future actions and intentions of surrounding agents to reach their goals efficiently and avoid collisions. The dynamics of those agents strongly depends on their tasks, roles, or observable labels. Class-conditioned motion prediction is thus an appealing...
The human gaze is an important cue to signal intention, attention, distraction, and the regions of interest in the immediate surroundings. Gaze tracking can transform how robots perceive, understand, and react to people, enabling new modes of robot control, interaction, and collaboration. In this paper, we use gaze tracking data from a rich dataset...
Considering the tractability of OGM (Occupancy Grid Map) and its wide use in the dynamic environment representation of mobile robotics, the extraction of motion information from successive OGMs are very important for many tasks, such as SLAM (Simultaneously Localization And Mapping) and DATMO (Detection and Tracking of Moving Object). In this paper...
Interactions between mobile robots and human operators in common areas require a high level of safety, especially in terms of trajectory planning, obstacle avoidance and mutual cooperation. In this connection, the crossings of planned trajectories and their uncertainty based on model fluctuations, system noise and sensor noise play an outstanding r...
Interactions between mobile robots and human operators in common areas require a high safety especially in terms of trajectory planning, obstacle avoidance and mutual cooperation. In this connection the crossings of planned trajectories, their uncertainty based on model fluctuations, system noise and sensor noise,play an outstanding role. This pape...
This paper motivates and describes the THÖR-MAGNI dataset: a collection of human motion data aligned with eye tracking data and robot sensor data.
Submitted to The International Journal of Robotics Research (IJRR) on 28 of February 2024.
Recognizing patterns is an essential skill in early mathematics education. However, first graders often have difficulties with tasks such as extending patterns of the form ABCABC. Studies show that this pattern-recognition ability is a good predictor of later pre-algebraic skills and mathematical achievement in general, or the development of mathem...
There is growing evidence that the ability to perceive structure is essential for students’ mathematical development. Looking at students’ structure sense in basic numerical and patterning tasks seems promising for understanding how these tasks set the foundation for the development of later mathematical skills. Previous studies have shown how stud...
Mobile multi-robot systems are well suited for gas leak localization in challenging environments. They offer inherent advantages such as redundancy, scalability, and resilience to hazardous environments, all while enabling autonomous operation, which is key to efficient swarm exploration. To efficiently localize gas sources using concentration meas...
Autonomous systems, that need to operate in human environments and interact with the users, rely on understanding and anticipating human activity and motion. Among the many factors which influence human motion, semantic attributes, such as the roles and ongoing activities of the detected people, provide a powerful cue on their future motion, action...
Human motion prediction is important for mobile service robots and intelligent vehicles to operate safely and smoothly around people. The more accurate predictions are, particularly over extended periods of time, the better a system can, e.g., assess collision risks and plan ahead. In this paper, we propose to exploit maps of dynamics (MoDs, a clas...
Robotic mapping provides spatial information for autonomous agents. Depending on the tasks they seek to enable, the maps created range from simple 2D representations of the environment geometry to complex, multilayered semantic maps. This survey article is about maps of dynamics (MoDs), which store semantic information about typical motion patterns...
The number line (NL) is an important tool in mathematics education. Students with mathematical difficulties (MD) tend to have difficulties in NL tasks, as indicated by qualitative analyses of eye-tracking data. However, these qualitative analyses are laborious especially for large amounts of data. Our paper uses an innovate approach to facilitate t...
For early mathematics learning, adaptive strategy use by students at different levels of mathematical achievement is of central importance. For several mathematical tasks, there is evidence that high-achieving students are more able to use strategies adaptively, but not yet for pattern-recognition tasks. This paper presents results from an empirica...
A central concern of mathematics education is to develop students’ understanding of multiplication. To this end, it is necessary to investigate students’ strategies in multiplication tasks. Common representations for multiplication are array representations (AR) (i.e., rectangular arrangement of elements). Previous research has identified strategie...
Webcam-based eye tracking (wcET) comes with the promise to become a pervasive platform for inexpensive, easy, and quick collection of gaze data without requiring dedicated hardware. To fulfill this promise, wcET must address issues with poor and variable spatial accuracy due to, e.g., participant movement, calibration validity, and the uncertainty...
Robots are increasingly used in shared environments with humans, making effective communication a necessity for successful human-robot interaction. In our work, we study a crucial component: active communication of robot intent. Here, we present an anthropomorphic solution where a humanoid robot communicates the intent of its host robot acting as a...
Human motion prediction is essential for the safe and smooth operation of mobile service robots and intelligent vehicles around people. Commonly used neural network-based approaches often require large amounts of complete trajectories to represent motion dynamics in complex semantically-rich spaces. This requirement may complicate deployment of phy...
Registration of point cloud data containing both depth and color information is critical for a variety of applications, including in-field robotic plant manipulation, crop growth modeling, and autonomous navigation. However, current state-of-the-art registration methods often fail in challenging agricultural field conditions due to factors such as...
Automated forest machines are becoming important due to human operators’ complex and dangerous working conditions, leading to a labor shortage. This study proposes a new method for robust SLAM and tree mapping using low-resolution LiDAR sensors in forestry conditions. Our method relies on tree detection to perform scan registration and pose correct...
Current intralogistics services require keeping up with e-commerce demands, reducing delivery times and waste, and increasing overall flexibility. As a consequence, the use of automated guided vehicles (AGVs) and, more recently, autonomous mobile robots (AMRs) for logistics operations is steadily increasing.
Eye tracking (ET) is increasingly used in cognitive science and human-computer interaction research. Currently, however, expensive ET devices are required, which limits their pervasive application, for example, as a tool for digital learning. The emergence of low-cost Artificial Intelligence (AI)-based consumer-grade webcam eye tracking, partially...
To better understand the dynamics in hazardous environments, gas distribution mapping aims to map the gas concentration levels of a specified area precisely. Sampling is typically carried out in a spatially sparse manner, either with a mobile robot or a sensor network and concentration values between known data points have to be interpolated. In th...
This paper presents an accurate, highly efficient, and learning-free method for large-scale odometry estimation using spinning radar, empirically found to generalize well across very diverse environments -- outdoors, from urban to woodland, and indoors in warehouses and mines - without changing parameters. Our method integrates motion compensation...
Robots operating with humans in highly dynamic environments need not only react to moving persons and objects but also to anticipate and adhere to patterns of motion of dynamic agents in their environment. Currently, robotic systems use information about dynamics locally, through tracking and predicting motion within their direct perceptual range....
Rapid development of social robots stimulates active research in human motion modeling, interpretation and prediction, proactive collision avoidance, human-robot interaction and co-habitation in shared spaces. Modern approaches to this end require high quality datasets for training and evaluation. However, the majority of available datasets suffers...
Robots are increasingly deployed in spaces shared with humans, including home settings and industrial environments. In these environments, the interaction between humans and robots (HRI) is crucial for safety, legibility, and efficiency. A key factor in HRI is trust, which modulates the acceptance of the system. Anthropomorphism has been shown to m...
Students who are deaf or hard-of-hearing (DHH) often show significant difficulties in learning mathematics. Previous studies have reported that students who are DHH lag several years behind in their mathematical development compared to hearing students. As possible reasons, limited learning opportunities due to a lesser incidental exposure to numer...
Human motion trajectory prediction, an essential task for autonomous systems in many domains, has been on the rise in recent years. With a multitude of new methods proposed by different communities, the lack of standardized benchmarks and objective comparisons is increasingly becoming a major limitation to assess progress and guide further research...
Recognizing patterns is an important skill in early mathematics learning. Yet only few studies have investigated how first-grade students recognize patterns. These studies mainly analyzed students’ expressions and drawings in individual interviews. The study presented in this paper used eye tracking in order to explore the processes of 22 first-gra...
Robust perception is an essential component to enable long-term operation of mobile robots. It depends on failure resilience through reliable sensor data and preprocessing, as well as failure awareness through introspection, for example the ability to self-assess localization performance. This paper presents CorAl: a principled, intuitive, and gene...
This paper presents CorAl: a principled, intuitive, and generalizable method to measure the quality of alignment between pairs of point clouds, which learns to detect alignment errors in a self-supervised manner. CorAl compares the differential entropy in the point clouds separately with the entropy in their union to account for entropy inherent to...
Detecting chemical compounds using electronic noses is important in many gas sensing related applications. A gas detection system is supposed to indicate a significant event, such as the presence of new chemical compounds or a noteworthy change of concentration levels. Existing gas detection methods typically rely on prior knowledge of target analy...
For researchers and practitioners, it is important to identify students at risk of developing mathematical difficulties. The aim of this pilot study was to investigate whether it is possible to identify first-grade students who are at risk of developing mathematical difficulties (RMD) through online measures in arithmetic and pattern tasks. In our...
In the age of artificial intelligence where standard problems are increasingly processed by computers, creative problem solving, the ability to think outside the box is in high demand. Collaboration is also increasingly significant, which makes creative collaboration an important twenty-first-century skill. In the research described in this paper,...
This article presents an accurate, highly efficient, and learning-free method for large-scale odometry estimation using spinning radar, empirically found to generalize well across very diverse environments—outdoors, from urban to woodland, and indoors in warehouses and mines—without changing parameters. Our method integrates motion compensation wit...
Heavy-duty mobile machines (HDMMs) are a wide range of machinery used in diverse and critical application areas which are currently facing several issues like skilled labor shortage, poor safety records, and harsh work environments. Consequently, efforts are underway to increase automation in HDMMs for increased productivity and safety, eventually...
This paper presents an accurate, highly efficient and learning free method for large-scale radar odometry estimation. By using a simple filtering technique that keeps the strongest returns, we produce a clean radar data representation and reconstruct surface normals for efficient and accurate scan matching. Registration is carried out by minimizing...
This paper presents an efficient and accurate radar odometry pipeline for large-scale localization. We propose a radar filter that keeps only the strongest reflections per-azimuth that exceeds the expected noise level. The filtered radar data is used to incrementally estimate odometry by registering the current scan with a nearby keyframe. By model...
This paper presents a new detector for filtering noise from true detections in radar data, which improves the state of the art in radar odometry. Scanning Frequency-Modulated Continuous Wave (FMCW) radars can be useful for localization and mapping in low visibility, but return a lot of noise compared to (more commonly used) lidar, which makes the d...
This paper presents a efficient and accurate radar odometry pipeline for large-scale localization. We propose a radar filter that keeps only the strongest reflections per-azimuth that exceeds the expected noise level. The filtered radar data is used to incrementally estimate odometry by registering the current scan with a nearby keyframe. By modeli...