Isolation Forest: learned iForest construction for toy dataset

Isolation Forest: learned iForest construction for toy dataset

Source publication
Article
Full-text available
3D point cloud denoising is an increasingly demanding field as such type of data structure is getting more attention in perceiving the 3D environment for diverse applications. Despite their novelty, recently proposed solutions are still modest in terms of effectiveness and robustness, especially for scenes corrupted with a massive amount of noise....

Similar publications

Article
Full-text available
This study aims at developing a new methodological approach for building composite indicators, focusing on the weight schemes through an unsupervised machine learning technique. The composite indicator proposed is based on fuzzy metrics to capture multidimensional concepts that do not have boundaries, such as competitiveness, development, corruptio...

Citations

... Inspired by the fusion denoising algorithms and techniques in the field of image and point cloud processing [17][18][19][20], here we propose a multi-step adaptive denoising framework for superresolution localization data, called MSDenoiser. This framework makes full use of the different characteristics of reported denoising algorithms (including Voronoi Tessellation [21], Frontiers in Physics frontiersin.org ...
Article
Full-text available
Recent developments in single-molecule localization microscopy (SMLM) enable researchers to study macromolecular structures at the nanometer scale. However, due to the complexity of imaging process, there are a variety of complex heterogeneous noises in SMLM data. The conventional denoising methods in SMLM can only remove a single type of noise. And, most of these denoising algorithms require manual parameter setting, which is difficult and unfriendly for biological researchers. To solve these problems, we propose a multi-step adaptive denoising framework called MSDenoiser, which incorporates multiple noise reduction algorithms and can gradually remove heterogeneous mixed noises in SMLM. In addition, this framework can adaptively learn algorithm parameters based on the localization data without manually intervention. We demonstrate the effectiveness of the proposed denoising framework on both simulated data and experimental data with different types of structures (microtubules, nuclear pore complexes and mitochondria). Experimental results show that the proposed method has better denoising effect and universality.
... Therefore, light detection and ranging (lidar) sensors, which provide a three-dimensional depth map of the environment, are often found in sensor setups. While there is much research about local denoising of lidar point clouds on the pixel level [3,74], we are interested in anomalies on object and domain level, where an entire cluster of points or a large and constant shift in appearance is considered as anomalous. Especially weather conditions like rain, snow, and fog heavily influence the data. ...
Preprint
Nowadays, there are outstanding strides towards a future with autonomous vehicles on our roads. While the perception of autonomous vehicles performs well under closed-set conditions, they still struggle to handle the unexpected. This survey provides an extensive overview of anomaly detection techniques based on camera, lidar, radar, multimodal and abstract object level data. We provide a systematization including detection approach, corner case level, ability for an online application, and further attributes. We outline the state-of-the-art and point out current research gaps.
... The Isolation Forest working principle, adapted from[22]. ...
Article
Full-text available
Within the context of Industry 4.0, quality assessment procedures using data-driven techniques are becoming more critical due to the generation of massive amounts of production data. In this paper, we address the detection of abnormal screw tightening processes, which is a key industrial task. Since labeling is costly, requiring a manual effort, we focus on unsupervised detection approaches. In particular, we assume a computationally light low-dimensional problem formulation based on angle–torque pairs. Our work is focused on two unsupervised machine learning (ML) algorithms: isolation forest (IForest) and a deep learning autoencoder (AE). Several computational experiments were held by assuming distinct datasets and a realistic rolling window evaluation procedure. First, we compared the two ML algorithms with two other methods, a local outlier factor method and a supervised Random Forest, on older data related with two production days collected in November 2020. Since competitive results were obtained, during a second stage, we further compared the AE and IForest methods by adopting a more recent and larger dataset (from February to March 2021, totaling 26.9 million observations and related to three distinct assembled products). Both anomaly detection methods obtained an excellent quality class discrimination (higher than 90%) under a realistic rolling window with several training and testing updates. Turning to the computational effort, the AE is much lighter than the IForest for training (around 2.7 times faster) and inference (requiring 3.0 times less computation). This AE property is valuable within this industrial domain since it tends to generate big data. Finally, using the anomaly detection estimates, we developed an interactive visualization tool that provides explainable artificial intelligence (XAI) knowledge for the human operators, helping them to better identify the angle–torque regions associated with screw tightening failures.