Peter Zeiler’s research while affiliated with Esslingen University of Applied Sciences and other places

What is this page?


This page lists works of an author who doesn't have a ResearchGate profile or hasn't added the works to their profile yet. It is automatically generated from public (personal) data to further our legitimate goal of comprehensive and accurate scientific recordkeeping. If you are this author and want this page removed, please let us know.

Publications (48)


A Study on the Effectiveness of Time Series Similarity Measures for the Comparison of Degradation Curves of Similar Engineering Systems
  • Article
  • Full-text available

January 2024

·

64 Reads

IEEE Access

Marcel Braig

·

Peter Zeiler

Data-driven methods have been shown to be suitable for the diagnosis and prognosis of the health of engineering systems. However, the training of data-driven methods usually requires a large amount of data, which is rarely available in industry. In addition, the prediction accuracy often degrades when operating or environmental conditions change or when there are similar systems with different technical characteristics. Transfer learning offers the possibility to transfer knowledge about the degradation behavior between such systems. However, there is a risk that the degradation behavior differs too much, which leads to a so-called negative transfer. Therefore, the authors argue that a similarity assessment of degradation behavior is essential. An assessment based on the operational data of systems seems particularly appropriate. In this paper, the suitability of time series similarity measures for such data-based similarity assessments is investigated. The current state of research is presented. Thereby, no studies on the similarity comparison of degradation curves of engineering systems using time series similarity measures are found. Furthermore, measures for assessing the similarity of degradation curves are identified and categorized. In a case study on filter clogging curves, similarity tests are performed using these measures to find the most similar time series. Various approaches are proposed for evaluation, two of which are used in this paper. The results show that mostly a good selection is made, with some measures performing particularly well. The work presented in this paper represents valuable groundwork for the use of time series similarity measures in transfer learning.

Download


Fig. 1. Schematic representation of pipelines constructed by AUTORUL to map sensor data to RUL predictions. The pipeline is structured into three major phases: data cleaning, feature engineering and regression. Each phase contains multiple steps, displayed below the ML pipeline, configured by various hyperparameters. Steps with solid borders indicate mandatory steps included in every pipeline while dashed borders represent optional pipeline steps.
Fig. 2. Visualization of the mean performance, aggregated over all datasets and iterations, with standard deviations plotted over time. Displayed is the immediate regret, i.e., the performance difference to the best solution, of the best so-far found configuration as a function over wall clock time.
Automated Machine Learning for Remaining Useful Life Predictions

June 2023

·

149 Reads

Being able to predict the remaining useful life (RUL) of an engineering system is an important task in prognostics and health management. Recently, data-driven approaches to RUL predictions are becoming prevalent over model-based approaches since no underlying physical knowledge of the engineering system is required. Yet, this just replaces required expertise of the underlying physics with machine learning (ML) expertise, which is often also not available. Automated machine learning (AutoML) promises to build end-to-end ML pipelines automatically enabling domain experts without ML expertise to create their own models. This paper introduces AutoRUL, an AutoML-driven end-to-end approach for automatic RUL predictions. AutoRUL combines fine-tuned standard regression methods to an ensemble with high predictive power. By evaluating the proposed method on eight real-world and synthetic datasets against state-of-the-art hand-crafted models, we show that AutoML provides a viable alternative to hand-crafted data-driven RUL predictions. Consequently, creating RUL predictions can be made more accessible for domain experts using AutoML by eliminating ML expertise from data-driven model construction.


Verwendung von Kenntnissen über den Degradationsprozess beim Training eines künstlichen neuronalen Netzes zur Steigerung der Vorhersagegenauigkeit einer Prognose der verbleibenden nutzbaren Lebensdau...

January 2023

·

3 Reads

Vorwort Sehr geehrte Damen und Herren, durch die zunehmende Digitalisierung, Autonomisierung und Vernetzung von technischen Systemen, beispielsweise in einer Smart Factory im Kontext von Industrie 4.0 oder in autonomen Fahrzeugen, werden hohe Anforderungen an die Zuverlässigkeit, die Verfügbarkeit und die Sicherheit dieser Systeme gestellt. Dies erfordert den konsequenten Einsatz und die ständige Weiterentwicklung von Methoden und Modellen der Zuverlässigkeitstechnik entlang des gesamten Lebenszyklus zur Planung, Entwicklung und Absicherung der Zuverlässigkeit. Die zunehmende Digitalisierung bietet durch die steigende Zugänglichkeit und Verfügbarkeit von relevanten Daten gleichzeitig enorme Chancen und neue Möglichkeiten für die Anwendung dieser Methoden und Modelle für Zuverlässigkeitsanalysen und -prognosen. Der vorliegende Tagungsband enthält die Manuskripte der Referenten und Referentinnen und der Posterreferenten. Der Tagungsleiter und die Mitglieder des Programmausschusses danken allen, die zum Gelingen der Veranstaltung mitwirken. Die VDI Wissensforum GmbH und die VDI-Gesellschaft Produkt- und Prozessgestaltung (GPP) führen die Tagung Technische Zuverlä...


Figure 1. Illustration of the functional principle of the hybrid prognostic methods (a) physics-based generation of synthetic training data and (b) final hypothesis set validation.
Figure 2. Illustration of the functional principle of the hybrid prognostic methods (a) physics-based model as input and (b) physics-based model within the data-driven model.
Figure 3. Illustration of the functional principle of the hybrid prognostic methods (a) residual modeling and (b) regions of competence.
Figure 4. Differential pressure trajectories of filter loading under identical conditions except for (a) the type of dust and (b) the dust supply per time. There are (a) three types of dust and (b) three levels of dust feed with three trajectories each.
A Comparative Study on Methods for Fusing Data-Driven and Physics-Based Models for Hybrid Remaining Useful Life Prediction of Air Filters

January 2023

·

77 Reads

·

6 Citations

IEEE Access

Approaches for diagnosis and prognosis of the health of engineering systems are divided into data-driven, model-based, and hybrid methods. Data-driven methods depend on the availability of data. Model-based methods require knowledge of the degradation process. A great effort for data generation along with the high complexity of degradation processes often limits both approaches. To mitigate these limitations, the combination of data and knowledge through hybrid methods is examined in this paper. This approach is compared to the alternative approach of reducing the effort for generating training data, as both are gaining importance in diagnostics and prognostics. A new categorization of hybrid prognostic methods for combining data-driven and physics-based models is presented, along with references to existing realizations of these methods. Based on the categorization, a case study on the hybrid remaining useful life prediction of a filtration process is conducted. Several hybrid methods are implemented and tested in this study. Through the combination of models, an improvement in predictive accuracy is achieved. In addition, the paper examines systematic attributes of the individual hybrid methods. Statements on the influence of data scarcity on the predictive accuracy, data-driven models with high variance, and the computational efficiency of the hybrid methods are made. It is shown that these statements are supported by the case study’s results.


Evaluierung der Güte von datengetriebenen Methoden zur Lebensdauerprognose technischer Systeme unter Berücksichtigung von Zeitreihencharakteristiken

January 2023

·

12 Reads

Vorwort Sehr geehrte Damen und Herren, durch die zunehmende Digitalisierung, Autonomisierung und Vernetzung von technischen Systemen, beispielsweise in einer Smart Factory im Kontext von Industrie 4.0 oder in autonomen Fahrzeugen, werden hohe Anforderungen an die Zuverlässigkeit, die Verfügbarkeit und die Sicherheit dieser Systeme gestellt. Dies erfordert den konsequenten Einsatz und die ständige Weiterentwicklung von Methoden und Modellen der Zuverlässigkeitstechnik entlang des gesamten Lebenszyklus zur Planung, Entwicklung und Absicherung der Zuverlässigkeit. Die zunehmende Digitalisierung bietet durch die steigende Zugänglichkeit und Verfügbarkeit von relevanten Daten gleichzeitig enorme Chancen und neue Möglichkeiten für die Anwendung dieser Methoden und Modelle für Zuverlässigkeitsanalysen und -prognosen. Der vorliegende Tagungsband enthält die Manuskripte der Referenten und Referentinnen und der Posterreferenten. Der Tagungsleiter und die Mitglieder des Programmausschusses danken allen, die zum Gelingen der Veranstaltung mitwirken. Die VDI Wissensforum GmbH und die VDI-Gesellschaft Produkt- und Prozessgestaltung (GPP) führen die Tagung Technische Zuverlä...


On the Integration of Fundamental Knowledge about Degradation Processes into Data-Driven Diagnostics and Prognostics Using Theory-Guided Data Science

June 2022

·

108 Reads

·

9 Citations

PHM Society European Conference

In Prognostics and Health Management, there are three main approaches for implementing diagnostic and prognostic applications. These approaches are data-driven methods, physical model-based methods, and combinations of them, in the form of hybrid methods. Each of them has specific advantages but also limitations for their purposeful implementation. In the case of data-driven methods, one of the main limitations is the availability of sufficient training data that adequately cover the relevant state space. For model-based methods, on the other hand, it is often the case that the degradation process of the considered technical system is of significant complexity. In such a scenario physics-based modeling requires great effort or is not possible at all. Combinations of data-driven and model-based approaches in form of hybrid approaches offer the possibility to partially mitigate the shortcomings of the other two approaches, however, require a sufficiently detailed data-driven and physics-based model. This paper addresses the transitional field between data-driven and hybrid approaches. Despite the issues of formulating a physics-based model that provides a representation of the degradation process, basic knowledge of the considered system and of the laws governing its degradation process is usually available. Integration of such knowledge into a machine learning process is part of a research field that is either called theory-guided data science, (physics) informed machine learning, physics-based learning or physics guided machine learning. First, the state of research in Prognostics and Health Management on methods of this field is presented and existing research gaps are outlined. Then, a concept is introduced for incorporating fundamental knowledge, such as monotonicity constraints, into data-driven diagnostic and prognostic applications using approaches from theory-guided data science. A special aspect of this concept is its cross-application usability through the consideration of knowledge that repeatedly occurs in diagnostics and prognostics. This is, for example, knowledge about physically justified boundaries whose compliance makes a prediction of the data-driven model plausible in the first place.




Using Data From Similar Systems for Data-Driven Condition Diagnosis and Prognosis of Engineering Systems: A Review and an Outline of Future Research Challenges

January 2022

·

149 Reads

·

11 Citations

IEEE Access

Prognostics and health management (PHM) is an engineering approach dealing with the diagnosis, prognosis, and management of the health state of engineering systems. Methods that can analyze system behavior, fault conditions, and degradation are crucial for PHM applications, as they create the basis for determining, predicting, and monitoring the health of engineering systems. Data-driven methods have been proven to be suitable for automated diagnosis or prognosis due to their pattern recognition and anomaly detection abilities. Moreover, they do not require knowledge of the underlying degradation process. However, training data-driven methods usually requires a large amount of data, whose collection, cleansing, organization, and preparation are generally very time-consuming and costly. There are usually little or no run-to-failure data available at market launch, especially for new systems such as new machine generations. Nevertheless, related systems, hereinafter referred to as similar systems, often already exist, differing only in some technical characteristics. In this paper, the similar system problem is defined, and explanations of the difficulties that arise when using data from similar systems are presented. Furthermore, it is discussed why the usage of these data offers great potential for condition diagnosis and prognosis of engineering systems. An overview of data-driven methods that can be used to utilize data from similar systems is provided, and the methods that such systems already consider are highlighted. Two related research areas are identified, namely, fleet learning and transfer learning. In the paper, it is shown that similar system approaches will become an important branch of research in PHM. However, some difficulties must be overcome.


Citations (22)


... In the AUTORUL [3] project, automatic feature extraction and model selection are integrated with fine-tuned standard regression methods to adapt the pipeline for prognostic tasks. However, this approach appears overly simplistic and too limited when applied to complex predictive maintenance problems. ...

Reference:

Mopidip: a modular real-time pipeline for machinery diagnosis and prognosis based on deep learning algorithms
Automated Machine Learning for Remaining Useful Life Predictions

... By using ML to model the relationship of the system health and RUL, no thorough understanding of the degradation process is required. In recent years, various ML methods, like random forest or different neural networks, have been proposed to model RUL predictions [2], [4]. ...

Performance Evaluation of Neural Network Architectures on Time Series Condition Data for Remaining Useful Life Prognosis Under Defined Operating Conditions
  • Citing Conference Paper
  • January 2022

... By using ML to model the relationship of the system health and RUL, no thorough understanding of the degradation process is required. In recent years, various ML methods, like random forest or different neural networks, have been proposed to model RUL predictions [2], [4]. ...

Performance Evaluation of Neural Network Architectures on Time Series Condition Data for Remaining Useful Life Prognosis Under Defined Operating Conditions
  • Citing Conference Paper
  • January 2022

... Algorithms play a crucial role in PdM implementation, particularly in its three core phases: data processing, fault diagnostics, and prognostics [7]. Three predominant methodological approaches in PdM research have been identified [8]: ...

A Comparative Study on Methods for Fusing Data-Driven and Physics-Based Models for Hybrid Remaining Useful Life Prediction of Air Filters

IEEE Access

... Existing review articles on fleet-based methods (Table 1) mostly focus only on one specific method, without providing a cross-method overview. The only exception is [10], which made a first attempt to collect different fleet-based methods -transfer learning and fleet learning. However, because fleet learning is not yet a well-defined research term, using explicit search keywords such as "fleet" only provided a small number of publications. ...

Using Data From Similar Systems for Data-Driven Condition Diagnosis and Prognosis of Engineering Systems: A Review and an Outline of Future Research Challenges

IEEE Access

... Nevertheless, modelling systems that experience trend-based degradation is considered one of the major challenges inherent to health modelling in manufacturing environments (Toothman et al. 2023). According to Hagmeyer et al. (2022), there exist three primary approaches for implementing diagnostic and prognostic applications including data-driven approaches, physical model-based approaches, and hybrid approaches. However, Kim et al. (2017) advise to focus on the development of novel hybrid approaches to compensate for the limitations of pure data-driven and model-based approaches. ...

On the Integration of Fundamental Knowledge about Degradation Processes into Data-Driven Diagnostics and Prognostics Using Theory-Guided Data Science

PHM Society European Conference

... PdM tasks include failure prediction, failure detection, failure type classification, and prediction of the machine's RUL. Further, PdM relies on the real-time monitoring of the machine condition to make tool RUL predictions [ 4 ]. ...

Creation of Publicly Available Data Sets for Prognostics and Diagnostics Addressing Data Scenarios Relevant to Industrial Applications
  • Citing Article
  • November 2021

International Journal of Prognostics and Health Management

... Afterwards, using well-known standard parameter estimators such as the Maximum Likelihood Method (MLE) [13], the parameters of the bootstrap sample are estimated so that the cdf obtained by bootstrapping Φ � ( ), named as realization, can be identified. Figure 3. Non-parametric (left) and parametric (right) bootstrapping [28]. ...

Bootstrap-Monte-Carlo-Simulation von Zuverlässigkeit und Aussagewahrscheinlichkeit bei periodischer Instandhaltung
  • Citing Chapter
  • January 2017

... The motivation behind the hybrid and the data-driven variant is that no model by itself performs best throughout the entire state space. Otherwise, the effort of having multiple models would be unnecessary [46]. Since the models within the ensemble provide estimates independently of each other, regions of competence is to be designated as a parallel method. ...

Enhancing Remaining Useful Lifetime Prediction by an Advanced Ensemble Method Adapted to the Specific Characteristics of Prognostics and Health Management
  • Citing Conference Paper
  • January 2019