Conference PaperPDF Available

Case study on automated and continuous reliability assessment of software-defined manufacturing based on digital twins

Authors:
Case Study on Automated and Continuous Reliability Assessment of
Software-Defined Manufacturing Based on Digital Twins
Philipp Grimmeisen
University of Stuttgart
philipp.grimmeisen@ias.uni-stuttgart.de
Andreas Wortmann
University of Stuttgart
wortmann@isw.uni-stuttgart.de
Andrey Morozov
University of Stuttgart
andrey.morozov@ias.uni-stuttgart.de
Abstract—Traditional production systems are characterized
by rare software updates and fixed production lines. Each
production unit is designed and programmed for a specific
task. Therefore, the reliability assessment is conducted once
before the operation, mostly manually, and is based on tra-
ditional reliability models, such as event trees, fault trees,
or reliability block diagrams. In comparison to traditional
production systems, the focus of modern, complex produc-
tion systems is shifted towards the software part. This is
emphasized by the concepts of digital twins and Software-
Defined Manufacturing (SDM). These software-intensive and
safety-critical systems have more frequent software updates
to address higher system flexibility and adjustable production
processes. Therefore, SDM systems require a new approach to
reliability assessment. Each software update can change the
system behavior significantly. This leads to the necessity to
reconduct the reliability assessment automatically before each
software update. Advanced and hybrid reliability models are
the key enabling technology. These models must be automat-
ically generated and synchronized with the available system
models and digital twins. Model-to-Model (M2M) transforma-
tion methods are another enabling technology.
In this paper, we present a case study on automated and
continuous reliability assessment of SDM. It shows, that our
new method is a suitable candidate to enable the reliability
assessment of SDM based on digital twins. The method includes
(i) the extension of SysML v2 for reliability assessment, (ii)
the automatic generation of hybrid reliability models from
the digital twin, and (iii) their reliability assessment with new
solvers developed for our OpenPRA framework.
Keywords: Case Study, Reliability Assessment, Software-
Defined Manufacturing, Digital Twin, SysML v2, Model-to-
Model (M2M) transformation
1. Introduction
Software-Defined Manufacturing (SDM) [1] is a concept
derived from information and communication technology
Software-Defined Anything (SDx). SDx follows the ap-
proach that solely the software is decisive for the config-
uration of system functionality [1]. The concept of SDM
enables a separation of the manufacturing ecosystem into
physical manufacturing layers and software definition lay-
ers, which enables full scalability of production and its
equipment through definition via software. Based on the
description of the product to be manufactured, the whole
production software, including machine control software,
embedded software, cloud services, and part programs, can
be automatically generated, instantiated, and configured.
Key aspects for SDM are Model-Based Systems Engineering
(MBSE) in production environments and digital twins of
the cyber-physical systems, available at all times during the
engineering process and operation [1, 2].
SDM requires a new approach to reliability analysis.
Traditional production systems are characterized by fixed
production lines and infrequent software updates. Figure 1
a) shows such a traditional production system. Each pro-
duction system is designed and programmed for a certain
task. Therefore, the reliability assessment is performed once
before the operation, mostly manually, and is based on
classical reliability models, such as event trees [3], fault
trees [4], or reliability block diagrams [5]. In comparison
to traditional production systems, the focus of modern,
complex production systems is increasingly shifted towards
the software part. SDM and digital twins [6] are part of
this trend. SDM systems assume more frequent software
updates. Depending on the domain, we can expect a few
updates per day. Each update can change the system be-
havior significantly. Such an SDM system is illustrated in
Figure 1 b). The reliability assessment of SDM systems
must be performed before each software update. Therefore,
it is required to conduct the reliability assessment in an
automated and continuous approach. Advanced hybrid and
highly flexible reliability models are the key enabling tech-
nology. These models must be automatically generated and
synchronized with the available system models and digital
twins. Therefore, Model-to-Model (M2M) transformation
methods are another enabling technology.
This paper presents a case study on automated and
continuous reliability assessment of SDM systems based
on digital twins. The case study on a robotic manipula-
tor demonstrates the applicability of the new method for
automated and continuous reliability assessment of SDM
based on digital twins. In particular, the method includes (i)
a language profile of SysML v2 for reliability analysis, (ii)
automated M2M transformations from the extended SysML
v2 system models to hybrid reliability models, and (iii) prob-
abilistic reliability analysis with the OpenPRA framework,
extended with new solvers.
Figure 1. Comparison of a traditional production system (a), with fixed
production elements and a software-defined manufacturing system (b) with
flexible and re-configurable elements and a digital twin.
2. State of the art
This section introduces the terms digital twin, model-
based systems engineering, and reliability assessment. It
discusses related work that is relevant to the topics examined
in this paper.
2.1. Digital Twins
A digital twin is a software system consisting of models,
data, and services to interact with a cyber-physical system
for a particular purpose [7, 6, 8]. They serve to monitor, bet-
ter understand and optimize the behavior of their respective
counterparts. Modifications to the counterpart are automat-
ically reflected in the digital twin and modifications to the
digital twin are automatically reflected in the counterpart.
Therefore, digital twins must provide both a representation
of their counterpart and a connection to it that enables to
communicate changes between both systems [9]. Digital
twins enable a wide range of value adding services, such
as predictive maintenance, real-time monitoring, detailed
design-space exploration, process optimization, reliability
assessment, and anomaly detection [10, 11, 12].
2.2. Model-Based Systems Engineering
MBSE is the formalized system modeling to support
requirements, analysis, design, validation, and verification
phases of the system development life cycle [13]. In this
paper, we selected SysML version 2 (SysML v2) as the mod-
eling language. We follow a simplified modeling method
based on structural and behavioral diagrams.
SysML v1.X [14, 15] is a standardized modeling lan-
guage. It provides system engineers with the capability to
design and visualize models for various aspects of hard-
ware and software systems and their components. SysML
v2 improves the expressiveness, precision, interoperability,
integration, and consistency of the language as compared to
SysML v1.X. SysML v1.X was a profile of Unified Mod-
eling Language (UML). SysML v2 is an extension of the
kernel metamodel defined by the Kernel Modeling Language
[KerML]. SysML v2 provides both graphical and complete
textual notation [14]. Huckaby and Christensen [16] have
shown, that SysML is a feasible option for modeling robotic
systems. Makarov et al. [17] propose to use SysML as a
modeling language to describe the digital twin. A possibility
to model digital twins of cyber-physical systems is presented
in Bibow et al. [8]. The applied reference architecture is
specified in MontiArc.
2.3. Reliability Assessment
A Fault Tree (FT) [4] is a directed acyclic graph that
models how failures can cause a system failure. In a FT, the
top event is the event of interest and represents the failure
of the system or subsystem. The leaves of a FT are called
basic events that model the failures of individual system
components. In addition to basic events, intermediate events
are represented as logical gates such as AND, OR, and K/N.
Logical gates show how failures in individual components
can propagate through the system to a system failure. An
example of a FT is shown in Figure 7. The Fault Tree
Analysis (FTA) is one of the most common techniques for
reliability evaluation. In this paper, we use a bottom-up [18]
technique to compute the probability of system failure.
A Markov chain [19, 20] is a mathematical abstraction
of a stochastic process, which consists of a set of states
and transitions between them. The transition probability
describes how likely it is to jump from one state to the
next one and depends only upon the current state. Fig-
ure 6 gives an example of a Markov chain. The transi-
tion matrix summarizes all the transition probabilities. The
most common types of Markov chains are Discrete-Time
Markov chains (DTMC) and Continuous-Time Markov
chains (CTMC). A DTMC describes a Markov process as
a directed graph weighted with probabilities. In reliabil-
ity analysis, stochastically-defined reliability-related events
such as activation of faults, propagation of errors, compo-
nent replacement, and repairs are considered in the system
operation process described by a Markov chain.
For reliability analysis, absorbing Markov chains are
the most interesting ones. A Markov chain is an absorbing
Markov chain if at least one absorbing state exists and if it
is possible to reach the absorbing state from every state. An
absorbing state is a state which is impossible to leave, the
other states are called transient states. In Figure 6 the done
and failure state are absorbing states. The reliability-related
questions are (a) ”What is the probability that the process
ends in an absorbing state?” and (b) ”How many steps will it
take on average?” The answers are given by the computation
of the probability of absorption and the time to absorption.
To quantify a Markov chain, a variety of numerical methods
exist.
Hybrid reliability models: In risk analysis, different re-
liability models assess the reliability of the system from
various points of view. This makes it important to combine
different reliability models to so-called hybrid reliability
models. The common way of combining fault trees, event
trees, and Bayesian networks is defined as Hybrid Casual
Logic [21]. The classical approach to integrate event trees
and fault trees is to link fault trees to the nodes of an event
tree. The quantitative analysis of such a hybrid reliability
model can be performed by top-down or bottom-up tech-
niques, for a static coherent system without common events.
A method based on binary decision diagrams is suitable
for non-coherent systems. In our previous work [22], we
presented the limited scope of our open-source software
platform OpenPRA, which supports combined event tree and
fault tree analysis. We have extended it with a DTMC solver
and combined Markov chain and fault tree analysis. The
standard approach to link a Markov chain and fault trees is
to define the transition probabilities to jump from one state
to another by the failure probabilities of fault trees.
Model-to-Model transformation: The continuous relia-
bility assessment of SDM systems requires M2M transfor-
mation methods, to create hybrid reliability models from
the digital twin formalism. Transformation methods to fault
trees from SysML models are presented in [23, 24], from
UML in [25], from AADL in [26, 27, 28], and from
Simulink in [29]. Several transformation approaches to
DTMC from SysML models are introduced in [30, 31, 32,
33], from AADL in [34, 35], and from Simulink [36, 37].
None of them support the transformation to hybrid reliability
models.
3. Approach
3.1. Overview
Our approach to the automated and continuous reliability
assessment of SDM systems is shown in Figure 2. The
information about the structure and behavior of the system
is provided by the formalism of a digital twin. We use this
information and M2M transformation methods to generate
hybrid reliability models - Markov chains with intercon-
nected fault trees. The Markov chains are created from the
behavioral diagrams and the fault trees from the structural
diagrams of the digital twin formalism. The hybrid relia-
bility models are stored in the OpenPRA model exchange
format and serve as input for our OpenPRA framework that
can numerically solve these models. Before each update of
the digital twin, the M2M transformation and the reliability
assessment are repeated. The reliability assessment results
are returned to the digital twin for the update/not-update
decisions.
Figure 2. Overview of the proposed approach to the automated and con-
tinuous reliability assessment of SDM based on digital twins.
3.2. Extended System Model
A Digital Twin models the system behavior, structure,
and environment. For reliability analysis, it is also important
to extend these models with reliability data. SysML v2
provides various concepts and methods to model systems,
their components, behavior, structure, and environment. We
assume that the DT of the SDM system is modeled with
SysML v2 formalism with additional risk metadata. In
SysML v2, packages and parts are used to model the struc-
ture of a system. A package is a container that organizes
other elements of the model. A part models a modular
structural unit, such as a system, or a component that
can interact with the system either indirectly or directly.
Each part can contain features such as attributes, actions,
or ports. Actions model the behavior of a system and can
be associated with several parts of the system structure.
The actions are connected to the sequencing of actions that
represent the software flow of the system. This is illustrated
in Figure 6. The sequencing of actions can be controlled
by control nodes such as decision node, fork node, join
node, and merge node. The RiskMetadata package, provided
by SysML v2, allows us to embed reliability data, such
as failure probabilities to parts or actions. We extended
the RiskMetadata package with the possibility to mark re-
dundant components. In this paper, we consider only the
classical redundancy. However, in a similar way, we can
model other reliability-related features such as k/n switches,
spares, dependencies for dynamic fault trees, etc.
3.3. M2M Transformation Method
Our M2M transformation algorithm parses a SysML v2
file and searches for keywords. Which allows us to read
the structure, dependencies, behavior, and reliability data for
further processing. A function creates the XML structure
according to the OpenPRA model exchange format and
writes the final XML file. Figure 3 shows the M2M transfor-
Figure 3. M2M transformation from SysML v2 structure models to fault
trees.
mation method for fault trees. Our algorithm automatically
generates an FT for each action, where only the used parts
appear as basic events. For example, the action move (a)
is transformed into the top event modeled by an OR gate.
Our algorithm transforms the parts associated with the move
action, such as the electric motor (b), into basic events. The
failure probabilities for each basic event (c) are provided by
the risk metadata package. In addition, the risk metadata
gives us information about the redundancy. The redundancy
of the power system is modeled by an AND gate (d).
Figure 4 illustrates the M2M transformation method for
Markov chains. The actions (move, pick, move with piece,
and release) are transformed into transient states and one or
several absorbing failure states are created. The fault trees
provide the transition probabilities. The transition probabil-
ity to jump from the move state to the failure state is given
by the Move failure FT from Figure 3. The transition prob-
ability to jump from move to pick is 1P(Move failure).
The generated hybrid reliability models in the OpenPRA
model exchange format contain a Markov chain with inter-
connected fault trees.
Figure 4. M2M transformation from SysML v2 action sequences to Markov
chains.
3.4. Reliability Analysis
We use and extend our OpenPRA framework [22] for the
reliability analysis. OpenPRA is an open-source framework,
which aims to integrate multiple Probabilistic Risk As-
sessment (PRA) methods into a universal, easy-to-use, and
highly customizable environment. OpenPRA includes a FTA
module, a new DTMC module, and a new integrated analysis
module. The FTA module consists of a public API, a solver,
and an XML reader. The FT solver is based on a bottom-up
algorithm that computes the probability of failure of the top
event. In the scope of this work, we extended OpenPRA
with a DTMC module and an integrated analysis module
for hybrid reliability models. The DTMC module consists
of similar modules as the FTA module. The DTMC solver
can compute the probability of absorption and the time to
absorption. The integrated analysis module was developed
to analyze hybrid reliability models, such as Markov chains
linked with fault trees.
The integrated analysis module implements the follow-
ing steps: (i) Reads the given XML files and stores the
reliability models internally as graphs. (ii) Start solving
the fault trees by calling the FTA solver, since they are at
the bottom level and linked to the DTMC. (iii) Add the
computed results to the transitions of the Markov chain.
(iv) Call the DTMC solver to solve the final DTMC. (v)
Output the final results of each fault tree, the probability of
absorption, and the time to absorption of the DTMC.
4. Case Study
4.1. System Overview
For our case study we have selected a robotic manipu-
lator. The robotic manipulator consists of a control system,
a camera, seven non-redundant electric motors, seven non-
redundant torque sensors, two redundant power systems, and
a two-finger gripper. The initial software to control the robot
with the two-finger gripper, Figure 5 a), consists of the
following steps: initially, the robotic manipulator moves to a
certain position and subsequently tries to detect a workpiece
to pick. If the piece is detected, the robotic manipulator picks
the piece, moves to the conveyor belt, and releases the piece
there. Afterward, the robotic manipulator starts the process
again. In case there is no detected workpiece, the task of
the robotic manipulator is finished.
It is possible to install new tools on the robotic manipula-
tor. For example a soldering iron. This leads to the necessity
to update the control software. The updated control software,
Figure 5 b), consists of the following steps: initially, the
robotic manipulator tries to detect a solder spot on a board.
If there is a detected spot, the robotic manipulator moves
to this position. After moving to the detected position, the
position is checked one more time. If the position is correct,
the robotic manipulator starts the soldering. If not, the adjust
action is performed. After the soldering is completed, the
robotic manipulator tries to detect another solder spot. If no
spot is detected, the task is complete.
It is possible to update the software by adding new
functions or skills, e.g. adding a function to rotate the
workpiece into the pick and release software flow (Figure 5
a)).
4.2. System Models
The system is modeled in SysML v2 with a high-level
package and parts. Figure 8 illustrates the system architec-
ture model of the system. The components of the robotic
manipulator (a) are modeled as parts and extended with
risk metadata. The risk metadata adds the failure probability
and if necessary redundancy to the component, e.g. part
power system with failure probability and redundancy (d).
The failure probability is obtained from the FIDES 2009
[38] and NPRD-95 [39]. The actions are connected to the
corresponding parts. For example, the action detect is added
to the parts camera,power system, and control system (c).
In SysML v2 it is possible to add risk metadata to actions.
We use this for instance to override the failure probability of
the electric motor during the move with piece action with
a higher failure probability (b), due to the additional weight.
The behavior of the robotic manipulator, which shows
the software flow, is modeled as a sequence of actions.
Figure 5 a) and b) depict the software flows modeled in
SysML v2.
4.3. Hybrid Reliability Models
The software flow, 5 a), is automatically transformed
into a Markov chains with interconnected fault trees. Figure
6 illustrates the Markov chain of the pick and release action.
The Markov chain contains the transient states move,detect,
pick,move with a piece, and release as well as the absorbing
Figure 5. The software flow of the pick and release action (a) and the solder
action (b).
states done and failure. After each transient state, it is possi-
ble to jump to the failure state. These transition probabilities
are given by the corresponding fault trees. Similarly, we
automatically transform every updated software flow into a
Markov chain with interconnected fault trees. The Markov
chain of the soldering iron control software contains the
transient states detect,move,check position,adjust, and
solder as well as one absorbing failure state for each action
and the absorbing state done.
From the system architecture, as shown in Figure 8, our
M2M transformation method creates automatically for each
action a fault tree containing all the used components. The
probabilities of basic events define the failure probabilities
of associated components during one minute of operation.
The data is obtained from the FIDES 2009 [38] and NPRD-
95 [39]. Figure 7 illustrates the fault tree of the detect action.
Figure 6. Markov chain of the pick and release action. With two absorbing
states failure and done. From each transient , it is possible to jump directly
to the failure state.
Figure 7. Fault tree of the detect failure. The top event detect failure occurs
either because of the failure of the camera, control system or power system.
The detect failure is modeled as the top event. The top event
occurs either because of the failure of the camera,control
system, or power system. The power system fails if both
power systems fail. The other fault trees are not shown in
the scope of this paper.
5. Results
We analyze the reliability of the hybrid reliability mod-
els, discussed in subsection 4.3, with the OpenPRA frame-
work. The obtained results are presented in this section.
TABLE 1. PROBABILITY OF ABSORPTION OF THE MARKOV CHAINS.
THE PROBABILITY OF ABSORPTION IS GIVEN FOR ONE ABSORBING
FAIL UR E STATE.
Markov chain Probability of absorption
Pick and release 1.690e-05
Soldering 7.802e-06
TABLE 2. PROBABILITY OF ABSORPTION OF THE MARKOV C HAI N OF
TH E PIC K AND R ELE ASE A CTI ON,W ITH A FA ILU RE S TAT E FOR E ACH
ACT ION .
Failure state Probability of absorption
move failure 6.648-06
detect failure 1.246e-08
pick failure 6.722e-07
move with piece failure 8.237e-06
release failure 1.332e-06
First, we consider the hybrid reliability model of the pick
and release action. Second, we focus on the soldering action.
Table 1 presents the results of the Markov chains with
one failure state. The starting state in the pick and release
Markov chain is the move state and in the soldering Markov
chain the detect state. The first row of Table 1 shows that the
probability of absorption in the failure state of the pick and
release action is 1.690e-05. The probability of absorption in
the failure state of the soldering action, shown in the second
row of Table 1, is 7.802e-06. Table 2 shows the probabilities
of absorption of the Markov chain of the pick and release
action. Starting in the move state and with several absorbing
failure states. The probability to get absorbed in the move
failure or release failure state is most likely. In comparison
Table 3 shows the results of the Markov chain of the solder
action, starting in the detect state, with several absorbing
failure states. The adjust failure and move failure states are
the most likely absorbing states. For completeness, Table 4
presents the top event failure probabilities of all given fault
trees.
TABLE 3. PROBABILITY OF ABSORPTION OF THE MARKOV C HAI N OF
TH E SOL DER AC TI ON,W ITH A FA ILU RE STATE F OR EAC H ACT ION .
Failure state Probability of absorption
detect failure 1.246e-08
move failure 5.983-06
check position failure 1.121e-08
adjust failure 1.132e-06
solder failure 6.629e-07
The results show, that our method is suitable for the
automated and continuous reliability assessment of SDM
systems based on digital twins. The structure and behavior of
the system are modeled in a SysML v2 formalism extended
for reliability analysis. We can compute the reliability of the
system depending on the software. The results of the fault
trees are checked and compared against XFTA [40].
TABLE 4. FAILU RE PRO BAB ILI TIE S OF T HE FAULT TR EES .
Fault tree Failure probability top event
Move 6.647e-07
Detect 1.246e-09
Pick 7.468e-08
Move with piece 9.152e-07
Release 1.480e-07
Check position 1.246e-09
Adjust 2.516e-07
Solder 7.366e-08
6. Conclusion
In this paper, we use a case study on a robotic manipu-
lator to show, that our method for automated and continu-
ous reliability assessment of SDM systems with frequently
changing software is suitable. The robotic manipulator can
perform different tasks depending on the uploaded software.
The digital twin of the robotic manipulator is modeled
in SysML v2. Our method consists of (i) an extension
of SysML v2 for reliability analysis, (ii) automated M2M
transformations from the extended SysML v2 system models
to hybrid reliability models, and (iii) probabilistic reliability
analysis with our developed OpenPRA framework extended
with new solvers. The case study demonstrates, that the
automatically generated hybrid reliability models can adapt
to changes in system structure and behavior. This enables
the possibility to compute the reliability of the system before
each software update, based on the models of the digital
twin. The main goal of the paper is to demonstrate how the
automated and continuous reliability assessment can enable
the utilization of safety-critical SDM systems.
The extension to other hybrid reliability models that
include stochastic Petri net, dual graph error propagation
model, CTMCs, or dynamic fault trees is possible. This will
require the further extension of the SysML v2 formalism, the
development of new solvers for our OpenPRA framework,
and new M2M transformations. This will help us to analyze
the reliability of the system more precisely and will be
the subject of our future work. It is possible to extend the
OpenPRA framework to other reliability metrics, such as
MTTF, Weibull distribution, or exponential distribution.
The M2M transformation algorithms are limited in their
functionality. The transformation from behavioral diagrams
to Markov chains does only support decision nodes, no join
nodes, no fork nodes, and no merge nodes. The transfor-
mation algorithm to fault trees does not support special
features, such as ports or attributes.
Acknowledgements
This work has been partly funded by the German Federal
Ministry of Economic Affairs and Climate Action (Bun-
desministerium f¨
ur Wirtschaft und Klimaschutz, BMWK)
under the project ”Software-defined Manufacturing f¨
ur die
Fahrzeug- und Zulieferindustrie” (SDM4FZI, funding code
13IK001ZE).
References
[1] Armin Lechler, Oliver Riedel, and Daniel Coupek.
“VIRTUAL REPRESENTATION OF PHYSICAL
OBJECTS FOR SOFTWARE DEFINED MANU-
FACTURING”. In: International Conference on Pro-
duction Research (2017).
[2] Lei Xu et al. “Reshaping the Landscape of the Future:
Software-Defined Manufacturing”. In: Computer 54.7
(2021), pp. 27–36.
[3] PL Clemens. “Event tree analysis”. In: JE Jacobs
Sverdrup, (2002).
[4] Enno Ruijters and Mari¨
elle Stoelinga. “Fault tree
analysis: A survey of the state-of-the-art in modeling,
analysis and tools”. In: Computer science review 15
(2015), pp. 29–62.
[5] Marko ˇ
Cepin. “Reliability block diagram”. In: As-
sessment of Power System Reliability. Springer, 2011,
pp. 119–123.
[6] Werner Kritzinger et al. “Digital Twin in manu-
facturing: A categorical literature review and clas-
sification”. In: IFAC-PapersOnLine 51.11 (2018),
pp. 1016–1022.
[7] J¨
org Christian Kirchhof et al. “Model-driven digi-
tal twin construction: synthesizing the integration of
cyber-physical systems with their information sys-
tems”. In: Proceedings of the 23rd ACM/IEEE Inter-
national Conference on Model Driven Engineering
Languages and Systems. 2020, pp. 90–101.
[8] Pascal Bibow et al. “Model-driven development of a
digital twin for injection molding”. In: International
Conference on Advanced Information Systems Engi-
neering. Springer. 2020, pp. 85–100.
[9] Romina Eramo et al. “Conceptualizing digital twins”.
In: IEEE Software 39.2 (2021), pp. 39–46.
[10] Qinghua Xu, Shaukat Ali, and Tao Yue. “Digital twin-
based anomaly detection in cyber-physical systems”.
In: 2021 14th IEEE Conference on Software Test-
ing, Verification and Validation (ICST). IEEE. 2021,
pp. 205–216.
[11] Fei Tao et al. “Digital twins and cyber–physical sys-
tems toward smart manufacturing and industry 4.0:
Correlation and comparison”. In: Engineering 5.4
(2019), pp. 653–661.
[12] Jerome Pfeiffer et al. “Modeling Capabilities of Dig-
ital Twin Platforms-Old Wine in New Bottles?” In:
(2022).
[13] SE INCOSE. Vision 2020 (INCOSE-TP-2004-004-
02). 2007.
[14] Object Management Group (OMG). OMG Systems
Modeling Language (SysML) Version 2.0. See also
URL https://github.com/Systems-Modeling/SysML-
v2-Release.. 2021.
[15] Matthew Hause et al. “The SysML modelling lan-
guage”. In: Fifteenth European Systems Engineering
Conference. Vol. 9. 2006, pp. 1–12.
[16] Jacob Huckaby and Henrik I Christensen. “A case
for SysML in robotics”. In: 2014 IEEE International
Conference on Automation Science and Engineering
(CASE). IEEE. 2014, pp. 333–338.
[17] Makarov et al. “The design concept of digital twin”.
In: 2019 Twelfth International Conference” Man-
agement of large-scale system development”(MLSD).
IEEE. 2019, pp. 1–4.
[18] William E Vesely et al. Fault tree handbook. Tech.
rep. Nuclear Regulatory Commission Washington
DC, 1981.
[19] Norman B Fuqua. “The applicability of markov
analysis methods to reliability, maintainability, and
safety”. In: Selected Topic in Assurance Related Tech-
nologies (START) 2.10 (2003), pp. 1–8.
[20] Charles Miller Grinstead and James Laurie Snell.
Introduction to probability. American Mathematical
Soc., 1997.
[21] Chengdong Wang. Hybrid causal logic methodology
for risk assessment. University of Maryland, College
Park, 2007.
[22] Philipp Grimmeisen et al. “Demonstration of a
Limited Scope Probabilistic Risk Assessment for
Autonomous Warehouse Robots With OpenPRA”.
In: ASME International Mechanical Engineering
Congress and Exposition. Vol. 85697. American So-
ciety of Mechanical Engineers. 2021, V013T14A030.
[23] Faida Mhenni, Nga Nguyen, and Jean-Yves Choley.
Automatic fault tree generation from SysML system
models”. In: 2014 IEEE/ASME International Confer-
ence on Advanced Intelligent Mechatronics. IEEE.
2014, pp. 715–720.
[24] Nataliya Yakymets, Hadi Jaber, and Agnes Lanusse.
“Model-based system engineering for fault tree gen-
eration and analysis”. In: International Conference
on Model-Driven Engineering and Software Devel-
opment. Vol. 2. SCITEPRESS. 2013, pp. 210–214.
[25] Zhao Zhao. “UML model to fault tree model trans-
formation for dependability analysis”. PhD thesis.
Carleton University, 2014.
[26] Anjali Joshi, Steve Vestal, and Pam Binns. Auto-
matic generation of static fault trees from AADL
models”. In: (2007).
[27] Hongyu Sun, Miriam Hauptman, and Robyn Lutz.
“Integrating product-line fault tree analysis into aadl
models”. In: 10th IEEE High Assurance Systems
Engineering Symposium (HASE’07). IEEE. 2007,
pp. 15–22.
[28] Peter Feiler and Julien Delange. “Automated fault tree
analysis from aadl models”. In: ACM SIGAda Ada
Letters 36.2 (2017), pp. 39–46.
[29] Yiannis Papadopoulos and Matthias Maruhn. “Model-
based synthesis of fault trees from matlab-simulink
models”. In: 2001 International Conference on De-
pendable Systems and Networks. IEEE. 2001, pp. 77–
82.
[30] Yosr Jarraya et al. “Automatic verification and perfor-
mance analysis of time-constrained sysml activity di-
agrams”. In: 14th Annual IEEE International Confer-
ence and Workshops on the Engineering of Computer-
Based Systems (ECBS’07). IEEE. 2007, pp. 515–522.
[31] Mourad Debbabi et al. Verification and validation in
systems engineering: assessing UML/SysML design
models. Springer Science & Business Media, 2010.
[32] Abdelhakim Baouya et al. “A probabilistic and timed
verification approach of SysML state machine dia-
gram”. In: 2015 12th International Symposium on
Programming and Systems (ISPS). IEEE. 2015, pp. 1–
9.
[33] Samir Ouchani, Otmane Ait Mohamed, and Mourad
Debbabi. “A formal verification framework for
SysML activity diagrams”. In: Expert Systems with
Applications 41.6 (2014), pp. 2713–2728.
[34] Tao Zhang et al. “An aadl model-based safety analysis
method for flight control software”. In: 2014 Interna-
tional Conference on Computational Intelligence and
Communication Networks. IEEE. 2014, pp. 1148–
1152.
[35] Yun-wei Dong, Geng Wang, and Hong-bing Zhao.
“A model-based testing for aadl model of embedded
software”. In: 2009 Ninth International Conference
on Quality Software. IEEE. 2009, pp. 185–190.
[36] Adrian Beer et al. “Model-based quantitative safety
analysis of Matlab Simulink/Stateflow models”. In:
Model-Based Development of Embedded Systems.
2013, pp. 60–69.
[37] Anjali Joshi and Mats PE Heimdahl. “Model-based
safety analysis of simulink models using SCADE
design verifier”. In: International conference on com-
puter safety, reliability, and security. Springer. 2005,
pp. 122–135.
[38] FIDES Group. FIDES guide 2009, Reliability
Methodology for Electronic Systems. 2010.
[39] William Denson et al. Nonelectronic parts reliability
data 1995. Tech. rep. RELIABILITY ANALYSIS
CENTER GRIFFISS AFB NY, 1994.
[40] Antoine Rauzy. Probabilistic Safety Analysis with
XFTA. 2020.
Appendix
Figure 8. Except of the system structure of the robotic manipulator modeled
in SysML v2.
... SysML v1 resilience profiles for reliability analysis were introduced in [14] and [15]. In our previous work [16], [17], [18] we used and extended the SysML v2 RiskMetadata package [19]. The RiskMetadata package allows the integration of reliability-related data, such as the failure probability of parts into SysML v2 models. ...
... To adequately describe and analyze flexible softwaredefined systems, M2M transformation methods that automatically generate risk models are indispensable. In our previous papers [18], [16], [17] we introduced a new method that includes a transformation method from SysML v2 to hybrid risk models. This enables the automated and continuous reliability assessment based on the SysML v2 [19] models of the digital twin. ...
Conference Paper
Full-text available
In modern and complex production systems, the focus is shifted toward the software part. Software-Defined Manufacturing (SDM) and Cyber-Physical Production Systems (CPPS) characterize this trend. SDM and CPPS enable the concept of adaptive, flexible, and self-configuring production systems. These software-intensive robotic systems are safety- critical because they usually are applied in the same environ- ments as human workers. Therefore they require a continuous risk assessment. The uploading of a new software to the system can change its behavior drastically and therefore, the risk assessment needs to be redone. Key enabling technologies are digital twins, advanced and hybrid risk models, and Model-to- Model (M2M) transformation methods. In this paper, we introduce a new approach to the automated and continuous risk assessment based on Robot Operating System (ROS) code of a software-defined robotic system. The approach pipelines four key elements: (i) a logger that logs the data of the digital twin, (ii) an adder algorithm that creates risk annotated code based on the given ROS code, the output of the logger, and the hardware description including risk data of robot parts, (iii) an M2M transformation algorithm that automatically generates hybrid risk models from risk-annotated code, and (iv) OpenPRA solvers for numerical evaluation of the generated hybrid risk models.
... The first versions of SysML, up to SysML v1.7, have been designed as a UML profile, i.e., an extension of UML. SysML v2, instead, is an extension of a generic Kernel Modeling Language (KerML) [14] conceived for precise and formal specification of modelling languages. KerML and SysML v2 are defined via a formal grammar implemented in Xtext 10 , thus leveraging automatically generated supporting tools (parser, linker, typechecker, compiler, editor). ...
Conference Paper
Full-text available
Probabilistic Risk Assessment (PRA) is an indispensable technology to evaluate the risk, dependability, and resilience characteristics of safety-critical systems. Therefore, PRA uses widely adopted methods, such as classical event trees, fault trees, Markov chains, Bayesian networks, and their numerous combinations. To analyze challenging failure scenarios of modern, intelligent, autonomous, and highly dynamic Cyber-Physical Systems (CPS), the integration of multiple PRA methods is needed. This paper presents a PRA approach based on classical Event Tree Analysis (ETA) and Fault Tree Analysis (FTA) and provides the technical description of a new open-source software platform called OpenPRA. Besides, this paper describes a representative case study from the autonomous system domain, focusing on autonomous warehouse robots.
Article
Full-text available
Digital Twins are an emerging concept which is gaining importance in several fields. It refers to a comprehensive software representation of an actual system, which includes structures, properties, conditions, behaviours, history and possible futures of that system through models and data to be continuously synchronized. Digital Twins can be built for different purposes, such as for the design, development, analysis, simulation, and operations of non-digital systems in order to understand, monitor, and/or optimize the actual system. To realize Digital Twins, data and models originated from diverse engineering disciplines have to be integrated, synchronized, and managed to leverage the benefits provided by software (digital) technologies. However, properly arranging the different models, data sources, and their relations to engineer Digital Twins is challenging. We, therefore, propose a conceptual modeling framework for Digital Twins that captures the combined usage of heterogeneous models and their respective evolving data for the twin’s entire life-cycle.
Conference Paper
Full-text available
Digital twins emerge in many disciplines to support engineering, monitoring, controlling, and optimizing cyber-physical systems, such as airplanes, cars, factories, medical devices, or ships. There is an increasing demand to create digital twins as representation of cyber-physical systems and their related models, data traces, aggregated data, and services. Despite a plethora of digital twin applications, there are very few systematic methods to facilitate the modeling of digital twins for a given cyber-physical system. Existing methods focus only on the construction of specific digital twin models and do not consider the integration of these models with the observed cyber-physical system. To mitigate this, we present a fully model-driven method to describe the software of the cyber-physical system, its digital twin information system, and their integration. The integration method relies on MontiArc models of the cyber-physical system's architecture and on UML/P class diagrams from which the digital twin information system is generated. We show the practical application and feasibility of our method on an IoT case study. Explicitly modeling the integration of digital twins and cyber-physical systems eliminates repetitive programming activities and can foster the systematic engineering of digital twins.
Chapter
Full-text available
Digital Twins (DTs) of Cyber-Physical Production Systems (CPPSs) enable the smart automation of production processes, collection of data, and can thus reduce manual efforts for supervising and controlling CPPSs. Realizing DTs is challenging and requires significant efforts for their conception and integration with the represented CPPS. To mitigate this, we present an approach to systematically engineering DTs for injection molding that supports domain-specific customizations and automation of essential development activities based on a model-driven reference architecture. In this approach, reactive CPPS behavior is defined in terms of a Domain-Specific Language (DSL) for specifying events that occur in the physical system. The reference architecture connects to the CPPS through a novel DSL for representing OPC-UA bindings. We have evaluated this approach with a DT of an injection molding machine that controls the machine to optimize the Design of Experiment (DoE) parameters between experiment cycles before the products are molded. Through this, our reference implementation of the DT facilitates the time-consuming setup of a DT and the subsequent injection molding activities. Overall, this facilitates to systematically engineer digital twins with reactive behavior that help to optimize machine use.
Article
Full-text available
State-of-the-art technologies such as the Internet of Things (IoT), cloud computing (CC), big data analytics (BDA), and artificial intelligence (AI) have greatly stimulated the development of smart manufacturing. An important prerequisite for smart manufacturing is cyber–physical integration, which is increasingly being embraced by manufacturers. As the preferred means of such integration, cyber–physical systems (CPS) and digital twins (DTs) have gained extensive attention from researchers and practitioners in industry. With feedback loops in which physical processes affect cyber parts and vice versa, CPS and DTs can endow manufacturing systems with greater efficiency, resilience, and intelligence. CPS and DTs share the same essential concepts of an intensive cyber–physical connection, real-time interaction, organization integration, and in-depth collaboration. However, CPS and DTs are not identical from many perspectives, including their origin, development, engineering practices, cyber–physical mapping, and core elements. In order to highlight the differences and correlation between them, this paper reviews and analyzes CPS and DTs from multiple perspectives.
Article
We describe the concept of software-defined manufacturing, which divides the manufacturing ecosystem into software definition and physical manufacturing layers. Software-defined manufacturing allows better resource sharing and collaboration, and it has the potential to transform the existing manufacturing sector.
Article
The Digital Twin (DT) is commonly known as a key enabler for the digital transformation, however, in literature is no common understanding concerning this term. It is used slightly different over the disparate disciplines. The aim of this paper is to provide a categorical literature review of the DT in manufacturing and to classify existing publication according to their level of integration of the DT. Therefore, it is distinct between Digital Model (DM), Digital Shadow (DS) and Digital Twin. The results are showing, that literature concerning the highest development stage, the DT, is scarce, whilst there is more literature about DM and DS.
Article
Cyber-physical systems, used in domains such as avionics or medical devices, perform critical functions where a fault might have catastrophic consequences (mission failure, severe injuries, etc.). Their development is guided by rigorous practice standards that prescribe safety analysis methods in order to verify that failure have been correctly evaluated and/or mitigated. This laborintensive practice typically focuses system safety analysis on system engineering activities. As reliance on software for system operation grows, embedded software systems have become a major source of hazard contributors. Studies show that late discovery of errors in embedded software system have resulted in costly rework, making up as much as 50% of the total software system cost. Automation of the safety analysis process is key to extending safety analysis to the software system and to accommodate system evolution. In this paper we discuss three elements that are key to safety analysis automation in the context of fault tree analysis (FTA). First, generation of fault trees from annotated architecture models consistently reflects architecture changes in safety analysis results. Second, use of a taxonomy of failure effects ensures coverage of potential hazard contributors is achieved. Third, common cause failures are identified based on architecture information and reflected appropriately in probabilistic fault tree analysis. The approach utilizes the SAE Architecture Analysis & Design Language (AADL) standard and the recently published revised Error Model Annex V2 (EMV2) standard to represent annotated architecture models of systems and embedded software systems. The approach takes into account error sources specified with an EMV2 error propagation type taxonomy and occurrence probabilities as well as direct and indirect propagation paths between system components identified in the architecture model to generate a fault graph and apply transformations into a fault tree representation to support common mode analysis, cut set determination and probabilistic analysis.