Conference Paper

A discrete event XML based system of systems hardware-in-the-loop simulation for robust threat detection

Authors:
To read the full-text of this research, you can request a copy directly from the authors.

Abstract

In a system of systems (SoS) consisting of heterogeneous independently operable systems, successfully sending, receiving, and understanding data is necessary to achieve interoperation among the systems. Extensible Markup Language (XML) is applied to wrap the data in a way that is commonly understood in the SoS while the asynchronous nature of the interactions among systems is viewed as an event driven system. Discrete event specification (DEVS) formalism is used to describe the models composing the SoS. Simulation provides a means to examine and analyze systems and their interactions as well as how a new system effects the SoS but can hide issues that arise during final implementation. Hardware-in-the-loop (HIL) simulation provides a bridge between simulation and implementation in order to reduce build cost and more readily verify a system's desired performance. A Groundscout robot is used as a real system in the simulation of a robust threat detection scenario.

No full-text available

Request Full-text Paper PDF

To read the full-text of this research,
you can request a copy directly from the authors.

... </subsystem> </system> </systemofsystem>Figure 1. Original XML based System of Systems architecture as name and description, and standard tree structure allow individual systems to correctly interpret data. There have been multi-agent applications that have used the XMLbased SoS framework directly or with slight modifications as seen in [9], [10], [11], [12], [13], [14]. In [9], [10], [14], the framework is used without modification, in [11], [12], they modify the XML tags due to hardware constraints, and in [13] the framework is modified to make use of XML attributes. ...
... There have been multi-agent applications that have used the XMLbased SoS framework directly or with slight modifications as seen in [9], [10], [11], [12], [13], [14]. In [9], [10], [14], the framework is used without modification, in [11], [12], they modify the XML tags due to hardware constraints, and in [13] the framework is modified to make use of XML attributes. The work proposed in this paper also utilizes a modified version of the XML based SoS architecture, where the structure and tags chosen better fit the desired communication requirements. ...
Conference Paper
Full-text available
System of Systems (SoS) architectures have been used to conceptually define complex systems. However, very few SoS architectures have been physically realized to solve real-world problems. Proposed in this work is the full realization of a net-centric SoS architecture used to implement and integrate a complex system used to automate human detection from an image source. A SoS architecture was selected to implement the human detection system due to a SoS's ability to achieve high levels of interoperability. This high level of interoperability is feasible via standardization of communication and by structuring information to conform to a proposed XML framework. Additionally, each individual system within the SoS hierarchy is functionally decomposed based on sets defined services that each system requires and provides. Moreover, a new concept of a commonly implemented directory service is used to initialize system communication and automate SoS architecture discovery.
Conference Paper
This work builds upon our previous work, where a swarm robot called a Groundscout was tested for its emergent behavior(s) using a system of systems framework based on discrete-event simulation and XML-based hardware in the loop simulation (HIL). This paper presents performance optimizations, bug-fixes, and implementations of new features to further examine the benefits of using HIL simulations to develop and test swarm robots. In this work, the Groundscout's communications protocols were improved, a new obstacle-avoidance algorithm was added, and the environment and simulation engines have been either re-implemented or optimized for performance. Specifically for the obstacle-avoidance algorithm, the benefits of using HIL simulations, together with the principle of model continuity, are clearly demonstrated with testing experiments. Towards the eventual goal of creating simulations for testing emergent behaviors of much larger robot swarms, considerations that were learned are presented.
Conference Paper
Full-text available
Human detection and tracking is a primary focus for visual surveillance systems. However, current systems for human tracking are often complex and require vast amounts of computing resources. A reduction in complexity of the overall tracking system can be achieved by using a System of Systems (SoS) architecture. Once formed, a SoS architecture must achieve desirable levels of interoperability and integration. Proposed in this paper is a human tracking system that uses a net-centric SoS architecture capable of detecting a human via video surveillance and subsequently providing coordinates for mobile robot tracking. This SoS architecture establishes integration and conceptual interoperability through the standardization of communication and data representation. Within the SoS, communication is accomplished using a client-server architecture while data is structured according to a custom XML framework. The resulting SoS is composed of decentralized independent systems inter-operating on heterogeneous platforms to achieve the ultimate goal of human tracking.
Conference Paper
To address the challenge of automated performance benchmarking in virtualized cloud infrastructures, an extensible and adaptable framework called CloudBench has been developed to conduct scalable, controllable, and repeatable experiments in such environments. This paper presents the hardware-in-the-loop simulation technique used in CloudBench, which integrates an efficient discrete-event simulation with the cloud infrastructure under test in a closed feedback control loop. The technique supports the decomposition of complex resource usage patterns and provides a mechanism for statistically multiplexing application requests of varied characteristics to generate realistic and emergent behavior. It also exploits parallelism at multiple levels to improve simulation efficiency, while maintaining temporal and causal relationships with proper synchronization. Our experiments demonstrate that the proposed technique can synthesize complex resource usage behavior for effective cloud performance benchmarking.
Conference Paper
Full-text available
A system of systems (SoS) simulation framework using discrete event system specification (DEVS) and data encoded with Extensible Markup Language (XML) tags is presented to support agent-in-the-loop (AIL) simulations for large, complex, and distributed systems. AIL simulations provide a necessary step in maintaining model continuity methods to achieve a greater degree of accuracy in systems analysis. A system of systems approach enables the simulation and analysis of these independent and cooperative systems by concentrating on the data transferred among systems instead of determining global state spaces. A mobile robot is deployed as a real agent working cooperatively with virtual agents to form a robotic swarm in an example threat detection scenario. The swarm robot's performance is tracked and the emergent swarm behavior is also evaluated.
Conference Paper
Full-text available
The challenge of generating a federation driven by operational requirements "on the fly" has been formulated in various programs and proposals, but so far, no satisfying solution has been accomplished. The use of open source doesn't satisfy the industry, which has a vital interest to keep their core solutions in-house (protection of intellectual property). The use of interface-driven solutions based on black boxes leads to discrepancies and inconsistent federations. The use of open standards to connect components and escorting reference models -allowing a white box view on the components functionality and their interior and exterior interrelations without revealing the implementation details -will fulfill the industry requirement for privacy as well as the user requirement for the necessary transparency required for V&V and credibility of the federated solution. Using an improved version of the Levels of Conceptual Interoperability Model (LCIM), various open standards will be evaluated concerning their contribution to respective levels. Based on this finding, a possible implementation will be proposed showing how the various open standards can complement each other resulting in an M&S repository comprising heterogeneous solutions that can be federated into a composable mission space driven by the users requirements. Furthermore it will be argued, that aligning these standards within DoD is possible, and this will help to terminate the shortcomings of interface driven solutions and to integrate components delivering M&S functionality into real world systems, in particular for Command and Control.
Conference Paper
Full-text available
This paper presents a system of systems approach to threat detection through integration of heterogeneous independently operable systems. The approach is presented on a realistic situation where a human-controlled base robot, swarm robot(s), and sensors work together to obtain a decision about a possible threat in the environment. The base robot is remotely operated by a human using a haptic control system. The swarm robot(s) are autonomous and can accept directives from the base robot. Finally, sensors directly communicate with (report to) the base robot. In this scenario, heterogeneous systems and human interact in a system of systems architecture. With the inclusion of human expert and sensor verification of swarm robots, the system can successfully perform the threat detection and reduce the false alarms. Finally, a system of systems simulation framework including a base robot, a swarm robot, and two sensors is presented in addition to an experimental evaluation of the proposed SoS architecture.
Book
Discover the emerging science and engineering of System of Systems. Many challenges of the twenty-first century, such as fossil fuel energy resources, require a new approach. The emergence of System of Systems (SoS) and System of Systems Engineering (SoSE) presents engineers and professionals with the potential for solving many of the challenges facing our world today. This groundbreaking book brings together the viewpoints of key global players in the field to not only define these challenges, but to provide possible solutions. Each chapter has been contributed by an international expert, and topics covered include modeling, simulation, architecture, the emergence of SoS and SoSE, net-centricity, standards, management, and optimization, with various applications to defense, transportation, energy, the environment, healthcare, service industry, aerospace, robotics, infrastructure, and information technology. The book has been complemented with several case studies-Space Exploration, Future Energy Resources, Commercial Airlines Maintenance, Manufacturing Sector, Service Sector, Intelligent Transportation, Future Combat Missions, Global Earth Observation System of Systems project, and many more-to give readers an understanding of the real-world applications of this relatively new technology. System of Systems Engineering is an indispensable resource for aerospace and defense engineers and professionals in related fields.
Article
Systems engineering is at a crossroad now at the beginning of the 21st century. One of the main challenges of any paradigms in systems engineering is being able to handle complex systems under unforeseen uncertainties. A system may be called complex if its dimension (order) is too high and its model (if available) is nonlinear, interconnected, and information on the system is uncertain such that classical techniques cannot easily handle the problem. A system of systems (SoS) is a "super system," or an integration of complex systems coordinated together in such a way to achieve a wider goal with possible higher significance. Applications of SoS are quite extensive - examples are future combat mission, global warming, Mars missions, air traffic system, global Earth observation system, electric power grid system, energy systems, etc. Computational intelligence (CI) or soft computing, a consortium of fuzzy logic (approximate reasoning), neuro-computing (learning), genetic algorithms and genetic programming (optimization), has proven to be a powerful set of tools for adding autonomy and semi-autonomy to many complex systems. For such systems the size of autonomous controller architecture will be nearly infinite. In this presentation system of systems are being introduced, challenges are brought up and potential solutions and needs are discussed. Special emphasis on UTSAACE Center's SoS technology will be demonstrated. Some animated and experimental implementation as well as media movies and clips will be shown.
Article
This thesis evaluates the application of current Extensible Markup Language (XML) tools and technologies toward solving data interoperability issues between legacy data repositories. Past efforts to address these issues have largely failed. XML has the capability to address many of the past problems, but this can only be accomplished when the supporting COTS tools and technologies are available. The thesis first establishes the underlying issues that need to be addressed. It then evaluates the current state of technologies and COTS products and describes the advantages and disadvantages of each. Finally, it focuses in on the schema for a specific relational database, demonstrates a process by which data exchange can be implemented, and outlines the issues remaining to be solved.
Article
Simulation plays important roles in experimenting with, understanding, and evaluating the performance of cooperative robotic systems. Typically, simulation-based studied of robotic systems are conducted in the computer, without involving any real system components. This paper presents a new hybrid approach to simulation that allows real robots as well as robot models to work together in a simulation-based virtual environment. This capability of robot-in-the-loop simulation effectively bridges conventional simulation and real system execution, augmenting them to constitute an incremental study and measurement process. It is especially useful for large-scale cooperative robotic systems whose complexity and scalability severely limit experimentation in a physical environment using real robots. We present architecture for this simulation-based virtual environment that, together with an incremental study process and associated experimental frames, can support systematic analysis of cooperative robotic systems. An example of robotic convoy is provided. Some measurement metrics are developed and simulation results are described. An experimental setup for robot-in-the-loop simulation is discussed.
Conference Paper
This paper extends an XML based system of systems simulation framework using DEVS to support hardware-in-the-loop simulations for SoS. A system of systems approach enables the simulation and analysis of multiple complex, independent, and cooperative systems by concentrating on the data transferred among systems. This paper wraps information exchanged among heterogeneous systems in XML to enable receiving systems to correctly parse and interpret the information. A Groundscout robot is deployed as a real agent working cooperatively with virtual agents in a robotic swarm. The DEVS activity concept facilitates communication between the real system and virtual systems in the SoS. A robust threat detection example is provided. Initial performance metrics of the SoS are briefly discussed.
Conference Paper
Simulation-based study plays important roles in robotic systems development. This paper describes robot-in-the-loop simulation, which is a novel simulation method that we developed to allow real robots and robot models to work together for system-wide measurement and test. To support robot-in-the-loop simulation, a simulated virtual environment is developed. Several kinds of sensor/actuator interface models are defined to allow real robots to interact with the virtual environment. To demonstrate the capability of robot-in-the-loop simulation, three mobile robot examples were developed and are presented in the paper in an incremental way. These examples illustrate the usages and configurations of robot-in-the-loop simulation under different situations