Conference PaperPDF Available

VSSo: A Vehicle Signal and Attribute Ontology

Authors:

Abstract and Figures

Application developers in the automotive domain have to deal with thousands of different signals, represented in highly heterogeneous formats, and coming from various car architectures. This situation prevents the development and connectivity of modern applications. We hypothesize that a formal model of car signals, in which the definition of signals are uncorrelated with the physical implementations producing them, would improve interoperability. In this paper, we propose VSSo, a car signal ontology that derives from the automotive standard VSS, and that follows the SSN/SOSA pattern for representing observations and actuations. This ontology is comprehensive while being extensible for OEMs, so that they can use additional private signals in an interoperable way. We developed a simulator for interacting with data modeled under the VSSo ontology pattern available at http://automotive.eurecom.fr/simulator/query
Content may be subject to copyright.
Short Paper: VSSo - A Vehicle Signal and
Attribute Ontology
Benjamin Klotz1,2[0000000290082120] , Rapha¨el Troncy1 [0000000304571436],
Daniel Wilms2[0000000204510265] , and Christian Bonnet1[0000000237337227]
1EURECOM, Sophia Antipolis, France
firstname.lastname@eurecom.fr
2BMW Research, New Technologies, Innovation, Munich, Germany
Abstract. Application developers in the automotive domain have to
deal with thousands of different signals, represented in highly hetero-
geneous formats, and coming from various car architectures. This sit-
uation prevents the development and connectivity of modern applica-
tions. We hypothesize that a formal model of car signals, in which the
definition of signals are uncorrelated with the physical implementations
producing them, would improve interoperability. In this paper, we pro-
pose VSSo, a car signal ontology that derives from the automotive stan-
dard VSS, and that follows the SSN/SOSA pattern for representing
observations and actuations. This ontology is comprehensive while be-
ing extensible for OEMs, so that they can use additional private sig-
nals in an interoperable way. We developed a simulator for interact-
ing with data modeled under the VSSo ontology pattern available at
http://automotive.eurecom.fr/simulator/query
Keywords: ontology, automotive, signal, sensor, VSS
1 Introduction
Current and future automotive applications rely on the ability to manage highly
heterogeneous data. In this context, vehicle data needs to be interoperable in
order to be handled by remote applications and services regardless of the brand,
model, and internal network architecture of each connected vehicle. This is ac-
tually challenging today as a developer needs deep insights into the architecture
of a vehicle3in order to have access and to process data coming from a vehi-
cle signal. In addition, information about signal metadata is needed in order
to interpret the returned values. As soon as the internal architecture changes,
the developer has to update the implementation and will need the same prior
knowledge. This might be the case already with different models of the same
brand.
We propose to use semantic technologies for addressing the challenge of defin-
ing a formal model of car signals [2]. Many ontologies have been developed
3http://www.ieee802.org/1/files/public/docs2013/new-tsn-diarra-osi-
layers-in-automotive-networks-0313-v01.pdf
2 B. Klotz et al.
in order to solve problems in the automotive domain. In 2003, [9] proposed
an ontology-based data access for car. [10] describes the relationship between
components, failures and their symptoms. [3] proposes an automotive ontology
describing the user’s actions and car context. More generally, several research
projects proposed ontology-based representation of some car context to provide
advanced driver-assistance systems (ADAS) [12, 1,8, 11,7], but they are not com-
plete or extensible, nor they are automotive standards.
W3C and OGC have developed standards for defining systems with their
signals. The Semantic Sensor Network4(SSN) ontology [6] is an ontology for
describing sensors and their observations, as well as actuators and actuations.
SSN follows a horizontal and vertical modularization architecture by including a
lightweight but self-contained core ontology called SOSA5[4] (Sensor, Observa-
tion, Sample, and Actuator) for its elementary classes and properties, that was
released in October 2017. Both SSN and SOSA are domain independent.
We therefore observe a gap between the need for data interoperability and the
current state of the art in terms of car modeling. We see a need for an ontology
focusing on car signals and sensors. We also identify another requirement: such
an ontology should be compliant with automotive standard such as the Vehicle
Signal Specification (VSS)6or follow best modeling practices in order to be
used. We require such an ontology to be comprehensive enough to cover most
known signals while being extensible by OEMs. The remainder of this paper is
structured as follow. First, we list our requirements in Section 2. We describe how
we have converted the VSS automotive standard into an ontology in Section 3.
We evaluate it in Section 4. Finally we conclude and describe future work in
Section 5.
2 Requirements
A good car signal ontology should enable a web developer to query and extract
knowledge from a car signal database with no deep expertise in the automotive
domain. In this section, we define a set of competency questions7, which we will
later use as a mean of evaluating the produced ontology.
There is a need to define a number of static properties or attributes describing
either a complete vehicle or its parts. For instance:
How many attributes does a car have?
What is the model and release date of this car?
What are the dimensions of this car?
What type of transmission does this car have?
How many doors or seats does this car have?
4http://www.w3.org/ns/ssn/
5http://www.w3.org/ns/sosa/
6https://github.com/GENIVI/vehicle_signal_specification
7The full list of questions is available at https://github.com/klotzbenjamin/vss-
ontology
Short Paper: VSSo - A Vehicle Signal and Attribute Ontology 3
On which side is located the steering wheel in this car?
A car contains numerous sensors that produce signals. We need to be able
to retrieve metadata about those sensors and signals. For instance:
Is there a signal measuring the steering wheel angle?
Which signals are both observable and actuable?
How many different speedometers does this car contain?
What unit type does the signal vss:VehicleYaw use?
What are the maximum values allowed for all signals from a Vehicle?
Which signals measure a temperature and in which part are they located in
the car?
Car sensors will generate a lot of values that depend on time and space. One
should be able to query the current values of the signals as well as past historical
ones. This leads to additional competency questions:
What is the current gear?
Which windows are currently open?
What is the local temperature on the driver side now?
We hypothesize that the generic modeling patterns defined in the SSN/-
SOSA ontology [4] is adequate to describe observations and that an additional
vocabulary is needed to define the specific terms in the automotive domain.
3 Development of VSSo
We developed VSSo, a vehicle signal ontology based on the GENIVI and W3C
standard data model VSS (Vehicle Signal Specification). The ontology is avail-
able at https://github.com/klotzbenjamin/vss-ontology/.
3.1 VSS
The Vehicle Signal Specification defines a tree containing 451 Branches, 43 At-
tributes and 1060 Signals that aim to represent car data. The specification states
that:
Branches are car parts or components. They are represented as nodes in the
VSS tree. Branches can contain other branches or signals and attributes.
Attributes are the static information about a car. They are represented as
leaves in the VSS tree and defined by a path starting with “Attribute” de-
scribing its position in the VSS tree. For instance, the VIN is Attribute.Ve-
hicle.VehicleIdentification.VIN. They also have entries such as a de-
scription, a type, a unit or restrictions on values.
Signals are the dynamic information about a car that is either produced by a
sensor or consumed by an actuator. For instance, Signal.Drivetrain.Trans-
mission.Speed is the car speed, measured in the Transmission branch. Sig-
nals, like attributes, have entries providing a description, a type, and poten-
tially a unit and restrictions on values.
4 B. Klotz et al.
In its original form, VSS did not contain information about sensors or ac-
tuators. In order to describe the difference between signals measuring the same
phenomenon with different sensors, we added new entries in VSS signals. We
also clarified the concepts names and choices of units. Those corrections have
been approved by GENIVI and are now part of evolution of this standard.
3.2 General modeling pattern
The general idea behind the design of the VSS ontology is to reuse the pattern
of VSS. All branches are sub-branches of bigger branches. Therefore, we reuse it
in a component-based pattern using subclasses of vss:Branch linked with the
transitive object property vss:partOf. This means that a VSS Branch is used to
generate a new class, and the parent branch is attached to it with a vss:partOf
property (Listing 1.1).
Listing 1.1. vss:Drivetrain is an example of a generated class part of vss:Vehicle
v s s : D r i v e t r a i n a r d f s : C la s s , o wl : C l a s s ;
r d f s : s u bC l as s Of v s s : Br an ch ;
r d f s : s u bC l as s O f [ a owl : R e s t r i c t i o n ;
ow l : onProp e r t y v s s : p a r t O f ;
ow l : a l lV a l u e sF r o m v s s : V e h i c l e ] ;
r d f s : l a b e l ” D r i v e t r a i n ” @en ;
r d f s : c ommen t ” D r i v e t r a i n . A l l bo dy co m po ne nt s ”@en .
It also reuses the sets of entries defining VSS concepts. Indeed, attributes,
branches and signals are all defined by at least a name, a type and a description.
These entries allow the generation of one class per VSS concept, with a RDFS
label and comment. Attributes and signals also have additional entries, such as
a unit, or a set of potential values and a sensor or actuator. All these entries
define the specific details of an attribute or signal (Listing 1.2).
Listing 1.2. vss:AmbientAirTemperature is a signal measured by a vss:Thermometer
in qudt:DegreeCelcius
v s s : A mb ie nt Ai rT em p er at ur e a r d f s : C l a ss , o wl : C l a s s ;
r d f s : s u b Cl a s s O f v s s : O b s e r v a b l e S i g n a l ;
r d f s : l a b e l ” A mb ie nt Ai rT em pe ra tu re ” @en ;
r d f s : comme nt S i g n a l . V e h i c l e . A mb ie n tA i rT em p er at u re :
Am bie nt a i r t em p er a tu r e ”@en ;
r d f s : s u bC l as s O f [ a ow l : R e s t r i c t i o n ;
ow l : o n Pr o p er t y s o s a : i s Ob s e rv e d By ;
ow l : a l l Va l u e s Fr o m v s s : Th er mo me ter ] ;
r d f s : s u bC l as s O f [ a ow l : R e s t r i c t i o n ;
ow l : o nP r o p er t y q ud t : u n i t ;
ow l : allValues Fr om qud t : T emper ature Unit ] .
We generate a datatype property for each VSS attribute which are sub-
properties of a generic vss:attribute datatype property. All those attributes
being static, there is no need to model them using a dynamic pattern. VSS
Short Paper: VSSo - A Vehicle Signal and Attribute Ontology 5
attributes are attached to VSS branches which is materialized in the domain of
those properties, while their range makes use of a custom datatype (Listing 1.3).
Listing 1.3. vss:tankCapacity is an attribute of the vss:FuelSystem branch
vs s : t a n k C apacity a ow l : Dat a t y p e Prope rty ;
r d f s : s u bP ro p er t yO f v s s : a t t r i b u t e ;
r d f s : l a b e l ” T an kC ap ac it y” @en ;
r d f s : comme nt A t t r i b u t e . D r i v e t r a i n . F ue l Sy s te m . Ta n kC ap a ci ty :
Capa ci ty o f the f u el tank i n l i t e r s @en ;
r d f s : do ma in v s s : F u el Sy st e m ;
r d f s : r a ng e c d t : v ol um e .
Signals, however, are going to be observed over time and space and there is a
need for a dynamic modeling pattern. We take advantage of the SSN/SOSA pat-
tern for modeling sensors, actuators, observable and actuatable properties, ob-
servations and actuations. SOSA uses the triplets (Observation, ObservableProp-
erty, Sensor) to model this. Observations contextualize the data with properties
such as sosa:FeatureOfInterest (e.g. a car), the sosa:(Simple)Result as
well as sosa:phenomenonTime and geo:lat,geo:long for the spatiotemporal
context of the Observation. An equivalent pattern exist for actuations in SOSA.
SSN/SOSA does not define a unique unit ontology, but it is open to use
multiple ones. In order to remain open, we only set restrictions on unit systems
in the QUDT ontology8[5] and let the user choose the units freely.
3.3 Modeling problems and new VSS policies
Several exceptions and issues prevent the trivial generation of a healthy ontology
from VSS.
Concept disambiguation. VSS relies on a full path to define an attribute or a
signal. For instance Signal.Drivetrain.Engine.Speed, is clearly the rotation
speed of the engine while Signal.Cabin.Infotainment.Navigation.Current-
Location.Speed is the vehicle speed measured by the GPS. However they would
both generate a class vss:Speed if we would take the leaf of the tree as the base
concepts. Therefore, VSS concepts are renamed for clarification. In this example,
vss:EngineSpeed and vss:VehicleSpeed are actually created. Sometimes, two
different paths in the VSS tree actually refer to the same concept. For example,
the signal Signal.Drivetrain.Transmission.Speed also measures the speed
of the car according to the gearbox. The class vss:VehicleSpeed is here unique.
Its instances differ given the sensors that will produce the values and the branch
hosting the sensor (Fig. 1).
Signals are observable, actuatable or both. We define two main signal classes in
the VSS ontology: vss:ObservableSignal, as a subclass of sosa:Observable-
Property, and vss:ActuatableSignal subclass of sosa:ActuatableProperty.
8http://www.qudt.org
6 B. Klotz et al.
Fig. 1. Two signals representing the same concept: the vehicle speed
All signals in VSS are subclasses of at least one of them. Many signals are
subclasses of both. The choice of making a signal observable or actuatable is
based on the existence of the sensor and actuator entries of each VSS Signal.
We also define a sosa:Sensor for all sosa:ObservableProperty and a
sosa:Actuator for all sosa:ActuatableProperty. These sensors and actua-
tors are as technology-independent as possible, as their physical instances vary
from one OEM to another. Some signals relate to complex systems such as the
infotainment system where there are no physical sensors or actuators. In this
case, a virtual system defines the sensor/actuator producing and consuming the
data.
All branches are vss:partOf vss:Vehicle.The path defining attributes and
signals begins with the top element of the tree, being either “Attribute” or
“Signal”. The modeling choice would require the top branch to be the complete
vehicle that contains all branches. There is, nevertheless, a branch among the
top one called “Vehicle” containing attributes and signals about the full vehicle,
such as its VIN. We take this branch as the top one containing all other branches.
Position-related concepts are not branches. In VSS, the path to certain at-
tributes and signals contains the position of certain branches. This is especially
the case for elements that exist multiple times within one car, such as doors,
seats and mirrors. For instance, there are signals Door.Left.IsLocked and
Mirror.Right.Tilt. It is not desired to have classes defining “left” and “right”.
We decide to model the hosting branches with a property vss:position. This
defines instances of such branches with the correct positions and still refer to a
unique class. Using the same example, a door instance would have vss:position
vss:Left and the mirror instance a vss:position vss:Right.
Short Paper: VSSo - A Vehicle Signal and Attribute Ontology 7
4 Evaluation
In order to evaluate the coverage of the VSS ontology, we tried to write SPARQL
queries for all competency questions described in the Section 2. We also generate
synthetic traces data using the VSSo ontology. Here are simple examples of such
queries:
What are the attributes of the chassis?
SELECT ? a t t r i b u t e ? v a l u e
WHERE {
? a t t r i b u t e r d f s : s u bP ro p er t yO f vs s : a t t r i b u t e .
? b ra nc h ? a t t r i b u t e ? v a l ue ;
a v s s : C h as s i s .
}
What is the current gear?
SELECT ? s i g n a l ? r e s u l t ? t i me
WHERE {
? s i g n a l a v s s : Ge ar .
? o bs a s o s a : O b s e r v at i o n ;
s o sa : o b se r ve d P ro p er t y ? s i g n a l ;
s os a : h as S im p l eR e su l t ? r e s u l t ;
s o s a : phe nom eno nTi me ? t im e .
}
ORDER BY DESC( ? ti me )
LIMIT 1
VSSo fits our requirements of being based on an automotive standard and se-
mantically enriching car data. Furthermore, with more than 300 different signals
and 50 attributes, VSSo defines more concepts than all ontologies, vocabularies
and schemata from the state of the art, making it more complete. Finally, be-
cause VSSo is based on a specification meant to be extended, it is also easy to
extend. In order to do so, a developer can directly use VSSo and its patterns to
create new attributes, branches and signals. Another solution consists in writ-
ing the VSS extension in VSS format, and generate a new ontology. However,
this second solution requires a step of validation afterwards. We extended the
generator9with a simple health check script. For instance, an OEM can define
a private signal for a new embedded camera. In order to use it, a developer will
define this camera as part of the VSSo extension in a new namespace.
5 Conclusion and Future Work
In this paper, we identified a gap in formal definition of car signals and sen-
sors. We used some best practices both from the Semantic Web community and
the automotive standards to propose VSSo, an ontology developed on top of
9https://github.com/klotzbenjamin/vss-ontology/tree/master/rdf-
generation
8 B. Klotz et al.
the SSN/SOSA recommendation. This new formal representation of car signals
and attributes allows semantic queries. Various applications can benefit from
this ontology, such as car fleet monitoring, car trajectory mining, contextual
representation of a car and interaction between any car and web services.
References
1. A. Armand, D. Filliat, and J. Ibaez-Guzman. Ontology-based context awareness for
driving assistance systems. In IEEE Intelligent Vehicles Symposium Proceedings,
pages 227–233, 2014.
2. P. Barnaghi, W. Wang, C. Henson, and K. Taylor. Semantics for the Internet of
Things: early progress and back to the future. International Journal on Semantic
Web and Information Systems (IJSWIS), 8(1):1–21, 2012.
3. M. Feld and C. M¨uller. The Automotive Ontology: Managing Knowledge Inside
the Vehicle and Sharing it Between Cars. In 3r d International Conference on
Automotive User Interfaces and Interactive Vehicular Applications, pages 79–86,
Salzburg, Austria, 2011.
4. A. Haller, K. Janowicz, S. Cox, M. Lefranois, K. Taylor, D. L. Phuoc, J. Lieberman,
R. Garca-Castro, R. Atkinson, and C. Stadler. The Modular SSN Ontology: A
Joint W3C and OGC Standard Specifying the Semantics of Sensors, Observations,
Sampling, and Actuation. under review, 2018.
5. R. Hodgson, P. J. Keller, J. Hodges, and J. Spivak. QUDT-quantities, units, di-
mensions and data types ontologies. USA, Available from: http://qudt. org [March
2014], 2014.
6. K. Janowicz, S. Cox, K. Taylor, D. L. Phuoc, M. Lefran¸cois, and A. Haller. Se-
mantic Sensor Network Ontology. Recommendation, W3C, 2017.
7. S. Kannan, A. Thangavelu, and R. Kalivaradhan. An Intelligent Driver Assistance
System (I-DAS) for Vehicle Safety Modelling using Ontology Approach. Interna-
tional Journal Of UbiComp (IJU), 1(3), 2010.
8. M. Madkour and A. Maach. Ontology-based context modeling for vehicle context-
aware services. Journal of Theoretical and Applied Information Technology, 34(2),
2011.
9. A. Maier, H.-P. Schnurr, and Y. Sure. Ontology-Based Information Integration in
the Automotive Industry. In 2nd International Semantic Web Conference (ISWC),
pages 897–912, 2003.
10. A. Reymonet, J. Thomas, and N. Aussenac-gilles. Ontology Based Information
Retrieval: an application to automotive diagnosis. In 20th International Workshop
on Principles of Diagnosis (DX), pages 9–14, Stockholm, Sweden, 2009.
11. Z. Xiong, V. V. Dixit, and S. T. Waller. The development of an Ontology for
driving Context Modelling and reasoning. In IEEE 19th International Conference
on Intelligent Transportation Systems (ITSC), pages 13–18, 2016.
12. L. Zhao, R. Ichise, S. Mita, and Y. Sasaki. Core Ontologies for Safe Autonomous
Driving. In 14th International Semantic Web Conference, Posters and Demos
Track (ISWC), 2015.
... In the field of knowledge representation, ontologies formally define objects and relationships between objects which are part of a considered environment. For example, the Vehicle Signal Specification Ontology (VSSo) describes objects in the vehicular domain, such as wheels, engine, windows, speed, or cabin temperature [86]. ...
... What is more, specific ontologies have been defined for vehicular networks. For example, the Vehicle Signal Specification (VSS), as augmented in [86], defines a large set of vehicle-related information, such as the temperature of the engine of a vehicle. It features a data type, i.e., integer, a range of possible values, and a unit, i.e, −50 to 200 degrees Celsius, as well as a human readable description. ...
Thesis
Machine learning, Artificial Intelligence, Semantic Reasoning or other Knowledge creation mechanisms have recently been applied successfully to various connected automated automotive domains, such as hazard detection, automated driving or sensor fusion. Knowledge is highly promising but lacks cooperation to achieve its full potential. Instead of individually creating knowledge as done so far, what if knowledge could be shared, disseminated and used by other vehicles ? This doctoral work investigates means to characterize, create,and distribute knowledge in vehicular networks. Through selected use cases, this work aims at modeling and analyzing the benefits of knowledge in information gathering and dissemination, first to reduce the amount of information effectively required for knowledge, and second to enhance mechanisms involved in information-centric networks (ICN) or edge caching (EC) to fulfill the delay, reliability and availability required by next generation vehicular networks.
... Early approaches propose ontologies for the vehicle only [29], vehicle sensors [30], driver [31] or human-machine-interface [32]. Combined approaches for managing driving related information by a model representing the driver, the vehicle, and the context are described in [32,33]. ...
Article
Autonomous Driving (AD) datasets, when used in combination with deep learning techniques, have enabled significant progress on difficult AD tasks such as perception, trajectory prediction and motion planning. These datasets represent the content of driving scenes as captured by various sensors, including cameras, RADAR, and LiDAR, along with 2D/3D annotations of traffic participants. Such datasets, however, often fail to capture and to represent the spatial, temporal, and semantic relations between entities in a scene. This lack of knowledge leads to a shallow understanding of the true complexity and dynamics inherent in a driving scene. In this paper, we argue that a Knowledge Graph (KG) based representation of driving scenes, that provides a richer structure and semantics, will lead to further improvements in autonomous driving. Towards this goal, we developed a layered architecture and ontologies for specific autonomous driving datasets and a fundamental ontology of shared concepts. We also built KGs for three different AD datasets. We perform an analysis w.r.t. information contained in the AD KGs and outline how the additional semantic information contained in the KGs could improve the performance of different AD tasks. Moreover, example queries are provided to retrieve relevant information that can be exploited for augmenting the AD pipelines. All artefacts needed for reproducibility purposes are provided via a Github repository: https://github.com/boschresearch/dskg-constructor .
... Vehicle Model An ontology modeling the main concepts of vehicles, such as vehicle type, installed components and sensors, is described in [117]. The work in [62] focuses on representing sensors, their attributes, and generated signals to increase data interoperability. Driver Model Combined approaches for managing driving related information by a model representing the driver, the vehicle, and the context are described in [43,24]. ...
Chapter
Deep learning methods have made remarkable breakthroughs in machine learning in general and in automated driving (AD) in particular. However, there are still unsolved problems to guarantee reliability and safety of automated systems, especially to effectively incorporate all available information and knowledge in the driving task. Knowledge graphs (KG) have recently gained significant attention from both industry and academia for applications that benefit by exploiting structured, dynamic, and relational data. The complexity of graph-structured data with complex relationships and inter-dependencies between objects has posed significant challenges to existing machine learning algorithms. However, recent progress in knowledge graph embeddings and graph neural networks allows to applying machine learning to graph-structured data. Therefore, we motivate and discuss the benefit of KGs applied to AD. Then, we survey, analyze and categorize ontologies and KG-based approaches for AD. We discuss current research challenges and propose promising future research directions for KG-based solutions for AD.
... Early approaches propose ontologies for the vehicle only [29], vehicle sensors [30], driver [31] or human-machineinterface [32]. Combined approaches for managing driving related information by a model representing the driver, the vehicle, and the context are described in [32], [33]. ...
... Vehicle Model An ontology modeling the main concepts of vehicles, such as vehicle type, installed components and sensors, is described in [117]. The work in [62] focuses on representing sensors, their attributes, and generated signals to increase data interoperability. ...
Preprint
Full-text available
Automated driving is one of the most active research areas in computer science. Deep learning methods have made remarkable breakthroughs in machine learning in general and in automated driving (AD)in particular. However, there are still unsolved problems to guarantee reliability and safety of automated systems, especially to effectively incorporate all available information and knowledge in the driving task. Knowledge graphs (KG) have recently gained significant attention from both industry and academia for applications that benefit by exploiting structured, dynamic, and relational data. The complexity of graph-structured data with complex relationships and inter-dependencies between objects has posed significant challenges to existing machine learning algorithms. However, recent progress in knowledge graph embeddings and graph neural networks allows to applying machine learning to graph-structured data. Therefore, we motivate and discuss the potential benefit of KGs applied to the main tasks of AD including 1) ontologies 2) perception, 3) scene understanding, 4) motion planning, and 5) validation. Then, we survey, analyze and categorize ontologies and KG-based approaches for AD. We discuss current research challenges and propose promising future research directions for KG-based solutions for AD.
... Vehicle Model An ontology modeling the main concepts of vehicles, such as vehicle type, installed components and sensors, is described in [117]. The work in [62] focuses on representing sensors, their attributes, and generated signals to increase data interoperability. ...
Conference Paper
Full-text available
Automated driving is one of the most active research areas in computer science. Deep learning methods have made remarkable breakthroughs in machine learning in general and in automated driving (AD) in particular. However, there are still unsolved problems to guarantee reliability and safety of automated systems, especially to effectively incorporate all available information and knowledge in the driving task. Knowledge graphs (KG) have recently gained significant attention from both industry and academia for applications that benefit by exploiting struc-tured, dynamic, and relational data. The complexity of graph-structured data with complex relationships and inter-dependencies between objects has posed significant challenges to existing machine learning algorithms. However, recent progress in knowledge graph embeddings and graph neu-ral networks allows to applying machine learning to graph-structured data. Therefore, we motivate and discuss the potential benefit of KGs applied to the main tasks of AD including 1) ontologies 2) perception, 3) scene understanding, 4) motion planning, and 5) validation. Then, we survey, analyze and categorize ontologies and KG-based approaches for AD. We discuss current research challenges and propose promising future research directions for KG-based solutions for AD.
... Early approaches propose ontologies for the vehicle only [29], vehicle sensors [30], driver [31] or human-machineinterface [32]. Combined approaches for managing driving related information by a model representing the driver, the vehicle, and the context are described in [32], [33]. ...
Preprint
Full-text available
Automated Driving (AD) datasets, when used in combination with deep learning techniques, have enabled significant progress on difficult AD tasks such as perception, trajectory prediction and motion planning. These datasets represent the content of driving scenes as captured by various sensors, including cameras, RADAR, and LiDAR, along with 2D/3D annotations of traffic participants. Such datasets, however, often fail to capture and to represent the spatial, temporal, functional, and semantic relations between entities in a scene. This lack of knowledge leads to a shallow understanding of the true complexity and dynamics inherent in a driving scene. In this paper, we argue that a knowledge graph based representation of driving scenes, that provides a richer structure and semantics, will lead to further improvements in automated driving. Towards this goal, we developed a layered architecture and ontologies for specific automated driving datasets and a fundamental ontology of shared concepts. We also built knowledge graphs (KG) for three different AD datasets. We perform an analysis w.r.t. information contained in the AD KGs and outline how the additional semantic information contained in the KGs could improve the performance of different AD tasks. Moreover, example queries are provided to retrieve relevant information that can be exploited for augmenting the AD pipelines.
Chapter
In the vehicle sales area, a recommender system (RS) allows vehicle items to be displayed and selected replied on the parameters that are the most relevant to specific users-buyers. In other words, users-buyers can meet with vehicle items suited to their profile, preferences, or interests. Therefore, users will not spend much time searching and retrieving what corresponds to their needs and capacities, as well as against the ever-growing volume of information in the application. In this paper, we realize the analysis of the characteristics of users-buyers and vehicle items in vehicle recommendations. As a result, we propose our approach for building a RS based on ontologies in the vehicle sales area.
Chapter
Full-text available
Handling interoperability of data exchange among road traffic sensor devices, connected vehicles, infrastructure components and heterogeneous traffic management center applications has become an important and basic requirement nowadays. To meet this requirement, this paper proposes an ontology based framework to capture the knowledge domain about traffic automatic incident detection system (AIDS) based on Connected Vehicles (CVs) technology. This ontology addresses the semantic data interoperability needed between different heterogeneous entities constituent this AIDS. This contribution aims at modeling and capturing the semantic of the anomaly information used in the incident detection process and describing the AIDS components, their observations, measurements and communications messages features. First, to achieve this goal, NeOn methodology was adopted. Then, we defined the basic concepts and observations of a traffic sensor and CVs that has been extended to define concepts related to the data sensing and gathering layer of this framework based on ontology concepts. In addition, to ensure data interoperability and identify ontology’s restrictions, we used the OWL (Web Ontology Language) language. Furthermore, to build this ontology, we used the OWL under Protégé tool. Finally, OAIDS consisted of 93 concepts and 33 object properties. OntoMetrics was used to confirm the effectiveness of this proposed ontology to carry out the interoperability of CV’s sensor data in the urban road AIDS domain.
Conference Paper
Full-text available
Within a vehicle driving space, different entities such as vehicles and vulnerable road users are in constant interaction which governs their behaviour. Whilst smart sensors provide information about the state of the perceived objects, considering the spatio-temporal relationships between them with respect to the subject vehicle remains a challenge. This paper proposes to fill this gap by using contextual information to infer how perceived entities are expected to behave, and thus what are the consequences of these behaviours on the subject vehicle. For this purpose, an ontology is formulated about the vehicle, perceived entities and context (map information) to provide a conceptual description of all road entities with their interaction. It allows for inferences of knowledge about the situation of the subject vehicle with respect to the environment in which it is navigating. The framework is applied to the navigation of a vehicle as it approaches road intersections, to demonstrate its applicability. Results from the real-time implementation on a vehicle operating under controlled conditions are included. They show that the proposed ontology allows for a coherent understanding of the interactions between the perceived entities and contextual data. Further, it can be used to improve the situation awareness of an ADAS (Advanced Driving Assistance System), by determining which entities are the most relevant for the subject vehicle navigation.
Article
Full-text available
The Internet of Things IoT has recently received considerable interest from both academia and industry that are working on technologies to develop the future Internet. It is a joint and complex discipline that requires synergetic efforts from several communities such as telecommunication industry, device manufacturers, semantic Web, and informatics and engineering. Much of the IoT initiative is supported by the capabilities of manufacturing low-cost and energy-efficient hardware for devices with communication capacities, the maturity of wireless sensor network technologies, and the interests in integrating the physical and cyber worlds. However, the heterogeneity of the "Things" makes interoperability among them a challenging problem, which prevents generic solutions from being adopted on a global scale. Furthermore, the volume, velocity and volatility of the IoT data impose significant challenges to existing information systems. Semantic technologies based on machine-interpretable representation formalism have shown promise for describing objects, sharing and integrating information, and inferring new knowledge together with other intelligent processing techniques. However, the dynamic and resource-constrained nature of the IoT requires special design considerations to be taken into account to effectively apply the semantic technologies on the real world data. In this article the authors review some of the recent developments on applying the semantic technologies to IoT.
Article
Full-text available
Computing becomes increasingly mobile and pervasive today; these changes imply that applications and services must be aware of and adapt to their changing contexts in highly dynamic environments. Now a days, vehicles have become an increasingly important and exciting test bed for ubiquitous computing (UbiComp), however, context-aware vehicle service to enable high adaptation of service to driver, vehicle or even road in ubiquitous environment is still little addressed in the literature. The context management in pervasive computing environments must reflect the specific characteristics of these environments, e.g. mobility, resource-constrained devices, or heterogeneity of context sources. Although a number of context models have been presented in the literature, none of them supports all of these requirements to a sufficient extent at the same time. This paper focuses on building an ontology modeling approach for Context Management in Intelligent Pervasive Middleware for Context-Aware Vehicle Services. To support context-awareness, we embed capabilities of context modeling and context reasoning in an ontology-based context system, which focuses on management of the context and generates a consistent model which promises the common information representation and facilitates a development of context-aware services.
Conference Paper
Full-text available
This article describes a real-world semantic information retrieval tool for auto- motive diagnosis. Troubleshooting documents have always been popular within car work- shops / manufacturers as a simple and direct way to capitalize knowledge on the one hand and to access repair information on the other hand. However, with more and more complex vehicle architectures, troubleshooting bases have grown so much nowadays that nding relevant pieces of information can become harder than looking for a needle in a haystack. Based on a limited knowledge model of automotive diagnosis, our software aims at relieving car mechanics from the burden of storing and semantically searching through a large set of breakdown cases. 1. MOTIVATIONS
Article
Full-text available
This paper proposes an ontology modelling approach for assisting vehicle drivers through safety warningmessages during time critical situation. Intelligent Driver Assistance System (I-DAS) is a majorcomponent of InVANET[12], which focuses on generating the alert messages based on the context awareparameters such as driving situations, vehicle dynamics, driver activity and environment.I-DAS manages the parameter representation, consistent update /maintenance in XML format while theinterpretation of a critical situation is done using ontology modeling. Related safety technologies such asAdaptive Cruise Control, Collision Avoidance System, Lane Departure Warning System, DriverDrowsiness detection system, Parking Assistance System, which generate warnings and alerts to drivercontinuously, for assistance according to context which is integrated in Vehicle and Vehicle 2 Driver(V2D) communications by DVI(Driver Vehicle Interface) had been applied.The simulation test bed developed using Java framework[21] to generate safety alerts in various drivingsituations shows the usefulness of this approach. The response time graph for the simulation of context IDASis depicted and analysed. The effective performance of the driving scenarios in various modes likeday and night for single, 2-way and 4-way road scenario for the best, worst and average cases ofsimulation had been studied. The system works in VANET scenario, which needs to be adaptive forenvironment changes and to vary according to the context. The presented approach shows the simulationthat can be implemented to all vehicles in real time scenario with promising results.
Conference Paper
In order to use technology to influence human behaviour and promote safer and more fuel efficient behaviour through incentive mechanisms, an instrumented vehicle is developed. The first step is to make it “perceive” the outside world, so extracting knowledge from some data sources such as sensors is crucial. More critically, there is a fundamental need for a standard that would enable knowledge sharing/exchanging among the different entities, e.g., between on-board sensors, in-vehicle controls and traffic management agencies. This paper proposes an Ontology for Context Modelling (OCM) to be used as the world model for driving context representation and reasoning, which can enable a better understanding of traffic context and sensor capability, which is the basis for providing data source to Advanced Driver Assistance Systems (ADAS), V2X (Vehicle-to-Everything) communications and even driving decision making within autonomous vehicles. Through the experiments, we evaluate the capability of the OCM to represent the driving context and the reasoning mechanism to compensate for sensor failures and recognize lane changing and overtaking events. This methodology has significant value for creating standards in autonomous and semi-autonomous cars.
Conference Paper
Cars have been increasingly equipped with technology, meeting the demand of people for safety, connectivity, and comfort. Upcoming HMIs provide access to in-car systems and web services in a personalized manner that facilitates a large array of functionality even while driving, with other passengers also benefiting from an enhanced experience. Such intelligent applications however depend on a solid basis to be effective: Personalization, adaptive HMI, situation-aware intelligent systems -- either of these require semantic knowledge about the user, the vehicle, the current driving situation. Advanced functions coexist with sensors, other functions, and even other vehicles. In such an environment, collaboration can be highly beneficial. Obtaining a common understanding of knowledge and providing a platform to exchange it is essential in order to reach the next level of intelligent in-car systems. This work describes the Automotive Ontology, which is located at the core of such an open platform. We give an overview of design areas relevant to automotive applications, as well as meta aspects that facilitate inference and reasoning.
Conference Paper
Information integration is still one of today’s hottest IT topics. Neither merging the information from different data sources nor preparing it for the end user’s access has been completely solved. The goal of this paper is to present a holistic approach to integration by using ontologies and logic. There are several reasons for an ontology-based approach: Ontologies are able to cover all occurring data structures, for ontologies can be seen as nowadays most advanced knowledge representation model. They are able to cover complexity, for the combination with deductive logic extends the mapping and business logic capabilities. As the model is separated from the data storage, we get a higher degree of abstraction, whereby the semantics of the whole system is increased. Ontologies are extendible and highly reusable and deliver the user a better access to his relevant content. In this paper we describe how current capabilities of knowledge representation, mapping of structures and description of the business logic are extended. In an elaborated case study of a specific R&D process in the automobile industry [Ste03] we demonstrate that the complex integration process can be realized much easier, faster, more understandable and less expensive than before, without changing the existing IT legacy environment.
QUDT-quantities, units, dimensions and data types ontologies. USA
  • R Hodgson
  • P J Keller
  • J Hodges
  • J Spivak
R. Hodgson, P. J. Keller, J. Hodges, and J. Spivak. QUDT-quantities, units, dimensions and data types ontologies. USA, Available from: http://qudt. org [March 2014], 2014.