ArticlePDF Available

Big Building Data - a Big Data Platform for Smart Buildings

Authors:

Abstract and Figures

Future buildings will more and more rely on advanced Building Management Systems (BMS) connected to a variety of sensors, actuators and dedicated networks. Their objectives are to observe the state of rooms and apply automated rules to preserve or increase comfort while economizing energy. In this work, we advocate for the inclusion of a dedicated system for sensors data storage and processing, based on Big Data technologies. This choice enables new potentials in terms of data analytics and applications development, the most obvious one being the ability to scale up seamlessly from one smart building to several, in the direction of smart areas and smart cities. We report in this paper on our system architecture and on several challenges we met in its elaboration, attempting to meet requirements of scalability, data processing, flexibility, interoperability and privacy. We also describe current and future end-user services that our platform will support, including historical data retrieval, visualisation, processing and alarms. The platform, called BBData - Big Building Data, is currently in production at the Smart Living Lab of Fribourg and is offered to several research teams to ease their work, to foster the sharing of historical data and to avoid that each project develops its own data gathering and processing pipeline.
Content may be subject to copyright.
ScienceDirect
Available online at www.sciencedirect.com
Available online at www.sciencedirect.com
ScienceDirect
Energy Procedia 00 (2017) 000–000
www.elsevier.com/locate/procedia
1876-6102 © 2017The Authors. Published by Elsevier Ltd.
Peer-review under responsibility of the Scientific Committee of The 15th International Symposium on District Heating and Cooling.
The 15th International Symposium on District Heating and Cooling
Assessing the feasibility of using the heat demand-outdoor
temperature function for a long-term district heat demand forecast
I. Andrića,b,c*, A. Pinaa, P. Ferrãoa, J. Fournierb., B. Lacarrièrec, O. Le Correc
aIN+ Center for Innovation, Technology and Policy Research -Instituto Superior Técnico,Av. Rovisco Pais 1, 1049-001 Lisbon, Portugal
bVeolia Recherche & Innovation,291 Avenue Dreyfous Daniel, 78520 Limay, France
cDépartement Systèmes Énergétiques et Environnement -IMT Atlantique, 4 rue Alfred Kastler, 44300 Nantes, France
Abstract
District heating networks are commonly addressed in the literature as one of the most effective solutions for decreasing the
greenhouse gas emissions from the building sector. These systems require high investments which are returned through the heat
sales. Due to the changed climate conditions and building renovation policies, heat demand in the future could decrease,
prolonging the investment return period.
The main scope of this paper is to assess the feasibility of using the heat demand outdoor temperature function for heat demand
forecast. The district of Alvalade, located in Lisbon (Portugal), was used as a case study. The district is consisted of 665
buildings that vary in both construction period and typology. Three weather scenarios (low, medium, high) and three district
renovation scenarios were developed (shallow, intermediate, deep). To estimate the error, obtained heat demand values were
compared with results from a dynamic heat demand model, previously developed and validated by the authors.
The results showed that when only weather change is considered, the margin of error could be acceptable for some applications
(the error in annual demand was lower than 20% for all weather scenarios considered). However, after introducing renovation
scenarios, the error value increased up to 59.5% (depending on the weather and renovation scenarios combination considered).
The value of slope coefficient increased on average within the range of 3.8% up to 8% per decade, that corresponds to the
decrease in the number of heating hours of 22-139h during the heating season (depending on the combination of weather and
renovation scenarios considered). On the other hand, function intercept increased for 7.8-12.7% per decade (depending on the
coupled scenarios). The values suggested could be used to modify the function parameters for the scenarios considered, and
improve the accuracy of heat demand estimations.
© 2017 The Authors. Published by Elsevier Ltd.
Peer-review under responsibility of the Scientific Committee of The 15th International Symposium on District Heating and
Cooling.
Keywords: Heat demand; Forecast; Climate change
Energy Procedia 122 (2017) 589–594
1876-6102 © 2017 The Authors. Published by Elsevier Ltd.
Peer-review under responsibility of the scientific committee of the CISBAT 2017 International Conference – Future Buildings &
Districts – Energy Efficiency from Nano to Urban Scale
10.1016/j.egypro.2017.07.354
10.1016/j.egypro.2017.07.354
© 2017 The Authors. Published by Elsevier Ltd.
Peer-review under responsibility of the scientic committee of the CISBAT 2017 International Conference – Future Buildings &
Districts – Energy Efciency from Nano to Urban Scale
1876-6102
Available online at www.sciencedirect.com
Energy Procedia 00 (2016) 000–000
www.elsevier.com/locate/procedia
CISBAT 2017 International Conference Future Buildings & Districts Energy Eciency from
Nano to Urban Scale, CISBAT 2017 6-8 September 2017, Lausanne, Switzerland
Big Building Data - a Big Data Platform for Smart Buildings
Lucy Lindera, Damien Vionnetb, Jean-Philippe Bacherb, Jean Henneberta,
aInstitute of Complex Systems, HEIA-FR, Boulevard de Perolles 80, 1700 Fribourg, Switzerland
bInstitute of Energy, HEIA-FR, Boulevard de Perolles 80, 1700 Fribourg, Switzerland
Abstract
Future buildings will more and more rely on advanced Building Management Systems (BMS) connected to a variety of sensors,
actuators and dedicated networks. Their objectives are to observe the state of rooms and apply automated rules to preserve or in-
crease comfort while economizing energy. In this work, we advocate for the inclusion of a dedicated system for sensors data storage
and processing, based on Big Data technologies. This choice enables new potentials in terms of data analytics and applications
development, the most obvious one being the ability to scale up seamlessly from one smart building to several, in the direction of
smart areas and smart cities. We report in this paper on our system architecture and on several challenges we met in its elaboration,
attempting to meet requirements of scalability, data processing, flexibility, interoperability and privacy. We also describe current
and future end-user services that our platform will support, including historical data retrieval, visualisation, processing and alarms.
The platform, called BBData - Big Building Data, is currently in production at the Smart Living Lab of Fribourg and is oered to
several research teams to ease their work, to foster the sharing of historical data and to avoid that each project develops its own
data gathering and processing pipeline.
c
2016 The Authors. Published by Elsevier Ltd.
Peer-review under responsibility of the scientific committee of the CISBAT 2017 International Conference Future Buildings &
Districts Energy Eciency from Nano to Urban Scale.
Keywords: Big Data; Building Management Systems; Smart Buildings; Web of Buildings;
1. Introduction
Concerns about climate change have triggered the need for more sustainable and dynamic energy management
systems. This is especially true for the building sector, which accounts for about 20% of the energy consumed
worldwide [1].
The standardisation of building sensors, for example through IoT technologies, and their coupling to smarter con-
trol systems are forming the basis of Smart Buildings, providing new ways for the owners, operators and facility
managers to improve both the reliability and performances of building assets. Research wise, smart control systems
are intensively investigated with the objectives to save energy and at the same time increase the comfort level. Exam-
ples of smart controls are promising, reporting savings from 10% for simple controls up to 60% for the most advanced
Corresponding author. Tel.: +41-26-429-6596
E-mail address: jean.hennebert@hefr.ch
1876-6102 c
2016 The Authors. Published by Elsevier Ltd.
Peer-review under responsibility of the scientific committee of the CISBAT 2017 International Conference Future Buildings & Districts Energy
Eciency from Nano to Urban Scale.
Available online at www.sciencedirect.com
Energy Procedia 00 (2016) 000–000
www.elsevier.com/locate/procedia
CISBAT 2017 International Conference Future Buildings & Districts Energy Eciency from
Nano to Urban Scale, CISBAT 2017 6-8 September 2017, Lausanne, Switzerland
Big Building Data - a Big Data Platform for Smart Buildings
Lucy Lindera, Damien Vionnetb, Jean-Philippe Bacherb, Jean Henneberta,
aInstitute of Complex Systems, HEIA-FR, Boulevard de Perolles 80, 1700 Fribourg, Switzerland
bInstitute of Energy, HEIA-FR, Boulevard de Perolles 80, 1700 Fribourg, Switzerland
Abstract
Future buildings will more and more rely on advanced Building Management Systems (BMS) connected to a variety of sensors,
actuators and dedicated networks. Their objectives are to observe the state of rooms and apply automated rules to preserve or in-
crease comfort while economizing energy. In this work, we advocate for the inclusion of a dedicated system for sensors data storage
and processing, based on Big Data technologies. This choice enables new potentials in terms of data analytics and applications
development, the most obvious one being the ability to scale up seamlessly from one smart building to several, in the direction of
smart areas and smart cities. We report in this paper on our system architecture and on several challenges we met in its elaboration,
attempting to meet requirements of scalability, data processing, flexibility, interoperability and privacy. We also describe current
and future end-user services that our platform will support, including historical data retrieval, visualisation, processing and alarms.
The platform, called BBData - Big Building Data, is currently in production at the Smart Living Lab of Fribourg and is oered to
several research teams to ease their work, to foster the sharing of historical data and to avoid that each project develops its own
data gathering and processing pipeline.
c
2016 The Authors. Published by Elsevier Ltd.
Peer-review under responsibility of the scientific committee of the CISBAT 2017 International Conference Future Buildings &
Districts Energy Eciency from Nano to Urban Scale.
Keywords: Big Data; Building Management Systems; Smart Buildings; Web of Buildings;
1. Introduction
Concerns about climate change have triggered the need for more sustainable and dynamic energy management
systems. This is especially true for the building sector, which accounts for about 20% of the energy consumed
worldwide [1].
The standardisation of building sensors, for example through IoT technologies, and their coupling to smarter con-
trol systems are forming the basis of Smart Buildings, providing new ways for the owners, operators and facility
managers to improve both the reliability and performances of building assets. Research wise, smart control systems
are intensively investigated with the objectives to save energy and at the same time increase the comfort level. Exam-
ples of smart controls are promising, reporting savings from 10% for simple controls up to 60% for the most advanced
Corresponding author. Tel.: +41-26-429-6596
E-mail address: jean.hennebert@hefr.ch
1876-6102 c
2016 The Authors. Published by Elsevier Ltd.
Peer-review under responsibility of the scientific committee of the CISBAT 2017 International Conference Future Buildings & Districts Energy
Eciency from Nano to Urban Scale.
Available online at www.sciencedirect.com
Energy Procedia 00 (2016) 000–000
www.elsevier.com/locate/procedia
CISBAT 2017 International Conference Future Buildings & Districts Energy Eciency from
Nano to Urban Scale, CISBAT 2017 6-8 September 2017, Lausanne, Switzerland
Big Building Data - a Big Data Platform for Smart Buildings
Lucy Lindera, Damien Vionnetb, Jean-Philippe Bacherb, Jean Henneberta,
aInstitute of Complex Systems, HEIA-FR, Boulevard de Perolles 80, 1700 Fribourg, Switzerland
bInstitute of Energy, HEIA-FR, Boulevard de Perolles 80, 1700 Fribourg, Switzerland
Abstract
Future buildings will more and more rely on advanced Building Management Systems (BMS) connected to a variety of sensors,
actuators and dedicated networks. Their objectives are to observe the state of rooms and apply automated rules to preserve or in-
crease comfort while economizing energy. In this work, we advocate for the inclusion of a dedicated system for sensors data storage
and processing, based on Big Data technologies. This choice enables new potentials in terms of data analytics and applications
development, the most obvious one being the ability to scale up seamlessly from one smart building to several, in the direction of
smart areas and smart cities. We report in this paper on our system architecture and on several challenges we met in its elaboration,
attempting to meet requirements of scalability, data processing, flexibility, interoperability and privacy. We also describe current
and future end-user services that our platform will support, including historical data retrieval, visualisation, processing and alarms.
The platform, called BBData - Big Building Data, is currently in production at the Smart Living Lab of Fribourg and is oered to
several research teams to ease their work, to foster the sharing of historical data and to avoid that each project develops its own
data gathering and processing pipeline.
c
2016 The Authors. Published by Elsevier Ltd.
Peer-review under responsibility of the scientific committee of the CISBAT 2017 International Conference Future Buildings &
Districts Energy Eciency from Nano to Urban Scale.
Keywords: Big Data; Building Management Systems; Smart Buildings; Web of Buildings;
1. Introduction
Concerns about climate change have triggered the need for more sustainable and dynamic energy management
systems. This is especially true for the building sector, which accounts for about 20% of the energy consumed
worldwide [1].
The standardisation of building sensors, for example through IoT technologies, and their coupling to smarter con-
trol systems are forming the basis of Smart Buildings, providing new ways for the owners, operators and facility
managers to improve both the reliability and performances of building assets. Research wise, smart control systems
are intensively investigated with the objectives to save energy and at the same time increase the comfort level. Exam-
ples of smart controls are promising, reporting savings from 10% for simple controls up to 60% for the most advanced
Corresponding author. Tel.: +41-26-429-6596
E-mail address: jean.hennebert@hefr.ch
1876-6102 c
2016 The Authors. Published by Elsevier Ltd.
Peer-review under responsibility of the scientific committee of the CISBAT 2017 International Conference Future Buildings & Districts Energy
Eciency from Nano to Urban Scale.
Available online at www.sciencedirect.com
Energy Procedia 00 (2016) 000–000
www.elsevier.com/locate/procedia
CISBAT 2017 International Conference Future Buildings & Districts Energy Eciency from
Nano to Urban Scale, CISBAT 2017 6-8 September 2017, Lausanne, Switzerland
Big Building Data - a Big Data Platform for Smart Buildings
Lucy Lindera, Damien Vionnetb, Jean-Philippe Bacherb, Jean Henneberta,
aInstitute of Complex Systems, HEIA-FR, Boulevard de Perolles 80, 1700 Fribourg, Switzerland
bInstitute of Energy, HEIA-FR, Boulevard de Perolles 80, 1700 Fribourg, Switzerland
Abstract
Future buildings will more and more rely on advanced Building Management Systems (BMS) connected to a variety of sensors,
actuators and dedicated networks. Their objectives are to observe the state of rooms and apply automated rules to preserve or in-
crease comfort while economizing energy. In this work, we advocate for the inclusion of a dedicated system for sensors data storage
and processing, based on Big Data technologies. This choice enables new potentials in terms of data analytics and applications
development, the most obvious one being the ability to scale up seamlessly from one smart building to several, in the direction of
smart areas and smart cities. We report in this paper on our system architecture and on several challenges we met in its elaboration,
attempting to meet requirements of scalability, data processing, flexibility, interoperability and privacy. We also describe current
and future end-user services that our platform will support, including historical data retrieval, visualisation, processing and alarms.
The platform, called BBData - Big Building Data, is currently in production at the Smart Living Lab of Fribourg and is oered to
several research teams to ease their work, to foster the sharing of historical data and to avoid that each project develops its own
data gathering and processing pipeline.
c
2016 The Authors. Published by Elsevier Ltd.
Peer-review under responsibility of the scientific committee of the CISBAT 2017 International Conference Future Buildings &
Districts Energy Eciency from Nano to Urban Scale.
Keywords: Big Data; Building Management Systems; Smart Buildings; Web of Buildings;
1. Introduction
Concerns about climate change have triggered the need for more sustainable and dynamic energy management
systems. This is especially true for the building sector, which accounts for about 20% of the energy consumed
worldwide [1].
The standardisation of building sensors, for example through IoT technologies, and their coupling to smarter con-
trol systems are forming the basis of Smart Buildings, providing new ways for the owners, operators and facility
managers to improve both the reliability and performances of building assets. Research wise, smart control systems
are intensively investigated with the objectives to save energy and at the same time increase the comfort level. Exam-
ples of smart controls are promising, reporting savings from 10% for simple controls up to 60% for the most advanced
Corresponding author. Tel.: +41-26-429-6596
E-mail address: jean.hennebert@hefr.ch
1876-6102 c
2016 The Authors. Published by Elsevier Ltd.
Peer-review under responsibility of the scientific committee of the CISBAT 2017 International Conference Future Buildings & Districts Energy
Eciency from Nano to Urban Scale.
Available online at www.sciencedirect.com
Energy Procedia 00 (2016) 000–000
www.elsevier.com/locate/procedia
CISBAT 2017 International Conference Future Buildings & Districts Energy Eciency from
Nano to Urban Scale, CISBAT 2017 6-8 September 2017, Lausanne, Switzerland
Big Building Data - a Big Data Platform for Smart Buildings
Lucy Lindera, Damien Vionnetb, Jean-Philippe Bacherb, Jean Henneberta,
aInstitute of Complex Systems, HEIA-FR, Boulevard de Perolles 80, 1700 Fribourg, Switzerland
bInstitute of Energy, HEIA-FR, Boulevard de Perolles 80, 1700 Fribourg, Switzerland
Abstract
Future buildings will more and more rely on advanced Building Management Systems (BMS) connected to a variety of sensors,
actuators and dedicated networks. Their objectives are to observe the state of rooms and apply automated rules to preserve or in-
crease comfort while economizing energy. In this work, we advocate for the inclusion of a dedicated system for sensors data storage
and processing, based on Big Data technologies. This choice enables new potentials in terms of data analytics and applications
development, the most obvious one being the ability to scale up seamlessly from one smart building to several, in the direction of
smart areas and smart cities. We report in this paper on our system architecture and on several challenges we met in its elaboration,
attempting to meet requirements of scalability, data processing, flexibility, interoperability and privacy. We also describe current
and future end-user services that our platform will support, including historical data retrieval, visualisation, processing and alarms.
The platform, called BBData - Big Building Data, is currently in production at the Smart Living Lab of Fribourg and is oered to
several research teams to ease their work, to foster the sharing of historical data and to avoid that each project develops its own
data gathering and processing pipeline.
c
2016 The Authors. Published by Elsevier Ltd.
Peer-review under responsibility of the scientific committee of the CISBAT 2017 International Conference Future Buildings &
Districts Energy Eciency from Nano to Urban Scale.
Keywords: Big Data; Building Management Systems; Smart Buildings; Web of Buildings;
1. Introduction
Concerns about climate change have triggered the need for more sustainable and dynamic energy management
systems. This is especially true for the building sector, which accounts for about 20% of the energy consumed
worldwide [1].
The standardisation of building sensors, for example through IoT technologies, and their coupling to smarter con-
trol systems are forming the basis of Smart Buildings, providing new ways for the owners, operators and facility
managers to improve both the reliability and performances of building assets. Research wise, smart control systems
are intensively investigated with the objectives to save energy and at the same time increase the comfort level. Exam-
ples of smart controls are promising, reporting savings from 10% for simple controls up to 60% for the most advanced
Corresponding author. Tel.: +41-26-429-6596
E-mail address: jean.hennebert@hefr.ch
1876-6102 c
2016 The Authors. Published by Elsevier Ltd.
Peer-review under responsibility of the scientific committee of the CISBAT 2017 International Conference Future Buildings & Districts Energy
Eciency from Nano to Urban Scale.
Smart Cities (Urban Simulation, Big Data)
590 Lucy Linder et al. / Energy Procedia 122 (2017) 589–594
2Lucy Linder /Energy Procedia 00 (2016) 000–000
systems. Smart controls are addressing the dierent sources of consumptions in buildings such as heating, cooling,
ventilation, electric lighting and solar shadings [2], lightning [3], electric appliance [4], etc. We observe that such
technologies will rely more and more on the gathering of large amounts of data from multiple sensors, actuators and
dedicated networks.
The handling of Smart Building data is challenging in many ways. First, the building automation domain has a long
history with interoperability problems due to the diversity of systems and technologies [5], leading to interoperability
and integration concerns [6]. Second, the density of sensors and actuators as well as the sensing frequency tend to
increase for a finer observation and control of the equipments, leading to large quantities of data to process. As an
example, in Project Dasher, the database reached its limits after only three months and the collection of 2 billion rows
of data [7]. Third, advanced control, monitoring and post occupancy evaluation are relying on more and more complex
models using both real-time and historical data, as well as aggregations and correlations in the range of several years.
While real-time and time-aggregation processing have received a renewed attention and many frameworks try to
address those needs, none of them are currently fully mature [8]. Finally, while the coupling between the IoT and the
Big Data is strong, there are few comprehensive approaches to support the collection of data from building sensors to
their exploitation. Current research eorts are mainly focusing on the collection of data from the data producer tiers,
the reception tiers or the exploitation one [9].
In the BBData project, we attempt to answer those challenges by providing a full-featured data processing platform
for Big Building Data. BBData is an ingestion, processing and sharing system able to scale up to the Big Data
expectations of Smart Building environments. The project is an applied research contribution of HEIA-FR in the
context of the Smart Living Lab in Fribourg. Still in the earlier stages of development, it has been running continuously
for several months to gather data from more than two thousands sensors located at the Halle Bleue of the BlueFactory
site.
Section 2 presents a general overview of the BBData platform. Subection 2.1 shows how Big Data technologies
changed the landscape of Smart Building solutions. Subsection 2.2 presents the architecture of BBData, as well as the
technologies that support it. In section 3, we review some of the challenges of big data and how we met them in our
solution. In section 4, we present some key features of BBData and how Building professionals could benefit from it.
2. System description
2.1. From BMS to Web of Buildings
In this work, we rely on the inclusion of a dedicated system for the storage and processing of sensors data equipping
smart buildings. More specifically, the architecture of this system is remote, de-coupled and based on Big Data
technologies. This choice enables new potentials in terms of data analytics and applications development, the most
obvious one being the ability to scale up seamlessly from one smart building to several, in the direction of smart
areas and smart cities. More than a simple evolution of Building Management Systems (BMS), such open Big Data
architectures are probably an important paradigm shift from BMS to what is called Web of Buildings [10].
As illustrated on the left part of Figure 1, traditional Building Management Systems (BMS) are standalone soft-
wares running on a server located in the premises of a building. Standard BMS includes three levels of functions:
(1) the field layer is made of sensors and actuators connecting to the physical word; (2) the automation layer applies
strategies derived from a set of rules and parameters; (3) the management layer configures and manages the other lay-
ers. BMS usually oer limited capacities in terms of sensor data storage and act as isolated systems often unreachable
from the outside.
The right part of Figure 1 illustrates our BBDATA architecture with the inclusion of remote solutions for storage
and data processing. More than the ability of scaling up at the level of a city, this approach brings new opportunities in
terms of BMS evolution through the de-coupling of sensors, data storage and applications levels. This opening is sup-
ported by the emergence of the open and standardised principles of the Internet of Things and Web of Things [11][12].
It allows for seamless integration of new data sources, such as weather forecasts available in web services or mobile
sensors. It also allows for shorter application development cycles, enabling for example mashup approaches as in
modern web application development. Finally, the availability of long term historical data allows to use advanced
mathematical models and machine learning technique [13].
Lucy Linder et al. / Energy Procedia 122 (2017) 589–594 591
Lucy Linder /Energy Procedia 00 (2016) 000–000 3
Management
Field
Automation
storage
Processing
Field
Field
Field
Applications
Applications
Applications
monitoring / controlnetworks of sensors cloud / Big Data platforms
Fig. 1. On the right, a traditional BMS architecture; On the left, a Web of Buildings architecture.
2.2. The BBData architecture
Figure 2 shows the journey of a measure in the BBData system. In (1), dierent kind of sensors produce measures.
Those sensors might come from dierent manufacturer and use various data encodings. To ensure the compatibility of
the platform with any kind of equipment, BBData uses the concept of virtual objects. A virtual object has metadata,
such as name, unit and type and can be mapped to a real sensor through an ID. This mapping is handled by collec-
tors (2). A collector creates a bbdata record for each measure and sends it to the input api in a structured JSON format.
In case some sensors lack an internal clock, the collector can also produce a timestamp. The input api (3) is a JavaEE
REST service running on GlassFish1whose role is to validate the incoming measure and ensure its authenticity using
the object’s ID and a secure token. If the check succeeds, security informations are dropped and the resulting JSON is
added to an Apache Kafka2message queue (4) for processing. The content of this queue is also dumped periodically
to HDFS, so the raw inputs can be replayed anytime. Before processing, the measure is first ”augmented” with the
virtual object’s metadata pulled from a MySQL3database (5). The result is stored in a second message queue using a
compressed format (6).
In BBData, processing covers a wide area of tasks. It goes from the saving of raw values into a persistent store
to the detection of anomalies or the computation of time aggregations. Each of these tasks is handled by a specific
processor. Processors are independent streaming applications running in a hadoop cluster. They subscribe to the
augmented Kafka topic, carry their task and save their output, if any, in a Cassandra database. This design makes it
possible to add or remove processors without any impact on the system. We have currently two kind of processors,
both implemented with Apache Flink4: the first saves the raw records to Cassandra, the second one computes live
time aggregates (mean, max, last measure, standard deviation) with a granularity of fifteen minutes, one hour and one
day.
Users and building automation applications can access the data and manage virtual objects through a standard
REST interface called the output api (7) or via HTML5 web applications.
3. Big Data: challenges and pitfalls
The potential of Big Data technologies is undeniable. However it raises many challenges when it comes to design
a sustainable and ecient data ecosystem. First, even if Hadoop is a de-facto standard in the Big Data landscape, it
is made of many components distributed on multiple machines. The maintenance of such system is rather intensive
1https://glassfish.java.net/
2https://kafka.apache.org/
3https://www.mysql.com/
4https://kafka.apache.org/
592 Lucy Linder et al. / Energy Procedia 122 (2017) 589–594
4Lucy Linder /Energy Procedia 00 (2016) 000–000
raw
INPUT API
augmentation
(ßink)
processors
(ßink)
metadata
(MySQL)
values
(Cassandra)
OUTPUT API
augmented
1
2
3
4
567
8
Fig. 2. Architecture of BBData: the journey of a measure
and the learning curve is steep. Second, the technology landscape in Big Data is fast evolving and improvements
are constant, especially in the analytics domain. With our BBData system, we had to and we still are compromising
between stabilising our environment and incorporating the latest techniques, sometimes questioning initial choices in
front of emerging Big Data design patterns. We can report here on two examples we faced while designing BBData
and that are specific to the storage and processing of building data.
At the storage level, NoSQL databases are compromising between consistency (C), availability (A) and partition
tolerance (P), known as the CAP theorem [14]. It has been revised since to include latency in the equation [15]. Our
choice of using Apache Cassandra was motivated by its good reported performance as an AP database and also by the
fact we could reach good consistency with a proper configuration. But this performance comes at a cost: the supported
queries are tightly dependent on the data model. Such scalable databases use the notion of shards that are partitions
of the data on dierent nodes. A given data will be stored in a given shard according to a user defined strategy. In
BBData, we privileged a fair distribution of the data on several shards using as distribution key the object’s id and the
timestamp’s year and month. This ensures data are well-balanced between nodes, but also limits our queries to those
where the object id and the time period are known. Moreover, since measures from dierent month are potentially
stored on dierent machines, the wider the time range, the less the performance.
At the processing level, our focus on building data and energy management requested the ability to compute
time-based aggregations on streams. While aggregations are relatively common needs, the main stream-processing
frameworks such as Apache Spark, Flink and Kafka Streams are still looking for satisfying general solutions. In our
case, we needed aggregations based on timestamps embedded in the data and also that the time advanced dierently
for each virtual object. This conjonction of requirements are not supported by any framework yet. As a result, we had
to implement our own tool to oer on-the-fly time aggregations to our users.
4. User services
BBData can oer many tools to dierent types of user. It includes the building user, the building owner, the
architects and the engineering consultancies. The first set of tools is related to data monitoring. At the building user
point of view, these tools oer access to live monitoring, to historic data and to dierent type of pre-calculated values.
The data monitoring is also useful to the architects and the engineering consultancies. Presently, these two actors have
access to few information once the building is in operation. A data monitoring service would be a real added value
for them. Such a service allows to understand the behavior of the building and the behavior of the occupants. From
the observed behaviors, the engineering consultancies are able to do post-occupancy evaluation and optimization to
reduce the energy consumption and/or improve the user satisfaction [16][17]. Figure 3 illustrates a potential for energy
savings based on correlating door sensors and lighting consumption. For the architects, they can use this information
to build best practice guides and to enrich their experience for the next constructions.
Building owners have also expressed their interest for other types of services. The first one is the ”anomaly
detection” [18]. By taking advantage of data history, it is possible to identify data patterns that define the standard
Lucy Linder et al. / Energy Procedia 122 (2017) 589–594 593
Lucy Linder /Energy Procedia 00 (2016) 000–000 5
Fig. 3. Post occupancy optimization: modify lighting automation to save energy after the last person leaves the oce
behavior of the building and its users. By comparing these patterns to the current state (see Figure 4), discrepancies
can be detected automatically and alerts can be triggered, for example a maintenance alert. Based on the same idea,
a predictive maintenance can be developed. Like patterns for standard building behaviors, it is possible to define
patterns from the occurred anomalies and associate to them metadata such as the equipment or user behavior causing
the anomaly and the way the issue was solved. If one of these anomalies arise one more time, the BBData system
could detect it and suggest the right issue resolution. These dierent services are not yet provided by the BBData
system but are under development.
Fig. 4. Standard pattern vs. abnormal pattern - Simulated data
We are also currently developing a third set of tools useful to the building owner for planning building renovation
and comparing the performances of dierent buildings. These tools are able to compute yearly building energy
signatures and environmental CO2eq footprints. With such tools, the building owner can compare the current state
versus the previous year and check if the established action plan has any eect. Prediction models will also be included
based on the current state and on historical data for the rest of the year [19].
5. Conclusion and future work
In this paper, we presented the BBData platform, a distributed system for storing and processing building data.
Based on Big Data technologies, the platform enables new potentials in terms of data analytics and applications
development, with the ability to scale up seamlessly from one smart building to several, in the direction of smart
areas and smart cities. We detailed the architecture of the system and the dierent technological choices we made by
describing the journey of a data emitted from a sensor and going trough the modules of the system. We then reviewed
some of the challenges we met setting up the platform, some of them being related to classical constraints of Big Data
environments. We finally described several services, existing and under development, that leverage on BBData and
that are dedicated to building users, owners, architects and managers.
594 Lucy Linder et al. / Energy Procedia 122 (2017) 589–594
6Lucy Linder /Energy Procedia 00 (2016) 000–000
In our future work, we plan to further develop end-user services such as alarms based on advanced anomaly detec-
tion and prediction. Other areas of development will go in the direction of multivariate stream processing including,
for example, time aggregations on a group of objects or correlations between streams.
References
[1] Residential and commercial buildings. U.S. Energy. Information Administration, International Energy Outlook 2016; 2016.
[2] Daum, D.. On the Adaptation of Building Controls to the Envelope and the Occupants. Ph.D. thesis; ENAC; Lausanne; 2011. doi:10.5075/epfl-
thesis-4935.
[3] Rea, M., of North America, I.E.S.. The IESNA Lighting Handbook: Reference & Application. IESNA LIGHTING HANDBOOK; Illumi-
nating Engineering Society of North America; 2000. ISBN 9780879951504. URL: https://books.google.mu/books?id=0Ot4QgAACAAJ.
[4] Ridi, A., Gisler, C., Hennebert, J.. A Survey on Intrusive Load Monitoring for Appliance Recognition. In: 22nd International Conference on
Pattern Recognition - ICPR. IEEE. ISBN 9781479952106; 2014, p. 3702–3707. doi:10.1109/ICPR.2014.636.
[5] Ploennigs, J.. A modular, adaptive building automation system ontology. IEEE IECON 2012;.
[6] Moreno, M.V.. Applicability of big data techniques to smart cities deployments. IEEE Transactions on Industrial Informatics 2016;.
[7] Khan, A.. Big data from the built environment. Proceedings of the 2nd international workshop on Research in the large 2011;.
[8] Maninder Pal Singh Mohammad A. Hoque, S.T.. A survey of systems for massive stream analytics. Tech. Rep.; Cornell University; 2016.
[9] Cyril Cecchinel Matthieu Jimenez, e.A.. An architecture to support the collection of big data in the internet of things. Conference: 2014 IEEE
World Congress on Services 2014;.
[10] Bovet, G.. A scalable and sustainable web of buildings architecture. Ph.D. thesis; Telecom ParisTech; 2015.
[11] Bovet, G., Hennebert, J.. A web-of-things gateway for knx networks. In: Smart SysTech 2013; European Conference on Smart Objects,
Systems and Technologies. 2013, p. 1–8.
[12] Bovet, G., Hennebert, J.. Oering web-of-things connectivity to building networks. In: Proceedings of the 2013 ACM Conference on
Pervasive and Ubiquitous Computing Adjunct Publication. UbiComp ’13 Adjunct; New York, NY, USA: ACM; 2013, p. 1555–1564.
[13] Ridi, A., Zarkadis, N., Bovet, G., Morel, N., Hennebert, J.. Towards reliable stochastic data-driven models applied to the energy saving
in buildings. In: International Conference on Cleantech for Smart Cities & Buildings from Nano to Urban Scale (CISBAT 2013). 2013, p.
501–506.
[14] Gilbert, S., Lynch, N.. Perspectives on the cap theorem. Computer 2012;45(2):30–36.
[15] Abadi, D.. Consistency tradeos in modern distributed database system design: Cap is only part of the story. Computer 2012;45(2):37–42.
[16] Zimmerman, A.. Post-occupancy evaluation: benefits and barriers. Building research and information 2001;.
[17] Tarrio-Saavedra, J., al., . Assessing thermal comfort and energy eciency in buildings by statistical quality control for autocorrelated data.
Applied energy 2017;.
[18] Burton, K., al., . Development and alpha testing of a cloud based automated fault detection and diagnosis tool for air handling units.
Automation in Construction 2014;.
[19] Mathieu, J., al., . Quantifying changes in building electricity use, with application to demand response. IEEE Transactions on SMART GRID
2011;.
... • Localization and occupancy-Research underscores that the localization and occupancy of building spaces significantly influence energy consumption, challenging the traditional focus solely on the usage of objects within buildings [63,65,67,71,74,77,[79][80][81][89][90][91][105][106][107]. Unlike usage models that monitor device interaction, occupancy and localization models focus on how space utilization affects energy needs. ...
... To effectively leverage occupancy data, various sophisticated techniques are employed to enhance building energy management. Knowledge bases aggregate and process occupancy data, applying predefined rules to deduce room usage patterns and optimize energy distribution according to actual needs [63,77,90,105,107]. Additionally, the K-nearest neighbor algorithm, combined with Kalman filters, is used to improve the accuracy of spatial classification, ensuring that energy management systems are finely tuned to the specific layouts of a building [71,91]. ...
... These structures are rich in information and are equipped with various devices that constantly collect and produce data. This SLR reports a constant interest of researchers [30,34,39,40,52,57,58,63,71,72,83,94,96,102] in dealing with Buildings' big data. ...
Article
Full-text available
Buildings are complex structures composed of heterogeneous elements; these require building management systems (BMSs) to dynamically adapt them to occupants’ needs and leverage building resources. The fast growth of information and communication technologies (ICTs) has transformed the BMS field into a multidisciplinary one. Consequently, this has caused several research papers on data-driven solutions to require examination and classification. This paper provides a broad overview of BMS by conducting a systematic literature review (SLR) summarizing current trends in this field. Unlike similar reviews, this SLR provides a rigorous methodology to review current research from a computer science perspective. Therefore, our goal is four-fold: (i) Identify the main topics in the field of building; (ii) Identify the recent data-driven methods; (iii) Understand the BMS’s underlying computing architecture (iv) Understand the features of BMS that contribute to the smartization of buildings. The result synthesizes our findings and provides research directions for further research.
... Literature [12] suggests that big data technology is driving economic development in low-technology industries, including agriculture; it predicts future localized events and returns through big data analytics systems based on operational improvements in agriculture real-time and historical data timely recommendations and two areas of big data visualization and analytics for rural infrastructure. Literature designed a big building data platform [13] to store and process sensor data based on big data technology. Literature [14] suggests that the promotion of big data for rural infrastructure has begun to bear fruit, and several practical demonstration projects of big data for rural infrastructure have been formed based on a comprehensive technology acceptance model. ...
Article
Full-text available
In the context of rural revitalization strategy, this paper uses an adaptive density-sensitive similarity measure method to improve based on a spectral clustering algorithm and combines with coordinate visualization technology to cluster rural infrastructure data for visualization. On this basis, a rural infrastructure big data platform is constructed by designing data management, data analysis and data visualization, and the overall performance of the rural infrastructure big data platform is tested in the configured test environment. The results show that when the visualization node is 50000, the running time is only 153.8s, the big data platform can output data stably, the proportion of failure is within 3%, and the corresponding time of each interface on the line is also 1000ms. Based on this research, the infrastructure for a big data platform in rural revitalization strategies can be successfully constructed.
... Offprint provided courtesy of www.icevirtuallibrary.com Author copy for personal use, not for distribution using such platforms focusing on scalability (Bashir et al., 2022;Genkin and McArthur, 2023;Linder et al., 2017Linder et al., , 2021. As part of a joint research effort towards pushing commercial technology boundaries, the data platform selected was the ACP (see Figure 2), which was developed using state-of-the-art technologies such as Vrtx to enable real-time applications with minimal end-to-end (i.e. from data sources to applications) latency (Brazauskas et al., 2021). ...
Article
Improving efficiency of operations is a major challenge in Facility Management given the limitations of outsourcing individual building functions to third-party companies. The status of each building function is isolated in siloes which are controlled by these third-party companies. Companies provide access to aggregated information in the form of reports through web portals, emails, or bureaucratic processes. Digital Twins represent an emerging approach to return awareness and control to facility managers by automating all levels of information access (from granular data to defined KPIs and reports) and actuation. This paper proposes a low-latency data integration method that supports actuation and decision making in Facility Management, including construction, operations and maintenance data, and Internet of Things. The method uses federated data models and semantic web ontologies, and it is implemented within a data lake architecture with connections to siloed data to keep the delegation of responsibilities of data owners. A case study in the Alan Reece building (Cambridge, United Kingdom) demonstrates the approach by enabling Fault-Detection-and-Diagnosis of the Heating Ventilation and Air Conditioning system for facility management.
... Real-time data processing and big data analytics have been attracting much attention recently [9,10]. In particular, the development of the surveillance field has generated a huge of data daily leading to organizations must devise ways of handling this information since the existing techniques did not handle efficiently such a volume of data created at such a high rate. ...
... The research introduced BMS as a platform that is capable of facilitating the process of managing smart buildings. [14]. ...
Conference Paper
Full-text available
Smart building projects (SBP) evolved internationally during early 1980s; this trend of projects evolved in Egypt during the past twenty years. Nowadays, the New Administrative is Capital is considered the 1st smart city in Egypt where thousands of smart building projects (SBP) are being constructed. Lack of frameworks that are capable of managing SBP throughout their life cycle is considered a main problem facing this type of projects in Egypt. The current paper is concerned with analyzing and assessing the available frameworks of SBP and conducting a comparison between them in order to determine the characteristics and pros and cons of each of the frameworks. The objective of the paper has been fulfilled first; through analysis of literature sources; second; through analyzing and assessing the available frameworks of SBP. Finally, a comparative analysis between the available frameworks of SBP has been conducted and pros and cons of each framework have been pointed out.
Article
Full-text available
The construction industry, being responsible for a large share of global carbon emissions, need to reduce its high carbon outputto meet carbon reduction goals. Artificial intelligence can provide eflicient and accurate technical support for carbon emission calculation and prediction. Here, we review the use of artificial intelligence techniques in forecasting, management andreal-time monitoring of carbon emissions, focusing on how they are applied, their impacts, and challenges. Compared totraditional methods, the prediction accuracy of artifcial intelligence models has increased by 20%. Artificial intelligencedriven systems could reduce carbon emissions by up to 15% through real-time monitoring and adaptive management strategies. Artificial intelligence applications improve energy efficiency in buildings by up to 25%, while reducing operationalcosts by up to 10%. Artificial inteligence supports the establishment of a digital carbon management system and contributesto the development of the carbon trading market.
Article
Improving energy efficiency in buildings is a challenge during operation and maintenance. The work proposes a cloud artificial intelligence-based building energy management (cloud AI-BEM) system for predicting building energy consumption. The proposed system includes the data layer, the AI-analytics layer, and the decision support information layer. The data layer collects and stores data in the cloud database management system. The analytics layer performs applied a hybrid AI model which was developed and deployed in this layer that enables predict future energy consumption in buildings. The hybrid AI model, namely the SAMFOR model was developed based on the integration of the seasonal autoregressive integrated moving average (SARIMA) model and the firefly algorithm (FA) and least-squares support vector regression (LSSVR). The web-based layer visualizes insights for users. As insights, the cloud AI-BEM system enables to monitor and to compare the energy consumption among buildings; to predict one-day-ahead energy use in buildings, to produce key performance indicators of energy use; to visualize energy data and outdoor temperature data; to easily interact with data from the system interface. Average accuracy in terms of RMSE values ranged from 1.36 kW per 30 min. The R values were higher than 0.957 and very close to 1.
Article
Full-text available
Property growth, especially in high-rise buildings in developed and developing countries, has experienced a significant increase. The increasingly expensive resources and the development of information technology encourage the growth of smart buildings in almost all countries, especially in developed and developing countries, and become a trend. The Internet of things (IoT) is the main driver in the development of smart buildings. Property businesses are competing to adopt and implement smart buildings on their properties. This is further strengthened by the development of smart cities in almost all cities around the world, one of the criteria is a smart community. The purpose of implementing smart buildings is to make property management effective and efficient. Using the systematic literature review, this paper will discuss what components must be met for a property called a smart building, then what is the role of smart buildings for an area or community, and how the current smart building trend will be in the future.
Chapter
The potential of the use of data to help improve policymaking is increasingly recognized by governments, especially to address societal challenges. One of those societal challenges is the energy transition, which happens for a large part at the local government level. However, within the literature little is known about which type of applications are utilized for data-driven policymaking. From government practice a plethora of data-driven applications are mentioned to be under development or in experimental phase, but not much is known on which applications are actually utilized by policymakers. Therefore, the aim of this exploratory study is to gain insight into how these data-driven applications support policymaking for the local energy transition. To investigate this, we perform a multiple-case study of four municipalities in the Netherlands. Using an analytical framework derived from an literature overview of data-driven applications for the local energy transition, we carry out four case studies of the local energy transition in the Netherlands. We find that they use data-driven applications throughout the whole policy cycle. However, a significant gap exists between data-driven applications to enable and accelerate the energy transition currently implemented, and the desired applications, but also the potential applications found in literature. We recommend future research pertaining to integrated and actionable adoption strategies in order to bridge this gap.KeywordsData-driven policymakingData-driven applicationsEnergy transitionLocal governmentSustainable development goalsPolicy cycleConference trackICT and Sustainable Development Goals
Article
Full-text available
Heating Ventilation and Air Conditioning (HVAC) system energy consumption on average accounts for 40% of an industrial sites total energy consumption. Studies have indicated that 20 – 30% energy savings are achievable by recommissioning Air Handling Units (AHUs) in HVAC systems to rectify faulty operation. Studies have also demonstrated that on-going commissioning of building systems for optimum efficiency can yield savings of an average of over 20% of total energy cost. Automated Fault Detection and Diagnosis (AFDD) is a process concerned with automating the detection of faults and their causes in physical systems. AFDD can be used to assist the commissioning process at multiple stages. This paper outlines the development of an AFDD tool for AHUs using expert rules. It outlines the results of the alpha testing phase of the tool on 18 AHUs across four commercial & industrial sites with over €104,000 annual energy savings detected by the AFDD tool.
Article
Full-text available
We present methods for analyzing commercial and industrial facility 15-minute-interval electric load data. These methods allow building managers to better understand their facility's electricity consumption over time and to compare it to other buildings, helping them to ask the right questions to discover opportunities for demand response, energy efficiency, electricity waste elimination, and peak load management. We primarily focus on demand response. Methods discussed include graphical representations of electric load data, a regression-based electricity load model that uses a time-of-week indicator variable and a piecewise linear and continuous outdoor air temperature dependence, and the definition of various parameters that characterize facility electricity loads and demand response behavior. In the future, these methods could be translated into easy-to-use tools for building managers.
Article
In this paper, a case study of performing a reliable statistical procedure to evaluate the quality of HVAC systems in buildings using data retrieved from an ad hoc big data web energy platform is presented. The proposed methodology based on statistical quality control (SQC) is used to analyze the real state of thermal comfort and energy efficiency of the offices of the company FRIDAMA (Spain) in a reliable way. Non-conformities or alarms, and the actual assignable causes of these out of control states are detected. The capability to meet specification requirements is also analyzed. Tools and packages implemented in the open-source R software are employed to apply the different procedures. First, this study proposes to fit ARIMA time series models to CTQ variables. Then, the application of Shewhart and EWMA control charts to the time series residuals is proposed to control and monitor thermal comfort and energy consumption in buildings. Once thermal comfort and consumption variability are estimated, the implementation of capability indexes for autocorrelated variables is proposed to calculate the degree to which standards specifications are met. According with case study results, the proposed methodology has detected real anomalies in HVAC installation, helping to detect assignable causes and to make appropriate decisions. One of the goals is to perform and describe step by step this statistical procedure in order to be replicated by practitioners in a better way.
Article
This paper presents the main foundations of Big Data applied to Smart Cities. A general Internet of Things based architecture is proposed to be applied to different smart cities applications. We describe two scenarios of big data analysis. One of them illustrates some services implemented in the smart campus of the University of Murcia. The second one is focused on a tram service scenario where thousands of transit-card transactions should be processed. Results obtained from both scenarios show the potential of the applicability of this kind of techniques to provide profitable services of smart cities, such as the management of the energy consumption and comfort in smart buildings, and the detection of travel profiles in smart transport.
Article
Buildings are increasingly equipped with dedicated automation networks, aiming to reduce the energy consumption and to optimize the comfort. On the other hand, we see the arrival of sensors and actuators related to the Internet of Things, which can naturally connect to IP networks. Due to constraints imposed by the obsolescence or physical properties of buildings, it is not uncommon that different technologies have to coexist. These networks operate with different models and protocols, making the development of global automation systems difficult. Traditional models of distributed systems are not adapted to the context of sensor networks. The paradigm of the Web of Things is resource-based and strives to standardize the application layer of different objects using Web technologies, primarily HTTP and REST. In this thesis, we use the Web of Things to create a framework dedicated to smart buildings, allowing developers to develop composite applications without knowledge of the underlying technologies. By relying on Web technologies, we can provide seamless service while reusing the available resources within the network (sensors and actuators), forming a self-managed cloud. In order to equip the buildings with a higher-level intelligence, machine learning, often reserved for experts, is made accessible through Web interfaces hiding the complexity of the process.
Article
Electricity load monitoring of appliances has become an important task considering the recent economic and ecological trends. In this game, machine learning has an important part to play, allowing for energy consumption understanding, critical equipment monitoring and even human activity recognition. This paper provides a survey of current researches on Intrusive Load Monitoring (ILM) techniques. ILM relies on low-end electricity meter devices spread inside the habitations, as opposed to Non-Intrusive Load Monitoring (NILM) that relies on an unique point of measurement, the smart meter. Potential applications and principles of ILMs are presented and compared to NILM. A focus is also given on feature extraction and machine learning algorithms typically used for ILM applications.
Article
Post-occupancy evaluation (POE) is examined within a North American perspective. Benefits from using POE are examined and include: a feedback loop to enhance continuous improvement processes, improved fit between occupants and their buildings, the optimization of services to suit occupants, the reduction of waste of space and energy, validation of occupants' real needs, reduced ownership/operational expenses, improved competitive advantage in the marketplace. The barriers to implementing POE are found to include: fragmented incentives and benefits within the procurement and operation processes, lack of agreed and reliable indicators, potential liability for owners, exclusion from current delivery expectations, exclusion from professional curricula. Recommendations for overcoming these barriers are made at governmental, institutional, corporate and project levels.
Article
The CAP theorem's impact on modern distributed database system design is more limited than is often perceived. Another tradeoff—between consistency and latency —has had a more direct influence on several well-known DDBSs. A proposed new formulation, PACELC, unifies this tradeoff with CAP.
Article
Almost twelve years ago, in 2000, Eric Brewer introduced the idea that there is a fundamental trade-off between consistency, availability, and partition tolerance. This trade-off, which has become known as the CAP Theorem, has been widely discussed ever since. In this paper, we review the CAP Theorem and situate it within the broader context of distributed computing theory. We then discuss the practical implications of the CAP Theorem, and explore some general techniques for coping with the inherent trade-offs that it implies.
On the Adaptation of Building Controls to the Envelope and the Occupants
  • D Daum
Daum, D.. On the Adaptation of Building Controls to the Envelope and the Occupants. Ph.D. thesis; ENAC; Lausanne; 2011. doi:10.5075/epflthesis-4935.