ArticlePDF Available

Real-time forest fire monitoring system using unmanned aerial vehicle

Authors:

Abstract and Figures

The main focus of this research is to develop a real-time forest fire monitoring system using an Unmanned Aerial Vehicle (UAV). The UAV is equipped with sensors, a mini processor (Raspberry Pi) and Ardu Pilot Mega (APM) for the flight controller. This system used five sensors. The first is a temperature sensor that served to measure the temperature in the monitored forest area. The others sensors are embedded in the APM. There are a barometer, Global Positioning Sensor (GPS), inertial measurement unit (IMU) and compass sensor. GPS and compass are used in the navigation system. The barometer measured the air pressure that is used as a reference to maintain the height of the UAV. The IMU consists of accelerometer and gyroscope sensors that are used to estimate the vehicle position. The temperature data from the sensor and the data from GPS are processed by the Raspberry Pi 3, which serves as a mini processor. The results of the data processing are sent to the server to be accessible online and real-time on the website. The data transmission used the Transmission Control Protocol (TCP) system. The experimental setup was carried out in an area of 40 meters × 40 meters with 10 hotspots. The diameter of the hotspots is 0.4 meters with a height of 0.5 meters. The UAV is flown at a constant speed of 5 m/s at an altitude of 20 meters above the ground. The flight path is set by using a mission planner so the UAV can fly autonomously. The experimental results show that the system could detect seven hotspots in the first trial and nine hotspots in the second trial. This happened because there is some data loss in the transmission process. Other results indicate that the coordinates of hotspots detected by the UAV have a deviation error of approximately 1 meter from the actual fire point coordinates. This is still within the standard GPS accuracy as this system uses GPS with a range accuracy of 2.5 meters.
Content may be subject to copyright.
Journal of Engineering Science and Technology
Vol. 13, No. 6 (2018) 1587 - 1594
© School of Engineering, Taylor’s University
1587
REAL-TIME FOREST FIRE MONITORING
SYSTEM USING UNMANNED AERIAL VEHICLE
ENI DWI WARDIHANI*, MAGFUR RAMDHANI, AMIN SUHARJONO,
THOMAS AGUNG SETYAWAN, SIDIQ SYAMSUL HIDAYAT, HELMY,
SARONO WIDODO, EDDY TRIYONO, FIRDANIS SAIFULLAH
Department of Electrical Engineering, Politeknik Negeri Semarang, Jl. Prof. H. Soedharto,
S.H., Tembalang, Semarang, Jawa Tengah, 50275, Indonesia
*Corresponding Author: edwardihani@gmail.com
Abstract
The main focus of this research is to develop a real-time forest fire monitoring
system using an Unmanned Aerial Vehicle (UAV). The UAV is equipped with
sensors, a mini processor (Raspberry Pi) and Ardu Pilot Mega (APM) for the
flight controller. This system used five sensors. The first is a temperature sensor
that served to measure the temperature in the monitored forest area. The others
sensors are embedded in the APM. There are a barometer, Global Positioning
Sensor (GPS), inertial measurement unit (IMU) and compass sensor. GPS and
compass are used in the navigation system. The barometer measured the air
pressure that is used as a reference to maintain the height of the UAV. The IMU
consists of accelerometer and gyroscope sensors that are used to estimate the
vehicle position. The temperature data from the sensor and the data from GPS are
processed by the Raspberry Pi 3, which serves as a mini processor. The results of
the data processing are sent to the server to be accessible online and real-time on
the website. The data transmission used the Transmission Control Protocol (TCP)
system. The experimental setup was carried out in an area of 40 meters × 40
meters with 10 hotspots. The diameter of the hotspots is 0.4 meters with a height
of 0.5 meters. The UAV is flown at a constant speed of 5 m/s at an altitude of 20
meters above the ground. The flight path is set by using a mission planner so the
UAV can fly autonomously. The experimental results show that the system could
detect seven hotspots in the first trial and nine hotspots in the second trial. This
happened because there is some data loss in the transmission process. Other
results indicate that the coordinates of hotspots detected by the UAV have a
deviation error of approximately 1 meter from the actual fire point coordinates.
This is still within the standard GPS accuracy as this system uses GPS with a
range accuracy of 2.5 meters.
Keywords: APM, Hotspots, Raspberry Pi, Real-Time UAV.
1588 E. D. Wardihani et al.
Journal of Engineering Science and Technology June 2018, Vol. 13(6)
1. Introduction
Forests are an important component in maintaining the balance of nature. The
forests cover about a third of Earth's surface and are home to two-thirds of the
world's terrestrial species. Forests are the source of biodiversity on the Earth.
Unfortunately, every year, forest fires destroyed millions of hectares of forests and
hundreds of millions of dollars are spent to extinguish these fires [1]. Although
wildfires help to create new forests, it is difficult to ensure the uncontrolled fires
do not spread to places that threaten the ecological system of the forests and human
life. A forest fire has become a serious natural hazard. Therefore, early prevention
of forest fires is crucial [2].
This issue has been the subject of research for many years. There are a number
of solutions that have been developed to address this problem. One of the ways
used to prevent forest fires is the development of early fire detection systems in the
forest. Massive efforts have been made to monitor, detect, and extinguish the fire
quickly before it gets too large. Traditional fire monitoring and detection methods
use humans to monitor the forests unremittingly. But this method requires a high
cost and is not safe for humans. Recently, remote sensing systems have become
one of the most effective methods of forest monitoring. The development of
electronics, computer science, and digital camera technology have enabled
computer-based remote sensing systems for forest fire monitoring and detection.
Remote sensing approaches for forest fire monitoring and detection can be grouped
into three categories: land-based systems, manned air-based systems, and satellite-
based systems. However, each of these systems presents a variety of technological
issues and practices. Ground measurement equipment has very limited coverage.
Satellite systems are less effective for large numbers of hotspots. Manned air
vehicles are usually large and expensive. In addition, pilot safety is also a part to
be considered [3].
Unmanned aerial vehicles (UAVs) with computer-based remote sensing
systems are an increasingly becoming an attractive and realistic option. Besides
being faster and mobile, UAVs are also relatively cheaper to continuously monitor
and detect forest fires. The integration of UAVs with remote sensing techniques
can also add value to pre-existing methods. In addition, UAVs are able to operate
in hazardous areas that cannot be safely reached by humans. These are the reasons
that have made UAVs one of the solutions that are currently attracting the world's
attention to overcome forest fires [4-9].
In the beginning, the UAV system for forest fire detection was developed by
the United States Forest Services (USFS) Forest Fire Laboratory (Wilson and Davis
1988). Furthermore, the USRP and National Aeronautics and Space Administration
(NASA) developed a project called Wildfire Research and Applications Partnership
(WRAP), which aims to develop underserved forest fire applications [10]. A team
of researchers from the University of Cincinnati supported by the West Virginia
Department of Forestry (WVDF) used a UAV system called UAV Marcus
"Zephyr" to test the system's ability to detect forest fires [11].
This research develops a real-time forest fire monitoring system using a UAV.
The UAV is equipped with sensors, a mini processor and Ardu Pilot Mega (APM)
for the flight controller. Data from both the temperature sensor and GPS are processed
by the Raspberry Pi 3, which serves as a mini processor. The results of the data
Real-Time Forest Fire Monitoring System using Unmanned Aerial Vehicle 1589
Journal of Engineering Science and Technology June 2018, Vol. 13(6)
processing are sent to a server to be accessible online and real-time on the website.
The data transmission used the Transmission Control Protocol (TCP) system.
This paper is organized as follows: Section 1 is introduction while Section II is
system model. Numerical result and discussion are explained in Section III and
lastly, Section IV is the conclusion.
2. System Model
The purpose of this research is to develop a real-time forest fire monitoring system
using an Unmanned Aerial Vehicle (UAV). The configuration of the system can be
seen in Fig. 1. The UAV is equipped with sensors, a mini processor (Raspberry Pi)
and Ardu Pilot Mega (APM) for the flight controller. There are five sensors used
in this system. The first is a temperature sensor that serves to measure the
temperature in the monitored forest area. The temperature sensor uses a Non-
Contact Infra-Red Sensor. The principle of the Non-Contact Infra-Red Sensor is
like a conventional thermal camera, with 2 × 2-pixel resolution and a Field of View
(FOV) of five degrees. The other sensors are embedded in the APM.
There is a barometer, Global Positioning Sensor (GPS), an inertial measurement
unit (IMU) and compass. The GPS and compass are used as the navigation system.
The barometer measures the air pressure that is used as the reference to maintain
the height of the UAV. The IMU consists of accelerometer and gyroscope sensors
that are used to estimate the vehicle’s position. The data from both the temperature
sensor and GPS are processed by the Raspberry Pi 3, which serves as a mini
processor. The communication between the UAV and ground station uses telemetry
data link with a frequency of 433 MHz. The Raspberry Pi 3 sends data to the web
server to be accessible online and real-time on the website. The data transmission
uses the Transmission Control Protocol (TCP) system.
Fig. 1. System configuration.
1590 E. D. Wardihani et al.
Journal of Engineering Science and Technology June 2018, Vol. 13(6)
The forest fire information system website was developed by using CodeIgniter,
Grocery CRUD, PHP: Hypertext Preprocessor (PHP), Cascading Style Sheets
(CSS) [12] and jQuery [13]. The information system on the website shows the
number of hotspots, the coordinates of hotspots and the temperature of hotspots.
The website is integrated with Google Maps so the user can more easily pinpoint
the location of the hotspots. The flowchart of this system can be seen in Fig. 2.
Fig. 2. Flowchart of the system.
3. Numerical Result and Discussion
The experimental setup was carried out in an area of 40 meters × 40 meters with 10
hotspots, as shown in Fig. 3. The diameter of the hotspots is 0.4 meters with a height
of 0.5 meters. The UAV flies at a constant speed of 5 m/s at an altitude of 20 meters
above the ground. The flight path is set by using a mission planner so the UAV can
fly autonomously. The flight paths flown are shown in Fig. 4.
On the first flight, the drone can detect seven from 10 hotspots that have been
created. On the second flight, the drone can detect nine from 10 hotspots. This
Real-Time Forest Fire Monitoring System using Unmanned Aerial Vehicle 1591
Journal of Engineering Science and Technology June 2018, Vol. 13(6)
happens because of the difference of timeout on the first flight and the second flight.
The first flight has a timeout of 0.2 seconds and the second flight uses a timeout of
0.5 seconds. The smaller timeout value means more data is sent to the server.
Unfortunately, more data sent to the server also means more data lost. This is
because of the instability in the data transmission process. Another reason is the
wind speed, which makes the drone shifts slightly from the flight path. This issue
will be tackled in future works.
Figure 5 shows the display of UAV location on the website in real-time. If the
drone detects a temperature that exceeds the threshold in a certain coordinate, then
the display on the website will put a marker in this location.
The temperature data of the sensor is also displayed in the form of a contour
map so that the user can see in detail the temperature at each coordinate. This can
be seen in Fig. 6.
Fig. 3. The experimental setup.
Fig. 4. Flight paths.
1592 E. D. Wardihani et al.
Journal of Engineering Science and Technology June 2018, Vol. 13(6)
(a) Flight 1
(b) Flight 2
Fig. 5. Real-time website visualization.
Fig. 6. Contour map visualization.
(a) Flight 1 (b) Flight 2
Real-Time Forest Fire Monitoring System using Unmanned Aerial Vehicle 1593
Journal of Engineering Science and Technology June 2018, Vol. 13(6)
Figure 7 shows the coordinates of hotspots detected by the UAV. There is a
deviation error of approximately 1 meter from the actual fire point coordinates.
This is still in the range of GPS accuracy because this system uses GPS with a range
accuracy of 2.5 meters.
Fig. 7. Comparison of distance errors for
mapping 1 and 2 to the original coordinates.
4. Conclusion
A real-time forest fire monitoring system using an Unmanned Aerial Vehicle
(UAV) or drone has been developed. The drone can detect ground surface
temperatures from a height of 20 meters above the ground. The drone flies at a
constant speed of 5 m/s. The drone can also send the measured data to a web server
to be displayed on a forest fire information system website. The results also indicate
that the coordinates of hotspots detected by the drone have a deviation error of
approximately 1 meter from the actual fire point coordinates. This is still within the
standard GPS accuracy because this system uses a GPS system with a range
accuracy of 2.5 meters. Among the future works of this research is how to mitigate
data loss during the data transmission from the drone to the web server.
References
1. Martinez-de Dios, J. R; Arrue, B.C; Ollero, A; Merino, L; Gómez-Rodríguez,
F. (2008). Computer vision techniques for forest fire perception. Image and
Vision Computing, 26(4), 550-562.
2. Lin, H.; Liu, Z.; Zhao, T.; and Zhang, Y. (2014). Early warning system of forest
fire detection based on video technology. Proceedings of the 9th International
Symposium on Linear Drives for Industry Applications. Berlin: 751-758.
1594 E. D. Wardihani et al.
Journal of Engineering Science and Technology June 2018, Vol. 13(6)
3. Chisholm, R.A.; Cui, J.; Lum, S.K.; and Chen, B.M. (2013). UAV LiDAR for
below- canopy forest surveys. Journal of Unmanned Vehicle System, 1, 61-68.
4. Ambrosia, V.G.; and Zajkowski, T. (2015). Selection of appropriate class
UAS/sensors to support fire monitoring: experiences in the United States. In
Handbook of unmanned aerial vehicles. Netherlands: Springer.
5. Merino, L.; Martínez-de Dios, J.R.; and Ollero, A. (2015). Cooperative
unmanned aerial systems for fire detection, monitoring, and extinguishing. In
Handbook of unmanned aerial vehicles. Netherlands: Springer.
6. Shahbazi, M.; Théau, J.; and Ménard, P. (2014). Recent applications of
unmanned aerial imagery in natural resource management. GIScience &
Remote Sensing, 51(4), 339-365.
7. Sharifi, F.; Zhang, Y.M.; and Aghdam, A.G. (2014). Forest fire detection and
monitoring using a network of autonomous vehicles. Proceedings of the 10th
International Conference on Intelligent Unmanned Systems (ICIUS 2014),
Quebec, Canada.
8. Bosch, I.; Serrano, A.; and Vergara, L. (2013). Multisensor network system for
wildfire detection using infrared image processing. The Scientific World
Journal, Article ID 402196.
9. Merino, L.; Caballero, F.; Martínez-de-Dios, J.R.; Maza, I.; and Ollero, A.
(2012). An unmanned aircraft system for automatic forest fire monitoring and
measurement. Journal of Intelligent & Robotic Systems, 65(1-4), 533-548.
10. Ambrosia, V.G.; Wegener, S.; Zajkowski, T.; Sullivan, D.V.; Buechel, S.;
Enomoto, F.; Lobitz, B.; Johan, S.; Brass, J.; and Hinkley, E. (2011). The
Ikhana unmanned airborne system (UAS) western states fire imaging missions:
from concept to reality (2006-2010). Geocarto International, 26(2), 85-101.
11. Charvat, R.; Ozburn, R.; Bushong, J.; and Cohen, K. (2012). SIERRA team flight
of Zephyr UAV at West Virginia wild land fire burn. Proceedings of the AIAA
Infotech@Aerospace Conference. California, United States of America, 19-21.
12. Nixon, R. (2014). Learning PHP, MySQL, JavaScript, CSS & HTML5: A
step-by-step guide to creating dynamic websites. United States of America:
O’Reilly Media.
13. Suehring. S; and Valade, J (2013) PHP, MySQL, Javascript & HTML5 all-in-
one for dummies. United States of America: Wiley
... Grid power supply unfitness is reported to an ARC or service groups as a failure (the system switches to backup power) [97,[105][106][107]. Only alarm signals-fire and unfitness-are sent to the SFB via two independent teletransmission channels due to the certainty of the information reaching the recipient [1, [108][109][110]. Correct FAS energy balance calculations mean proper functioning during normal and emergency operation. ...
... This is also elevated by the issue of wireless notifications-the field propagation of electromagnetic fields. Human patrols are characterized by a limited field of view, required shifts due to human organism regeneration and a high percentage of false alarms and involve detection with the use of sight additionally armed with, e.g., binoculars or a camera with an imaging panel [109,110]. Other methods for detecting fires over vast areas include the use of satellite images. ...
... This also includes staff training, and thus, exposing human life to direct danger, particularly during flights at low altitudes and in smoke (imaging accuracy) [108,111]. Approximately 80 pilots have been killed during fire-fighting operations in the USA over the last 20 years [109,110]. In opposition to the traditional systems, when designing modern solutions, engineers turn to autonomous drones. ...
Article
Full-text available
The article reviews issues associated with the operation of stationary and non-stationary electronic fire alarm systems (FASs). These systems are employed for the fire protection of selected buildings (stationary) or to monitor vast areas, e.g., forests, airports, logistics hubs, etc. (non-stationary). An FAS is operated under various environmental conditions, indoor and outdoor, favourable or unfavourable to the operation process. Therefore, an FAS has to exhibit a reliable structure in terms of power supply and operation. To this end, the paper discusses a representative FAS monitoring a facility and presents basic tactical and technical assumptions for a non-stationary system. The authors reviewed fire detection methods in terms of fire characteristic values (FCVs) impacting detector sensors. Another part of the article focuses on false alarm causes. Assumptions behind the use of unmanned aerial vehicles (UAVs) with visible-range cameras (e.g., Aviotec) and thermal imaging were presented for non-stationary FASs. The FAS operation process model was defined and a computer simulation related to its operation was conducted. Analysing the FAS operation process in the form of models and graphs, and the conducted computer simulation enabled conclusions to be drawn. They may be applied for the design, ongoing maintenance and operation of an FAS. As part of the paper, the authors conducted a reliability analysis of a selected FAS based on the original performance tests of an actual system in operation. They formulated basic technical and tactical requirements applicable to stationary and mobile FASs detecting the so-called vast fires.
... The UAV's task involves tracking the perimeter of a wildfire and subsequently dropping extinguishing balls on the fire. Additionally, a mission planner is developed in [11] to enable a UAV to autonomously monitor the propagation of a wildfire. Previous research on wildfire monitoring and extinguishing using UAVs has shown promising results. ...
... • Unlike previous wildfire monitoring strategies in [9][10][11] that rely on asymptotic convergence-based control schemes for quadcopter UAVs, this article proposes a finite-time control scheme for a quadcopter UAV tasked with wildfire monitoring amidst external disturbances and parameter uncertainties. • In contrast with the previous research presented in [17][18][19][20] that utilize adaptive techniques to estimate the upper limits of external disturbances and uncertainties affecting quadcopter UAVs, assuming the availability of all system states, this article adopts a Higher-Order Sliding Mode Observer (HOSMO) to estimate external perturbations, parameter uncertainties, and unknown system states in both the position and attitude dynamics of the quadcopter UAV. ...
Article
Full-text available
This article investigates the problem of monitoring wildfires using a quadcopter uncrewed aerial vehicle (UAV) subject to external perturbations and nonlinear uncertainties. A finite‐time control scheme is designed for the quadcopter UAV to monitor the elliptical propagation of a wildfire. The control scheme is composed of an improved nonsingular fast terminal sliding mode control (NFTSMC) and a higher order sliding mode observer (HOSMO). The HOSMO is constructed first to estimate external perturbations, nonlinear uncertainties, and incomplete system states resulting from the system's uncertainties. Then, a novel NFTSMC is developed that utilizes the estimated system states. The Lyapunov theorem is used to demonstrate that the quadcopter UAV can elliptically monitor a wildfire, and the tracking error can rapidly converge to zero within a finite time. Comparative simulation results are presented to illustrate the effectiveness of the proposed control scheme.
... In terms of aerial firefighting, research mainly focuses on UAV fire field detection [24][25][26][27][28]. For the fire extinguishing agent delivering procedure, the simulation of aircraft water delivery and danger zone avoidance was carried out based on a simplified fixed-wing aircraft kinematics model and a simplified physical model of forest fire spread, tracking burning embers using the particle method [29,30]. ...
Article
Full-text available
Forest fires can develop rapidly and may cause a wide range of hazards. Therefore, aerial firefighting, which has the ability to respond and reach fire fields quickly, is of great significance to the emergency response to and subsequent extinguishing of forest fires. The burning of forest fires generates a lot of heat and smoke, which changes the air flow environment and vision over the region and brings challenges to aerial firefighting. In the present work, aerial forest firefighting simulation was divided into the forest fire spread model, the air flow model and the aircraft flight dynamic and automatic control model. Each model was constructed based on a physical method. An integrated framework was designed to realize the interaction among fire fields, airfields, and aircraft, and is verified. The proposed framework can be used for the emergency response decision of aerial forest fire fighting and subsequent fire-fighting mission planning.
Article
Unmanned aerial vehicle (UAV) thermal infrared (TIR) remote sensing is playing an increasingly important role in diverse applications such as agriculture, forestry, hydrology, and ecological monitoring. Moreover, UAV-based remote sensing significantly contributes to the understanding of fundamental remote sensing science issues, such as scale variation and its impacts on multi-source data collaboration. To cover extensive areas, UAVs often need to fly multiple strips to ensure complete coverage, leading to significant intervals between the start and end of missions. This can cause notable changes in brightness temperature (BT) due to the different observation times, introducing considerable uncertainty into the final BT mosaic, which, in turn, directly impacts subsequent applications, such as the calculation of land surface temperature (LST) and other temperature-related analyses. This study presents a Temporal Effect Removal from LST (TERL) method to effectively correct for differences due to observation time and thereby enhance the temporal consistency of BT data. The core of TERL involves three key processes: (1) modeling the temporal information of TIR mosaic pixels, (2) deriving the temporal dynamics related to specific surface features by classifying image sequences, and (3) capturing the temporal variation of BT differences and temperature compensation. Validation results indicate that TERL significantly improves both the temporal comparability of pixels and the consistency between UAV temperature data and ground observations. Specifically, the root mean square error (RMSE) of the corrected data is 22.50% to 77.14% smaller than that of the uncorrected data, with an impressive average reduction of 51.09%. Compared to the Digital number probability density function fitting and RAdiative Transfer simulation-based (DRAT) method, which primarily addresses temperature drift, TERL achieves an average RMSE reduction of 29.65%, showcasing its better performance. Moreover, the corrected data better reflects the temperature variation trends of surface features and shows strong correlations with ground observation data, with most correlation coefficients exceeding 0.5. Thus, TERL facilitates more accurate comparisons and analyses of UAV TIR data, ultimately enhancing not only the reliability and effectiveness of quantitative remote sensing research with UAVs but also advancing the understanding of fundamental issues like scale variation in remote sensing science.
Article
Forest fires are a worldwide issue that can cause major harm to forests, wildlife, vegetation, and local residents. Wildfires can also have long-term environmental consequences, such as soil deterioration, lower air quality, and the production of greenhouse gases. Forest fire prevention and control are serious challenges in many regions of the world, and fire detection and suppression techniques are continually evolving. There are several wildfire detection techniques available, some of the most commonly used techniques are watchtowers, satellites, wireless sensor networks (WSN), cameras, and drone systems. With these techniques, emergency services can detect forest fires faster and respond more quickly to limit damage. This paper will compile a list of all the techniques used to detect forest fires. To gain a clearer understanding, the paper addresses the benefits and drawbacks of each technique and discusses examples of research experiment findings. Finally, a comprehensive table is provided to summarize a comparison of different methodologies in order to contribute to future research endeavors aimed at developing early fire detection systems. This research takes an in-depth look at what is currently being done to monitor and detect wildfires. After examining the achievements and limitations of present methods of forest fire surveillance and detection, we finish by providing many possible research directions for the future.
Article
The cross-modal drone image-text (DIT) retrieval task involves using either text or drone images as queries to retrieve relevant drone images or corresponding text. The primary challenge stems from the diverse and intricate nature of drone images, making effective alignment between image and text challenging. In response, we propose an innovative approach called Visual Contextual Semantic Reasoning (VCSR), aimed at precisely aligning information across different modalities. VCSR employs textual cues to guide rich semantic reasoning within the visual context, reducing redundancy in visual information. Furthermore, the method captures drone image information relevant to the text, revealing subtle correspondences between drone image regions and textual content. To enhance visual semantic learning, context region learning term and consistency semantic alignment term are introduced for stronger guidance, further intensifying the cross-modal interaction between textual and visual data, resulting in more robust feature representation. Extensive experiments conducted on two self-constructed DIT datasets demonstrate that VCSR outperforms alternative methods in terms of DIT retrieval performance. The codes are accessible at https://github.com/huangjh98/VCSR.
Conference Paper
Full-text available
This paper discusses the Systems Engineering plan of the Surveillance for Intelligent Emergency Response Robotic Aircraft (SIERRA) Team of The University of Cincinnati in supporting continued development of technology for Emergency Management Operations. This paper represents the experimental and post flight analysis of the SIERRA program during the late 2011 time frame in which the team flew 2 successful demonstrations in West Virginia. This paper is the conclusion of “Intelligent Integration of UAV Systems for WildlandFire Management: Towards Concept Demonstration” from AIAA Infotech 2011.
Article
Full-text available
Unmanned aerial vehicles have become popular platforms for remote-sensing applications, particularly when spaceborne technology, manned airborne techniques, and in situ methods are not as efficient for various reasons. These reasons include the temporal and spatial data resolutions, accessibility over time and space, cost efficiency, and operational safety. Given that most commercial developers tend to focus on the hardware development of unmanned aerial systems, less attention is paid to the development and evaluation of their data processing techniques. Therefore, critical reviews of previous studies are required to describe the current state of research using data from unmanned remote sensing platforms. Accordingly, this article presents the results of a comprehensive review of applications of unmanned aerial imagery for the management of agricultural and natural resources. This review attempts to demonstrate that developing robust methodologies and reliable assessments of results are significant issues for successful applications of unmanned aerial imagery.
Article
Full-text available
This paper presents the next step in the evolution of multi-sensor wireless network systems in the early automatic detection of forest fires. This network allows remote monitoring of each of the locations as well as communication between each of the sensors and with the control stations. The result is an increased coverage area, with quicker and safer responses. To determine the presence of a forest wildfire, the system employs decision fusion in thermal imaging, which can exploit various expected characteristics of a real fire, including short-term persistence and long-term increases over time. Results from testing in the laboratory and in a real environment are presented to authenticate and verify the accuracy of the operation of the proposed system. The system performance is gauged by the number of alarms and the time to the first alarm (corresponding to a real fire), for different probability of false alarm (PFA). The necessity of including decision fusion is thereby demonstrated.
Article
Full-text available
The paper presents an Unmanned Aircraft System (UAS), consisting of several aerial vehicles and a central station, for forest fire monitoring. Fire monitoring is defined as the computation in real-time of the evolution of the fire front shape and potentially other parameters related to the fire propagation, and is very important for forest fire fighting. The paper shows how an UAS can automatically obtain this information by means of on-board infrared or visual cameras. Moreover, it is shown how multiple aerial vehicles can collaborate in this application, allowing to cover bigger areas or to obtain complementary views of a fire. The paper presents results obtained in experiments considering actual controlled forest fires in quasi-operational conditions, involving a fleet of three vehicles, two autonomous helicopters and one blimp.
Chapter
This chapter deals with the application of cooperative unmanned aerial systems to forest fires. Fire detection and fire monitoring and measurement to assist in fire extinguishing are discussed. The chapter presents a decision and control architecture for multi-UAS teams in forest firefighting. Then, the applications to fire detection and fire monitoring/measurement are studied by including in both cases the sensors, mainly infrared and visual cameras, the perception techniques (fire segmentation, geolocalization, and data fusion), and some experimental results. Finally the fire extinguishing is also considered, and some results are presented.
Chapter
As government agencies around the globe strive to improve their disaster monitoring capabilities and speed response and recovery efforts, requirements for more accurate and safer data collection mean that Unmanned Aerial System (UAS) are being examined more closely for their potential roles in safely gathering data over those events. Wildfires are consistently one of the most common worldwide “disaster” events, and therefore the wildfire management community is experiencing a surge in UAS interest to support intelligence gathering and pertinent data delivery over those fire incidents. There are numerous, often confusing differences amongst UAS platforms and their sensors. Coupled with the various mission roles required by observation platforms in the wildfire domain, the UAS landscape can be a daunting place for a wildfire manager (or any disaster manager) to select the appropriate UAS solution capability that matches his/her requirements. This chapter describes some of the UAS lessons learned by both the U.S.. Forest Service (USFS) and the National Aeronautics and Space Administration (NASA) during their C10-year efforts on identifying appropriate UAS wildfire observation capabilities. The agencies, along with the UAS community, have demonstrated the use of both Low-Altitude, Short-Endurance (LASE) and Medium-Altitude, Long-Endurance (MALE) platforms for wildfire sensor intelligence gathering. Those experiences are identified in this chapter as well as an examination of the future direction of UAS systems for supporting the wildfire management community.
Article
Remote sensing tools are increasingly being used to survey forest structure. Most current methods rely on GPS signals, which are available in above-canopy surveys or in below-canopy surveys of open forests, but may be absent in below-canopy environments of dense forests. We trialled a technology that facilitates mobile surveys in GPS-denied below-canopy forest environments. The platform consists of a battery-powered UAV mounted with a LiDAR. It lacks a GPS or any other localisation device. The vehicle is capable of an 8 min flight duration and autonomous operation but was remotely piloted in the present study. We flew the UAV around a 20 m × 20 m patch of roadside trees and developed postprocessing software to estimate the diameter-at-breast-height (DBH) of 12 trees that were detected by the LiDAR. The method detected 73% of trees greater than 200 mm DBH within 3 m of the flight path. Smaller and more distant trees could not be detected reliably. The UAV-based DBH estimates of detected trees were positively correlated with the human-based estimates (R ² = 0.45, p = 0.017) with a median absolute error of 18.1%, a root-mean-square error of 25.1% and a bias of −1.2%. We summarise the main current limitations of this technology and outline potential solutions. The greatest gains in precision could be achieved through use of a localisation device. The long-term factor limiting the deployment of below-canopy UAV surveys is likely to be battery technology.
Article
Between 2006 and 2010, National Aeronautics and Space Administration (NASA) and the US Forest Service flew 14 unmanned airborne system (UAS) sensor missions, over 57 fires in the western US. The missions demonstrated the capabilities of a UAS platform (NASA Ikhana UAS), a multispectral sensor (autonomous modular sensor (AMS)), onboard processing and data visualization (Wildfire Collaborative Decision Environment (W-CDE)), to provide fire intelligence to management teams. Autonomous, on-board processing of the AMS sensor data allowed real-time fire product delivery to incident management teams on the wildfire events. The fire products included geo-rectified, colour-composite quick-look imagery, fire detection shape files, post-fire real-time normalized burn ratio imagery and burn area emergency response (BAER) imagery. The W-CDE was developed to allow the ingestion and visualization of AMS data and other pertinent fire-related information layers. This article highlights the technologies developed and employed, the UAS wildfire imaging missions performed and the outcomes and findings of the multi-year efforts.
Article
This paper presents computer vision techniques for forest fire perception involving measurement of forest fire properties (fire front, flame height, flame inclination angle, fire base width) required for the implementation of advanced forest fire-fighting strategies. The system computes a 3D perception model of the fire and could also be used for visualizing the fire evolution in remote computer systems. The presented system integrates the processing of images from visual and infrared cameras. It applies sensor fusion techniques involving also telemetry sensors, and GPS. The paper also includes some results of forest fire experiments.