ArticlePDF Available

A Large-Scale Emulation System for Realistic Three-Dimensional (3-D) Forest Simulation

Authors:

Abstract and Figures

The realistic reconstruction and radiometric simulation of a large-scale three-dimensional (3-D) forest scene have potential applications in remote sensing. Although many 3-D radiative transfer models concerning forest canopy have been developed, they mainly focused on homogeneous or relatively small heterogeneous scenes, which are not compatible with the coarse-resolution remote sensing observations. Due to the huge complexity of forests and the inefficiency of collecting precise 3-D data of large areas, realistic simulation over large-scale forest area remains challenging, especially in regions of complex terrain. In this study, a large-scale emulation system for realistic 3-D forest Simulation is proposed. The 3-D forest scene is constructed from a representative single tree database (SDB) and airborne laser scanning (ALS) data. ALS data are used to extract tree height, crown diameter and position, which are linked to the individual trees in SDB. To simulate the radiometric properties of the reconstructed scene, a radiative transfer model based on a parallelized ray-tracing code was developed. This model has been validated with an abstract and an actual 3-D scene from the radiation transfer model intercomparison website and it showed comparable results with other models. Finally, a 1 km ×\times 1 km scene with more than 100 000 realistic individual trees was reconstructed and a Landsat-like reflectance image was simulated, which kept the same spatial pattern as the actual Landsat 8 image.
Content may be subject to copyright.
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING 1
A Large-Scale Emulation System for Realistic
Three-Dimensional (3-D) Forest Simulation
Jianbo Qi, Donghui Xie, Dashuai Guo, and Guangjian Yan
Abstract—The realistic reconstruction and radiometric simula-
tion of a large-scale three-dimensional (3-D) forest scene have po-
tential applications in remote sensing. Although many 3-D radia-
tive transfer models concerning forest canopy have been developed,
they mainly focused on homogeneous or relatively small heteroge-
neous scenes, which are not compatible with the coarse-resolution
remote sensing observations. Due to the huge complexity of forests
and the inefficiency of collecting precise 3-D data of large areas, re-
alistic simulation over large-scale forest area remains challenging,
especially in regions of complex terrain. In this study, a large-scale
emulation system for realistic 3-D forest Simulation is proposed.
The 3-D forest scene is constructed from a representative single tree
database (SDB) and airborne laser scanning (ALS) data. ALS data
are used to extract tree height, crown diameter and position, which
are linked to the individual trees in SDB. To simulate the radio-
metric properties of the reconstructed scene, a radiative transfer
model based on a parallelized ray-tracing code was developed. This
model has been validated with an abstract and an actual 3-D scene
from the radiation transfer model intercomparison website and it
showed comparable results with other models. Finally, a 1 km ×
1 km scene with more than 100 000 realistic individual trees was
reconstructed and a Landsat-like reflectance image was simulated,
which kept the same spatial pattern as the actual Landsat 8 image.
Index Terms—Airborne laser scanning (ALS), three-dimen-
sional (3-D) forest reconstruction, 3-D simulation, forest.
I. INTRODUCTION
FORESTS cover approximately 31%of the land surface
across the globe and play a prominent role in the global car-
bon cycle [1]. Forests are highly complex and dynamic ecosys-
tems that comprise various species and a large number of in-
dividual trees. They are important and also widely managed
for biodiversity protection, wildlife habitat conservation, forest
products, and recreation [2]. Modeling the forest [3], [4] is an es-
sential step to assist management decisions [5]. However, most
of these models, such as the whole-stand model [6], rely on ab-
stract, conceptual, and two-dimensional (2-D) representations
of the forest canopy, which are rarely presented in a coherent
Manuscript received November 20, 2016; revised March 5, 2017 and May
2, 2017; accepted June 2, 2017. This work was supported by the National
Natural Science Foundation of China programs under Grant 41331171 and
Grant 41571341 and the National Basic Research Program of China under
Grant 2013CB733402. (Corresponding author: Donghui Xie.)
The authors are with the College of Remote Science and Engineering, Faculty
of Geographical Science, Beijing Normal University, Beijing 100875, China
(e-mail: qijb@mail.bnu.edu.cn; xiedonghui@bnu.edu.cn; 1130219602@qq.
com; gjyan@bnu.edu.cn).
Color versions of one or more of the figures in this paper are available online
at http://ieeexplore.ieee.org.
Digital Object Identifier 10.1109/JSTARS.2017.2714423
and stimulating manner, and also complicate the translation of
this information into landscape images [7]. Consequently, new
powerful tools, such as precise 3-D landscape and forest models,
are required to model precise landscapes and environments [8].
In the remote sensing community, various methods have been
developed to extract forest parameters from remotely sensed
data [9]. However, most of these methods based on direct field
measurements are not completely and comprehensively vali-
dated due to the complexity of forest canopies and inhomo-
geneity of land surfaces [10], [11]. Thus, simulated datasets
resulting from radiative transfer models are widely used to vali-
date and analyze retrieval methods, and this simulation enables
us to precisely control the composition and spatial arrange-
ment of stand structures. It can help to understand the physical
process of interactions between the incoming solar radiation
and plants within the canopy, and it is also used to study
the radiative properties (scattering, absorption, and emission,
etc.) of specific land cover types [12] or to develop parametric
models [13].
To fully describe the scattering of radiation by vegetation
canopies, a number of 3-D radiative transfer models have been
developed [14], such as DART [15], [16] (discrete-ordinate ray
tracing), FLIGHT [17] (Monte Carlo ray tracing), and RGM
[18] (radiosity). All of them have been successfully applied to
the study of canopy properties. In [11], the DART model was
parameterized using airborne laser scanning (ALS) data and in
situ measurements to simulate the at-sensor spectral radiances,
and the results were compared with measurements of Airborne
Prism Experiment (APEX) [19]. In [20], a radiosity model, Ra-
diosity Applicable to Porous IndiviDual objects (RAPID), was
introduced for 3-D radiative transfer simulation over large-scale
heterogeneous areas. This method parameterized the single tree
crown into porous individual objects to achieve a better balance
between computing efficiency and accuracy. In order to obtain
the explicitly described 3-D structures of forest canopy, which
are the input for most 3-D models, individual tree architecture
(from leaf to crown), tree position, and tree species in a forest
area need to be predetermined.
A persistent and significant challenge in 3-D models is always
about precisely reconstructing the complex forest, which usually
contains plenty of trees, and each individual tree is constructed
with millions of leaves and branches. Thus, it is impractical to
directly reconstruct the structures of all the trees and branches.
Fortunately, a number of site- and species-specific allometric
equations which connect biomass and leaf area (LA) to diame-
ter at breast height (DBH) or tree height have been established
1939-1404 © 2017 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.
See http://www.ieee.org/publications standards/publications/rights/index.html for more information.
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.
2 IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING
[21], [22]. These equations enable us to populate the leaf area
index (LAI) measured at plot scale to each individual tree with
the aid of field-inventory data (DBH, crown diameter and tree
height). With these parameters available, we can generate a se-
ries of individual tree models that have different DBHs by some
well-developed tree modeling packages [23]–[25]. For the tree
positions, they can be manually measured using a global po-
sition system (GPS). However, it is labor-intensive and time
consuming, notably impossible in large and dangerous areas.
Recently, airborne laser scanning (ALS) has been widely used
to study the structure of forests [26], [27]. It provides a promis-
ing alternative to acquire large-scale 3-D structure and spatial
distribution data of individual trees in a relatively short time.
In this paper, we presented a so-called large-scale emulation
system (LESS) for realistic 3-D forest simulation which can
rapidly generate virtual forest with explicitly described individ-
ual tree models. In addition, a radiative transfer model based on a
parallelized ray-tracing code was developed and validated. This
system can simulate visible images, multispectral images, and
bidirectional reflectance factor (BRF) for different research pur-
poses. The entire simulation process is mostly automatic with
only a few parameters to be set by the user, and this significantly
speeds up the emulation process.
II. MATERIAL
A. Study Area
The study area is located in the Genhe Forestry Reserve
(Genhe) (12012to 12255E, 5020to 5230N), Greater
Khingan of Inner Mongolia, Northeastern China. It has a hilly
terrain with 75%forest cover, which is mainly composed of
Dahurian Larch (Larix gmelinii) and White Birch (Betula platy-
phylla Suk.). Nine forest plots (labeled as L1 L9) with the
area of 45 m ×45 m were established with their locations shown
in Fig. 1.
The leaf area index (LAI) of each plot was measured with a
TRAC (Tracing Radiation and Architecture of Canopies) instru-
ment (Third Wave Engineering, ON, Canada) in August 2013.
For each plot, the positions of four corners were measured by
a differential global positioning system (DGPS) device. Each
plot was divided into 3 ×3 subplots. In these subplots, the tree
height, tree position, crown diameter, and DBH were manually
measured. The position of each individual tree was obtained by
measuring the relative distances to the plot corners. Field data
are shown in Table I.
B. Spectral Data
The spectral reflectance and transmittance of white birch
leaves were measured by a field spectroradiometer (ASD Field-
Spec 3, Analytical Spectral Devices, USA) equipped with an in-
tegrating sphere in August 2013. Some of the white birch leaves
became yellow, so both green and yellow leaves were selected
for our measurements. The barks of white birch and larch were
also collected and their reflectance spectra were obtained. The
reflectance and transmittance spectra of needles were simulated
by LIBERTY [28] and the parameters used in LIBERTY were
Fig. 1. Locations of forest plots and the DEM of the Genhe Forestry Reserve.
TAB L E I
PLOTS IN THE STUDY AREA
Plot Birch
(number)
Larch
(number)
Mean height
(m)
Mean DBH
(cm)
LAI
L1 131 220 8.4 9.9 2.52
L2 111 467 9.1 8.8 3.06
L3 11 71 7.9 7.7 2.57
L4 294 79 11.7 11.5 4.51
L5 1 327 12.7 12.9 2.96
L6 0 173 17.3 22.3 2.3
L7 18 112 10.2 13.1 1.49
L8 63 118 13.3 15.6 2.44
L9 1 585 8.4 8.7 3.16
Fig. 2. Optical properties of the larch, soil background (left) and white birch
(right).
adopted from [29], which were retrieved based on the measured
reflectance of larch needles in the Great Xingan Mountain,
Inner Mongolia, very near to our study area. All the spectral
data were resampled from 400 to 1000 nm with a step of 1 nm
(see Fig. 2).
The canopy background (the underlying soil) reflectance was
obtained by comparing the measurements of the ground with
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.
QI et al.: LARGE-SCALE EMULATION SYSTEM FOR REALISTIC THREE-DIMENSIONAL (3-D) FOREST SIMULATION 3
Fig. 3. Overview of the simulation system.
measurements of an ideal and diffuse standard surface in the
same observation geometry with an ASD FieldSpec instrument.
To obtain representative spectra of the ground, we averaged
50 ASD measurements that were uniformly distributed in the
plot. The type of ground was bare earth.
C. ALS and CCD Data
Data acquisition flights with an onboard LIDAR (Leica
ALS60, Leica Geosystem AG, Heerbrugg, Switzerland) and
a charge-coupled device (CCD-Leica RCD105, Leica Geosys-
tem AG, Heerbrugg, Switzerland) were performed from Au-
gust to September 2012 above the Genhe study Area, covering
approximately 230 km2. The flight height was about 1.8 km
above ground level. This measurement used a rotation scanning
system with an angle range of ±30. The wavelength of the air-
borne laser sensor was 1064 nm, and the laser beam divergence
was 0.3 mrad. The vertical accuracy of the acquired ALS data
was within 0.15 m. This LIDAR+CCD mission acquired point
cloud data with an average density of 8.0 points/m2and CCD
image with 0.5 m spatial resolution.
III. METHOD
The proposed system (LESS) mainly consists of four main
modules (see Fig. 3):
1) individual tree generation;
2) individual tree detection;
3) virtual forest scene generation;
4) and radiative transfer simulation.
A. 3-D Scene Reconstruction
1) Individual Tree Generation: It is usually difficult to pre-
cisely reconstruct each individual tree in a forest, especially for
larch, which has very small needle-like leaves. In this study, 3-D
structures of individual tree were generated from the OnyxTREE
software (www.onyxtree.com). This software can generate re-
alistic 3-D trees from a variety of parameters which define the
Fig. 4. Generated trees: (a) white birch tree; (b) larch tree.
architectures of the tree. Since DBH is an important parame-
ter which is usually related to other parameters, 20 birch and
20 larch trees with different DBHs were generated. To match
them to the real trees in this study area, the tree height, tree
crown diameter, and under branch height were obtained from
field measurements. Among all the parameters, the LA of an
individual tree was the most difficult parameter to be retrieved.
To get the LA, we used allometric-based method to populate the
plot LAI to individual tree LA as presented in [30]. For com-
pleteness, we summarized the main idea of this method here.
The relationship between DBH and LA can be expressed as:
LA =aDBHb(1)
where aand bare parameters which need to be determined for
different species. For a forest plot, the LA of the whole plot is
the sum of all the individual trees. Thus,
Splot ·LAI =
N
i
LAi=a
N
i
DBHib(2)
where Splot is the area of the plot. LAiis the LA of individual
tree. Nis total number of trees in the plot. Using plot L5 and
L9, aand bof white birch were estimated as 0.746 and 1.235,
respectively. The parameters of larch were a=0.06 and b=2.36
(using plot L1 and L4). It should be noted that L1 and L4
were mixed plots with white birches and larches, the LA of
white birches in these plots were calculated by the relationship
established by L5 and L9. Some representatives of the generated
trees for the SDB are shown in Fig. 4.
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.
4 IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING
Fig. 5. Generated 3-D forest, which is a part of a 1 km ×1 km forest scene
with more than 100 000 instanced trees from SDB.
2) Individual Tree Detection: Individual trees were ex-
tracted from the canopy height model (CHM) by a watershed
algorithm, which was also presented in [30]. The CHM used in
this study was obtained by subtracting a digital elevation model
(DEM) from a digital surface model (DSM). The DSM was
directly derived from ALS first returns, while the DEM was ex-
tracted by using an easy-to-use airborne lidar filtering algorithm
[31], which was based on cloth simulation. The final resolution
of the CHM map was 0.5 m. As no multispectral data were
collected in this area, the CCD image was used to distinguish
tree species. This image was obtained in September 2012 when
the leaves of white birch became slightly yellow while larch re-
mained green. We used a statistical histogram of CIELAB color
to separate birch from larch [30].
3) 3-D Forest Generation: 3-D forest scene of this study
area was generated by choosing a proper individual tree model
from SDB, and placing it on the DEM map according to the
detected parameters of individual trees from the CHM. Thus,
a similarity factor (SF) was defined to describe the selection
criteria:
SF =w|HdHm|
Hm
+(1w)|CdCm|
Cm
(3)
where Hd(Cd) is the tree height (crown diameter) of a de-
tected tree from CHM map. Hm(Cm) is the tree height (crown
diameter) of a model from SDB, wis a weight parameter that
lies between [0,1]. By default, it is set to 0.5. To generate forest,
the model with the smallest SF is selected. As the number of
individual trees in SDB is limited, a tree model may be used
multiple times. Thus, an ”instance” mechanism is adopted. If
a tree model has already been selected before the current se-
lection, an instance or reference of that model is created. This
mechanism can reduce the memory usage, especially when there
are millions of individual trees. Fig. 5 shows a generated 3-D
virtual forest, which contains more than 100 000 trees.
Fig. 6. Path tracing algorithm.
B. Reflectance Image Simulation
1) Simulation Fundamentals: The simulation system in this
study uses physically based ray-tracing as the basis to calculate
the radiances at the top of canopy (TOC). Rays are traced from
the virtual sensor into the virtual scene, and the intersections
between rays and objects in the scene are tested. The rays are
defined to be launched in parallel within a field of view (ortho-
graphic projection) that covers the whole scene. At each inter-
section point, the bidirectional reflectance distribution function
(BRDF) is used to determine the incoming direction of the ray
that is reflected toward the sensor. By this way, the contributions
and attenuations along the tracing path are summed to calculate
the radiance that light sources scatter into the sensor. For an
arbitrary point pin the scene, the reflected outgoing radiance
along direction ωocan be expressed as [32],
Lo(p, ωo)=2π
fr(p, ωi
o)Li(p, ωi)|cos θi|i(4)
where Lo(p, ωo)is the outgoing radiance along direction ωoat
point p,fr(p, ωi
o)is BRDF, Li(p, ωi)is the incident radiance
from direction ωi, it includes both direct illumination as well
as indirect illumination (i.e., multiple scattering). Usually, ωiis
considered as a differential solid angle. θiis the angle between
the incident radiance direction ωiand surface normal at point
p. The integration is applied to the upper hemisphere space at
point p. If transmittance exists, fr(p, ωi
o)is simply replaced
by a bidirectional transmittance distribution function (BTDF)
ft(p, ωi
o), then the incident direction ωiand ωowill be in the
different hemispheres. For convenience, BRDF and BTDF can
be combined together as f(p, ωi
o), which is called bidirec-
tional scattering distribution function (BSDF). Then, the equa-
tion which considers both reflectance and transmittance will be
(5), the integration is now applied to the 4πspace at point p.
Lo(p, ωo)=4π
f(p, ωi
o)Li(p, ωi)|cosθi|i.(5)
This equation is solved by a path tracing algorithm [32],
which is illustrated in Fig. 6. Assuming a ray is traced from the
sensor and the first intersection point is p. At point p, the direct
irradiance from the sun is evaluated, then an outgoing radiance
can be calculated with the BSDF of point p, this is called first
scattering. To calculate outgoing radiance induced by multiple
scattering, a new ray originated at pis traced, the direction is
determined by the BSDF of point p. If this new ray intersects
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.
QI et al.: LARGE-SCALE EMULATION SYSTEM FOR REALISTIC THREE-DIMENSIONAL (3-D) FOREST SIMULATION 5
with the scene (e.g., leaves and branches) at point p1, we execute
the same operation as at point p(evaluate sun radiation and
multiple scattering), the outgoing radiation of p1is the incident
radiation of p. This process is recursively performed until it
reaches the maximum scattering order specified by the user or
when the contribution of multiple scattering is below a small
threshold. Through this way, a path between sun and sensor can
be found, which determines the amount of radiation scattered
from sun to sensor. For each pixel, many sensor rays are traced
to get an average value. It should be noted that although the
image is simulated pixel by pixel, the neighbor objects are still
considered, because the rays are allowed to traverse through the
whole scene. To implement this simulation system, a ray tracer,
named Mitsuba [33], was modified to calculate the TOC spectral
radiances.
Compared to forward tracking methods (tracing rays from sun
to sensor), this backward tracking method has a few advantages
when simulating at-sensor images: 1) it only needs to calculate
the radiation which exactly goes to the sensor, avoiding a lot of
useless computations for radiation which goes out of the scene;
2) The number of rays of each pixel is configurable, which
means that a low value (e.g., rays =2) can make the simulation
very fast with a relatively low quality. However, this mechanism
makes it possible to have a quick preview of the result to check
the correctness of parameter configurations, especially when
simulating large areas. In addition, the proposed system can
run on high-performance computing clusters with hundreds of
processing cores. This scalability also enables LESS to simulate
much larger scenes (e.g., >5km).
2) Model Intercomparison: Before applying this system to
realistic forest simulation, we first tested it with some exist-
ing models from RAMI [34], which proposes a mechanism
to benchmark various radiative transfer models by using some
well-controlled experimental conditions. A homogeneous ab-
stract canopy with two layers (HOM28 in RAMI-IV) and a
heterogeneous actual canopy (HET07_JPS_SUM in RAMI-IV)
were chosen as the testing scenes. The detailed optical and struc-
tural properties can be found at [35].
The leaf shape is defined as a disk in HOM28, we converted
it into a rectangle with the same LA, and each leaf was then
represented by two triangles only. For HET07_JPS_SUM, the
needle shape of J¨
arvselja Scots Pine is described by a scaled
sphere. In our simulation, this scaled sphere is represented as
a hexagonal prism, which keeps the same total area and needle
length with RAMI definitions. LESS treats leaves and breaches
as facet, which do not have thickness, so it is impossible to
input transmittance of needle directly, because needles are usu-
ally like cylinders. To maximumly imitate the behavior of needle
transmittance, we set outside reflectance of facets (ρout) equal to
ρneedle, which is given by RAMI (see Fig. 7). For transmittance,
both sides of the facet are set to τneedle, and the inside re-
flectance (ρin) is 0, so there will be no multiple scattering within
the needle, then the total transmittance (τtotal) is exactly τneedle ,
which is the transmittance of a needle.
To compare with RAMI, BRF in principal plane from the
scene of HOM28 was simulated in RED and near infrared (NIR)
bands, and the scene of HET07_JPS_SUM was simulated with
Fig. 7. Structural and optical properties of needle and shoot.
Fig. 8. Comparison between measured LAI and predicted LAI.
19 bands. The observation zenith angles range from 1to 75
withastepof2
. The BRF was finally compared with results
from other radiative transfer models.
3) Realistic Forest Simulation: A large plot (LPLOT) with
1km×1 km (red rectangle in Fig. 1) in our study area was
reconstructed. It contains 152 848 larch trees and 9433 birch
trees. The terrain of LPLOT has a minimum elevation of 857
m, and a maximum elevation of 958 m. Each component (i.e.,
leaf, truck, and soil background) was assigned with different
optical property that was obtained in the field measurements,
and all facets in this scene were assumed to be Lambertian.
Based on this virtual scene, a Landsat-like reflectance image
was simulated in RED (from 625 to 690 nm), and NIR (from
830 to 901 nm) bands with 1 nm spectral resolution and 30
m spatial resolution. The sun direction was calculated by the
overpass time of Landsat 8 and geographical location of the
study area. The final image was simulated under nadir direction
with an orthographic camera. The spectral response function
of Landsat 8 was then applied to the multispectral images to
get broadband images in RED and NIR. Finally, the normal-
ized difference vegetation index (NDVI) was calculated. The
land surface reflectance of Landsat 8 was obtained by the Fast
Line-of-sight Atmospheric Analysis of Hypercubes (FLAASH)
atmospheric correction model in ENVI 5.1. Since our study area
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.
6 IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING
Fig. 9. Comparison with RAMI for an abstract two layers case: (a) NIR BRF. (b) RED BRF. (The figures of other models are originally from RAMI website.)
Fig. 10. Comparison with RAMI for a heterogeneous case, two bands were chosen from the simulation results: (a) band9 with a needle reflectance around 0.056.
(b) band17 with a needle reflectance around 0.52. (The figures of other models are originally from RAMI website.)
was covered by clouds during the whole summer of 2013. The
date of Landsat 8 data used in our study is May 24, 2014.
IV. RESULTS
A. Allometric Relationship
Allometric relationships between DBH and LA for larch and
white birch were established by using field inventory data of L1,
L4, L5, and L9. We then used these relationships to predict the
LAI of other plots. We found that L3 and L8 had similar LAI,
DBH distribution, and tree height distribution, but the number
of individual trees in L3 (82) was much lower than that in
L8 (181). Therefore, we inferred that the field measurement of
L3 was incorrect, and excluded it from the following analysis.
Fig. 8 shows the comparison between predicted LAI and field-
measured LAI for L2, L6, L7, and L8. The root-mean-square
error (RSME) between the predicted LAI and measured LAI is
0.42.
B. Model Intercomparison
The ray-tracing-based radiative transfer simulation was vali-
dated with other models on the RAMI website. Fig. 9 presents
the results of HOM28. It shows a relatively accurate result for
both NIR and RED BRF, since it is inconsistent with most of
the existing models. Fig. 10 shows the principal BRF of the
heterogeneous actual canopy. It can be observed that the dif-
ferences between different models are relatively large. Among
them, our model is at the middle position. BRF near hotspot of
our model is in good agreement with several other 3-D mod-
els, such as librat. However, the inconsistence also can be seen
when the zenith angles are larger than 20. Our BRF has a
more obvious bowl shape than other models. Although similar
ray-tracing theory has been used in other simulation models
(i.e., pbrt), the representations of 3-D scene are different. RAMI
provides a standard description of the a 3-D scene, but some
models still have simplifications due to the complex structure of
canopy, especially for the representations of needles and shoots.
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.
QI et al.: LARGE-SCALE EMULATION SYSTEM FOR REALISTIC THREE-DIMENSIONAL (3-D) FOREST SIMULATION 7
Fig. 11. Comparison between CCD image and generated visible image: (a) CCD image; (b) generated image.
Fig. 12. Comparison between NDVIL8and NDVIS: (a) NDVIL8; (b) NDVIS; (c) Horizontal profile 1 (P1_L8 and P1_LESS); (d) Horizontal profile 2 (P2_L8
and P2_LESS).
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.
8 IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING
Fig. 13. Difference between simulated NDVI and Landsat 8 NDVI: (a) NDVI
difference distribution. (b) Histogram of NDVI difference.
These simplifications can result in inconsistencies between dif-
ferent models.
C. Image Simulation
Fig. 11 shows the computer-generated image of LPLOT.
Compared with the CCD image, the main distribution of in-
dividual trees in this plot is consistent with the real world, as
seen in the CCD image, especially for the isolated trees which
are easier to be segmented from CHM map. In the subplot (red
rectangle), the shadow of trees is also comparable with the CCD
image. In this virtual scene, there is a small valley around the
green rectangle in Fig. 11. The shadow produced by this valley
is well preserved. However, the classification of tree species is
not very accurate, because no multispectral data were available,
and the quality of CCD image is relatively low.
D. Spectral Simulation
Landsat-like land surface reflectance images in NIR and
RED were simulated by LESS, and NDVI from simulation
data (NDVIS) were calculated and compared with the observed
Landsat 8 NDVI (NDVIL8) (see Fig. 12). Overall, the distribu-
tion pattern of NDVISis similar to NDVIL8, both of them show
a relatively high value in areas with dense vegetation. Two hori-
zontal profiles across different places of the image were chosen
and illustrated in Fig. 12(c) and (d). It can be seen that the trends
are quite consistent. Fig. 13 illustrates the distribution of the dif-
ference between NDVISand NDVIL8. The mean value is 0.17
with a standard deviation of 0.08. The distribution of the differ-
ence showed that NDVISwas slightly larger than NDVIL8.A
possible reason is that most of the predicted LAIs based on the
allometric relationship in this study area are also overestimated
(see Fig. 8), which would result in a larger NDVIS.Themain
differences locate at areas with relatively sparse trees coverage
(the bottom of the image) and area of the valley, while in areas
with bare earth and dense vegetation, the differences are smaller,
because these areas are more homogeneous.
V. D ISCUSSION
A. 3-D Scene Generation
In this study, we used a well-established plant software pack-
age (OnyxTREE) to generate a series of individual trees, for
which the parameters were obtained by field measurements.
Fig. 14. A 30 m ×30 m forest scene: (a) RGB image, (b) NIR image. This
scene contains 30 birch trees, which are made from three single tree objects
with random translations and rotations.
However, the highest uncertainty is the LA of individual tree,
this uncertainty is produced either by the effective LAI mea-
surements or allometric relationships used in this study. In the
future, terrestrial laser scanner (TLS) may be a good alternative
to estimate LA of both individual tree and plot [36]. More im-
portantly, TLS can obtain very accurate 3-D branch structures
of trees. In this way, we can generate a virtual tree which is
almost identical to real trees.
B. Spectral Simulation
The absolute values of NDVISand NDVIL8show an apparent
offset. This may be caused by a number of reasons. Since we
only used a limited number of individual tree models and the
regenerated 3-D forest was not really identical to the real one,
and this structural difference may produce the gap between
NDVISand NDVIL8. Another reason was that the selection of
individual trees from SDB was only based on the tree height
and crown diameter, but LA, which is a very important factor
that influences NDVI, was not considered currently. In fact, the
predicted LAIs in most plots, excluding L8, were overestimated,
which means that the produced individual tree model may have
higher LA than a real tree and in turn produced a higher NDVI.
Additionally, the Landsat data were obtained in May, but the
scene in August was reconstructed, the LAI in May was lower
than the LAI in August, which caused that NDVISwas larger
than NDVIL8. However, the simulation is still useful because
we have predetermined all the “ground truth” (such as LAI)
of the regenerated scene, which is important to support some
quantitative remote sensing studies, such as the validation of
land surface parameter retrieval algorithms.
C. Ray-Tracing Sampling
Since ray-tracing mainly relies on random sampling of image
plane; thus, the sampling count (SC) per square meter may have
a large influence on the simulation accuracy, especially in highly
heterogeneous areas. To study the influences of SC, we simu-
lated the nadir BRF in NIR band of a 30 m ×30 m scene (see
Fig. 14) under different SC values, which range from 20m2to
2Nm2(N=0, 1,..., 10). For each SC, the simulations were
carried out 50 times. The mean, minimum, maximum value,
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.
QI et al.: LARGE-SCALE EMULATION SYSTEM FOR REALISTIC THREE-DIMENSIONAL (3-D) FOREST SIMULATION 9
Fig. 15. Influence of sampling count (SC): (a) Simulation accuracy under different SC, BFRmean, BRFmin, BRFmax represents the mean, minimum, and maximum
value of the 50 simulations for each SC, 95%CI is the confidence interval that indicates each simulated BRF has a possibility of 0.95 to lie in this interval.
(b) Simulation time of first-scattering and multi-scattering under different SC (excluding the time for reading and writing files).
and 95%confidence interval (CI) are shown in Fig. 15, which
also shows the corresponding simulation time (under a laptop
with 8 cores and 16 GB memory). It can be observed that BRF
tends to be stable while SC increases, however, the difference
is only 0.1% between SC =64 and SC =1024. This means
that the accuracy of SC =64 is comparable with higher SC, but
the simulation time is significantly reduced (from 23.1 to 1.5 s).
Although BRFmin and BRFmax have a significant difference un-
der very low SC, the 95%CI is relatively small, i.e., there is
a possibility of 95%that the simulated BRF value will lie in a
small interval, which becomes smaller when SC increases.
This figure also indicates that the simulation of multiscatter-
ing takes up most of the computing resources, because vegeta-
tion usually has very complex foliage structures and relatively
high reflectance in NIR band. If the reflectance is low (e.g.,
RED band), we can set the tracing paths shorter to reduce the
scattering times, which will in turn reduce multiscattering and
increase computing efficiency.
VI. CONCLUSION
In this study, we proposed a large-scale emulation system
to generate 3-D forest scene with explicitly described individ-
ual trees and simulate reflectance images. Allometric equations
were used to populate plot LAI to individual tree LA. With these
parameters, we constructed a SDB which contained a series of
individual trees. This SDB can be reused to build a larger forest
scene and can be used in the remote sensing and forest manage-
ment research. We also developed a parallelized radiative trans-
fer model based on ray-tracing techniques, and it provided a
relatively efficient way to simulate images of large and complex
scene. This model has been validated with other 3-D radiative
transfer models from RAMI, and a high consistency with most
of them proved the model’s feasibility. Moreover, we have re-
leased LESS to the public and it has an easy-to-use graphic user
interface (GUI) [37]. This software can simulate multispectral,
multiangle, and multiresolution images. We hope this software
can help remote sensing researchers to better understand the
complex interactions between vegetation and radiation, and also
possibly ease their modeling and validation work.
ACKNOWLEDGEMENT
The authors would like to thank K. Yan and Y. Chen for
providing us with field measurement data. Special thanks also to
Dr. T. Yin and Prof. J.-P. Gastellu-Etchegorry, for their valuable
advice on improving this paper.
REFERENCES
[1] J. K. Winjum, R. K. Dixon, and P. E. Schroeder, “Estimating the global
potential of forest and agroforest management practices to sequester car-
bon,” in Natural Sinks CO2, J. Wisniewski and A. E. Lugo, Eds. The
Netherlands: Springer, 1992, pp. 213–227.
[2] M. J. Twery and A. R. Weiskittel, “Forest-m modelling,” in Environmental
Modelling: Finding Simplicity Complexity, 2nd ed. Hoboken, NJ, USA:
Wiley, 2013, pp. 379–398.
[3] D. Alder, “Growth modelling for mixed tropical forests,Tropi-
cal Forestry Papers (United Kingdom), 1995. [Online]. Available:
http://agris.fao.org/agris-search/search.do?recordID=GB9618283
[4] M. Battaglia, P.J. Sands, and S. G. Candy, “Hybrid growth model to predict
height and volume growth in young Eucalyptus globulus plantations,
Forest Ecol. Manag., vol. 120, no. 1, pp. 193–201, 1999.
[5] J. K. Vanclay, Modelling Forest Growth and Yield: Applications to Mixed
Tropical Forests. Wallingford, U.K.: CAB Int., 1994.
[6] R. O. Curtis, G. W. Clendenen, D. J. DeMars, and P. N. Forest, ANew
Stand Simulator for Coast Douglas-Fir: DFSIM User’s Guide. U.S. Dept.
Agriculture, Forest Service, Pacific Northwest Forest and Range Experi-
ment Station, Portland, 1981.
[7] P. Paar, “Landscape visualizations: Applications and requirements of 3D
visualization software for environmental planning,Comput., Environ-
ment Urban Syst., vol. 30, no. 6, pp. 815–839, Nov. 2006. [Online]. Avail-
able: http://linkinghub.elsevier.com/retrieve/pii/S0198971505000566
[8] S. R. Sheppard, “Guidance for crystal ball gazers: Developing a code of
ethics for landscape visualization,” Landscape Urban Plann., vol. 54, no.
1, pp. 183–199, 2001.
[9] G. Zheng and L. M. Moskal, “Retrieving leaf area index (LAI)
using remote sensing: Theories, methods and sensors,” Sensors,
vol. 9, no. 4, pp. 2719–2745, Apr. 2009. [Online]. Available:
http://www.mdpi.com/1424-8220/9/4/2719/
[10] M. B´
eland, J.-L. Widlowski, R. A. Fournier, J.-F. Cˆ
ot´
e, and M. M.
Verstraete, “Estimating leaf area distribution in savanna trees from terres-
trial lidar measurements,” Agricultural Forest Meteorol., vol. 151, no. 9,
pp. 1252–1266, 2011.
This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination.
10 IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING
[11] F. D. Schneider et al., “Simulating imaging spectrometer data: 3D for-
est modeling based on LiDAR and in situ data,Remote Sens. Environ.,
vol. 152, pp. 235–250, 2014.
[12] J.-L. Widlowski, J.-F. Cˆ
ot´
e, and M. B´
eland, “Abstract tree crowns in 3d
radiative transfer models: Impact on simulated open-canopy reflectances,
Remote Sens. Environ., vol. 142, pp. 155–175, 2014.
[13] R. Darvishzadeh, A. Skidmore, M. Schlerf, and C. Atzberger, “Inversion of
a radiative transfer model for estimating vegetation LAI and chlorophyll
in a heterogeneous grassland,” Remote Sens. Environ., vol. 112, no. 5,
pp. 2592–2604, 2008.
[14] M. I. Disney, P. Lewis, and P. North, “Monte Carlo ray tracing in opti-
cal canopy reflectance modelling,” Remote Sens. Rev., vol. 18, no. 2–4,
pp. 163–196, 2000.
[15] J.-P. Gastellu-Etchegorry, V. Demarez, V. Pinel, and F. Zagolski, “Model-
ing radiative transfer in heterogeneous 3D vegetation canopies,” in Satel-
lite Remote Sensing (ser. Satellite Remote Sensing). International Society
for Optics and Photonics, 1995, pp. 38–49.
[16] J.-P. Gastellu-Etchegorry et al., “Discrete anisotropic radiative transfer
(dart 5) for modeling airborne and satellite spectroradiometer and lidar
acquisitions of natural and urban landscapes,” Remote Sens., vol. 7, no. 2,
pp. 1667–1701, 2015.
[17] P. R. J. North, “Three-dimensional forest light interaction model using a
Monte Carlo method,” IEEE Trans. Geosci. Remote Sens., vol. 34, no. 4,
pp. 946–956, Jul. 1996.
[18] W. Qin and S. A. Gerstl, “3-D scene modeling of semidesert vegetation
cover and its radiation regime,Remote Sens. Environ., vol. 74, no. 1,
pp. 145–162, 2000.
[19] M. E. Schaepman et al., “Advanced radiometry measurements and earth
science applications with the airborne prism experiment (apex),” Remote
Sens. Environ., vol. 158, pp. 207–219, 2015.
[20] H. Huang, W. Qin, and Q. Liu, “RAPID: A radiosity ap-
plicable to porous indiviDual objects for directional re-
flectance over complex vegetated scenes,Remote Sens. En-
viron., vol. 132, pp. 221–237, May 2013. [Online]. Available:
http://linkinghub.elsevier.com/retrieve/pii/S0034425713000254
[21] A. Komiyama, J. E. Ong, and S. Poungparn, “Allometry, biomass, and pro-
ductivity of mangrove forests: A review,Aquatic Botany, vol. 89, no. 2,
pp. 128–137, Aug. 2008. [Online]. Available: http://www.sciencedirect.
com/science/article/pii/S0304377007001829
[22] D. P. Turner, S. A. Acker, J. E. Means, and S. L. Garman, “As-
sessing alternative allometric algorithms for estimating leaf area of
Douglas-fir trees and stands,” Forest Ecol. Manage., vol. 126, no. 1,
pp. 61–76, Feb. 2000. [Online]. Available: http://www.sciencedirect.
com/science/article/pii/S0378112799000833
[23] J.-F. Barczi et al., “Amapsim: A structural whole-plant simulator based
on botanical knowledge and designed to host external functional models,
Ann. Botany, vol. 101, no. 8, pp. 1125–1138, 2008.
[24] S. Griffon and F. de Coligny, “AMAPstudio: An editing and sim-
ulation software suite for plants architecture modelling,” Ecologi-
cal Modelling, vol. 290, pp. 3–10, Oct. 2014. [Online]. Available:
http://www.sciencedirect.com/science/article/pii/S030438001300536X
[25] J. Weber and J. Penn, “Creation and rendering of realistic trees,” in Proc.
22nd Annu. Comput. Graph. Interactive Techn., 1995, pp. 119–128. [On-
line]. Available: http://doi.acm.org/10.1145/218380.218427
[26] K. Lim, P. Treitz, M. Wulder, B. St-Onge, and M. Flood, “LiDAR remote
sensing of forest structure,” Progress Phys. Geography, vol. 27, no. 1,
pp. 88–106, 2003.
[27] M. Van Leeuwen and M. Nieuwenhuis, “Retrieval of forest structural
parameters using LiDAR remote sensing,Eur. J. Forest Res., vol. 129,
no. 4, pp. 749–770, 2010.
[28] T. P. Dawson, P. J. Curran, and S. E. Plummer, “LIBERTY-Modeling the
effects of leaf biochemical concentration on reflectance spectra,Remote
Sens. Environ., vol. 65, no. 1, pp. 50–60, 1998.
[29] L. Wang et al., “Reflectance features of water stressed Larix gmelinii
needles,” Forestry Studies China, vol. 11, no. 1, pp. 28–33, 2009.
[30] J. Qi, D. Xie, and G. Yan, “Realistic 3D-simulation of large-scale
forest scene based on individual tree detection,” in Proc. IEEE Int.
Geosci. Remote Sens. Symp., Jul. 2016, pp. 728–731. [Online]. Available:
http://ieeexplore.ieee.org/document/7729183/
[31] W. Zhang et al., “An easy-to-use airborne lidar data filtering method
based on cloth simulation,” Remote Sens., vol. 8, no. 6, 2016,Art. no. 501.
[Online]. Available: http://www.mdpi.com/2072-4292/8/6/501
[32] J. T. Kajiya, “The rendering equation,” in ACM SIGGRAPH Comput.
Graph., vol. 20, no. 4, pp. 143–150, 1986.
[33] W. Jakob, “Mitsuba physically based renderer. mitsuba-renderer.org,
2010.
[34] J. L. Widlowski et al., “Third radiation transfer model intercomparison
(RAMI) exercise: Documenting progress in canopy reflectance models,
J. Geophys. Res., Atmospheres (1984-2012), vol. 112, no. D9, 2007.
[35] “RAMI, RAMI-IV - EXPERIMENTS - European Commission.”
2017. [Online]. Available: http://rami-benchmark.jrc.ec.europa.
eu/HTML/RAMI-IV/RAMI-IV.php. Accessed on: Sep. 27, 2017.
[36] W. Yan, D. Xie, X. Wang, Q. I. Jianbo, W. Zhang, and G. Yan, “Simulation
and analysis of point clouds from a terrestrial laser scanner,” J. Remote
Sens., vol. 19, no. s1, pp. 391–399, 2015.
[37] J. Qi, “Home—LESS Documentation,” Mar. 2017. [Online]. Available:
http://ramm.bnu.edu.cn/projects/less/
Jianbo Qi is currently working toward the Ph.D. de-
gree in cartography and geographic information sys-
tem at Beijing Normal University, Beijing, China.
He is also a joint Ph.D. student at CESBIO Labora-
tory,Paul Sabatier University, France.
His research interests include 3-D radiative trans-
fer modeling, realistic forest scene simulation, and
vegetation parameter retrieval.
Donghui Xie received the Ph.D. degree in remote
sensing and geographic information systems from
Beijing Normal University, Beijing, China, in 2005.
From 2005 to 2007, she was a Postdoctoral Re-
search Associate with Beijing Normal University. She
is currently with the State Key Laboratory of Remote
Sensing Science, School of Geography, Beijing Nor-
mal University. Her research interests include canopy
radiative transfer modeling and biophysical parame-
ter retrieval of vegetation.
Dashuai Guo is currently working toward the Mas-
ter’s degree in cartography and geographic informa-
tion system at Beijing Normal University, Beijing,
China.
His research interests are mainly in individual trees
modeling and realistic forest scene simulation.
Guangjian Yan received the Ph.D. degree in carto-
graphy and geographic information system from the
Institute of Remote Sensing Applications, Chinese
Academy of Sciences, Beijing, China, in 1999.
He is currently a Professor with the State Key Lab-
oratory of Remote Sensing Science, School of Geog-
raphy, Beijing Normal University, Beijing. He has
published more than 160 papers. His main research
interests are multiangular remote sensing, vegetation
remote sensing, radiation budget, scale effect, and
scale correction of remote sensing.
... As stated by Åkerblom et al. (2018) and Janoutová et al. (2019), this method explicitly reconstructs tree trunks, branches, and leaves geometric objects closely resembling their actual shapes with specified optical information. However, because of the computational complexity and memory consumption allied with reconstructing each object in a forest stand, 3D explicit models are better suited for individual trees or plot scale forest scenes (Qi et al., 2017). To solve this issue, some studies reconstruct explicit models of individual trees and then duplicate them to create the complete forest scene (Côté et al., 2009;Zhao et al., 2023). ...
... In this study, we reconstructed a multi-layered, realistic forest scene by integrating the BLS and ULS data. For the purpose of reconstructing forest scenes in relatively large areas, many prior studies have relied solely on airborne laser scanning (ALS) or ULS (Schneider et al., 2014;Qi et al., 2017). However, due to low point cloud density and poor penetration, these data may be biased in RTMs and lack information about branches and understory vegetation (Kobayashi et al., 2012;Hu et al., 2017). ...
Article
Full-text available
Forests are complex, multi-layered ecosystems mainly comprising an overstory, understory, and soil. Radiative transfer simulations of these forests underpin the theoretical framework for retrieving forest parameters; however, the understory has often been neglected due to limitations in data acquisition technology. In this study, we assessed the contribution of the understory to canopy reflectance in a temperate broadleaf forest by comparing simulated bidirectional reflectance factor (BRF) differences between forest scenes with and without the understory. These scenes were reconstructed through voxel-based, boundary-based, and ellipsoid-based approaches respectively based on the multi-layered point cloud data acquired via combining unmanned aerial vehicle (UAV) and backpack laser scanning. The results show that the understory influences the simulated BRF across all three forest scene reconstruction approaches, suggesting that canopy reflectance signals can be used to evaluate the understory information, which provides a theoretical foundation for the feasibility of retrieving understory parameters via remote sensing. The understory increases BRF by 80% in shaded regions beneath the overstory in the red and NIR bands, and can increase BRF by 40% in the NIR band for voxel-based and ellipsoid-based forest scenes. Conversely, it reduces the simulated BRF in sunlit soil areas in the red band. Among the three forest reconstruction methods, the canopy reflectance simulation using the boundary-based model can consistently project the most understory information. Notably, the findings also indicate that the reflectance of the forest canopy definitely capture less understory vegetation information as the simulation resolution decreases, for instance, as the simulated resolution decreased from 1 m to 30 m, the absolute difference in the red band between the multi-layered BRF and L50 BRF decreased from 23.93% to 10.22% when using the boundary-based approach. It implies that higher resolution remote sensing observations are more advantageous for the retrieval of understory parameters. This study provides a successful case for modeling the multi-layered forest structure in natural temperate broadleaf forests, and even offers a theoretical reference for facilitating the retrieval of biochemical and biophysical information from the understory by remote sensing.
... Ray tracing models, offering accurate simulations of light behavior in 3D structures, are necessary for these situations. 3D RTM tools like LESS utilize special- ized ray tracing algorithms for this purpose (Qi et al., 2017(Qi et al., , 2022. Physics-based model generally need to be inverted, as they model the reflectance given some plant trait and not vice-versa. ...
... The application of radiative transfer models at canopy level, is labor-intensive due to the specialized nature of these models and limited guidance on their application. For this study, we adapted the ray tracing model LESS, a freely accessible 3D forest radiative transfer model (Qi et al., 2017(Qi et al., , 2022. A virtual almond orchard scene was created by using a 3D model of an almond tree from the cgtrader platform. ...
Article
Full-text available
Nitrogen (N) is vital for plant growth, but its imbalance can negatively affect crop yields, the environment, and water quality. This is especially crucial for California’s almond orchards, which are the most N-hungry nut crop and require substantial N for high productivity. The current practices of uniform and extensive N application lead to N leaching into the groundwater, creating environmental hazards. Traditional remote sensing methods often rely on data-driven approaches that work well statistically (achieving a high R² value) with one dataset but aren’t adaptable across different datasets. To create a more robust, data-driven model, one would typically need a vast and varied collection of datasets. Our goal, however, is to develop a more universally applicable model using smaller datasets, typical of commercial orchards, that can accurately estimate N content in tree canopies, regardless of differences in spatial, spectral, and temporal data. In this study, we investigate and evaluate multiple remote sensing approaches for estimating N concentration in Californian almonds, utilizing hyperspectral imaging at the canopy level. We assess various classical vegetation indices, machine learning models, and a physics-informed 3D radiative transfer model. While cross-validated results show comparable results for radiative transfer models and best-performing machine learning models, most single vegetation indices are not capable of exceeding the baseline model f(x)=yˉ\:f\left(\mathbf{x}\right)=\bar{y} and thus had R² value less than 0. Despite being less commonly used, 3D radiative transfer modeling shows promise as a strong and adaptable method, producing results that are comparable to the best machine learning models.
... However, the process of real data collection is complex, time-consuming, and labor-intensive. Although the advent of LiDAR significantly simplifies this process, point cloud data can be collected through LiDAR sensors mounted on different platforms, such as airborne LiDAR scanning (ALS), terrestrial LiDAR scanning (TLS), mobile LiDAR scanning (MLS), and unmanned aerial vehicle LiDAR scanning (ULS) [12][13][14]. Unfortunately, LiDAR data collection still faces certain limitations: the collection range is usually restricted to specific areas and fixed-scale samples, and the amount of data and tree species types obtained are still relatively limited. ...
Article
Full-text available
Three-dimensional (3D) virtual trees play a vital role in modern forestry research, enabling the visualization of forest structures and supporting diverse simulations, including radiation transfer, climate change impacts, and dynamic forest management. Current virtual tree modeling primarily relies on 3D point cloud reconstruction from field survey data, and this approach faces significant challenges in scalability and structural diversity representation, limiting its broader applications in ecological modeling of forests. To address these limitations, we propose Diff-Tree, a novel diffusion model-based framework for generating diverse and realistic tree point cloud with reduced dependence on real-world data. The framework incorporates an innovative tree realism-aware filtering mechanism to ensure the authenticity of generated data while maintaining structural diversity. We validated Diff-Tree using two distinct datasets: one comprising five tree species from different families and genera, and another containing five Eucalyptus species from the same genus, demonstrating the method’s versatility across varying taxonomic levels. Quantitative evaluation shows that Diff-Tree successfully generates realistic tree point cloud while effectively enhancing structural diversity, achieving average MMDCD and COVCD values of (0.41, 65.78) and (0.56, 47.09) for the two datasets, respectively. The proposed method not only significantly reduces data acquisition costs but also provides a flexible, data-driven approach for virtual forest generation that adapts to diverse research requirements, offering a more efficient and practical solution for forestry research and ecological modeling.
... The airborne laser scanning (ALS) point cloud data for various virtual forest scenes, as detailed in Section 2.2, were simulated using the LiDAR simulation module of the LESS model [30,32]. LESS (version 2.1.4, ...
Article
Full-text available
Accurately quantifying fine-scale forest canopy-absorbed photosynthetically active radiation (APAR) is essential for monitoring forest growth and understanding ecological processes. The development of 3D radiative transfer models (3D RTMs) enables the precise simulation of canopy–light interactions, facilitating better quantification of forest canopy radiation dynamics. However, the complex parameters of 3D RTMs, particularly detailed 3D scene structures, pose challenges to the simulation of radiative information. While high-resolution LiDAR offers precise 3D structural data, the effectiveness of different tree crown reconstruction methods for APAR quantification using airborne laser scanning (ALS) data has not been fully investigated. In this study, we employed three ALS-based tree crown reconstruction methods: alphashape, ellipsoid, and voxel-based combined with the 3D RTM LESS to assess their effectiveness in simulating and quantifying 3D APAR distribution. Specifically, we used two distinct 3D forest scenes from the RAMI-V dataset to simulate ALS data, reconstruct virtual forest scenes, and compare their simulated 3D APAR distributions with the benchmark reference scenes using the 3D RTM LESS. Furthermore, we simulated branchless scenes to evaluate the impact of branches on APAR distribution across different reconstruction methods. Our findings indicate that the alphashape-based tree crown reconstruction method depicts 3D APAR distributions that closely align with those of the benchmark scenes. Specifically, in scenarios with sparse (HET09) and dense (HET51) canopy distributions, the APAR values from scenes reconstructed using this method exhibit the smallest discrepancies when compared to the benchmark scenes. For HET09, the branched scenario yields RMSE, MAE, and MAPE values of 33.58 kW, 33.18 kW, and 40.19%, respectively, while for HET51, these metrics are 12.74 kW, 12.97 kW, and 10.27%. In the branchless scenario, HET09′s metrics are 10.65 kW, 10.22 kW, and 9.79%, and for HET51, they are 2.99 kW, 2.65 kW, and 2.11%. However, differences remain between the branched and branchless scenarios, with the extent of these differences being dependent on the canopy structure. Our conclusion demonstrated that among the three tree crown reconstruction methods tested, the alphashape-based method has the potential for simulating and quantifying fine-scale APAR at a regional scale. It provides a convenient technical support for obtaining fine-scale 3D APAR distributions in complex forest environments at a regional scale. However, the impact of branches in quantifying APAR using ALS-reconstructed scenes also needs to be further considered.
... UAV point cloud data of the two selected forest plots was utilized to reconstruct detailed 3D forest scenes by employing the 3D reconstruction module (Fig. 3) provided by the 3D RTM LESS (Qi et al., , 2017. LESS is a state-of-the-art 3D RTM that can simulate various remote sensing signals by configuring different sensor parameters, providing a reliable foundation for the development and validation of remote sensing models and retrieval algorithms (Zeng et al., 2023). ...
Article
Full-text available
Leaf chlorophyll content (LCC) retrieval from remote sensing imagery is essential for monitoring vegetation growth and stress in the agroforestry industry. Many remote sensing inversion methods for estimating LCC primarily rely on 1D radiative transfer models (RTMs) that abstract canopies into horizontal layers or simple geometric primitives. Yet, this methodology faces challenges when applied to heterogeneous canopies, particularly in fine-scale mapping where each pixel’s reflectance is significantly influenced by its surroundings, e.g. crown shadows. While 3D RTMs hold promise for addressing these challenges by explicitly describing complex canopy structures, their computational demands and the complexity involved in parameterizing detailed 3D structures limit the generation of extensive training datasets, requiring simulations across numerous parameter combinations. In this study, we used a semi-empirically accelerated 3D RTM, termed Semi-LESS, with a 1D residual network to accurately retrieve leaf chlorophyll content (LCC) from UAV images and LiDAR data at a 3-m resolution. We first reconstructed structures of forest plots using UAV LiDAR point cloud, based on which, UAV images with varying leaf and soil optical properties are simulated using the Semi-LESS. Subsequently, a training dataset consisting LCC and its corresponding reflectance was generated from the simulated UAV images by focusing on sunlit pixels. A 1D residual network is trained using the training dataset for LCC estimation. For comparison, we also trained an estimation model using a dataset generated from PROSAIL. The results show that estimation model trained with Semi-LESS surpasses PROSAIL in retrieving LCC from both simulation datasets and field measurements of two forest plots. The RMSE of Semi-LESS was 5.40–6.92 μg/cm2 for simulation datasets and 8.21–9.76 μg/cm2 for field measurements, whereas PROSAIL exhibited lower accuracy with an RMSE of 7.76–9.83 μg/cm2 for simulation datasets and 12.76–13.06 μg/cm2 in field measurements. The results demonstrate that Semi-LESS coupled with deep learning is reliable and has great potential for LCC mapping using UAV images, which is particularly useful for fine-scale applications such as crop and orchard monitoring. This approach also highlights the impact of shadows on LCC retrieval.
... Against this backdrop, the LESS model was developed by the team led by Qi et al. [32]. As a 3D RTM capable of both forward and backward ray tracing, it can construct realistic 3D structural scenes and efficiently simulate large-scale remote sensing data with simple operations and without requiring complex scene or vegetation parameter inputs [33]. ...
Article
Full-text available
The Leaf Area Index (LAI) is a critical parameter that sheds light on the composition and function of forest ecosystems. Its efficient and rapid measurement is essential for simulating and estimating ecological activities such as vegetation productivity, water cycle, and carbon balance. In this study, we propose to combine high-resolution GF-6 2 m satellite images with the LESS three-dimensional RTM and employ different machine learning algorithms, including Random Forest, BP Neural Network, and XGBoost, to achieve LAI inversion for forest stands. By reconstructing real forest stand scenarios in the LESS model, we simulated reflectance data in blue, green, red, and near-infrared bands, as well as LAI data, and fused some real data as inputs to train the machine learning models. Subsequently, we used the remaining measured LAI data for validation and prediction to achieve LAI inversion. Among the three machine learning algorithms, Random Forest gave the highest performance, with an R² of 0.6164 and an RMSE of 0.4109, while the BP Neural Network performed inefficiently (R² = 0.4022, RMSE = 0.5407). Therefore, we ultimately employed the Random Forest algorithm to perform LAI inversion and generated LAI inversion spatial distribution maps, achieving an innovative, efficient, and reliable method for forest stand LAI inversion.
... Regarding forest 3D modeling, common methods can be divided into individual tree based (Calders et al., 2018;Hu et al., 2017;Liu et al., 2021) and voxel based (Lin et al., 2023;J. Qi et al., 2017). Individual tree based forest 3D model restores the true 3D structure of the tree based on measurement data, which can achieve accurate restoration of branches, stems, and leaves. But this process is more complex and more dependent on fine-scale measurement of forest structure. Usually denser TLS point clouds are needed for mesh-based i ...
Article
Full-text available
Forest anomalies (e.g., pests, deforestation, and fires) are increasingly frequent phenomena on Earth’s surface. Rapid detection of these anomalies is crucial for sustainable forest management and development. On-orbit remote sensing detection of multi-type forest anomalies using single-temporal images is one of the most promising methods for achieving it. Nevertheless, existing forest anomaly detection methods rely on time series image analysis or are designed to detect a single type of forest anomaly. In this study, a Forest Anomaly Comprehensive Index (FACI) is proposed to detect multi-type forest anomalies using single-temporal Sentinel-2 images. First, the spectral characteristics of different forest anomaly events were analyzed to obtain potential band combinations. Then, the formulation of FACI was determined using imagery simulated by the LargE-Scale remote sensing data and image Simulation framework over heterogeneous 3D scenes (LESS) model. The thresholds for FACI for different anomalies were determined using the interquartile method and 90 in situ survey samples. The accuracy of FACI was quantitatively assessed using an additional 90 in situ survey samples. Evaluation results indicated that the overall accuracy of FACI in detecting the three forest anomalies was 88.3%, with a Kappa coefficient of 0.84. The overall accuracy of existing indices (NDVI, NDWI, SAVI, BSI, and TAI) is below 80%, with Kappa coefficients less than 0.7. In the end, a case study in Ji’an, Jiangxi Province, confirmed the ability of FACI to detect different stages of pest infection, as well as deforestation and forest fires, using single-temporal satellite images. The FACI provides a promising method for the on-orbit satellite detection of multi-type forest anomalies in the future.
Article
Full-text available
The fraction of green vegetation is a widely-used indicator of vegetation abundance at regional and/or global scales. The pixel mixture model, especially the dimidiate pixel model (DPM, also referred to as two-endmember model) based on the normalized difference vegetation index (NDVI), plays an important role in the accurate estimation of fractional vegetation cover (FVC) via remote sensing. The two components in the traditional DPM are vegetation and soil (both sunlit and shaded). However, to date, the influence of shaded vegetation and shaded soil has not been fully considered in the NDVI-based DPM. Herein we analyze the necessity and feasibility of processing shaded components separately. The shaded soil was found to largely affect the canopy NDVI and can be combined with the vegetation (both sunlit and shaded) as one of the two components in DPM due to the high NDVI of shaded soil under a small percentage of diffuse sky radiation (< 10 % of the total hemispherical radiation in red band in this study). This finding partially explains why the canopy NDVI is oversensitive to background. The DPM was then improved with the solar and view angles to account for the fraction of shaded soil. We performed simulation and field measurements to validate the proposed models to varying factors including the vegetation structure, soil background, solar and view geometry, and slope gradient. The improved DPMs outperformed the traditional DPM (i.e., where no effect of shaded soil is considered) when estimating the NDVI and FVC of the mixed pixel. The FVC estimated with traditional DPM results in the RMSE from 0.14 to 0.31, and that with the improved DPMs range from 0.04 to 0.13. The decrease of uncertainty by using the improved DPMs was generally over 50 % when compared to the output from a traditional DPM. The proposed DPM maintains the advantage of an easy-of-use two-component mixture model yet is more accurate than traditional ones and thus expected to improve the FVC estimation from satellite data.
Article
Full-text available
Separating point clouds into ground and non-ground measurements is an essential step to generate digital terrain models (DTMs) from airborne LiDAR (light detection and ranging) data. However, most filtering algorithms need to carefully set up a number of complicated parameters to achieve high accuracy. In this paper, we present a new filtering method which only needs a few easy-to-set integer and Boolean parameters. Within the proposed approach, a LiDAR point cloud is inverted, and then a rigid cloth is used to cover the inverted surface. By analyzing the interactions between the cloth nodes and the corresponding LiDAR points, the locations of the cloth nodes can be determined to generate an approximation of the ground surface. Finally, the ground points can be extracted from the LiDAR point cloud by comparing the original LiDAR points and the generated surface. Benchmark datasets provided by ISPRS (International Society for Photogrammetry and Remote Sensing) working Group III/3 are used to validate the proposed filtering method, and the experimental results yield an average total error of 4.58%, which is comparable with most of the state-of-the-art filtering algorithms. The proposed easy-to-use filtering method may help the users without much experience to use LiDAR data and related technology in their own applications more easily.
Article
Full-text available
Terrestrial Laser Scanner (TLS) technology can quickly acquire three-dimensional information of targets with high precision. Given that TLS is a new data collection technique, it has been gradually applied to characterize the structural attributes of forest canopy. However, the inversion accuracy of Leaf Area Index (LAI) is highly dependent on the intrinsic configuration of the sensor, such as beam size and echo detection energy. In this paper, a computer simulation model was proposed to simulate point clouds from TLS and to analyze quantitatively the influence of beam characteristic on LAI inverted from TLS data. A realistic tree was generated with OnyxTREE BROADLEAF software. Moreover, a computer model was proposed to simulate the interactions of lasers with a single tree and to acquire the point clouds from a TLS Riegl VZ-1000 based on the ray tracing algorithm. This model consisted of the ray intersection with triangular patches of photorealistic trees, the coordinate system conversion, and the acceleration of the algorithm. The beam size at exit, beam divergence, and echo detection algorithm were considered in the computer simulation method. One laser beam was divided into multiple bins, and each bin was treated as a separate pulse with its location, propagation direction, and an initial energy changing into a Gaussian shape. We inverted the crown-level Leaf Area Index (LAI) by using gap fraction analysis with the simulated point clouds, and the influence of beam characteristics (such as beam diameter and minimum echo detection intensity) on the LAI inversion was analyzed. Finally, we conducted the validation with the measured points of a birch tree located in Root River. We analyzed the influences of beam characteristics, such as beam size, beam divergence, and echo detection energy, on LAI inversion. The inversion results indicate that beam size and detection limit greatly influence LAI inversion. The points are increased with the decrease of the corresponding gap fraction because several points can be returned from one beam when the beam width and divergence were considered, particularly when significant differences are achieved at the edge of leaves. A larger beam size means that components in the edge portion are intercepted more easily. Thus, the deviation of LAI inversion would be greater. When the detection intensity threshold was small, echo information could be returned even if only part of the spot edge was intercepted. Thus, gap fraction is undervalued. However, when the energy threshold setting was large, the returned energy may be below the threshold value and cannot be recorded, thereby resulting in overestimation of the gap fraction and underestimation of LAI. Therefore, the points caused by beam size and echo detection must be filtered, and suitable points must be chosen before inverting LAI with the gap fraction model. The simulation model based on the ray tracing algorithm was presented to explore the laser beam interceptions with an individual tree generated by using OnyxTree software. The LAI was retrieved via gap fraction analysis with zenith slicing method. The beam characteristics, such as beam size, echo detection energy, and beam divergence, were considered. The simulation model enables efficient and cost-effective research that can avoid environmental and instrumental error. This model contributes to an improved understanding of the intersections of laser beams with the tree crown well, and the LAI inversion of an individual tree is facilitated.
Article
Full-text available
Satellite and airborne optical sensors are increasingly used by scientists, and policy makers, and managers for studying and managing forests, agriculture crops, and urban areas. Their data acquired with given instrumental specifications (spectral resolution, viewing direction, sensor field-of-view, etc.) and for a specific experimental configuration (surface and atmosphere conditions, sun direction, etc.) are commonly translated into qualitative and quantitative Earth surface parameters. However, atmosphere properties and Earth surface 3D architecture often confound their interpretation. Radiative transfer models capable of simulating the Earth and atmosphere complexity are, therefore, ideal tools for linking remotely sensed data to the surface parameters. Still, many existing models are oversimplifying the Earth-atmosphere system interactions and their parameterization of sensor specifications is often neglected or poorly considered. The Discrete Anisotropic Radiative Transfer (DART) model is one of the most comprehensive physically based 3D models simulating the Earth-atmosphere radiation interaction from visible to thermal infrared wavelengths. It has been developed since 1992. It models optical signals at the entrance of imaging radiometers and laser scanners on board of satellites and airplanes, as well as the 3D radiative budget, of urban and natural landscapes for any experimental configuration and instrumental specification. It is freely distributed for research and teaching activities. This paper presents DART physical bases and its latest functionality for simulating imaging spectroscopy of natural and urban landscapes with atmosphere, including the perspective projection of airborne acquisitions and LIght Detection And Ranging (LIDAR) waveform and photon counting signals.
Article
Full-text available
We present the Airborne Prism Experiment (APEX), its calibration and subsequent radiometric measurements as well as Earth science applications derived from this data. APEX is a dispersive pushbroom imaging spectrometer covering the solar reflected wavelength range between 372 and 2540 nm with nominal 312 (max. 532) spectral bands. APEX is calibrated using a combination of laboratory, in-flight and vicarious calibration approaches. These are complemented by using a forward and inverse radiative transfer modeling approach, suitable to further validate APEX data. We establish traceability of APEX radiances to a primary calibration standard, including uncertainty analysis. We also discuss the instrument simulation process ranging from initial specifications to performance validation. In a second part, we present Earth science applications using APEX. They include geometric and atmospheric compensated as well as reflectance anisotropy minimized Level 2 data. Further, we discuss retrieval of aerosol optical depth as well as vertical column density of NOx, a radiance data-based coupled canopy-atmosphere model, and finally measuring sun-induced chlorophyll fluorescence (Fs) and infer plant pigment content. The results report on all APEX specifications including validation. APEX radiances are traceable to a primary standard with < 4% uncertainty and with an average SNR of > 625 for all spectral bands. Radiance based vicarious calibration is traceable to a secondary standard with ≤ 6.5% uncertainty. Except for inferring plant pigment content, all applications are validated using in-situ measurement approaches and modeling. Even relatively broad APEX bands (FWHM of 6 nm at 760 nm) can assess Fs with modeling agreements as high as R2 = 0.87 (relative RMSE = 27.76%). We conclude on the use of high resolution imaging spectrometers and suggest further development of imaging spectrometers supporting science grade spectroscopy measurements.
Chapter
Forests play a prominent role in the global C cycle. Occupying one-third of the earth’s land area, forest vegetation and soils contain about 60% of the total terrestrial C. Forest biomass productivity can be enhanced by management practices, which suggests that, by this means, forests could store more C globally and thereby slow the increase in atmospheric CO2. The question is how much C can be sequestered by forest and agroforest management practices. To address the question, a global database of information was compiled to assess quantitatively the potential of forestry practices to sequester C. The database presently has information for 94 forested nations that represent the boreal, temperate and tropical latitudes. Results indicate that the most promising management practices are reforestation in the temperate and tropical latitudes, afforestation in the temperate regions, and agroforestry and natural reforestation in the tropics. Across all practices, the median of the mean C storage values for the boreal latitudes is 16 tCha-1 (n=46) while in the temperate and tropical latitudes the median values are 71 tCha-1 (n=401) and 66 tCha-1 (n=170), respectively. Preliminary projections are that if these practices were implemented on 0.6 to 1.2 × 109 ha of available land over a 50-yr period, approximately 50 to 100 GtC could be sequestered.
Article
AMAPstudio is a software suite dedicated to plants architecture modelling, designed for botanists and agronomists, providing features to edit, visualise, explore and simulate multi-scale plant descriptions. AMAPstudio is based on the multi-scale tree graph (MTG) data structure, which is commonly used to represent plant topology. The user can explore and edit the topology and the geometry of one or several plants. Specific data can be extracted with combinations of criteria and can be visualised in tables and graphs. Simple analysis functions can be run and data can be exported to external tools, e.g. R or any other statistical computing environment, for more specific analyses. AMAPstudio is also a framework in which modellers can integrate their own plant simulation models to build plant growth or scene dynamics scenarios and explore the results. Models can be of different kinds, they can address more or less functioning and interaction with other plants or with the environment, possibly enabling to run ecological studies. AMAPstudio is an open software built according to the Capsis methodology. It is scenario oriented and brings particularly interactive editors easing the daily work and knowledge transfer. It is a free open-source software (LGPL) available on all Java compatible operating systems and it can be downloaded on http://amapstudio.cirad.fr.
Article
Remote sensing offers the potential to study forest ecosystems by providing spatially and temporally distributed information on key biophysical and biochemical variables. The estimation of biochemical constituents of leaves from remotely sensed data is of high interest revealing insight on photosynthetic processes, plant health, plant functional types, and species composition. However, upscaling leaf level observations to canopy level is not a trivial task, in particular due to the inherent structural complexity of forests. A common solution for scaling spectral information is the use of physically-based radiative transfer models. We parameterize the Discrete Anisotropic Radiative Transfer (DART) model based on airborne and in situ measurements. At-sensor radiances were simulated and compared with measurements of the Airborne Prism Experiment (APEX) imaging spectrometer. The study was performed on the Laegern site (47°28′43.0 N, 8°21′53.2 E, Switzerland), a temperate mixed forest characterized by steep slopes, a heterogeneous spectral background, and a high species diversity. Particularly the accurate 3D modeling of the complex canopy architecture is crucial to understand the interaction of photons with the vegetation canopy and its background. Two turbid medium based forest reconstruction approaches were developed and compared; namely based on a voxel grid and based on individual tree detection. Our study shows that the voxel grid based reconstruction yields better results. When using a pixel-wise comparison with the imaging spectrometer data, the voxel grid approach performed better (R2 = 0.48, λ780 nm) than the individual tree approach (R2 = 0.34, λ780 nm). Spatial patterns as compared to APEX data were similar, whereas absolute radiance values differed slightly, depending on wavelength. We provide a successful representation of a 3D radiative regime of a temperate mixed forest, suitable to simulate most spectral and spatial features of imaging spectrometer data. Limitations of the approach include the high spectral variability of leaf optical properties between and within species, which will be further addressed. The results also reveal the need of more accurate parameterizations of small-scale structures, such as needle clumping at shoot level as well as leaf angle.
Article
Three-dimensional (3D) radiatives transfer models of vegetation canopies are increasingly used to study the reflective properties of specific land cover types and to interpret satellite-based remote sensing observations of such environments. In doing so, most 3D canopy reflectance models simplify the structural representation of individual tree crowns, for example, by using a single ellipsoidal envelope or a series of cubic volumes (known as voxels) to approximate the actual crown shape and the 3D distribution of scatterers therein. Often these tree abstractions ignore or simplify the woody architecture as well. Focusing on broad-leaved Savanna trees, this study investigates the impact that architectural simplifications may have on the fidelity of simulated satellite observations at the bottom of the atmosphere for a variety of spatial resolutions, spectral bands, as well as viewing and illumination geometries. The typical uncertainty associated with vicarious calibration efforts, i.e., 5%, is used as the quality objective for the simulated bidirectional reflectance factors (BRFs). Our results indicate that the size of the voxel as well as the spectral, viewing, and illumination conditions drive the BRF bias at a given spatial resolution. The simulation of remote sensing data at medium spatial resolution is not affected by canopy abstractions except in the near-infrared (NIR) for cases where woody structures are omitted. Here, the BRF simulations of the abstract tree crowns exceeded the 5% tolerance limit even at spatial resolutions coarser than 125 m. For high-resolution satellite imagery, i.e., for nominal pixel sizes of 1 × 1 m2 or finer, local BRF biases can be 10 times greater than the 5% tolerance criterion. Both positive and negative local biases are possible depending on the relative weights of the single-collided, single-uncollided, and multiple-collided BRF components.