ArticlePDF Available

Abstract and Figures

In this paper we introduce mathematical model and real-time numerical method for segmentation of Natura 2000 habitats in satellite images by evolving open planar curves. These curves in the Lagrangian formulation are driven by a suitable velocity vector field, projected to the curve normal. Besides the vector field, the evolving curve is influenced also by the local curvature representing a smoothing term. The model is numerically solved using the flowing finite volume method discretizing the arising intrinsic partial differential equation with Dirichlet boundary conditions. The time discretization is chosen as an explicit due to the ability of real-time edge tracking. We present the results of semi-automatic segmentation of various areas across Slovakia, from the riparian forests to mountainous areas with scrub pine. The numerical results were compared to habitat boundaries tracked by GPS device in the field by using the mean and maximal Hausdorff distances as criterion.
Content may be subject to copyright.
DISCRETE AND CONTINUOUS doi:10.3934/dcdss.2020231
DYNAMICAL SYSTEMS SERIES S
SEMI-AUTOMATIC SEGMENTATION OF NATURA 2000
HABITATS IN SENTINEL-2 SATELLITE IMAGES BY EVOLVING
OPEN CURVES
Karol Mikula, Jozef Urb´
an, Michal Koll´
ar and Martin Ambroz
Department of Mathematics, Slovak University of Technology
Radlinsk´eho 11, 810 05 Bratislava, Slovakia
and
Algoritmy:SK, s.r.o., ˇ
Sulekova 6, 811 06 Bratislava, Slovakia
Ivan Jarol
´
ımek, Jozef ˇ
Sib
´
ık and M´
aria ˇ
Sib
´
ıkov´
a
Institute of Botany, Slovak Academy of Sciences
ubravsk´a cesta 9, 845 23 Bratislava, Slovakia
Abstract. In this paper we introduce mathematical model and real-time nu-
merical method for segmentation of Natura 2000 habitats in satellite images
by evolving open planar curves. These curves in the Lagrangian formulation
are driven by a suitable velocity vector field, projected to the curve normal.
Besides the vector field, the evolving curve is influenced also by the local cur-
vature representing a smoothing term. The model is numerically solved using
the flowing finite volume method discretizing the arising intrinsic partial differ-
ential equation with Dirichlet boundary conditions. The time discretization is
chosen as an explicit due to the ability of real-time edge tracking. We present
the results of semi-automatic segmentation of various areas across Slovakia,
from the riparian forests to mountainous areas with scrub pine. The numerical
results were compared to habitat boundaries tracked by GPS device in the field
by using the mean and maximal Hausdorff distances as criterion.
1. Introduction. In this paper we present a semi-automatic method for image seg-
mentation of NATURA 2000 habitats in Sentinel-2 satellite images. In the section
2the main idea of our segmentation method is given. We design the velocity vec-
tor field and we prescribe the evolution equation for the segmentation curve in the
form of an intrinsic partial differential equation with Dirichlet boundary conditions.
Similar models are used in the context of dislocation dynamics in [5,10]. Section
3deals with the numerical discretization of the proposed segmentation model. The
comparison of numerically segmented areas and areas tracked by GPS device is
presented in section 4.
2010 Mathematics Subject Classification. Primary: 35R01, 65M08; Secondary: 35R37, 92F05.
Key words and phrases. Image segmentation, curve evolution, numerical method, Natura 2000,
satellite images, Sentinel-2.
Corresponding author.
This work was supported by projects APVV-16-0431, APVV-15-0522 and ESA Contract No.
4000122575/17/NL/SC.
1
2 KAROL MIKULA ET AL.
2. Mathematical model for semi-automatic image segmentation. In this
section we explain design of the segmentation model by using artificial images.
We use a suitable velocity vector field, based on the smoothed image information,
which drives the evolving curve automatically to the boundary of segmented habitat.
Such vector field is constructed by using the pre-smoothed image intensity gradient
as an edge indicator which is an input of the edge detector function. Then the
gradient of the edge detector function is projected to the normal of the curve and
the overall curve motion is regularized by using the local curvature of evolving curve
[3,4,7,8]. The final mathematical model is given by the corresponding nonlinear
intrinsic partial differential equation which is discretized and solved numerically by
the flowing finite volume method [9,7,1].
2.1. Construction of the velocity vector field. Let us consider a 2D scalar
function of image intensity I0:R2R, given e.g. by a simple artificial example
plotted in Fig. 1left, and also the function Iσrepresenting a Gaussian smoothing
of the original image, see Fig. 1right.
Figure 1. An example of artificial greyscale 2D image (left) and
smoothed image (right).
In other words, I0(x) = I0(x1, x2) represents a scalar value of the image intensity
in a particular (pixel) coordinates x1and x2. In case of the Sentinel-2 optical data
we work, in general, with a combination of three chosen optical bands, so we consider
the image intensity as a vector function I0:R2R3. However, the main ideas of
our semi-automatic segmentation approach can be simply explained in the scalar
case, so we do it in that way and emphasize arising differences only when necessary.
The smoothed greyscale image intensity function Iσfor the image in Fig. 1
can be also represented by a 3D graph as plotted in Fig. 2left. The boundaries of
segmented areas are usually represented by edges in the image and thus the edges are
the most important features which should attract the evolving segmentation curve.
The image edges can be identified by sharp changes of the smoothed image intensity
which is mathematically characterized by a large value of the norm of image intensity
gradient |∇Iσ(x)|. In Fig. 2right one can see a 3D graph of |∇Iσ(x)|calculated
for our illustrative image from Fig. 1right and its image intensity function plotted
in Fig. 2left.
SEMI-AUTOMATIC SEGMENTATION OF NATURA 2000 HABITATS 3
Figure 2. 3D graph of image intensity function Iσ(x) (left) and
graph of the image intensity gradient norm |∇Iσ(x)|(right), for
the smoothed image in Fig. 1right.
The norm of gradient |∇Iσ(x)|forms an input to an edge detector function g
defined by [11]
g(k, |∇Iσ(x)|) = 1
1 + k|∇Iσ(x)|2,(1)
where kis a so-called scaling factor. The values of g(k, |∇Iσ(x)|) are small along
the image edges and large elsewhere, see Fig. 3.
Figure 3. 3D graph of the edge detector g(|∇Iσ(x)|) for the
smoothed image in Fig. 1right.
Inspired by [3,4] we can define a velocity vector field v(x) by taking the gradient
of the edge detector function with minus sign,
v(x) = −∇g(|∇Iσ(x)|),(2)
and see in Fig. 4that such vector field points always towards the edges in the
image and thus can be used as a force driving segmentation curve always in a
correct direction, to the habitat border lines, see also Fig. 11 in section 4.
4 KAROL MIKULA ET AL.
Figure 4. A visualization of the vector field v(x) for image in
Fig. 1right. We see that arrows points to the edge in the image
from both sides.
2.2. The curve evolving in vector field. Let Γ be an open planar curve, Γ :
[0,1] R2, Γ = {x(t, u), u [0,1]}, depending on time tand let x(t, u) =
(x1(t, u),x2(t, u)) be a position vector of the curve Γ for parameter uin time t. In
the sequel, the curve will be discretized and represented by a set of points. An exam-
ple of an open planar curve discretization is displayed in Fig. 5, where xm
0,xm
1, ..., xm
n
are discrete curve points which correspond to the uniform discretization of the in-
terval [0,1] with spatial step h= 1/n at m-th time with time step τ. Due to the
Dirichlet boundary conditions we have that x(t, 0) = x(0,0) and x(t, 1) = x(0,1),
t > 0.
xm
0=x(0,0)
xm
n=x(0,1)
xm
i1xm
i=x(mτ, ih)
xm
i+1 u= 0 u= 1
Figure 5. An open curve discretization (left) corresponding to the
uniform discretization of parameter u[0,1] (right).
2.2.1. Evolution driven by the vector field. The curve evolution driven by the vector
field v(x) is given by a nonstationary differential equation
xt=v(x),(3)
where xtdenotes a partial derivative of xwith respect to t. In our approach the
segmentation curve evolution begins from a uniformly distributed line segment,
defined by a user e.g. by mouse clicks, which is then moved automatically towards
the edge in the image, see Fig. 6for the discrete curve point evolution to the edge
in the artificial image from Fig. 1.
We can clearly see that such curve evolution brings suitable results for simple
images, however, it can be fairly inaccurate in more complicated cases and it needs
SEMI-AUTOMATIC SEGMENTATION OF NATURA 2000 HABITATS 5
Figure 6. Trajectories of points of a discrete segmentation curve
(red) evolved in the vector field vdriven to the image edge. The
final state of discrete segmentation curve is given by green points
localized on the image edge.
important modifications. Due to the discrete character of the vector field and
evolving curve as well, one of the problems arising is an accumulation of a discrete
curve points during the curve evolution and in the steady state. This phenomenon
is documented in Fig. 7, where more complicated objects were segmented by the
above simple approach, and lead us to a modification of the basic model (3).
Figure 7. Trajectories of points of a discrete segmentation curve
(red) evolved in the vector field vand their final position (green)
visualized over the original image. One can see a problem of non-
uniform distribution of points on evolving discrete segmentation
curve due to non-controlled tangential velocities in the vector field
v.
2.2.2. Ignoring of the uncontrolled tangential velocity component. In general, we can
describe the curve evolution given by Eq. (3) as a motion in normal and tangential
directions
xt=βN+αT,(4)
where αis a tangential velocity, T=xsis a unit tangent vector with sbeing
the arc-length parametrization of the curve Γ, ds =Gdu,G=|xu|,βis a normal
velocity and N=T= ((x2)s,(x1)s) is a unit normal vector.
Although the tangential component of velocity vector does not change the overall
curve shape, it only reparametrizes the curve and moves the points along the curve
in tangential direction, it can cause a non-uniform distribution of points on the
curve, see Fig. 7, and thus serious numerical errors in realistic situations. If we
ignore it, we can eliminate such undesired movements. Therefore, if we start from
uniformly distributed initial abscissa and move it only in normal direction, the
evolving curve will remain almost uniformly discretized, see Fig. 8. In such case,
6 KAROL MIKULA ET AL.
α= 0 in Eq. (4), and we can rewrite the curve evolution equation into the following
form
xt=λvNN,(5)
where λ > 0 is a parameter and the nonlinear term vNrepresents the projection of
velocity vector vonto the normal Nof the moving curve,
vN=v·N.(6)
Removing the non-controlled tangential part of velocity causes better distribution
of curve grid points as can be seen in Fig. 8.
Figure 8. Trajectories of points of a discrete segmentation curve
(red) evolved in the vector field vand their final position (green)
visualized over the original image. An improved distribution of the
curve grid points after removing the tangential component of the
velocity vector field vis obvious.
2.2.3. The regularization by curvature. The mathematical model (5) can be even
more improved and numerically stabilized by incorporating the local curvature in-
formation. Incorporating the curvature yields a sensitivity of the numerical dis-
cretization to a distance of neighbouring points, which ties together discrete points
of the evolving curve. In Fig. 9we illustrate a situation, when the image is less
smoothed and thus the velocity vector field is almost zero in some points of initial
abscissa. Clearly, by using numerically discretized equation (5), these points cannot
move, normal direction is changed and the evolution is not as one desires, see Fig.
9top. On the other hand, incorporating the local curvature influence, we smooth
the evolution, ties all points together in numerical discretization and get the result
plotted in Fig. 9bottom. So we modify the curve evolution equation (5) into the
following form
xt=λvNN+δkN,(7)
where δis a parameter and the term kNrepresents the so-called curvature vector.
From the Frenet equations we get for the curvature vector identities kN=Ts=
xss. Using this we obtain final intrinsic nonlinear partial differential equation for
evolution of the segmentation curve
xt=λvNN+δxss.(8)
The parameters λand δweight the vector field influence and the curvature influence.
SEMI-AUTOMATIC SEGMENTATION OF NATURA 2000 HABITATS 7
Figure 9. Trajectories of points of a discrete segmentation curve
(red) evolved in the vector field vand their final position (green)
visualized over the original image. Top: the curve evolution by
(5) in a less smoothed image when problem of crossing, accumu-
lating and not moving points may arise; bottom: such undesired
behaviour is removed by employing the local curvature influence
into the model (7).
3. Numerical discretization. Let us recall the intrinsic PDE (8) for the open
curve evolution and write it in the following form suitable for numerical discretiza-
tion
xt=δxss +wx
s,(9)
where w=λvN. First, we perform the spatial discretization, which is based on the
flowing finite volume method [9,2,1].
Integrating (9) over the finite volume pi= [xi1
2,xi+1
2], see Fig. 10, where xi1
2
represents the middle point between the points xi1and xiand ds is an integration
element of piecewise linear approximation of original curve, i.e.
xi1
2=xi1+xi
2, i = 1, . . . , n (10)
we get
xi+1
2
Z
xi1
2
xtds =δ
xi+1
2
Z
xi1
2
xssds +w
xi+1
2
Z
xi1
2
x
sds, (11)
where the values δand ware considered constant, with values δiand wion the
discrete curve segment piaround the point xi. We define hi=|xixi1|, then the
measure of the segment piis equal to hi+hi+1
2. Using the Newton-Leibniz formula,
(10) and using approximation of the arc-length derivative xsby a finite difference
8 KAROL MIKULA ET AL.
xi
xi1
xi+2
xi+3
xi2
xi3
xi+1
xi
3
2
xi
5
2
pi1
xi
1
2
xi+1
2
xi+3
2
xi+5
2
pi
Figure 10. Visualization of the curve discretization [1] curve grid
points (red), discrete curve segments (different colors) and the mid-
points (black). Finite volumes pi1,pi,and pi+1 are highlighted
by green, brown and yellow color. Note that piis not a straight
line given by xi1
2and xi+1
2, but a broken line given by xi1
2,xi
and xi+1
2.
we get semi-discrete flowing finite volume scheme
hi+hi+1
2(xi)t=δixi+1 xi
hi+1
xixi1
hi+wixi+1 xi1
2
,(12)
for i= 1, ..., n1. In order to perform the time discretization, let us denote by mthe
time step index and by τthe length of the discrete time step. Let us approximate
the time derivative by the finite difference (xi)t=xm+1
ixm
i
τ. Approximating both
the vector field term and the curvature term explicitly we obtain the fully discrete
explicit scheme
xm+1
i=xm
i+τδm
i
2
hm
i+1 +hm
ixm
i+1 xm
i
hm
i+1
xm
ixm
i1
hm
i(13)
+τwm
ixm
i+1 xm
i1
hm
i+1 +hm
i
for i= 1, ..., n 1, where nis the number of the curve grid points. Due to boundary
conditions we have xm
0=x0
0and xm
n=x0
n. The parameter wm
iis given as follows
wm
i=λvN
m
i=λv(xm
i)·Nm
i=λv(xm
i).xm
i+1 xm
i1
hm
i+1 +hm
i
.(14)
4. Numerical experiments. In the first numerical experiment, we show behaviour
of the model (7) in real data. As one can see in Fig. 11, the model (7) and its
numerical discretization (13) cause a regular, almost uniform distribution of grid
points during the evolution and in the segmentation result. Moreover, the numer-
ical scheme (13) can be efficiently implemented and allows real-time segmentation
of habitats.
We note here that in the segmentation of real data we use three optical channels
and thus we consider the vector image intensity function I0defined at the beginning
of section 2.1. However, the only change in the mathematical model (7) and its
numerical discretization (13) is that, instead of the norm of gradient of the scalar
SEMI-AUTOMATIC SEGMENTATION OF NATURA 2000 HABITATS 9
image intensity Iσin Eq. (2) we consider the average of norms of gradients of image
intensities in all three channels. Moreover, in our implementation, the Gaussian
convolution is realized numerically by solving the linear heat equation in one discrete
time step using the implicit scheme. The coefficients k, λ and δare chosen by
the user such that the semi-automatic method would give desired results. These
coefficients can be changed during the segmentation, which is natural for such real
time method.
Figure 11. A discrete segmentation curve evolving to habitat
boundary in a real 3-band Sentinel-2 optical image. The green
color shows trajectories of moving discrete curve points and blue
points represents the result of segmentation of this particular sec-
tion of the habitat border.
In Fig. 11 we present just one section of the segmentation curve and it illustrates
the procedure how a user performs semi-automatic segmentation. The user clicks
the mouse at some correctly chosen point on the habitat boundary and drag the
mouse along the expected habitat boundary. The algorithm always connects the first
clicked point with the last mouse position, constructs the straight line between them
and in real-time adjusts this line to the habitat border by using the numerical scheme
(13). When the user is satisfied with the detected borderline, clicks the mouse again
and that portion of segmentation is finished. By repeating the procedure the user
can continue along the borderline and eventually he clicks on the first point of the
first segment to close the boundary curve. We illustrate this consecutive procedure
in Fig. 12.
4.1. Comparison of discrete curves. After performing the semi-automatic seg-
mentation of habitats in Sentinel-2 data, we compare the segmentation results with
the GPS tracks obtained by botanists in the field. For this quantitative compar-
ison of two curves we use the classical (maximal) Hausdorff distance [12] and the
so-called mean Hausdorff distance, see e.g. [6], which are general tools for comput-
ing distance of curves, surfaces and even more complicated geometrical continuous
or discrete objects (sets). The mean Hausdorff distance dH(A, B ) is given by the
10 KAROL MIKULA ET AL.
Figure 12. An example of the semi-automatic segmentation
showing consecutive building of the segmentation curve (yellow),
the final result is on the bottom right.
SEMI-AUTOMATIC SEGMENTATION OF NATURA 2000 HABITATS 11
following formulae
δH(A, B) = 1
n
n
X
i=1
min
bBd(ai, b),δH(B, A) = 1
m
m
X
i=1
min
aAd(a, bi),(15)
dH(A, B) = δH(A, B) + δH(B, A)
2,(16)
where d(ai, b) is Euclidean distance of two points aiand bfrom the point sets
A={a1, a2, a3, ..., an}and B={b1, b2, b3, ..., bm}, and the maximal Hausdorff
distance dH(A, B), given as
dH(A, B) = max sup
aA
inf
bB
d(a, b),sup
bB
inf
aA
d(a, b).(17)
In order to test reliability and usability of the semi-automatic segmentation
method, together 24 areas of riparian forests - Natura 2000 habitat 91F0 Ripar-
ian mixed forests along the great river - were tracked by GPS device. Due to the
variable borders, they are suitable for testing the ability and performance of devel-
oped semi-automatic segmentation tool to detect accurately their shape. In case of
problems in the field, mainly due to flooded parts of forests where it was impossible
to walk around, some GPS tracks were corrected in the Google Earth Pro soft-
ware. The mean Hausdorff distance is in average 11.48 m which is very close to the
pixel resolution (10m) of Sentinel-2 data. This means that by the semi-automatic
segmentation we are able to detect habitat borders as accurately as the image reso-
lution allows. Maximal Hausdorff distance is in average about 58m, what represents
5-6 pixels. Some differences can be found only in areas with cotone zones where
tree dominated riparian forests are connected to surrounding meadows or fields by
shrub dominated zone, see Figs. 13 and 14.
Next, 18 areas of Natura 2000 habitat 4070* Bushes with Pinus mugo and Rhodo-
dendron hirsutum (Mugo-Rhododendretum hirsuti) were tracked in various moun-
tain ranges in Slovakia (Mal´a Fatra Mts., apadn´e Tatry Mts., ızke Tatry Mts.,
Choˇcsk´e vrchy Mts. and Oravsk´e Beskydy Mts.). Bushes with Pinus mugo usu-
ally form large areas of diversified shape, discontinued by avalanche gullies, small
mountain creeks or by glacially formed moraines. Considering this fact, the correct
semi-automatic segmentation is a challenging task. Moreover, the field mapping
of habitat borders in high-altitude rugged terrain is very complicated and time-
consuming, so using the satellite image segmentation methods seem to be very ef-
ficient and promising way of monitoring this habitat. In general, we observed that
the mean Hausdorff distances of GPS tracked and semi-automatically segmented
borders of bushes with Pinus mugo areas are also close to the pixel resolution of
Sentinel-2 data, 13.9m in average of all 18 areas. The maximal Hausdorff distances
are in general bigger than those observed in the areas of riparian forests. Bushes
with Pinus mugo grow on large areas connected with the mountain spruce forests.
Some extreme values of the maximal Hausdorff distance are caused by the “ecotone
zone” where botanist in the field takes subjective decision about the habitat border,
for illustration of such problematic areas see Figs. 15 and 16.
5. Conclusions. In this paper we proposed a semi-automatic segmentation method
of Natura 2000 habitats in Sentinel-2 optical data. We discussed the segmentation
curve velocity vector field design and described the curve evolution numerical al-
gorithm using the explicit scheme allowing real-time boundary tracking. We also
12 KAROL MIKULA ET AL.
Figure 13. Semi-automatic segmentation (yellow) and GPS track
(light-blue) with almost exact overlap. The maximal Haussdorff
distance is 62.1m and the mean Hausdorff distance is 14.0m in this
case, which means that we obtained almost the pixel resolution
(10m) accuracy.
presented numerical experiments using Sentinel-2 optical images. The comparison
of areas obtained by the semi-automatic segmentation and by the GPS tracking in
the field shows that we can get the accuracy compared to the pixel resolution of
Sentinel-2 data. Some further improvements of the numerical model, e.g. asymptot-
ically uniform curve grid point redistribution, will be treated in the future together
with the implementation of the semi-implicit scheme. Here the real-time perfor-
mance of the method will be also a discretization quality criterion.
REFERENCES
[1] M. Ambroz, M. Balaˇzovjech, M. Medla and K. Mikula, Numerical modeling of wildland
surface fire propagation by evolving surface curves,Advances in Computational Mathematics,
45 (2019), 1067–1103.
[2] M. Balaˇzovjech, K. Mikula, M. Petr´sov´a and J. Urb´an, Lagrangean method with topological
changes for numerical modelling of forest fire propagation, Proceedings of ALGORITMY,
(2012), 42–52.
[3] V. Caselles, R. Kimmel and G. Sapiro, Geodesic active contours,International Journal of
Computer Vision,22 (1997), 61–79.
[4] S. Kichenassamy, A. Kumar, P. Olver, A. Tannenbaum and A. Yezzi, Jr., Conformal curvature
flows: From phase transitions to active vision,Arch. Rational Mech. Anal.,134 (1996), 275–
301.
[5] M. Kol´r, M. Beneˇs and D. ˇ
Sevˇcoviˇc, Computational analysis of the conserved curvature
driven flow for open curves in the plane,Mathematics and Computers in Simulation,126
(2016), 1–13.
[6] Z. Kriv´a, K. Mikula, M. Peyri´eras, B. Rizzi, A. Sarti and O. Staˇsov´a , 3D early embryogenesis
image filtering by nonlinear partial differential equations, Medical Image Analysis,14 (2010),
510–526.
SEMI-AUTOMATIC SEGMENTATION OF NATURA 2000 HABITATS 13
Figure 14. An example of a complicated border of the riparian
forest. We compare the semi-automatic segmentation (yellow) and
GPS track (light-blue). The mean Haussdorff distance is 12.0m and
the maximal Haussdorff distance, in this case, is 62.1m, indicating
correctly discrepancy in habitat area estimate in the field and by
employing the Sentinel-2 optical data.
[7] K. Mikula and D. ˇ
Sevˇcoviˇc, Computational and qualitative aspects of evolution of curves
driven by curvature and external force,Computing and Visualization in Science,6(2004),
211–225.
[8] K. Mikula and D. ˇ
Sevˇcoviˇc, Evolution of curves on a surface driven by the geodesic curvature
and external force,Applicable Analysis,85 (2006), 345–362.
[9] K. Mikula, D. ˇ
Sevˇcoviˇc and M. Balaˇzovjech, A simple, fast and stabilized flowing finite volume
method for solving general curve evolution equations,Communications in Computational
Physics,7(2010), 195–211.
[10] P. Pauˇs, M. Beneˇs, M. Kol´r and J. Kratochv´ıl, Dynamics of dislocations described as evolv-
ing curves interacting with obstacles, Modelling and Simulation in Materials Science and
Engineering,24 (2016), 34 pp.
[11] P. Perona and J. Malik, Scale space and edge detection using anisotropic diffusion,Proceedings
of the IEEE Society Workshop on Computer Vision,12 (1987), 629–639.
[12] Hausdorff distance, 20 12 2018, https://en.wikipedia.org/wiki/Hausdorff_distance.
Received January 2019; revised September 2019.
E-mail address:mikula@math.sk
E-mail address:jozo.urban@gmail.com
E-mail address:michalkollar27@gmail.com
E-mail address:ambroz.martin.ml@gmail.com
E-mail address:ivan.jarolimek@savba.sk
E-mail address:jozef.sibik@savba.sk
E-mail address:maria.sibikova@savba.sk
14 KAROL MIKULA ET AL.
Figure 15. The locality with the highest, 413.3m, maximal Haus-
dorff distance between semi-automatically segmented and GPS
tracked curves among bushes with Pinus mugo tested areas, here
also the mean Hausdorff distance was the highest, 44.8m. On the
North-West habitat border, we can see the “ecotone zone” that
was included during field tracking (light-blue) and excluded by us-
ing the semi-automatic segmentation (yellow).
Figure 16. The locality dominated by Pinus mugo with the “eco-
tone zone” that was included during the field tracking (light-blue)
and excluded by using the semi-automatic segmentation (yellow).
The mean Hausdorff distance is 19.1m and the maximal Hausdorff
distance is 171.0m.
... The satellite image segmentation methods used in the present study are one such tool [31][32][33] . They work based on evolving planar curves and are efficient and robust segmentation tools when an "initial estimate" of the desired area is available. ...
... The software allows a user to focus the Sentinel-2 image to the selected habitat occurrence indicating point and then allows a user to perform either semiautomatic 32 or automatic 33 segmentation by evolving the initial curve, either in the form of a straight line or automatically chosen image isoline (semiautomatic segmentation) or in the form of a small circle (or circles) or a small square (automatic segmentation). The segmentation curve is evolved by a general mathematical model including homogeneity and edge detector driving forces and curvature influence 32,33,45 . ...
... Semiautomatic segmentation requires user interaction. The user clicks the mouse at some correctly chosen point on the habitat boundary and drags the mouse along the expected habitat boundary-the algorithm always connects the first clicked point with the last mouse position, constructs the initial curve between them and adjusts this line to the habitat border in real time by using the numerical scheme 32,45 . The overall segmentation results are given by an interconnection of several open curve segments. ...
Article
Full-text available
Natura 2000 is a network of protected areas covering Europe's most valuable and threatened species and habitats. Recently, biota belonging to these networks have been threatened by both climate change and various human impacts. Regular monitoring is needed to ensure effective protection and proper management measures in these sites and habitats, but conventional field approaches are often time-consuming and inaccurate. New approaches and studies with different focuses and results are being developed. Our approach includes point data from field research and phytosociological databases as starting points for automatic segmentation, which has been developed just recently as a novel method that could help to connect ground-based and remote sensing data. Our case study is located in Central Slovakia, in the mountains around the village of Čierny Balog. The main aim of our case study is to apply advanced remote sensing techniques to map the area and condition of vegetation units. We focus on forest habitats belonging mainly to the Natura 2000 network. We concentrated on the verification of the possibilities of differentiation of various habitats using only multispectral Sentinel-2 satellite data. Our software NaturaSat created by our team was used to reach our objectives. After collecting data in the field using phytosociological approach and segmenting the explored areas in the program NaturaSat, spectral characteristics were calculated within identified habitats using software tools, which were subsequently processed and tested statistically. We obtained significant differences between forest habitat types. Also, segmentation accuracy was tested by comparing closed planar curves of ground based filed data and software results. This provided promising results and validation of the methods used. The results of this study have the potential to be used in a wider area to map the occurrence and quality of Natura 2000 habitats.
... The satellite image segmentation methods used in the present study are one such tool [31][32][33]. They work based on evolving planar curves and are e cient and robust segmentation tools when an "initial estimate" of the desired area is available. ...
... NaturaSat software integrates various image-processing techniques together with vegetation data management [31]. The software allows a user to focus the Sentinel-2 image to the selected habitat occurrence indicating point and then allows a user to perform either semiautomatic [32] or automatic [33] segmentation by evolving the initial curve, either in the form of a straight line or automatically chosen image isoline (semiautomatic segmentation) or in the form of a small circle (or circles) or a small square (automatic segmentation). The segmentation curve is evolved by a general mathematical model including homogeneity and edge detector driving forces and curvature in uence [32,33,45]. ...
... The software allows a user to focus the Sentinel-2 image to the selected habitat occurrence indicating point and then allows a user to perform either semiautomatic [32] or automatic [33] segmentation by evolving the initial curve, either in the form of a straight line or automatically chosen image isoline (semiautomatic segmentation) or in the form of a small circle (or circles) or a small square (automatic segmentation). The segmentation curve is evolved by a general mathematical model including homogeneity and edge detector driving forces and curvature in uence [32,33,45]. ...
Preprint
Full-text available
Natura 2000 is a network of protected areas covering Europe's most valuable and threatened species and habitats. Recently, biota belonging to these networks have been threatened by both climate change and various human impacts. Regular monitoring is needed to ensure effective protection and proper management measures in these sites and habitats, but conventional field approaches are often time-consuming and inaccurate. New approaches and studies with different focuses and results are being developed. Our approach includes point data from field research and phytosociological databases as starting points for automatic segmentation, which has been developed just recently as a novel method that could help to connect ground-based and remote sensing data. The main aim of our case study is to apply advanced remotely sensed techniques to map the area and condition of vegetation units. We focus on forest habitats belonging mainly to the Natura 2000 network in the area of Čierny Balog village (Central Slovakia). We concentrated on the verification of the possibilities of differentiation of various habitats using only multispectral Sentinel-2 satellite data. New software created by our team called NaturaSat was used to reach our objectives. In the identified areas, spectral characteristics were calculated using software tools, which were subsequently processed and tested statistically. We obtained significant differences between forest habitat types that provided promising results and verification of the methods used. This type of new habitat identification is necessary for the automatic monitoring of habitat areas and changes in conditions by remote sensing.
... The boundaries of the segmented regions from the automatic and semi-automatic methods are extracted for this. The semi-automatic segmentation method, based on the Lagrangian approach [73], is done by an expert to create the "gold standard" for comparison, see also [33]. For the quantitative comparison, we choose two macrophages (the first and fifth macrophages in Fig. 8). ...
... Also, a part of the background that does not appear any macrophage over time was cropped to check additionally whether the background noise is segmented as an object or not. The accuracy of the automatic segmentation was computed by comparing it with the images obtained by the semi-automatic segmentation (gold standard) [73]. ...
Preprint
Full-text available
The automated segmentation and tracking of macrophages during their migration are challenging tasks due to their dynamically changing shapes and motions. This paper proposes a new algorithm to achieve automatic cell tracking in time-lapse microscopy macrophage data. First, we design a segmentation method employing space-time filtering, local Otsu's thresholding, and the SUBSURF (subjective surface segmentation) method. Next, the partial trajectories for cells overlapping in the temporal direction are extracted in the segmented images. Finally, the extracted trajectories are linked by considering their direction of movement. The segmented images and the obtained trajectories from the proposed method are compared with those of the semi-automatic segmentation and manual tracking. The proposed tracking achieved 97.4% of accuracy for macrophage data under challenging situations, feeble fluorescent intensity, irregular shapes, and motion of macrophages. We expect that the automatically extracted trajectories of macrophages can provide pieces of evidence of how macrophages migrate depending on their polarization modes in the situation, such as during wound healing.
... The boundaries of the segmented regions from the automatic and semi-automatic methods are extracted for this. The semi-automatic segmentation method, based on the Lagrangian approach [73], is done by an expert to create the "gold standard" for comparison, see also [33]. For the quantitative comparison, we choose two macrophages (the first and fifth macrophages in Fig. 8). ...
... Also, a part of the background that does not appear any macrophage over time was cropped to check additionally whether the background noise is segmented as an object or not. The accuracy of the automatic segmentation was computed by comparing it with the images obtained by the semi-automatic segmentation (gold standard) [73]. ...
Article
Full-text available
The automated segmentation and tracking of macrophages during their migration are challenging tasks due to their dynamically changing shapes and motions. This paper proposes anew algorithm to achieve automatic cell tracking in time-lapse microscopy macrophage data. First, we design a segmentation method employing space-time filtering, local Otsu’s thresholding, and the SUBSURF (subjective surface segmentation) method. Next, the partial trajectories for cells overlapping in the temporal direction are extracted in the segmented images. Finally, the extracted trajectories are linked by considering their direction of movement. The segmented images and the obtained trajectories from the proposed method are compared with those of the semi-automatic segmentation and manual tracking. The proposed tracking achieved 97.4% of accuracy for macrophage data under challenging situations, feeble fluorescent intensity, irregular shapes, and motion of macrophages. We expect that the automatically extracted trajectories of macrophages can provide pieces of evidence of how macrophages migrate depending on their polarization modes in the situation, such as during wound healing.
... NaturaSat provides two segmentation methods: semi-automatic [14] and automatic segmentation models [15]. Both methods are based on a robust implementation of Lagrangian curve (we call it also polygon) evolution models, featuring tangential redistribution of evolving curve points and efficient handling of topological changes, such as the splitting and merging of evolving curves. ...
Article
Full-text available
Wetlands, areas that are permanently or seasonally flooded or saturated with water, are among the most productive and biodiverse ecosystems on the planet. Their conservation, revitalization and health status monitoring require the hydrological modelling. We introduce the novel hydrological modelling tool in the NaturaSat software and show the useful workflows supporting environmental control and informed decisions. The tool is based on numerical solution of the Laplace equation with Dirichlet boundary conditions on a triangular grid using the complementary volume method. We present results for a case study of the Foráš Nature Reserve in Slovakia, in the alluvium of Danube River, demonstrating the practical application of developed methods. By comparing the solution with the Digital Terrain Model we study the waterlogging status of the most important wetland habitats in the area, and complement the results by analysis of Sentinel-1 radar satellite data and Sentinel-2 optical satellite data.
... As depicted in the first row of Fig. 4.1, the alluvial areas of the Danube River are shown on the Sentinel-2 image on the left, while the relevancy map for the riparian forest from the Danube River alluvial areas is displayed on the right. Additionally, segmented regions denoting natural riparian forests (yellow curves) and planted riparian forests (red curves), provided by botany experts from the Plant Science and Biodiversity Centre SAS using semi-automatic and automatic segmentation methods [12,11], are illustrated in all subfigures of Fig. 4.1. One can see that the interior of the yellow segmented areas exhibits white colours, indicating high relevancy for the riparian forest habitat. ...
Conference Paper
Full-text available
This paper explores the graph-Laplacian operator and its application in image classification tasks, focusing on its effectiveness in capturing local variation and structural properties of data. We investigate its mathematical formulation, practical implementation, and usability in biodiversity modelling, extending Laplace operator application from the physical domain to graph structures. Our research proposes a novel methodology for identifying and classifying natural riparian forests with high biodiversity value from optical satellite imagery. We combine graph-Laplacian analysis with relevancy maps generated by the Natural Numerical Network to distinguish between natural and planted riparian forests. Furthermore, we explore graph-Laplacian as a statistical characteristic of Sentinel-2 optical bands in constructing the Natural Numerical Network. Numerical experiments and case studies highlight the applicability of the graph-Laplacian operator in environmental science, describing its potential in biodiversity modelling and protected habitat identification.
... , N C , and N C = 4. All habitat areas borders were semi-automatically segmented in NaturaSat software [24,25] and checked in the field by botany experts during vegetation seasons of 2019 and 2020. There were 125 areas segmented in red, green, blue and near-infrared channels of Sentinel-2 data [18]. ...
Article
Full-text available
Natural numerical networks are introduced as a new classification algorithm based on the numerical solution of nonlinear partial differential equations of forward-backward diffusion type on complete graphs. The proposed natural numerical network is applied to open important environmental and nature conservation task, the automated identification of protected habitats by using satellite images. In the natural numerical network, the forward diffusion causes the movement of points in a feature space toward each other. The opposite effect, keeping the points away from each other, is caused by backward diffusion. This yields the desired classification. The natural numerical network contains a few parameters that are optimized in the learning phase of the method. After learning parameters and optimizing the topology of the network graph, classification necessary for habitat identification is performed. A relevancy map for each habitat is introduced as a tool for validating the classification and finding new Natura 2000 habitat appearances.
... NaturaSat software integrates various image-processing techniques together with vegetation data management(Mikula et al. 2021a). The software allows a user to focus the Sentinel-2 image to the selected habitat occurrence indicating point and then allows a user to perform either semiautomatic(Mikula et al. 2021b) or automatic (Mikula et al. 2021c) segmentation by evolving the initial curve, either in the form of a straight line or automatically chosen image isoline (semiautomatic segmentation) or in the form of a small circle (or circles) or a small square (automatic segmentation). The segmentation curve is evolved by a general mathematical model including homogeneity and edge detector driving forces and curvature in uence (Ambroz et al. 2020, Mikula et al. 2021b,c). ...
Preprint
Full-text available
Natura 2000 is a network of protected areas covering Europe's most valuable and threatened species and habitats. Recently, biota belonging to these networks have been threatened by both climate change and various human impacts. Regular monitoring is needed to ensure effective protection and proper management measures in these sites and habitats, but conventional field approaches are often time-consuming and inaccurate. New approaches and studies with different focuses and results are being developed. Our approach includes point data from field research and phytosociological databases as starting points for automatic segmentation, which has been developed just recently as a novel method that could help to connect ground-based and remote sensing data. The main aim of our case study is to apply advanced remotely sensed techniques to map the area and condition of vegetation units. We focus on forest habitats belonging mainly to the Natura 2000 network in the area of Čierny Balog village (Central Slovakia). We concentrated on the verification of the possibilities of differentiation of various habitats using only multispectral Sentinel-2 satellite data. New software created by our team called NaturaSat was used to reach our objectives. In the identified areas, spectral characteristics were calculated using software tools, which were subsequently processed and tested statistically. We obtained significant differences between forest habitat types that provided promising results and verification of the methods used. This type of new habitat identification is necessary for the automatic monitoring of habitat areas and changes in conditions by remote sensing.
Article
Full-text available
Landscape changes caused by climate change require new methods for forest research, analysis, mapping, and monitoring. This study aims to combine ground-based and remote sensing data utilizing deep learning techniques to map protected forest habitats and communities within the Natura 2000 network. The study also seeks to evaluate the accuracy of this approach, specifically in oak-dominated forests, as well as identify the optimal time period within a year for effective habitat identification. Using the specialized software NaturaSat, automated segmentations were performed using phytosociological relevés coordinates and database-based forest strands. Oak-dominated forest habitats were differentiated solely through multispectral data obtained from Sentinel-2 satellites. A dataset was selected for the training of a deep learning algorithm called the Natural Numerical Network on the bases of the analysis results. This algorithm aims to create a prediction map of habitats dominated by Quercus cerris, which is also known as the relevancy map. Through the utilization of the Natural Numerical Network, a training accuracy of 95.24% was achieved. Field validation, which was conducted at randomly generated locations within the relevancy map, yielded an accuracy of 98.33%. The most distinguishing differences in band characteristics between the two oak-dominated habitats were observed during the autumn months. This study presents a framework that integrates terrestrial and remote sensing data. This method can serve as a basis for mapping forest habitats and observing changes related to climate change. Moreover, it contributes to the documentation of nature conservation and the mapping of landscapes.
Article
Full-text available
The paper deals with the multichannel curve segmentation of planar point clouds, scanned by a terrestrial laser scanner (TLS), which usually represent walls of buildings. Information derived from the point cloud can be used for quality check of a building (e.g. wall flatness or mutual perpendicularity of walls) or creation of virtual models of buildings. Therefore, segmentation of the planar point cloud into subsets representing the surface of the wall and other structures (e.g. door, electrical outlets) is desired. We describe a mathematical model of evolving planar curves, which is used for the segmentation of the point cloud. The evolution of curves is controlled by the properties of the scanned walls, such as colour and intensity. We discretize the model using the finite-volume method and the semi-implicit Inflow-Implicit/Outflow-Explicit (IIOE) scheme. We demonstrate the functionality of segmentation on real data.
Article
Full-text available
We introduce a new approach to wildland fire spread modeling. We evolve a 3-D surface curve, which represents the fire perimeter on the topography, as a projection to a horizontal plane. Our mathematical model is based on the empirical laws of the fire spread influenced by the fuel, wind, terrain slope, and shape of the fire perimeter with respect to the topography (geodesic and normal curvatures). To obtain the numerical solution, we discretize the arising intrinsic partial differential equation by a semi-implicit scheme with respect to the curvature term. For the advection term discretization, we use the so-called inflow-implicit/outflow-explicit approach and an implicit upwind technique which guarantee the solvability of the corresponding linear systems by an efficient tridiagonal solver without any time step restriction and also the robustness with respect to singularities. A fast treatment of topological changes (splitting and merging of the curves) is described and shown on examples as well. We show the experimental order of convergence of the numerical scheme, we demonstrate the influence of the fire spread model parameters on a testing and real topography, and we reconstruct a simulated grassland fire as well.
Article
Full-text available
In this paper we describe the model of glide dislocation interaction with obstacles based on the planar curve dynamics. The dislocations are represented as smooth curves evolving in a slip plane according to the mean curvature motion law, and are mathematically described by the parametric approach. We enhance the parametric model by employing so called tangential redistribution of curve points to increase the stability during numerical computation. We developed additional algorithms for topological changes (i.e. merging and splitting of dislocation curves) enabling a detailed modelling of dislocation interaction with obstacles. The evolving dislocations are approximated as a moving piece-wise linear curves. The obstacles are represented as idealized circular areas of a repulsive stress. Our model is numerically solved by means of semi-implicit flowing finite volume method. We present results of qualitative and quantitative computational studies where we demonstrate the topological changes and discuss the effect of tangential redistribution of curve points on computational results.
Article
Full-text available
In this paper, we analyze geometric active contour models from a curve evolution point of view and propose some modifications based on gradient flows relative to certain new feature-based Riemannian metrics. This leads to a novel edge-detection paradigm in which the feature of interest may be considered to lie at the bottom of a potential well. Thus an edge-seeking curve is attracted very naturally and efficiently to the desired feature. Comparison with the Allen-Cahn model clarifies some of the choices made in these models, and suggests inhomogeneous models which may in return be useful in phase transitions. We also consider some 3-dimensional active surface models based on these ideas. The justification of this model rests on the careful study of the viscosity solutions of evolution equations derived from a level-set approach.
Article
Full-text available
We propose a direct method for solving the evolution of plane curves satisfying the geometric equation v=(x,k,) where v is the normal velocity, k and are the curvature and tangential angle of a plane curve R2 at a point x. We derive and analyze the governing system of partial differential equations for the curvature, tangential angle, local length and position vector of an evolving family of plane curves. The governing equations include a nontrivial tangential velocity functional yielding uniform redistribution of grid points along the evolving family of curves preventing thus numerically computed solutions from forming various instabilities. We also propose a full space-time discretization of the governing system of equations and study its experimental order of convergence. Several computational examples of evolution of plane curves driven by curvature and external force as well as the geodesic curvatures driven evolution of curves on various complex surfaces are presented in this paper.
Article
Full-text available
A novel scheme for the detection of object boundaries is presented. The technique is based on active contours evolving in time according to intrinsic geometric measures of the image. The evolving contours naturally split and merge, allowing the simultaneous detection of several objects and both interior and exterior boundaries. The proposed approach is based on the relation between active contours and the computation of geodesics or minimal distance curves. The minimal distance curve lays in a Riemannian space whose metric is defined by the image content. This geodesic approach for object segmentation allows to connect classical "snakes" based on energy minimization and geometric active contours based on the theory of curve evolution. Previous models of geometric active contours are improved, allowing stable boundary detection when their gradients suffer from large variations, including gaps. Formal results concerning existence, uniqueness, stability, and correctness of the evolution a...
Article
Full-text available
We present nonlinear diffusion equations, numerical schemes to solve them and their application for filtering 3D images obtained from laser scanning microscopy (LSM) of living zebrafish embryos, with a goal to identify the optimal filtering method and its parameters. In the large scale applications dealing with analysis of 3D+time embryogenesis images, an important objective is a correct detection of the number and position of cell nuclei yielding the spatio-temporal cell lineage tree of embryogenesis. The filtering is the first and necessary step of the image analysis chain and must lead to correct results, removing the noise, sharpening the nuclei edges and correcting the acquisition errors related to spuriously connected subregions. In this paper we study such properties for the regularized Perona-Malik model and for the generalized mean curvature flow equations in the level-set formulation. A comparison with other nonlinear diffusion filters, like tensor anisotropic diffusion and Beltrami flow, is also included. All numerical schemes are based on the same discretization principles, i.e. finite volume method in space and semi-implicit scheme in time, for solving nonlinear partial differential equations. These numerical schemes are unconditionally stable, fast and naturally parallelizable. The filtering results are evaluated and compared first using the Mean Hausdorff distance between a gold standard and different isosurfaces of original and filtered data. Then, the number of isosurface connected components in a region of interest (ROI) detected in original and after the filtering is compared with the corresponding correct number of nuclei in the gold standard. Such analysis proves the robustness and reliability of the edge preserving nonlinear diffusion filtering for this type of data and lead to finding the optimal filtering parameters for the studied models and numerical schemes. Further comparisons consist in ability of splitting the very close objects which are artificially connected due to acquisition error intrinsically linked to physics of LSM. In all studied aspects it turned out that the nonlinear diffusion filter which is called geodesic mean curvature flow (GMCF) has the best performance.
Article
The paper studies the constrained curvature flow for open planar curves with fixed endpoints by means of its numerical solution. This law originates in the theory of phase transitions for crystalline materials and where it describes the evolution of closed embedded curves with constant enclosed area. We show that the area is preserved for open curves with fixed endpoints as well. Here, the area is given by the curve and its ends connected to the origin of coordinates. We provide the form of the stationary solution towards which any other solution converges asymptotically in time. The evolution law is reformulated by means of the direct method into the system of degenerate parabolic partial differential equations for the curve parametrization. This system is spatially discretized by means of the flowing finite volumes method and solved numerically by the explicit Runge-Kutta solver. We experimentally investigate the order of approximation of the scheme by means of our numerical data and by knowing the analytical solution. We also discuss the role of the suitable tangential redistribution. For this purpose, several computational studies related to the open curve dynamics are presented.
Article
We study a flow of closed curves on a given graph surface driven by the geodesic curvature and external force. Using vertical projection of surface curves to the plane we show how the geodesic curvature-driven flow can be reduced to a solution of a fully nonlinear system of parabolic differential equations. We show that the flow of surface curves is gradient-like, i.e. there exists a Lyapunov functional nonincreasing along trajectories. Special attention is placed on the analysis of closed stationary surface curves. We present sufficient conditions for their dynamic stability. Several computational examples of evolution of surface curves driven by the geodesic curvature and external force on various surfaces are presented in this article. We also discuss a link between the geodesic flow and the edge detection problem arising from the image segmentation theory.
Article
A new definition of scale-space is suggested, and a class of algorithms used to realize a diffusion process is introduced. The diffusion coefficient is chosen to vary spatially in such a way as to encourage intraregion smoothing rather than interregion smoothing. It is shown that the `no new maxima should be generated at coarse scales' property of conventional scale space is preserved. As the region boundaries in the approach remain sharp, a high-quality edge detector which successfully exploits global information is obtained. Experimental results are shown on a number of images. Parallel hardware implementations are made feasible because the algorithm involves elementary, local operations replicated over the image