ArticlePDF Available

Restoration of the missing pixel information caused by contrails in multispectral remotely sensed imagery

Authors:

Abstract and Figures

Although removing the pixels covered by contrails and their shadows and restoring the missing information at the locations in remotely sensed imagery are important to understand contrails' effects on climate change, there are no such studies in the current literature. This study investigates the restoration of the missing information of the pixels caused by contrails in multispectral remotely sensed Landsat 5 TM imagery using a cokriging approach. Interpolation results and several validation methods show that it is practical to use the cokriging approach to restore the contrail-covered pixels in the multispectral remotely sensed imagery. Compared to ordinary kriging, the results are improved by taking advantage of both the spatial information in the original imagery and information from the secondary imagery.
Content may be subject to copyright.
Restoration of the missing pixel
information caused by contrails in
multispectral remotely sensed
imagery
Daxiang Zhang
Chuanrong Zhang
Weidong Li
Robert Cromley
Dean Hanink
Daniel Civco
David Travis
Restoration of the missing pixel information caused by
contrails in multispectral remotely sensed imagery
Daxiang Zhang,aChuanrong Zhang,aWeidong Li,aRobert Cromley,a
Dean Hanink,aDaniel Civco,band David Travisc
aUniversity of Connecticut, Center for Environmental Sciences and Engineering, Department
of Geography, Storrs, Connecticut 06269
chuanrong.zhang@uconn.edu
bUniversity of Connecticut, Department of Natural Resources and the Environment, Storrs,
Connecticut 06269
cUniversity of Wisconsin-Whitewater, Department of Geography and Geology, Whitewater,
Wisconsin 53190
Abstract. Although removing the pixels covered by contrails and their shadows and restoring
the missing information at the locations in remotely sensed imagery are important to understand
contrailseffects on climate change, there are no such studies in the current literature. This study
investigates the restoration of the missing information of the pixels caused by contrails in multi-
spectral remotely sensed Landsat 5 TM imagery using a cokriging approach. Interpolation
results and several validation methods show that it is practical to use the cokriging approach to
restore the contrail-covered pixels in the multispectral remotely sensed imagery. Compared to
ordinary kriging, the results are improved by taking advantage of both the spatial information in
the original imagery and information from the secondary imagery. ©2014 Society of Photo-Optical
Instrumentation Engineers (SPIE) [DOI: 10.1117/1.JRS.8.083698]
Keywords: restoration; contrail; remotely sensed images; geostatistics; cokriging.
Paper 13030 received Jan. 30, 2013; revised manuscript received Nov. 29, 2013; accepted for
publication Dec. 4, 2013; published online Jan. 6, 2014.
1 Introduction
Aircraft-generated contrails are the visible trails of condensed water vapor made by the exhaust
of aircraft engines in sufficiently cold air. The aircraft-generated contrails and their resulting
cirrus clouds have the positive (warming) component from the contrailsgreenhouse effect
[longwave contrail radiative forcing (CRF)] and the negative (cooling) component from the
backscattering of solar irradiance (shortwave CRF). The net radiative forcing, that is, the differ-
ence between radiant energy received by the earth and energy radiated back to space, depends on
the longwave/shortwave cancellation. The aircraft-generated contrails and their resulting cirrus
clouds may exacerbate climate warming in subregions characterized by frequent commercial
flights and may have a potential influence on climate change.1Similar to that of an aircrafts
carbon dioxide (CO2) emissions, the aircraft-generated contrails contribute to the greenhouse
effect by trapping heat in the Earths atmosphere. In addition, a significant amount of high-
level thin cloudiness can be added over high-traffic areas because of the aircraft-generated con-
trails,2and the addition of high thin cloudiness may trap energy in the atmosphere and lead to
warmer surface temperatures.3According to the results of a recent study conducted by Burkhardt
and Karcher4of the Institute for Atmospheric Physics at the German Aerospace Centre, aircraft-
generated contrails are contributing more to global warming than all the CO2that has been
caused by the entire 108 years of airplane flight.
Further, aircraft-generated contrails occurring in otherwise mostly clear skies can signifi-
cantly modify radiation and energy budgets, and help to reduce the diurnal temperature
range (DTR) at the Earths surface. The results of studies on the effects of contrails on climate
0091-3286/2014/$25.00 © 2014 SPIE
Journal of Applied Remote Sensing 083698-1 Vol. 8, 2014
indicated that the difference between day and night temperatures was about 1°C higher in the
absence of contrails after the September 11, 2001, event, when all aircraft in the United States
were grounded for 3 days.5The influence of aircraft-generated contrails on climate has been
explored by climate scientists.68Both airline companies and national governments have
expressed a desire to reduce aviation impacts on the environment and climate, including those
related to aircraft-generated contrails.
However, studying aircraft-generated contrails has always been difficult because they are at a
high altitude and of short duration, sometimes only minutes. Recently, with the development of
space technologies, remotely sensed satellite imageries have become good data sources for
studying these spreading aircraft-generated contrails. For example, the Advanced Very High
Resolution Radiometer (AVHRR) satellite images and the Moderate Resolution Imaging
Spectroradiometer (MODIS) satellite images have been employed to study the effects of the
aircraft-generated contrails on climate.9,10 To estimate contrail impacts on global climate, radi-
ative forcing due to linear-shaped jet contrails was calculated over the Northern Hemisphere for
four seasonal months using 2006 Aqua MODIS satellite images in a radiative transfer model by
Spangenberg et al.11
Simulated removal of contrails from remotely sensed satellite images may further help study-
ing the effects of the aircraft-generated contrails on climate change because such removal will
permit estimation of the change in albedo or radiation due to their presence (versus absence) over
a particular area, as has been shown in similar cloud and aerosol radiative forcing studies.12 This
information can be used in physical or climate model analysis of the impacts on radiation and
energy budgets to verify the differences in temperature or DTRs identified in weather station
observations.
Although removing the contrails and their shadows in the remotely sensed images and restor-
ing the missing information are important to understanding their effects on climate change, to the
best of our knowledge there are no such studies in the current literature. Most contrail studies in
the literature are mainly focused on detection of the contrails.1316 For example, Zhang et al.17
recently introduced an object-based method for automatically detecting contrails in AVHRR
satellite images by utilizing not only the spectral characteristics but also the spatial information
in the images.
Although in the atmospheric literature, CRF or contrail optical properties, were estimated
from the satellite imagery to study contrail impacts on global climate,11,1820 the models pro-
duced a wide range of CRF values. The most recent assessment of aircraft climate effects has
an uncertainty of >100% in the net CRF of linear contrails in terms of the global mean, because
the actual contrail properties and their background radiation fields are poorly known.11
Simulated removal of contrails from remotely sensed satellite images may help in understanding
the background radiation fields and reduce uncertainties of the estimated CRF, thus improving
the studies on the effects of aircraft-generated contrails on climate change.
Compared to Zhang et al.,17 this paper goes a further step: we not only identify the aircraft-
generated contrails in the multispectral Landsat 5 TM imagery but also restore the missing pixel
information [i.e., the expected digital number (DN) values of pixels without contrail contami-
nation] in the imagery based on spatial information in the original image and a secondary image.
We anticipate that with both the original satellite imagery with contrails and the simulated
imagery without contrails climate scientists will be able to better study the atmospheric effects
of contrails for potential mitigation of their climatic impacts. Note that we do not study the CRF
or contrail optical properties from the satellite imagery in this research. This study is only
focused on estimating the missing pixel information in the areas covered by contrails in satellite
imagery. It is hoped that the processed contrail-free imagery could be useful for studying CRF or
contrail optical properties by atmospheric scientists or climatologists, as has been done in a
similar cloud and aerosol radiative forcing study by Allan.21
We use a cokriging approach to restore contrail pixels in the multispectral remotely sensed
Landsat 5 TM imagery in this study. In fact, similar to the restoration of the missing information
in clouded multispectral remotely sensed imagery, many different methods may be used to re-
cover the information of contrail pixels in the multispectral remotely sensed imagery. For exam-
ple, the simple replacement method or histogram matching,22,23 regression trees, and image
fusion techniques2327 may also be used for the restoration of contrail pixels in the multispectral
Zhang et al.: Restoration of the missing pixel information caused by contrails. . .
Journal of Applied Remote Sensing 083698-2 Vol. 8, 2014
remotely sensed imagery. However, these methods do not take full advantage of the spatial infor-
mation in the contrail imagery. Spatial independence rarely occurs in image scenes, rather there
is spatial dependence in images that is reflected in the variability of DN values.28,29 Adjacent
pixels tend to be spatially autocorrelated and it is expected that two adjacent pixels will generally
be more similar in their DN values than would be two pixels separated by a greater distance.30
Without taking full consideration of the spatially autocorrelated information in the contrail
imagery, the aforementioned methods may yield poor quality results if the contrail imagery
and the secondary imagery do not satisfy certain criteria such as a minimum date separation
and a low temporal variability.
By taking full consideration of the spatially autocorrelated information in the contrail
imagery and incorporating information from secondary imagery without contrail coverage at
the same locations, a cokriging approach may restore well the contrail pixels in the multispectral
remotely sensed Landsat 5 TM imagery. The cokriging approach was found to be a relatively
more effective method for restoring the missing information caused by clouds.31 In this study,
this approach is investigated for restoring the missing information in contrail-covered multispec-
tral remotely sensed imagery. Such a study represents a new application area for cokriging. The
method should be especially helpful for restoringcontrail pixels because of the linear char-
acteristic of contrail shapes. In this study, we apply the cokriging method to the relatively weak
correlation situations for bands 2 and 3 to assess whether the method works well or not for
restoration of contrail pixels. Specifically, we (1) identify the aircraft-generated contrails in
the multispectral remotely sensed Landsat 5 TM imagery using the object-based method pro-
posed in Zhang et al.;17 (2) model the spatial dependence between the original contrail imagery
and the secondary imagery using a linear model of coregionalization; (3) interpolate the missing
information in contrail-covered areas in the original imagery using cokriging; (4) compare the
cokriging method with the ordinary kriging to identify the advantages of the cokriging method;
and (5) verify the restoration accuracy of the cokriging method using a manually cutting-off
linear-shaped polygon as a simulated contrail.
2 Methods
2.1 Object-Based Contrail Detection
The object-based image method for the identification of contrails in remotely sensed imagery17
includes two steps: first, the whole image is segmented into meaningful pixel groups or image
objects; second, knowledge-based classification is used to define these image objects into
desired contrail or noncontrail classes. In using these two steps, both the spectral information
and spatial information are considered.
In the first step, the multiresolution segmentation extracts image objects at different hierar-
chical segmentation levels. The objects are grouped into a larger object based on a single param-
eter called heterogeneity, which is calculated based on the spectral similarity, level of contrast
with the neighboring objects, and shape characteristics of the resulting object.
After segmentation, a nearest neighbor classification method is used to classify the primary
image into two classescontrail and noncontrail objects. A set of training samples are used to
assign contrail and noncontrail membership values. The classification results are tested based on
the training image object samples. The whole image object domain is then classified based on the
nearest sample neighbors.
The nearest neighbor classification returns a contrail or noncontrail fuzzy membership value to
each of the segmented image objects based on its feature space distance to its nearest neighbors.
The fuzzy logic values of the feature space distance are calculated based on the spectral and shape
features. The brightness, the shape index, and the width are applied in this case study to compute
the fuzzy logic values. Because shape features and color features may not be represented on a
common scale and may have different value ranges, the fuzzy logic values are standardized
by dividing the standard deviation of both the shape and color feature values. Thus, the final
obtained fuzzy logic values range from 0 to 1.0. A value of 0 means the object does not belong
to the contrail class, while a value of 1.0 means the object most likely belongs to the contrail class.
Zhang et al.: Restoration of the missing pixel information caused by contrails. . .
Journal of Applied Remote Sensing 083698-3 Vol. 8, 2014
The Definiens Developer 8.0 software program was used to perform the segmentation and
object-based image analysis.
2.2 Cokriging
Cokriging is the extension of simple kriging to incorporate data from the related variables to
increase the accuracy of estimates by taking simultaneously into account the autocorrelation in
each variable and the cross correlation between the variables.32 There are different types of cok-
riging methods. The distinctions arise from the way in which constraints are imposed. Three
common types of cokriging are simple cokriging, traditional ordinary cokriging, and standard-
ized ordinary cokriging.3335 Simple cokriging assumes that the trend component in kriging sys-
tem has a constant and known mean, which normally is not the case in reality. Thus, simple
cokriging usually generates poorer results than found by the traditional ordinary cokriging
and standardized ordinary cokriging. In this study, we use the traditional ordinary cokriging
for restoration of contrail pixels in the multispectral remotely sensed imagery. It was selected
because it generates results similar to those found by the standardized ordinary cokriging in
restoration of clouded pixels in the multispectral remotely sensed imagery,31 but is more widely
applied.
The linear model of coregionalization is the input parameter for cokriging. The linear model
of coregionalization is a set of direct and cross-variogram models that describes spatial depend-
ence of two or more sets of variables and their interdependences simultaneously. The direct
variogram models represent the spatial dependence in individual regionalized variables and
the cross-variogram models express the interdependence or joint spatial dependence between
the regionalized variables. A direct variogram is calculated by
γðhÞ¼ 1
2NðhÞX
NðhÞ
α¼1
½zðxαÞzðxαþhÞ2;(1)
where zðxαÞ;is the DN values of the pixels and NðhÞis the number of pairs of pixels for lag h.As
γðhÞincreases, the pixels become less similar. Besides the individual variograms computing the
spatial dependence within the images, the joint spatial dependence is calculated using a cross-
variogram:
γðhÞ¼ 1
2NðhÞX
NðhÞ
α¼1
½ziðxαÞziðxαþhÞ½zjðxαÞzjðxαþhÞ;(2)
where ziðxαÞand zjðxαÞare the DN values of the pixels in two random variables Z1ðxÞ
and Z2ðxÞ.
In order to use the variogram and cross-variogram in cokriging, a linear model of coregion-
alization needs to be constructed. The linear model of coregionalization is defined as a set of
direct and cross-variogram models γijðhÞ, such that
γijðhÞ¼X
L
l¼o
bl
ijglðhÞ;(3)
where γijðhÞrepresents the variogram models between the two variables, lrepresents each of the
Lvariables, and glðhÞis a permissible variogram model.
In the cases where the two variables exist, three inequalities must be satisfied to ensure that
the coregionalization matrix Blis positive semidefinite:
bl
11 0;(4)
bl
22 0;(5)
bl
11bl
22 bl
12bl
12 0:(6)
Zhang et al.: Restoration of the missing pixel information caused by contrails. . .
Journal of Applied Remote Sensing 083698-4 Vol. 8, 2014
It should be noted that in ArcGIS, the cross-variograms used in cokriging are expressed by
cross-covariance functions (called cross-covariograms) through the quantitative relationship
γijðhÞ¼Cij ð0Þ½CijðhÞþCijðhÞ2, where hand hrepresent the opposite directions
and are the same for the isotropic case.34
Cokriging is a multivariate image fusing technique. It integrates the information carried out
by a secondary variable related to the primary variable being estimated. Nonexhaustive secon-
dary information can be incorporated using the cokriging approach that explicitly accounts for
the spatial cross correlation between primary and secondary variables,34 thus the interpolation
accuracy could be improved.
For a single secondary variable case, the ordinary cokriging estimate is a linear combination
of both the primary and secondary data values and is given by
Z
1ðuÞ¼X
n1ðuÞ
α1¼1
λα1ðuÞZ1ðuα1ÞþX
n2ðuÞ
α2¼1
λα2ðuÞZ2ðuα2Þ(7)
with the following two constraints making the estimator unbiased
X
n1ðuÞ
α1¼1
λα1ðuÞ¼1;(8)
X
n2ðuÞ
α2¼1
λα2ðuÞ¼0;(9)
where n1ðuÞis the known DN value in the primary image Z1,n2ðuÞis the known DN value in the
secondary image Z2,λα1ðuÞare the weights assigned to the primary image Z1, and λα2ðuÞare the
weights applied to the secondary image Z2.
The cokriging system also aims at minimizing the variance of the errors by solving the fol-
lowing cokriging equations:
8
>
>
>
<
>
>
>
:
Pn1ðμÞ
β1¼1λβ1ðuÞC11ðuα1uβ1ÞþPn2ðμÞ
β2¼1λβ2ðuÞC12ðuα1uβ2Þþμ1ðuÞ¼C11 ðuα1uÞ;α1¼1;2;:::n1ðuÞ
Pn1ðμÞ
β1¼1λβ1ðuÞC21ðuα2uβ1ÞþPn2ðμÞ
β2¼1λβ2ðuÞC22ðuα2uβ2Þþμ2ðuÞ¼C21 ðuα1uÞ;α2¼1;2;:::n1ðuÞ
Pn1ðμÞ
β1¼1λβ1ðuÞ¼1&Pn2ðμÞ
β2¼1λβ2ðuÞ¼0
(10)
where C11 and C22 are the autocovariances of the primary and secondary images, C12 and C21 are
the cross-covariances between the primary and secondary images, and μ1ðuÞand μ2ðuÞare the
two Lagrange parameters accounting for the two constraints that make the estimator unbiased.
2.3 Verification Methods
In order to assess the accuracy of the restoration and confirm that it is feasible and reliable to use
the cokriging method to restore contrail pixels in Landsat 5 TM imagery, a narrow and long
polygon is cut off manually from the original image and the polygon is assumed to represent
a contrail in the primary image. Since the same linear coregionalization model is used for cok-
riging parameters, the verification can be performed on this polygon by comparing the restored
DN values with their original DN values. The root-mean-square-error (RMSE), standardized
RMSE, as well as quantilequantile (QQ) plots are employed to measure the overall accuracy
of the restored pixels and error distribution maps are used to assess the spatial distribution of the
DN value errors of the restored pixels.
Zhang et al.: Restoration of the missing pixel information caused by contrails. . .
Journal of Applied Remote Sensing 083698-5 Vol. 8, 2014
2.3.1 RMSE and standardized RMSE
RMSE is determined by
RMSE ¼ffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffi
1
nX
n
i¼1
ðzi;act zi;estÞ2
s;(11)
where nis the number of pixels, zi;act is the known value of pixel iin the primary image, and zi;est
is the restored value of pixel i.
The standardized RMSE is used to make band comparisons by normalizing the standard
deviation of the corresponding bands, and is determined by
Standardized RMS E¼RMSE
s¼ffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffi
1
nX
n
i¼1
ðzi;act zi;estÞ2
s2
s;(12)
where s2is the variance and sis the standard deviation of the corresponding band.
2.3.2 Quantilequantile plot
A general QQplot is employed to check whether the original imagery and the restored imagery
have the same distribution. Quantiles of the restored DN values of the test polygon are plotted
against quantiles of the original DN values of the test polygon. If the original imagery and the
restored imagery have the same distribution, then the points of the general QQplot should fall
along a 45 deg reference line. The departure from the reference line means that the original
imagery and the restored imagery have a dissimilar distribution. A QQplot can provide insight
into the nature of the difference in many distributional aspects, such as shifts in location, shifts in
scale, changes in symmetry, and the presence of outliers.31
2.3.3 Error distribution maps
Although RMSE, the standardized RMSE, and QQplots can help to evaluate the overall per-
formance of cokriging interpolation, these global statistics cannot spatially assess the effective-
ness of cokriging as the performance of cokriging may be location-dependent. The
corresponding error (true DN value minus restored DN value) distribution maps for different
bands for the test polygon area are used in this study to spatially assess cokrigings effectiveness.
The error distribution maps can demonstrate the spatial distribution of interpolation errors.
3 Background and Data
Two Landsat 5 TM images are chosen to restore contrail-covered pixels in the multispectral
remotely sensed imagery using the cokriging method. The images were downloaded from
the United States Geological Survey (USGS) website (http://earthexplorer.usgs.gov/). They
are level 1 systematically corrected products, which provide systematic radiometric and geomet-
ric accuracies. The study area is located in the eastern part of the state of Connecticut. Figure 1
shows the relative location of the study area. Figure 2(a) shows the primary image used in this
study, which is a subset of a Landsat 5 TM image from Path12Row31 (World Reference System
2) collected on November 20, 2005. It has 277 rows and 253 columns. It can be seen from
Fig. 2(a) that this area has a complex heterogeneous landscape, and different types of land covers
are mingled and scattered in the primary image. There are obvious spatial variations. Obvious
contrails and contrail shadows can be seen in the image. Figure 2(b) shows the secondary
Landsat 5 TM image, which covers the same area but was acquired on February 8, 2006.
Because of the different periods within a year, we can see that the DN values between the
original image [Fig. 2(a)] and the secondary image [Fig. 2(b)] are quite different. The correlation
coefficients between the primary image and the secondary image for two different TM bands
band 2 and band 3are 0.572 and 0.611, respectively. From these values, we can see that the
Zhang et al.: Restoration of the missing pixel information caused by contrails. . .
Journal of Applied Remote Sensing 083698-6 Vol. 8, 2014
correlation coefficient values for band 2 and band 3 are low, which implies that there is a weak/
moderate cross-linear correlation between the original image and the secondary image for both
of these two individual bands. For bands with a strong cross correlation between the original
image and the secondary image, many image fusion methods, such as simple replacement, histo-
gram matching, or regression tree methods could work well for restoration of contrail pixels in
the multispectral remotely sensed imagery. In this study, wewill use the cokriging method for the
Fig. 1 Relative location of the study area (eastern Connecticut).
Fig. 2 Images used for cokriging interpolation and analysis. (a) Original image with contrails and
contrail shadows (an RGB composite image of bands 4, 3, and 2). (b) Secondary image for use in
cokriging (an RGB composite image of bands 4, 3, and 2). (c) Original band 2 image. (d) Original
band 3 image.
Zhang et al.: Restoration of the missing pixel information caused by contrails. . .
Journal of Applied Remote Sensing 083698-7 Vol. 8, 2014
relatively weak/moderate cross correlation situations for bands 2 and 3 to assess whether the
method works well or not for restoration of contrail pixels. Figures 2(c) and 2(d) show the
original images of band 2 and band 3. The differences of mean DN values between the original
image and the secondary image for band 2 and band 3 are 2.60 and 4.50, respectively. It can
be seen that the mean DN values for the secondary image are all lower than those for the primary
image. The mean values of these bands are not very close, which suggests that other interpolation
methods, such as maximum value composite, minimum value composite, and simple replace-
ment, may yield poor results because of the large difference between the DN values of these
individual bands. Therefore, we use the cokriging method, which considers spatial correlation
structure in the original image, to restore contrail pixels in the multispectral remotely sensed
imagery.
4 Results
4.1 Object-Based Classification Results
The individual band images are divided into various objects using the multiresolution segmen-
tation method. In the image segmentation step, several parameters are established. The first
parameter is scale. A segmentation scale value of 15 is chosen through visual inspection
and this scale makes the segmentation results depict contrails reasonably well, which means
that the segmentation results avoid both having too many image objects and being too coarse
for the detection of the contrail pixels.
Both the spectral and spatial heterogeneity criteria are applied in the segmentation process to
avoid generating the branched and fractured objects. The three parameters that represent the
spectral and spatial heterogeneity criteria are color, smoothness, and compactness. The latter
two parameters are shape criteria. A color parameter of 0.9 is set for all the scenarios to empha-
size the brightness information. The shape parameter is set to 0.1. Compactness and smoothness
each comprise 50% of the shape criterion because a certain degree of shape homogeneity often
can improve the quality of object extraction.
Evenly distributed contrail and noncontrail samples are selected for the object-based clas-
sification. The brightness, shape index, and width are used to optimize the three-dimensional
feature space and to reduce the computational requirements. Figure 3shows the object-based
classification results for band 2 and band 3. It can be seen from this figure that the linear shape of
the contrails is identified and the linear contrail features are captured reasonably well.
Fig. 3 Object-based classification results of contrail pixels. (a) Classification results for band 2
(white indicates contrail pixels and black indicates noncontrail pixels). (b) Classification results
for band 3 (white indicates contrail pixels and black indicates noncontrail pixels).
Zhang et al.: Restoration of the missing pixel information caused by contrails. . .
Journal of Applied Remote Sensing 083698-8 Vol. 8, 2014
4.2 Modeling the Spatial Dependence Between the Primary and the Secondary
Images
The construction of the variogram and cross-covariogram models is mainly based on the ana-
lysts judgment and decision. The choice of the lag tolerance width determines the number of
those lags in any transect. 36 We chose 30 m as an appropriate lag tolerance width for this case
study because the variograms and cross-covariograms estimated with this lag tolerance are reli-
able. This distance is consistent with the spatial resolution of the Landsat 5 TM data and it is a
proper distance to capture the detailed spatial information within the data set. In order to model
the spatial dependence between the primary image and the secondary image, we fit models of
both direct variograms and cross-covariograms simultaneously to satisfy the positive definite
constraint in solving the cokriging system. To fit a linear model of coregionalization for
each band, all models (two direct variogram models and one cross-covariogram model for
each band) must have the same common model structure and range. However, the two direct
variogram models and one cross-covariogram model for each band may have different partial
sills and nuggets. In this study, each fitted variogram or cross-covariogram model is composed of
two structures: a nugget structure and a spherical structure
YðhÞ¼c0þc13h
2a1
1
2h
a13;(13)
where c0is the nugget, c1is the sill of the spherical structure, and a1is the range parameter of the
spherical structure. Here, sill is defined as the total magnitude of spatial variability. Range is the
distance over which data are correlated. Nugget represents the extent of random variation within
the data. Usually, variance at the distance of 0 is theoretically equal to 0. However, measurement
errors and small-scale variability may often cause DN values within a small separation to be quite
dissimilar. Thus, a discontinuity at the origin of a variogram may occur and this phenomenon is
referred to as the nugget effect. The nugget effect appears in the variogram model in this case
study. Table 1shows the parameters of the linear model of coregionalization. The permissible
coregionalization model (including models for direct variogram of contrail image, direct vario-
gram of secondary image, and cross-covariogram) for band 2 uses the spherical basic functions
as the common basic structure and 268.5 m as the common range. The permissible coregion-
alization model for band 3 also uses the spherical basic functions as the common basic structure
and 292.2 m as the common range. Figure 4illustrates the direct variogram models of the origi-
nal and secondary images and the cross-covariogram models between the original and secondary
images for bands 2 and 3.
4.3 Estimating DN Values of Contrail Pixels Using Cokriging
As noted above, individual band 2 and band 3 are used to explore the cokriging method for
restoration of the contrail pixels under a weak correlation circumstance. Ordinary kriging is
also used to interpolate the contrail pixels in the primary image in order to test whether the
Table 1 Parameters of the fitted variogram and cross-covariogram models for use in cokriging
(optical band 2 and band 3).
Band Variogram/covariogram Model type Nugget Sill Range
Band 2 Direct variogram of contrail image Spherical 0.69 2.47 268.46
Direct variogram of secondary image Spherical 0.63 5.42 268.46
Cross-covariogram Spherical 0.0 2.91 268.46
Band 3 Direct variogram of contrail image Spherical 0.47 5.28 292.23
Direct variogram of secondary image Spherical 2.15 14.67 292.23
Cross-covariogram Spherical 0.0 6.86 292.23
Zhang et al.: Restoration of the missing pixel information caused by contrails. . .
Journal of Applied Remote Sensing 083698-9 Vol. 8, 2014
introduction of the secondary variable improves the restoration results in this contrail case study.
Figure 5provides a comparison of the results of the cokriging and ordinary kriging methods.
Figures 5(a) and 5(d) show the original images for band 2 and band 3, respectively. Figures 5(b)
and 5(e) show the restored results using the cokriging for band 2 and band 3, respectively.
Through visual inspection, it can be seen that by using cokriging, the contrail effect has
been reduced substantially and most traces of the contrail have been removed. Although
there are still some smoothing effects, the restoration results appear to be good and most
parts of the edges of the contrail are matched spatially. Overall, the smoothing effect is not
significant and the detailed spatial variation can still be found in the restored contrail area.
Figures 5(c) and 5(f) show the ordinary kriging restoration results for individual band 2 and
band 3. Compared with Figs. 5(b) and 5(e), it can be seen that there is an obvious smoothing
effect in the area restored by ordinary kriging and the basic spatial structure cannot be captured
using only the information in the primary image. The restored contrail pixels do not match the
surrounding noncontrail pixels spatially. There are obvious interpolation-related artifacts and
the edges of the contrails can be identified easily. This occurs due to the fact that the shapes
of the contrail in the original image are wide and the surrounding noncontrail pixels are too far
Fig. 4 The direct variogram models of the primary and secondary images, and the cross-covario-
gram models between the primary and secondary images for band 2 and band 3. (a) The direct
variogram model of the primary image for band 2. (b) The direct variogram model of the secondary
image for band 2. (c) The cross-covariogram model between the primary and secondary images
for band 2. (d) The direct variogram model of the primary image for band 3. (e) The direct vario-
gram model of the secondary image for band 3. (f) The cross-covariogram model between the
primary and secondary images for band 3.
Zhang et al.: Restoration of the missing pixel information caused by contrails. . .
Journal of Applied Remote Sensing 083698-10 Vol. 8, 2014
away, thus they may have dissimilar DN values to the original pixels. When performing the
restoration, only using the primary image information cannot capture the details of the spatial
structure of the contrail pixels well. This verifies that by incorporating the information from the
secondary image, cokriging can produce better restoration results than the ordinary kriging.
4.4 Validation Results
Figure 6shows the location of the test polygon area that is cut off manually for validation. The
test polygon is used to simulate a contrail with a linear irregular shape. The yellow line surrounds
the test polygon. Figure 7shows the zoomed-in original and restored polygon areas. It can be
Fig. 5 Comparison of cokriging and ordinary kriging for restoring contrail-covered pixels.
(a) Original image for band 2. (b) Cokriging results for band 2. (c) Ordinary kriging results for
band 2. (d) Original image for band 3. (e) Cokriging results for band 3. (f) Ordinary kriging results
for band 3.
Fig. 6 The location of the test polygon for validation.
Zhang et al.: Restoration of the missing pixel information caused by contrails. . .
Journal of Applied Remote Sensing 083698-11 Vol. 8, 2014
seen that there are only slight differences between the original image pixels and the restored
contrail pixels. The spatial pattern of these pixels is well preserved as is the spatial continuity
of the majority of the scene in the restored pixel region. Therefore, the performance of the cok-
riging model is shown to be reliable for restoration of the contrail pixels in the multispectral
remotely sensed imagery.
The RMSE for band 2 and band 3 is 1.32 and 1.96, and the standardized RMSE for band 2
and band 3 is 0.24 and 0.09, respectively. These global statistics values indicate that overall the
cokriging performs well.
Figure 8shows the QQplots of the estimated DN values versus the true DN values in the
test polygon for band 2 and band 3. From the QQplots, it can be seen that most points are close
to the 45 deg line, which means that the restored pixel DN values are well correlated with the true
pixel DN values. The general QQplots indicate that the restored pixel DN values in the test
polygon are similar to the corresponding true pixel DN values. However, there are still some
outliers. At the upper tails of the QQplots, large deviations appear in both bands and most
points are below the 45 deg reference line, which indicates that some pixels with extremely high
values are underestimated. While it is still difficult to restore the contrail pixels with extreme DN
values, the QQplots show the feasibility of using cokriging to estimate the contrail values in
the remotely sensed imagery.
Figure 9shows the error distribution maps for band 2 and band 3. The error distribution map
is useful in analyzing the reliability of the DN value of each pixel in the test polygon. The yellow
color denotes the accurately estimated pixels, whereas the red color indicates positive errors, and
the green color indicates negative errors, respectively. For band 2, the error ranges from 2.37 to
þ9.13 (unit: DN value), while for band 3, the error ranges from 3.4 to þ18.2 (unit: DN value).
From the error distribution maps, it can be seen that most pixels have small deviations from the
original pixel DN values by showing yellow, light red, and light green colors. Only a small
Fig. 7 Zoomed-in images for the purpose of validation. (a) Zoomed-in original image (bands 4, 3, 2
composite). (b) Zoomed-in restored images (bands 4, 3, 2 composite).
Fig. 8 QQ plots of the distributions between the true DN values and the estimated DN values in
the test polygon (assumed ing as a contrail) for band 2 and band 3.
Zhang et al.: Restoration of the missing pixel information caused by contrails. . .
Journal of Applied Remote Sensing 083698-12 Vol. 8, 2014
percentage of pixels have large deviations with a deep red color. Hence, the error distribution
maps also show that it is feasible to restore the contrail cells using the cokriging method.
Spatial autocorrelation can also be seen in the error distribution maps. Red cells and green
cells are grouped separately because the positive error cells tend to group together, while the
negative error cells have the same trend. Generally, if the values of a group of cells are quite
different from surrounding cells or if they have extremely high or low values, the errors will
Fig. 9 Spatial error distribution maps for band 2 and band 3 (the true DN values minus the cor-
responding estimated DN values).
Fig. 10 Comparison images before radiometric correction and after radiometric correction,
(a) Original November 2005 image with contrails (bands 4, 3, 2 composite). (b) November
2005 image with contrails image after radiometric correction (bands 4, 3, 2 composite).
(c) Original February 2006 image without contrails (bands 4, 3, 2 composite). (d) February
2006 image without contrails after radiometric correction (bands 4, 3, 2 composite).
Zhang et al.: Restoration of the missing pixel information caused by contrails. . .
Journal of Applied Remote Sensing 083698-13 Vol. 8, 2014
Fig. 11 The object-based classification results of contrail pixels for band 2 and band 3 after radio-
metric correction. (a) Object-classification results for band 2. (b) Object-classification results for
band 3.
Fig. 12 The results of the cokriging restoration based on the radiometric correction images.
(a) Image with radiometric correction for band 2. (b) Cokriging results for band 2. (c) Image
with radiometric correction for band 3. (d) Cokriging results for band 3.
Zhang et al.: Restoration of the missing pixel information caused by contrails. . .
Journal of Applied Remote Sensing 083698-14 Vol. 8, 2014
become large. From the error distribution maps, it can also be noted that there is a small area of
extremely high deviation at the lower left corner. This occurs because in the original image the
corresponding land cover at this place is very different from the surrounding land cover.
Therefore, it is difficult to accurately restore the high-variation pixels based on the DN values
of their neighboring pixels.
5 Discussion and Conclusions
Although studies in the literature indicate that aircraft-generated contrails may have a large
impact on climate, the extent of contrail coverage, and the amount of warming effects still remain
quite uncertain. It is important to identify and restore the contrail-covered areas in the remotely
sensed imagery for contrail effect research and climate change studies. This paper introduces a
cokriging approach for the restoration of contrail pixels in the multispectral remotely sensed
imagery. The case study shows that it is very useful to use the cokriging approach in this resto-
ration. The cokriging method takes advantage of both the spatial information in the original
imagery and information from the secondary imagery.
Initially, we thought that the restoration of contrails would be fairly simple because the
shapes of contrails are relatively narrow and the information in the surrounding pixels within
a short distance may be enough to capture the spatial structure of the contrail pixels. Thus, ordi-
nary kriging might be used for the restoration of contrail pixels. However, the case study con-
ducted in this research shows that this is not the case. Through the comparison of results between
ordinary kriging and cokriging, it can be seen that the performance of the ordinary kriging in
restoring the contrail pixels is poor, which indicates that using only the primary band information
is not enough even for restoration of the linear-shaped contrail pixels. Therefore, to restore more
accurately the contrail pixels in the multispectral images, we have to incorporate the secondary
image information to acquire detailed patterns of contrail pixels in the multispectral remotely
sensed imagery. Although the study area in this application has a complex heterogeneous land-
scape, the cokriging method still produced good results.
Because we cannot obtain the ground survey true data values at the contrail pixel locations,
we manually cut off a contrail-free polygon from the original image and assumed it to be a
contrail. The validation methods demonstrate that cokriging performed well in the restoration
of the manualcontrail. Most of the restored contrail pixels have similar values to the corre-
sponding values in the original image, which indicates the accuracy of the cokriging method is
relatively good. Some pixels still have high deviations, mainly because the corresponding pixels
in the original image have extremely high or low values.
Although cokriging is reliable in this case study, there are still some limitations to consider. In
this study, we only restored contrail pixels with linear shapes in the multispectral remotely
sensed imagery. However, contrails are not stable spatial features and they may change their
linear shapes from their formation stage into the final dissolution of the aviation-induced cirrus
cloud, making it difficult to identify the contrail-covered pixels and restore them well no matter
what methods are used. For multispectral remotely sensed images, the cokriging method may
work well for restoration of the young contrails with linear shapes, but the method may not work
so well for restoring a cirrus contrail with a spread shape. The cokriging method works well for
linear contrails because it more effectively uses the information from neighboring pixels of the
original imagerythe linear shape is narrow and the values of the neighboring pixels are nor-
mally more similar to the expected values of the contrail-covered pixels in a linear area than in
the other shapes (such as circles). The spreading of contrails not only makes it harder to identify
contrail pixels, but also causes the smoothing effect problem for the cokriging method. The
smoothing effect is caused by the far distances between the central pixels of the contrail
areas (with nonlinear shapes) and the surrounding nearest pixels in noncontrail areas, and
these two groups of pixels tend to have very different DN values. Many interpolation methods
including cokriging have this limitation.
It should be noted that when using the cokriging method, it does not matter whether DN
values or reflectance values are used as long as the variables involved are regionalized variables
which have spatial correlations at some scales. This study was focused on introducing a method
Zhang et al.: Restoration of the missing pixel information caused by contrails. . .
Journal of Applied Remote Sensing 083698-15 Vol. 8, 2014
to restore the DN values of contrail pixels in the multispectral remotely sensed Landsat 5 TM
imagery. However, the DN values recorded by the sensor do not have corrections of object illu-
mination effects (e.g., caused by terrain slope and orientation) and intervening atmospheric
effects (e.g., caused by atmospheric and solar conditions).37 Thus, the DN values for the
same spectral class over different places or at different times over the same area may be different
to some extent. This may decrease the performance of the introduced cokriging method for resto-
ration of the missing information. Converting the DN values into the surface reflectance values
through atmospheric and topographic correction models might improve the restoration results.
To answer the question whether the radiometric correction would lead to more accurate resto-
ration results in this study, we performed the radiometric correction processing on the data set
that we used using the Geomatic 2013 software. Figures 10(a) and 10(b) show the original
November 2005 image with contrails (bands 4, 3, 2 composite) and the image with radiometric
correction (bands 4, 3, 2 composite), respectively. Figures 10(c) and 10(d) display the original
February 2006 image without contrails (bands 4, 3, 2 composite) and the image with radiometric
correction (bands 4, 3, 2 composite), respectively. The correlation coefficients between the cor-
rected and uncorrected November 2005 images for band 2 and band 3 are 0.980 and 0.985, and
those for February 2006 images are 0.988 and 0.992, respectively.
Because the training data and the image to be classified as contrails are at the same relative
scale (corrected or uncorrected), atmospheric and topographic corrections may have little effect
on identifying and removing contrails from the original image.38 We verified this point in this
study. Figure 11 shows the object-based classification results of contrail pixels for band 2 and
band 3 after radiometric correction. Comparing with Fig. 3, it can be seen that there is not much
difference on identifying and removing contrails using the radiometric correction images.
Nevertheless, the restoration results derived from different dates of images using the cokrig-
ing method or other fusion methods may be better with the atmospheric and topographic cor-
rections.39,40 To check if the cokiging method can work better for fusing the images with different
reflectance values, we performed cokriging interpolation for restoration of the missing pixel
information caused by contrails using the images after radiometric correction. Figure 12
shows the results of the cokriging restoration on the images with the radiometric correction
for band 2 and band 3.
Compared with the results on the images without the radiometric correction (Fig. 5), it can be
seen that there is no significant difference for this study. However, for application studies, we still
recommend the conversion of DN values into reflectance values before performing the restoration.
Finally, the cokriging method requires reasonably strong correlations, either direct/autocorrelations
or cross correlations among the primary and secondary images.31,34 With relatively weak corre-
lations (both the direct/autocorrelations in the primary and secondary images and the cross corre-
lations between the primary and secondary images), contrail restoration could become a tough task
even for the cokriging method. Although there are weak cross correlations between the original
images and the secondary images for bands 2 and 3 in the case studies of this research, there are
strong direct/autocorrelations from the neighboring pixels in both of the original images and the
secondary images. This may be why the cokriging method worked well. Whenever possible, one
should choose a secondary image with a short separation date from the original image to perform
the restoration of the missing pixel information caused by contrails. Further exploration for poten-
tially better methods to more effectively restore contrail-covered pixels in the multispectral
remotely sensed imagery should be conducted in the future.
References
1. J. E. Penner et al., Aviation and the Global Atmosphere: A Special Report of the
Intergovernmental Panel on Climate Change, Cambridge University, Cambridge (1999).
2. W. L. Seaver and J. E. Lee, A statistical examination of sky cover changes in the contiguous
United States,J. Clim. Appl. Meteorol. 26,8895 (1987), http://dx.doi.org/10.1175/1520-
0450(1987)026<0088:ASEOSC>2.0.CO;2.
3. K. N. Liou, Influence of cirrus clouds on weather and climate processes: a global perspec-
tive,Mon. Weather Rev. 114, 11671199 (1986), http://dx.doi.org/10.1175/1520-0493
(1986)114<1167:IOCCOW>2.0.CO;2.
Zhang et al.: Restoration of the missing pixel information caused by contrails. . .
Journal of Applied Remote Sensing 083698-16 Vol. 8, 2014
4. U. Burkhardt and B. Karcher, Global radiative forcing from contrail cirrus,Nat. Clim.
Change 1,5458 (2011), http://dx.doi.org/10.1038/nclimate1068.
5. D. J. Travis, A. M. Carleton, and R. G. Lauritsen, Contrails reduce daily temperature range:
a brief interval when the skies were clear of jets unmasked an effect on climate,Nature
418(6898), 601 (2002), http://dx.doi.org/10.1038/418601a.
6. J. E. Lee and S. D. Johnson, Expectancy of cloudless photographic days in the contiguous
United States,Photogramm. Eng. Remote Sens. 51(12), 18831891 (1985).
7. J. K. Angell, Variation in United States cloudiness and sunshine duration between 1950
and the drought year of 1988,J. Clim. 3, 296308 (1990), http://dx.doi.org/10.1175/1520-
0442(1990)003<0296:VIUSCA>2.0.CO;2.
8. D. J. Travis, J. S. Johnson, and J. Q. DeGrand, U.S. jet contrail frequency changes:
influences of jet aircraft flight activity and atmospheric conditions,Int. J. Climatol. 27,
621632 (2007), http://dx.doi.org/10.1002/(ISSN)1097-0088.
9. P. Minnis et al., Contrail properties over the eastern north pacific from AVHRR data,
Meteorol. Z. 14(4), 515523 (2005), http://dx.doi.org/10.1127/0941-2948/2005/0056.
10. R. Palikonda et al., Contrail climatology over the USA from MODIS and AVHRR data,in
Proc. AMS 10th Conf. Aviation, Range, and Aerospace Meteorology, R. Palikonda et al.,
Eds., pp. 1316, American Meteorological Society, Portland, Oregon (2002).
11. D. A. Spangenberg et al., Contrail radiative forcing over the Northern Hemisphere from
2006 Aqua MODIS data,Geophys. Res. Lett. 40(3), 595600 (2013), http://dx.doi.org/10
.1002/grl.50168.
12. J. R. Norris and M. Wild, Trends in aerosol radiative effects over Europe inferred from
observed cloud cover, solar dimming,and solar brightening,J. Geophys. Res. 112(D8),
113 (2007), http://dx.doi.org/10.1029/2006JD007794.
13. M. Engelstad et al., Automated detection of jetcontrails using the AVHRR split
window,Int. J. Remote Sens. 13(8), 13911412 (1992), http://dx.doi.org/10.1080/
01431169208904199.
14. H. Hetzheim, Automated contrail and cirrus detection using stochastic properties,Int. J.
Remote Sens. 28(9), 20332048 (2007), http://dx.doi.org/10.1080/01431160600641665.
15. H. Mannstein, R. Meyer, and P. Wendling, Operational detection of contrails from NOAA-
AVHRR-data,Int. J. Remote Sens. 20(8), 16411660 (1999), http://dx.doi.org/10.1080/
014311699212650.
16. R. Meyer et al., Contrail observations over Southern and Eastern Asia in NOAA/AVHRR
data and comparisons to contrail simulations in a GCM,Int. J. Remote Sens. 28(9), 2049
2069 (2007), http://dx.doi.org/10.1080/01431160600641707.
17. D. Zhang et al., An object-based method for contrail detection in AVHRR satellite images,
GISci. Remote Sens. 49(3), 412427 (2012), http://dx.doi.org/10.2747/1548-1603.49.3
.412.
18. R. R. Deleon et al., Sensitivity of radiative properties of persistent contrails to the ice water
path,Atmos. Chem. Phys. 12, 78937901 (2012), http://dx.doi.org/10.5194/acp-12-7893-
2012.
19. M. Ponater, S. Marquart, and R. Sausen, Contrails in a comprehensive climate model:
parameterization and radiative forcing,J. Geophys. Res. Atmos. 107(D13), 115
(2002), http://dx.doi.org/10.1029/2001JD000429.
20. P. Minnis et al., Global distribution of contrail radiative forcing,Geophys. Res. Lett.
26(13), 18531856 (1999), http://dx.doi.org/10.1029/1999GL900358.
21. R. P. Allan, Combining satellite data and models to estimate cloud radiative effect at the
surface and in the atmosphere,Meteorol. Appl. 18(3), 324333 (2011).
22. R. E. Rossi, J. L. Dungan, and L. R. Beck, Kriging in the shadows: geostatistical inter-
polation for remote sensing,Remote Sens. Environ. 49(1), 3240 (1994), http://dx.doi.org/
10.1016/0034-4257(94)90057-4.
23. P. Arellano, Missing information in remote sensing: wavelet approach to detect and remove
clouds and their shadows,Masters Thesis, International Institute for Geo-information
Science and Earth Observation, Enschede (2004).
24. C. G. Homer et al., Landscape covertype modeling using a multi-scene Thematic Mapper
mosaic,Photogramm. Eng. Remote Sens. 63(1), 5967 (1997).
Zhang et al.: Restoration of the missing pixel information caused by contrails. . .
Journal of Applied Remote Sensing 083698-17 Vol. 8, 2014
25. C. Pohl, Tools and methods for fusion of images of different spatial resolution,Int. Arch.
Photogramm. Remote Sens. 32,711 (1999).
26. S. M. Howard and J. M. Lacasse, An evaluation of gap-filled Landsat SLC-off imagery for
wildland fire burn severity mapping,Photogramm. Eng. Remote Sens. 70(8), 877880
(2004).
27. E. Helmer and B. Ruefenacht, Cloud-free satellite image mosaics with regression trees and
histogram matching,Photogramm. Eng. Remote Sens. 71(9), 10791089 (2005), http://dx
.doi.org/10.14358/PERS.71.9.1079.
28. D. L. B. Jupp, A. H. Strahler, and C. E. Woodcock, Autocorrelation and regularization in
digital images: I. Basic theory,IEEE Trans. Geosci. Remote Sens. 26(4), 463473 (1988),
http://dx.doi.org/10.1109/36.3050.
29. D. L. B. Jupp, A. H. Strahler, and C. E. Woodcock, Autocorrelation and regularization in
digital images: II. Simple image models,IEEE Trans. Geosci. Remote Sens. 27(3), 247
258 (1989), http://dx.doi.org/10.1109/36.17666.
30. R. M. Lark, Geostatistical description of texture on an aerial photograph for discriminating
classes of land cover,Int. J. Remote Sens. 17(11), 21152133 (1996), http://dx.doi.org/10
.1080/01431169608948761.
31. C. Zhang, W. Li, and D. J. Travis, Restoration of clouded pixels in multispectral remotely
sensed imagery with cokriging,Int. J. Remote Sens. 30(9), 21732195 (2009), http://dx.doi
.org/10.1080/01431160802549294.
32. M. A. Oliver and R. Webster, How geostatistics can help you,Soil Use Manage. 7(4),
206217 (1991), http://dx.doi.org/10.1111/sum.1991.7.issue-4.
33. E. H. Isaaks and R. M. Srivastava, An Introduction to Applied Geostatistics, Oxford
University, New York (1989).
34. P. Goovaerts, Geostatistics for Natural Resources Evaluation, Oxford University, New York
(1997).
35. C. V. Deutsch and A. G. Journel, GSLIB: Geostatistical Software Library and Users Guide,
Oxford University, New York (1998).
36. P. J. Curran, The semivariogram in remote sensing: an introduction,Remote Sens.
Environ. 24, 493507 (1988), http://dx.doi.org/10.1016/0034-4257(88)90021-1.
37. X. Pons and L. Sole-Sugranes, A simple radiometric correction model to improve auto-
matic mapping of vegetation from multispectral satellite data,Remote Sens. Environ. 48,
191204 (1994), http://dx.doi.org/10.1016/0034-4257(94)90141-4.
38. C. Song et al., Classification and change detection using Landsat TM data when and how
to correct atmospheric effects?,Remote Sens. Environ. 75(2), 230244 (2001), http://dx
.doi.org/10.1016/S0034-4257(00)00169-3.
39. S. M. Vicente-Serrano, F. Perez-Cabello, and T. Lasanta, Assessment of radiometric cor-
rection techniques in analyzing vegetation variability and change using time series of
Landsat images,Remote Sens. Environ. 112, 39163934 (2008), http://dx.doi.org/10
.1016/j.rse.2008.06.011.
40. M. Feng et al., Quality assessment of Landsat surface reflectance products using MODIS
data,Comput. Geosci. 38,922 (2012), http://dx.doi.org/10.1016/j.cageo.2011.04.011.
Daxiang Zhang is a PhD student in Department of Geography at the University of Connecticut.
He got his masters degree in geography from the University of Connecticut. His research inter-
ests include geostatistics, remote sensing applications to natural environment, land use, and land
cover change study.
Chuanrong Zhang is an associate professor at the University of Connecticut and holds a joint
appointment with the Department of Geography and the Center for Environmental Sciences and
Engineering (CESE). She got her PhD degree in GIS from University of Wisconsin, Milwaukee
in 2004. She has several years of working experience in computer companies. Her current
research interests include Internet GIS, geostatistics, and applications of these techniques in
natural resource and environmental management.
Weidong Li is a research professor in the Department of Geography at University of
Connecticut. He got a masters degree in computer science from Marquette University and
Zhang et al.: Restoration of the missing pixel information caused by contrails. . .
Journal of Applied Remote Sensing 083698-18 Vol. 8, 2014
obtained a PhD degree in soil and water science in 1995 from China Agricultural University. His
research interest is focused on geostatistics and geoinformatics for natural resource management.
Robert Cromley has a PhD from the Ohio State University and is a professor of geography at
the University of Connecticut. His research interests include different forms of spatial analysis
and geoprocessing procedures.
Dean M. Hanink is a professor of geography at the University of Connecticut, Storrs, CT. His
research interests are in regional economicenvironmental change, especially urban land-use
transitions, and the economic geography of China.
Dan Civco is a professor of geomatics in the Department of Natural Resources Management and
Engineering at the University of Connecticut. He is also director of the Center for Land Use
Education and Research (CLEAR). His research interests are in remote sensing applications
to the natural environment, digital image processing algorithm development, neural processing
and expert systems methods in remote sensing image processing, geographic information sys-
tems (GIS), land cover mapping and other earth resources applications of geoprocessing.
David Travis received his PhD in geography from Indiana University in 1994 with an emphasis
on atmospheric science and climatology. His research has primarily focused on human impacts
on climate with an emphasis on aviation impacts. His work on the climatic effects of jet con-
densation trails has received international attention. He was hired onto the faculty at the
University of Wisconsin-Whitewater in 1994. In recent years, he has moved into progressively
higher administrative roles at that institution and most recently was named dean of the College of
Letters & Sciences. He received his bachelors and masters degrees in geography from the
University of Georgia in 1987 and 1989, respectively.
Zhang et al.: Restoration of the missing pixel information caused by contrails. . .
Journal of Applied Remote Sensing 083698-19 Vol. 8, 2014
... For this purpose, we tested the samples' probability distributions of the five land cover types using the Quantile-Quantile Plot (Q-Q Plot) [54], and it showed that normal distribution assumption was acceptable. ...
Article
Full-text available
Rice is one of the most important crops in the world; meanwhile, the rice field is also an important contributor to greenhouse gas methane emission. Therefore, it is important to get an accurate estimation of rice acreage for both food production and climate change related studies. The eastern plain region is one of the major single-cropped rice (SCR) growing areas in China. Subjected to the topography and intensified human activities, the rice fields are generally fragmented and irregular. How remote sensing can meet this challenge to accurately estimate the acreage of the rice in this region using medium-resolution imagery is the topic of this study. In this study, the applicability of the Chinese HJ-1A/B satellites and a two-band enhanced vegetation index (EVI2) was investigated. Field campaigns were carried out during the rice growing season and ground-truth data were collected for classification accuracy assessments in 2012. A stepwise classification strategy utilizing the EVI2 signatures during key phenology stages, i.e., the transplanting and the vegetative to reproductive transition phases, of the SCR was proposed, and the overall classification accuracy was 91.7%. The influence of the mixed pixel and boundary effects to classification accuracy was also investigated. This work demonstrates that the Chinese HJ-1A/B data are suitable data source to estimating SCR cropping area under complex land cover composition.
... Carvalho et al. (2006) used a direct sequential cosimulation algorithm to improve accuracy of land cover classification by integrating ground data and remotely sensed land cover proportional data classified by the SML algorithm. Other applications of conventional geostatistics in remote sensing studies include, for example, deriving image texture measures to aid classification (Balaguer et al. 2010), evaluating large area forest inventory (Meng et al. 2009), and restoring missing or contaminated pixels (Zhang et al. 2014). Recently, Tang et al. (2013) used the multiple-point geostatistical algorithm (Strebelle 2002) to post-process a remotely sensed land cover classification generated by SML for accuracy improvement by taking the pre-classified image as a training image, the SML probabilities as soft conditioning data and the training samples as hard conditioning data. ...
Article
Full-text available
This study introduces a Bayesian Markov chain random field (MCRF) cosimulation approach for improving land-use/land-cover (LULC) classification accuracy through integrating expert-interpreted data and pre-classified image data. The expert-interpreted data are used as conditioning sample data in cosimulation, and may be interpreted from various sources. The pre-classification can be performed using any convenient conventional method. The approach uses the recently suggested MCRF cosimulation algorithm (Co-MCSS) to take a pre-classified image as auxiliary data while performing cosimulations conditioned on expert-interpreted data. It was tested using a series of expert-interpreted data sets and an image data set pre-classified by the supervised maximum likelihood (SML) algorithm. Results show that with the density of the interpreted data (pixel labels) increasing from 0 to 1.81 % of total pixels, the accuracy of optimal classification maps from Co-MCSS improves by 8.49 to 20.96 %, being much higher than that generated by SML and those purely conditioned on expert-interpreted data. This means that expert-interpreted data may largely contribute to the accuracy of LULC classification from remotely sensed imagery, and inversely the pre-classified image data also can largely contribute to the accuracy of LULC classes simulated by the MCRF approach based on expert-interpreted data. Therefore, the proposed approach can improve classification accuracy of pre-classified maps as long as some expert-interpreted data are available. The main advantage of this approach is that it may comprehensively utilize a variety of available information seamlessly to LULC classification through expert interpretation and spatial cosimulation.
Article
Despite an ever-increasing number of spaceborne, airborne, and ground-based data acquisition platforms, remote sensing data are still often spatially incomplete or temporally irregular. While deterministic interpolation techniques are often used, they tend to create unrealistic spatial patterns and generally do not provide uncertainty quantification. Geostatistical simulation models are effective in generating an ensemble of realistic and equally probable realizations of an unmeasured phenomenon, allowing data uncertainty to be propagated. These models are commonly used in several fields of earth science, and in recent years, they have been applied widely to remotely sensed data. This study provides the first review of the applications of geostatistical simulation to remote sensing data. We review recent geostatistical simulation models relevant to satellite remote sensing data and discuss the characteristics and advantages of each approach. Finally, the applications of each geostatistical simulation model are categorized in different domains of natural sciences, including soil, vegetation, topography, and atmospheric science.
Article
Full-text available
Due to sensor or ground station failure and poor atmospheric conditions, missing information is a common problem that reduces the usage of optical remote sensing data. A large number of algorithms have been developed to reconstruct missing information. Simple methods are compared for filling missing data in the case that one spectral band presents missing information but the other bands are complete. The methods are (1) spatial convolution filtering, (2) unsupervised classification using the complete bands and assignment of the cluster's average value to missing stripe pixels, (3) global regression models, (4) geographically weighted regression (GWR) models, and (5) a combination of classification and linear models. To evaluate the performance of the different methods, missing line stripes of different sizes are simulated and reconstructed using the five methods. Then, root mean square error (RMSE), correlation, maximum deviance, and bias are computed. To identify the conditions related to the performance of each method, some characteristics of the missing lines, as correlation between spectral bands and spatial autocorrelation, are also calculated. The unsupervised classification based on the larger number of clusters, in particular when combined with linear regression, presents a low RMSE due to its ability to identify the spectral signature of the objects present in the scene. The GWR model performs better than global regression model because it is able to fit the relationship between the missing band and the complete bands locally, which is an important advantage in heterogeneous landscape. Spatial filtering is the most inaccurate method except for one pixel-width missing line. © 2019 Society of Photo-Optical Instrumentation Engineers (SPIE).
Article
Full-text available
The dependence of the radiative properties of persistent linear contrails on the variability of their ice water path is assessed in a two-stream radiative transfer model. It is assumed that the ice water content and the effective size of ice crystals in aged contrails do not differ from those observed in natural cirrus; the parameterization of these two variables, based on a correlation with ambient temperature derived from in situ observations, allows a more realistic representation than the common assumption of fixed values for the contrail optical depth and ice crystal effective radius. The results show that the large variability in ice water content that aged contrails may share with natural cirrus, together with an assumed contrail vertical thickness between 220 and 1000 m, translate into a wider range of radiative forcings from linear contrails [1 to 66 m Wm<sup>−2</sup>] than that reported in previous studies, including IPCC's [3 to 30 m Wm<sup>−2</sup>]. Further field and modelling studies of the temporal evolution of contrail properties will thus be needed to reduce the uncertainties associated with the values assumed in large scale contrail studies.
Article
Full-text available
Contrails are important in understanding how aviation potentially affects climate change. The commonly used methods for detecting contrails usually only consider the spectral information of the image. This study focuses on introducing an object-based method for detecting contrails in AVHRR images. An object-based method utilizes not only the spectral characteristics, but also spatial information to aid in the detection. The results of the experimental study demonstrate that it is practical to use an object-based classification method for contrail detection. Compared with pixel-based classification methods, the accuracy of the results is improved using the object-based method.
Article
Full-text available
We examine multidecadal changes in surface downward shortwave (SW) radiation flux, total cloud cover, SW cloud effect, and related parameters over Europe during 1965-2004 using monthly gridded data from the Global Energy Balance Archive (GEBA), synoptic cloud reports, and the International Satellite Cloud Climatology Project (ISCCP). One key issue is distinguishing the effects of natural cloud variability from long-term anthropogenic aerosol influences on surface SW flux. Accordingly, we introduce the concept of cloud cover radiative effect (CCRE), defined as the change in downward SW flux produced by a change in cloud cover. The correlation between pan-European time series of CCRE anomalies and GEBA solar radiation anomalies is 0.88, indicating that cloud cover variability and associated changes in cloud albedo dominate SW radiation variability on monthly to decadal timescales. After these weather-related cloud effects are removed by subtracting CCRE anomalies from GEBA solar radiation anomalies via linear regression, a distinct decreasing trend followed by a distinct increasing trend remain in the residual time series. Depending on the method of trend calculation, pan-European residual flux declined by a statistically significant 2.7-3.5 W m-2 per decade during 1971-1986 and rose by a statistically significant 2.0-2.3 W m-2 per decade during 1987-2002. The fact that independent grid boxes exhibit mostly negative trends in the earlier period and mostly positive trends in the later period demonstrates that these long-term variations in SW flux are real and widespread over Europe. Changes in cloud cover cannot account for the trends in surface SW flux since cloud cover actually slightly decreased during 1971-1986 and slightly increased during 1987-2002. The most likely explanation is changes in anthropogenic aerosol emissions that led to more scattering and absorption of SW radiation during the earlier period of solar ``dimming'' and less scattering and absorption during the later period of solar ``brightening.''
Article
Full-text available
Abstract for the 10,Conference on Aviation, Range, and Aerospace Meteorology 13-16 May 2002 Portland, OR J1.3 ,,,,CONTRAIL CLIMATOLOGY OVER THE USA FROM MODIS AND AVHRR DATA Rabindra Palikonda
Article
The Sette Weather Chart was produced in 1939 using data collected from the years 1900 to 1936 to predict cloudless photographic days in the United States. Inadvertent climate modifications that have taken place since this time period makes this chart obsolete. Using current National Weather Service records from the period 1950 to 1982, the number of days having 0.1 cloud cover or less are tabulated. A new chart is produced that can predict cloudless photographic days based on current data. Forty-five cities are common both to Sette's original study and the current study. Forty-four out of the forty-five cities have had their annual monthly average of cloudless photographic days decrease between the time periods 1900-1936 and 1950-1982. Fort Worth, Texas is the only city that had its monthly average photographic days increase between the time periods studied. -Authors
Article
For pt.I see ibid., vol.26, no.4, p.463-73, July 1988. The variogram function used in geostatistical analysis is a useful statistic in the analysis of remotely sensed images. Using the results derived in Part I, the basic second-order, or covariance, properties of scenes modeled by simple disks of varying size and spacing after imaging into disk-shaped pixels are analyzed to explore the relationship between the image variograms and discrete object scene structure. The models provide insight into the nature of real images of the Earth's surface and the tools for a complete analysis of the more complex case of three-dimensional illuminated discrete-object images.
Article
[1] Radiative forcing due to linear-shaped jet contrails is calculated over the Northern Hemisphere for four seasonal months using 2006 Aqua Moderate-resolution Imaging Spectroradiometer cloud and contrail property retrieval data in a radiative transfer model. The 4 month mean shortwave, longwave, and net radiative forcings normalized to 100% contrail cover are −5.7, 14.2, and 8.5 Wm−2. Mean total net forcing over the northern half of the globe varies from 9.1 mW m−2 during October to 12.1 mW m−2 in January and is only representative at 01:30 and 13:30 LT in nonpolar regions. In some dense flight traffic corridors, the mean net forcing approaches 80 mW m−2. Scaling the 4 month average of 10.6 mW m−2 to the Southern Hemisphere air traffic yields global mean net forcing of 5.7 mW m−2, which is smaller than most model estimates. Nighttime net forcing is 3.6 times greater than during daytime, when net forcing is greatest over low clouds. Effects from contrail cirrus clouds that evolve from linear contrails are not considered in these results.
Article
The electromagnetic radiation (EMR) signals collected by satellites in the solar spectrum are modified by scattering and absorption by gases and aerosols while traveling through the atmosphere from the Earth's surface to the sensor. When and how to correct the atmospheric effects depend on the remote sensing and atmospheric data available, the information desired, and the analytical methods used to extract the information. In many applications involving classification and change detection, atmospheric correction is unnecessary as long as the training data and the data to be classified are in the same relative scale. In other circumstances, corrections are mandatory to put multitemporal data on the same radiometric scale in order to monitor terrestrial surfaces over time. A multitemporal dataset consisting of seven Landsat 5 Thematic Mapper (TM) images from 1988 to 1996 of the Pearl River Delta, Guangdong Province, China was used to compare seven absolute and one relative atmospheric correction algorithms with uncorrected raw data. Based on classification and change detection results, all corrections improved the data analysis. The best overall results are achieved using a new method which adds the effect of Rayleigh scattering to conventional dark object subtraction. Though this method may not lead to accurate surface reflectance, it best minimizes the difference in reflectances within a land cover class through time as measured with the Jeffries–Matusita distance. Contrary to expectations, the more complicated algorithms do not necessarily lead to improved performance of classification and change detection. Simple dark object subtraction, with or without the Rayleigh atmosphere correction, or relative atmospheric correction are recommended for classification and change detection applications.
Article
The mean square-root pair difference between the DN values of pixels separated by a particular spatial interval (lag) in a digital image is a measure of spatial variability related to the semi-variance. It is shown that this statistic, when evaluated in a local window for several lags differing in length and direction, can make an important contribution to the discrimination of classes of land cover. Square-root pair differences are, for this purpose, statistically preferable to semi-variances. It is also shown that a set of square-root pair differences measures different components of image texture, not all of which may be distinguished by simpler textural variables.