A Minor Project Report

Submitted
to
NATIONAL INSTITUTE OF TECHNOLOGY, RAIPUR
CHHATTISGARH, INDIA.

Session 2018

by

Vivek Kumar
B.Tech (7th Semester)
Roll No. 15114076
Under the Supervision
Of

Dr. A.D. Prasad

Assistant Professor
Department of Civil Engineering
National Institute of Technology, Raipur
Chhattisgarh, 492010, India

DEPARTMENT OF CIVIL ENGINEERING

National Institute of Technology, Raipur
Raipur, Chhattisgarh, 492010, India
 TABLE OF CONTENTS
Content
1 ABSTRACT
2 LITERATURE REVIEW
3 PAPER REVIEW-I
4 PAPER REVIEW-II
5 WAVELET TRANSFORMATION
6 REFERENCES
 1. ABSTRACT
With the rapid development of satellite sensors, remote sensing images have become widely
used. However, due to the technical limitations of the sensors and other factors, the existing
remote sensing sensors have to make a fundamental tradeoff between the spatial and spectral
resolutions. Specifically, there are two main limitations.
(1) The incoming radiation energy into the sensor. In general, the high spatial resolution (HR)
panchromatic (PAN) image has broader bandwidth, and the low spatial resolution (LR)
multispectral (MS) image has narrower bandwidth To collect more photons and ensure the
signal-to-noise ratio (SNR), the size of the MS detector should be larger (i.e., a larger
instantaneous field of view (IFOV), and then a lower spatial resolution).
(2) The data volume collected by the sensor. It should be noted that the data volume of the HR
MS image is significantly larger than that of the bundled LR MS and HR PAN images.
Therefore, this can overcome the difficulty of the limited on-board storage capacity and the data
transmission from platform to ground. Fortunately, PAN/MS image fusion, which is typically
referred to as “pansharpening”, can be used to integrate the geometrical detail of the HR PAN
image and the spectral information of the LR MS image to obtain an HR MS image, and it can
overcome the tradeoff between the spatial and spectral resolutions of satellite sensors.
 2. LITERATURE REVIEW
S. Title Author YEA Journals Methodology Conclusion Remarks
No. R
1 Remote Jinying Zhong, 2016 Sensing and (1.) MS image (1.) A novel two- The poposed
Sendsing Image Bin Yang, Imaging An Super-Resolution stage RSIF algorithm method with
Fusion with Guoyu Huang, International with is proposed in this Convolutiona
Convoluton Fei Zhong, Journal Convolutional paper, which makes l Neural
Neural Network Zhongze Chen Neueral Network. the full use of both Netwrk has
(2.) Remote spatial detail and much more
Sensing Image spectral information imformation
Fusion of the LMS image and is
itself. presented in
(2.) LMS image fully this paper in
utilize itself spatial great deatail
details to improve its and compared
resolution with to existing
SRCNN, GS methodology.
transformation is
employed to conduct
the fusion for
obtaining final HMS
image.

2 Fusion of Rocco 2016 IEEE (1.) (1.)The results show This paper
Multispectral Restaino,Gemine Pansharpening that the proposed discusses new
and Vivone, algorithm. method greatly approach to
Panchromatic Mauro Dalla (2.) Mathematical outclasses the Mathematical
Images based on Mura Morphology existing Morphology.
morphological (MM), pansharpening It also
Operators morphological algorithms based on compare the
approaches mathematical
(3.) texture morphology.
analysis, image (2.) the existing
segmentation and pansharpening
classification algorithms based on
mathematical
morphology achives
top class
performance without
requiring specific
knowledge of the
sensor.

3 Image Fusion Yosra BEN 2016 International (1.) JDL model (1.) A model defining Approach to
Models and SALEM, image and Data – different processing image
Techniques at Kamel processing Feature – levels for the fusion processing
pixel level HAMROUNI, application Decision (DFD) processis severely like
Basel and system Model. required. JDL,DFD
SOLAIMAN conference (2.)PCA (2.) This paper methods are
(Principal reviewd the basic discussed and
 Component models and also basic
Analyses) techniquees used in method are
(3.)Wavelet image fuison. disccussed
based methods with the
(4.) mathematical
IHS(Intensity- formula to be
Hue-Saturation) used in the
based methods calculation

4 Review of the Meng 2018 Information (1.) Component (1.)This Paper shows It consists of
pansharpening Xiangchao, Shen Fusion Substitution(CS) that most of the VO- thorough
methods for Hauanfeng, Li (2.) based methods process and
remte sensing huifang, Zhang Multiresolution generally perform flowchart of
images based on Liangpei, Fu Analysis(MRA) better than the CS- how the
the idea of meta- Randi (3.)Variational based methods and fusion
analysis Optimization the MRA-based process is
(VO) methods. carried out to
(2.) This paper has get the best
presented a result of the
comprehensive LR MS and
review of the HR PAN.
pansharpening
methods for remote
sensing images

5 Pan sharpening R.V.G. 2018 The (1.) RSR and (1.)Based on This Paper
using relative Anjaneyulu, International Curvelet Based experimental results discussed
spectral response A.Krishna Archives of Image Fusion pertaining to the Curvelet
of sensor for prasad, K. the quality metrics- the method and
CARTOSAT-1 Srinivasa Photogram proposed method how it is
PAN and Murthy, C.V. metry, provides better better in
RESOURCESA Rao, B. Gopala Remote results, both visually various
T LISS-4 MX Krishna Sensing and and quantitatively, aspect of
Data Spatial for remote sensing preserving
Information optical image fusion. Spatial and
Sciences Spectral
details then
other method
under
observation.
 3. PAPER REVIEW
Review of the pansharpening methods for remte sensing images based on the idea of meta-analysis
S.No Name of Description
method
1 Component substitution (1.)The CS-based method
(CS) based methods are simple and are widely
used. (2.) It
is based on simple
substitution of single
component by the PAN
image,and then obtained by
linear combination of
spectral bands of MS images
as in GSA,BDSD methods.
2 Multiresolution (1.) It is basically based on
analysis (MRA) based single level decomposoiton
method as the High-Pass filter but
now these are based strictly
on the decimated wavelet
transform(DWT).
(2.) The image is first
decomposed into series of
bandpass channels then, the
high-frequency channels
coming from PAN
decompostion are inserted
into the corresponding MS
band channels before the
reconstruction step.
3 (1.)They acquire a large (1.) The main process of this
collection of external methods is based on or
images, which is converted to the
computationally optimization of the
expensive. variational model.
(2.) The model-based The two major part are:
and sparse-based a. contruction of the energy
apprach don not have functional.
the rigid distinction. b. optimization
(2.) Energy functional terms
a. the spectral fidelity model
b. the spatial enhancement
model c. the pror
model
Advantages Disadvanta
ges
(1.)It leads to easier and faster (1.)it must be
implementation of previous satisfying the
or traditional methods. premise that its
(2.)It opens up new component are to
opportunity for this kind of be substituted in
method to develop. a linearly
generated by the
available spectral
bands.
(1.) The purpose of this For the
method is to preserve the calculation with
whole content of the LR MS the decimated
image and add the further filters, such as
high sppatial structure the DWT filter,
information of the HR PAN the low-pass
image. version has to go
(2.)The high spatial structure through the
information is taken from the down-sampling
difference between PAN and interpolation
image P and its low-pass operation , and
version this generally
introduce the
spatial aliasing
artifacts.
(1.) The optimization solution (1.)They acquire
of the fusion method is based a large collection
on iterative optimization of external
algorithm. images, which is
They are gradient descent computationally
algorithm, the conjugate expensive.
gradient algorithm, the split (2.) The model-
bregman iteration algorithm, based and sparse-
and the alternating direction based apprach
method of multipliers don not have the
algorithm. rigid distinction.
(2.) Contruction of optimal
fusion energy functional.
(3.) Adaptive selection of the
model parameteres.
(4.) fast optimal solution.
 4. PAPER REVIEW
Pan sharpening using relative spectral response of sensor for CARTOSAT-1 PAN and RESOURCESAT LISS-4
MX Data

S.No Name of Description Advantages Disadvanta

method
1 Curvelet Transform (1.)the curvelet transform
is a multiscale pyramid
with many directions and
positions at each length
scale, and needle-shaped
elements at fine scales.
(2.)Curvelets efficiently
address very important
problems where wavelets
fails.
(3.) Example:
a. Optimally sparse
representation of objects
with edge.
b. Optimally sparse
representation of wave
propagators.
c. Optimal iamge
reconstruction in severely
illposed problems.
ges
(1.) The digital (1.) If the spectral
implementation of the characteristics are
second generationcurvelet well preserved, the
transform in two and three spatial quality is
dimensions provided by lost.
curvelab.
(2.) its implementation are
fast in the sense that they
run in O(n2 log n) flops for
n by n Cartesian arrays; in
additiona they are also
ivertible, with rapid
inversion algorithms of
about the same complexity.
(3.) Both digital
transformations return a
table of digital curvelet
coefficients indexed by a
scale parameter, an
orientation parameter, and a
spatial location parameter.

2 RSR and curvelet based
fusion
(1.) The spectral radiance
at the sensor aperture, and
the peak-normalized
spectral response.
(2.) The weights are
obtained by comparing the
response of individual
bands of the sensor and the
response of the
panchromatic band.
(3.) The panchromatic
image, which will replace
the intensity image, will be
spectrally similar to the
intensity image if bands not
included in the intensity are
subtracted from it.
(1.) Prelaunch Normalised
RSR lab measurements for
all invidual PAN and Mx
bands were used.
(2.)The spectral band to be
subtracted from the
highresolution panchromatic
image has a lower spatial
resolution than the original
panchromatic image
(3.) Since the wavelet
transform preserves the
spectral information of the
original multispectral
images, it has the high
spectral resolution in
contrast with the IHS-based
fusion result, which has
some colour distortion
(1.) The obtained
synthesised PAN
band is highly
correlated with the
multispectral
intensity image
but lacks in spatial
details from the
original PAN
image.
(2.). The wavelet-
based fusion result
has much less
spatial information
than that of the
IHS-based fusion
result.
5. WAVELET TRANSFORMAION MATLAB CODE
 +

HR PAN LSR MS

High resolution Fused image

 5. REFERENCES
1.Jinying Zhong, Bin Yang, Guoyu Huang, Fei Zhong, Zhongze Chen, Remote Sendsing Image Fusion with
Convoluton Neural Network; Sensing and Imaging An International Journal, 2016

2. Rocco Restaino,Gemine Vivone, Mauro Dalla Mura , Fusion of Multispectral and Panchromatic Images based
on morphological Operators , IEEE 2016.

3. Yosra BEN SALEM, Kamel HAMROUNI, Basel SOLAIMAN, Image Fusion Models and Techniques at
pixel level, International image processing application and system conference 2016.

4. Meng Xiangchao, Shen Hauanfeng, Li huifang, Zhang Liangpei, Fu Randi, Review of the pansharpening
methods for remte sensing images based on the idea of meta-analysis, Image Fusion 2018.

5. R.V.G. Anjaneyulu, A.Krishna prasad, K. Srinivasa Murthy, C.V. Rao, B. Gopala Krishna, Pan sharpening
using relative spectral response of sensor for CARTOSAT-1 PAN and RESOURCESAT LISS-4 MX Data, The
International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences 2018.