Professional Documents
Culture Documents
ABSTRACT
The main focus of this paper is to present the review work carried out in the analysis of under sea water object categorization.
This study presents various architecture used to identify the type of objects like classifying the fish species, manmade objects,
type of devices used for image acquisition with different type of classification methods. The fishing methods employed currently
is very harmful to the marine environment by catching sea animals those are produced rarely in sea like Turtle dolphins and
sea horse etc., In this study we have proposed new architecture to have an automatic tagging system for various type of sea
animals in underwater sea images. Providing automatic training set preparation for sea animals in underwater will help in
open-handed information for the bycatch problems by identifying the different types of species in sea.
Keywords: Image Acquisition, Classification, Sea animals and Bycatch problems
INTRODUCTION: Several types of underwater imageries are used for decision making of living marine resources.
Varity of Datasets of undersea water images exists like NOAA, ROV and Real time datasets using HD Camera as
Youtube videos. The main purpose of this survey on related literatures for undersea water imagery analysis focus on
reducing the time spent looking for or marking fish, and hence saving personnel time devoted to the tasks like, tracking
the object, counting the species, analysing the behaviours of autonomous vehicles and propose the information for
bycatch problem. This paper focus on various methods adopted by the researchers to classify the undersea water
imageries and identify the Region of Interest (ROI).
REVIEW OF LITERATURE: In this Faisal et. al. [1] proposed a new paradigm of image set classification that can
be used to achieve improved recognition rates for a number of fish species. Huimin et al. in his study focused on a
single image enhancement method. Single image enhancement is a challenging problem. Several models have been
proposed in which the image restoration system by four parts. That is, image descattering, illumination correction,
color correction, and super resolution to recover the original image. Qin and Roger [3] proposed a work to detect
individual ice floes, and the morphological cleaning is applied to smoothen the shape of each identified ice floe. Based
on the identification result, the image is separated into four different layers: ice floes, brash pieces, slush, and water.
Luca Mazzei et. al. proposed a new automatic detection and counting methods for bioluminescent organisms
represented as ashes within video data acquired through the camera based on computer vision algorithms[5]. They have
proposed the system, which is capable of recognizing different underwater objects such as pipelines, rocks and
shipwrecks.
In the paper by Yujie et. al., the image processing methods are utilized to determine the mineral location and to
recognize the mineral actually within a little processing time. In this paper Tian Jie et. al. has proposed a model to
detect and recognize the still objects automatically using SVM classifier . The paper by Deokjin Joo et al. focused on
identification of Cichlid Fishes from Lake Malawi and marked male and female. They have proposed automated
algorithm to identify the fish which are closely related to each other.[9] the AST group is developing methods to
automatically process images from single or multiple camera systems to 1) assist image analysts with more automated
measurements of fishes (e.g., StereoMeasure; Rzhanov and Cutter); 2) automatically detect, and identify organisms by
adapting algorithms (e.g., Viola-Jones, and principal components analysis) developed for face recognition (Matai et al.,
this volume); and 3) identification and reconstruction of the entire three-dimensional (3-D) scene including fish targets
using algorithms adapted from SIFT or SURF (Rzhanov and Cutter, this volume) for measurement and classification of
fish using the combination of shape and pattern by adaptation of recognition algorithms (from stage 2) to stereo
images. Such methods will reduce the burden on analysts, increase the rate of analysis, and enable adaptive behaviours
of autonomous vehicles.
Here, [10] a Support Vector Machine (SVM) based technique is used for the elimination of the limitations of some
existing techniques and improved classification of fish species is proposed. The technique is based on the shape features
of fish. Daramola et. al. described the identification of fish based on the fish physical form. Here image processing
techniques are used and feature extraction and classification is done using SVD product extracted from block image. In
this work, they have employed two steps in order to recognize a fish from video source. First is the fish detection
process, in which the fish is detected and separated from background. The detected fish image from previous stage is
then passed to a recognition algorithm to identify the species of the fish.
The author [12] presented the detection process which consists of identifying fish locations in an image frame (i.e., its
x,y pixel coordinates), fish extent (width, height), followed by a clear segmentation of fish from background. The
outcome is an image that only contains fish targets, with the background masked out, and individual non-overlapping
fish targets separately labelled. In a research work [13], the correct identification rates are given based on temporal
centroid features and discrete cosine transform coefficients features and fused features. The processing results of actual
experimental data shows that multi-feature fusion method can improve the identification rate at about 5% effectively.
The researcher [14] applied Active Shape Models (ASM) to the attachment hooks of several species of Gyrodactylus,
including the notifiable pathogen G. salaris, to assign each species to its true species type. ASM is used as a feature
extraction tool to select information from hook images that can be used as input data into trained classifiers.
Several fish classification techniques [15] based on the wavelet packet was proposed with a bi-spectrum in the study.
To verify this method, firstly, an ex situ experiment has been performed with three kinds of fish: Crucian carp
(Carassius auratus), Yellow-headed catfish (Pelteobagrus fulvidraco) and Bluntnose black bream (Megalobrama
amblycephale). The backscattering signals of these fishes are obtained. Secondly, the wavelet packet decomposition of
backscattering envelop is done, and the energy of main frequency bands which is reconstructed from each node are
calculated. Thirdly, the bi-spectrum of envelop which is constructed using the backscattering of main frequency band in
order to filtering the high frequency noise, is extracted as the additional feature. The sub-band energy of wavelet packet
and the bi-spectrum are combined as the characteristic indicator to describe the fish feature. Finally, three kinds of fish
are successfully classified by the RBF support vector machine classifier. The results reveal that the proposed method
has a highly accuracy rate of classification at fish with different shapes. In this Paper [16] , they have developed
machine vision system to analysis the video to detect, track and count the fishes in uncontrolled water environment in
open sea (Videos with moving plant, murky water low contrast ,etc).They identified the image frame quality, color
(green,blue) .
Concetto et. al.[17] , fish classification is performed by combining two types of features: 1) Texture features extracted
by using statistical moments of the gray-level histogram, spatial Gabor filtering and properties of the co-occurrence
matrix and 2) Shape Features extracted by using the Curvature Scale Space transform and the histogram of Fourier
descriptors of boundaries. An affine transformation is also applied to the acquired images to represent fish in 3D by
multiple views for the feature extraction. Qi Chen et. al. presented deep-sea high-definition camera system with the
function of identifying the sea creatures .More than the normal camera it can have real time monitoring of water
environment and improve the speed of data transmission and video image resolution.
Here image processing technique is developed to identify the sea creatures and seven creatures are classified. Authors
[19] also presented methods to detect Rock Fish automatically based on cascade classifiers of Harr-like features created
using underwater imaging form ROV under ocean survey condition. Images are unconstrained and imaging system is
moving invariable and detecting the fish in complex rocky seabed background.
ANALYSIS OF RELATED WORK: Table 1.1 specifies the detailed overview of the various techniques adopted by
the researchers, its purpose and applicable for what kind of dataset.
Further it specifies the feature set used by the researchers and their performance analysis. This would help us to refine
our architecture for effective detection and classification of underwater imageries.
Table 1.1 : Analysis of the various reviews in Underwater Imagery Object identification
Paper Type of input Architecture Features Performance Materials /data set Used
No device(sonar/EM Evaluation
CCD/HD
Camera/Normal
Camera
I Digital video high A new paradigm of image set careful creation of these algorithms the image collection from
resolution classification is presented that can be images set high have the potential of ImageCLEF 2014 Fish Task
used to achieve improved accuracy of the solving the (Spampinato et al., 2014) has been
recognition rates for a number of presented image set- automatic fish utilized. The dataset contains pre-
fish species. State-of-the-art image based approach species defined training and test splits for
set construction, modelling, and under challenging identification ten fish species
matching algorithms from computer conditions. The problem in
vision literature are discussed with overall classification underwater videos
an analysis of their application for accuracy for all ten captured within
automatic fish species identification species studied in unconstrained
this work was environments.
around 95%.
II Free-Ascending Image restoration system presented. No Classification . proposed algorithm Ten underwater images were
Tripod (FAT)- It includes four parts image de Image restoration is evaluated both selected, including five images
with digital scattering, illumination correction, analytically and from the project South China Sea
camera color correction, and super experimentally by Deep and five images from our
resolution . using ground truths water tank experiments
III unmanned aerial Ice pixel extraction Edge detection- brash ice threshold A total of 2511 ice sea-ice features at Ny-lesund in
vehicle was used arranged in an array morphological size is larger than floes and 2624 early May 2011.
as a mobile sensor processing-classification-overall the fixed threshold brash ice are
plate form distribution of all types(4) for floes ice .others identified . The
are slush ice. Four coverage
layers of ice is percentages are
found. Size 65.98% ice floe,
calculated. Over all 5.03% brash ice,
distribution of all 17.52% slush, and
types of ice is 11.47% water.
calculated.
IV ICDeep (Image Image processing and Blop Blop Extraction TPR=CD/GT Digital video of bioluminescent
Intensified Charge Extraction (Thresholding, flood fill)- FPR=ALGO- organisms through the deep water
Coupled Device Blob Annotation(Labelling, CD/ALGO column
for Deep-sea Tracking)-Event 92.24% of the
research) Recording(counting). events identified by
the ground truth
were also detected
V underwater Acquired MBES Real data Shape features 100% detection of Artificial objects represented a
imaging Devices, contained three pipelines, which (Shapes created by all pipelines sample of the most common
these imaging was used for testing the proposed Autocad ,rectangle, underwater objects were tested;
devices include approach, and then artificial data circle, ellipse objects included a pipe, partial
MBES and SSS was generated and processed using artificial) ship wreck and a rock. The Sonar
the pre mentioned approach to check data acquisition. MBES and SSS
the validity of this approach. are used in different times and
under varying weather and
bathymetric conditions.
VI Underwater Video or image removing potential Shape based _ACE is used to Simulation of the mine detection
Camera Moire effect- the homomorphic Preconization enhancement system in
filters to correct the non-uniform the image. the darkroom of their laboratory.
illumination- DTC-wavelet
transform- proposed novel MAP
estimation-based method to
denoising.- make a decision to
remove artificial light or not. If
artificial light exist, remove by
single frame vignetting correction
algorithm, or else, utilizing the
proposed guided-trigonometric
bilateral filters to remove the haze.
Finally, take the proposed fast
automatic color equalization
algorithm for enhancing the contrast.
XII ROV Input Fish detection recognition. PCA with SIFT Using five positive Images of butterfly fish in an
The detection process consists of features ate used. images of butterfly aquarium collected by Benson et
identifying fish locations in an image fish and flag rock al. (2009) and rockfish images
frame (i.e., its x,y pixel fish resulted in a collected in situ
coordinates),fish extent (width, 50% recognition by an ROV were provided by J.
height), followed by a clear rate. With an Butler, NOAA SWFSC
segmentation of fish from increase in the Benthic Resources Group .
background. number of positive
The outcome is an image that only images to 10, a
contains fish targets, with the 100% hit rate
background masked out, and (#Test = 2) was
individual non-overlapping fish achieved
targets separately labelled.
XIII The main Fish acoustic scattering signal- acoustic scattering correct identification The tank experiment is carried
experiment >Hilbert transform -> Temporal data, temporal rates are given with fishes in the anechoic tank of
equipments are centroid, Discrete cosine transform centroid (TC) based on temporal Key Laboratory of Underwater
transmitting calculation->Features fusion- features and discrete centroid features Acoustic Technology, Harbin
transducer, >Features dimension reduction. cosine transform and discrete cosine Engineering University.
standard (DCT) coefficients transform The three kinds of fishes are
hydrophone, features used to coefficients features selected to be objectives of study,
acquisition, laser analyze acoustic and fused features. which are carassius auratus,
CONCLUSION:
Based on the review of literature survey carried out for underwater imagery, the following architecture can be designed
to overcome the challenges faced by the researchers in their proposed methodologies.
Any type of HD undersea water video can be considered for the analysis. The video has to be divided into frames and
fragmented.
The fragmented frames will be pre-processed and object detection can be performed and ROI is segmented.
Training set and Test set preparation based on set of features selection for properly segmented objects.
The classification method is employed to detect the type of under water objects effectively.
Advantages of the proposed technique:
1. Improve Identification through classification
2. Enhancing De-noising
3. Improve image enhancement
4. Background object detection and removal
5. Best feature selection for reducing high dimensional feature set
6. Extracting specialized feature
7. Different varieties of Input Data set(Videos)
8. Identify differentiate point in input data
REFERENCES:
1. Faisal Shafait et al., Fish identification from videos captured in uncontrolled underwater environments, ICES
Journal of Marine Science (2016).
2. Huimin Lu , Yujie Li, Seiichi Serikawa et. al.,, Image Restoration Method for Deep-sea Tripod Observation
Systems in the South China Sea, 978-0-933957-43-52015MTS.
3. Qin Zhang and Roger Skjetne, Image Processing for identification of Sea-Ice Floes and the Floe Size Distributions,
IEEE Transactions on Geoscience and Remote Sensing, Vol. 53.
4. Luca MazzeiSimone Marini, Jessica Craig (et. al.,), Automated Video imaging system for counting Deep sea
Bioluminescence organisms Events, 2014 ICPR Workshop on Computer Vision for Analysis of Underwater
Imagery.
5. Hatem Awad Khater,et. al.,, Underwater Object Recognition, International Journal of Engineering Inventions e-
ISSN: 2278-7461, p-ISSN: 2319-6491 Volume 2, Issue 7 (May2013) PP: 34-40.
6. Yujie Li, Huimin Lu,et. al.,, A Novel Deep-sea Image Enhancement Method, International Symposium on
Computer, Consumer and Control, 2014.
7. Tian Jie , Xue Shan- hua , Huang Hai-ning , Zhang Chun-hua , Classification of underwater still objects based on
multi-field features and SVM, Article Journal of Marine Science and Application March 2007, Volume 6, Issue 1,
pp 36-40.
8. Deokjin Joo,et. al.,, Identification of Cichlid Fishes from Lake Malawi Using Computer Vision, Claude Wicker-
Thomas, Editor.
9. Kevin Stierhoff, George Cutter, David Murfin,et. al.,,An Overview of Visual Survey Research and Imaging
Technology Development at the Southwest Fisheries Science Center, Report of the National Marine Fisheries
Service Automated Image Processing Workshop September 4-7, 2010.
10. S.O. Ogunlana, O. Olabode,et. al.,, Fish Classification Using Support Vector Machine, African Journal of
Computing & ICT 2015Afr J Comp & ICT All Rights Reserved-ISSN 2006-1781,www.ajocict.ne vol 8 ,No.2
June,2015(IEEE).
11. Daramola S. Adebayo,et. al.,, Fish Classification Algorithm using Single Value Decomposition, International
Journal of Innovative Research in Science, Engineering and Technology(A High Impact Factor, Monthly Peer
Reviewed Journal)Vol. 5,issue2,February 2016 Copyright to IJIRSET .
12. . Matai .J,Kastner.R, Automated techniques for detection and recognition of fishes using Computer Vision
algorithms University of California, San Diego,G.R. Cutter Jr. and D.A. Demer ,Southwest Fisheries Science
Center, NMFS, NOAA.
13. Du Weidong A,et. al.,, novel classification method of fish based on multi-feature fusion , Applied Mechanics and
Materials Vols 713-715 (2015) pp 1513-1519.
14. Ali,Amir Hussain, et. al.,, Feature Extraction and Classification for Multiple Species of Gyrodactylus Ectoparasite
Rozniza, TELKOMNIKA Indonesian Journal of Electrical Engineering Vol. 13, No. 3, March 2015, pp. 503 ~
511.
15. Qiao ZHANG, Feng XU, Tao WEN, Tianze YU, : A Method of Fish Classification Based on Wavelet Packet and
Bispectrum ,Copyright 2014 IFSA Publishing.
16. concerto Spampinato,et. al.,, Detection , Tracking and counting fish in low quality unconstrained under water
videos.
17. Concetto Spampinato,et. al.,, Automatic Fish Classification for underwater Species behaviour understanding,
ARTEMIS10, October 29, 2010, Firenze, Italy.,Copyright 2010 ACM 978-1-4503-0163-3/10/10.
18. Qi Chen,HaiBin Yu Hangzhou ,System Based on Marine Creature Classification Technology , 978-1-4673-7005-
9115/$31.00 2015 IEEE Proceedings of ICCT2015.
19. George Cutter, Kevin Stierhoff, Automated detection of rockfish in unconstraint under water videos using Harr
cascades and a new image data set: Labled fishes in the world, 2015 IEEE Winter Conference on Applications of
Computer Vision Workshops