Professional Documents
Culture Documents
org/emrEngineeringManagementReviews(EMR)Volume2Issue2,June2013
FeatureExtractionmethodforClassification
ofApprovedHalalLogoinMalaysiausing
FractionalizedPrincipleMagnitude
KhairulMuzzammilSaipullah*1,NurulAtiqahIsmail2andYewguanSoo3
FacultyofElectronicandComputerEngineering,
UniversitiTeknikalMalaysiaMelaka(UTeM),Melaka,Malaysia
*1
muzzammil@utem.edu.my;2m021110036@student.utem.edu.my;3soo@utem.edu.my
Abstract
Toovercomethisproblem,atoolisneededtohelpthe
Muslims in Malaysia to classify the approved Halal
logos. Since the logo can be distinguished using its
visualinformation,theclassificationcanbedoneusing
computer vision and image processing. To accurately
classifythelogo,agoodfeatureextractorisnecessary.
Some of the feature extractors used in logo
classification are histogram of oriented gradients
(HOG),Humoment,Zernikemomentandwaveletco
occurrence histogram (WCH). However, even though
these feature extractors hold high accuracy, their
algorithms are too complex and timeconsuming.
Therefore, in this paper, a new, simple and high
accuracyfeatureextractorhasbeenproposedbasedon
Fourier transform that is called Fractionalized
Principle Magnitude (FPM) the combination of
principle magnitudes of the Fourier transform
extractedfromthefractionalizedimages.
Fourier
Principle
Magnitude;
Logo
WiththedevelopmentoffastFouriertransform(FFT),
Fouriertransformbecomesoneofthefastmethodsto
extractfeaturesandiswidelyusedinfeatureextractor
application. For example, K. Muzzammil and Deok
Hwan Kim proposed localized angular phase which
utilizes the phase from the Fourier transform in
localized polar space. Besides that, Feng Zhou., Ju Fu
FengandQingYunShiproposedtexturedescriptorby
usingthemagnitudeofthe1DFouriertransform.Ville
OjansivuandJanneHeikkilproposedblurinsensitive
texturedescriptorusingthephaseofthelocalFourier
transform coefficients. K. Muzzammil, ShaohuPeng,
HyunSoo Kim and DeokHwan Kim proposed a 2D
localFouriertransformbasedtexturedescriptorwhere
spatial distribution of gray levels of neighborhood
pixels can be extracted. Furthermore K. Muzzammil
and DeokHwan Kim has used Fourier transform in
spectral feature extraction techniques in target
detectionofhyperspectralimages.
Introduction
Object detection is an important task in computer
vision community with the purpose of allowing
computers automatically detect semantic objects, like
human faces, ntiate between an approved Halal
product and a nonHalal product. Since the Halal
condition of product especially the food, is very
important for the Muslims, the classification of the
Halallogobecomessignificant.
IslamicdepartmentofMalaysia(JAKIM)haslistedout
theapprovedHalallogos.Therearearound50Halal
logos from 31 countries over the world approved by
JAKIM. Unfortunately, most of the Muslims in
Malaysia do not recognize these logos since there are
somanylogostoberemembered.
36
EngineeringManagementReviews(EMR)Volume2Issue2,June2013
Thispaperisorganizedasfollows:insection2,related
works are discussed. In section 3, the detail
explanations about FPM are presented. In section 4,
the results and their analysis are presented. Finally,
theconclusionisgiveninsection5.
HistogramofOrientedGradient
Histogram of Oriented Gradients (HOG), a technique
forobjectdetection,generallyisappliedtopedestrian
detection based on the evaluation of comparison
between the histograms regarding of gradient
orientation among the localization of an images. The
concept of the HOG is similar with that of edge
orientation, scaleinvariant feature transform (SIFT)
descriptorandshapecontexts,butitisregardingona
dense grid of uniformly spaced cells and used
overlappinglocalcontrastnormalizationforimproved
accuracy. Computation of each histogram is divided
into small region called cells. The group of cell is
combined to become a block. Then each cell is
compiled using HOG and the combination of
histogram represents descriptor. The illumination
changes depend on strength of the normalization of
thegradient.TheperformanceoftheHOGisrelatedto
the effective of local contrast normalization of each
block.
function.
n s !
n m
n m
s !
s !
s !
2
2
An , m
Anm
and
therefore
Since A00 and A11 are the same for all of the
normalized symbols, they will not be used in the
feature set. Therefore the extracted features of the
ordernstartfromthesecondordermomentsuptothe
nthordermoments.
MomentsInvariant
Moment invariants are related to the characteristic of
pattern regarding position, size, and rotation of the
image. The idea of the moment invariants was come
fromMingKueiHuinyear1962,whointroducedsix
orthogonal invariants and one skew orthogonal
invariants based on algebraic invariants [8]. Moment
invariants have been applied to many applications
especially pattern recognition, image registration and
imagereconstruction.
Therearetwodimensionaloforder(p+q)ofadigital
imagef(x,y)thatcanbedefinedasfollows:
M 1 N 1 p q
m pq x y f x , y , p , q 0,1, 2, ...
x 0 y 0
(5)
Thecentralmomentoff(x,y)canbedefinedas:
p
q
M 1 N 1
y y f x, y ,
xx
x 0 y 0
pq
p, q 0,1, 2,...
(1)
n2 s
Since
n m
2
s
R nm 1
s 0
2
2
f x , y Vnm x , y , x y 1 (4)
x y
ZernikeMoments
jm
n 1
Related Works
www.seipub.org/emr
Where x
(2)
m10
m
and y 01
m00
m00
(6)
wherenisanonnegativeinteger,misanintegersuch
scalingnormalizationofcentralimagemomentcanbe
definedas:
2
2
thatn|m|isevenand m n, x y ,and
pq
tan
1 x
pq
00
, w h e re
p q
1, p q 0 , 1, 2 , ...
(7)
(3)
37
www.seipub.org/emrEngineeringManagementReviews(EMR)Volume2Issue2,June2013
Resize images to
210x210 pixels
Accuracy Result
Group Test
Convert RGB to
Grayscale
Divide images
into 9 blocks
1D Fourier
Transform
Save the
magnitude value
Normalization
Classification
Group Train
FIG.1THEFLOWOFTHESYSTEM
1 20 02
4112
2
2
3 3
2
2
2
2
2
3 3
2
2
3 3
2
2
4
2
2
3 3
2
2
3 3
3
30
12
30
03
20
11
30
12
30
21
12
12
21
12
21
21
03
(8)
03
03
03
21
03
30
30
30
12
21
12
03
02
03
30
21
Fractionalized1DPrincipleMagnitude
03
21
12
21
21
12
30
Proposed Method
2 20 02
30
03
12
30
30
12
12
21
21
03
03
WaveletCooccurrenceHistogram
Wavelet cooccurrence histogram (WCH) is a method
of object detection especially in logo detection. Ali
Hesson and Dimitrious Androutsos used WCH for
logo detection in their experiment, and the results
showed that WCH is better in representation of the
image feature compared to Edge Directional
Histogram (EDH). Wavelet transform is used to
produce a signal with a good resolution especially in
spatialandfrequencydomain.Oneoftheexamplesof
wavelet transform is Haar transform, which is
grouped into two types of filter thatislow pass filter
andhighpassfilter.Therearefoursubbandsusedto
apply the Haar transform namely LowLow (LL),
LowHigh(LH),HighLow(HL)andHighHigh(HH)
filters. The subband is represented with low pass
filter and high pass filter in different order. Each
wavelet transform can be divided into three
dimensional vectors that are horizontal, diagonal and
vertical, each of which represents pixel of the image.
The first and second dimensions represent the pixel
vectors and the third dimension represents the
distancebetweenthetwovectors.
38
a)Imagesize
210x210
b)Blockofsize3x3
fractions
c)Imagesize
42x42
FIG.2THEGRAPHICALILLUSTRATIONOFDIVIDINGIMAGE
INTO5x5FRACTION
f1D (v) f
, v modW , v 0,1,...W H 1
(9)
EngineeringManagementReviews(EMR)Volume2Issue2,June2013
www.seipub.org/emr
2 jnv
H W 1
F1D ( n)
f (v )e H *W , n 0,1, ...., H W 1 (10)
v0 1D
Mag_F1D ( n ) Re F1D ( n )
Im F1D ( n )
(11)
Becauseoftherobustnessandconsistencyvalueofthe
magnitude,themagnitudeoftheFouriertransformis
only utilized as the feature. Among all of the
FIG.3THEGRAPHICALILLUSTRATIONOFCONVERTING2D
IMAGETOASINGLEARRAY
selected.
.
.
FIG.4THEFLOWOFTRANSFORMATIONFROM2DIMAGEINTO1DFOURIERTRANSFORMFORONEDIRECTION
39
www.seipub.org/emrEngineeringManagementReviews(EMR)Volume2Issue2,June2013
Asitiswellknownthatthefourvaluesonlygathered
from the first fraction of the logo can be labelled as
follows:
Mag _ F1D1,Mag _ F1D 2,
1
M _ F1D
Mag _ F1D(3),Mag _ F1D(4)
(12)
FIG.5FROM(1)UNTIL(50)ARETHEEXAMPLESOFHALAL
LOGOINTHEDATABASE
25
Fortheclassifier,knearestneighboralgorithm(kNN)
isimplemented.kNNisamethodtoclassifydatainto
two classes or more based on the closest training.
Form research done by Yang and Liu, it was stated
that kNN outperformed other approaches especially
intextcategorizationtask.Itisalsooneofthesimple
machinelearningmethods.kNNisjustdevelopedto
perform an analysis for estimate value or probability
ofthedatawhentheunknownordifficultdatashould
be classified. In this experiment, it is assumed that
value k=1 is a simple kNN in classification between
class and its nearest neighbour. Cosine similarity is
implemented in this experiment to measure the
differentanglebetweentwovectors.
accuracy %
TheperformanceofFPMiscomparedwiththatoffour
othermethodswhicharecommonlyusedthatisHOG,
Hu moment, Zernike and WCH. This experiment is
conductedoncomputerwithanAMDE350processor
1.60GHzand 6GB of main memory.All the codes are
40
no.of correctlyclassification
no.of totalimages
(14)
Aftercalculatingtheaccuracyofallofthe5folds,the
final average accuracy from each fold is calculated
usingthefollowingformula:
EngineeringManagementReviews(EMR)Volume2Issue2,June2013
averageaccuracy %
(15)
EffectofFractionSizeofFPM
Accuracy AOT %
Time
AverageAccuracy(%)
(16)
ACCURACYOVERTIME
www.seipub.org/emr
100
90
80
70
60
50
40
30
20
10
0
FPM
HOG
Humoment
Zernike
WCH
FIG.7AVERAGECLASSIFICATIONACCURACYONHALAL
LOGODATABASE
Table1showstheclassificationtimeofeachmethodto
classify the approved Halal logo. Based on the result,
FPM holds the fastest processing speed among the
others. It is due to simplicity of FPM compared to
othermethods.Zernikemethodtakesthelongesttime
to compute because the algorithm is complex and
needsmanycalculations.
4.1
4
3.9
3.8
3.7
3.6
3.5
3.4
3.3
3.2
3.1
TABLE1CLASSIFICATIONTIMEONHALALLOGO
16
25
36
SIZEOFFRACTION
Method
Classificationtime
FPM
23.74183
HOG
102.0857
Humoment
39.0395
Zernike
3765.757
WCH
7249.9
FIG.6THEOPTIMUMSIZEOFFRACTION
ComparativeStudyofFPMwithOthersMethod
BasedonClassificationofFeatureExtraction
The experiment is conducted to analyze the
classification performance of feature extractor among
FPM, HOG, Hu moment, Zernike and WCH on the
Halal logo database. The average classification result
is showed in the Figure 7, from which it can be
observe that FPM obtains the highest classification
accuracyof94%andHumomentperformsthelowest
41
www.seipub.org/emrEngineeringManagementReviews(EMR)Volume2Issue2,June2013
FalsePositivelogo
FPM
40
TABLE3ACCURACYANDCLASSIFICATIONTIMEONTRAFFICSIGN
HOG
30
DATABASE
HuMoment
20
Zernike
10
WCH
0
40
60
80
100
threshold[%]
Method
Accuracy
FPM
90
10.34
HOG
93.75
9.1608
Humoment
25
17.8337
Zernike
62.5
1081.2
WCH
78.12
8716.1
Classificationtime
FIG.8THEFALSEPOSITIVETHRESHOLD
EvaluationClassificationofFPMversusOthers
MethodBasedonTextureDatabase
TABLE2THEFALSEPOSITIVEWITHTHRESHOLD100%
Methods
False
Positive
FPM
HOG
Humoment
Zernike
WCH
18
37
49
46
38
EvaluationClassificationofFSMversusOthers
MethodbasedonTrafficSigndatabase
In this section the application of the FPM is applied
with a new database. The evaluation of the
performance of FPM and other four methods are
presented. Figure 9 shows the example of traffic sign
database gathered from German Traffic Sign
Recognition Benchmark database (http://benchmark.
ini.rub.de/). For the experiment 32 classes of traffic
sign are used and each class contains 10 images and
thetotalimagesis320.
Table4showstheclassificationtimeofFPMandother
featureextractors.Referringtotheresults,thehighest
accuracy for Outex database is HOG algorithm with
83.3% higher than other algorithm. Meanwhile FPM
algorithm with the achievement of 50% accuracy and
less computation time is appropriate for images logo
withspecificfeature.Comparedtootheralgorithms,it
is applied to flexible image or object. Although the
FPM algorithm result is less but it is able to compete
withotheralgorithm.
FIG.9TRAFFICSIGNDATABASE
42
FIG.11THEEXAMPLEOFOUTEXDATABASE
EngineeringManagementReviews(EMR)Volume2Issue2,June2013
TABLE4ACCURACYANDCLASSIFICATIONTIMEONTEXTUREDATABASE
Method
Accuracy
Classificationtime
FPM
50
28.2225
HOG
83.3
40.0752
Humoment
16.7
40.8569
Zernike
12.5
771.897
WCH
66.7
35929
www.seipub.org/emr
Hesson,A.,Androutsos,D.,Logoandtrademarkdetection
in
images
Histograms,
using
Color
IEEE
Wavelet
International
Cooccurrence
Conference
on
cooccurrence
histograms,
Canadian
ConferenceonElectricalandComputer Engineering,
pp.000927000930,2008.
JAKIM
Halal
webpage
http://www.halal.gov.my/v3/.
RetrievedonJuly10,2012.
Khairul Muzzammil Saipullah and DeokHwan Kim, A
robusttexturefeature extraction using the localized
angular phase, Multimedia Tools and Applications,
SpringerNetherlands,pp.1,31March2011.
KhairulMuzzammilbinSaipullah,DeokHwanKim,Target
detectionofhyperspectralimagesbasedontheirFourier
spectralfeatures,OpticalEngineering,Volume51,Issue
11,June2012.
Khairul Muzzammil, ShaohuPeng, HyunSoo Kim and
DeokHwan Kim, Texture Feature Extractor Based on
2D Local Fourier Transform, 31th Korea Information
ProcessingSocietySpringConference,April2009.
MingKuei Hu, Visual pattern recognition by moment
invariants,IRETransactiononInformationTheory,vol.
8(2),pp.179187,1962.
OjansivuV,HeikkilaJBlurinsensitivetextureclassification
ACKNOWLEDGMENT
pp236243,2008.
Qiang Zhu, MeiChen Yeh, KwangTing Cheng, Avidan, S.,
REFERENCES
Cover,
T.,
Hart,
Nearest
Neighbor
Pattern
ConferenceonComputerVisionandPatternRecognition,
Classification,IEEETransactiononInformationTheory,
vol.2,pp.14911498,2006.
vol.13(1),pp.2127,1967.
moments
Fast
using
computation
cascade digital
classification,IEEE transactiononinformationtheory,
exact
vol.13(1),pp.2127,1967.
filter,
InformationScience,vol.181(7),pp.36383651,2011.
RetrievedonOctober28,2012.
onComputerVisionandPatternRecognition,vol.1,pp.
886893,2005.
pp.606614,2002.
43
www.seipub.org/emrEngineeringManagementReviews(EMR)Volume2Issue2,June2013
Vision,andEmbeddedSystem.
scaling
and
rotation,
2nd
44