Professional Documents
Culture Documents
ASegmentationMethodUsingMultiscaleand
MultidirectionalMatchedFiltersBasedon
DyadicWaveletTransformforFingerVein
PatternExtraction
MariosVlachos*1,EvangelosDermatas2
DepartmentofElectricalEngineering&ComputerTechnology,UniversityofPatras,Patras,26500,Hellas
*1
mvlachos@teemail.gr;2dermatas@george.wcl2.ee.upatras.gr
Abstract
In this paper an efficient automatic method for robust
segmentation of finger vesselnetwork and vein pattern
extraction from infrared images acquired by a lowcost
monochrome or multichannel camera, is proposed. After
brightnessnormalization,thefingerprintlinesareeliminated
usingthe2Ddimensionaldiscretewavelettransformation.A
set of twelve directional kernels is constructed, based on a
dyadic wavelet transform, for each scale and is used to
enhancethedirectionalpropertiesofveins.Frommaximum
filters response along scale and direction, a neighborhood
thresholding derives a binary segmented image to produce
reliablepatternsoffingerveins.Apostprocessingmoduleis
usedincasewherelowqualityimagesaretobesegmented.
Preliminaryevaluationexperimentsoftheproposedmethod
demonstrateanumberofadvantages,comparedtorecently
publishedmethods.
Keywords
FingerVeinPattern;FingerprintLines;DyadicWavelet;Steerable
Filters;MatchedFilter
Introduction
Theproblemoffingerveinextractionarisesmainlyin
biometricapplicationsbutitisalsoveryimportantfor
thebiomedicalresearchcommunity.Inafewnumber
of studies, due to the recent scientific interest in this
area, vein enhancement methods in infrared images
havebeenpresented.Animportantapplicationsarea
is related to human verification and recognition,
includingawiderangeofsystemssuchasareaaccess
control, PC login, and ecommerce. The main
advantage over the other conventional verification
methodssuchaskeys,passwordsandPINnumbersis
that vein pattern verification does not suffer from
thefts, loss and reliance on the users memory. The
measurementofhumanbiologicalattributesincluding
fingerprint,face,iris,retina,voiceandhandgeometry
ElectricalEngineeringResearch(EER)Volume1Issue1,January2013
patternsandreducedhardwarecomplexity.Thefa1se
acceptance rate in verification experiments is five
times better than existing algorithm and the
processingspeedismeasuredtobe100ms/image.
Im et al. (2003), implement a vascular pattern
extraction algorithm, based on the directional
information of vascular patterns using two filters: a
rowpattern filter for abscissa vascular pattern
extraction and a columnpattern filter for effective
extraction of the ordinate vascular patterns. The
combined output produces the vascular patterns in
hand images. Unlike the conventional hand vascular
patternextractionalgorithm,thedirectionalextraction
approach prevents loss of the vascular pattern
connectivity.
A method for personal identification, based on finger
veinpatterns,ispresentedandevaluatedbyMiuraet
al. (2004), using line tracking starting at various
positions. Local dark lines are identified and a pixel
based line tracking algorithm is executed by moving
alongthelines.
Amethodforfingerveinpatternextractionininfrared
images is proposed by Vlachos et al. (2006). Using
image enhancement and kernel filtering methods, the
vein patterns in low contrast images are detected.
Further improvement is achieved by a twolevel
morphologicalprocess:amajoritiesfiltersmoothesthe
contours and removes some of the misclassified
isolatedpixels,followedbyareconstructionprocedure
usedtoremovetheremainingmisclassifiedregions.
Tanaka et al. (2004), propose a certification system
comparing vein images for lowcost, high speed and
highprecisioncertification.Therecognitionalgorithm
is based on phase correlation and template matching.
Several noise reduction filters, sharpness filters and
histogram manipulations are tested, giving a high
certificationratio.
Dingetal.(2005),studythetheoreticalfoundationand
difficulties of hand vein recognition are introduced
andthresholdsegmentationandlinethinningmethod
inhandveinimages.Asaresult,anewsegmentation
methodandanimprovedconditionalthinningmethod
areproposed,followedbyafeatureextractionmethod
based on endpoints and crossingpoints. The 99.1%
pass ratio using distance measures in human
verificationexperimentsisachieved.
Preliminary work and experiments for localizing
surface veins via nearinfrared (NIR) imaging and
structuredlightrangingarepresentedbyPaquitetal.
ElectricalEngineeringResearch(EER)Volume1Issue1,January2013
Preprocessing
In case of low contrast, poor illumination conditions,
and/ornoisyinfraredimages,apreprocessingmodule
enhances the image properties to obtain the desirable
quality.Thispreprocessingmoduleisespeciallyuseful
for correcting nonuniform illumination or shading
artifacts.Thelocallinearnormalizationprocessadapts
theimagebrightnesstakingintoaccountthestatistical
properties of the neighbor pixels, as shown in FIG. 3.
The linear transformation parameters, window sizes,
w1, and, w2, are derived experimentally and are close
relatedtothelocalmeanandvariance.
a.b.
FIG.1a.ORIGINALDIGITALIMAGEANDFIG.b.ROIIMAGE
FIG.3THEBLOCKDIAGRAMOFTHELOCAL
NORMALIZATIONPROCEDURE
ThenormalizedimagefnisestimatedinsidetheROIas
follows:
f n (i , j )
f (i , j ) m f (i , j )
f (i , j )
,(1)
FIG.2FLOWCHARTOFPROPOSEDFINGERVEINEXTRACTION
METHODININFRAREDIMAGES
ElectricalEngineeringResearch(EER)Volume1Issue1,January2013
Qx (i, j )
zeromeanandvariance are:
2
G (i, j )
Qy (i, j )
G (i, j ) .(3)
1
i j
Qx ( L , L ) ,
L
4
2 2
yL (i, j )
1
i j
Qy ( L , L ) .(5)
L
4
2 2
Twelvedifferentfilterkernelsareconstructedforeach
scalebyselectingtwelvedifferentvaluesfortheangle
FIG.4a.ROIIMAGE,FIG.b.ROIIMAGEAFTER
which forms the orientation of filter kernel with the
FINGERPRINTLINESELIMINATION
horizontal axis (FIG. 5). he kernel size is strongly
correlated with the average vein diameter. f the
ConstructionofSteerableFilters
average vein diameter in the acquired image is n the
IfWxLandWyLarethewaveletstransformsofxandy
minimum filter kernel size must be 2 n 1 . he
direction at levelL, any linear expression of WxL and
valuesofweresetto0,15,30,45,60,75,90,105,120,
WyL setup the wavelet transform in the arbitrary
135, 150 and 165 degrees. These values are proved
direction:WL=WxLcos()+WyLsin().
(2)
exp(
)
applications where the execution time is extremely
2 2
2 2
crucial, the number of filter kernels can be decreased
and its derivatives can be used to characterize the
to six without significant reduction in the methods
image brightness in different regions [Mallat et al.
accuracy.
a.b.
ElectricalEngineeringResearch(EER)Volume1Issue1,January2013
0 degrees
15 degrees
30 degrees
-5
15
10
10
15
-5
15
10
45 degrees
10
15
-5
15
5
0
-5
15
-5
15
10
15
10
90 degrees
10
15
5
0
-5
15
-5
15
10
15
10
135 degrees
10
15
5
0
-5
15
-5
15
10
15
15
10
15
10
10
15
10
165 degrees
-5
15
10
150 degrees
120 degrees
-5
15
10
10
105 degrees
75 degrees
-5
15
10
10
60 degrees
10
10
15
10
10
15
FIG.5THETWELVEFILTERKERNELSCONSTRUCTED
FORVARIOUSANGLES
0 degrees
15 degrees
30 degrees
Im L mean (Im L )
,(8)
std (Im L )
45 degrees
60 degrees
75 degrees
Im nL isthenormalizedmaximumresponseatscaleL,
and mean (Im L ) , std (Im L ) are the mean value and
the standard deviation of the maximum response at
scaleL.
90 degrees
105 degrees
120 degrees
135 degrees
150 degrees
165 degrees
FIG.6THETWELVEDIRECTIONALRESPONSES
InitialConstructionofVeinsMap
The advantages of multiscale edge representation are
used to construct the initial veins map and the most
effective scale factor is derived, maximizing the
separationcapabilitiesofwaveletanalysis.Takinginto
account that the veins thickness varies and the image
resolution differs (related to the imaging system),
multiple maximum response images for a number of
scales are estimated and the initial veins map is
constructed from the maximum response of these
images.
ElectricalEngineeringResearch(EER)Volume1Issue1,January2013
our
study,
morphological filtering and/or
morphologicalimagereconstructionprocessisusedto
eliminatetheerroneousregions[Vlachosetal.(2006)].
As mentioned, the use of the preprocessing or the
postprocessingmodulesdependsonthespecificimage
characteristics.
a.
Experimental Results
b.
FIG.7a.ROIIMAGE,FIG.b.TOTALMAXIMUMRESPONSE
IMAGE
LocalNeighborhoodThresholding
The local neighborhood thresholding is a simple and
computationalefficientprocessforsegmentingimages,
in contrast to the global thresholding Otsus method
[Otsu (1979)] which proved inadequate in our
experiments.
In every pixel, a square window of nxn pixels,
containing the neighbor pixels is considered (the
testing pixel is the centre of window), and the mean
value of the pixels brightness inside the window is
estimated. If the brightness of the central pixel is
greater than the corresponding mean value, the pixel
is considered as vein, otherwise it is considered as
tissue, as shown in FIG. 8 a. The window size affects
significantlythequalityoftheproducedbinaryimage,
and the most effective window size is selected
experimentally.
binary finger vein
a.b.c.
FIG.8FINGERVEINPATTERNUSINGFIG.a.THE
PROPOSEDMETHOD,FIG.b.THEMETHODDESCRIBED
IN[Miuraetal.(2004)],ANDFIG.c.THEMETHOD
DESCRIBEDIN[Vlachosetal.(2006)]
Postprocessing
As shown in FIG. 8 a, the segmentation result is
adequate to describe the finger veins and does not
require further processing. However, in some cases,
the original image suffers from lowcontrast and
strongnoisepresence,sothesegmentationresultmay
not satisfy the desired specifications. In such cases,
somemisclassificationareasappearasisolatedcircular
or shapeless regions which generally do not associate
withveins.Thus,apostprocessingstepisrequired.In
ElectricalEngineeringResearch(EER)Volume1Issue1,January2013
comparedifferentmethods.
The proposed method is evaluated quantitatively on
the artificial image database. Each image of the set is
constructed according to the above procedure. The
evaluation is performed using the widely known
statistical measures of sensitivity, specificity and
accuracy. TABLE 1 shows the mean sensitivity,
specificity and accuracy of the proposed method on
theartificialfingerimagedatabase,whileFIG.9shows
the ROC curve produced by varying the local
segmentation threshold and estimating the
correspondingmeasures.
TABLE1MEANSENSITIVITY,SPECIFICITYANDACCURACYOF
THEPROPOSEDMETHODWITHOUT
PREPROCESSING/POSTPROCESSING
EvaluationRates
TP
sensitivity
,(11)
TP FN
TN
specificity
.(12)
TN FP
Usually, there is a tradeoff between two measures.
Finally, the accuracy of the binary classification is
definedby:
accuracy
Mean
Standard
Deviation
Specificity
Accuracy
0.869
0.898
0.892
0.081
0.025
0.036
ROC curve
1
0.9
0.8
0.7
TPR=sensitivity
Sensitivity
0.6
0.5
0.4
0.3
0.2
0.1
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
FPR=1-specificity
FIG.9ROCCURVEOFTHEPROPOSEDMETHOD
PRODUCEDBYVARYINGTHELOCALSEGMENTATION
THRESHOLD
TP TN
,(13)
PN
wherePandNrepresentthetotalnumberofpositives
(vein) and negatives (nonvein) pixels in the
segmentation processandis the degree of conformity
of the estimated binary classification to the true
according to a manual segmentation. Thus, the
accuracy is strongly related to the segmentation
quality and for this reason it is used to evaluate and
FIG.10ARTIFICIALINFRAREDFINGERIMAGEANDTHE
EXTRACTEDVEINPATTERN
Conclusions
In this paper a robust method for finger vein pattern
extraction in infrared images is presented and
evaluated taking into account the directional
ElectricalEngineeringResearch(EER)Volume1Issue1,January2013
IdentificationSystembyExtractingHandVeinPatterns,
HereceivedhisDiplomaandPhDdegrees
from the Department of Electrical and
Computer Engineering of the University
of Patras, Patras, Hellas in 2004 and 2010
respectively.
Dr. Vlachos research interests focus on biomedical image
processingandanalysis,patternrecognitionandbiometrics.
ElectricalEngineeringResearch(EER)Volume1Issue1,January2013
HereceivedhisDiplomaandPhDdegrees
fromtheDepartmentofElectrical
1985and1991respectively.
Professor Dermatas research interest areas include: medical
signalprocessing,patternrecognition.