Professional Documents
Culture Documents
H CH MINH
M U
Ngy nay vi cc tin b ca khoa hc k thut th mi cng vic hu nh u
c th tin hnh trn my tnh mt cch t ng ha hon ton hoc mt phn. Mt
trong nhng s thay i ln l cch thc chng ta thu nhn v x l d liu. Cc
cng c nhp liu nh bn phm hay my scan dn b thay th bng cc thit b tin li
hn nh mn hnh cm ng, camera
Hn th na, cc my tnh bn khng cn l cng c duy nht c th h tr
cho con ngi. Chng ta bc sang th k 21 vi s pht trin mnh m ca cc thit
b di ng, gii tr cm tay hay smartphone. Vi kch thc ngy cng nh gn v
hiu sut lm vic th khng ngng c ci tin, cc cng c mini ny ha hn s l
mt phn khng th thiu trong x hi hin i. V do , pht trin cc ng dng trn
cc thit b ny cng l mt xu th tt yu.
Cng ngh nhn dng l mt trong cc cng ngh ang c p dng cho cc
thit b di ng hin nay. Nhn dng c th bao gm nhn dng m thanh, hnh nh.
Cc i tng nhn dng c nhiu kiu nh ting ni, ch vit, khun mt, m vch
v bin bo giao thng cng l mt trong s . Chng trnh nhn dng bin bo
giao thng thng phc tp v c ci t trn nhng h thng c b x l ln,
camera cht lng cao. Mc tiu ca kha lun l ci tin cng ngh nhn dng ny v
mang n ci t trn cc thit b di ng, gip chng ta pht hin bin bo v nhn
dng n mt cch nhanh nht.
Kha lun Xy dng ng dng nhn dng bin bo giao thng trn thit
b di ng bao gm tt c 4 chng.
Chng I - Gii thiu: Gii thiu khi qut v kha lun v mc ch ca
kha lun.
Chng II - Nn tng v cng ngh: Gii thiu y v cc kin thc nn
tng cng nh cng ngh v phn mm c s dng trong kha lun bao gm kin
thc v x l nh, l thuyt mng noron, mi trng h iu hnh dnh cho di ng
Android, th vin x l nh OpenCV.
Chng III - Xy dng ng dng nhn dng bin bo giao thng: Trnh
by m hnh gii quyt bi ton nhn dng trn thit b di ng, cc s chc nng
v thit k giao din ca chng trnh.
Chng IV - nh gi kt qu v kt lun: Tng kt qu trnh thc hin
kha lun v rt ra hng pht trin sau ny.
LI CM N
Trong sut thi gian thc hin kha lun tt nghip, chng em nhn c s
gip , ch bo tn tnh ca cc thy c Trng H CNTT HQGTPHCM.
Chngem xin gi li cm n su sc n qu thy c. c bit xin chn thnh cm n
c Phan Nguyt Minh ngi trc tip hng dn v to mi iu kin thun li
gip chng em hon thnh kha lun ny.
Chng em cng xin cm n chn thnh ti gia nh v bn b, cng ty to
iu kin, gip v ng vin chng em hon thnh kha lun ng thi hn.
Mc d c gng ht kh nng nhng kha lun khng th no trnh khi
nhng thiu xt. Rt mong nhn c s gp qu bu ca qu thy c kha lun
c th hon chnh hn.
Nhm sinh vin thc hin
Nguyn B Chung Trng Giang
Thng 2 2012
NHN XT
(Ca ging vin hng dn)
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
NHN XT
(Ca ging vin phn bin)
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
.....................................................................................................................
GVHD: ThS. Phan Nguyt Minh
MC LC
M U .................................................................................................................. 2
LI CM N ........................................................................................................... 4
NHN XT .............................................................................................................. 5
NHN XT .............................................................................................................. 6
MC LC ................................................................................................................ 7
DANH MC BNG BIU ...................................................................................... 9
DANH MC HNH V .......................................................................................... 10
CHNG 1 : GII THIU ................................................................................... 1
1.1
1.2
M T Bi Ton ........................................................................................... 47
3.1.1 t vn ......................................................................................... 47
3.1.2 i tng ca bi ton ...................................................................... 48
3.2 M Hnh Gii Quyt Bi Ton ................................................................... 52
3.2.1 M hnh tng qut ............................................................................. 52
3.2.2 Thu nhn hnh nh (Capture Image) ................................................. 53
3.2.3 Pht hin bin bo v trch xut vng c trng ............................... 54
3.2.4 X l trc khi nhn dng (Pre-recognized) .................................... 62
3.2.5 Qu trnh nhn dng (Recognized) ................................................... 63
3.3 Thit K Chng Trnh .............................................................................. 66
3.3.1 Yu cu phn mm ............................................................................ 66
3.3.2 Thit k Use-Case ............................................................................. 69
3.3.3 Thit k s lp (mc phn tch) ................................................... 74
3.3.4 Thit k d liu ................................................................................. 81
3.3.5 Thit k giao din .............................................................................. 82
3.4 Thc Nghim ............................................................................................... 87
CHNG 4 : NH GI KT QU V KT LUN ...................................... 88
nh Gi Lun Vn .................................................................................... 88
nh Gi Chng Trnh ............................................................................ 88
4.2.1 Kt qu t c ............................................................................... 88
4.2.2 Cc hn ch ....................................................................................... 88
4.3 Hng Pht Trin ....................................................................................... 89
4.4 Kt Lun....................................................................................................... 89
4.1
4.2
DANH MC HNH V
Hnh 1.1 Mt s thit b hay c s dng trong nhn dng ................................... 1
Hnh 1.2 Smartphone ang l xu hng pht trin mi trong giai on ny ........... 2
Hnh 1.3 Nhng nn tng s s dng trong kha lun ............................................. 3
Hnh 2.1 Cc bc c bn trong x l nh ............................................................... 4
Hnh 2.2 Hng cc im bin v m tng ng..................................................... 7
Hnh 2.3 Minh ha xc nh im bin .................................................................. 12
Hnh 2.4 Lc rn ln v cch chn ngng .................................................. 13
Hnh 2.5 Minh ha khi nim lin thng ................................................................ 15
Hnh 2.6 n v x l (Processing Unit) ............................................................... 18
Hnh 2.7 Hm ng nht (Identity function) .......................................................... 20
Hnh 2.8 Hm bc nh phn (Binary step function) ............................................. 21
Hnh 2.9 Hm Sigmoid ........................................................................................... 21
Hnh 2.10 Hm sigmoid lng cc......................................................................... 22
Hnh 2.11 Mng nron truyn thng nhiu lp (Feed-forward neural network) .... 23
Hnh 2.12 Mng nron hi quy (Recurrent neural network) .................................. 24
Hnh 2.13 M hnh Hc c thy (Supervised learning model) ............................... 25
Hnh 2.14 Mng nron truyn thng nhiu lp ...................................................... 26
Hnh 2.15 Lch s pht trin Android ..................................................................... 32
Hnh 2.16 Mt s giao din ca Android ............................................................... 33
Hnh 2.17 Bn phm ca Android .......................................................................... 33
Hnh 2.18 Kin trc ca Android ........................................................................... 34
Hnh 2.19 Kin trc file XML ................................................................................ 37
Hnh 2.20 Activity Stack ........................................................................................ 39
Hnh 2.21 Vng i ca mt Activity .................................................................... 40
Hnh 2.22 V d v Computer Vision ..................................................................... 41
Hnh 2.23 Tc x l ca OpenCV so vi LTI v VXL ..................................... 43
Hnh 2.24 Lch s pht trin ca OpenCV ............................................................. 44
Hnh 2.25 Cu trc th vin OpenCV .................................................................... 45
Hnh 3.1 Bi ton nhn dng bin bo giao thng .................................................. 48
GVHD: ThS. Phan Nguyt Minh
1|Trang
CHNG 1 :
GII THIU
Nhn dng d liu bao gm c nhn dng m thanh v nhn dng hnh nh.
Cc i tng ca bi ton nhn dng th rt phong ph, v d nh nhn dng khun
mt, ting ni, nhn dng ch vit tay, nhn dng m vch Bin bo giao thng
cng l mt trong s . y l kiu i tng c tnh cht hnh hc c trng,
thng bt gp trong i sng hng ngy vi cng dng l a ra nhng cnh bo
thng tin cho ngi tham gia giao thng. Tuy nhin cc bin bo giao thng th khng
GVHD: ThS. Phan Nguyt Minh
2|Trang
ng dng cng ngh nhn dng trn smartphone chnh l tng m nhm
hng ti khi thc hin kha lun ny. Bi ton nhm s gii quyt l lm th no xy
dng mt h thng thng minh cho php pht hin v nhn dng bin bo giao thng
trn thit b di ng.
GVHD: ThS. Phan Nguyt Minh
3|Trang
1.2 Mc Tiu Ca Ti
Mc tiu ca ti l nghin cu bi ton nhn dng ni chung v nhn dng
bin bo giao thng ni ring, t ci tin p dng cho vic xy dng h thng trn
cc thit b di ng. Mc d smartphone c nhng ci tin vt tri nhng tt nhin
nhng khc bit v phn cng nh chip x l hay camera s khng th so snh vi
my tnh c. Do chng trnh nhm xy dng s tm cch ti u ha lm sao
cho c th tn dng c nhng kh nng vn c ca smartphone.
Ngoi ra h thng bin bo giao thng ca nc ta kh ln, do nhm s xy
dng chng trnh hon chnh nhng s thu nh tp d liu li, coi y nh l mt tp
d liu demo p dng cho kha lun ny.
Chng trnh s c xy dng trn nn tng Android, mt trong nhng nn
tng di ng pht trin mnh nht hin nay. Ngoi ra nhm s dng th vin OpenCv
h tr cho vic x l nh.
4|Trang
CHNG 2 :
2.1 L Thuyt X L nh
2.1.1 Tng quan v x l nh
2.1.1.1 X l nh l g
Con ngi thu nhn thng tin qua cc gic quan, trong th gic ng vai tr
quan trng nht. Nhng nm tr li y vi s pht trin ca phn cng my tnh, x
l nh v ho pht trin mt cch mnh m v c nhiu ng dng trong cuc
sng. X l nh v ho ng mt vai tr quan trng trong tng tc ngi my.
Qu trnh x l nh c xem nh l qu trnh thao tc nh u vo nhm cho
ra kt qu mong mun. Kt qu u ra ca mt qu trnh x l nh c th l mt nh
tt hn hoc mt kt lun.
C th hiu mt cch khc, x l nh hay cao cp hn na l th gic my tnh
(Computer Vision) bao gm tt c cc l thuyt v k thut lin quan, cho php to
lp mt h thng c kh nng tip nhn thng tin t cc hnh nh thu c, lu tr v
x l theo nhu cu.
5|Trang
Thu nhn nh: Qu trnh tip nhn thng tin t vt th thng qua camera mu
hoc trng en, nh thu nhn c c th l nh tng t hoc nh s ha.
Tin x l nh: Sau b thu nhn, nh c th nhiu, tng phn thp nn cn
a vo b tin x l nng cao cht lng. Chc nng chnh ca b tin x
l l lc nhiu, nng tng phn lm nh r hn, nt hn.
Phn on nh: L tch mt nh u vo thnh cc vng thnh phn biu
din phn tch, nhn dng nh. V d: nhn dng ch (hoc m vch) trn
phong b th cho mc ch phn loi bu phm, cn chia cc cu, ch v a
ch hoc tn ngi thnh cc t, cc ch, cc s (hoc cc vch) ring bit
nhn dng. y l phn phc tp kh khn nht trong x l nh v cng d gy
li, lm mt chnh xc ca nh. Kt qu nhn dng nh ph thuc rt nhiu
vo cng on ny.
Biu din nh: u ra nh sau phn on cha cc im nh ca vng nh
(nh phn on) cng vi m lin kt vi cc vng ln cn. Vic bin i
cc s liu ny thnh dng thch hp l cn thit cho x l tip theo bng my
tnh. Vic chn cc tnh cht th hin nh gi l trch chn c trng
(Feature Selection) gn vi vic tch cc c tnh ca nh di dng cc thng
tin nh lng hoc lm c s phn bit lp i tng ny vi i tng
khc trong phm vi nh nhn c. V d: trong nhn dng k t trn phong b
th, chng ta miu t cc c trng ca tng k t gip phn bit k t ny vi
k t khc.
Nhn dng v ni suy nh: Nhn dng nh l qu trnh xc nh nh. Qu
trnh ny thng thu c bng cch so snh vi mu chun c hc (hoc
lu) t trc. Ni suy l phn on theo ngha trn c s nhn dng. V d:
mt lot ch s v nt gch ngang trn phong b th c th c ni suy thnh
m in thoi.
6|Trang
M lot di
M lot di (Run-length Code) hay dng biu din cho vng nh hay
nh nh phn. Mt vng nh R c th biu din n gin nh mt ma trn nh phn:
7|Trang
M xch
M xch (Chain Code) thng c dng biu din bin ca nh. Thay v
lu tr ton b nh, ngi ta lu tr dy cc im nh nh A, BM. Theo phng
php ny, 8 hng ca vect ni 2 im bin lin tc c m ha. Khi nh c
biu din qua im nh bt u A cng vi chui cc t m. iu ny c minh ha
trong hnh di y:
2.1.2.3
M t phn
Theo phng php m t phn (Quad Tree Code), mt vng nh coi nh bao
kn mt hnh ch nht. Vng ny c chia lm 4 vng con (Quadrant). Nu mt vng
con gm ton im en (1) hay ton im trng (0) th khng cn chia tip. Trong
trng hp ngc li, vng con gm c im en v trng gi l vng khng ng
nht, ta tip tc chia thnh 4 vng con tip v kim tra tnh ng nht ca cc vng
con . Qu trnh chia dng li khi mi vng con ch cha thun nht im en hoc
im trng. Qu trnh to thnh mt cy chia theo bn phn gi l cy t phn.
Nh vy, cy biu din nh gm mt chui cc k hiu b (black), w (white) v g
(grey) km theo k hiu m ha 4 vng con. Biu din theo phng php ny u vit
hn so vi cc phng php trn, nht l so vi m lot di. Tuy nhin, tnh ton s
o cc hnh nh chu vi, m men l tng i kh khn.
GVHD: ThS. Phan Nguyt Minh
8|Trang
9|Trang
Mt n Prewitt
- K thut s dng 2 mt n nhn chp xp x o hm theo 2
hng x v y l:
- Tnh I Hx+ I Hy ra c kt qu
- V d:
Mt n Sobel
- K thut s dng 2 mt n nhn chp xp x o hm theo 2
hng x v y l:
10 | T r a n g
K thut la bn
- K thut s dng 8 mt n nhn chp theo 8 hng 00, 450,
900, 1350, 1800, 2250, 2700, 3150.
I H
i 1
2 f 2 f
f 2 2
x
y
Ta c:
2 f
f
f ( x 1, y) f ( x, y )
x 2 x x x
f ( x 1, y ) f ( x, y) f ( x, y) f ( x 1, y )
f ( x 1, y) 2 f ( x, y) f ( x 1, y)
Tng t
2 f
f
f ( x, y 1) f ( x, y)
y 2 y y y
f ( x, y 1) f ( x, y ) f ( x, y) f ( x, y 1)
f ( x, y 1) 2 f ( x, y) f ( x, y 1)
Vy: f= f(x+1,y) + f(x,y+1) - 4f(x,y) + f(x-1,y) + f(x,y-1)
2
11 | T r a n g
Dn ti
Bc 1: Lm trn nh
Tnh I H, vi:
2
4
1
5
H
115
4
2
12 9 4
15 12 5
12 9 4
5 4 2
4 5 4 2
9
12
9
4
Gi G l kt qu lc nhiu: G= IH
-
Gx = GHx, Gy = GHy
-
12 | T r a n g
13 | T r a n g
Xem xt lc xm ca nh xc nh cc nh v cc khe. Nu
nh c dng rn ln (nhiu nh v khe), cc khe c th dng
chn ngng.
14 | T r a n g
15 | T r a n g
16 | T r a n g
17 | T r a n g
18 | T r a n g
19 | T r a n g
Trong :
xi : cc u vo
wji : cc trng s tng ng vi cc u vo
j : lch (bias)
aj : u vo mng (net-input)
zj : u ra ca nron
g(x): hm chuyn (hm kch hot).
Trong mt mng nron c ba kiu n v:
-
Trng hp wji > 0, nron c coi l ang trong trng thi kch thch.
Tng t, nu nh wji < 0, nron trng thi kim ch. Chng ta gi cc n v vi
lut lan truyn nh trn l cc sigma units.
GVHD: ThS. Phan Nguyt Minh
20 | T r a n g
21 | T r a n g
22 | T r a n g
23 | T r a n g
24 | T r a n g
25 | T r a n g
26 | T r a n g
Trong
p: s th t mu trong tp hun luyn
i : s th t ca n v u ra
tpi v ypi : tng ng l u ra mong mun v u ra thc t ca mng
cho n v u ra th i trn mu th p.
Trong cc ng dng thc t, nu cn thit c th lm phc tp hm s vi mt
vi yu t khc c th kim sot c s phc tp ca m hnh.
2.2.3 Mng truyn thng v thut ton lan truyn ngc
n gin v trnh hiu nhm, mng truyn thng trnh by trong phn ny l
mng truyn thng c nhiu lp (MLP - MultiLayer Perceptron). y l mt trong
nhng mng truyn thng in hnh, thng c s dng trong cc h thng nhn
dng.
2.2.3.1 Mng truyn thng MLP
Mt mng truyn thng nhiu lp bao gm mt lp vo, mt lp ra v mt
hoc nhiu lp n. Cc nron u vo thc cht khng phi cc nron theo ng
ngha, bi l chng khng thc hin bt k mt tnh ton no trn d liu vo, n
gin n ch tip nhn cc d liu vo v chuyn cho cc lp k tip. Cc nron lp
n v lp ra mi thc s thc hin cc tnh ton, kt qu c nh dng bi hm
u ra (hm chuyn). Cm t truyn thng (feed forward) (khng phi l tri ngha
ca lan truyn ngc) lin quan n mt thc t l tt c cc nron ch c th c kt
ni vi nhau theo mt hng: ti mt hay nhiu cc nron khc trong lp k tip (loi
tr cc nron lp ra).
27 | T r a n g
Trong
P: Vector u vo (vector ct)
Wi: Ma trn trng s ca cc nron lp th i.
(SixRi: S hng (nron) - R ct (s u vo))
bi: Vector lch (bias) ca lp th i (Six1: cho S nron)
ni: net input (Six1)
fi: Hm chuyn (hm kch hot)
ai: net output (Six1)
: Hm tng thng thng.
Mi lin kt gn vi mt trng s, trng s ny c thm vo trong qu trnh
tn hiu i qua lin kt . Cc trng s c th dng, th hin trng thi kch thch,
hay m, th hin trng thi kim ch. Mi nron tnh ton mc kch hot ca chng
bng cch cng tng cc u vo v a ra hm chuyn. Mt khi u ra ca tt c cc
nron trong mt lp mng c th thc hin xong tnh ton th lp k tip c th bt
u thc hin tnh ton ca mnh bi v u ra ca lp hin ti to ra u vo ca lp
k tip. Khi tt c cc nron thc hin tnh ton th kt qu c tr li bi cc
nron u ra. Tuy nhin, c th l cha ng yu cu, khi mt thut ton hun
luyn cn c p dng iu chnh cc tham s ca mng.
Xt trng hp mng c hai lp nh hnh 2.14, cng thc tnh ton cho u ra
nh sau:
28 | T r a n g
29 | T r a n g
30 | T r a n g
Thut ton lan truyn ngc s dng ch s hiu nng l trung bnh bnh
phng li ca u ra so vi gi tr ch. u vo ca thut ton chnh l
tp cc cp m t hot ng ng ca mng:
Mi u vo a vo mng, u ra ca mng i vi n c em so
snh vi u ra mong mun.Thut ton s iu chnh cc tham s ca
mng ti thiu ha trung bnh bnh phng li.
31 | T r a n g
32 | T r a n g
33 | T r a n g
34 | T r a n g
2.3.3 My o Dalvik
Trn Android, cc nh pht trin phn mm c th la chn gia ngn ng
C/C++ hoc Java vit ng dng. i vi cc ng dng vit bng Java, Android
thc thi chng thng qua my o tng t JVM trn my bn gi l Dalvik.
Dalvik l mt phn mm m ngun m c thit k v vit bi Dan Bornstein da
trn JVM nhng c ci tin c th hot ng hiu qu trn cc thit b Android.
im khc bit ca Dalvik so vi JVM (hot ng da trn thanh ghi stack),
chnh l vic Dalvik da theo kin trc cc register.
Mc d dng chung ngn ng Java, nhng cc file .class s c dch sang
nh dng .dex nhm lm gim ti a dung lng ca cc chng trnh. Cc hng hay
chui trng nhau s c tinh gim trong file .dex. Cc bytecode ca Java cng s
c chuyn thnh mt b ch th ca Dalvik. iu ny em n s khc bit v dung
lng cho cc file .dex so vi trc khi chuyn i.
Ngoi ra, my o Dalvik cn c ti u ha rt nhiu c kh nng chy cng lc
nhiu instance m khng tn qu nhiu b nh v nng lc x l. Trong cc phin
bn ca Android, Dalvik lin tc c ci tin em n kh nng hot ng hiu
qu hn cho cc ng dng Android.
2.3.4 Kin trc ca Android
M hnh sau th hin mt cch tng qut cc thnh phn ca h iu hnh
Android. Mi mt phn s c c t mt cch chi tit di y.
35 | T r a n g
phi l m ngun, chng hn nh: localized strings, graphics, and layout files.
36 | T r a n g
v iu hng cc activity.
2.3.4.3 Library (Th vin)
Android bao gm mt tp hp cc th vin C/C++ c s dng bi nhiu
thnh phn khc nhau trong h thng Android. iu ny c th hin thng qua nn
tng ng dng Android. Mt s cc th vin c bn c lit k di y:
h tr cho vic chi nhc, quay phim, chp hnh theo cc nh dng file MPEG4,
H.264, MP3, AAC, AMR, JPG, v PNG
37 | T r a n g
38 | T r a n g
Application
Th <application>, bn trong th ny cha cc thuc tnh c nh
ngha cho ng dng Android nh:
SDK version
39 | T r a n g
40 | T r a n g
41 | T r a n g
42 | T r a n g
VXL(http://vxl.sourceforge.net/)
y l th vin x l hnh nh mc c bn, chuyn v cc thao tc chnh sa
hnh nh nh i mu sc, thay i kch thc nh VXL c xy dng trn nn
tng ngn ng ANSI/ISO C++ nhm tng kh nng tng thch v tc hot ng
ca tc v x l nh. Hin ti VXL xut hin trn Linux, Windows v Mac OS
nhng vn cha xut hin trn nn tng di ng no.
Camellia (http://camellia.sourceforge.net/)
B th vin ny c vit hon ton trn ngn ng C v c ti u ha rt
nhiu nhm em n tc hot ng thi gian thc. Camellia xut hin trn c
Linux, Windows, Mac OS nhng ch yu h tr cho ngn ng Ruby v cha c k
hoch xut hin trn nn tng di ng no.
OpenVIDIA
(http://openvidia.sourceforge.net/index.php/OpenVIDIA)
OpenVIDIA l b th vin x l hnh nh c nVidia khi xng nhm mc
ch tn dng sc mnh x l vn rt d d t cc GPU (mnh v x l song song).
B th vin ny tn dng rt nhiu cng ngh ca nVidia nh CUDA, NPP v h tr
cc th vin m ngun m nh OpenGL, OpenCL Nh tn dng kh nng x l
mnh m ca GPU (vn mnh hn nhiu so vi CPU), b th vin ny cho tc x
l nhanh hn kh nhiu so vi cc gii php hin ti. B th vin ny h tr y
cc gii php nhn dng hnh nh, x l hnh nh thi gian thc
OpenVIDIA hin c cc gii php phn mm xut hin trn nn tng Tegra
2 ca di ng, nhng nhm khng chn b th vin ny v n khng th ph bin rng
ri ln cc nn tng khng s dng GPU ca nVidia.
NCV Nokia Computer Vision
(http://research.nokia.com/page/221)
B th vin x l hnh nh c Nokia xy dng dnh ring cho h iu hnh
Symbian ca mnh, cung cp cc kh nng x l hnh nh nh thay i kch thc,
thay i khung hnh, dng hnh, dng giao din ngi dng nhng li thiu i cc
hm mang tnh cn thit cho mc tiu ca ti nhn dng hnh nh. B th vin
ny cng khng h tr cc nn tng khc nh Android, iOS.
GVHD: ThS. Phan Nguyt Minh
43 | T r a n g
44 | T r a n g
45 | T r a n g
Theo di mt v ming
Theo di 3D
Tm khung xng ca vt th
46 | T r a n g
47 | T r a n g
CHNG 3 :
3.1 M T Bi Ton
3.1.1 t vn
Bin bo giao thng l cch thc thng bo cho ngi tham gia giao thng
tnh trng ng, a ra nhng ch dn, hay cnh bo gip ngi tham gia giao thng
x l v a ra nhng hnh vi hp l, m bo an ton giao thng. Mi ngi tham
gia giao thng i hi phi nm bt v hiu ht ton b ngha ca tt c cc bin bo
giao thng. Vic ny tr nn kh kh khn khi s lng bin bo qu ln. Hn th na
vic pht hin bin bo tr nn phc tp khi m cc yu t ngoi cnh tc ng. Bin
bo c th b h hi khi tip xc mt thi gian di di nh nng mt tri. Mu sc b
thay i trong cc iu kin sng m, nh sng yu ban m, bin bo b che khut
bi nh ca, cy ci
V nhng l do trn, nhm mong mun xy dng mt ng dng nh gn, cm
tay, n gin cho php ngi dng c th tra cu trc quan thng tin ca bin bo khi
khng nh ni dung bin bo ny, pht trin hn na v sau c th l tch hp hoc
kt ni ti cc phng tin giao thng v a ra cc cnh bo thch hp.
Chc nng chnh c bn ca ng dng l tra cu thng tin trc quan. Ngi
dng s dng in thoi c ci ng dng, chp hnh hoc qut camera qua khung
cnh c hnh bin bo. ng dng s t ng pht hin (detect) cc khu vc c hnh
dng bin bo v xut hnh nh cng thng tin bin bo m ng dng nhn ra.
48 | T r a n g
49 | T r a n g
50 | T r a n g
51 | T r a n g
52 | T r a n g
53 | T r a n g
54 | T r a n g
55 | T r a n g
56 | T r a n g
57 | T r a n g
58 | T r a n g
59 | T r a n g
60 | T r a n g
61 | T r a n g
Tnh cht hnh trn (hoc eclipse): Tnh ton bn knh trc
ln, trc nh, din tch ca Contour, t suy ra gi tr PI.
Nu Pi ~3.14 th tha mn tnh cht hnh trn.
62 | T r a n g
Sau khi c d liu nh, chng ta thay i kch thc nh v cng kch
thc mu 30*30 pixel
63 | T r a n g
Gii thut hun luyn mng l gii thut lan truyn ngc li Backpropagation
Hm activation l hm sigmoid.
64 | T r a n g
Mng gm c 3 layer:
o Input Layer: S noron l 63, i din cho 63 tham s th hin
ca bc nh
o Hidden layer: lp n, lp gia ca mng. S noron lp ny
c xc nh bng thc nghim o hiu nng ca mng
o Output Layer: S noron bng chnh lng bin bo m mng c
th nhn din, v d: output c 5 noron th mng ch c th nhn
din 5 bin bo.
65 | T r a n g
66 | T r a n g
STT
M t
Ghi ch
chp hnh
pht
hin bin bo
Ngi dng s dng ch
2
quay video ng
dng t pht hin bin
bo
ng dng nhn dng cc
Thay i gia ch
pht hin bng tay v
pht hin t ng
Thay i kch thc hnh Ch h tr
Zoom hnh nh
trong ch
pht hin bin
bo bng tay
67 | T r a n g
3.3.1.2 Yu cu hiu qu
p dng vi thit b di ng :
-
B nh 512MB tr ln
Camera 5 Megapixel tr ln
Chc nng
STT
Tc x l
Ngay lp tc
10Fps (Frame/giy)
Ngay lp tc
Ghi ch
Ngay lp tc
Tc Zoom ch
yu ph thuc vo
Zoom hnh nh
3Fps (Frame/giy)
kh nng h tr
ca phn cng
in thoi
B nh 512MB tr ln
Camera 5 Megapixel tr ln
68 | T r a n g
STT
Mc d s dng
Ghi ch
Thao tc cm ng
trn mn hnh
Khng cn thao tc
Thao tc cm ng
trn mn hnh
bin bo
trn mn hnh
Thao tc cm ng
Zoom hnh nh
trn mn hnh
Ty thuc phn
cng h tr hay
khng
3.3.1.5 Yu cu tin ha
STT
Chc nng
Gi tr cn thay i
Ghi ch
nhn bit bin bo
mi, d liu cn cho
mng noron
iu chnh li ma trn
trng s cho thch
hp
69 | T r a n g
ngha/Ghi ch
Tn Actor
Ngi dng
Tn Use-Case
Pht hin bin bo bng tay
ngha/Ghi ch
Ngi dng t iu chnh camera, la
chn khu vc hnh nh c bin bo
giao thng sau chp hnh ng
70 | T r a n g
Thay i ch
Zoom hnh nh
3.3.2.4 c t Use-Case
3.3.2.4.1 c t Use case Pht hin bin bo bng tay:
a. Tm tt
-
b. Dng s kin
-
c. Cc yu cu c bit
-
Khng c.
71 | T r a n g
f. im m rng
-
Khng c.
b. Dng s kin
-
c. Cc yu cu c bit
-
Khng c.
f. im m rng
-
Khng c.
72 | T r a n g
b. Dng s kin
-
c. Cc yu cu c bit
-
Khng c.
f. im m rng
-
Khng c.
b. Dng s kin
-
73 | T r a n g
c. Cc yu cu c bit
-
Khng c.
f. im m rng
-
Khng c.
b. Dng s kin
-
c. Cc yu cu c bit
-
74 | T r a n g
f. im m rng
-
Khng c.
S lp mc phn tch
75 | T r a n g
3.3.3.2
STT
Tn lp/quan h
Loi
ngha/Ghi ch
Input
Public
Hidden
Public
Output
Public
IbackPropagation<T>
Public
MLP<T>
Public
CaptureObjectLayer
Public
DetectObjectLayer
Public
NeuralNetwork<T>
Public
3.3.3.3
STT
Tn thuc tnh
Kiu
Truy cp
Value
double
Public
Weights
double[]
Public
preDwt
double[]
Public
ngha/Ghi ch
Gi tr output ca noron
Mng cha trng s ng
vi noron ny
Mng cha trng s trc
khi sa li
3.3.3.3.2 Lp Hidden:
STT
Tn thuc tnh
Kiu
Truy cp
InputSum
double
Public
Tng trng s
Bias
double
Public
ngha/Ghi ch
76 | T r a n g
preBias
double
Public
Output
double
Public
Gi tr u ra ca noron
Error
double
Public
Gi tr li
Weights
double[]
Public
preDwt
double[]
Public
khi sa li
3.3.3.3.3 Lp Output:
STT
Tn thuc tnh
Kiu
Truy cp
ngha/Ghi ch
InputSum
double
Public
Tng trng s
Bias
double
Public
preBias
double
Public
Output
double
Public
Gi tr u ra ca noron
Error
double
Public
Gi tr li
Target
double
Public
Value
Public
Gi tr u ra mong
mun
Kiu tr kiu T tng ng
vi u ra
3.3.3.3.4 Lp IbackPropagation<T>:
STT
Tn phng thc
Kiu
Truy cp
ngha/Ghi ch
Lan truyn ngc li v
backPropagate
void
Public
double
Public
77 | T r a n g
forwardPropagate
void
Public
recognize
void
Public
initializeNetwork
void
Public
3.3.3.3.5 Lp MLP<T>:
Truy
STT
Tn thuc tnh
Kiu
InputNum
int
Private
S noron lp Input
HiddenNum
int
Private
S noron lp Hidden
OutputNum
int
Private
S noron lp Output
learningRate
double
Private
T l thay i trng s
alpha
double
Private
cp
ngha/Ghi ch
OutputValueHight
double
Private
ng vi gi tr mong
mun nht
MatchedHigh
Private
Gi tr kiu T tng ng
vi OutputValueHight
Gi tr tnh ton c gn
OutputValueLow
double
Private
ng xp th 2 so vi gi
tr mong mun nht
MatchedLow
Private
10
InputLayer
Input[]
Private
11
HiddenLayer
Hidden[]
Private
Gi tr kiu T tng ng
vi OutputValueLow
Mng cha cc noron lp
Input
Mng cha cc noron lp
Hidden
SVTH: Nguyn B Chung
Trng Giang
78 | T r a n g
12
OutputLayer
Output<T>[]
Private
STT
Tn phng thc
Kiu
Truy cp
reset
void
Public
getMatchedHigh
Public
getOutputValueHight
double
Public
getMatchedLow
Public
getOutputValueLow
double
Public
ngha/Ghi ch
Khi to li cc tham s
ca mng
Ly kt qu kiu T gn
chnh xc nht
Ly kt qu gn chnh xc
nht
Ly kt qu kiu T gn
chnh xc th hai
Ly kt qu gn chnh xc
th hai
3.3.3.3.6 Lp CaptureObjectLayer:
Truy
STT
Tn thuc tnh
Kiu
mCamera
Camera
Private
Camera ca thit b
mFrameWidth
int
Private
mFrameHeight
int
Private
mFrame
Byte[]
Private
cp
ngha/Ghi ch
STT
Tn phng thc
Kiu
Truy cp
processFrame
Bitmap
Public
run
Void
Public
ngha/Ghi ch
X l nh thu c t
camera
Khi chy lung ph song
song vi lung chnh, lin
SVTH: Nguyn B Chung
Trng Giang
79 | T r a n g
tc ly d liu t camera
3
getFrameWidth
int
Public
getFrameHeight
int
Public
Ly rng ca Frame
hnh
Ly cao ca Frame
hnh
3.3.3.3.7 Lp DetectObjectLayer:
Truy
STT
Tn thuc tnh
Kiu
image
Bitmap
Private
signList
List<Mat>
Private
boxList
List<Rect>
Private
cp
ngha/Ghi ch
Cha hnh thu t camera
x l
Danh sch cc bin bo
tm c
Danh sch cc vin bao
ch nht ca bin bo
Truy
STT
Tn phng thc
Kiu
getContoursRedMask
List<Mat>
Public
getContoursBlueMask
List<Mat>
Public
detectRedTriangleSign
void
Public
detectBlueCircleSign
void
Public
detectRedCircleSign
void
Public
Tm cc bin bo trn
getSignList
List<Mat>
Public
getBoxList
List<Rect>
Public
cp
ngha/Ghi ch
Ly ng bin sau khi
lc mt n mu
Ly ng bin sau khi
lc mt n mu xanh
Tm cc bin bo tam
gic
Tm cc bin bo trn
xanh
80 | T r a n g
ch nht ca bin bo
Bng3.17 Danh sch phng thc lp DetectObjectLayer
3.3.3.3.8 Lp NeuralNetwork<T>:
Truy
STT
Tn thuc tnh
Kiu
neuralNet
MLP<T>
Private
Mng MLP
maximumError
double
Private
Gii hn ti a ca li
maximumIteration
int
Private
TrainingSet
Hashtable<T,
double[]>
cp
Public
ngha/Ghi ch
Truy
STT
Tn phng thc
Kiu
train
void
Public
recognize
Void
Public
Nhn dng mt u vo
saveNetwork
void
Public
Lu cu hnh mng
loadNetwork
void
Public
cp
ngha/Ghi ch
81 | T r a n g
82 | T r a n g
STT
Tn mn hnh
ngha/Ghi ch
Mn hnh chnh
Mn hnh kt qu detect
3.3.5.2
83 | T r a n g
STT
Tn
Loi
Ngha
Kch
hot
Ghi ch
Cho php ko
1
cusZoomSlider
Drag
hnh nh
2
imgFocusImage
ImageView
Focus hnh nh
btnCaptureButton
ImageButton
Chp hnh
mItemManual
MenuItem
mItemAuto
MenuItem
Chn ch pht
hin bng tay
Chn ch pht
hin t ng
Click
Click
Click
[cusZoomSlider drag ]
Thay i hnh nh theo t l Zoom thch hp
[btnCaptureButton click ]
Chp hnh sau thng bo kt qu:
o Hin thng bo nu khng c pht hin bin bo
o Chuyn n mn hnh kt qu detect nu pht hin bin bo
[mItemManual click ]
Chuyn sang ch pht hin bng tay
[mItemAuto click ]
Chuyn sang ch pht hin t ng
84 | T r a n g
STT
Tn
Loi
Kch
Ngha
hot
Ghi ch
Cho php ko
1
cusZoomSlider
Drag
hnh nh
2
imgFocusImage
ImageView
Focus hnh nh
btnCaptureButton
ImageButton
Chp hnh
Click
[cusZoomSlider drag ]
Thay i hnh nh theo t l Zoom thch hp
[btnCaptureButton click ]
Chp hnh sau thng bo kt qu:
o Hin thng bo nu khng c pht hin bin bo
o Chuyn n mn hnh kt qu detect nu pht hin bin bo
GVHD: ThS. Phan Nguyt Minh
85 | T r a n g
STT
Tn
Loi
tvFPS
TextView
imgFocusImage ImageView
Ngha
Kch
hot
Ghi ch
Hin th s Frame/giy
Focus hnh nh
86 | T r a n g
STT
Tn
Loi
Kch
Ngha
hot
Ghi ch
FrameViewLayer t camera x l v
cam
STT
Tn
Loi
Ngha
Kch
Ghi
hot
ch
cam
FrameViewLayer camera x l v
khoanh vng bin bo
Hin th kt qu nhn
quickAction
PopupMenu
87 | T r a n g
S lng mu
S vng lp
Kt qu hun
lp n
hun luyn
phng li ti thiu
hun luyn
luyn
10
0.317
500000
Tht bi
20
0.240
500000
Tht bi
30
0.237
500000
Tht bi
40
0.153
500000
Tht bi
45
0.0001
20882
Thnh cng
45
10
0.161
500000
Tht bi
50
10
0.0001
39388
Thnh cng
50
15
0.0001
59349
Thnh cng
50
20
0.0001
64497
Thnh cng
50
25
0.0001
111311
Thnh cng
50
30
0.407
500000
Tht bi
60
30
0.329
500000
Tht bi
70
30
0.089
500000
Tht bi
80
30
0.0001
47092
Thnh cng
88 | T r a n g
CHNG 4 :
NH GI KT QU V KT LUN
4.1 nh Gi Lun Vn
Bo co l thuyt trnh by y v c th nhng im then cht v x l
nh, mng noron cng nh sc mnh ca n. Ngoi ra bo co cng gii thiu mt
nn tng di ng mi dnh cho cc nh pht trin ng dng di ng l h iu hnh
Android. Cng vi n l th vin x l nh OpenCV, mt trong cc th vin thng
hay c s dng khi lm vic vi cc bi ton nhn dng.
V mt p dng, kha lun gii quyt c bi ton pht hin v nhn dng
bin bo giao thng Vit Nam. M hnh gii quyt bi ton n gin, d ci t v
thch hp vi cc th b di ng khng cn i hi qu nhiu v phn cng.
4.2 nh Gi Chng Trnh
4.2.1 Kt qu t c
Chng trnh tng i hon chnh cho php ngi dng thc hin cc chc
nng sau:
-
Pht hin bin bo trong khung cnh bng tay thng qua thao tc chp
hnh
4.2.2 Cc hn ch
-
89 | T r a n g
90 | T r a n g