Control 2004, University of Bath, UK, September 2004 ID-126

$63(&762)/($51,1*$1'5(/($51,1*,152%27,&
)25&()(('%$&.&21752/
0+6FKZDU].%XUQ&6&R[
8QLYHUVLW\RI6XQGHUODQG&RQWURO6\VWHPV&HQWUH8QLWHG.LQJGRP
>PLFKDHOVFKZDU]NHYLQEXUQFKULVFR[@#VXQGHUODQGDFXN

.H\ZRUGV,WHUDWLYH/HDUQLQJ&RQWURO5RERWLFV5RERW)RUFH 6HFWLRQ  6RPH SRVVLEOH IXWXUH GLUHFWLRQV WKDW WKH UHVHDUFK
 &RQWURO P\WDNHDUHRXWOLQHGLQ6HFWLRQ

$EVWUDFW  3URFHVV'HVFULSWLRQDQG3UREOHP6WDWHPHQW
7KLV SDSHU LV FRQFHUQHG ZLWK DVSHFWV RI OHDUQLQJ DQG UH 7R DVVHVV WKH PHWKRG WZR ,/& VWUDWHJLHV ZHUH DSSOLHG WR D
OHDUQLQJ IRU ILOWHUEDVHG LWHUDWLYH OHDUQLQJ FRQWURO ,/& IRUFHFRQWUROSUREOHPVXJJHVWHGE\%XUQHWDO>@DQG6KRUW
PHWKRG IRU D UHSHWLWLYH IRUFH IHHGEDFN FRQWURO H[SHULPHQW >@7KH GHWDLOV RI WKH PRGHO SUHVHQWHG LQ )LJXUH  DV D
:LWKLQ D IHZ LWHUDWLRQF\FOHV RI WKH H[SHULPHQW WKH ,/& 6LPXOLQN EORFNGLDJUDPFDQEHIRXQGLQ%XUQHWDO>@
70

PHWKRG LPSURYHV WKH LQSXW WUDFNLQJ SHUIRUPDQFH 7KHVDPSOLQJWLPHZDVVHOHFWHGDVVHFRQGV

VLJQLILFDQWO\7KH,/&PHWKRGLVDEOHWROHDUQQHZUHIHUHQFH
VLJQDOV ZLWKLQ D IHZ LWHUDWLRQV ZLWKRXW UHVHWWLQJ WKH IHHG
IRUZDUG,/&YHFWRUDQGFDQFRSHZLWKPRGHOFKDQJHV
d u /d t
T o Wo rksp a ce 2
d Fe /d t d Fe
e rro r

 ,QWURGXFWLRQ
[t u k] -K-

Ra m p s tif f (11 1)
P ID
Veloc ity s o f t (1 3)
K p sti ff Fo rce

7KH URRWV RI WKH LWHUDWLYH OHDUQLQJ FRQWURO ,/&  PHWKRG JR

(0 .0 0 0 2 3 ) th eta (a c tua l) M a n u a l S wi tch
M a n u a l S wi tch 1

EDFN WR WKH \HDU  ZKHUH WKH PHWKRG ZDV RULJLQDOO\
Ra m p 1 P ID A rm + e n vi ro n m e n t
(su b syste m )
T o Wo rksp a ce 1

SURSRVHG LQ WKH URERWLFV FRPPXQLW\ >@ DV DQ LQWHOOLJHQW

K p so ft
(0 .0 0 2 ) e rro r1 G e a r ra ti o 20
N

WHDFKLQJ PHWKRG IRU URERW PDQLSXODWRUV 6LQFH WKHQ WKH

LQWHUHVW LQ WKLV PHWKRG KDV VWHDGLO\ EHHQ JURZLQJ DQG D
T o Wo rksp a ce 3
d u /d t

PRGHUDWH QXPEHU RI FRQIHUHQFH MRXUQDO DUWLFOHV DQG D IHZ

e rro r2
d th e ta
d th e ta /d t

ERRNV KDYH EHHQ ZULWWHQ DQG SXEOLVKHG VR IDU $ UHFHQWO\

SUHVHQWHGVXUYH\E\0RRUH>@SURYLGHVDJRRGGHVFULSWLRQRI
WKH WHFKQLTXH DQG LWV XVDELOLW\ ,QLWLDOO\ XVHG LQ URERWLFV WKH
PHWKRG FDQ QRZDGD\V DOVR EH IRXQG LQ PDQXIDFWXULQJ
SURFHVVHV VXFK DV FKHPLFDO EDWFK UHDFWRUV DQG EDWFK
GLVWLOODWLRQRUDQ\RWKHUUHSHWLWLYHLQGXVWULDOSURFHVV>@
7KH EDVLF LGHD RI ,/& LV WR LPSURYH WKH FXUUHQW FRQWURO
SURFHVV E\ XVLQJ WKH NQRZOHGJH RI WKH SUHYLRXV UHVXOW
)LJXUH6LPXOLQNEORFN'LDJUDPIRUVRIWDQGKDUGFRQWDFW
6LWXDWLRQ
7KHPRGHOLV WKDW RI D URERW SHUIRUPLQJ D IRUFH FRQWURO WDVN
DQG LV DQ DFFXUDWH UHSUHVHQWDWLRQ RI DQ H[SHULPHQWDO URERW
GHYHORSHG E\ WKH 6XQGHUODQG 5RERWLFV *URXS >@ ,W
FRPSULVHV WKH FRQWUROOHU WKH DUP G\QDPLFV DQG WKH VWLIIQHVV
RI FRQWDFW .  DW WKH URERWWDVN LQWHUIDFH 7KH IRUFH FRQWURO
LWHUDWLRQF\FOH DV DQ DGGLWLRQDO IHHGIRUZDUG VLJQDO (YHU\
WLPH WKH VDPH EDWFK SURFHVV LV UHSHDWHG WKH WUDFNLQJ
SHUIRUPDQFH VKRXOG LQFUHDVH XQWLO LW FRQYHUJHV WR D ILQDO
UHVXOW ,I DQ HQWLUHO\ QHZ EDWFK SURFHVV LV SUHSDUHG WKHQ WKH
,/&ZRXOGVLPSO\OHDUQWKHQHZWUDMHFWRU\WUDFNLQJ>@
VWUDWHJ\XQGHULQYHVWLJDWLRQKHUHLVIRUFHWUDFNLQJVRWKDWWKH
H
GHPDQG LV D IRUFH UDPS DQG WKH RXWSXW LV FRQWDFW IRUFH
PHDVXUHGE\DIRUFHWRUTXHVHQVRURQWKHUHDOV\VWHP
$ VSHFLILF IHDWXUH RI WKH PRGHO LV WKDW YDULDEOH VWLIIQHVV . 
ZKLFK FKDQJHV E\ D IDFWRU RI DSSUR[LPDWHO\  EHWZHHQ
H

,/& GLIIHUV IURP PDQ\ RWKHU IHHGIRUZDUG FRPSHQVDWLRQ ¶KDUG¶ KLJK .  DQG µVRIW¶ ORZ .  FRQWDFW 7KLV LV D
PHWKRGV LQ WKDW LI HIILFLHQWO\ H[SORLWV LQSXWRXWSXW SUREOHPDWLFDUHDRIURERWLFV ZKHUHIL[HGJDLQFRQWUROOHUVDUH
H H

UHODWLRQVKLSV V\VWHPLQSXW V\VWHP RXWSXWHUURU RI SUHYLRXV HPSOR\HG8VXDOO\WKHVROXWLRQLVWRHPSOR\WZRSURSRUWLRQDO

H[SHULPHQWV 7KH PHWKRG OHDUQV DQG LPSURYHV WKURXJK WKH FRQWUROOHUVVHOHFWDEOHE\DVZLWFKWXQHGIRUWKHOLPLWVRI. 
UHSHWLWLRQRIWKHH[SHULPHQWDQGLVQRWEDVHGRQDQ\SURFHVV 7KXVWKHPDLQSUREOHPDULVHVZKHQ. LVQRWNQRZQSULRUWR
H

PRGHO>@ WKH FRQWDFW DQG VRPH IRUP RI JDLQ VFKHGXOLQJ DQG .
H

7KHUHVWRIWKHSDSHULVRUJDQLVHGDVIROORZV,Q6HFWLRQWKH GHWHFWLRQ LV UHTXLUHG WR HQVXUH DFFHSWDEOH SHUIRUPDQFH LV

H

WZR GLIIHUHQW FRQWDFW VLWXDWLRQV DUH GHVFULEHG DQG WKH DFKLHYHG7KH PRVWFKDOOHQJLQJVLWXDWLRQ IRU DQ ,/& PHWKRG
SUREOHP VWDWHPHQW LV LQWURGXFHG ,Q 6HFWLRQ  WZR ,/& ODZV ZDV IRXQG WR EH ZKHQ WKH FRQWUROOHU IRU KDUG FRQWDFW ZDV
DUHSUHVHQWHG7KHVWDELOLW\DQDO\VLVLVSUHVHQWHGLQ6HFWLRQ LPSOHPHQWHG LH KLJK SURSRUWLRQDO JDLQ EXW ZKHQ D VRIW
7KHUHVXOWV PDNH XS6HFWLRQDQGFRQFOXVLRQVDUHGUDZQLQ FRQWDFWPRGHOKDGEHHQVHOHFWHG7KHLQLWLDOEHKDYLRXUIRUWKH
IRXU GLIIHUHQW VLWXDWLRQV DUH SUHVHQWHG LQ )LJXUH  7KH LGHD
 Control 2004, University of Bath, UK, September 2004
ZDV WR VHOHFW RQH FRQWUROOHU DQG WKH ,/& PHWKRG VKRXOG
VLPSO\OHDUQWKHFRQWDFWVLWXDWLRQ$OOJUDSKVDUHSUHVHQWHGDW
WKHHQGRIWKHSDSHU
 )LOWHU%DVHG,WHUDWLRQ/HDUQLQJ&RQWURO
6LQFHWKHILVWLQWURGXFWLRQRI,/& PDQ\GLIIHUHQWDOJRULWKPV
DQGPHWKRGVKDYHEHHQSURSRVHG)LJXUHVKRZVWKHSURFHVV
ID-126
,QWKHH[SHULPHQWVgl0DQG1ZHUHVHOHFWHGDV
 UHVSHFWLYHO\ ZKLFK KDG EHHQ SURYHQ DV D JRRG FKRLFH
GXULQJ WKH LQLWLDO H[SHULPHQWV $ GLVFXVVLRQ RQ WKH VHOHFWLRQ
RIWKHOHDUQLQJUDWHLVSUHVHQWHGLQVHFWLRQ
 6WDELOLW\$QDO\VLV
6WDELOLW\ DQDO\VLV LV DQ LPSRUWDQW LVVXH LQ ,/& DQG KHUH LV
3 FRQWUROOHG E\ D IHHGEDFN FRQWUROOHU WRJHWKHU ZLWK WKH LQYHVWLJDWHG KRZ WKH HUURU 6LJQDO EHKDYHV ZKHQ WKH XSGDWH
DGGLWLRQDO,/&FRPSRQHQWV ODZLV DSSOLHG7KH LQSXWRXWSXW UHODWLRQVKLS LQ )LJXUH  FDQ
+ + + + EHZULWWHQDV
< = 3 ¼ 8 = 3 ¼ 8 N& + 3 ¼ 8 N6 Ã < = 3 ¼ *& ¼ ( N + 3 ¼ 8 N6 
 
8 . +
0HPRU\ 7KHFXUUHQWHUURUFDQEHH[SUHVVHGDV
( N + = 5 - <N + = 5 - 3 ¼ 8 N6+ - 3 ¼ *F ¼ ( N + 
(. 8.
5 <
8 V

3
N

*&
8 N& + +
,QVHUWLQJHTXDWLRQLQHTXDWLRQ\LHOGV
( N + = 5 - 3 ¼ +  ¼ ( . - 3 ¼ +  ¼ 8 N6 - 3 ¼ *F ¼ ( N + 
-

&RQVHTXHQWO\WKHHUURUHTXDWLRQFDQEHUHZULWWHQDV
( N + ( + 3 ¼ *F ) = 5 - 3 ¼ +  ¼ ( . - 3 ¼ +  ¼ 8 N6
)LJXUH3URFHVV6\VWHPVZLWK)HHGEDFN&RQWUROOHUDQG

,WHUDWLYH/HDUQLQJ&RQWURO
7KHJHQHUDOLVHGXSGDWHODZLVJLYHQE\>@ %\DGGLQJDQGVXEWUDFWLQJ +  ¼ ( N HTXDWLRQEHFRPHV
8 N + = +  ¼ ( N + +  ¼ 8 .  
(N + ( + 3 ¼ *F ) = 5 - 3 ¼ + ¼ (. - 
:KHUH8 UHSUHVHQWVDYHFWRUWKDWFRQWDLQVHYHU\VLQJOH,/&
YDOXH IRU HYHU\ VDPSOH WLPH 8 ( DUH WKH UHFRUGHG V\VWHP 3 ¼ +  ¼ 8 N6 + +  ¼ (N - +  ¼ (N
N

LQSXW VLJQDO DQG HUURU UHVSHFWLYHO\  +  DQG +  DUH OLQHDU 7KHHUURURIWKHSUHYLRXV,/&F\FOHFDQEHVWDWHGDV

N  N

ILOWHUVEHFDXVH,/&LVDQRIIOLQH PHWKRG +  DQG +  FDQ EH

( N = 5 - 3 ¼ 8 NF - 3 ¼ 8 N6 
  

QRQFDXVDO DQG \LHOGV LQ HTXDWLRQ  7KH VXEVFULSW N

 

UHSUHVHQWVWKHHQWLUHN LWHUDWLRQF\FOH ,QVHUWLQJHTXDWLRQLQHTXDWLRQ\LHOGV

8 = * ¼l ¼K ( +g ¼K 8  (N + ( + 3 ¼ *F ) = 5 - 3 ¼ + ¼ (. - 3 ¼ +  ¼8 N6 
WK


 + +  ¼ (N - +  ¼ 5 + +  ¼ 3 ¼ 8 NF + +  ¼ 3 ¼8 N6
N + .
7KHWHFKQLTXHSUHVHQWHGXVHVDVLPSOH PRYLQJDYHUDJH ILOWHU
F N

IRU WKH HUURU VLJQDO 7KHUHIRUH HTXDWLRQ  FDQ EH UHZULWWHQ

DV $IWHU FDQFHOODWLRQ DQG UHGHILQLQJ +  ¼ 3 ¼8 N& =
+  ¼ 3 ¼ *F ¼ (N HTXDWLRQEHFRPHV
Ê (N ( D + M ) + ¼8 N ( D + L )
l
8 N + ( D ) =


(N + ( + 3 ¼ *F ) = 5 - 3 ¼ + ¼ ( . +
1

 1 +  M =- 1 
7R LQGLFDWH D VSHFLILF VDPSOHG YDOXH ZLWKLQ WKH GLIIHUHQW
YHFWRUV WKH YDULDEOH ¶D¶ LV XVHG g LV D ILOWHU JDLQ DQG +
+  ¼ (N - +  ¼ 5 + +  ¼ 3 ¼ *F ¼ (N
UHSUHVHQWV WKH FRQYROXWLRQ RSHUDWRU 1 VSHFLILHV WKH ILOWHU (TXDWLRQFDQEHUHDUUDQJHGDV
KRUL]RQ ( - +  ) (+ + +  ¼ 3 ¼ *F - 3 ¼ +  ) 
( N + = ¼5+  ¼ (.
)RU WKH VHFRQG ODZ WZR FKDQJHV ZHUH PDGH WR VSHHG XS WKH ( + 3 ¼ *F ) ( + 3 ¼ *F )
FRQYHUJHQFHDQGWRPDNHWKHDOJRULWKPFDSDEOHRIUHOHDUQLQJ )LQDOO\HTXDWLRQFDQEHIRUPXODWHGDV
GLIIHUHQW RU QHZ VLWXDWLRQV ZLWKRXW UHVHW 7KH LVVXH RI UH
( - +  ) Ë 3 ¼ + Û 
OHDUQLQJ RU OHDUQLQJ GLIIHUHQW DQG XQNQRZQ VLWXDWLRQV DUH ( N + = ¼ 5 + ÌÌ +  - ܼ(
LPSRUWDQWZKHQWKHDOJRULWKPVLVDXWRPDWHG7KH,/&XSGDWH ( + 3 ¼ *F ) Í ( + 3 ¼ *F ) ÜÝ .
ODZZDVFKDQJHGDQG\LHOGVHTXDWLRQ
8 (W ) = 8 (W ) + g ¼ ( (W ) + ( (W )
7KH6WDELOLW\FULWHULRQEHFRPHV
3 ( MZ ) ¼ +  ( MZ )
 
+  ( MZ ) - < " Z
( + 3 ( MZ ) ¼ * F ( MZ ))
N + N +
7KH,/&ODZGRHVQRWRQO\HPEUDFHSDVWV\VWHPLQSXWYDOXHV
N N

DQG HUURUV LW DOVR LQFOXGHV WKH FXUUHQW HUURU $Q DYHUDJLQJ
ILOWHU LV DOVR LQFRUSRUDWHG 7KH ILOWHU VKRXOG UHPRYH
GLVWXUEDQFHVDQGQRQYDOLGLQIRUPDWLRQ IURPWKH,/& YHFWRU  ,OOXVWUDWLYH([DPSOHV
7KHUHIRUHWKHILQDOXSGDWHODZFDQEHUHZULWWHQDV

Ê
Ë l Û 
8 N + ( D ) = Ì (N (D + M )Ü + /HDUQLQJUDWHVHOHFWLRQ
1

Í  1 +  M=- 1 Ý
7KH WXQLQJ SDUDPHWHU g KDV DQ LPSDFW RQ WKH UDWH RI WKH
Ê 8 N ( D + L ) + ( N + ( D )
g 0
FRQYHUJHQFHSURFHVV 7KLV VHFWLRQ JLYHV VRPH JXLGHOLQHV RQ
 0 +  L= - 0 KRZWRVHOHFWWKHOHDUQLQJUDWH7KHH[SHULPHQWVHOHFWHGXVHV
D KDUGFRQWDFW VWLII FRQWUROOHU EXW WKH VRIW FRQWDFW VXUIDFH
 Control 2004, University of Bath, UK, September 2004 ID-126

5RXJKO\DQ,/&DOJRULWKPZLWKg FRQYHUJHVVORZHUWKDQ 7KH PRGLILHG ,/& PHWKRG SURYLGHV YHU\ VDWLVIDFWRU\

RQHZLWKg EXWDQ,/&DOJRULWKPWKDWXVHVg GLYHUJHV VROXWLRQV3HUIHFWWUDFNLQJLVQRWDFKLHYHGEXW WKH RYHUVKRRW
ZKLFK FDQ EH VKRZQ ZLWK HTXDWLRQ  ,Q JHQHUDO WKH
QXPEHURIFRQYHUJHQFHWULDOVLVQRWWKHPRVWLPSRUWDQWLVVXH
UDWKHULWLVIRUWKHURERWWRIROORZWKHVHWSRLQWDVDFFXUDWHO\DV
SRVVLEOH)LJXUHVKRZVWKHFRQYHUJHQFHSURSHUWLHVRYHU
LWHUDWLRQVZKHUHg 
7KHWRSOHIWILJXUHVKRZVWKHVHWSRLQWWUDFNLQJFRQYHUJHQFH
LVDURXQGDQGWKHVHWWOLQJWLPHLVOHVVWKDQVHFRQGV
$g ZDVXVHGDVDOHDUQLQJIDFWRUIDVWHUFRQYHUJHQFHFDQ
DJDLQEHDFKLHYHGE\LQFUHDVLQJg7KHUHVXOWVDUHSUHVHQWHG
LQ )LJXUH  7KH DOJRULWKP LV DOVR DEOH WR UHOHDUQ UHIHUHQFH
WUDFNLQJIRUGLIIHUHQWFRQWDFWVLWXDWLRQVZLWKRXWWKHQHHGWREH
UHVHW )LJXUH  VKRZV WKDW WKH DOJRULWKP UHOHDQHG WKH LQSXW
SURFHVVRIWKHILUVWWULDODIWHUWKHWKWKDQGWKUXQ7KH YHFWRUDIWHUWKHVDPHQXPEHURILWHUDWLRQV2QFHLQVWDOOHGWKH
ILUVWLWHUDWLRQVDUHWKHPRVWLPSRUWDQWRQHVWKHUHPDLQLQJ DOJRULWKP FDQ KDQGOH RYHU D PRGHVW QXPEHU RI LWHUDWLRQV
DUH ILQHWXQLQJ 7KH ERWWRP OHIW ILJXUH VKRZV WZR LPSRUWDQW GLIIHUHQW FRQWDFW VLWXDWLRQV ,Q )LJXUH  WKH UHOHDUQHG V\VWHP
VLJQDOV 8& &RQWUROOHU 6LJQDO DQG 8 3URFHVV,QSXW 7KH
FRQWURO VLJQDO 8& GHFUHDVHV ZLWK WKH QXPEHUV RI WUDLOV
WRZDUGV]HURZKLFKLVH[SHFWHGVLQFHQRGLVWXUEDQFHVRFFXU
DQG WKH ,/&PHWKRG LV EHFRPLQJ SURJUHVVLYHO\ UHVSRQVLEOH
IRU LPSURYHG WUDFNLQJ SHUIRUPDQFH 7KH FRQWUROOHU FDQ EH
HPSOR\HG IRU GLVWXUEDQFH UHMHFWLRQ DV GHVFULEHG LQ VHFWLRQ
RXWSXWZDVVKLIWHGE\XQLWVWREHDEOHWRFRPSDUHWKHWZR
FXUYHV
'LVWXUEDQFH'HWHFWLRQ
7KHODVWDVSHFWWREHGHPRQVWUDWHGZLWKWKLV,/&DOJRULWKPLV
7KHVHFRQGVLJQDO8LVWKHDFWXDOVLJQDOWREHVHQWWRWKH
V\VWHP 3HUIHFW UHIHUHQFH WUDFNLQJ LV QRW DFKLHYHG DV
SUHVHQWHG LQ WKH ULJKWKDQG ILJXUH ZKLFK LV D ]RRPHG LQ
ILJXUH RI WKH V\VWHP UHVSRQVH DQG UHIHUHQFHVLJQDO EXW WKH
ILQDORYHUVKRRWLVDURXQGZKLFKLVUHVSHFWDEOHIRUDWDVN
RILWVQDWXUH>@
7KH VDPH H[SHULPHQW ZDV FDUULHG RXW WZLFH ,Q WKH VHFRQG
H[SHULPHQWWKHOHDUQLQJJDLQgZDVFKDQJHGIURPWR
7KH UHVXOWV DUH SUHVHQWHG LQ )LJXUH  7KH VDPH WUDFNLQJ
SHUIRUPDQFHFDQEHDFKLHYHGZLWKLQLWHUDWLRQV0RUHWHVWV
KDYHVKRZQWKDWgVKRXOGQRWEHHQFKRVHQODUJHUWKDQ,Ig
OLHV ZLWKLQ WKH UDQJH RI  WR  WKHQ WKH V\VWHP LQSXW
EHFRPHV RVLOORWDU\ DQG D VLJQLILFDQW RYHUVKRRW ZLWKLQ WKH
VHFRQG DQG WKLUG WUDLO RFFXUV EHIRUH LW FRQYHUJHV gYDOXHV
DERYHGHVWDELOLVHWKHV\VWHP
WKHUHMHFWLRQRIORDGGLVWXUEDQFHV:KHQDGLVWXUEDQFHRFFXUV
WKHFRQWUROOHUUHDFWVDQGWKHDFWLRQLVVWRUHGLQWKH,/&YHFWRU
7KH DOJRULWKP ZLOO UHDFW RQ WKH GLVWXUEDQFH RI WKH SUHYLRXV
LWHUDWLRQZKLFKLVQRZDSKDQWRPSHUWXUEDWLRQ7KHDOJRULWKP
LVFDSDEOHRIUHPRYLQJWKHSKDQWRPGLVWXUEDQFHIURPWKH,/&
YHFWRU ,W WDNHV RQ DYHUDJH  LWHUDWLRQV EHIRUH WKH SDVW
GLVUXSWLRQ LV HOLPLQDWHG 7KH VFHQDULR LV SUHVHQWHG LQ )LJXUH
$QLQFUHDVHLQWKH ILOWHU KRUL]RQFDQ LPSURYH WKH UHPRYDO
RIWKHFRUUXSWHGGDWDEXWLWZRXOGEHPRUHVXIILFLHQWWRGHWHFW
DQ\ GLVWXUEDQFHV EHIRUHKDQG UDWKHU WKDQ ILOWHU WKHP
DIWHUZDUGV
$ SURFHGXUH WR GHWHFW D SHUWXUEDWLRQ LV WR REVHUYH WKH
FRQWUROOHU RXWSXW $IWHU WKH ,/&PHWKRG KDV FRQYHUJHG WKH
FRQWURORXWSXW VKRXOG EH DURXQG ]HUR DV VKRZQ LQ )LJXUH 
7KH ,/&PHWKRG LV LQWROHUDQW WR GLVWXUEDQFHV EXW QRW WKH
IHHGEDFN FRQWUROOHU 7KLV VLJQDO FDQ EH XVHG DV DQ LQGLFDWRU
7KHDYHUDJH [ HTXDWLRQRISDVWVLJQDOVRIWKHFXUUHQWWHVW
/HDUQLQJDQG5HOHDUQLQJ
LVFRPSXWHGDQGWKHHVWLPDWHG SRSXODWLRQ VWDQGDUG GHYLDWLRQ
7KH QH[W H[SHULPHQW GHDOV ZLWK WKH LVVXH RI OHDUQLQJ D QHZ sÖ [ HTXDWLRQ,IDV\VWHPJHWVSHUWXUEHGE\DORDGFKDQJH
WDVNZLWKRXWUHVHWWLQJWKH,/&YHFWRU(TXDWLRQLVXVHGDV
WKH XSGDWHODZ 7KH SUHYLRXV H[SHULPHQW VRIW FRQWDFW WKHQ WKH DYHUDJH ZLOO VKLIW DQG ZLOO YLRODWH WKH sÖ [ UDQJH
VLWXDWLRQKDUG FRQWDFW FRQWUROOHU ZLWK g  ZDV FDUULHG RXW
 WLPHV VXFK WKDW ,/&DOJRULWKP OHDUQW WR IROORZ WKH
UHIHUHQFHVLJQDODFFXUDWHO\7KHQWKHPRGHOZDVFKDQJHGWRD
KDUGFRQWDFWVLWXDWLRQDQGWKH,/&DOJRULWKPKDGWROHDUQWKH
VDPH UHIHUHQFH VLJQDO $IWHU  LWHUDWLRQV LW ZDV VZLWFKHG WR
VLJQLILFDQWO\7KHQXPEHULVQRWDIL[HGRUUDQGRPQXPEHU
,I WKH YDOXH LV GHFUHDVHG WKHQ PRUH YLRODWLRQV FDQ EH
GHWHFWHG EXW DOVR QRLVH FDQ WKHQ EH LQWHUSUHWHG DV D ORDG
FKDQJH ZKLFK LV D IDOVH GHWHFWLRQ ,I WKH YDOXH LV WRR ODUJH
WKHQVRPHORDGFKDQJHVPD\EHXQGHWHFWHG
Ê
WKHSUHYLRXVVRIWFRQWDFWPRGHO7KHDOJRULWKPKDGDJDLQ  1 
LWHUDWLRQVWRUHOHDUQWKHWUDFNLQJRIWKHUHIHUHQFHVLJQDOZLWK [ = [L
1
VRIW FRQWDFW 7KH GLIIHUHQFHV LQ WKH ,/&YHFWRU DUH VKRZQ LQ L=
,QLWLDOH[SHULPHQWV VKRZHG WKDW WKH YDOXHV DURXQG  SHUIRUP


)LJXUH  7KH DOJRULWKP LV QRW DEOH WR OHDUQ WKH SUHYLRXV
ZHOO 7KH DFWXDO GHULYDWLRQ RI WKH DOJRULWKP FDQ EH IRXQG LQ
WUDFNLQJ H[DFWO\ ,I WKLV H[SHULPHQW LV FDUULHG RXW VHYHUDO
5KLQHKDUW>@
WLPHV VZLWFKLQJ EHWZHHQ WKH WZR GLIIHUHQW PRGHOV ZLWKRXW

Ê

( [L - [ )
UHVHWWLQJ WKH ,/&YHFWRU WKHQ WKH ,/&VLJQDO EHFRPHV 
sÖ [ =
1
RVFLOODWRU\DQGILQDOO\XQVWDEOH 1 -


)RU WKH VHFRQG ,/& ODZ HTXDWLRQ  ZDV XVHG DQG WKH
L=
)LJXUH  VKRZV WKH GHWHFWLRQ UHVXOWV 7KH WRS JUDSK VKRZV


H[SHULPHQWZDVFDUULHGRXWDJDLQ7ZRFKDQJHVZHUHPDGHWR
WZR GLVWRUWLRQ DW DERXW  DQG  VHFRQGV RI D PDJQLWXGH RI
VSHHGXSWKHFRQYHUJHQFHDQGWRPDNHWKHDOJRULWKPFDSDEOH
7KHILUVWGLVWRUWLRQLVGXHWRUDPSVLJQDOLQWURGXFHGWR
RI UHOHDUQLQJ GLIIHUHQW RU QHZ VLWXDWLRQV ZLWKRXW UHVHW 7KH
WKH V\VWHP DQG WKH GLVWRUWLRQ DW  VHFRQGV RFFXUV ZKHQ WKH
,/&ODZLQFOXGHVWKHUHODWLRQVKLSRISDVWV\VWHPLQSXWYDOXHV
UHIHUHQFHVLJQDOFKDQJHVWRDVWHDG\VWDWHVLJQDO
DQG HUURUV DQG WKH FXUUHQW HUURU $Q DYHUDJLQJ ILOWHU LV DOVR
:KHQWKHPRGHOFKDQJHVGXULQJDUXQFKDQJLQJWKHPRGHO
LQFRUSRUDWHG WR UHPRYH GLVWXUEDQFHV DQG QRQYDOLG
ZKLFKLVGRQHDWVHFRQGVDQGDWVHFRQGVWKHGHWHFWRU
LQIRUPDWLRQIURPWKH,/&YHFWRU
 Control 2004, University of Bath, UK, September 2004 ID-126

LQGLFDWHV WKLV ZLWK D KLJK DPSOLWXGH RI  LQ WKH ILUVW >@ 0RRUH ./ ³,WHUDWLYH /HDUQLQJ &RQWURO $Q ([SRVLWRU\
LQVWDQFH DQG ZLWK DQ DPSOLWXGH RI  DW WKH VHFRQG 7KH 2YHUYLHZ´  $SSOLHG DQG &RPSXWDWLRQDO &RQWUROV
VHFRQG DPSOLWXGH LV VPDOOHU VLQFH WKH VRIW FRQWDFW PRGHO LV 6LJQDO3URFHVVLQJDQG&LUFXLWV
DFWLYHDQGVRPHRIWKHGLVWXUEDQFHLVDEVRUEHGE\WKH PRGHO >@ 3KDQ 0 /RQJPDQQ 5: 0RRUH ./ ³8QLILHG
LWVHOI )RUPXODWLRQ RI /LQHDU ,WHUDWLYH /HDUQLQJ &RQWURO´
$$6$,$$ 6SDFH 0HFKDQLFV 0HHWLQJ &OHDUZDWHU )O
 &RQFOXVLRQ 3DSHU1R$$6
>@ 5KLQHKDUW 55 ³$Q RQOLQH 63&EDVHG WULJJHU IRU
7KLVSDSHUKDVLQWURGXFHGWZRGLIIHUHQW,/&XSGDWHODZVDQG FRQWURO DFWLRQ´ &RQIHUHQFH SURFHHGLQJV PLFURHOHFWURQLF
WKHVHZHUHWHVWHGRQDURERWLFIRUFHIHHGEDFNFRQWUROSUREOHP PDQXIDFWXULQJ$XVWLQ7;SDSHU
7KH SDSHU DOVR KLJKOLJKWHG WKH LPSRUWDQFH RI D VXLWDEOH >@ 6KRUW 0 ³7KH 'HYHORSPHQW RI D JHQHULF 5RERW
OHDUQLQJ UDWH VHOHFWLRQ 1RUPDOO\ D KLJKHU OHDUQLQJ UDWH &RQWUROOHU $UFKLWHFWXUH IRU $GYDQFHG DQG ,QWHOOLJHQW
FRQYHUJHV IDVWHU EXW FDQ OHDG WR XQVDWLVIDFWRU\ LQWHUPHGLDWH 5RERWV´3K'7KHVLV8QLYHUVLW\RI6XQGHUODQG
LWHUDWLRQUHVXOWV >@;X -; /HH 7+ 7DQ < ´(QKDQFLQJ WUDMHFWRU\ IRU D
7KHLPSRUWDQFHRIOHDUQLQJ DQG UHOHDUQLQJ ZLWKRXW UHVHWWLQJ FODVV RI SURFHVV FRQWURO SUREOHPV XVLQJ LWHUDWLYH
WKH,/&YHFWRUZDVH[DPLQHG7KHILUVWXSGDWHODZSUHVHQWHG OHDUQLQJ´ (QJLQHHULQJ $SSOLFDWLRQV RI $UWLILFLDO
LQ HTXDWLRQ  SURYLGHV VXIILFLHQW UHVXOWV IRU D VSHFLILF ,QWHOOLJHQFHSS
FRQWUROV\VWHPEXWLVXQDEOHWROHDUQDQHZVLWXDWLRQGLIIHUHQW >@;X -; +X 4 /HH 7+ <DPDPRWR 6 ³,WHUDWLYH
PRGHO ZLWKRXW EHLQJ UHVW 7KH VHFRQG DSSURDFK SUHVHQWHG /HDUQLQJ &RQWURO ZLWK 6PLWK 7LPH 'HOD\ &RPSHQVDWRU
RIIHUHGVDWLVIDFWRU\UHVXOWVLQOHDUQLQJDFFXUDWHO\WRIROORZWKH IRU EDWFK 3URFHVVHV´ -RXUQDO RI 3URFHVV &RQWURO  SS
UHIHUHQFH VLJQDO 7KH FRQWUROV\VWHP ZDV DEOH WR DGDSW WR 
GLIIHUHQWFRQWDFWVLWXDWLRQVZLWKRXWEHLQJUHVHW
7KH ILQDO VHFWLRQ GHDOW ZLWK GLVWXUEDQFH GHWHFWLRQ ,/& FDQ
FDSWXUH WKH FRQWUROOHUUHVSRQVH IRU D VLJQDO GLVWXUEDQFH DQG
$SSHQGL[
WKLV OHDGV WR D SKDQWRP GLVWXUEDQFH LQ WKH QH[W WULDO $
VWDWLVWLFDO PHWKRG ZDV LQWURGXFHG WR ILUVWO\ H[DPLQH WKH
FRQWUROOHUUHVSRQVH WR FKHFN LI WKH GDWDVHW LV SHUWXUEDWLRQ
IUHHDQGWKHQWRXVHWKHQHZGDWDVHWIRUWKH,/&DOJRULWKP

 )XWXUH:RUN
)XWXUHZRUNFDQEHVXPPDULVHGDV

œ 3HUIRUPPRUHH[SHULPHQWVHVSHFLDOO\ZLWKUHDOGDWDIURP
GLIIHUHQWODERUDWRU\ULJV
œ ,QYHVWLJDWHGLIIHUHQWILOWHUVWUDWHJLHV
œ 8VH ,/& NQRZOHGJH WR UHWXQH WKH FRQWUROOHU ZLWKRXW
GLVWXUELQJWKHSURFHVV

 5HIHUHQFHV
>@ $ULPRWR 6 .DZDPXUD 6 0L\D]DNL ) ³%HWWHULQJ
RSHUDWLRQ RI URERWV E\ OHDUQLQJ´ -RXUQDO RI 5RERWLF
6\VWHPV
>@ %XUQ.6KRUW0DQG%LFNHU5³$GDSWLYHDQG1RQOLQHDU
)X]]\ )RUFH &RQWURO 7HFKQLTXHV $SSOLHG WR 5RERWV
2SHUDWLQJ LQ 8QFHUWDLQ (QYLURQPHQWV´ -RXUQDO RI
5RERWLF 6\VWHPV  SS :LOH\ 3HULRGLFDOV
,QF
>@ %XUQ . %LFNHU 5 ³'HYHORSPHQW RI D QRQOLQHDU IRUFH
FRQWUROOHUXVLQJIX]]\ORJLFWHFKQLTXHV´,0HFK(-RXUQDO
RI6\VWHPVDQG&RQWURO(QJ
>@ *XQQDUVVRQ * 1RUUORHI 0 ³$ 6KRUW ,QWURGXFWLRQ WR
,WHUDWLYH /HDUQLQJ &RQWURO´ 7HFKQLFDO 5HSRUW 5HSRUW
1R/L7+,6<5
>@ +X 4 ;X -; /HH 7+ ³,WHUDWLYH /HDUQLQJ &RQWURO
'HVLJQIRU6PLWKSUHGLFWRU´6\VWHPV &RQWURO/HWWHUV
SS )LJXUH'LIIHUHQW&RQWDFW6LWXDWLRQV
 Control 2004, University of Bath, UK, September 2004 ID-126

)LJXUH5HVXOWVXVLQJDQ,/&PHWKRG )LJXUH5HVXOWVIRUOHDUQLQJUHOHDUQLQJ

)LJXUH5HVXOWVXVLQJD,/&PHWKRGZLWKDOHDUQLQJUDWHRI )LJXUH5HVXOWVXVLQJPRGLILHG,/&DOJRULWKP

 Control 2004, University of Bath, UK, September 2004 ID-126

)LJXUH5HOHDUQLQJUHVXOWVXVLQJPRGLILHG,/&DOJRULWKP )LJXUH'LVWXUEDQFHGHWHFWLRQ

)LJXUH,/&DOJRULWKPDQGSKDQWRPGLVWXUEDQFHUHMHFWLRQ