TPC Benchmark W (Web Commerce) : Specification

TPC BENCHMARK TM W (We b Com m e r c e )
Sp e c i f i c a t i o n Version 1.8 Feb 19, 2002
Tran s a c t i o n Proc e s s i n g Perf or m a n c e Cou n ci (TPC)

650 N. Winch e s t e r Blvd, S ite 1 S!n "ose, #$ 951 2 8 , %S$ &hon e '(08) 295* 889 ( F!+ '(08) 2,1* 66( 8 htt-.//000.t - c.or 1 e* 2 !il.! d 2 i n3 t - c.or 1 4 199 5 * 2000 Tr!ns ! c ti o n &roces si n 1 &er6or2 ! n c e #o ncil
Ac!n o " e # g m e n t s
7evelo-in 1 ! T&# benc h 2 ! r 8 6or ! ne0 environ 2 e n t re9 ire s ! h 1 e conc e - t ! li: e, res e ! r c h , s-eci6;, revie0, -rotot ;- e !nd veri6; the benc h 2 ! r 8 . e66ort to
The T&#*W s bco 2 2 i t t e e 0o ld li8e to !c8no0l e d 1 e the contrib tio n s 2! d e b; the 2! n ; 2e 2 b e r s d rin1 the dev elo - 2 e n t o6 the benc h 2 ! r 8 s-eci6ic!tio n. <t h!s t!8e n the dedic ! t e d e66ort s o6 -eo -l e !cros s 2 ! n ; co2 - ! ni e s , o6ten in !ddition to their re1 l !r d tie s. The list o6 si1ni6ic! nt contrib t or s incl d e s 7!ve Mc# tch e o n , #!rol =r!n 1 e , Bh!1;! 2 Moses, S!dh ! n ! >;!th ! - - ! l ! , Sh!n ti S br ! 2 ! n i ! n , Fr!ncois ?!!b, @orn! @ivin1tr e e , "errold B 11e rt , ?ich!r d S! n d e r s , Stev e Morris, B r:in &!tel, " di B!n8, #h!rles @evine, "i2 Anri1ht, W!;n e S2ith, "!c8 Ste- h e n s , Neel "!in, 7!ve B i2 b ellot, Berson Finlev, Bre1 7!rn ell, Son @ on1, To2 #ol!ti, $ndre0 Aisen b e r 1, $l!n #h!n, >!rl C --l er, 7ino D int ero, B!s8er Sh! n 2 1 ! 2 , ?!2 b ! b @ol!b !t t !nd Ton; &etrossi ! n .
TPC Me m b e r s $ i p
'!s o6 7ece 2 b e r , 1999) $cer, <nc. $n1!r ! 7!t! b ! s e So6t0!r e, <nc. BA$ S;st e 2 s , <nc. B ll S.$. #o2- ! 9 #o2 - t e r #or7ell #o2- t e r s #or-. Alectronic 7!t! S;st e 2 s #or-. AM# #or-. F Eits @td. Ce0lett* &!c8!rd #o. Cit!chi @td. <BM #or-. <n6or2i+ So6t0!r e <ntel #or-. <T=M <ntern ! ti o n !l Microso6t #or-. M;le+ #or-. N#? #or-. NA# S;st e 2 s @!bor !t or ; Netsc ! - e #or-. =>< Alectric <nd str; =r!cl e #or-. &ro1re s s So6t0!r e #or-. S!nt ! #r : =-er ! ti on <nc. Sie2 e n s $B Silicon Br!- hics <nc. S n Micros;st e 2 s <nc. S;b! s e <nc. Toshib ! #or-. %nis;s #or-. White #ross S;st e 2 s <nc.
Tra# e m a r ! s an # %eg a
Notic e s
T&# Bench 2 ! r 8 F , T&#*W, W<&S, W<&So !nd W<&Sb !re tr!d e 2 ! r 8 s o6 the Tr!ns ! c ti o n &roces si n 1 &er6or2 ! n c e #o ncil. $ll -!rti e s -!rt o6 this - r-o s e o6 - blic!tion, Tr!ns ! c tio n !re 1r! nt e d -er 2i s sio n to co-; !nd distrib t e to !n; -!rt ; 0itho t 6ee !ll or 2 !t e ri !l -rovid e d th!t. 1) co-;in 1 !nd distrib tion is don e 6or the -ri2 !r ; diss e 2 i n ! ti n 1 T&# 2!t e ri !lG 2) the T&# co-;ri1ht notice, the title o6 the !nd its d!t e !-- e ! r , !nd notice is 1iven th!t co-;in 1 is b; -er 2i s si on o6 the &roce s si n 1 &er6or 2 ! n c e #o ncil.
&!rties 0ishin1 to co-; !nd distrib t e T&# 2!t e ri !ls oth er th! n 6or the - r-o s e s o tline d !bov e 'incl din 1 incor-or ! ti n 1 T&# 2!t e ri !l in ! non* T&# doc 2 e n t , s-eci6ic!tion or re-ort), 2 st sec r e the T&#Hs 0ritte n -er 2i s si on.
T&# Bench2!r8I W
St!nd!rd S-eci6ic!tion Version &'(
&!1e
iii
)oc u m e n t Hist or *
Nove 2 b e r 19, 1999 7ece 2 b e r . 9, 1999 M!; 10, 200 0 Febr ! r ; ,, 200 1 7r!6t 5.5 ?evie0 dr!6t -rior to !--rov !l b; 2 !il b!llot Version 1.0 M!il b!llot version o6 st! n d ! r d benc h 2 ! r 8 -
Version 1.01$ F rth er co2 2i t t e e revisions 6ro2 revie0 co2 2 e n t s thro 1 h #l! s e 2.6.5.5 Version 1.5.1 #l!ri6ied re9 ir e 2 e n t s o6 the se- ! r ! t e se!rc h 9 eri e s. Modi6ied re-ortin 1 !11r e 1 ! t e d !nd 1r! - hi n 1
re9 ire 2 e n t s 6or s;st e 2 s .
T&# Bench2!r8I W
&!1e
iv
Tab e of Con t e n t s C ause + , PREAMB%E C ause & , WEB .B/ECT 0 %.12CA% )ATABASE )ES21N
1.1 1.2 1.5 1.( 1.5 1.6 1., 1.8
-iii 3ii
0.1 <NT?=7%#T<=N ...............................................................................................................................................................V<<< 0.2 B ANA?$@ <M&@AMANT$T<=N B %<7A@<NAS....................................................................................................................... J B%S<NASS $N7 $ &&@<#$T<=N ANV<?=NMANT ................................................................................................................J<< 7 AF<N<T<=N =F TA?MS....................................................................................................................................................J<<< 7 $T$B$SA ANT<T<AS, ?A@$T<=NSC<&S , $N7 # C$?$#TA?<ST<#S..................................................................................J<V T$B@A @$K=%TS.............................................................................................................................................................. JV W AB = B"A#TS, # C$?$#TA?<ST<#S $N7 ?A@$T<=NSC<& W<TC 7 $T$B$SA...................................................................J<J <M&@AMANT$T<=N ?%@AS................................................................................................................................................JJ <NTAB?<TK ?%@AS...........................................................................................................................................................JJ<< 7 $T$ $ ##ASS T?$NS&$?AN#K ?AD%<?AMANTS.........................................................................................................JJ<<
C ause 4 , WEB 2NTERACT2.NS AN) W.RK%.A) PR.52%E
33i-
2.1 7 AF<N<T<=N =F TA?MS................................................................................................................................................. JJ<V 2.2 <M&@AMANT$T<=N ?%@AS.............................................................................................................................................JJV< 2.5 C =MA W AB <NTA?$#T<=N ..........................................................................................................................................JJJ<< 2.( SC=&&<NB # $?T W AB <NTA?$#T<=N .........................................................................................................................JJJV 2.5 # %ST=MA? ?AB<ST?$T<=N W AB <NTA?$#T<=N ............................................................................................................ J@< 2.6 B%K ?AD%AST W AB <NTA?$#T<=N ...............................................................................................................................J@<V 2., B%K # =NF<?M W AB <NTA?$#T<=N ...................................................................................................................................@ 2.8 = ?7A? <ND%<?K W AB <NTA?$#T<=N ..............................................................................................................................@V 2.9 = ?7A? 7 <S&@$K W AB <NTA?$#T<=N ............................................................................................................................@V<< 2.10 SA$?#C ?AD%AST W AB <NTA?$#T<=N .........................................................................................................................@J< 2.11 SA$?#C ?AS%@T W AB <NTA?$#T<=N .........................................................................................................................@J<<< 2.12 N AW & ?=7%#TS W AB <NTA?$#T<=N .........................................................................................................................@JV< 2.15 BAST SA@@A?S W AB <NTA?$#T<=N ............................................................................................................................. @J<J 2.1( & ?=7%#T 7 AT$<@ W AB <NTA?$#T<=N .....................................................................................................................@JJ<< 2.15 $ 7M<N ?AD%AST W AB <NTA?$#T<=N ......................................................................................................................@JJV 2.16 $ 7M<N # =NF<?M W AB <NTA?$#T<=N ..................................................................................................................@JJV<<<
C ause 6 , )ATABASE TRANSACT2.N AN) S7STEM PR.PERT2ES C ause 8 , SCA%2N1 AN) )ATABASE P.P9%AT2.N
(.1 (.2 (.5 (.( (.5 (.6 (., (.8 5.1 5.2 5.5 5.( 5.5 5.6
333ii 3ciii
5.1 7 $T$B$SA T?$NS$#T<=N $#<7 & ?=&A?T<AS........................................................................................................ @JJJ<< 5.2 W AB & $BA # =NS<STAN#K ?AD%<?AMANTS................................................................................................................... J#< B ANA?$@ S#$@<NB ?%@A.............................................................................................................................................J#<<< S#$@<NB ?AD%<?AMANTS.............................................................................................................................................J#<<< # =NF<B%?$T<=N ..........................................................................................................................................................J#<V 180*7 $K S&$#A # =M&%T$T<=N .................................................................................................................................. J#V @=B ?AD%<?AMANTS.....................................................................................................................................................J#V 7 $T$B$SA & =&%@$T<=N ..............................................................................................................................................J#V< T$B@A & =&%@$T<=N ?AD%<?AMANTS...............................................................................................................................# WBAN 7 $T$ & =&%@$T<=N B ANA?$T=? ....................................................................................................................#<<<
C ause : , PER5.RMANCE METR2CS AN) RESP.NSE T2ME
c-i
7 AF<N<T<=N =F TA?MS...................................................................................................................................................#V< W AB <NTA?$#T<=N M <JAS............................................................................................................................................#V<< TC<N> T<MA $N7 ?AS&=NSA T<MA..............................................................................................................................#J<<< # =M&%T$T<=N =F TC?=%BC&%T ?$T<NB ..................................................................................................................#JV M A$S%?AMANT <NTA?V$@ ?AD%<?AMANTS.................................................................................................................#JV ?AD%<?A7 ?A&=?T<NB ...............................................................................................................................................#JV<<< T&# Bench2!r8I W St!nd!rd S-eci6ic!tion Version &'( &!1e v
5., $ 77<T<=N$@ & A?F=?M$N#A ST$T<ST<#S....................................................................................................................#J<J
C ause ; , S9T< RBE AN) NETW.RK )E52N2T2.NS

6.1 6.2 6.5 6.( 6.5 6.6 6., ,.1 ,.2 ,.5 ,.(
c33-
?AM=TA B?=WSA? AM%@$T=? '?BA).......................................................................................................................#JJV % SA? SASS<=N 7 %?$T<=N ..........................................................................................................................................#JJV< SKSTAM % N7A? TAST 'S%T).....................................................................................................................................#JJV<< & $KMANT B $TAW$K AM%@$T=? '&BA)..................................................................................................................#JJ<J M =7A@ =F TCA # =M&@ATA TASTA7 SKSTAM..............................................................................................................#JJJ # =MM%N<#$T<=NS <NTA?F$#AS 7 AF<N<T<=NS ..........................................................................................................#JJJ = &A?$T<=N$@ # C$?$#TA?<ST<#S =F TCA M A?#C$NT # =MMA?#A $ &&@<#$T<=N ...............................................#JJJ<
C ause = , PR2C2N1
c333iii
& ?<#<NB M ATC=7=@=BK .........................................................................................................................................#JJJ<<< & ?<#A7 SKSTAM.........................................................................................................................................................#JJJV M $<NTAN$N#A ........................................................................................................................................................ #JJJV< ?AD%<?A7 ?A&=?T<NB ...........................................................................................................................................#JJJV<<<
C ause ( , 59%% )2SC%.S9RE REP.RT
c333i3
8.1 B ANA?$@ ?AD%<?AMANTS.......................................................................................................................................#JJJ<J 8.2 AJA#%T<VA S%MM$?K..................................................................................................................................................#J@< 8.5 # @$%SA 1 * W AB = B"A#T $N7 @=B<#$@ 7 $T$B$SA 7 AS<BN ..................................................................................#J@<V 8.( # @$%SA 2 * W AB <NTA?$#T<=NS $N7 W =?>@=$7 ...................................................................................................#J@V 8.5 # @$%SA 5 * 7 $T$B$SA T?$NS$#T<=N $N7 SKSTAM & ?=&A?T<AS............................................................................#J@V 8.6 # @$%SA ( * S#$@<NB $N7 7 $T$B$SA & =&%@$T<=N .................................................................................................#J@V 8., # @$%SA 5 & A?F=?M$N#A M AT?<#S $N7 ?AS&=NSA T<MAS.....................................................................................#J@V< 8.8 # @$%SA 6 * S%T, ?BA $N7 N ATW=?> ........................................................................................................................#@< 8.9 # @$%SA , * & ?<#<NB .....................................................................................................................................................#@<V 8.10 # @$%SA 9 * $ %7<T ?A@$TA7 <TAMS............................................................................................................................#@V 8.11 $ V$<@$B<@<TK =F TCA F%@@ 7 <S#@=S%?A ?A&=?T....................................................................................................#@V 8.12 ?AV<S<=NS T= TCA F%@@ 7 <S#@=S%?A ?A&=?T..........................................................................................................#@V
C ause > , A9)2T Appen#i3 A , C9ST.MER E?ENT )2A1RAM
c -iii c 3i-
9.1 B ANA?$@ ?%@AS.........................................................................................................................................................#@V<<< 9.2 $ %7<T=? LS # CA#> @<ST.............................................................................................................................................#@V<<< $.1 <NT?=7%#T=?K AJ&@$N$T<=NS ..............................................................................................................................#@J<V $.2 AVANT 7 <$B?$M 1.................................................................................................................................................... #@JV $.5 AVANT 7 <$B?$M 2................................................................................................................................................... #@JV<
Appen#i3 B , SH.PP2N1 STATE )2A1RAMS

B.1 B.2 B.5 B.( #.1 #.2 #.5 #.(
c 3-ii
<NT?=7%#T=?K AJ&@$N$T<=NS ..............................................................................................................................#@JV<< TCA ST$TA V$@%AS..................................................................................................................................................#@JV<< TCA ST$TA T?$NS<T<=N 7 <$B?$M .........................................................................................................................#@JV<<< # =MM%N<#$T<=N BATWAAN ?BA $N7 S%T =F AJ<STAN#A =F SC=&&<NB SASS<=N ..............................................#@J<J
Appen#i3 C , 2NTR.)9CT2.N T. SS%
c 33
= VA?V<AW...................................................................................................................................................................#@JJ SS@ V5 S&A#<F<#$T<=NS ...........................................................................................................................................#@JJ< SS@ V5 <M&@AMANT$T<=N T==@><TS.......................................................................................................................#@JJ< = BT$<N<NB $ SA?VA? 7 <B<T$@ # A?T<F<#$TA F=? TAST<NB ....................................................................................#@JJ<
Appen#i3 ) , )ATABASE P.P9%AT2.N RAT2.NA%E Appen#i3 E , SAMP%E PSE9).,C.)E
c 33iii c 33i-
7.1 7 A?<V$T<=N =F 2880 # %ST=MA?S &A? B?=WSA?.................................................................................................#@JJ<<< 7.2 % S<NB 8 C?S =F & A$> TC?=%BC&%T T= # =M&%TA ST=?$BA .............................................................................#@JJ<<<
T&# Bench2!r8I W
&!1e
vi
Appen#i3 5 , SAMP%E HTM% C.)E
c 33i3
F.1 $ 7M<N # =NF<?M .....................................................................................................................................................#@JJ<J F.2 $ 7M<N ?AD%AST......................................................................................................................................................#@JJ<J F.5 BAST SA@@A?S.............................................................................................................................................................#@JJJ F.( B%K # =NF<?M ........................................................................................................................................................#@JJJ<V F.5 B%K ?AD%AST..........................................................................................................................................................#@JJJV F.6 # %ST=MA? ?AB<ST?$T<=N ...................................................................................................................................#@JJJV<< F., C =MA ..................................................................................................................................................................... #@JJJ<J F.8 N AW & ?=7%#TS..........................................................................................................................................................#J#<< F.9 = ?7A? 7 <S&@$K.........................................................................................................................................................#J#V< F.10 = ?7A? <ND%<?K.....................................................................................................................................................#J#V<<< F.11 & ?=7%#T 7 AT$<@..................................................................................................................................................#J#V<<< F.12 SA$?#C ?AD%AST.................................................................................................................................................... #J#<J F.15 SA$?#C ?AS%@TS...........................................................................................................................................................## F.1( SC=&&<NB # $?T...........................................................................................................................................................##<
Appen#i3 1 , E@EC9T2?E S9MMAR7
ccii
B.1 <M&@AMANT$T<=N = VA?V<AW & $BA ...........................................................................................................................##<< B.2 & ?<#<NB & $BA ..............................................................................................................................................................##V B.5 N %MA?<#$@ D %$NT<T<AS S%MM$?K & $BA ...............................................................................................................##V<
Appen#i3 H , W1EN 9T2%2T7

C.1 C.2 C.5 C.( C.5
cc-ii
7 AS#?<&T<=N ..............................................................................................................................................................##V<< % S<NB WBAN ...........................................................................................................................................................##V<< # =MM$N7 @<NA = &T<=NS .......................................................................................................................................##V<<< ANV<?=NMANT V$?<$B@AS......................................................................................................................................##V<<< WBAN = %T&%T .........................................................................................................................................................##<J
Appen#i3 2 , STAN)AR) RE5ERENCES
cc3ii
<.1 <NTA?NAT ?F# S...........................................................................................................................................................##J<< <.2 # =MM=N @=B F=?M$T .............................................................................................................................................##J<<
T&# Bench2!r8I W
&!1e
vii
C a u s e + , PREAMB%E
+ ' & 2n tr o # u c t i o n
T&# Bench 2 ! r 8F W 'T&#*W) is ! tr!n s ! c ti o n !l 0eb benc h 2 ! r 8 . The 0or8lo! d is -er6or 2 e d in ! controlle d intern e t co2 2 e r c e environ 2 e n t th!t si2 l !t e s the !ctivities o6 ! b sin e s s orient e d tr!n s ! c ti o n !l 0eb serv er. The 0or8lo! d e+ ercis e s ! bre ! d t h o6 s;st e 2 co2 - o n e n t s !sso ci ! t e d 0ith s ch environ 2 e n t s , 0hich !re ch!r ! c t e ri: e d b;. M lti-le on* line bro0s e r ses sion s 7;n! 2i c -!1 e 1en e r ! ti o n 0ith d!t ! b ! s e !cc e s s !nd #onsist e n t 0eb obEect s The si2 lt ! n e o s co2 -l e +it ; e+ ec tio n o6 2 lti-le tr!ns ! c ti o n t;- e s th!t s-! n ! bre ! d t h o6 -d ! t e
=n* line tr!n s ! c ti o n e+ ec ti o n 2od e s 7!t! b ! s e s consistin 1 rel!tion s hi - s o6 2! n ; t!bl es 0ith ! 0ide v!riet ; o6 si:es, !ttrib t e s , !nd
Tr!ns ! c ti o n inte 1rit ; '$#<7 -ro- e rti e s) #ont e n tio n on d!t ! !cc e s s !nd -d ! t e
The -er6or 2 ! n c e 2 et ric re-ort e d b; T&#*W is the n 2 b e r o6 0eb inter ! c tio n s -roc e s s e d -er seco n d. M lti-le 0eb inter ! c tio n s !re se d to si2 l !t e the !ctivit; o6 ! ret !il stor e, !nd e!c h inter ! c ti on is s bE ect to ! res-o n s e ti2 e constr !i nt . The store si:e is chos e n 6ro2 !2 o n 1 ! set o6 1iven sc!l e 6!ctors, 0hich is the n 2 b e r o6 <te2 s in invent or; !nd v!ries 6ro2 1,000 ite2 s to 10,00 0, 0 0 0 ite2 s. The -er6or 2 ! n c e 2 etric 6or this benc h 2 ! r 8 is e+-r e s s e d in Web <nter! c ti on s &er Secon d !t ! test e d sc!l e 6!ctor e+-r e s s e d b; W<&S3sc!l e 6!ctor 0her e sc!l e 6!ctor is the n 2 b e r o6 ite2 s in the <TAM t!bl e. For e+ ! 2 -l e 125W<&S310 0, 0 0 0 . $ll re6er e n c e s to W<&S in this s-eci6ic!tio n 2 e ! n W<&S3sc!l e 6!ctor. T&#*W si2 l !t e s thre e di66ere n t -ro6iles b; v!r;in1 the r!tio o6 bro0s e to b ;. -ri2 !ril; sho- -i n 1 'W<&S), bro0sin 1 'W<&Sb) !nd 0eb* b!s e d orderin 1 'W<&So). $ll re6er e n c e s to W<&S 'W<&Sb, W<&So) res lts 2 st incl d e the -ri2 !r; 2 et rics, 0hich !re. the W<&S r!t e, the !sso ci ! t e d -rice -er W<&S 'M/W<&S), !nd the !v!il!bilit; d!t e o6 the -rice d con6i1 r ! tio n. The 6ollo0in1 6 nction s, i6 se d in the benc h 2 ! r 8 , 2 st be -rovid e d b; co2 2 e r ci !ll; !v!il! bl e -rod ct s !nd be tr!ns - ! r e n t to the $--lic!tion &ro1r ! 2 'See #l! s e s 1.2.10 !nd 2.2.2 2). M lti-le+in 1 ?o tin1 @o!d B!l!nci n 1 #!chin1 'se e #l! s e 6.5.5.1)
T&# Bench2!r8I W
&!1e
viii
Com m e n t A The tr!ns - ! r e n c ; re9 ir e 2 e n t 2e ! n s th!t the !--lic!tio n 2 st not h!v e code th!t directl; re6er e n c e s thes e 6 nction s d rin1 the 2e ! s r e 2 e n t interv !l. To i2-le 2 e n t the electro nic co2 2 e r c e 6 nction one 2! ; se co2 2 e r ci !ll; !v!il!bl e -rod ct s or i2-le 2 e n t ! t i o n s-eci6ic -ro1r ! 2 s . The electro nic co2 2 e r c e 6 nction 2 st incl d e, !t 2ini 2 2 , the 6ollo0in1 c!- ! bilities !s de6ine d in this s-eci6ic!tion. Sec r e Soc8et @!;er 'SS@) Sho--i n 1 #!rt #redit #!rd Veri6ic!tion Sec r e on* line -!;2 e n t ! t h ori: ! tion
$ltho 1 h thes e s-eci6ic!tio n s e+-r e s s i2-le 2 e n t ! t i o n in ter 2 s o6 ! rel!tion !l d!t ! 2od el 0ith ! conv e n tio n !l loc8in1 sch e 2 e , the d!t ! b ! s e 2 !; be i2-le 2 e n t e d sin1 !n; co2 2 e r ci !ll; !v!il!bl e d!t ! b ! s e 2 ! n ! 1 e 2 e n t s;st e 2 '7BMS), d!t ! b ! s e serv er, 6ile s;st e 2 , or oth er d!t ! re-o sit or; th!t -rovid e s ! 6 nction !ll; e9 iv !l e n t i2-le 2 e n t ! t i o n. The ter2 s Nt!bl eN, Nro0N, !nd Ncol 2 nN !re se d in this doc 2 e n t onl; !s e+! 2 -l e s o6 lo1ic!l d!t ! str ct r e s . T&#*W se s ter2i n olo 1; !nd 2 et rics th!t !re si2il!r to oth er benc h 2 ! r 8 s ori1in !t e d b; the T&# or other s. S ch si2il!rit; in ter 2i nolo 1 ; does not in !n; 0!; i2-l; th!t T&#*W res lt s !re co2 - ! r ! b l e to oth er benc h 2 ! r 8 s. The onl; benc h 2 ! r 8 res lt s co2 - ! r ! bl e to T&#*W !re oth er T&#*W res lt s 0ith the !--ro -ri !t e revision !nd s! 2 e sc!l e 6!ctor. 7es-it e the 6!ct th!t this benc h 2 ! r 8 o66ers ! rich environ 2 e n t th!t e2 l ! t e s 2! n ; 0eb bro0sin 1 !nd 0eb* b!s e d orderin 1 !--lic!tio n s, this benc h 2 ! r 8 doe s not re6lect the entire r!n1 e o6 0eb serv er re9 ire 2 e n t s . <n !ddition, the e+t e n t to 0hich ! c st o 2 e r c!n !chi ev e the res lt s re-ort e d b; ! ven d or is hi1hl; de- e n d e n t on ho0 closel; T&#*W !--ro+i 2 ! t e s the c sto 2 e r !--lic!tion. The rel!tive -er6or 2 ! n c e o6 s;st e 2 s derive d 6ro2 this benc h 2 ! r 8 does not nec e s s ! ril; hold 6or other 0or8lo! d s or environ 2 e n t s . A+tr!- ol !ti on s to !n; oth er environ 2 e n t !re not reco 2 2 e n d e d . Bench 2 ! r 8 res lts !re hi1hl; de- e n d e n t -on s;st e 2 s desi 1n, !nd i2-le 2 e n t ! t i o n . ?el!tive thes e !nd oth er 6!ctors. Ther e6or e, T&#*W sho c sto 2 e r !--lic!tion benc h 2 ! r 8i n 1 0hen ev!l ! tio n decision s !re cont e 2 - l ! t e d . 0or8lo! d, s-eci6ic !--lic!tion re9 ire 2 e n t s , s;st e 2 -er6or 2 ! n c e 0ill v!r; !s ! res lt o6 l d not be se d !s ! s bstit t e 6or ! s-eci6ic critic!l c!- ! cit ; -l!nni n 1 !nd/ or -rod ct
Bench 2 ! r 8 s-on s or s !re -er 2itt e d sev er !l -ossibl e s;st e 2 desi 1n s, inso6!r !s the; !dh e r e to the 2od el describ e d !nd -ictori!ll; ill str! t e d in #l! s e 6. $ F ll 7isclos r e ?e-ort o6 the i2-le 2 e n t ! t i o n det !ils, !s s-eci6ied in #l! s e 8, 2 st be 2 ! d e !v!il!bl e !lon 1 0ith the re-ort e d res lt s. Com m e n t A While se- ! r ! t e d 6ro2 the 2!in te+t 6or re! d ! bilit;, co2 2 e n t s !re ! -!rt o6 the st!n d ! r d !nd !re en6orc e d . Co0ev e r, the s! 2 -l e -ro1r ! 2 s incl d e d !s $--e n di+ A, the s 2 2 ! r ; st!t e 2 e n t s incl d e d !s $--en di+ B, !nd the n 2 e ric !l 9 ! n titi e s s 2 2 ! r ;, incl d e d !s $--en di+ B, !re -rovid e d onl; !s e+ ! 2 -l e s !nd !re s-eci6ic!ll; not -!rt o6 this st!n d ! r d .
T&# Bench2!r8I W
&!1e
i+
+ ' 4 1 e n e r a 2m p e m e n t a t i o n 1ui # e i n e s
The - r-o s e o6 T&# benc h 2 ! r 8 s is to -rovid e relev ! n t , obEectiv e -er6or 2 ! n c e d!t ! to ind st r; sers. To !chi ev e th!t - r-o s e , T&# benc h 2 ! r 8 s-eci6ic!tio n s re9 ir e th!t benc h 2 ! r 8 test s be i2-le 2 e n t e d 0ith s;st e 2 s , -rod ct s, tech n ol o 1i e s !nd -ricin1 th!t. $re 1en e r !ll; !v!il!bl e to sers.
$re relev ! n t to the 2 !r8 e t se1 2 e n t th!t the individ !l T&# benc h 2 ! r 8 2od el s or re-re s e n t s 'e.1. T&#*W 2od el s !nd re-r e s e n t s hi1h* vol 2 e , co2 -l e + 0eb bro0sin 1 !nd 0eb* b!s e d orderin 1 environ 2 e n t s ). $ si1ni6ic! nt n 2 b e r o6 sers in the 2!r8 e t se1 2 e n t the benc h 2 ! r 8 2od el s or re-r e s e n t s 0o ld -l! sibl; i2-le 2 e n t .
The se o6 ne0 s;st e 2 s , -rod c t s, tech n olo 1i e s 'h!rd0 ! r e or so6t0!r e), !nd -ricin1 is enco r ! 1 e d so lon1 !s the; 2e e t the re9 ire 2 e n t s !bov e. S-eci6ic!ll; -rohibit e d !re benc h 2 ! r 8 s;st e 2 s , -rod ct s, tech n ol o 1i e s, -ricin1, !nd i2-le 2 e n t ! t i o n s 0hos e -ri2 !r ; - r-o s e is -er6or 2 ! n c e o-ti2i: !tio n o6 T&# benc h 2 ! r 8 res lts 0itho t !n; corre s - o n di n 1 !--lic! bilit; to re!l* 0orld !--lic!tio n s !nd environ 2 e n t s . <n oth er 0ords, !ll Nbenc h 2 ! r 8 s-eci !lN i2-le 2 e n t ! t i o n s th!t i2-rov e benc h 2 ! r 8 res lt s b t not re!l* 0orld -er6or 2 ! n c e or -ricin1, !re -rohibit e d. The 6ollo0in1 ch!r ! c t e ri stics sho ld be se d !s ! 1 ide to E d1e 0het h e r ! -!rtic l !r i2-le 2 e n t ! t i o n is ! benc h 2 ! r 8 s-eci !l. <t is not re9 ire d th!t e!c h -oint belo0 be 2 et, b t th!t the c 2 l ! tiv e 0ei1ht o6 the evid e n c e be consid er e d to identi6; !n n!c c e - t ! b l e i2-le 2 e n t ! t i o n. $bsol t e cert !i nt ; or cert !i nt ; be;o n d ! re!s o n ! b l e do bt is not re9 ir e d to 2!8 e ! E d1 2 e n t on this co2 -l e + iss e. The 9 e s tio n th!t 2 st be !ns0 e r e d is this. b!s e d on the !v!il! bl e evide n c e , doe s the cle!r -re - o n d e r ! n c e 'the 1re ! t e r sh!r e or 0ei1ht) o6 evide n c e indic!t e th!t this i2-le 2 e n t ! t i o n is ! benc h 2 ! r 8 s-eci !lO The 6ollo0in1 ch!r ! c t e ri stics sho ld be ! benc h 2 ! r 8 s-eci !l. se d to E d1e 0het h e r ! -!rtic l !r i2-le 2 e n t ! t i o n is
!) <s the i2-le 2 e n t ! t i o n 1en e r !ll; !v!il! bl e, doc 2 e n t e d , !nd s - - ort e d O b) 7oes the i2-le 2 e n t ! t i o n h!v e si1ni6ic! nt restrictions on its its se be;o n d T&# benc h 2 ! r 8 s O se or !--lic! bilit; th!t li2its
c) <s the i2-le 2 e n t ! t i o n or -!rt o6 the i2-le 2 e n t ! t i o n -oorl; inte 1r ! t e d into the l!r1er -rod ct O d) 7oes the i2-le 2 e n t ! t i o n t!8e s-eci !l !dv ! n t ! 1 e o6 the li2ited n!t r e o6 T&# benc h 2 ! r 8 s 'e.1., tr!n s ! c ti o n -ro6ile, tr!ns ! c ti o n 2i+, tr!ns ! c ti o n conc rr e n c ; !nd/or cont e n ti o n, tr!ns ! c ti o n isol!tion) in ! 2! n n e r th!t 0o ld not be 1en e r !ll; !--lic! bl e to the environ 2 e n t the benc h 2 ! r 8 re-r e s e n t s O e) <s the se o6 the i2-le 2 e n t ! t i o n disco r ! 1 e d b; the ven d orO 'This incl d e s 6!ilin1 to -ro 2 o t e the i2-le 2 e n t ! t i o n in ! 2! n n e r si2il!r to oth er -rod ct s !nd tech n olo 1i e s .) 6) 7oes the i2-le 2 e n t ! t i o n re9 ire nco 2 2 o n so-hi stic !tio n on the -!rt o6 the end* ser, -ro1r ! 2 2 e r , or s;st e 2 !d 2i ni str ! t o rO
1) <s the -ricin1 n s !l or non* c sto 2 ! r ; 6or the vend or or n s !l or non* c sto 2 ! r ; to nor 2 !l b sin e s s -r!ctic e s O The 6ollo0in1 -ricin1 -r!ctic e s !re s s- e c t . $v!il!bilit; o6 ! disco n t to ! s2 !ll s bs e t o6 -ossibl e c st o 2 e r s .
T&# Bench2!r8I W
&!1e
7isco nt s doc 2 e n t e d in !n
n s !l or non* c st o 2 ! r ; 2 ! n n e r .
7isco nt s th!t e+ce e d 25P on s2 !ll 9 ! n titi e s !nd 50P on l!r1e 9 ! n titie s. &ricin1 6e!t r e d !s ! close* o t or one* ti2 e s-eci !l. %n s !l or non* c sto 2 ! r ; restrictions on tr!n s6 e r ! bilit; o6 -rod c t, 0!rr! n t ; or 2 !int e n ! n c e on disco n t e d ite2 s.
h) <s the i2-le 2 e n t ! t i o n bein1 se d 'incl din 1 bet !) or - rch ! s e d b; end* ser s in the 2 !r8 e t !re ! the benc h 2 ! r 8 re-r e s e n t s O Co0 2 ! n ;O M lti-le sitesO <6 the i2-le 2 e n t ! t i o n is not c rre n tl; bein1 se d b; end* ser s, is ther e !n; evid e n c e to indic!t e th!t it 0ill be se d b; ! si1ni6ic!n t n 2 b e r o6 sersO
T&# Bench2!r8I W
&!1e
+i
C a u s e & , WEB .B/ECT 0 %.12CA% )ATABA SE )E S21N
& ' & B u s i n e s s a n # A p p i c a t i o n En -ir o n m e n t

T&# Bench 2 ! r 8F W co2 -ri s e ! set o6 b!sic o-er ! ti o n s desi 1n e d to e+ ercis e tr!ns ! c ti o n !l 0eb s;st e 2 6 nction !lit; in ! 2 ! n n e r re-r e s e n t ! t i v e o6 intern e t co2 2 e r c e !--lic!tion environ 2 e n t s . Thes e b!sic o-er ! tio n s h!v e bee n 1iven ! re!l* li6e cont e+ t, -ortr ! ;i n 1 the !ctivit; o6 ! 0eb site th!t s -- ort s ser bro0sin 1, se !rc hi n 1 !nd online orderin 1 !ctivit;. This is inten d e d to helser s rel!t e int itivel; to the co2 - o n e n t s o6 the benc h 2 ! r 8 . The 0or8lo! d is cent e r e d !ro n d the !ctivit; o6 bro0sin 1, se!rc hi n 1 !nd -roc e s si n 1 order s !nd -rovid e s ! lo1ic!l d!t ! b ! s e desi 1n, 0hich c!n be distrib t e d 0itho t str ct r !l ch! n 1 e s to the !--lic!tion. T&#*W does not re-r e s e n t the !ctivit; o6 !n; -!rtic l !r b sin e s s se1 2 e n t , b t r!th er !n; ind st r; th!t 2 st 2 !r8 e t !nd sell ! -rod c t or service over the <ntern e t 'e.1., ret !il store, so6t0!r e distrib tion, !irline reserv ! ti o n, etc.). T&#*W does not !tt e 2 - t to be ! 2od el o6 ho0 to b ild !n !ct !l !--lic!tion. The - r-o s e o6 this benc h 2 ! r 8 is to red c e the diversit; o6 o-er ! ti o n s 6o nd in !n intern e t co2 2 e r c e !--lic!tion, 0hile ret !inin 1 the !--lic!tio nH s ess e n ti !l -er6or 2 ! n c e ch!r ! c t e ri stics, n! 2 el ;. the level o6 s;st e 2 tili:!tion !nd the co2 -l e +it ; o6 o-er ! tio n s. $ l!r1e n 2 b e r o6 6 nction s h!v e to be -er6or 2 e d to 2 ! n ! 1 e !n environ 2 e n t 0hich s -- ort s bro0s e !nd order -roc e s si n 1. We incl d e ! re-r e s e n t ! t i v e set o6 6 nctions. M!n; oth er 6 nction s !re not o6 -ri2 !r ; inter e s t 6or -er6or 2 ! n c e !n !l ;si s, sinc e the; !re -ro-ortion !ll; s2 !ll in ter 2 s o6 s;st e 2 reso rc e tili:!tion or in ter 2 s o6 6re9 e n c ; o6 e+ ec ti o n. $ltho 1 h thes e 6 nction s !re vit!l 6or ! -rod c tio n s;st e 2 , the; 2er el ; cre !t e nn e c e s s ! r ; diversit ; in the cont e+ t o6 ! st!n d ! r d benc h 2 ! r 8 !nd h!v e be e n o2itt e d in T&#*W. The !--lic!tion -ortr! ;e d b; the benc h 2 ! r 8 is ! ret !il store on the intern e t 0ith c sto 2 e r bro0s e !nd order scen ! ri o. # sto 2 e r s visit the co2 - ! n ; 0eb site, the store* 6ront, to loo8 !t -rod ct s, 6ind in6or2 ! ti o n, -l!c e !n order, or re9 e s t the st!t s o6 !n e+istin1 order. The 2!Eorit; o6 visitor !ctivit; is to bro0s e the site. So2 e -erc e n t ! 1 e o6 !ll visits res lt in s b 2it tin 1 ! ne0 order. <n !ddition to sin1 the s;st e 2 !s ! store* 6ront, it is !lso se d 6or !d 2i ni str ! tio n o6 the 0eb site. $d2inistr ! ti on incl d e s 2odi6ic!tion to the store* 6ront.
T&# Bench2!r8I W
&!1e
+ii
& ' 4 ) e f i ni ti o n o f Ter m s

1.2.1 The ter 2 N uni B u e 2)s is se d in this s-eci6ic!tion to re6er to ! 6ield th!t 2 st be !ble to hold !n; one <7 0ithin ! 2ini2 2 set o6 N ni9 e <7s, re1! r dl e s s o6 the -h;sic !l re-r e s e n t ! t i o n 'e.1., bin!r;, -!c8 e d deci 2 !l, !l-h ! b e t i c, etc.) o6 the 6ield. The ter2 5i3e # te3 t < siC e N is se d in this s-eci6ic!tion to re6er to ! 6ield th!t 2 st be !ble to hold !n; strin1 o6 ch!r ! c t e r s o6 ! 6i+ed len1t h o6 N. <6 the strin1 it holds is short e r th! n N ch!r ! c t e r s , it 2 st be -!d d e d 0ith s-!c e s . The ter 2 ?aria b e te3 t < siC e N is se d in this s-eci6ic!tion to re6er to ! 6ield th!t 2 st be !bl e to hold !n; strin1 o6 ch!r ! c t e r s o6 ! v!ri!bl e len1t h 0ith ! 2!+i 2 2 len1t h o6 N. The 6ield 2 !; o-tion !ll; be i2-le 2 e n t e d !s Q6i+ed te+t, si:e NR. The ter 2 )at e is se d in this s-eci6ic!tion to re6er to ! 6ield th!t 2 st be !ble to hold !n; d!t e bet0 e e n 1st "!n !r; 1800 !nd 51st 7ece 2 b e r 2100 0ith ! resol tion o6 !t le!st one d!;. The ter2 )at e an # tim e is se d in this s-eci6ic!tion to re6er to ! 6ield th!t 2 st be !ble to hold !n; d!t e bet0 e e n 1st "!n !r ; 180 0 !nd 51st 7ece 2 b e r 210 0 0ith ! resol tion o6 !t le!st one seco n d . The ter 2 Curre n t #at e is se d in this s-eci6ic!tion to re6er to ! d!t e !nd ti2 e st! 2 - !s ret r n e d b; the o-er ! ti n 1 s;st e 2 . The ter 2 Nu m e r i c is se d in this s-eci6ic!tion to re6er to ! 6ield th!t 2 st be !ble to hold !n; n 2 e ri c v!l e. $ 6ield s-eci6ied !s Nu m e ri c < N #i gi t s 2 st be !ble to hold !n; N deci 2 !l di1its v!l e. $ 6ield s-eci6ied !s Nu m e r i c < (n< m ) #igi t s 2 st be !bl e to hold !n; n deci 2 !l di1its v!l e be6ore the deci 2 !l -oint !nd !n; 2 deci 2 !l di1its v!l e !6ter the deci 2 !l -oint. N 2 eric 6ields th!t cont !i n 2on e t ! r ; v!l e s 'N 2 e ric, 'n,2) di1its) 2 st se d!t ! t;-e s th!t 1ive e+ !ct re-r e s e n t ! t i o n to !t le!st the s2 !ll es t 2on e t ! r ; nit in the c rre n c ; bein1 se d. For e+ ! 2 -l e , #SB$@$N#A !nd #SKT7S&MT in %.S. doll!rs 2! ; be re-r e s e n t e d !s '12,2) di1it si1n e d deci 2 !l '0ith i2-licit sc!lin1), or sc!l e d to cent s in ! si1n e d inte 1 e r o6 !t le!st (1 bits, or sc!l e d to cent s in ! do bl e -recision '6( bit) ?A$@. The ter 2 Nu is se d in this s-eci6ic!tion to 2 e ! n o t o6 the r!n 1 e o6 v!lid v!l e s 6or ! 1iven d!t ! t ;- e !nd !l0!;s the s! 2 e v!l e. The ter2 2ma g e is se d in this s-eci6ic!tion to re6er to !n i2-le 2 e n t ! t i o n s-eci6ic 2 et h o d o6 storin1 !n i2! 1 e or ! -oint er to !n i2! 1 e store d else0 h e r e on the s;st e 2 nd er test.
1.2.2
1.2.5
1.2.(
1.2.5
1.2.6
1.2.,
1.2.8
1.2.9
1.2.10 The ter 2 ap p i c a t i o n pro g r a m is se d in this s-eci6ic!tion to re6er to code th!t is not -!rt o6 the co2 2 e r ci !ll; !v!il! bl e co2 - o n e n t s o6 the s;st e 2 , b t -rod c e d s-eci6ic!ll; to i2-le 2 e n t the 0eb inter ! c tio n s !nd the d!t ! b ! s e tr!n s ! c ti o n s de6in e d in this benc h 2 ! r 8. For e+ ! 2 -l e , store d -roc e d r e s , tri11er s, !nd re6er e n ti !l inte1rit; constr !i nt s !re consid er e d -!rt o6 the !--lic!tio n -ro1r ! 2 0he n se d to i2-le 2 e n t !n; -ortion o6 the 0eb inter ! c tio n s or d!t ! b ! s e tr!n s ! c ti o n s , b t !re not consid e r e d -!rt o6 the !--lic!tio n -ro1r ! 2 0he n solel; se d to en6orc e inte1rit; r les 'see #l! s e 1.,) or tr!n s - ! r e n c ; re9 ire 2 e n t s 'se e #l! s e 1.8) inde - e n d e n t l ; o6 !n; s-eci6ic 0eb inter ! c tion or d!t ! b ! s e tr!n s ! c ti o n.
T&# Bench2!r8I W
&!1e
+iii
The se o6 co2 2 e r ci !ll; !v!il! bl e -rod c t s is enco r ! 1 e d . <6 thes e -rod c t s !re se d, code, $&< c!lls !nd con6i1 r ! tio n 6iles th!t !re se d to control !nd/or 2! n ! 1 e the o-er ! ti o n o6 the co2 2 e r ci !l -rod c t s or !llo0 intero - e r ! bilit; bet0 e e n co2 2 e r ci !ll; !v!il!bl e -rod ct s !re not consid er e d -!rt o6 the $--lic!tion &ro1r! 2 . The code, $&< c!lls !nd con6i1 r ! tio n 6iles 2 st be !--lic! bl e to si2il!r Aco2 2 e r c e !--lic!tion s !nd not s-eci6ic to the T&#*W benc h 2 ! r 8 i2-le 2 e n t ! t i o n .
& ' 6 ) a t a b a s e En ti ti e s < R e a ti o n s $ i p s < a n # C$ ar a c t e ri s t i c s

1.5.1 The co2 - o n e n t s o6 the T&#*W d!t ! b ! s e !re de6in e d to consist o6 ! 2ini2 2 o6 ei1ht se- ! r ! t e !nd individ !l b!s e t!bl e s. The rel!tion s hi - s !2 o n 1 thes e t!bl es !re de6in e d in the entit;* rel!tion s hi - di!1r ! 2 sho0n belo0 !nd !re s bEec t to the r les s-eci6ied in #l! s e 1.5. $ b!s e t!bl e c!n not be i2-le 2 e n t e d !s ! vie0. Com m e n t A To en ! bl e co2 2 e r ci !l -rod ct s 'co2 2 e r c e or 2 erc h ! n t !--lic!tion s) to e+ ec t e the 0or8lo! d 0itho t e+t e n si v e 2odi6ic!tion s, ! s - e r s e t o6 the d!t ! b ! s e sch e 2 ! is !llo0e d. This co ld be in the 6or2 o6 !ddition !l t!bl e s. $ll s ch !dditions !nd/or 2odi6ic!tion s sho ld be 6 ll; disclos e d .
CUSTOMER
C_ID C_UNAME C_PASSWD C_FNAME C_LNAME C_ADDR_ID C_PHONE C_EMAIL C_SINCE C_LAST_VISIT C_LOGIN C_EXPIRATION C_DISCOUNT C_BALANCE C_YTD_PMT C_BIRTHDATE C_DATA
ORDERS
O_ID O_C_ID O_DATE O_SUB_TOTAL O_TAX O_TOTAL O_SHIP_TYPE O_SHIP_DATE O_BILL_ADDR_ID O_SHIP_ADDR_ID O_STATUS
ORDER_LINE
OL_ID OL_O_ID OL_I_ID OL_QTY OL_DISCOUNT OL_COMMENT
ITEM
I_ID I_TITLE I_A_ID I_PUB_DATE I_PUBLISHER I_SUBJECT I_DESC I_RELATED[1-5] I_THUMBNAIL I_IMAGE I_SRP I_COST I_AVAIL I_STOCK I_ISBN I_PAGE I_BACKING I_DIMENSION
CC_XACTS
CX_O_ID CX_TYPE CX_CC_NUM CX_CC_NAME CX_EXPIRY CX_AUTH_ID CX_XACT_AMT CX_XACT_DATE CX_CO_ID
ADDRESS
ADDR_ID ADDR_STREET1 ADDR_STREET2 ADDR_CITY ADDR_STATE ADDR_ZIP ADDR_CO_ID
COUNTRY
CO_ID CO_NAME CO_CURRENCY CO_EXCHANGE
AUTHOR
A_ID A_FNAME A_LNAME A_MNAME A_DOB A_BIO
cl1_erdiag
%eg e n # A
T&# Bench2!r8I W
&!1e
+iv
7ott e d lines re-r e s e n t one* to* one rel!tion s hi - s bet0 e e n non* 8e; 6ields rel!t e d thro 1 h ! b sin e s s r le. Thes e 6ields !re sho0n in it!lic. The !rro0s -oint in the direction o6 one* to* 2 ! n ; rel!tion s hi - s bet0 e e n t!bl e s. Bold t;- e s identi6; -ri2 !r; !nd 6orei1n 8e;s.
& ' 8 Ta b e %a * o u t s
The 6ollo0in1 lists de6in e the str ct r e 'list o6 6ields) o6 e!c h t!bl e. For e!c h t!bl e, the de6in e d 6ields c!n be i2-le 2 e n t e d in !n; order, sin1 !n; -h;sic !l re-r e s e n t ! t i o n !v!il! bl e 6ro2 the test e d s;st e 2 . Com m e n t . T!ble !nd col 2 n n! 2 e s !re 2! ; be se d b; the i2-le 2 e n t ! t i o n. &' 8 ' & 2TEM Tab e %a*o u t se d 6or ill str! tion - r-o s e s onl;G di66ere n t n! 2 e s
T&# Bench2!r8I W
&!1e
+v
5ie # Na m e <S<7 <ST<T@A <S$S<7 <S&%BS7$TA <S&%B@<SCA? <SS%B"A#T <S7AS# <S?A@$TA71 <S?A@$TA72 <S?A@$TA75 <S?A@$TA7( <S?A@$TA75 <STC%MBN$<@ <S<M$BA <SS?& <S#=ST <S$V$<@ <SST=#> <S<SBN <S&$BA <SB$#><NB <S7<MANS<=NS
5ie # )efi ni ti o n N 2 eric, 10 di1its V!ri!bl e te+t, si:e 60 N 2 eric, 10 di1its 7!te V!ri!bl e te+t, si:e 60 V!ri!bl e te+t, si:e 60 V!ri!bl e te+t, si:e 500 N 2 eric, 10 di1its N 2 eric, 10 di1its N 2 eric, 10 di1its N 2 eric, 10 di1its N 2 eric, 10 di1its <2!1 e <2!1 e N 2 eric, '15,2) di1its N 2 eric, '15,2) di1its 7!te N 2 eric, ( di1its Fi+ed te+t, si:e 15 N 2 eric, ( di1its V!ri!bl e te+t, si:e 15 V!ri!bl e te+t, si:e 25
Com m e n t s %ni9 e <7 o6 <te2 Title o6 <te2 $ thor <7 o6 <te2 7!te o6 rele ! s e o6 the -rod c t & blish e r o6 ite2 S bEect o6 Boo8 7escri-tion o6 <te2 %ni9 e <te2 <7 '<S<7) o6 rel!t e d ite2 %ni9 e <te2 <7 '<S<7) o6 rel!t e d ite2 %ni9 e <te2 <7 '<S<7) o6 rel!t e d ite2 %ni9 e <te2 <7 '<S<7) o6 rel!t e d ite2 %ni9 e <te2 <7 '<S<7) o6 rel!t e d ite2 Th 2 b n !il i2!1 e o6 <te2 or -oint er to th 2 b n ! il i2!1 e <te2 i2!1 e or -oint er to i2!1 e S 11 e s t e d ?et!il &rice #ost o6 <te2 When ite2 is !v!il!bl e D !ntit; in stoc8 &rod ct <SBN N 2 b e r o6 -!1 e s o6 boo8 T;-e o6 boo8, -!- e r or h!rd b!c8 Si:e o6 boo8 in inch e s
&ri2 !r; >e;. '<S<7) '<S$S<7) Forei1n >e;, re6er e n c e s '$S<7) &' 8 ' 4 C.9NTR7 Tab e %a*o u t 5ie # Na m e #=S<7 #=SN$MA #=SAJ#C$NBA #=S#%??AN#K &ri2 !r; >e;. '#=S<7) 5ie # )efi ni ti o n N 2 eric, ( di1its V!ri!bl e te+t, si:e 50 N 2 eric, '6, 6) di1its V!ri!bl e te+t, si:e 18 Com m e n t s %ni9 e #o ntr; <7 N!2 e o6 #o ntr; A+ch! n 1 e r!t e to %S 7oll!rs N!2 e o6 # rren c ;
T&# Bench2!r8I W
&!1e
+vi
&' 8 ' 6
A9TH.R Tab e %a*o u t 5ie # Na m e $S<7 $SFN$MA $S@N$MA $SMN$MA $S7=B $SB<= &ri2 !r; >e;. '$S<7) 5ie # )efi ni ti o n N 2 eric, 10 di1its V!ri!bl e te+t, si:e 20 V!ri!bl e te+t, si:e 20 V!ri!bl e te+t, si:e 20 7!te V!ri!bl e te+t, si:e 500 Com m e n t s %ni9 e $ thor <7 First N!2 e o6 $ thor @!st N!2 e o6 $ thor Middle N!2 e o6 $ thor 7!te o6 Birth o6 $ thor $bo t the $ thor
&' 8 ' 8
C9ST.MER Tab e %a*o u t 5ie # Na m e #S<7 #S%N$MA #S&$SSW7 #SFN$MA #S@N$MA #S$77?S<7 #S&C=NA #SAM$<@ #SS<N#A #S@$STSV<S<T #S@=B<N #SAJ&<?$T<=N #S7<S#=%NT #SB$@$N#A #SKT7S&MT #SB<?TC7$TA #S7$T$ 5ie # )efi ni ti o n N 2 eric, 10 di1its V!ri!bl e te+t, si:e 20 V!ri!bl e te+t, si:e 20 V!ri!bl e te+t, si:e 15 V!ri!bl e te+t, si:e 15 N 2 eric, 10 di1its V!ri!bl e te+t, si:e 16 V!ri!bl e te+t, si:e 50 7!te 7!te 7!te !nd ti2 e 7!te !nd ti2 e N 2 eric, '5,2) di1its Si1n n 2 e ric, '15,2) di1its N 2 eric, '15,2) di1its 7!te V!ri!bl e te+t, si:e 500 Com m e n t s %ni9 e <7 -er # sto 2 e r %ni9 e %ser N!2 e 6or # sto 2 e r %ser &!ss0or d 6or # sto 2 e r First n! 2 e o6 # sto 2 e r @!st n! 2 e o6 # sto 2 e r $ddre s s <7 o6 # sto 2 e r &hon e n 2 b e r o6 # sto 2 e r For sen di n 1 - rch ! s e con6ir2 ! tio n s 7!te o6 # sto 2 e r re1istr ! ti on 7!te o6 l!st visit St!rt o6 # rren t # sto 2 e r Sessio n # rre nt # sto 2 e r Session A+-ir; &erce n t ! 1 e disco n t 6or # sto 2 e r B!l!nc e o6 # sto 2 e r KT7 &!;2 e n t o6 # sto 2 e r Birth d!t e o6 # sto 2 e r Miscell!n e o s in6or2 ! tio n
&ri2 !r; >e;. '#S <7) '#S$77?S<7) Forei1n >e;, re6er e n c e s '$77?S<7)
T&# Bench2!r8I W
&!1e
+vii
&' 8 ' :
.R)ERS Tab e %a*o u t 5ie # Na m e =S<7 =S#S<7 =S7$TA =SS%BST=T$@ =ST$J =ST=T$@ =SSC<&STK&A =SSC<&S7$TA =SB<@@S$77?S<7 =SSC<&S$77?S<7 =SST$T%S 5ie # )efi ni ti o n N 2 eric, 10 di1its N 2 eric, 10 di1its 7!te !nd ti2 e N 2 eric, '15,2) di1its N 2 eric, '15,2) di1its N 2 eric, '15,2) di1its V!ri!bl e te+t, si:e 10 7!te !nd ti2 e N 2 eric, 10 di1its N 2 eric, 10 di1its V!ri!bl e te+t, si:e 15 Com m e n t s %ni9 e <7 -er order # sto 2 e r <7 o6 =rder =rder 7!te !nd ti2 e S bt ot !l o6 !ll order* line ite2 s T!+ over the s bt ot !l Tot!l 6or this order Metho d o6 deliver; =rder Shi- 7!t e $ddre s s <7 to bill $ddre s s <7 to shi- order =rder st!t s
&ri2 !r; >e;. '=S<7) '=S#S<7) Forei1n >e;, re6er e n c e s '#S<7)G '=SB<@@S$77?, =SSC<&S$77?) Forei1n >e;, re6er e n c e s '$77?S<7) &' 8 ' ; .R)ERD%2NE Tab e %a*o u t 5ie # Na m e =@S<7 =@S=S<7 =@S<S<7 =@SDTK =@S7<S#=%NT =@S#=MMANTS 5ie # )efi ni ti o n N 2 eric, 5 di1its N 2 eric, 10 di1its N 2 eric, 10 di1its N 2 eric, 5 di1its N 2 eric, '5,2) di1its V!ri!bl e te+t, si:e 100 Com m e n t s %ni9 e =rder @ine <te2 <7 =rder <7 o6 =rder @ine %ni9 e <te2 <7 '<S<7) D !ntit; o6 <te2 &erce n t ! 1 e disco n t o66 o6 <SS?& S-eci !l <nstr ction s
&ri2 !r; >e;. '=@S<7, =@S=S<7) '=@S<S<7) Forei1n >e;, re6er e n c e s '<S<7)G '=@S=S<7) Forei1n >e;, re6er e n c e s '=S<7)
T&# Bench2!r8I W
&!1e
+viii
&' 8 ' =
CCD@ACTS Tab e %a*o u t (Cre # i t Car# Tran s a c t i o n Tab e ) 5ie # Na m e #JS=S<7 #JSTK&A #JSN%M #JSN$MA #JSAJ&<?K #JS$%TCS<7 #JSJ$#TS$MT #JSJ$#TS7$TA #JS#=S<7 5ie # )efi ni ti o n N 2 eric, 10 di1its V!ri!bl e te+t, si:e 10 N 2 eric, 16 di1its V!ri!bl e te+t, si:e 51 7!te Fi+ed te+t, si:e 15 N 2 eric, '15,2) di1its 7!te !nd ti2 e N 2 eric, ( di1its Com m e n t s %ni9 e =rder <7 '=S<7) #redit c!rd t;- e #redit c!rd n 2 b e r N!2 e on credit c!rd A+-ir!tion d!t e o6 credit c!rd $ thori:!tion 6or tr!n s ! c ti o n !2 o n t $2o nt 6or this tr!n s ! c ti o n 7!te !nd ti2 e o6 ! t h ori: ! tion #o ntr; 0her e tr!n s ! c ti o n ori1in !t e d
&ri2 !r; >e;. '#JS=S<7) '#JS=S<7) Forei1n >e;, re6er e n c e s '=S<7)G '#JS#=S<7) Forei1n >e;, re6er e n c e s '#=S<7) &' 8 ' ( A))RES S Tab e %a*o u t 5ie # Na m e $77?S<7 $77?SST?AAT1 $77?SST?AAT2 $77?S#<TK $77?SST$TA $77?ST<& $77?S#=S<7 5ie # )efi ni ti o n N 2 eric, 10 di1its V!ri!bl e te+t, si:e (0 V!ri!bl e te+t, si:e (0 V!ri!bl e te+t, si:e 50 V!ri!bl e te+t, si:e 20 V!ri!bl e te+t, si:e 10 N 2 eric, ( di1its Com m e n t s %ni9 e !ddr e s s <7 Stre e t !ddr e s s , line 1 Stre e t !ddr e s s , line 2 N!2 e o6 cit; N!2 e o6 st!t e Ti- cod e or &ost !l code %ni9 e <7 o6 #o ntr;
&ri2 !r; >e;. '$77?S<7) '$77?S#=S<7) Forei1n >e;, re6er e n c e s '#=S<7)
& ' : W e b . bE e c t s < C$ ar a c t e ri s t i c s a n # R e a ti o n s $ i p " i t $ ) a t a b a s e

The 6ollo0in1 de6in e s the "&AB !nd B<F obEect s se d in this benc h 2 ! r 8 .
T&# Bench2!r8I W
&!1e
+i+
1.5.1
The i2!1 e co2 - o n e n t s o6 the T&#*W 0eb obEect s !re de6ine d to consist o6 i2!1 e s o6 v!r;in 1 si:es in "&AB 6or2 ! t . The c rre n tl ; de6ine d si:es !re. 5>, 10>, 50>, 100> !nd 250>B. The i2!1 e s !re 2e ! n t to re-r e s e n t d!t ! 6lo0 o6 di66ere n t 2 e di ! on the 0eb s ch !s i2!1 e s , ! dio, video* stre ! 2 , !ni 2 ! t e d B<F, etc. A!ch o6 the s e i2! 1 e s is 1en e r ! t e d sin1 the T&#*W <2!1 e Ben er ! t o r '!v!il!bl e on the T&# 0eb site). The tot !l n 2 b e r o6 ni9 e i2! 1 e s 1en e r ! t e d is e9 !l to the c!rdin !lit; o6 the <TAM t!ble to re-r e s e n t e!c h ite2Ls i2!1 e !nd other rich 2 e di ! on the site 'se e #l! s e (.6). The distrib tion 6or the di66ere n t i2! 1 e si:es 6ollo0s. 5> i2!1 e s 10> i2!1 e s 50> i2!1 e s 100> i2!1 e s 250> i2!1 e s (5P 55P 15P (P 1P
1.5.2
A!ch ite2 6ro2 the <TAM t!bl e !lso h!s ! th 2 b n ! il i2! 1 e , <STC%MBN$<@, o6 5 >*b;t e s !ssoci !t e d 0ith it. Thes e i2!1 e s !re !lso 1en e r ! t e d sin1 the T&#*W <2!1 e Ben er ! t o r. The store* 6ront h!s -red e t e r 2 i n e d B<F i2! 1 e s 6or n!vi1! tio n. This incl d e s the b tto n s s ch !s thos e 6or UCo 2 e V , US e ! r c h V , US h o - -i n 1 #!rt V, !nd U# h e c8 o t V . The i2-le 2 e n t ! t i o n o6 the benc h 2 ! r 8 2 st se the b tto n i2! 1 e s th!t !re -!rt o6 the T&#*W s! 2 -l e 0eb -!1 e s on the T&#*W 0ebsit e.
1.5.5
& ' ; 2m p e m e n t a t i o n R u e s
1.6.1 1.6.2 The -h;sic !l cl st erin 1 o6 record s 0ithin the d!t ! b ! s e is !llo0e d. $ll t!ble s 2 st h!v e the -ro- erl ; sc!l e d -o- l ! tion re9 ir e 2 e n t s 'se e #l! s e (.5). n 2ber o6 ro0s !s de6in e d b; the d!t ! b ! s e
1.6.5
Cori:ont !l -!rtitionin 1 o6 t!ble s is !llo0e d. Bro - s o6 ro0s 6ro2 ! t!ble 2! ; be !ssi1n e d to di66ere n t 6iles, dis8s, or !re ! s . <6 i2-le 2 e n t e d , the det !ils o6 s ch -!rtitionin 1 2 st be disclos e d. Vertic!l -!rtitionin 1 o6 t!bl e s is !llo0e d. Bro - s o6 6ields 'col 2 n s) o6 one t!bl e 2 !; be !ssi1n e d to 6iles, dis8s, or !re ! s di66ere n t 6ro2 thos e storin1 the oth er 6ields o6 th!t t!bl e. <6 i2-le 2 e n t e d , the det !ils o6 s ch -!rtitionin 1 2 st be disclos e d 'se e #l! s e 1., 6or li2it!tion s). ?e-lic!tion is !llo0e d 6or !ll t!ble s. M!ni- l !tion o6 d!t ! in !ll co-ie s o6 t!bl e s 0hich !re re-lic!t e d 2 st 2e e t !ll re9 ir e 2 e n t s 6or !to 2icit;, consist e n c ;, !nd isol!tion !s de6in e d in #l! s e 5. <6 i2-le 2 e n t e d , the det !ils o6 s ch re-lic!tion 2 st be disclos e d . Com m e n t . =nl; one co-; o6 ! re-lic!t e d t!bl e nee d s to 2 e e t the d r! bilit; re9 ir e 2 e n t s de6ine d in #l! s e 5.
1.6.(
1.6.5
T&# Bench2!r8I W
&!1e
++
1.6.6
Fields 2! ; not be !dd e d !nd/or d -lic!t e d 6ro2 one t!bl e to !not h e r. Fields 2 !; not be d -lic!t e d 6ro2 one t!bl e into !n; o6 the oth er t!ble s de6in e d in 1.(. This does not -recl d e the se o6 vie0s, te2 - o r ! r ; t!bl e s or -er 2 ! n e n t t!bl e s 0hich do co2 bi n e 6ields 6ro2 2 lti-l e t!bl e s. Co0ev e r thes e !re don e, the; 2 st 2 e e t the $#<7 re9 ire 2 e n t s . The !--lic!tion 2 st 2!int !i n the ori1in !l t!bl e s !s s-eci6ied in #l! s e 1.(. A!ch 6ield, !s describ e d in #l! s e 1.(, 2 st be lo1ic!ll; discr et e !nd inde - e n d e n t l ; !cc e s si bl e b; the d!t ! 2! n ! 1 e r . For e+! 2 -l e, $SFN$MA, $SMN$MA !nd $S@N$MA c!n n o t be i2-le 2 e n t e d !s thre e s b* -!rt s o6 ! discr et e !ttrib t e $SN$MA. A!ch 6ield, !s describ e d in #l! s e 1.(, 2 st be !cce s si bl e b; the d!t ! 2 ! n ! 1 e r !s ! sin1l e 6ield. For e+! 2 -l e, #S7$T$ c!nn o t be i2-le 2 e n t e d !s t0o discr et e 6ields #S7$T$S1 !nd #S7$T$S2. Com m e n t A The 6ollo0in1 6ields !re e+ce - tio n s to d!t e v!l e 'i.e., #S@=B<N, #SAJ&<?$T<=N, =S7$TA, i2-le 2 e n t e d !s ! co2 bi n ! ti o n o6 t0o 6ields. ! -!rtitionin 1 c!n be de6ine d bet0 e e n the t0o 6ields this cl! s e . $ll 6ields holdin1 ! ti2 e* !nd* =SSC<&S7$TA !nd #JSJ$#TS7$TA) c!n be d!t e 6ield !nd ! ti2 e 6ield. No vertic!l se d to i2-le 2 e n t it.
1.6.,
1.6.8
1.6.9
The -ri2 !r ; 8e; o6 e!c h t!bl e 2 st not directl; re-r e s e n t the -h;sic !l dis8 !ddr e s s e s o6 the ro0 or !n; o66set s ther e o6. The !--lic!tion 2 !; not re6er e n c e ro0s sin1 rel!tive !ddr e s si n 1 since the; !re si2-l; o66set s 6ro2 the be1in ni n 1 o6 the stor! 1 e s-!c e. This does not -recl d e h!s hi n 1 sch e 2 e s or oth er 6ile or1! ni: ! tio n s 0hich h!v e -rovision s 6or !ddin 1, deletin 1, !nd 2odi6;in 1 record s in the ordin !r; co rs e o6 -roc e s si n 1. Com m e n t & . <t is the inten t o6 this cl! s e th!t the !--lic!tion -ro1r ! 2 'se e #l! s e 1.2.10) e+ ec ti n 1 the d!t ! b ! s e tr!n s ! c ti o n, or s b 2i ttin 1 the d!t ! b ! s e tr!n s ! c ti o n re9 e s t , not se -h;sic !l identi6iers, b t lo1ic!l identi6iers 6or !ll !cc e s s e s , !nd cont !i n no ser 0ritte n cod e 0hich tr!n sl !t e s or !ids in the tr!n sl !ti on o6 ! lo1ic!l 8e; to the loc!tion 0ithin the t!ble o6 the !ssoci !t e d ro0 or ro0s. For e+ ! 2 -l e , it is not le1iti2 ! t e 6or the !--lic!tio n to b ild ! Ntr!n sl !ti on t!bl eN o6 lo1ic!l* to* -h;sic !l !ddr e s s e s !nd se it to enh ! n c e -er6or 2 ! n c e . Com m e n t 4 . <ntern !l record or ro0 identi6iers, 6or e+ ! 2 -l e , t -le <7s or c rsors, 2 !; be se d nd er the condition th!t 0ithin e!c h d!t ! b ! s e tr!n s ! c ti o n, initi!l !cc e s s to !n; ro0 2 st be vi! ! lo1ic!l 8e; co2 -ris e d onl; o6 6ields 6ro2 th!t ro0. <niti!l !cc e s s incl d e s insertion, deletion, retriev !l, !nd -d ! t e o6 !n; ro0.
T&# Bench2!r8I W
&!1e
++i
1.6.10 <n the c!s e 0her e 0eb obEect s !re stor e d o tsid e o6 the <TAM t!bl e !nd re6er e n c e d in the <TAM t!bl e b; ! -oint er 2 ! n ! 1 e d b; the !--lic!tion -ro1r ! 2 'se e #l! s e 1.2.10), th!t -oint er 2 st not directl; re-r e s e n t the -h;sic !l dis8 !ddr e s s e s o6 the obEect or !n; o66set s ther e o6. The !--lic!tion 2! ; not re6er e n c e obEect s sin1 rel!tive !ddr e s si n 1 since the; !re si2-l; o66set s 6ro2 the be1in ni n 1 o6 the stor ! 1 e s-!c e. This doe s not -recl d e h!s hi n 1 sch e 2 e s or other 6ile or1! ni: ! ti on s 0hich h!v e -rovision s 6or !ddi n 1, deletin 1, !nd 2odi6;in1 obEect s in the ordin !r; co rs e o6 -roc e s si n 1. 1.6.11 While insert s !nd del et e s !re not -er6or 2 e d on !ll t!bl e s, the s;st e 2 2 st not be con6i1 r e d to t!8e s-eci !l !dv ! n t ! 1 e o6 this 6!ct d rin1 the test. $ltho 1 h insert s !re inher e n tl ; li2ite d b; the stor! 1 e s-!c e !v!il! bl e on the con6i1 r e d s;st e 2 , ther e 2 st be no restriction on insertin 1 in !n; o6 the t!bl e s ! 2ini2 2 n 2 b e r o6 ro0s e9 !l to 5P o6 the t!bl e c!rdin !lit; !nd 0ith ! 8e; v!l e o6 !t le!st do bl e the r!n 1 e o6 8e; v!l e s -res e n t in th!t t!bl e. Com m e n t A <t is re9 ire d th!t the s-!c e 6or the !ddition !l 5P t!bl e c!rdin !lit; be con6i1 r e d 6or the Test ? n 'se e cl! s e 5.5.1.1) !nd -riced !ccor din 1l;. <6 ! co2 2 e r ci !l -rod c t is se d 6or the !--lic!tio n 0hich re9 ire s ! s - er s e t o6 the d!t ! b ! s e sch e 2 ! , the n the s-!c e con6i1 r e d !nd -riced sho l d incl d e the !ddition !l stor ! 1 e ne e d e d 6or the !ddition !l t!ble s !nd/ or 6ields. For s;st e 2 s 0her e s-!c e is con6i1 r e d !nd d;n ! 2 i c !ll; !lloc!t e d !t ! l!ter ti2 e, this s-!c e 2 st be consid e r e d !s !lloc!t e d !nd incl d e d in the -riced s;st e 2 'se e #l! s e (.(). 1.6.12 The 2ini2 2 deci 2 !l -recision 6or !n; co2 - t ! t i o n -er6or 2 e d !s -!rt o6 the !--lic!tio n -ro1r ! 2 'se e #l! s e 1.2.10) 2 st be the 2 !+i 2 2 deci 2 !l -recision o6 !ll the individ !l ite2 s in th!t c!lc l !tio n. The !--lic!tion code 2 st h!n dl e the entire r!n1 e o6 v!l e s !s de6in e d in cl! s e 1.(.
& ' = 2n t e g ri t * R u e s
1.,.1 <n !n; co2 2i tt e d st!t e, the -ri2 !r; 8e; v!l e s 2 st be ni9 e 0ithin e!c h t!bl e. For e+! 2 -l e, in the c!s e o6 ! hori:ont !ll; -!rtition e d t!bl e, -ri2 !r ; 8e; v!l e s o6 ro0s !cros s !ll -!rtitions 2 st be ni9 e .
& ' ( ) a t a A c c e s s Tra n s p a r e n c * R e B u ir e m e n t s

7!t ! !cc e s s tr!ns - ! r e n c ; is the -ro- e rt ; -ro1r ! 2 !n; 8no0le d 1 e o6 the loc!tion i2-le 2 e n t ! t i o n 0hich se s vertic!l re9 ir e 2 e n t s 6or tr!ns - ! r e n t d!t ! !cc e s s o6 the s;st e 2 0hich re2 ov e s 6ro2 the !--lic!tio n !nd !cc e s s 2ec h ! ni s 2 s o6 -!rtition e d d!t !. $n !nd/or hori:ont !l -!rtitionin 1 2 st 2e e t the describ e d her e.
No 6inite serie s o6 test s c!n -rov e th!t the s;st e 2 s - - ort s co2 -l et e d!t ! !cc e s s tr!ns - ! r e n c ;. The re9 ire 2 e n t s belo0 describ e the 2ini 2 2 c!- ! bilities nee d e d to est ! blish th!t the s;st e 2 -rovid e s tr!ns - ! r e n t d!t ! !cc e s s. Com m e n t . The inte nt o6 this cl! s e is to re9 ir e th!t !cc e s s to -h;sic !ll; !nd/ or lo1ic!ll; -!rtition e d d!t ! be -rovid e d directl; !nd tr!ns - ! r e n t l ; b; servic e s i2-le 2 e n t e d b; co2 2 e r ci !ll; !v!il! bl e l!;er s belo0 the !--lic!tion -ro1r ! 2 s ch !s the d!t !/6ile 2! n ! 1 e r '7BMS), the o-er ! ti n 1 s;st e 2 , the h!rd0 ! r e , or !n; co2 bi n ! ti o n o6 the s e .
T&# Bench2!r8I W
&!1e
++ii
1.8.1
$ll t!bl e s se d b; the !--lic!tio n 2 st be identi6ied b; n! 2 e s 0hich h!v e no rel!tion s hi - to the -!rtitionin 1 o6 t!bl es. $ll d!t ! 2 ! ni - l ! ti on o-er ! ti o n s in the !--lic!tio n -ro1r ! 2 'see #l! s e 1.2.10) 2 st se onl; thes e n! 2 e s . The s;st e 2 2 st -rev e n t !n; d!t ! 2 ! ni - l ! tio n o-er ! tio n -er6or 2 e d sin1 the n! 2 e s describ e d in #l! s e 1.8.1 0hich 0o ld res lt in ! viol!tion o6 the inte1rit; r les 'see #l! s e 1.6). %sin1 the n! 2 e s 0hich s!tis6; #l! s e 1.8.1, !n; !rbitr!r; non* T&#*W !--lic!tio n 2 st be !bl e to 2 ! ni - l ! t e !n; set o6 ro0s or col 2 n s. <denti6i!bl e b; !n; !rbitr!r ; condition s - - ort e d b; the %sin1 the n! 2 e s describ e d in #l! s e se 2 ! n t i c s !nd s;nt ! + 6or !ll t!bl es. 1.8.1 !nd nd erl ;in 1 7BMS d!t ! 2 ! ni - l ! ti on
1.8.2
1.8.5
sin1 the s! 2 e
For e+! 2 -l e, the se 2 ! n t i c s !nd s;nt !+ se d to -d ! t e !n !rbitr!r; set o6 ro0s in !n; one t!bl e 2 st !lso be s! bl e 0hen -d ! ti n 1 !not h e r !rbitr!r; set o6 ro0s in !n; other t!bl e. Com m e n t . The inte nt is th!t the T&#*W !--lic!tio n 2ec h ! ni s 2 s to 2! ni - l ! t e d!t ! in the d!t ! b ! s e . -ro1r ! 2 se s 1en e r !l - r-o s e
T&# Bench2!r8I W
&!1e
++iii
C a u s e 4 , WEB 2NTERACT2.N S AN ) W.RK%.A) PR.52%E
4 ' & ) e f i ni ti o n o f Ter m s

2.1.1 The ter 2 9s er is se d in this s-eci6ic!tion to re6er to !n entit; ' s !ll; ! h 2 ! n G co ld be ! so6t0!r e -ro1r ! 2 ) th!t co2 2 ni c ! t e s 0ith the S;st e 2 %nder Test 'S%T, de6in e d in cl! s e 6.5) vi! ! Bro0ser. The ter2 ent eri n 1 "&AB), ! 6!cilit!t e Tr!ns6 er Bro " s e r !s se d in this s-eci6ic!tion re6ers to the inter6! c e devic e c!- ! bl e o6 !nd dis-l! ;in 1 CTT& V 1.0, CTT& V1.1, CTM@ V 5.0, "!v!Scri-t, "!v!, i2!1 e s 'B<F W dio !nd 2ovie stre ! 2 s vi! T#&/<&. $ bro0s e r is de6in e d !s the co2 - o n e n t s th!t %ser in- t !nd the dis-l !; o6 the o t - t -!1 e s !s de6in e d in #l! s e 2. C;-ert e + t &rotocol 1.1 'CTT& 1.1), !s de6ine d in ?F# 2068 htt-.//000.iet6.or1/r6c/r6c2 0 6 8 . t + t
2.1.2
2.1.5
The ter 2 Emu a t e # Bro " s e r ' EB ) is se d in this s-eci6ic!tion to re6er to the entit; 'e.1., ! -roc e s s or ! thre ! d ) th!t e2 l ! t e s ! ser co2 2 ni c ! ti n 1 vi! ! Bro0s er b; sen di n 1 !nd rec eivin 1 CTM@ cont e n t vi! CTT& !nd T#&/<& over ! net0or8 conn e c tio n 'e.1., ! soc8e t) to the S%T. The ter2 " e b int er a c t i o n is se d in this s-eci6ic!tion to re6er to ! co2 -l e t e c;cle o6 co2 2 ni c ! ti o n bet0 e e n the AB !nd the S%T. This c;cle st!rt s 0he n the AB select s ! n!vi1 ! ti o n o-tion 6ro2 the -revio sl ; dis-l !;e d 0eb -!1 e or 0he n re9 e s t i n 1 the Co2 e &!1e 6or the 6irst ti2 e. <t incl d e s one or 2or e e+ch ! n 1 e s o6 2 es s ! 1 e s bet0 e e n the S%T !nd the AB. Thes e e+ch ! n 1 e s 2! ; incl d e the re9 e s t !nd co2 2 ni c ! ti o n o6 coo8ies, CTM@ -!1 e s , i2!1 e 6iles or other 0eb obEect s. The n 2 b e r !nd t;- e s o6 s ch e+ch ! n 1 e s !re benc h 2 ! r 8 i2-le 2 e n t ! t i o n s-eci6ic. The c;cle !lso incl d e s so2 e -roc e s si n 1 to t!8e -l!c e on the S%T. The c;cle is co2 -l et e d 0he n the l!st b;t e o6 d!t ! 6ro2 the res- o n s e -!1 e , incl din1 !ll re6er e n c e d e2 b e d d e d obEect s, h!s bee n rec eiv e d b; the AB. The ter 2 9s er S e s s i o n is se d in this s-eci6ic!tion to re6er to ! contin o s -eriod o6 ti2 e d rin1 0hich !n AB re9 e s t s one or 2ore 0eb inter ! c ti on s, st!rtin 1 0ith the Co2 e 0eb inter ! c tio n !nd endi n 1 !s de6ine d in cl! s e 6.2. The ter 2 Cust o m e r is se d in this s-eci6ic!tion to re6er to ! %ser 0hos e identit ; h!s bee n record e d b; the S%T in the #%ST=MA? t!ble. The ter 2 S$ o p p i n g S e s s i o n is se d in this s-eci6ic!tion to re6er to ! contin o s -eriod o6 ti2 e d rin1 0hich !n AB re9 e s t s one or 2or e 0eb inter ! c ti on s, st!rtin 1 !s e!rl; !s 0he n it 6irst re9 e s t s the Co2 e 0eb inter ! c tio n !nd no l!ter th! n 0he n it re9 e s t s the Sho--i n 1 #!rt 0eb inter ! c tio n 6or the 6irst ti2 e. Com m e n t . The in6or2 ! tio n re9 ir e d to be !ble to identi6; i6 the %ser re9 e s ti n 1 the 0eb inter ! c ti on h!s !n !ctive Sho- -i n 1 Session 2 st be co2 2 ni c ! t e d b; the AB to the S%T d rin1 e!c h 0eb inter ! c ti on 'see #l! s e 2.2.5).
2.1.(
2.1.5
2.1.6
2.1.,
T&# Bench2!r8I W
&!1e
++iv
2.1.8
The ter 2 Web %og g i n g is $ccess @o1.
se d in this s-eci6ic!tion to re6er to entrie s in the Web Server
2.1.9
The ter 2 #at a b a s e tran s a c t i o n !s se d in this s-eci6ic!tion re6ers to one or 2ore o-er ! ti o n s th!t res lt in ! nit o6 0or8 on the d!t ! b ! s e 0ith 6 ll $#<7 -ro- e rti e s !s describ e d in #l! s e 5. $ 0eb inter ! c tio n 2! ; be co2 -ri s e d o6 one or 2or e d!t ! b ! s e tr!n s ! c ti o n s . When ! d!t ! b ! s e tr!n s ! c ti o n incl d e s 2or e th! n one o-er ! tio n, the set o6 o-er ! ti o n s is enclos e d bet0 e e n the t!1s Us t ! r t tr!ns ! c ti o n V !nd Uend tr!ns ! c ti o n V . The order o6 the d!t ! 2 ! ni - l ! tio n s 0ithin the tr!ns ! c ti o n bo n d s is i22 ! t e ri !l, nles s other0is e s-eci6ied, !nd is le6t to the l!tit d e o6 the test s-on s or, !s lon1 !s the i2-le 2 e n t e d tr!n s ! c ti o n s !re 6 nction !ll; e9 iv !l e n t to thos e s-eci6ied in the tr!n s ! c ti o n -ro6iles.
2.1.10 The ter2 at o m i c s e t of op e r a t i o n s is se d in this s-eci6ic!tion to re6er to ! set o6 o-er ! tio n s th!t res lts in d!t ! -d ! t e s '!ddition, deletion, 2odi6ic!tion) 0ithin the S%T !nd h!s the -ro- e rt ; to 1 !r ! n t e e th!t eith er !ll -d ! t e s 0ill be co2 -l et e d G or th!t non e o6 the -d ! t e s 0ill be co2 -l et e d , le!vin1 !ll t!r1 e t e d d!t ! nch ! n 1 e d . When de6ine d !s !to 2ic, ! set o6 o-er ! ti o n s is enclos e d bet0 e e n the t!1s U st ! r t !to 2i c set V !nd U e n d !to 2i c set V . The order o6 the 6 nction s 0ithin the set bo n d s is i22 ! t e ri !l, nles s other0is e s-eci6ied, !nd is le6t to the test s-on s or, !s lon1 !s the i2-le 2 e n t ! t i o n is 6 nction !ll; e9 iv!l e n t to thos e s-eci6ied in the inter ! c tion. 2.1.11 The ter2 ob t ai n e # is se d in this s-eci6ic!tion to re6er to the !ction o6 retrievin 1 the c rre n t v!l e o6 ! 1iven 6ield 6ro2 0ithin the S%T. The loc!tion 0ithin the S%T 6ro2 0hich the v!l e is retriev e d , s ch !s d!t ! b ! s e , c!ch e , or oth er, is not s-eci6ied !nd is onl; constr !i n e d b; the 0eb inter ! c tio n de6inition s !nd b; the $#<7 re9 ir e 2 e n t s . 2.1.12 The ter2 ran # o m * s e e c t e # "it $i n F3'' *G 2 e ! n s inde - e n d e n t l ; select e d !t r!nd o 2 !nd ni6or2l ; distrib t e d bet0 e e n + !nd ;, incl siv el;, 0ith ! 2e ! n o6 '+ X;)/ 2, !nd 0ith the s! 2 e n 2 b e r o6 di1its o6 -recision !s sho0n. For e+! 2 -l e, Y0.01 .. 100.0 0Z h!s 10,0 0 0 ni9 e v!l e s, 0her e ! s Y1 ..100Z h!s onl; 100 ni9 e v!l e s. 2.1.15 The ter2 non , unif or m ran # o m fun c ti o n (N9Ra n # ) is se d in this s-eci6ic!tion to re6er to the 6 nction se d 6or 1en e r ! t i n 1 #S<7 !nd the t!r1e t s 6or the Se!rc h ?e9 e s t 0eb inter ! c tio n s. This 6 nction 1en e r ! t e s !n inde - e n d e n t l ; select e d !nd non* ni6or 2l; distrib t e d r!nd o 2 n 2 b e r over the s-eci6ied r!n1 e o6 v!l e s Y x .. y Z, !nd is s-eci6ied !s 6ollo0s. N%?!nd'$, +, ;) [ ''r!nd o 2 ' 0 , $) \ r!nd o 2 '+ , ;)) P '; * + X 1)) X + Where. e+-r1 \ e+-r2 st! n d s 6or the bit0ise lo1ic!l =? o-er ! tio n bet0 e e n e+-r1 !nd e+-r2 e+-r1 P e+-r2 st! n d s 6or e+-r1 2od l o e+-r2 r!nd o 2 '+ , ;) st! n d s 6or r!ndo 2 l ; select e d 0ithin Y x .. y Z $ is ! const ! n t chos e n !ccor din 1 to the si:e o6 the r!n1 e Y+ .. ;Z
T&# Bench2!r8I W
&!1e
++v
4 ' 4 2m p e m e n t a t i o n R u e s
2.2.1 $ 0eb inter ! c tion c!n be eith er n-rot e c t e d co2 2 ni c ! ti o n s bet0 e e n the AB !nd the S%T SS@ version 5, or 0ith T@S '?F#22( 6), sin1 s it e. The -riv!t e 8e; 6or the serv er di1it !l descri-tion o6 the ci-her s ite c!n be 6o nd !t. or sec r e . <n sec r e 0eb inter ! c tio n s !ll 2 st be encr;- t e d !nd co2 2 ni c ! t e d 0ith SS@S?S$SW<TCS?#(S128SM75 !s the ci-h er certi6ic!t e 2 st be !t le!st 102 ( bits. $
htt-.//000.h o 2 e . n e t s c ! - e . c o 2 / e n 1 / s s 1 5 / (* $&&N.CTM]# &le!s e re6er to $--en di+ <. 2.2.2 A!ch %ser Sessio n 0hich re9 ir e s one or 2or e sec r e inter ! c ti on s 2 st est ! blish its o0n SS@ sessio n !nd e+ec t e ! 6 ll h!n d s h ! 8 e . SS@ ses sion s 2 st not be sh!r e d b; 2 lti-l e %ser Sessio n s. When st!rtin1 ! ne0 %ser Session, the AB 2 st e2 l !t e one o6 the 6ollo0in1 t0o sce n ! ri o s. 1. 2. S b 2it ! re9 e s t 6ro2 ! %ser th!t is not ! # sto 2 e r . This sce n ! ri o is chos e n b; the AB 20P o6 the ti2 e. $t so2 e -oint, the %ser 2 !; beco 2 e ! # sto 2 e r. S b 2it ! re9 e s t 6ro2 ! # sto 2 e r !nd -rovid e its # sto 2 e r identi6ic!tio n to the S%T. This sce n ! ri o is chos e n b; the AB 80P o6 the ti2 e. The # sto 2 e r identi6ic!tion '#S<7) o6 the ret r nin 1 # sto 2 e r is chos e n !s s-eci6ied in cl! s e 2.5.2.
2.2.5
Com m e n t & . S b 2ittin 1 ! re9 e s t 6ro2 ! # sto 2 e r 0ho does not -rovid e its # sto 2 e r identi6ic!tion to the S%T b t, !t so2 e l!ter ti2 e, identi6ies itsel6 !s ! # sto 2 e r is ! sce n ! ri o th!t is e+cl d e d 6ro2 the benc h 2 ! r 8 . This sce n ! rio, 0hile re!listic, 0o ld incre ! s e the level o6 co2 -l e +it ; 0itho t !ddin 1 si1ni6ic!n t v!l e to the 0or8lo! d. Com m e n t 4 . <t is -ossi bl e 6or ! %ser to -er6or 2 ! %ser Session 0itho t ever identi6;in1 itsel6 !s ! 8no0n # sto 2 e r or 0itho t ever beco 2i n 1 ! ne0 # sto 2 e r. 2.2.( $ll # sto 2 e r s 2 st identi6; the 2 s el v e s !t the be1in ni n 1 o6 their %ser Sessio n b; co2 2 ni c ! ti n 1 their #S<7, or !n; oth er ni9 e identi6ier !llo0in1 the S%T to obt !i n their #S<7, d rin1 the 6irst Co2 e 0eb inter ! c tio n. Com m e n t . #o2 2 ni c ! ti n 1 ! # sto 2 e r identi6ic!tio n to the S%T c!n be i2-le 2 e n t e d b; v!rio s 2et h o d s incl din1, b t not li2ite d to, the -!s si n 1 o6 ! 6ield in the CTT& re9 e s t , or the se o6 ! coo8ie. The ni9 e c sto 2 e r identi6ier is the onl; in6or2 ! tio n !bo t the # sto 2 e rLs identit ; th!t c!n be co2 2 ni c ! t e d b; the # sto 2 e r 6or the - r-o s e o6 identi6ic!tion. There !re no !ddition !l restriction s -l!c e d on 6or2 ! t !nd cont e n t o6 the CTT& 6ield or o6 the coo8ie or on other 2 ec h ! n i s 2 se d 6or th!t - r-o s e . 2.2.5 The S%T 2! ; choos e to tr!c8 !ll %ser Sessio n s sin1 ! ni9 e SC=&&<NBS<7. =nce ! %ser Sessio n beco 2 e s ! Sho- -i n 1 Session, the S%T 2 st tr!c8 it sin1 ! ni9 e SC=&&<NBS<7 !nd !n !sso ci ! t e d #$?T. The Sho--i n 1 Session 2 st be 2!int !i n e d b; the S%T 6or !t le!st t0o ho rs !6ter the l!ter o6. '$) the cre !ti on o6 the #$?T or 'B) the l!st -d ! t e to the #$?T. #$?T is de6in e d in cl! s e 2.2.6. Com m e n t A B!tt er ; b!c8 e d - 2 e 2 o r ; 0ith !t le!st 2 ho r ret e n ti o n is s 66icient to 2e e t this re9 ir e 2 e n t -rovidin1 !ll other re9 ire 2 e n t s d r! bl e 2e di 2 !re 2et.
T&# Bench2!r8I W
&!1e
++vi
2.2.6
For e!c h Sho--i n 1 Session, the S%T 2 st 2 !int !i n !n individ !l #$?T d!t ! str ct r e th!t re-re s e n t s the %serLs sho- -i n 1 c!rt. This #$?T is !sso ci ! t e d 0ith the ni9 e SC=&&<NBS<7 !ssi1n e d b; the S%T to the Sho--i n 1 Session. $t 2ini 2 2 , the #$?T 2 st be !ble to 2 !int !i n the 6ollo0in1 in6or2 ! ti o n. S#SSC=&&<NBS<7 S#S#S<7 S#S7$TA S#SS%BST=T$@ S#ST$J S#SSC<&S#=ST S#ST=T$@ S#S#SFN$MA S#S#S@N$MA S#S#S7<S#=%NT %ni9 e identi6ier o6 the Sho- -i n 1 Sessio n The #S<7 o6 the # sto 2 e r The d!t e !nd ti2 e 0hen the #$?T 0!s l!st -d ! t e d
The 1ross tot !l !2 o n t o6 !ll ite2 s in the #$?T The t!+ b!s e d on the 1ross tot!l !2 o n t The tot !l shi--in 1 !nd h!n dlin1 ch!r1 e s The tot !l !2 o n t o6 the order #SFN$MA o6 the # sto 2 e r #S@N$MA o6 the # sto 2 e r #S7<S#=%NT o6 the # sto 2 e r
$ 2ini2 2 o6 100 ite2 s 0ith. S#@S<S<7 The <S<7 6or the ite2 in the #$?T S#@SDTK S#@S#=ST S#@SS?& S#@ST<T@A S#@SB$#><NB The 9 ! n tit ; 6or the ite2 in the #$?T The cost o6 the ite2 in the #$?T The list -rice 6or the ite2 in the #$?T The title o6 the ite2 in the #$?T The b!c8in1 o6 the ite2 in the #$?T
The -h;sic !l i2-le 2 e n t ! t i o n o6 the #$?T is not s-eci6ied !s lon1 !s it s -- ort s the !bov e lo1ic!l re-r e s e n t ! t i o n, th!t it is 2 !int !i n e d b; the S%T thro 1 h the d r!tion o6 the Sho- -i n 1 Session !nd th!t it is 8e-t d r! bl e over !n; sin1le -oint o6 6!il re 'se e #l! s e 5.1.5.5). The i2-le 2 e n t ! t i o n !nd se o6 the #$?T is not consid er e d to be c!chi n 1.
T&# Bench2!r8I W
&!1e ++vii
2.2.,
The S%T 2! ; choos e to tr!c8 !ll # sto 2 e r s sin1 their #S<7. =nce ! # sto 2 e r h!s be e n identi6ied !s the o0n er o6 ! Sho- -i n 1 Session, its identit ; 2 st be 2 !int !i n e d 0ithin the #$?T !sso ci ! t e d 0ith th!t Sho--i n 1 Sessio n. The cl! s e s titled 2npu t ReB uir e m e n t s de6in e the 2ini 2 2 set o6 d!t ! re9 ir e d b; the S%T !s in- t to ! 0eb inter ! c tio n. Si2il!rl;, the cl! s e titled N!vi1! tion =-tions de6ine the 2ini2 2 set o6 d!t ! to be -rovid e d b; the AB !s in- t to ! 0eb inter ! c tion. The i2-le 2 e n t ! t i o n 2 !; choos e to ! 1 2 e n t thes e 2ini 2 2 set s o6 in- t d!t ! -rovid e d th!t it doe s not red c e the 0or8lo! d on the S%T !nd doe s not i2-rov e -er6or 2 ! n c e . The cl! s e s titled Pro c e s s i n g )efi ni ti o n de6ine the b sin e s s lo1ic th!t 2 st be e+ ec t e d b; the S%T !s -!rt o6 the inter ! c tio n.
2.2.8
2.2.9
2.2.10 The cl! s e s titled Re s p o n s e Pa g e )efi ni ti o n incl d e ! s! 2 -l e o6 e!c h res- o n s e -!1 e !nd ! set o6 2ini 2 2 re9 ire 2 e n t s 6or the CTM@ code -rod c e d b; the S%T 6or th!t res- o n s e -!1 e . <n !ddition to the s e -!1 e s-eci6ic re9 ir e 2 e n t s , !ll res-o n s e -!1 e s 2 st 2e e t the 6ollo0in1 re9 ir e 2 e n t s . 1. The -!1 e cont e n t !s dis-l! ;e d in the bro0s e r 2 st be the s! 2 e !s or ! s - er s e t o6 the s! 2 -l e res- o n s e -!1 e . $ll 0eb obEect s -res e n t in the s! 2 -l e 2 st be incl d e d. $ddition !l obEect s !re !llo0e d. The -!1 e l!;o t !s dis-l! ;e d in the bro0s e r 2 st be si2il!r to th!t o6 the s! 2 -l e res-o n s e -!1 e. #h!n 1 e s in color, 6ont, !nd b!c81ro n d !re !llo0e d. $ll ele 2 e n t s o6 the -!1 e 'i.e., 0eb obEect s) 2 st be co2 2 ni c ! t e d individ !ll;. $ll t!1s in the CTM@ cod e 2 st be W5# co2 -li! nt . The CTM@ code 2 !; not cont !i n or re6er e n c e !n; !ctive ele 2 e n t s .
2. 5. (. 5.
2.2.11 <6 c!chi n 1 is se d, it 2 st 2 e e t !ll the re9 ire 2 e n t s o6 #l! s e 6.5.5. 2.2.12 The cl! s e s titled EB Na-i g a t i o n .pti o n s de6in e the set o6 n!vi1 ! ti o n o-tion s th!t the AB 2 st choos e 6ro2. See #l! s e 5.2 6or ho0 the AB choos e s ! n!vi1 ! ti o n o-tion. $n !ct !l ser h!s 2! n ; !ddition !l n!vi1 ! ti o n o-tions 'e.1., boo8 2 ! r8 s, 1o 2e n , etc.) Thos e !ddition !l o-tion s 'not incl d e d in the AB N!vi1! tion =-tions) !re consid er e d seco n d ! r ; !nd !re not e+ercis e d d rin1 the benc h 2 ! r 8 e+ec ti on. 2.2.15 The Web Ser - e r Acc e s s %og d!t ! 2 st be collect e d 0ith ! 2ini2 2 resol tion o6 one seco n d !nd 0ritt en in #o2 2 o n @o1 For2 ! t '#@F) !t le!st onc e ever; 50 seco n d s to ! -ersist e n t 2e di ! see $--en di+ <. The 6ields o6 #@F !re !s 6ollo0s. client. 7NS N!2 e or <& !ddr e s s o6 re2 ot e client dd. 7!; 2 2. Month ;;;;. Ke!r hh. ho r 2 2. 2in t e s ss. seco n d s re9 e s t . First line o6 CTT& re9 e s t !s sent b; the client ddd. st!t s cod e ret rn e d b; the serv er bbbb. Tot!l n 2 b e r o6 b;t e s sent, not incl din1 CTT& he ! d e r St!nd!rd S-eci6ic!tion Version &'( &!1e ++viii
T&# Bench2!r8I W
Com m e n t A The lo11in1 re9 ir e 2 e n t s de6ine d !bov e !re re9 ir e d onl; 6or s;st e 2 s th!t r n !--lic!tio n cod e !nd !re the -ri2 !r; store o6 i2!1 e s . &ri2 !r; store is de6in e d !s the -l!c e the d!t ! is store d !ss 2 i n 1 !ll c!ch e s !re e2 -t ;. This does not 2e ! n the dis8 s bs ;s t e 2 s or ?$<7 controllers, b t the s;st e 2 th!t 2! n ! 1 e s the s e co2 - o n e n t s . 2.2.1( $6ter !n AB re9 e s t s ! Ne0 &rod ct s, Best Sellers, or Se!rc h ?es lt 0eb inter ! c tio n, the AB 2 st 2!int !i n ! c!ch e d list o6 the %?@Hs ' C9R% ) th!t 0ere cont !i n e d in the res- o n s e -!1 e 6or th!t 0eb inter ! c tio n, ntil s ch ti2 e th!t the AB select s ! n!vi1 ! ti o n o-tion th!t is not the &rod ct 7et !il 0eb inter ! c ti on. This #%?@ is 2 !int !i n e d 6or the sole - r-o s e o6 n!vi1! ti n 1 6ro2 the &rod ct 7et !il inter ! c tio n b!c8 to the &rod ct 7et !il inter ! c tion, !s s-eci6ied in cl! s e 2.1(.5. (. 2.2.15 7 rin1 the -roc e s si n 1 o6 ! Se!rc h ?es lt 0eb inter ! c ti on the S%T is !llo0e d to -roce s s the se !rc h on ! co2 2 e r ci !ll; !v!il!bl e te+t se !rc h en1i n e th!t is not -!rt o6 the 7BMS. 2.2.16 The i2-le 2 e n t ! t i o n o6 f a g s , !s se d in the 0eb inter ! c tio n de6inition s, is not s-eci6ied. Fl!1s !re se d to c!rr; in6or2 ! ti o n 6ro2 one 0eb inter ! c tio n to !not h e r. A+!2 -l e s o6 -ossi bl e i2-le 2 e n t ! t i o n s incl d e the se o6 ! 6ield in the CTT& re9 e s t !nd the se o6 2 lti-le %?@Ls, e!c h re6lectin 1 ! di66ere n t v!l e 6or the 6l!1. 2.2.1, Ther e is no re9 ire 2 e n t 6or the i2-le 2 e n t ! t i o n o6 the benc h 2 ! r 8 to !llo0 the bro0s e r to in- t or to dis-l! ; !n; ch!r ! c t e r s other th! n thos e de6ine d in #l! s e (.6.2.2. 2.2.18 The 1en e ric Pro m o t i o n a 6ollo0s. Pro c e s s i n g , e+ ec t e d b; select e d 0eb inter ! c ti on s, is de6ine d !s ni6or2 distrib tio n over the r!n1 e o6 v!l e s <S?A@$TA72, <S?A@$TA75,
The S%T select s ! r!ndo 2 <S<7 6ro2 ! de6ine d in #l! s e (.,.1.
The S%T obt !in s the 6ive rel!t e d ite2 s '<S?A@$TA71, <S?A@$TA7(, <S?A@$TA75) 6or the select e d ite2. The CTM@ to dis-l! ; e!c h -ro 2 o ti on !l !--ro - ri ! t e -rod ct det !il -!1 e . ite2 2 st !lso
The S%T obt !in s the th 2 b n ! il i2! 1 e , <STC%MBN$<@, 6ro2 e!c h o6 the 6ive rel!t e d ite2 s. cont !i n n!vi1 ! ti o n to the
T&# Bench2!r8I W
&!1e
++i+
2.2.19 The $d2in ?e9 e s t !nd $d2in #on6ir2 0eb inter ! tio n s !re !d 2i nistr ! tiv e t!s8s. The; !re not co2 - o n e n t s th!t ! re1 l !r c sto 2 e r 0o ld see, b t e+ist !s -!rt o6 the 2od el de-ict e d b; the 0or8lo! d. 2.2.20 The 6ollo0in1 di!1r ! 2 sho0s the se9 e n ci n 1 o6 0eb inter ! c tion s. 7 rin1 ! %ser Session e!c h A2 l!t e d Bro0s er c! s e s ! se9 e n c e o6 0eb inter ! c tio n s to be -er6or 2 e d . Th!t se9 e n c e corre s - o n d s to ! tr!v er s !l o6 this di!1r ! 2 . A!ch nod e in the di!1r ! 2 cont !i n s the n! 2 e o6 ! 0eb inter ! c tio n t;- e 'Co2 e, Best Seller, Se!rc h ?e9 e s t , etc.). $n !rro0 bet0 e e n t0o nod e s $ !nd B 'i.e., $ B) indic!t e s th!t !6t er -er6or 2i n 1 0eb inter ! c tio n $, it is -ossi bl e 6or !n A2 l!t e d Bro0ser to ne+t -er6or 2 the 0eb inter ! c ti on B. When ther e !re 2 lti-l e !rro0s le!vin 1 ! nod e, the !rc th!t is chos e n 6or the ne+t 0eb inter ! c ti on is det er 2 i n e d -rob ! bilistic!ll; !s describ e d in #l! s e 5. A!ch !rro0 0ith ! solid he! d is !nno t ! t e d !t its t!il end 0ith ! l!bel o6 the 6or2 NU6oo V N. This indic!t e s th!t, in order to 1et to the -oint e d* to 0eb inter ! c ti on 6ro2 the c rre n t 0eb inter ! c ti on, ! b tto n n! 2 e d N6ooN is -res s e d '!s e2 l ! t e d b; the A2 l!t e d Bro0s er). 'Note ho0ev e r, th!t the UCo 2 e V l!bels !re not indic!t e d in the di!1r ! 2 in order to red c e cl tt er.) For e+! 2 -l e, the !rc !t the ver; to- o6 the di!1r ! 2 indic!t e s th!t, b; -res si n 1 the US e ! r c h V b tt o n, the bro0s er c!n 1o 6ro2 the Co2 e 0eb inter ! c ti on to the Se!rc h ?e9 e s t 0eb inter ! c ti on. $rcs 0ith o-e n !rro0h e ! d s indic!t e th!t, in order 1et to the -oint e d* to 0eb inter ! c tio n 6ro2 the c rre n t 0eb inter ! c ti on, the e2 l ! t e d bro0s e r 6ollo0s !n C?AF lin8 -rovid e d b; the c rre n t inter ! c tio n. For e+ ! 2 -l e , the Best Seller 0eb inter ! c ti on 6or the s bE ect o6 &$?ANT<NB ret rn s sev er !l C?AFLs to the best sellin1 -rod ct s on -!r e n ti n 1. The e2 l ! t e d bro0s e r c!n choos e to loo8 !t the det !ils o6 one o6 thes e -rod ct s b; 6ollo0in1 one o6 the s e C?AF lin8s. '<.e., ! re9 e s t o6 the &rod ct 7et!il -!1 e 6or th!t -rod c t is 2! d e .) The bo+ in the -- e r le6t o6 the di!1r ! 2 l!bel e d NSt!rt %ser SessionN does not re-r e s e n t ! 0eb inter ! c ti on t;-e. ?!th er, it indic!t e s th!t the 6irst 0eb inter ! c ti on o6 ! %ser Session is !l0!;s ! Co2 e 0eb inter ! c ti on. Not indic!t e d in the di!1r ! 2 is ho0 %ser Sessio n s end. $ %ser Session c!n end !6ter -er6or 2i n 1 !n; 0eb inter ! c tio n 'other th! n the Co2 e 0eb inter ! c ti on) s ch th!t the chos e n ne+t 0eb inter ! c tio n is Co2 e, !nd th!t ! re9 isit e 2ini 2 2 !2 o n t o6 ti2 e h!s el!- s e d . See #l! s e 6.2.2 6or the det !ils o6 the conditions nd er 0hich ! %ser Session ends .
T&# Bench2!r8I W
&!1e
+++
Ke*A St!rt %ser Session
UN!2e V
B tton n!2e Web <nter!ction tr!nsition vi! b tton Web <nter!ction tr!nsition vi! C?AF lin8
USe!rchV $d2in #on6ir2
USe!rchV US b2itV $d2in ?e9 est USe!rchV
USe!rchV Se!rch ?es lt Best Seller '#%?@) Ne0 &rod ct &rod ct 7et!il U$dd to #!rt V
US b2it D er; V
U$d2inV
USe!rchV
Co2e
USho--in1 #!rtV
Sho--in1 #!rt USho--in1 #!rt V U#on6ir2 %-d!tes V U#hec8o tV
Se!rch ?e9 est
# sto2er ?e1istr!tion U#ontin e B ;V

?et rnin1 # sto2er
USe!rchV
U#ontin e B ;V
Not ?et rnin1 # sto2er
B ; ?e9 est U#on6ir2 B ;V B ; #on6ir2
USho--in1 #!rt V
USe!rchV
=rder <n9 ir; U=rder St!t sV
USe!rchV
U7is-l!; @!st =rderV =rder 7is-l!;
USe!rchV
T&# Bench2!r8I W
&!1e
+++i
2.2.21 A!ch AB 2 st se !t le!st one inde - e n d e n t r!nd o 2 n 2 b e r 1en e r ! t o r 'i.e., not sh!r e d 0ith !n; oth er AB). A!ch r!nd o 2 n 2 b e r 1en e r ! t o r 2 st be see d e d 0ith ! ni9 e v!l e. $ltho 1 h the selection o6 the ni9 e see d is le6t to the i2-le 2 e n t e r , it 2 st not be don e in ! 6!shion th!t 0o ld i2-rov e -er6or 2 ! n c e . The S%T is re9 ire d to 1en e r ! t e r!nd o 2 n 2 b e r s 6or cert !i n Web <nter ! cti on s. <6 the s e r!ndo 2 n 2 b e r s !re 1en e r ! t e d b; 2 lti-l e r!nd o 2 n 2 b e r 1en e r ! t o r s 6or ! -!rtic l !r Web <nter ! ctio n, the initi!l r!ndo 2 n 2 b e r 1en e r ! t o r se e d s 2 st be ni9 e. Com m e n t . The inte nt o6 this #l! s e is to -rev e n t ! -er6or 2 ! n c e !dv ! n t ! 1 e th!t co ld res lt 6ro2 !ll the ABLs or S%T s;st e 2 s sin1 r!nd o 2 n 2 b e r s 1en e r ! t e d 6ro2 ! sin1l e see d 0hich 2! ; 1en e r ! t e non* r!nd o 2 !cc e s s e s to the Web !nd d!t ! b ! s e obEect s. 2.2.22 The !--lic!tion 2! ; -er6or 2 6 nction !l ro tin1 's ch !s ! te+t se!rc h servic e or !n i2! 1 e service) to one or !n n8no0 n n 2 b e r o6 serv er s o6 e!c h service t;-e. The servic e 2 !; co2 2 ni c ! t e directl; b!c8 to the AB. 7!t ! de- e n d e n t ro tin1 or lo!d b!l !n c e ro tin1 b; the !--lic!tion is not !llo0e d. The !--lic!tion 2! ; direct s bs e 9 e n t re9 e s t s b!c8 to itsel6 '8no0n !s !66init; ro tin1). $--lic!tion ro tin1 b!s e d on the v!l e o6 the in- t re9 ire 2 e n t s 'e.1. ite2 n 2 b e r), sh!ll be li2ited to the 6ollo0in1. Web <nter ! c tio n %?@, the se !rc h t;- e s, the s bE ect t;-e s !nd 0eb obEect s !s de6ine d in cl! s e 1.5.
$ll oth er ro tin1 th!t se s in- t v!l e s is consid e r e d d!t ! de- e n d e n t ro tin 1 !nd 2 st be don e b; ! co2 2 e r ci !ll; !v!il! bl e -rod ct .
2.2.25 7!t! 0ithin !n inter ! c ti on is onl; re9 ir e d to be obt !in e d onc e, eve n tho 1 h it 2 !; be re6err e d to 2 lti-l e ti2 e s 0ithin th!t inter ! c tio n.
4 ' 6 H o m e W e b 2n t e r a c t i o n
4' 6 ' & .-er-i e " This n-rot e c t e d 0eb inter ! c ti on ret rn s to the AB ! 0eb -!1 e 0hich cont !i n s lin8s to -rod ct lists 6or ne0 -rod c t s !nd 6or best sellers. This is the initi!l 0eb inter ! c tio n re9 e s t e d b; !ll %sers st!rtin 1 ! ne0 %ser Session. <t is !lso ! n!vi1! tio n o-tion 6ro2 2ost other 0eb -!1 e s . 4' 6 ' 4 2npu t ReB uir e m e n t s This 0eb inter ! c ti on is invo8e d b; !n CTT& re9 e s t !nd re9 ir e s the 6ollo0in1 in- t d!t !. The %?@ 6or the Co2 e &!1e, 0hich is cont !i n e d in the CTT& re9 e s t .
T&# Bench2!r8I W
&!1e +++ii
<6 this is the 6irst Co2 e 0eb inter ! c tio n o6 ! %ser Session !nd the %ser is ! # sto 2 e r, the n the AB -res e n t s !s in- t ! #S<7 th!t 0!s chos e n sin1 the N%?!nd 6 nction de6in e d in #l! s e 2.1.12 0ith the 6ollo0in1 -!r ! 2 e t e r s . + [ 1 ; [ N%MS#%ST=MA?S, 0her e N%MS#%ST=MA?S is the initi!l c!rdin !lit; o6 the #%ST=MA? t!bl e. $ is chos e n !ccor din 1 to the 6ollo0in1 t!bl e.
5or N9MDC9ST.MERS in t$i s ran g e 1 * 9,99 9 10,0 0 0 * 59,99 9 (0,0 0 0 * 159,9 9 9 160,0 0 0 * 659,9 9 9 6(0,0 0 0 * 2,559, 9 9 9 2,56 0, 0 0 0 * 10,25 9, 9 9 9 10,2 ( 0, 0 0 0 * (0,95 9, 9 9 9 (0,9 6 0, 0 0 0 * 165,8 5 9 , 9 9 9 165,8 ( 0, 0 0 0 * 655,5 5 9, 9 9 9
?a u e for A 1,02 5 (,09 5 16,58 5 65,55 5 262,1 ( 5 1,0(8, 5 , 5 (,19(, 5 0 5 16,,, ,, 2 1 5 6,,10 8, 8 6 5
Com m e n t . This 2e ! n s th!t !n; #S<7Ls !ssi 1n e d to ne0l;* cre! t e d # sto 2 e r s d rin1 ! Test ? n '!s s-eci6ied in cl! s e 2.6.5.2) !re nev er se d b; ?BALs 6or ret rni n 1 # sto 2 e r selectio n s. Th!t is, ! ne0 # sto 2 e r 0ill nev er be ! ret rni n 1 # sto 2 e r . The S%T is not !llo0e d to t!8e !dv ! n t ! 1 e o6 this 6!ct to i2-rov e its -er6or 2 ! n c e . 4' 6 ' 6 2.5.5.1 Proc e s s i n g )efi ni ti o n <6 this %ser is ! # sto 2 e r !nd its #S<7 is 8no0n, then in6or2 ! tio n !bo t the # sto 2 e r . 2.5.5.2 2.5.5.5 2.5.5.( 4' 6 ' 8 the S%T obt !i ns the 6ollo0in1
#SFN$MA or S#S#SFN$MA i6 the sho- -i n 1 sessio n e+ists 6or this c st o 2 e r #S@N$MA or S#S#S@N$MA i6 the sho- -i n 1 ses sion e+ists 6or this c sto 2 e r
The S%T e+ ec t e s the &ro2 otion !l &roce s si n 1, !s de6ine d in #l! s e 2.2.1 8. The S%T -rod c e s the CTM@ cod e 6or the Co2 e &!1e !nd ret r n s the 0eb -!1 e to the AB. The AB select s ! n!vi1 ! ti o n o-tion !ccordi n 1 to #l! s e 5.2.2. Re s p o n s e Pa g e )efi ni ti o n $ s! 2 -l e o6 the Co2 e &!1e is sho0n belo0 !s it 0o ld !-- e ! r in ! Bro0s er.
T&# Bench2!r8I W
&!1e +++iii
T&# Bench2!r8I W
&!1e +++iv
The CTM@ cod e 6or the Co2 e &!1e '!n e+ ! 2 -l e o6 0hich c!n be 6o nd in $--e n di+ F) 2 st 2e e t the 6ollo0in1 re9 ir e 2 e n t s . 1. The len1t h o6 the cod e 2 st be ! 2ini2 2 o6 ,,1, 2 ch!r ! c t e r s. 2. The 6ollo0in1 0eb obEect s 2 st be re6er e n c e d . <2!1 e s 6or the US h o - -i n 1 #!rt V , US e ! r c h V !nd U=rd e r St!t s V b tt o n s <2!1 e 6or the T&# @o1o <2!1 e s 6or the th 2 b n ! il o6 the 6ive -ro2 o tio n !l ite2 s <2!1 e s 6or QWh!tLs Ne0R !nd QBest SellersR
5. <t 2 st cont !i n ! list o6 2( s bEect s 6or ne0 ite2 s !nd ! list o6 2( s bE ect s 6or best sellers '!s de6ine d in #l! s e (.6.2.1 2). (. The 6ollo0in1 d!t ! 2 st be dis-l! ;e d i6 retriev e d 6ro2 the S%T. 4' 6 ' : 2.5.5.1 #SFN$MA or S#S#SFN$MA #S@N$MA or S#S#S@N$MA
EB Na-i g a t i o n .pti o n s US h o - -i n 1 #!rt V b tt o n. M!8e !n CTT& re9 e s t to initi!t e the Sho- -i n 1 #!rt 0eb inter ! c tio n, 0ith the 6ollo0in1 in- t. $n e2 - t ; list o6 '<S<7, DTK) -!irs The $77SF@$B is set to QNR
2.5.5.2 2.5.5.5 2.5.5.(
U Se!rc h V b tto n. M!8e !n CTT& re9 e s t to initi!t e the Se!rc h ?e9 e s t 0eb inter ! c tion. U=rd e r St!t s V b tto n. M!8e !n CTT& re9 e s t to initi!t e the =rder <n9 ir; 0eb inter ! c tio n. UNe0 &rod ct s V lin8. M!8e !n CTT& re9 e s t to initi!t e the Ne0 &rod ct s 0eb inter ! c ti on, 0ith the 6ollo0in1 in- t. S%B"A#TSST?<NB, 0her e the AB select s 6ro2 ! 6ro2 the list o6 %?@s 6or ne0 title s bE ect s. ni6or2 r!ndo 2 distrib tion one entr;
2.5.5.5
UBe s t Sellers V lin8. M!8e !n CTT& re9 e s t to initi!t e the Best Sellers 0eb inter ! c ti on, 0ith the 6ollo0in1 in- t. S%B"A#TSST?<NB, 0her e the AB select s 6ro2 ! 6ro2 the list o6 %?@s 6or best seller s bEec t s. ni6or2 r!ndo 2 distrib tion one entr;
4 ' 8 S $ o p p i n g Car t W e b 2n t e r a c t i o n
4' 8 ' & .-er-i e " This n-rot e c t e d 0eb inter ! c ti on -d ! t e s the !sso ci ! t e d #$?T 're6res hi n 1 the #$?TLs d!t e !nd o-tion !ll; !ddi n 1 ! ne0 ite2 or -d ! ti n 1 e+istin1 ite2 s) !nd !l0!;s ret r n s to the AB ! 0eb -!1 e 0hich dis-l !;s the -d ! t e d cont e n t s o6 the %serLs #$?T. <6 ! Sho--i n 1 Sessio n is not identi6ied !t the st!rt o6 this 0eb inter ! c tio n, ! ne0 Sho--i n 1 Session is cre! t e d . T&# Bench2!r8I W St!nd!rd S-eci6ic!tion Version &'( &!1e +++v
4' 8 ' 4
2npu t ReB uir e m e n t s This 0eb inter ! c ti on is invo8e d b; !n CTT& re9 e s t !nd re9 ir e s the 6ollo0in1 in- t d!t !. The %?@ 6or the Sho--i n 1 #!rt &!1e, 0hich is cont !i n e d in the CTT& re9 e s t . $ list o6 '<S<7, DTK) -!irs 6or the ite2 s to be -d ! t e d or !dd e d to the #$?T, 0hich is cont !i n e d in the CTT& re9 e s t . This list 2! ; be e2 -t ;. $ v!l e 6or the 6l!1 $77SF@$B, 0hich de- e n d s on the -!1 e 6ro2 0hich this inter ! c tion is re9 e s t e d .
4' 8 ' 6 2.(.5.1
Proc e s s i n g )efi ni ti o n <6 the SC=&&<NBS<7 is not 8no0n, then the S%T cre !t e s ! ne0 ni9 e SC=&&<NBS<7. <6 ther e is no #$?T !ssoci !t e d 0ith this SC=&&<NBS<7, the n the S%T cre !t e s !n !sso ci ! t e d #$?T initi!li:ed !s 6ollo0s. S#SSC=&&<NBS<7 [ SC=&&<NBS<7 S#S7$TA [ c rre n t d!t e !nd ti2 e on the S%T
2.(.5.2
<6 ! ne0 #$?T 0!s cre! t e d d rin1 this 0eb inter ! c ti on !nd #S<7 is 8no0n, then the S%T obt !in s in6or2 ! tio n !bo t the # sto 2 e r to -d ! t e the #$?T !s 6ollo0s. S#S#SFN$MA [ #SFN$MA S#S#S@N$MA [ #S@N$MA S#S#S7<S#=%NT [ #S7<S#=%NT or the #$?T is e2 -t ; or '<S<7, <SDTK) -!irs !re not e2 - t ; then do the '#o2 2 e n t . ther e !re c!s e s 0her e thes e conditions !re not 2et, s8i- to cl! s e 2.(.5.() B!se d on SC=&&<NBS<7, the S%T -d ! t e s the !n !to 2ic set o6 o-er ! ti o n s !s 6ollo0s.
2.(.5.5
<6 $77SF@$B [ NKN 6ollo0in1 -d ! t e s . -roc e s si n 1 sho l d !ssoci !t e d #$?T !s Ust ! r t !to 2i c set V
<6 $77SF@$B [ QKR '!nd the o-tion !l #$?T li2it o6 100 ite2 s h!s not be e n re!c h e d ). <6 <S<7 [ S#@S<S<7 'i.e., the ite2 !lre ! d ; e+ists in the #$?T). S#@SDTK [ S#@SDTK X 1 'i.e., incre 2 e n t 9 ! n tit ; b; 1 6or S#@S<S<7) Alse 'i.e., the ite2 does not !lre ! d ; e+ist s in #$?T). The S%T obt !i ns the 6ollo0in1 in6or2 ! tio n !bo t the ite2 <S<7. <S#=ST <SS?& <ST<T@A <SB$#><NB
The S%T !dd s the ite2 to the #$?T 0ith. S#@S<S<7 [ <S<7 S#@SDTK [ 1 S#@S#=ST [ <S#=ST St!nd!rd S-eci6ic!tion Version &'( &!1e +++vi
T&# Bench2!r8I W
S#@SS?& [ <SS?& S#@ST<T@A [ <ST<T@A S#@SB$#><NB [ <SB$#><NB
Note. <6 the #$?T li2it h!s be e n re!c h e d , the ite2 is not !dd e d !nd the 2 es s ! 1 e QSho- -i n 1 #!rt is 6 ll, ite2 not !dd e d R is incl d e d on the res-o n s e -!1 e . The -roc e s si n 1 res 2 e s !t #l! s e 2.(.5.(. <6 $77SF@$B [ QNR !nd the list o6 '<S<7, DTK) -!irs is not e2 - t ;, the #$?T is 6ollo0s. For e!c h '<S<7, DTK) -!ir. <6 DTK [ 0 'i.e., the ite2 2 st be re2 o v e d 6ro2 the #$?T). 7elet e the entr; 6ro2 the #$?T 6or ite2 S#@S<S<7 -d ! t e the ite2 !s 6ollo0s. -d ! t e the 9 ! n tit ; 6or ite2 S#@S<S<7) -d ! t e d !s
Alse,
S#@SDTK [ DTK 'i.e.,
Alse 'i.e., $77SF@$B [ QNR !nd the list o6 '<S<7, DTK) -!irs is e2 - t ;), !nd the #$?T is e2 -t ;, !dd ! -ro2 o tio n !l ite2 to the #$?T !s 6ollo0s. $ r!nd o 2 <S<7 is select e d b; the S%T 0ithin the r!n1 e o6 Y1 .. N%MS<TAMSZ The S%T obt !i ns the v!l e o6 <S?A@$TA71 6or the select e d <S<7 The S%T !dd s the ite2 to the #$?T !s 6ollo0s. The S%T obt !i ns the 6ollo0in1 in6or2 ! tio n !bo t the ite2 <S?A@$TA71. <S#=ST <SS?& <ST<T@A <SB$#><NB
$ ne0 ite2 is !dd e d to the #$?T 0ith. S#@S<S<7 [ <S?A@$TA71 S#@SDTK [ 1 S#@S#=ST [ <S#=ST S#@SS?& [ <SS?& S#@ST<T@A [ <ST<T@A S#@SB$#><NB [ <SB$#><NB !s. S#SS%BST=T$@ [ s 2'S#@SDTK ^
The ne0 s b* tot!l o6 the #$?T is co2 - t e d S#@S#=ST)
The v!l e o6 S#S7$TA is set to the c rre n t d!t e !nd ti2 e on the S%T, 0ith ! 2ini2 2 -recision o6 1 seco n d.
U e n d !to 2i c set V 2.(.5.( The S%T e+ ec t e s the &ro2 otion !l &roce s si n 1, !s de6ine d in #l! s e 2.2.1 8.
T&# Bench2!r8I W
&!1e +++vii
2.(.5.5
B!se d on SC=&&<NBS<7, the S%T obt !in s the 6ollo0in1 in6or2 ! tio n !bo t the !ssoci !t e d #$?T. For the #$?T. S#S7$TA S#SS%BST=T$@ S#S#SFN$MA S#S#S@N$MA
For e!c h ite2 in the #$?T. S#@S<S<7 S#@SDTK S#@S#=ST S#@SS?& S#@ST<T@A S#@SB$#><NB
2.(.5.6
The S%T -rod c e s the CTM@ code 6or the Sho- -i n 1 #!rt &!1e !nd ret rn s the 0eb -!1 e to the AB. The AB select s ! n!vi1 ! ti o n o-tion !ccordi n 1 to #l! s e 5.2.2.
2.(.5.,
T&# Bench2!r8I W
&!1e +++viii
4' 8 ' 8
Re s p o n s e Pa g e )efi ni ti o n $ s! 2 -l e o6 the Sho- -i n 1 #!rt &!1e is sho0n belo0 !s it 0o ld !-- e ! r in ! Bro0s er.
The CTM@ cod e 6or the Sho--i n 1 #!rt &!1e '!n e+! 2 -l e o6 0hich c!n be 6o nd in $--e n di+ F) 2 st 2 e e t the 6ollo0in1 re9 ire 2 e n t s . 1. The len1t h o6 the cod e 2 st be ! 2ini2 2 o6 2,05 6 ch!r ! c t e r s. T&# Bench2!r8I W St!nd!rd S-eci6ic!tion Version &'( &!1e +++i+
2. The 6ollo0in1 0eb obEect s 2 st be re6er e n c e d . 5. <2!1 e s 6or the U#h e c 8 o t V , UCo 2 e V !nd U? e6re s h V b tto n s <2!1 e 6or the T&# @o1o <2!1 e s 6or the th 2 b n ! il o6 the 6ive -ro2 o tio n !l ite2 s
The 6ollo0in1 d!t ! 2 st be dis-l! ;e d i6 retriev e d 6ro2 the S%T. S#SS%BST=T$@ S#S7$TA
For e!c h line in the #$?T. S#@SDTK S#@ST<T@A S#@SB$#><NB S#@SS?& S#@S#=ST
4' 8 ' : 2.(.5.1
EB Na-i g a t i o n .pti o n s U? e6re s h V b tto n. M!8e !n CTT& re9 e s t to initi!t e the Sho--i n 1 #!rt 0eb inter ! c ti on, 0ith the 6ollo0in1 in- t. The AB cre !t e s ! co2 -l et e list o6 '<S<7, DTK) -!irs 6or !ll ite2 s in the #$?T sho0n in the 2ost rec e n t Sho--i n 1 #!rt &!1e receiv e d b; the AB. Com m e n t . The !ction s de6in e d in the &roce s si n 1 7e6inition section o6 the Sho- -i n 1 #!rt inter ! c tio n 1 !r ! n t e e th!t the #$?T 0ill h!v e !t le!st one ite2 in it, !nd ther e6or e , the co2 -l e t e list o6 '<S<7, DTK) -!irs cre !t e d b; the AB 6or this n!vi1 ! ti o n o-tion 0ill !lso cont !i n !t le!st one -!ir. <6 ther e is onl; one '<S<7, DTK) -!ir in the list, the AB set s DTK to ! r!ndo 2 v!l e 'bet0 e e n 1 !nd 10, e+cl din 1 S#@SDTK) 1en e r ! t e d sin1 ! ni6or 2 r!nd o 2 6 nction. Alse ther e !re 1re ! t e r th! n n 2 b e r o6 '<S<7, DTK) -!irs n 2 b e r o6 -!irs in the list)Z AB set s DTK to ! r!ndo 2 v!l ni6or2 r!nd o 2 6 nction. The $77SF@$B is set to NNN. one '<S<7, DTK) -!irs in the list. The AB select s ! r!nd o 2 6ro2 the list 'in the incl siv e r!n 1 e Y1, 'one less th!n the sin1 ! ni6or2 r!nd o 2 6 nction. For e!c h select e d -!ir, the e 'bet0 e e n 0 !nd 10, e+cl din 1 S#@SDTK) 1en e r ! t e d sin1 !
2.(.5.2 2.(.5.5
UCo 2 e V b tt o n. M!8e !n CTT& re9 e s t to initi!t e the Co2 e 0eb inter ! c ti on. U#h e c 8 o t V inter ! c tio n. b tto n. M!8e !n CTT& re9 e s t to initi!t e the # sto 2 e r ?e1istr ! ti on 0eb
T&# Bench2!r8I W
&!1e
+l
4 ' : Cu s t o m e r R e g i s t r a t i o n W e b 2n t e r a c t i o n
4' : ' & .-er-i e " This n-rot e c t e d 0eb inter ! c ti on ret rn s to the AB ! 0eb -!1 e 0hich !llo0s ! %ser to -rovid e the in6or2 ! ti o n nec e s s ! r ; to re1ist e r !s ! 8no0n # sto 2 e r or !s ! ne0 # sto 2 e r !nd to s b 2it their re1istr ! tio n. This is the 6irst ste- in b ;in1 the cont e n t s o6 the #$?T. 4' : ' 4 2npu t ReB uir e m e n t s This 0eb inter ! c ti on is invo8e d b; !n CTT& re9 e s t !nd re9 ir e s the 6ollo0in1 in- t d!t !. 4' : ' 6 2.5.5.1 The %?@ 6or the # sto 2 e r ?e1istr ! ti on &!1e, 0hich is cont !i n e d in the CTT& re9 e s t .
Proc e s s i n g )efi ni ti o n The S%T -rod c e s the CTM@ cod e 6or the # sto 2 e r ?e1istr !tion &!1e !nd ret r n s the 0eb -!1 e to the AB. The AB select s ! n!vi1 ! ti o n o-tion !ccordi n 1 to #l! s e 5.2.2. Re s p o n s e Pa g e )efi ni ti o n $ s! 2 -l e o6 the # sto 2 e r ?e1istr !tio n &!1e is sho0n belo0 !s it 0o ld !-- e ! r in ! Bro0ser.
2.5.5.2 4' : ' 8
T&# Bench2!r8I W
&!1e
+li
The CTM@ cod e 6or the # sto 2 e r ?e1istr ! ti on &!1e '!n e+! 2 -l e o6 0hich c!n be 6o nd in $--en di+ F) 2 st 2e e t the 6ollo0in1 re9 ir e 2 e n t s . 1. The len1t h o6 the cod e 2 st be ! 2ini2 2 o6 2,,6 9 ch!r ! c t e r s. 2. The 6ollo0in1 0eb obEect s 2 st be re6er e n c e d .
T&# Bench2!r8I W
&!1e
+lii
4' : ' : 2.5.5.1
<2!1 e s 6or the US b 2 i t V , UCo 2 e V !nd US e ! r c h V b tt o n s <2!1 e 6or the T&# @o1o
EB Na-i g a t i o n .pti o n s US b 2 i t V b tt o n 0ith the 6ollo0in1. <6 the AB 8no0s the #S<7 !sso ci ! t e d 0ith the c rre n t %ser Sessio n, the n the Q?et r ni n 1 # sto 2 e r R is chec8 e d . M!8e !n CTT& re9 e s t to initi!t e the B ; ?e9 e s t 0eb inter ! c tio n, 0ith the 6ollo0in1 in- t. ?AT%?N<NBSF@$B set to QKR %N$MA is 1en e r ! t e d b; the AB !ccor din 1 to #l! s e (.6.2.1 0. &$SSW7 is 1en e r ! t e d b; the AB !ccordi n 1 to #l! s e (.6.2.1 1.
<6 the AB doe s not ;et 8no0 ! sern ! 2 e '%N$MA) !sso ci ! t e d 0ith the c rre n t %ser Sessio n, the n the Q?et r ni n 1 # sto 2 e r R is n* chec8 e d. M!8e !n CTT& re9 e s t to initi!t e the B ; ?e9 e s t 0eb inter ! c tion, 0ith the 6ollo0in1 in- t. ?AT%?N<NBSF@$B is set to QNR FN$MA is ! r!ndo 2 !* strin1 Y8 .. 15Z @N$MA is ! r!nd o 2 !* strin1 Y8 .. 15Z ST?AAT1 is ! r!nd o 2 !* strin1 Y15 .. (0Z ST?AAT2 is ! r!nd o 2 !* strin1 Y15 .. (0Z #<TK is ! r!nd o 2 !* strin1 Y( .. 50Z ST$TA is ! r!ndo 2 !* strin1 Y2 .. 20Z T<& is ! r!nd o 2 !* strin1 Y5 .. 10Z #=%NT?K is chos e n !ccordi n 1 to #l! s e (.6.2.1 5 &C=NA is ! r!nd o 2 n* strin1 Y9 .. 16Z AM$<@ is 1en e r ! t e d !s the conc ! t e n ! t i o n o6 FN$MA, 6ollo0e d b; the s-eci !l ch!r ! c t e r Q3R, 6ollo0e d b; @N$MA, 6ollo0e d the strin1 Q.co 2 R. B<?TC7$TA is ! r!ndo 2 d!t e 1en e r ! t e d !s s-eci6ied in cl! s e (.,.1 7$T$ is ! r!nd o 2 !* strin1 Y100 .. 500Z
2.5.5.2 2.5.5.5
UCo 2 e V b tt o n. M!8e !n CTT& re9 e s t to initi!t e the Co2 e 0eb inter ! c ti on. US e ! r c h V b tt o n. M!8e !n CTT& re9 e s t to initi!t e the Se!rc h ?e9 e s t 0eb inter ! c ti on.
T&# Bench2!r8I W
&!1e
+liii
4 ' ; B u * R e B u e s t W e b 2n t e r a c t i o n
4' ; ' & .-er-i e " This sec r e 0eb inter ! c ti on re1ist er s ! ne0 c st o 2 e r or identi6ies ! ret rni n 1 c sto 2 e r !nd ret rn s to the AB ! 0eb -!1 e 0hich dis-l! ;s in6or2 ! ti o n !bo t the c st o 2 e r , con6ir2in 1 eith er the re1istr ! tio n or the identi6ic!tion, !nd dis-l !;s ! s 2 2 ! r ; o6 the ite2 s in the !sso ci ! t e d #$?T. The -!1 e -rovid e s edit ! bl e 6ields 6or ent e rin 1 credit c!rd in6or2 ! ti o n !nd selectin 1 shi--in 1 o-tions. 4' ; ' 4 2npu t ReB uir e m e n t s This 0eb inter ! c ti on is invo8e d b; !n CTT& re9 e s t !nd re9 ir e s the 6ollo0in1 in- t d!t !. The %?@ 6or the B ; ?e9 e s t &!1e, 0hich is cont !i n e d in the CTT& re9 e s t . V!l e 6or the 6ield ?AT%?N<NBSF@$B, 0hich is cont !i n e d in the CTT& re9 e s t <6 ?AT%?N<NBSF@$B is set to QKR, v!l e s 6or the 6ollo0in1 6ields, 0hich !re cont !i n e d in the CTT& re9 e s t . %N$MA &$SSW7
<6 ?AT%?N<NBSF@$B is set to QNR, v!l e s 6or the 6ollo0in1 6ields, 0hich !re cont !i n e d in the CTT& re9 e s t . FN$MA @N$MA ST?AAT1 ST?AAT2 #<TK ST$TA T<& #=%NT?K &C=NA AM$<@ B<?TC7$TA 7$T$
4' ; ' 6 2.6.5.1
Proc e s s i n g )efi ni ti o n <6 ?AT%?N<NBSF@$B is set to QKR, the n the S%T e+ec t e s the 6ollo0in1 ste - s. =bt !in s the 6ollo0in1 in6or2 ! tio n !bo t the c st o 2 e r 0ith '#S%N$MA [ %N$MA). #S<7 or S#S#S<7 #S&$SSW7
T&# Bench2!r8I W
&!1e
+liv
#SFN$MA or S#S#SFN$MA #S@N$MA or S#S#S@N$MA $77?SST?AAT1 $77?SST?AAT2 $77?S#<TK $77?SST$TA $77?ST<& #=SN$MA #S&C=NA #SAM$<@ #SB<?TC7$TA #S7$T$ #S7<S#=%NT or S#S#S7<S#=%NT
%-d!t e the 6ollo0in1 in6or2 ! tio n 0ithin ! sin1l e d!t ! b ! s e tr!n s ! c ti o n. U s t ! r t tr!n s ! c ti o n V #S@=B<N is set to c rre n t d!t e/ ti 2 e #SAJ&<?$T<=N is set to #S@=B<N X 2 ho rs
U e n d tr!n s ! c ti o n V &$SSW7 is co2 - ! r e d to #S&$SSW7.
Com m e n t . The !--lic!tio n -ro1r ! 2 is re9 ir e d to incl d e lo1ic to de!l 0ith inv!lid -!s s0 or d s b; ret r nin 1 !n error 2e s s ! 1 e to the AB. <n the cont e + t o6 the benc h 2 ! r 8 , !ll s --lie d -!s s0 or d s 0ill be v!lid, !llo0in1 the -roc e s si n 1 o6 the order to contin e . $ll conv e n ti o n !l 2 e ! n s o6 -!s s0 or d ! t h e n ti c ! tio n 'e.1., sin1 ! direct or; serv er vi! @7$&) !re !cc e - t ! bl e 6or this - r-o s e . 2.6.5.2 <6 ?AT%?N<NBSF@$B is set to QNR, the S%T e+ ec t e s d!t ! b ! s e tr!ns ! c ti o n. Ust ! r t tr!ns ! c ti o n V $dds ! ne0 c sto 2 e r record in the #%ST=MA? t!bl e b!s e d on the in- t d!t ! !nd the 6ollo0in1 v!l e s. #S<7 is set to ! ni9 e v!l e, not nec e s s ! ril; seri!l or conti1 o s , 0ithin the #%ST=MA? t!ble. #S%N$MA is 1en e r ! t e d !ccordi n 1 to #l! s e (.6.2.1 0 #S&$SSW7 is 1en e r ! t e d !ccor din 1 to #l! s e (.6.2.1 1 #S@$STSV<S<T is the # rren t d!t e 1iven b; the o-er ! ti n 1 s;st e 2 0he n the record is !dd e d #S7<S#=%NT is r!ndo 2 0ithin Y0.00 .. 0.50Z #SB$@$N#A is set to 0.00 the 6ollo0in1 ste- s 0ithin ! sin1l e
T&# Bench2!r8I W
&!1e
+lv
#SKT7S&MT is set to 0.00 #SS<N#A is the c rre n t d!t e/ ti 2 e 1iven b; the o-er ! ti n 1 s;st e 2 0he n the record is !dd e d #SFN$MA is set to FN$MA #S@N$MA is set to @N$MA #S&C=NA is set to &C=NA #SAM$<@ is set to AM$<@ #SB<?TC7$TA is set to c rre n t d!t e #S@=B<N is set to c rre n t d!t e/ ti 2 e #SAJ&<?$T<=N is set to #S@=B<N X 2 ho rs #S7$T$ is set to 7$T$
$tte2 - t s to 2!t c h the c st o 2 e rLs !ddr e s s 'ST?AAT1, ST?AAT2, #<TK, ST$TA, T<&, #=%NT?K) 0ith !n !ddr e s s in the $77?ASS t!ble. <6 ! 2!t c h is 6o nd, then the #S$77?S<7 is set to $77?S<7 6or the 2 !t c hi n 1 record. <6 no 2 !t c h is 6o nd, ! ne0 record is cre !t e d in the $77?ASS t!bl e sin1 the c sto 2 e rLs !ddr e s s 0ith ! ne0 ni9 e $77?S<7 'not nec e s s ! ril; se9 e n ti !l nor conti1 o s ).
U e n d tr!ns ! c ti o n V %-d!t e sho- -i n 1 c!rt 6ields 2.6.5.5 scScS6n! 2 e [ cS6n! 2 e scScSln! 2 e [ cSln! 2 e scScSdisco n t [ cSdisco n t scScSid [ cSid
The S%T e+ ec t e s the 6ollo0in1 ste- s !s !n !to 2ic set o6 o-er ! ti o n s. Ust ! r t !to 2i c set V %-d!t e s the 6ollo0in1 6ields o6 the #$?T. The v!l e o6 S#@S#=ST is set to the c rre n t v!l e o6 <S#=ST 6ro2 the <TAM t!bl e 6or e!c h ite2 in the #$?T. %-d!t e the S#S7$TA
=bt !in s the 6ollo0in1 in6or2 ! tio n 6or e!c h ite2 in the #$?T. S#@ST<T@A S#@S#=ST S#@SS?& S#@SB$#><NB S#@SDTK -d ! t e s the 6ollo0in1 6ields o6 the #$?T.
#!lc l !t e s !nd
S#SS%BST=T$@ [ s 2'S#@S#=ST ^ S#@SDTK) ^ '1 _ S#S#S7<S#=%NT) S#ST$J [ S#SS%BST=T$@ ^ 0.08 2 5 St!nd!rd S-eci6ic!tion Version &'( &!1e +lvi
T&# Bench2!r8I W
S#SSC<&S#=ST [ 5.00 X '1.00 ^ s 2'S#@SDTK)) S#ST=T$@ [ S#SS%BST=T$@ X S#SSC<&S#=ST X S#ST$J
U e n d !to 2i c set V 2.6.5.( The S%T -rod c e s the CTM@ cod e 6or the B ; ?e9 e s t &!1e cont !i ni n 1 the billin1, shi--in 1, order !nd credit c!rd in6or2 ! tio nG !nd ret rn s the 0eb -!1 e to the AB. <6 ?AT%?N<NBSF@$B is set to NNN, then the S%T !lso ret r n s to the AB the v!l e s o6 the #S<7 !nd #S%N$MA o6 the ne0l; cre! t e d #%ST=MA? record. Com m e n t . #o2 2 ni c ! ti n 1 the #S<7 !nd #S%N$MA v!l e s to the AB c!n be i2-le 2 e n t e d b; v!rio s 2et h o d s incl din1, b t not li2ite d to, the -!s si n 1 o6 ! 6ield in the CTM@ res- o n s e , or the se o6 ! coo8ie. 2.6.5.5 4' ; ' 8 The AB select s ! n!vi1 ! ti o n o-tion !ccordi n 1 to #l! s e 5.2.2. Re s p o n s e Pa g e )efi ni ti o n $ s! 2 -l e o6 the B ; ?e9 e s t &!1e is sho0n belo0 !s it 0o ld !-- e ! r in ! Bro0ser.
T&# Bench2!r8I W
&!1e
+lvii
T&# Bench2!r8I W
&!1e +lviii
The CTM@ cod e 6or the B ; ?e9 e s t &!1e '!n e+ ! 2 -l e o6 0hich c!n be 6o nd in $--en di+ F) 2 st 2 e e t the 6ollo0in1 re9 ire 2 e n t s . 1. The len1t h o6 the cod e 2 st be ! 2ini2 2 o6 5,69 0 ch!r ! c t e r s. 2. The 6ollo0in1 0eb obEect s 2 st be re6er e n c e d . <2!1 e s 6or the U&roc e s s =rder V , UCo 2 e V !nd US h o - -i n 1 #!rt V b tto n s
5. The 6ollo0in1 d!t ! 2 st be dis-l! ;e d i6 retriev e d 6ro2 the S%T. 4' ; ' : 2.6.5.1 #SFN$MA or S#S#SFN$MA #S@N$MA or S#S#S@N$MA $77?SST?AAT1 $77?SST?AAT2 $77?S#<TK $77?SST$TA $77?ST<& #=SN$MA #SAM$<@ #S<7 or S#S#S<7 #S7<S#=%NT or S#S#S7<S#=%NT #S&C=NA #S%N$MA S#SS%BST=T$@ S#ST$J S#SSC<&S#=ST S#ST=T$@ For e!c h line in the #$?T S#@SDTK S#@ST<T@A S#@SB$#><NB S#@SS?& S#@S#=ST
EB Na-i g a t i o n .pti o n s U&roc e s s =rder V b tto n. M!8e !n CTT& re9 e s t to initi!t e the B ; #on6ir2 0eb inter ! c tio n, 0ith the 6ollo0in1 in- t. SC<&&<NB is r!nd o 2 l ; select e d 6ro2 t;- e s de6in e d in (.,.1 ##STK&A is r!nd o 2 l ; select e d 0ithin YV<S$, M$STA?#$?7, 7<S#=VA?, 7<NA?S, $MAJZ ##SN%MBA? is 1en e r ! t e d !s ! r!nd o 2 n* strin1 o6 16 di1its St!nd!rd S-eci6ic!tion Version &'( &!1e +li+
T&# Bench2!r8I W
##SN$MA is 1en e r ! t e d b; conc ! t e n ! t i n 1 #SFN$MA !nd #S@N$MA se- !r ! t e d b; ! sin1le s-!c e ##SAJ&<?K is 1en e r ! t e d !s the c rre n t d!t e X ! r!ndo 2 n 2 b e r o6 d!;s 0ithin Y1 .. ,50Z =n ! r!nd o 2 l ; select e d 5P o6 the ti2 e, the shi--in 1 !ddr e s s is -d ! t e d 0ith 'ST?AATS1, ST?AATS2, #<TK, ST$TA, T<&, #=%NT?K) 1en e r ! t e d !ccor din 1 to #l! s e (.,.1
2.6.5.2 2.6.5.5
UCo 2 e V b tt o n. M!8e !n CTT& re9 e s t to initi!t e the Co2 e 0eb inter ! c ti on. US h o - -i n 1 #!rt V b tt o n. M!8e !n CTT& re9 e s t to initi!t e the Sho- -i n 1 #!rt 0eb inter ! c tio n. $n e2 - t ; list o6 '<S<7, DTK) -!irs The $77SF@$B is set to QNR
4 ' = B u * Co n fir m W e b 2n t e r a c t i o n
4' = ' & .-er-i e " This sec r e 0eb inter ! c ti on tr!ns6 er s the cont e n t o6 the !ssoci !t e d #$?T into ! ne0l; cre !t e d order 6or the re1ist er e d c st o 2 e r !nd e+ ec t e s ! 6 ll -!;2 e n t ! t h ori: ! tion. <t then ret rn s to the AB ! 0eb -!1 e cont !i nin 1 the det !ils o6 the ne0l; cre! t e d order. 4' = ' 4 2.,.2.1 2npu t ReB uir e m e n t s This 0eb inter ! c tio n is invo8e d b; !n CTT& re9 e s t !nd re9 ire s the 6ollo0in1 in- t d!t !. The %?@ 6or the B ; #on6ir2 &!1e, 0hich is cont !i n e d in the CTT& re9 e s t . The 6ollo0in1 -!;2 e n t !nd shi--in 1 in6or2 ! tio n. ##STK&A ##SN%MBA? ##SN$MA ##SAJ&<?K SC<&&<NB So2 e -erc e n t ! 1 e o6 ti2 e, !s de6in e d in 2.6.5.1, ther e 0ill be !ddition !l in- t o6 shi--in 1 !ddr e s s 'ST?AATS1, ST?AATS2, #<TK, ST$TA, T<&, #=%NT?K)
4' = ' 6 2.,.5.1
Proc e s s i n g )efi ni ti o n B!se d on the 8no0n SC=&&<NBS<7 !nd !ssoci !t e d #$?T !nd # sto 2 e r . #S<7, the S%T obt !i ns in6or2 ! tio n !bo t the
The 6ollo0in1 in6or2 ! ti o n is obt !i n e d !bo t e!c h ite2 in the #$?T. S#@S<S<7 S#@S#=ST S#@SDTK
The 6ollo0in1 in6or2 ! ti o n is obt !i n e d !bo t the #$?T. St!nd!rd S-eci6ic!tion Version &'( &!1e l
T&# Bench2!r8I W
2.,.5.2
S#SS%BST=T$@ S#ST$J S#SSC<&S#=ST S#ST=T$@
The 6ollo0in1 in6or2 ! ti o n is obt !i n e d !bo t the # sto 2 e r . #SFN$MA or S#S#SFN$MA #S@N$MA or S#S#S@N$MA #S7<S#=%NT or S#S#S7<S#=%NT #S$77?S<7
<6 ! shi--in 1 !ddr e s s is -!s s e d , then the S%T !tt e 2 - t s to 2!t c h the !ddr e s s 'ST?AATS1, ST?AATS2, #<TK, ST$TA, T<&, #=%NT?K) 0ith !n !ddr e s s in the $77?ASS t!bl e. <6 ! 2 !t c h is 6o nd, set $77?S<7 to the $77?S<7 o6 the 2 !t c hi n 1 ro0. <6 no 2!t c h is 6o nd, then ! ne0 record is cre !t e d in the $77?ASS t!bl e sin1 the shi--in 1 !ddr e s s 0ith ! ne0 ni9 e $77?S<7 'not nec e s s ! ril; se9 e n ti !l or conti1 o s ). This entire -roc e s si n 1 ste - is e+ ec t e d 0ithin ! sin1l e d!t ! b ! s e tr!n s ! c ti o n. The S%T e+ ec t e s the 6ollo0in1 ste- s !s !n !to 2ic set o6 o-er ! ti o n s. Ust ! r t !to 2i c set V #re!t e s ! ne0 order !s 6ollo0s, 0ithin ! sin1le d!t ! b ! s e tr!n s ! c ti o n. U s t ! r t tr!n s ! c ti o n V $ record is !dd e d in the =?7A? t!ble 0ith. =S<7 is ni9 e 0ithin the =?7A? t!bl e 'not nec e s s ! ril; se9 e n t i !l or conti1 o s) =S#S<7 is set to #S<7 or S#S#S<7 =S7$TA is set to the c rre n t o-er ! ti n 1 s;st e 2 d!t e !nd ti2 e =SS%BST=T$@ is set to S#SS%BST=T$@ =ST$J is set to S#ST$J =ST=T$@ is set to S#ST=T$@ =SSC<&STK&A is set to SC<&&<NB =SSC<&S7$TA is set to c rre n t o-er ! ti n 1 s;st e 2 d!t e X r!ndo 2 0ithin Y1 .. ,Z d!;s =SB<@@S$77?S<7 is set to #S$77?S<7 <6 the shi--in 1 !ddr e s s 0!s -!s s e d , =SSC<&S$77?S<7 is set to $77?S<7 else the =SSC<&S$77?S<7 is set to #S$77?S<7 =SST$T%S is set to Q&endi n 1R =@S<7 is ni9 e 0ithin the =?7A?S@<NA record 6or the order 'not nec e s s ! ril; se9 e n ti !l or conti1 o s ) =@S=S<7 is set to =S<7 =@S<S<7 is set to S#@S<S<7 =@SDTK is set to S#@SDTK =@S7<S#=%NT is set to #S7<S#=%NT or S#S#S7<S#=%NT St!nd!rd S-eci6ic!tion Version &'( &!1e li
2.,.5.5
For e!c h ite2 in the #$?T, ! record is !dd e d in the =?7A?S@<NA t!bl e 0ith.
T&# Bench2!r8I W
=@S#=MMANTS is set to ! r!nd o 2 !* strin1 Y20 `100Z
For e!c h ite2 in the #$?T, <SST=#> is retriev e d 6ro2 the ite2 t!bl e 0her e <S<7 [ S#@S<S<7. <6 <SST=#> e+ce e d s S#@SDTK b; 10 or 2ore, the n <SST=#> is decr e ! s e d b; S#@SDTKG other0is e <SST=#> is -d ! t e d to '<SST=#> * S#@SDTK ) X 21.
U e n d tr!n s ! c ti o n V =bt !in s !n ! t h ori: !tio n 6ro2 the &!;2 e n t B!t e0 ! ; A2 l!t or '&BA) 'se e #l! s e 6.() !s 6ollo0s. B ild !n ! t hori: ! tion re9 e s t co2 -risin 1 o6 ! strin1 o6 b;t e s st!rtin1 0ith ##SN%MBA? enclos e d b; the t!1s UN%MV !nd U/N%MV, 6ollo0e d b; the 10 deci 2 !l di1it re-r e s e n t ! t i o n o6 the v!l e o6 =S<7, -re6i+ e d 0ith le!din 1 :eros !s nee d e d , enclos e d b; the t!1s U=<7 V !nd U/=<7 VG !nd -!d d e d to ! tot !l len1t h @, 0her e @ is !t le!st 600 0 b;t e s, !nd the -!d ch!r ! c t e r s !re ! r!nd o 2 !* strin1 Y@ * (8 .. @ * (8Z. Sen d the !bov e ! t h ori: !tio n re9 e s t to the &BA, encr;- t e d !nd co2 2 ni c ! t e d 0ith SS@ version 5, or !bov e , sin1 SS@S?S$SW<TCS?#(S12 8SM75 !s the ci-her s it e. The -riv!t e 8e;, 6or the di1it!l certi6ic!t e 2 st be !t le!st 1,02( bits. W!it to receiv e ! res- o n s e 6ro2 the &BA.
Com m e n t & . When est ! blishi n 1 !n SS@ ses sion bet0 e e n the S%T !nd the &BA, ! 6 ll SS@ h!n d s h ! 8 e 2 st be -er6or 2 e d -rior to the e+ch ! n 1 e o6 !n; ! t h ori: ! tion re9 e s t s !nd res- o n s e s . A!ch SS@ ses sion is !llo0e d to be se d 6or ! 2 !+i 2 2 o6 200 seco n d s 6ro2 the ti2 e it 0!s est ! blish e d , or 6or ! 2!+i 2 2 o6 100 ! t h ori: ! tion s, 0hich ev e r co2 e s 6irst. =nce this constr !i n t is 2 et, ! 6 ll SS@ h!n d s h ! 8 e 2 st !1!i n be -er6or 2 e d . The -rotocol 6or ! 6 ll h!n d s h ! 8 e is identic !l to the -rotocol o6 the ori1in!l h!n d s h ! 8 e 'e+ ec t e d 0he n the ses sion 0!s est ! blish e d ). This incl d e s the tr!n s6 e r o6 ! di1it !l certi6ic!t e 6ro2 the &BA to the S%T, !nd the 1en e r ! t i o n o6 ! ne0 encr;- tio n 8e;. $ltern ! t el ;, ! ne0 SS@ ses sion c!n be est ! blish e d . <6 ! ne0 sessio n is est ! blis h e d , the e+-ire d SS@ ses sion 2! ; be se d 6or -en di n 1 ! t h ori: ! tion res- o n s e s 6ro2 the &BA to the S%T, b t the e+-ire d ses sion c!n n o t be se d to sen d !n; ne0 ! t h ori: !tio n re9 e s t s . The n 2 b e r o6 SS@ ses sion s est ! blish e d !nd conn e c tio n s o-e n !t !n; 1iven -oint in ti2 e bet0 e e n the S%T !nd the &BA is not li2ited. Com m e n t 4A $ thori: !tion re9 e s t s c!nn o t be co2 bi n e d 0ithin ! sin1le SS@ 2e s s ! 1 e . Com m e n t 6A M!n! 1 e 2 e n t o6 SS@ ses sion s c!n be don e in the !--lic!tio n, !nd does not re9 ir e co2 2 e r ci !ll; !v!il!bl e -rod c t s.
7ecr;-t the ! t hori: ! tion res- o n s e 6ro2 the &BA !nd e+tr! ct the ! t h ori: !tio n code, $%TCS<7, 6ro2 the 2 es s ! 1 e , 0hich is enclos e d b; the t!1s U#=7A V !nd U/#=7A V. See cl! s e 6.(.5 6or the 6or2 ! t o6 the ! t h ori: !tio n res-o n s e 2 es s ! 1 e 6or2 the &BA.
#re!t e s ! ne0 credit c!rd record !s 6ollo0s, 0ithin ! sin1l e d!t ! b ! s e tr!n s ! c ti o n. U s t ! r t tr!n s ! c ti o n V $ record is !dd e d to the ##SJ$#TS t!bl e 0ith. #JS=S<7 is set to =S<7 #JSTK&A is set to ##STK&A St!nd!rd S-eci6ic!tion Version &'( &!1e lii
T&# Bench2!r8I W
#JSN%M is set to ##SN%MBA? #JSN$MA is set to ##SN$MA #JSAJ&<?K is set to ##SAJ&<?K #JS$%TCS<7 is set to $%TCS<7 #JSJ$#TS$MT is set to S#ST=T$@ #JSJ$#TS7$TA is set to the # rren t d!t e !nd ti2 e on the S%T #JS#=S<7 is set to #=%NT?K 6ro2 the shi--in 1 !ddr e s s
U e n d tr!n s ! c ti o n V #le!rs !ll S#@S^ ite2 s 6ro2 the #$?T !nd -d ! t e s S#S7$TA to c rre n t d!t e !nd ti2 e
U e n d !to 2i c set V Com m e n t & . The !--lic!tio n -ro1r ! 2 2 !; i2-le 2 e n t the !bov e set o6 !to 2ic o-er ! tio n s b; incl din 1 !ll o6 the e+ec tio n ste- s 0ithin ! sin1le d!t ! b ! s e tr!n s ! c ti o n. Com m e n t 4 . <n the eve n t o6 ! 6!il re !nd rollb!c8 o6 !n !to 2i c set o6 o-er ! tio n s involvin1 the &BA 's ch !s !bov e), the &BA is not re9 ir e d to re2 ov e the =S<7 or the ! t h ori: ! tion n 2 b e r 6ro2 the &BALs d r! bl e 2e di 2 i6 the; h!v e !lre ! d ; be e n record e d . 2.,.5.( The S%T -rod c e s the CTM@ cod e 6or the B ; #on6ir2 -!1 e, incl din 1 the co2 -l e t e order in6or2 ! tio n !nd the c sto 2 e r in6or2 ! tio nG !nd ret rn s the -!1 e to the AB. The AB select s ! n!vi1 ! ti o n o-tion !ccordi n 1 to #l! s e 5.2.2. Re s p o n s e Pa g e )efi ni ti o n $ s! 2 -l e o6 the B ; #on6ir2 &!1e is sho0n belo0 !s it 0o ld !-- e ! r in ! Bro0s er.
2.,.5.5 4' = ' 8
T&# Bench2!r8I W
&!1e
liii
The CTM@ cod e 6or the B ; #on6ir2 &!1e '!n e+ ! 2 -l e o6 0hich c!n be 6o nd in $--e n di+ F) 2 st 2 e e t the 6ollo0in1 re9 ire 2 e n t s . 1. 2. The len1t h o6 the cod e 2 st be ! 2ini2 2 o6 1,55 0 ch!r ! c t e r s. The 6ollo0in1 0eb obEect s 2 st be re6er e n c e d . 5. <2!1 e s 6or the UCo 2 e V !nd US e ! r c h V b tto n s
The 6ollo0in1 d!t ! 2 st be dis-l! ;e d .
T&# Bench2!r8I W
&!1e
liv
4' = ' : 2.,.5.1 2.,.5.2
=S<7 #S7<S#=%NT or S#S#S7<S#=%NT S#SS%BST=T$@ S#ST$J S#SSC<&S#=ST S#ST=T$@ For e!c h line in the #$?T S#@SDTK S#@ST<T@A S#@SB$#><NB S#@SS?& S#@S#=ST
EB Na-i g a t i o n .pti o n s UCo 2 e V b tt o n. M!8e !n CTT& re9 e s t to initi!t e the Co2 e 0eb inter ! c ti on. US e ! r c h V b tt o n. M!8e !n CTT& re9 e s t to initi!t e the Se!rc h ?e9 e s t 0eb inter ! c ti on.
4 ' ( .r # e r 2n B u ir * W e b 2n t e r a c t i o n
4' ( ' & .-er-i e " This sec r e 0eb inter ! c ti on ret rn s to the AB ! 0eb -!1 e 0hich !llo0s ! %ser to -rovid e the in6or2 ! ti o n nec e s s ! r ; to ent e r or con6ir2 their identit ; !s ! ret rni n 1 c sto 2 e r . This is the 6irst ste- in dis-l !;i n 1 in6or2 ! tio n !bo t the c st o 2 e rLs l!st order. 4' ( ' 4 2.8.2.1 2npu t ReB uir e m e n t s This 0eb inter ! c tio n is invo8e d b; !n CTT& re9 e s t !nd re9 ire s the 6ollo0in1 in- t d!t !. 4' ( ' 6 2.8.5.1 The %?@ 6or the =rder <n9 ir; &!1e, 0hich is cont !i n e d in the CTT& re9 e s t .
Proc e s s i n g )efi ni ti o n <6 this %ser is ! # sto 2 e r !nd its #S<7 is 8no0n, the S%T obt !in s the 6ollo0in1 in6or2 ! tio n !bo t the # sto 2 e r . #S%N$MA #S%N$MA i6
2.8.5.2
The S%T -rod c e s the CTM@ code 6or the =rder <n9 ir; &!1e, cont !i ni n 1 !v!il!bl e, !nd ret rn s the 0eb -!1 e to the AB. The AB select s ! n!vi1 ! ti o n o-tion !ccordi n 1 to #l! s e 5.2.2.
2.8.5.5
T&# Bench2!r8I W
&!1e
lv
4' ( ' 8
Re s p o n s e Pa g e )efi ni ti o n $ s! 2 -l e o6 the =rder <n9 ir; &!1e is sho0n belo0 !s it 0o ld !-- e ! r in ! Bro0s er.
The CTM@ cod e 6or the =rder <n9 ir; &!1e '!n e+! 2 -l e o6 0hich c!n be 6o nd in $--en di+ F) 2 st 2 e e t the 6ollo0in1 re9 ire 2 e n t s . 1. 2. The len1t h o6 the code 2 st be ! 2ini 2 2 o6 955 ch!r ! c t e r s . The 6ollo0in1 0eb obEect s 2 st be re6er e n c e d . 5. <2!1 e s 6or the U7is-l ! ; @!st =rder V , UCo 2 e V !nd US e ! r c h V b tto n s
The 6ollo0in1 d!t ! 2 st be dis-l !;e d i6 retriev e d 6ro2 the S%T. #S%N$MA
4' ( ' : 2.8.5.1
EB Na-i g a t i o n .pti o n s U7is-l ! ; @!st =rder V b tto n. M!8e !n CTT& re9 e s t inter ! c tio n, 0ith the 6ollo0in1 in- t. <6 ! #S<7 is 8no0n, the n. %N$MA is 1en e r ! t e d b; the AB !ccor din 1 to cl! s e (.6.2.1 0 &$SSW7 is 1en e r ! t e d b; the AB !ccordi n 1 to cl! s e (.6.2.1 1 to initi!t e the =rder 7is-l!; 0eb
<6 ! #S<7 is not 8no0n, then. $ te 2 - or ! r ; #S<7 is 1en e r ! t e d b; the AB sin1 the 2 et h o d de6in e d in 2.5.2. This #S<7 is the n se d to 1en e r ! t e d the 6ollo0in1. %N$MA is 1en e r ! t e d b; the AB !ccor din 1 to #l! s e (.6.2.1 0. &$SSW7 is 1en e r ! t e d b; the AB !ccordi n 1 to #l! s e (.6.2.1 1.
T&# Bench2!r8I W
&!1e
lvi
#o2 2 e n t . The order in9 ir; #S<7 bein 1 1en e r ! t e d to s!tis6; this inter ! c tion is te 2 - or ! r ; !nd doe s not 2!8 e the ser ! ret r nin 1 c st o 2 e r. This #S<7 is se d onl; b; this inter ! c tio n to n!vi1! t e to =rder 7is-l!; inter ! c ti on. The ser still re2 !i n s to be !n n8no0 n ser 6or rest o6 the inter ! c ti on s. 2.8.5.2 2.8.5.5 UCo 2 e V b tt o n. M!8e !n CTT& re9 e s t to initi!t e the Co2 e 0eb inter ! c ti on. US e ! r c h V b tt o n. M!8e !n CTT& re9 e s t to initi!t e the Se!rc h ?e9 e s t 0eb inter ! c ti on.
4 ' > .r # e r )i s p a * W e b 2n t e r a c t i o n
4' > ' & .-er-i e " This sec r e 0eb inter ! c tio n ret rn s to the AB ! 0eb -!1 e 0hich dis-l! ;s the st!t s o6 the l!st order -l!c e d b; the c sto 2 e r . 4' > ' 4 2npu t ReB uir e m e n t s This 0eb inter ! c ti on is invo8e d b; !n CTT& re9 e s t !nd re9 ir e s the 6ollo0in1 in- t d!t !. The %?@ 6or the =rder 7is-l!; &!1e, 0hich is cont !i n e d in the CTT& re9 e s t . The 6ollo0in1 c sto 2 e r identi6ic!tion in6or2 ! tio n. 4' > ' 6 2.9.5.1 %N$MA &$SSW7
Proc e s s i n g )efi ni ti o n The S%T obt !i ns the #S&$SSW7 6ro2 the c st o 2 e r 0ith '#S%N$MA [ %N$MA) !nd co2 - ! r e s &$SSW7 0ith #S&$SSW7. Com m e n t . The !--lic!tio n -ro1r ! 2 is re9 ir e d to incl d e lo1ic to de!l 0ith inv!lid -!s s0 or d s b; ret r nin 1 !n error 2e s s ! 1 e to the AB. <n the cont e + t o6 the benc h 2 ! r 8 , !ll s --lie d -!s s0 or d s 0ill be v!lid, !llo0in1 the -roc e s si n 1 o6 the order to contin e . $ll conv e n ti o n !l 2 e ! n s o6 -!s s0 or d ! t h e n ti c ! tio n 'e.1., sin1 ! direct or; serv er vi! @7$&) !re !cc e - t ! bl e 6or this - r-o s e .
2.9.5.2
The S%T obt !i ns the 6ollo0in1 in6or2 ! tio n !bo t the l!st order o6 the c st o 2 e r b!s e d on its #S%N$MA !nd 0ithin ! sin1l e d!t ! b ! s e tr!n s ! c ti o n. =S<7 #SFN$MA #S@N$MA #S&C=NA #SAM$<@ =S7$TA =SS%BST=T$@
T&# Bench2!r8I W
&!1e
lvii
=ST$J =ST=T$@ =SSC<&STK&A =SSC<&S7$TA =SST$T%S For For For the billin1 !ddr e s s $77?SST?AAT1 $77?SST?AAT2 $77?S#<TK $77?SST$TA $77?ST<& #=SN$MA the shi--in 1 !ddr e s s $77?SST?AAT1 $77?SST?AAT2 $77?S#<TK $77?SST$TA $77?ST<& #=SN$MA e!c h ite2 on the order. =@S<S<7 <ST<T@A <S&%B@<SCA? <S#=ST =@SDTK =@S7<S#=%NT =@S#=MMANTS
Fro2 the credit c!rd tr!n s ! c ti o n o6 the order. #JSTK&A #JS$%TCS<7
2.9.5.5
The S%T -rod c e s the CTM@ cod e 6or the =rder 7is-l!; &!1e cont !i ni n 1 the in6or2 ! tio n obt !in e d !nd ret r n s the 0eb -!1 e to the AB. Com m e n t & . <6 ther e !re no orders 6or this # sto 2 e r , the n the =rder 7is-l!; &!1e is dis-l! ;e d 0ith no order d!t ! in it. Com m e n t 4 . 7 e to the initi!l d!t ! b ! s e bein1 b!s e d on r!nd o 2 v!l e s !nd online ite2 -rices, the order s bt ot !l 2i1ht not 2!t c h the s 2 o6 the order line costs. -d ! t e s to
2.9.5.(
The AB select s ! n!vi1 ! ti o n o-tion !ccordi n 1 to #l! s e 5.2.2.
T&# Bench2!r8I W
&!1e
lviii
4' > ' 8
Re s p o n s e Pa g e )efi ni ti o n $ s! 2 -l e o6 the =rder 7is-l!; &!1e is sho0n belo0 !s it 0o ld !-- e ! r in ! Bro0s er.
T&# Bench2!r8I W
&!1e
li+
The CTM@ cod e 6or the =rder 7is-l!; &!1e '!n e+! 2 -l e o6 0hich c!n be 6o nd in $--e n di+ F) 2 st 2 e e t the 6ollo0in1 re9 ire 2 e n t s . 1. 2. The len1t h o6 the code 2 st be ! 2ini 2 2 o6 1,,15 ch!r ! c t e r s . The 6ollo0in1 0eb obEect s 2 st be re6er e n c e d . 5. <2!1 e s 6or the UCo 2 e V !nd US e ! r c h V b tto n s
The 6ollo0in1 2 st be dis-l !;e d i6 retriev e d 6ro2 the S%T. =S<7 =S7$TA =SSC<&STK&A =SSC<&S7$TA =SS%BST=T$@ =ST$J =ST=T$@ #SFN$MA #S@N$MA #SAM$<@ #S&C=NA #J*TK&A =SST$T%S
$ billin1 !ddr e s s cont !i ni n 1. $77?SST?AAT1 $77?SST?AAT2 $77?S#<TK $77?SST$TA $77?ST<& $77?S#=
$ shi--in 1 !ddr e s s cont !i ni n 1 $77?SST?AAT1 $77?SST?AAT2 $77?S#<TK $77?SST$TA $77?ST<& $77?S#=
For e!c h line in the order. =@S<S<7
T&# Bench2!r8I W
&!1e
l+
4' > ' : 2.9.5.1 2.9.5.2
<ST<T@A <S&%B@<SCA? <S#=ST =@SDTK =@S7<S#=%NT =@S#=MMANTS
EB Na-i g a t i o n .pti o n s UCo 2 e V b tt o n. M!8e !n CTT& re9 e s t to initi!t e the Co2 e 0eb inter ! c ti on. US e ! r c h V b tt o n. M!8e !n CTT& re9 e s t to initi!t e the Se!rc h ?e9 e s t 0eb inter ! c ti on.
4'&+
S e a r c $ R e B u e s t W e b 2n t e r a c t i o n
4' & + ' & .-er-i e " This n-rot e c t e d 0eb inter ! c tio n ret rn s to the AB ! 0eb -!1 e 0hich !llo0s ! %ser to s-eci6; se!rc h criteri ! to 6ind 9 !li6;in1 ite2 s. 4' & + ' 4 2npu t ReB uir e m e n t s This 0eb inter ! c ti on is invo8e d b; !n CTT& re9 e s t !nd re9 ir e s the 6ollo0in1 in- t d!t !. The %?@ 6or the Se!rc h ?e9 e s t &!1e, 0hich is cont !i n e d in the CTT& re9 e s t .
4' & + ' 6 Proc e s s i n g )efi ni ti o n 2.10.5.1 The S%T e+ ec t e s the &ro2 otion !l &roce s si n 1, !s de6ine d in #l! s e 2.2.1 8. 2.10.5.2 The S%T -rod c e s the CTM@ cod e 6or the Se!rc h ?e9 e s t &!1e !nd ret r n s the 0eb -!1 e to the AB. 2.10.5.5 The AB select s ! n!vi1 ! ti o n o-tion !ccordi n 1 to #l! s e 5.2.2. 4' & + ' 8 Re s p o n s e Pa g e )efi ni ti o n $ s! 2 -l e o6 the Se!rc h ?e9 e s t &!1e is sho0n belo0 !s it 0o ld !-- e ! r in ! Bro0ser.
T&# Bench2!r8I W
&!1e
l+i
The CTM@ cod e 6or the Se!rc h ?e9 e s t &!1e '!n e+! 2 -l e o6 0hich c!n be 6o nd in $--en di+ F) 2 st 2e e t the 6ollo0in1 re9 ir e 2 e n t s . 1. 2. The len1t h o6 the code 2 st be ! 2ini 2 2 o6 2,00( ch!r ! c t e r s . The 6ollo0in1 0eb obEect s 2 st be re6er e n c e d . <2!1 e s 6or the US h o - -i n 1 #!rt V , US b 2 i t V !nd UCo 2 e V b tt o n s <2!1 e 6or the T&# @o1o <2!1 e s 6or the th 2 b n ! il o6 the 6ive -ro2 o tio n !l ite2 s
4' & + ' : EB Na-i g a t i o n .pti o n s 2.10.5.1 US b 2 i t V b tt o n. M!8e !n CTT& re9 e s t to initi!t e the Se!rc h ?es lt 0eb inter ! c tion, 0ith the 6ollo0in1 in- t. The AB select s ! SA$?#CSTK&A 6ro2 ! Y$%TC=?, T<T@A, S%B"A#TZ ni6or 2 distrib tion over the 6ollo0in1 v!l e s.
<6 SA$?#CSTK&A is select e d to be $%TC=? then SA$?#CSST?<NB is set to 7i1S;l'N%?!nd'$, 1, N%MS<TAMS/10), ,).
T&# Bench2!r8I W
&!1e
l+ii
Com m e n t . SA$?#CSST?<NB is 2 e ! n t to 2!t c h ! s bst rin 1 e2 b e d d e d in the $S@N$MA 6ield o6 the $%TC=? t!bl e !s describ e d in cl! s e (.6.2.1 9. This sho ld ;ield !n !ver ! 1 e o6 2.5 $ thors !nd 10 boo8s. <6 SA$?#CSTK&A is select e d to be T<T@A the n SA$?#CSST?<NB is set to 7i1S;l'N%?!nd'$, 1, N%MS<TAMS/5), ,). Com m e n t . SA$?#CSST?<NB is 2 e ! n t to 2!t c h ! s bst rin 1 e2 b e d d e d in the <ST<T@A 6ield o6 the <TAM t!bl e !s describ e d in cl! s e (.6.2.1 9. This sho l d ;ield !n !ver ! 1 e o6 5 boo8s. <6 SA$?#CSTK&A is select e d to be S%B"A#T then SA$?#CSST?<NB is 1en e r ! t e d 6ro2 ! ni6or2 r!nd o 2 distrib tion !ccordi n 1 to #l! s e (.6.2.1 2.
<n the !bov e N%?!nd 6 nction s, the v!l e 6or $ 2 st be select e d 6ro2 the 6ollo0in1 t!bl e de- e n di n 1 on N%MS<TAMS, the n 2 b e r o6 ro0 in the <TAM t!bl e 'see cl! s e s (.5 !nd (.,).
5or N9MD2TEMS 1,00 0 10,00 0 100,0 0 0 1,000, 0 0 0 10,00 0, 0 0 0
?a u e for A 65 511 (,095 52,, 6 , 52(,2 8 ,
2.10.5.2 UCo 2 e V b tt o n. M!8e !n CTT& re9 e s t to initi!t e the Co2 e 0eb inter ! c ti on. 2.10.5.5 US h o - -i n 1 #!rt V b tt o n. M!8e !n CTT& re9 e s t to initi!t e the Sho- -i n 1 #!rt 0eb inter ! c tio n, 0ith the 6ollo0in1 in- t. $n e2 - t ; list o6 '<S<7, DTK) -!irs The $77SF@$B is set to QNR
4' &&
S e a r c $ R e s u t W e b 2n t e r a c t i o n
4' & & ' & .-er-i e " This n-rot e c t e d 0eb inter ! c ti on ret rn s to the AB ! 0eb -!1 e 0hich cont !i n s the list o6 ite2 s th!t 2!t c h ! 1iven se!rc h criteri!. 4' & & ' 4 2npu t ReB uir e m e n t s This 0eb inter ! c ti on is invo8e d b; !n CTT& re9 e s t !nd re9 ir e s the 6ollo0in1 in- t d!t !. The %?@ 6or the Se!rc h ?es lt &!1e, 0hich is cont !i n e d in the CTT& re9 e s t . The 6ollo0in1 t0o 6ields. SA$?#CSTK&A SA$?#CSST?<NB St!nd!rd S-eci6ic!tion Version &'( &!1e l+iii
T&# Bench2!r8I W
4' & & ' 6 Proc e s s i n g )efi ni ti o n 2.11.5.1 =6 the entire set o6 '<S<7, <ST<T@A) -!irs 6or ite2 s th!t 2 !t c h the selectio n criteri !, sort e d b; !sc e n di n 1 <ST<T@A, the 6irst 50 -!irs 'or less i6 the entire set cont !i n s less th!n 50 -!irs) !re obt !in e d . The S%T is -er 2it t e d to e+ec t e the se!rc h 0ith ! co2 2 e r ci !ll; !v!il!bl e te+t se !rc h en1in e 'see #l! s e 2.2.15 !nd #l! s e 6.5.5.1). The 6ollo0in1 se !rc h -redic ! t e s !re se d '0her e Us trin 1 V is the cont e n t o6 SA$?#CSST?<NB). <6 SA$?#CSTK&A [ Q$%TC=?R, the se!rc h -re dic ! t e is. U strin 1 V is 6o nd !t the be1i n ni n 1 o6 !n; 0ord in $S@N$MA <6 SA$?#CSTK&A [ QT<T@AR, the se !rc h -redic ! t e is. U strin 1 V is 6o nd !t the be1i n ni n 1 o6 !n; 0ord in <ST<T@A <6 SA$?#CSTK&A [ QS%B"A#TR, the se !rc h -redic ! t e is. <SS%B"A#T [ QUs trin 1 V R #o2 2 e n t . #l! s e 6.5.5.1 de6in e s the re9 ire 2 e n t s 6or se!rc h res lts consist e n c ;. 2.11.5.2 The S%T e+ ec t e s the &ro2 otion !l &roce s si n 1, !s de6ine d in #l! s e 2.2.1 8. 2.11.5.5 The S%T -rod c e s the CTM@ code 6or the Se!rc h ?es lt &!1e cont !i nin 1 the 6ields <ST<T@A, $SFN$MA, $S@N$MA 6or the list o6 ite2 s obt !in e d 0ith lin8s to the &rod ct 7et !il -!1 e s 6or the s e ite2 s !nd ret r n s the 0eb -!1 e to the AB. 2.11.5.( The AB select s ! n!vi1 ! ti o n o-tion !ccordi n 1 to #l! s e 5.2.2. 4' & & ' 8 Re s p o n s e Pa g e )efi ni ti o n $ s! 2 -l e o6 the Se!rc h ?es lt &!1e is sho0n belo0 !s it 0o ld !-- e ! r in ! Bro0s er.
T&# Bench2!r8I W
&!1e
l+iv
The CTM@ cod e 6or the Se!rc h ?es lt &!1e '!n e+ ! 2 -l e o6 0hich c!n be 6o nd in $--e n di+ F) 2 st 2 e e t the 6ollo0in1 re9 ire 2 e n t s . 1. 2. The len1t h o6 the code 2 st be ! 2ini 2 2 o6 1,891 ch!r ! c t e r s . The 6ollo0in1 0eb obEect s 2 st be re6er e n c e d . 5. <2!1 e s 6or the US h o - -i n 1 #!rt V , US e ! r c h V !nd UCo 2 e V b tto n s <2!1 e 6or the T&# @o1o <2!1 e s 6or the th 2 b n ! il o6 the 6ive -ro2 o tio n !l ite2 s
The 6ollo0in1 d!t ! 2 st be dis-l !;e d 6or e!c h ite2 6o nd in the se !rc h !nd retriev e d 6ro2 the S%T. $SFN$MA $S@N$MA <ST<T@A
T&# Bench2!r8I W
&!1e
l+v
4' & & ' : EB Na-i g a t i o n .pti o n s 2.11.5.1 US h o - -i n 1 #!rt V b tt o n. M!8e !n CTT& re9 e s t to initi!t e the Sho- -i n 1 #!rt 0eb inter ! c tio n, 0ith the 6ollo0in1 in- t. $n e2 - t ; list o6 '<S<7, DTK) -!irs The $77SF@$B is set to QNR
2.11.5.2 US e ! r c h V b tt o n. M!8e !n CTT& re9 e s t to initi!t e the Se!rc h ?e9 e s t 0eb inter ! c ti on. 2.11.5.5 U<t e 2 Title V lin8. M!8e !n CTT& re9 e s t to initi!t e the &rod ct 7et!il 0eb inter ! c tio n, 0ith the 6ollo0in1 in- t. <S<7, 0her e the AB select s 6ro2 ! %?@s 6or obt !i n e d ite2 s. ni6or 2 r!ndo 2 distrib tion one entr; 6ro2 the list o6
2.11.5.( UCo 2 e V b tt o n. M!8e !n CTT& re9 e s t to initi!t e the Co2 e 0eb inter ! c ti on.
4'&4
N e " Pr o # u c t s W e b 2n t e r a c t i o n
4' & 4 ' & .-er-i e " This n-rot e c t e d 0eb inter ! c ti on ret rn s to the AB ! 0eb -!1 e 0hich cont !i n s the list o6 rece n tl ; rele ! s e d ite2 s. 4' & 4 ' 4 2npu t ReB uir e m e n t s This 0eb inter ! c ti on is invo8e d b; !n CTT& re9 e s t !nd re9 ir e s the 6ollo0in1 in- t d!t !. The %?@ 6or the Ne0 &rod ct s &!1e, 0hich is cont !i n e d in the CTT& re9 e s t . The 6ollo0in1 6ield. S%B"A#TSST?<NB
4' & 4 ' 6 Proc e s s i n g )efi ni ti o n 2.12.5.1 =6 the entire set o6 '<S<7, <ST<T@A) -!irs 6or ite2 s on the select e d s bE ect, sort e d b; desc e n di n 1 <S&%BS7$TA !nd !sc e n di n 1 <ST<T@A, the 6irst 50 -!irs 'or less i6 the entire set cont !i n s less th! n 50 -!irs) !re obt !in e d . The 6ollo0in1 se!rc h -redic ! t e is se d '0her e U strin 1 V is the cont e n t o6 S%B"A#TSST?<NB). <S S%B"A#T [ QUst ri n 1 V R The d!t ! b ! s e re! d s to 1en e r ! t e the list o6 50 Ne0 &rod ct s 2 !; be -er6or 2 e d !t !n isol!tion level o6 0, 'see #l! s e 5.1.(.1). 2.12.5.2 The S%T e+ ec t e s the &ro2 otion !l &roce s si n 1, !s de6ine d in #l! s e 2.2.1 8. 2.12.5.5 The S%T -rod c e s the CTM@ code 6or the Ne0 &rod ct s &!1e cont !i nin 1 the 6ields <ST<T@A, $SFN$MA, $S@N$MA 6or the list o6 ite2 s obt !in e d 0ith lin8s to the &rod ct 7et !il -!1 e s 6or the s e ite2 s !nd ret r n s the 0eb -!1 e to the AB.
T&# Bench2!r8I W
&!1e
l+vi
2.12.5.( The AB select s ! n!vi1 ! ti o n o-tion !ccordi n 1 to #l! s e 5.2.2. 4' & 4 ' 8 Re s p o n s e Pa g e )efi ni ti o n $ s! 2 -l e o6 the Ne0 &rod ct s &!1e is sho0n belo0 !s it 0o ld !-- e ! r in ! Bro0ser.
T&# Bench2!r8I W
&!1e
l+vii
T&# Bench2!r8I W
&!1e l+viii
The CTM@ cod e 6or the Ne0 &rod ct s &!1e '!n e+ ! 2 -l e o6 0hich c!n be 6o nd in $--en di+ F) 2 st 2 e e t the 6ollo0in1 re9 ire 2 e n t s . 1. 2. The len1t h o6 the code 2 st be ! 2ini 2 2 o6 8,095 c h ! r ! c t e r s . The 6ollo0in1 0eb obEect s 2 st be re6er e n c e d . 5. <2!1 e s 6or the US h o - -i n 1 #!rt V , US e ! r c h V !nd UCo 2 e V b tto n s <2!1 e 6or the T&# @o1o <2!1 e s 6or the th 2 b n ! il o6 the 6ive -ro2 o tio n !l ite2 s
The 6ollo0in1 d!t ! 2 st be dis-l !;e d 6or e!c h ite2 retriev e d 6ro2 the S%T. $SFN$MA $S@N$MA <ST<T@A
4' & 4 ' : EB Na-i g a t i o n .pti o n s 2.12.5.1 US h o - -i n 1 #!rt V b tt o n. M!8e !n CTT& re9 e s t to initi!t e the Sho- -i n 1 #!rt 0eb inter ! c tio n, 0ith the 6ollo0in1 in- t. $n e2 - t ; list o6 '<S<7, DTK) -!irs The $77SF@$B is set to QNR
4'&6
B e s t S e e r s W e b 2n t e r a c t i o n
4' & 6 ' & .-er-i e " This n-rot e c t e d 0eb inter ! c ti on ret rn s to the AB ! 0eb -!1 e 0hich cont !i n s the list o6 best seller ite2 s. 4' & 6 ' 4 2npu t ReB uir e m e n t s This 0eb inter ! c ti on is invo8e d b; !n CTT& re9 e s t !nd re9 ir e s the 6ollo0in1 in- t d!t !. The %?@ 6or the Best Sellers &!1e, 0hich is cont !i n e d in the CTT& re9 e s t . The 6ollo0in1 6ield. S%B"A#TSST?<NB
T&# Bench2!r8I W
&!1e
l+i+
4' & 6 ' 6 Proc e s s i n g )efi ni ti o n 2.15.5.1 =6 the entire set o6 '<S<7, <ST<T@A) -!irs 6or ite2 s on the select e d s bE ect, the 6irst 50 -!irs 'or less i6 the entire set cont !i n s less th! n 50 -!irs) !re obt !in e d . The 6ollo0in1 se !rc h -redic ! t e is se d '0her e Ust ri n 1 V is the cont e n t o6 S%B"A#TSST?<NB). <SS%B"A#T [ QUst ri n 1 V R 6or the order lines o6 the 5,55 5 2ost rece n t orders '0her e =S<7 [ =@S=S<7) b!s e d on =S7$TA !nd sort e d b; desc e n di n 1 s 2'=@SDTK) 1ro - e d on =@S<S<7 The d!t ! b ! s e re! d s to 1en e r ! t e the list o6 50 Best Sellers 2 !; be -er6or 2 e d !t !n isol!tion level o6 0 'se e #l! s e 5.1.(.1). 2.15.5.2 The S%T e+ ec t e s the &ro2 otion !l &roce s si n 1, !s de6ine d in #l! s e 2.2.1 8. 2.15.5.5 The S%T -rod c e s the CTM@ cod e 6or the Best Sellers &!1e cont !i nin 1 the 6ields <ST<T@A, $SFN$MA, $S@N$MA 6or the list o6 ite2 s obt !in e d 0ith lin8s to the &rod ct 7et !il -!1 e s 6or the s e ite2 s !nd ret r n s the 0eb -!1 e to the AB. 2.15.5.( The AB select s ! n!vi1 ! ti o n o-tion !ccordi n 1 to #l! s e 5.2.2. 4' & 6 ' 8 Re s p o n s e Pa g e )efi ni ti o n $ s! 2 -l e o6 the Best Sellers &!1e is sho0n belo0 !s it 0o ld !-- e ! r in ! Bro0s er.
T&# Bench2!r8I W
&!1e
l++
T&# Bench2!r8I W
&!1e
l++i
The CTM@ cod e 6or the Best Sellers &!1e '!n e+ ! 2 -l e o6 0hich c!n be 6o nd in $--en di+ F) 2 st 2 e e t the 6ollo0in1 re9 ire 2 e n t s . 1. 2. The len1t h o6 the code 2 st be ! 2ini 2 2 o6 6,6(0 ch!r ! c t e r s . The 6ollo0in1 0eb obEect s 2 st be re6er e n c e d . 5. <2!1 e s 6or the US h o - -i n 1 #!rt V , US e ! r c h V !nd UCo 2 e V b tto n s <2!1 e 6or the T&# @o1o <2!1 e s 6or the th 2 b n ! il o6 the 6ive -ro2 o tio n !l ite2 s
The 6ollo0in1 d!t ! 2 st be dis-l !;e d i6 retriev e d 6ro2 the S%T. $SFN$MA $S@N$MA <ST<T@A
4' & 6 ' : EB Na-i g a t i o n .pti o n s 2.15.5.1 US h o - -i n 1 #!rt V b tt o n. M!8e !n CTT& re9 e s t to initi!t e the Sho- -i n 1 #!rt 0eb inter ! c tio n, 0ith the 6ollo0in1 in- t. $n e2 - t ; list o6 '<S<7, DTK) -!irs The $77SF@$B is set to QNR
4'&8
P r o # u c t ) e t a i W e b 2n t e r a c t i o n
4' & 8 ' & .-er-i e " This n-rot e c t e d 0eb inter ! c tio n ret rn s to the AB ! 0eb -!1 e 0hich cont !i n s det !ile d in6or2 ! ti o n on ! select e d ite2. 4' & 8 ' 4 2npu t ReB uir e m e n t s 2.1(.2.1 This 0eb inter ! c tio n is invo8e d b; !n CTT& re9 e s t !nd re9 ire s the 6ollo0in1 in- t d!t !. The %?@ 6or the &rod ct 7et!il &!1e, 0hich is cont !i n e d in the CTT& re9 e s t . <S<7
T&# Bench2!r8I W
&!1e
l++ii
4' & 8 ' 6 Proc e s s i n g )efi ni ti o n 2.1(.5.1 The S%T obt !i ns the 6ollo0in1 in6or2 ! ti o n 6or the select e d <S<7 0ithin ! sin1le d!t ! b ! s e tr!n s ! c ti o n. <ST<T@A $SFN$MA $S@N$MA <S&%BS7$TA <S&%B@<SCA? <SS%B"A#T <S7AS# The 1r!- hi c obEect re6er e n c e d b; <S<M$BA <S#=ST <SS?& <S$V$<@ <S<SBN <S&$BA <SB$#><NB <S7<MANS<=NS S!veR cost.
2.1(.5.2 The disco u n t is c!lc l !t e d !s the <SS?& 2in s <S#=ST !nd dis-l! ;e d !s the QKo
2.1(.5.5 The S%T -rod c e s the CTM@ code 6or the &rod ct 7et!il &!1e cont !i ni n 1 the in6or2 ! tio n obt !in e d !nd ret r n s the 0eb -!1 e to the AB. 2.1(.5.( The AB select s ! n!vi1 ! ti o n o-tion !ccordi n 1 to #l! s e 5.2.2. 4' & 8 ' 8 Re s p o n s e Pa g e )efi ni ti o n $ s! 2 -l e o6 the &rod ct 7et!il &!1e is sho0n belo0 !s it 0o ld !-- e ! r in ! Bro0s er.
T&# Bench2!r8I W
&!1e l++iii
The CTM@ cod e 6or the &rod ct 7et!il &!1e '!n e+ ! 2 -l e o6 0hich c!n be 6o nd in $--en di+ F) 2 st 2 e e t the 6ollo0in1 re9 ire 2 e n t s . 1. 2. The len1t h o6 the code 2 st be ! 2ini 2 2 o6 1,,26 ch!r ! c t e r s . The 6ollo0in1 0eb obEect s 2 st be re6er e n c e d . 5. <2!1 e s 6or the U$dd to #!rt V , US e ! r c h V , U%-d ! t e V !nd UCo 2 e V b tt o n s <2!1 e 6or the T&# @o1o <2!1 e 6or the ite2
The 6ollo0in1 d!t ! 2 st be dis-l !;e d !s retriev e d 6ro2 the S%T. <ST<T@A $SFN$MA $S@N$MA <SS%B"A#T <S7AS# <S#=ST St!nd!rd S-eci6ic!tion Version &'( &!1e l++iv
T&# Bench2!r8I W
Discou nt !s c!lc l !t e d in #l! s e 2.1(.5.2 <SB$#><NB <S&$BA <S&%B@<SCA? <S&%BS7$TA <S$V$<@ <S7<MANS<=NS <S<SBN
4' & 8 ' : EB Na-i g a t i o n .pti o n s 2.1(.5.1 U$dd to #!rt V b tt o n. M!8e !n CTT& re9 e s t to initi!t e the Sho--i n 1 #!rt 0eb inter ! c ti on, 0ith the 6ollo0in1 in- t. $ sin1l e '<S<7, DTK) -!ir, 0her e <S<7 is the select e d ite2 !nd DTK is set to 1 The $77SF@$B is set to QKR
2.1(.5.2 UCo 2 e V b tt o n. M!8e !n CTT& re9 e s t to initi!t e the Co2 e 0eb inter ! c ti on. 2.1(.5.5 US e ! r c h V b tt o n. M!8e !n CTT& re9 e s t to initi!t e the Se!rc h ?e9 e s t 0eb inter ! c ti on. 2.1(.5.( U<t e 2 Title V lin8. M!8e !n CTT& re9 e s t to initi!t e the &rod ct 7et!il 0eb inter ! c tio n, 0ith the 6ollo0in1 in- t. <S<7, 0her e the AB select s 6ro2 ! %?@s 6or obt !i n e d ite2 s. ni6or 2 r!ndo 2 distrib tion one entr; 6ro2 the list o6
Not e A This o-tion -ortr! ;s the n!vi1 ! ti o n o tco 2 e 6ro2 ! %ser sin1 the Bro0serLs b!c8* n!vi1! tio n 6e!t r e s to 1o b!c8 to the -revio s -!1 e 'either the Se!rc h ?es lt &!1e, the Ne0 &rod ct s &!1e or the Best Sellers &!1e) !nd selecti n 1 to see the det !ils o6 ! -rod c t. The list o6 %?@s 6ro2 the -revio s -!1 e is 2!int !i n e d in the #%?@ o6 the AB. 2.1(.5.5 U%-d ! t e V b tt o n. M!8e !n CTT& re9 e s t to initi!t e the $d2in ?e9 e s t 0eb inter ! c ti on 0ith the 6ollo0in1 in- t 6ield. <S<7
4'&:
A # m i n R e B u e s t W e b 2n t e r a c t i o n
4' & : ' & .-er-i e " This n-rot e c t e d 0eb inter ! c tio n ret rn s to the AB ! 0eb -!1 e 0hich !llo0s ! %ser to re9 e s t the -d ! t e o6 !n ite2. 4' & : ' 4 2npu t ReB uir e m e n t s This 0eb inter ! c ti on is invo8e d b; !n CTT& re9 e s t !nd re9 ir e s the 6ollo0in1 in- t d!t !.
T&# Bench2!r8I W
&!1e
l++v
The %?@ 6or the $d2in ?e9 e s t &!1e, 0hich is cont !i n e d in the CTT& re9 e s t . <S<7
4' & : ' 6 Proc e s s i n g )efi ni ti o n 2.15.5.1 The S%T obt !i ns the 6ollo0in1 d!t ! 6or the t!r1e t e d ite2. <SS?& <S#=ST <ST<T@A <S<M$BA <STC%MBN$<@ $SFN$MA $S@N$MA
2.15.5.2 The S%T -rod c e s the CTM@ code 6or the $d2in ?e9 e s t &!1e !nd ret r n s the 0eb -!1 e to the AB. 2.15.5.5 The AB select s ! n!vi1 ! ti o n o-tion !ccordi n 1 to #l! s e 5.2.2. 4' & : ' 8 Re s p o n s e Pa g e )efi ni ti o n $ s! 2 -l e o6 the $d2in ?e9 e s t &!1e is sho0n belo0 !s it 0o ld !-- e ! r in ! Bro0ser.
T&# Bench2!r8I W
&!1e l++vi
The CTM@ cod e 6or the $d2in ?e9 e s t &!1e '!n e+ ! 2 -l e o6 0hich c!n be 6o nd in $--en di+ F) 2 st 2e e t the 6ollo0in1 re9 ir e 2 e n t s . 1. 2. The len1t h o6 the code 2 st be ! 2ini 2 2 o6 1,551 ch!r ! c t e r s . The 6ollo0in1 0eb obEect s 2 st be re6er e n c e d . 5. <2!1 e s 6or the US b 2 i t #h!n 1 e s V , US e ! r c h V !nd UCo 2 e V b tt o n s <2!1 e 6or the T&# @o1o <2!1 e 6or the ite2 !nd its th 2 b n ! il
The 6ollo0in1 d!t ! is dis-l !;e d !s ret r n e d 6ro2 the S%T. <ST<T@A $SFN$MA $S@N$MA <SS?& <S#=ST
T&# Bench2!r8I W
&!1e l++vii
4' & : ' : EB Na-i g a t i o n .pti o n s 2.15.5.1 US b 2 i t #h!n 1 e s V b tto n. M!8e !n CTT& re9 e s t inter ! c tio n, 0ith the 6ollo0in1 in- t. The AB 1en e r ! t e s ! v!l e s 6or. <SNAWS<M$BA, 1en e r ! t e d !ccor din 1 to #l! s e (.6.2.1 5 6ro2 ! r!nd o 2 distrib tio n over the r!n1 e o6 <S<M$BA. <SNAWSTC%MBN$<@, 1en e r ! t e d !ccordi n 1 to #l! s e (.6.2.1 5 6ro2 ! r!ndo 2 distrib tion over the r!n 1 e o6 <STC%MBN$<@. <SNAWS#=ST, 1en e r ! t e d !ccor din 1 to #l! s e (.,.1 to initi!t e the $d2in #on6ir2 0eb
2.15.5.2 UCo 2 e V b tt o n. M!8e !n CTT& re9 e s t to initi!t e the Co2 e 0eb inter ! c ti on. 2.15.5.5 U Se!rc h V b tt o n. $ltho 1 h inter ! c tio n is ever initi!t e d. the Se!rc h B tton is dis-l !;e d no Se!rc h ?e9 e s t Web
4'&;
A # m i n C o n fir m W e b 2n t e r a c t i o n
4' & ; ' & .-er-i e " This n-rot e c t e d 0eb inter ! c ti on -d ! t e s !n ite2 !nd ret rn s to the AB ! 0eb -!1 e 0hich cont !i n s the det !ils o6 the -d ! t e d ite2. 4' & ; ' 4 2npu t ReB uir e m e n t s This 0eb inter ! c ti on is invo8e d b; !n CTT& re9 e s t !nd re9 ir e s the 6ollo0in1 in- t d!t !. The %?@ 6or the $d2in #on6ir2 &!1e, 0hich is cont !i n e d in the CTT& re9 e s t . <S<7 <SNAWS<M$BA <SNAWSTC%MBN$<@ <SNAWS#=ST
4' & ; ' 6 Proc e s s i n g )efi ni ti o n 2.16.5.1 The S%T obt !i ns the 6ollo0in1 in6or2 ! tio n 6or the t!r1e t e d ite2. <S<7 <ST<T@A $SFN$MA $S@N$MA <SS%B"A#T <S7AS# <S#=ST St!nd!rd S-eci6ic!tion Version &'( &!1e l++viii
T&# Bench2!r8I W
<S<M$BA <SS?& <SB$#><NB <S&$BAS <S&%B@<SCA? <S&%BS7$TA <S7<MANS<=NS <S<SBN
2.16.5.2 The S%T -d ! t e s the t!r1e t e d ite2 0ith '<S#=ST [ <SNAWS#=ST), '<S<M$BA [ <SNAWS<M$BA), '<S TC%MBN$<@ [ <SNAWS TC%MBN$<@) !nd '<S&%BS7$TA [ Uc rr e n t* d!t e V ) G 0ithin ! sin1l e d!t ! b ! s e tr!ns ! c ti o n. 2.16.5.5 The S%T -er6or 2 s the 6ollo0in1 -roce s si n 1 ste- s. =6 !ll the orders sort e d b; desc e n di n 1 =S7$TA, obt !in the set o6 the 6irst 10,00 0. Fro2 !ll orders th!t incl d e the t!r1 e t e d ite2 in the !bov e set, obt !in the set o6 c st o 2 e r s th!t -l!c e d the s e order s. ni9 e
Fro2 !ll c st o 2 e r s in the !bov e set, obt !i n the list o6 ni9 e ite2 s order e d b; the s e c st o 2 e r s 0ithin the !bov e set o6 10,0 0 0 orders, !nd sort thes e ite2 s b; desc e n di n 1 !11r e 1 ! t e d 9 ! n tit ; 'i.e., s 2'=@SDTK) 6or e!c h ni9 e =@S<S<7). <6 the sort e d list !bov e consist s o6 5 or 2or e ite2 s , e+cl din 1 <S<7. Then, obt !in the set '<S<71, <S<72, <S<75, <S<7(, <S<75) o6 the 6irst 6ive ite2 s.
<6 the sort e d list !bov e cont !i n s bet0 e e n 1 !nd ( ite2 s , e+cl di n 1 <S<7. Then, incre 2 e n t <S<7 6ro2 the l!st ite2 in the list ntil 5 ite2 s !re obt !i n e d . For e+! 2 -l e, i6 the list cont !i n s onl; 5 ite2 s, then '<S<7( [ <S<75 X 1) !nd '<S<75 [ <S<75 X 2), 0r!- -i n 1 b!c8 to the be1in ni n 1 o6 the <S<7 r!n 1 e i6 the end is re!c h e d !nd s8i--in 1 d -lic!t e ite2 s.
<6 the sort e d list !bov e cont !i n s no ite2 , or onl; <S<7. Then, cre! t e ! list o6 5 ite2 s b; incre 2 e n t i n 1 the t!r1 e t e d <S<7 b; ste - s o6 ,, s ch th!t '<S<71 [ <S<7 X ,), '<S<72 [ <S<7 X 1() '<S<75 [ <S<7 X 21) ''<S<7( [ <S<7 X 28) !nd '<S<75 [ <S<7 X 55), 0r!- -i n 1 b!c8 to the be1in ni n 1 o6 the <S<7 r!n 1 e i6 the end is re!c h e d .
%-d!t e the t!r1 e t e d ite2 0ith '<S?A@$TA71 [ <S<71), '<S?A@$TA72 [ <S<72), '<S?A@$TA75 [ <S<75), '<S?A@$TA7( [ <S<7() !nd '<S?A@$TA75 [ <S<75). #!lc l !t e s the discou n t !s <SS?& 2in s <S#=ST !nd dis-l !;s the discou n t !s the QKo S!veR !2 o n t .
Not e A The d!t ! b ! s e re!d s to 1en e r ! t e the 5 ite2 <7s 2 !; be -er6or 2 e d !t !n isol!tion level o6 0 'see #l! s e 5.1.(.1). The %-d!t e o6 the t!r1e t ite2 2 st be -er6or 2 e d !t the re9 ir e d -d ! t e isol!tion levels s-eci6ied in #l! s e 5.1.(.1. 2.16.5.( The S%T -rod c e s the CTM@ code 6or the $d2in #on6ir2 &!1e !nd ret rn s the 0eb -!1 e to the AB.
T&# Bench2!r8I W
&!1e l++i+
2.16.5.5 The AB select s ! n!vi1 ! ti o n o-tion !ccordi n 1 to #l! s e 5.2.2. 4' & ; ' 8 Re s p o n s e Pa g e )efi ni ti o n $ s! 2 -l e o6 the $d2in #on6ir2 &!1e is sho0n belo0 !s it 0o ld !-- e ! r in ! Bro0s er.
The CTM@ cod e 6or the $d2in #on6ir2 &!1e '!n e+ ! 2 -l e o6 0hich c!n be 6o nd in $--e n di+ F) 2 st 2e e t the 6ollo0in1 re9 ir e 2 e n t s . 1. 2. The len1t h o6 the code 2 st be ! 2ini 2 2 o6 1,5(9 ch!r ! c t e r s . The 6ollo0in1 0eb obEect s 2 st be re6er e n c e d . 5. <2!1 e s 6or the, US e ! r c h V !nd UCo 2 e V b tt o n s <2!1 e 6or the T&# @o1o The -d ! t e d i2! 1 e s 6or the ite2 !nd its th 2 b n ! il
The 6ollo0in1 d!t ! 2 st be dis-l !;e d !s retriev e d 6ro2 the S%T. <ST<T@A $SFN$MA St!nd!rd S-eci6ic!tion Version &'( &!1e l+++
T&# Bench2!r8I W
$S@N$MA <S7AS# <SS?& <S#=ST ' -d ! t e d v!l e) Discou nt !s c!lc l !t e d in #l! s e 2.16.5.5 <SB$#><NB <S&$BAS <S&%B@<SCA? <S&%BS7$TA ' -d ! t e d v!l e) <S7<MAN<S<=NS <S<SBN
4' & ; ' : EB Na-i g a t i o n .pti o n s 2.16.5.1 U Se!rc h V b tto n. M!8e !n CTT& re9 e s t to initi!t e the Se!rc h ?e9 e s t 0eb inter ! c tion. 2.16.5.2 UCo 2 e V b tt o n. M!8e !n CTT& re9 e s t to initi!t e the Co2 e 0eb inter ! c ti on.
T&# Bench2!r8I W
&!1e l+++i
C a u s e 6 , )ATABA SE TRAN SACT2.N AN ) S7 STEM PR. PERT2ES
6 ' & ) a t a b a s e Tra n s a c t i o n AC2) P r o p e r ti e s

<t is the inten t o6 this section to de6in e the $#<7 -ro- e rti e s re9 ir e 2 e n t s 6or d!t ! b ! s e tr!ns ! c ti o n s !nd to s-eci6; ! series o6 test s th!t 2 st be -er6or 2 e d to de 2 o n s t r ! t e th!t thes e re9 ir e 2 e n t s !re 2 et. 6' & ' & 5.1.1.1 2ntro # u c t i o n $ll inter ! c ti on s 0ith !n; d!t ! b ! s e 2!int !i ni n 1 the t!bl es de6ine d in #l! s e 1 2 st be 2! d e thro 1 h ! d!t ! b ! s e tr!ns ! c ti o n s -- orti n 1 6 ll $#<7 -ro- e rti e s, !s de6ine d in #l! s e s 5.1.2 to 5.1.(. No 6inite series o6 test s c!n -rove th!t the $#<7 -ro- er ti e s !re 6 ll; s - - ort e d . &!ssin 1 the s-eci6ied test s is ! nec e s s ! r ;, b t not s 66icient, condition 6or 2 e e ti n 1 the $#<7 re9 ir e 2 e n t s . Co0ev er, 6or 6!irne s s o6 re-ortin 1, onl; the test s s-eci6ied her e !re re9 ire d !nd 2 st !-- e ! r in the F ll 7isclos r e ?e-ort 6or this benc h 2 ! r 8 . Com m e n t . Thes e test s !re inte n d e d to de 2 o n s t r ! t e th!t the $#<7 -ro- er ti e s !re s - - ort e d b; the S%T !nd en! bl e d d rin1 the -er6or 2 ! n c e Me!s r e 2 e n t <nterv !l. The; !re not inten d e d to be !n e+h ! s tiv e 9 !lit; !ss r ! n c e test. 5.1.1.5 $ll 2ec h ! ni s 2 s nee d e d to ins r e 6 ll $#<7 -ro- er ti e s 2 st be en ! bl e d d rin1 both the $#<7 test -eriod !nd the Test ? ns '!s de6in e d in #l! s e 5.5). For e+! 2 -l e, i6 the s;st e 2 nd e r test relies on ndo lo1s, then lo11in 1 2 st be en! bl e d 6or !ll d!t ! b ! s e tr!ns ! c ti o n s. When this benc h 2 ! r 8 is i2-le 2 e n t e d on ! distrib t e d s;st e 2 , test s 2 st be -er6or 2 e d to veri6; th!t distrib t e d d!t ! b ! s e tr!n s ! c ti o n s 'd!t ! b ! s e tr!ns ! c ti o n s th!t !re -roc e s s e d on t0o or 2or e nod e s ) s - - ort the $#<7 -ro- e rti e s. $ltho 1 h the $#<7 test s 2! ; not e+ercis e !ll t;- e s o6 T&#*W d!t ! b ! s e tr!n s ! c ti o n s , the $#<7 -ro- e rti e s 2 st be s!tis6ie d 6or !ll t;- e s. Test s-on s or s re-ortin 1 T&#*W res lts on sev er !l s;st e 2 s 2 !; -er6or 2 the $#<7 test s on !n; one s;st e 2 6or 0hich res lt s !re bein1 disclos e d, -rovid e d th!t the; se the s! 2 e so6t0!r e e+ec t ! bl e s 'e.1., =-er !ti n 1 S;st e 2 , 7!t! b ! s e M!n! 1 e r , Web Server, $--lic!tion Serv er, tr!n s ! c ti o n -ro1r ! 2 s ). Co0ev e r, the d r! bilit; test s 6or s;st e 2 6!il re 'se e #l! s e s 5.1.5.5) 2 st be r n on !ll the s;st e 2 s th!t !re 2 e ! s r e d . $ll F ll 7isclos r e ?e-ort s 2 st identi6; the s;st e 2 s se d to veri6; $#<7 re9 ir e 2 e n t s !nd 6 ll det !ils o6 the $#<7 test s cond c t e d !nd res lts obt !in e d . Com m e n t . This cl! s e 0o ld be !--lic! bl e, 6or e+ ! 2 -l e , 0he n res lts !re re-ort e d 6or 2 lti-le s;st e 2 s in ! -rod c t line. 6' & ' 4 5.1.2.1 Ato mi c i t * $to2icit; &ro-ert ; 7e6inition
5.1.1.2
5.1.1.(
5.1.1.5
T&# Bench2!r8I W
&!1e l+++ii
The s;st e 2 nd e r test 2 st 1 !r ! n t e e th!t d!t ! b ! s e tr!n s ! c ti o n s !re !to 2ic. Within ! d!t ! b ! s e tr!ns ! c ti o n the s;st e 2 0ill eith er -er6or 2 !ll individ !l o-er ! ti o n s on the d!t !, or 0ill !ss r e th!t no o-er ! tio n s le!v e !n; e66ect s on the d!t !. 5.1.2.2 $to2icit; Test s The !to 2icit; test s re9 ir e th!t the B ; #on6ir2 0eb inter ! c ti on be instr 2 e n t e d so th!t the -d ! t e to the d!t ! b ! s e 2! ; be !bort e d 0hile in -ro1r e s s , !66ectin 1 the 6in!l o tco 2 e o6 the -d ! t e , b t 0itho t !66ectin 1 the !bilit; o6 the S%T to co2 -l et e the 0eb inter ! c tio n. The 6ollo0in1 ste - s describ e the !to 2i cit; test 1. Ste- 1. ?e9 e s t !nd co2 -l et e ! Best Sellers, ! Ne0 &rod ct s or ! Se!rc h ?es lt 0eb inter ! c tio n !nd choos e !n ite2 6ro2 the res-o n s e -!1 e. Ste- 2. ?e9 e s t !nd co2 -l et e ! &rod ct 7et!il 0eb inter ! c ti on 6or the ite2 chos e n in Ste- 1. Ste- 5. ?e9 e s t !n instr 2 e n t e d B ; #on6ir2 0eb inter ! c tio n 6or the ite2 chos e n in Ste- 1, orderin 1 the ite2, !nd co2 -l e t e the 0eb inter ! c tio n 0itho t !bortin 1 its -d ! t e s . Ste- (. ?e9 e s t !nd co2 -l et e !n =rder 7is-l!; 0eb inter ! c tion 6or the c sto 2 e r Ste- 5. se d in
Ste- 5. The in6or2 ! tio n -res e n t e d in the res- o n s e -!1 e 6ro2 Ste- ( 2 st 2!t c h the order ent er e d in Ste- 5. The 6ollo0in1 ste - s describ e the !to 2i cit; test 2. Ste- 1. ?e9 e s t !nd co2 -l et e ! Best Sellers, ! Ne0 &rod ct s or ! Se!rc h ?es lt 0eb inter ! c tio n !nd choos e !n ite2 6ro2 the res-o n s e -!1 e. Ste- 2. ?e9 e s t !nd co2 -l et e ! &rod ct 7et!il 0eb inter ! c ti on 6or the ite2 chos e n in Ste- 1. Ste- 5. ?e9 e s t !n instr 2 e n t e d B ; #on6ir2 0eb inter ! c tio n 6or the ite2 chos e n in Ste- 1, orderin 1 the ite2, !nd rollb!c8 its -d ! t e s be6or e co2 2 it tin 1 the tr!ns ! c ti o n. Ste- (. ?e9 e s t !nd co2 -l et e !n =rder 7is-l!; 0eb inter ! c tion 6or the c sto 2 e r Ste- 5. se d in
Ste- 5. The in6or2 ! tio n -res e n t e d in the res- o n s e -!1 e 6ro2 Ste- ( 2 st 2!8 e no 2 e nti on o6 the order ent er e d in Ste- 5. 6' & ' 6 5.1.5.1 Con si s t e n c * #onsist e n c ; &ro-ert ; 7e6inition The s;st e 2 nd e r test 2 st 1 !r ! n t e e th!t d!t ! b ! s e tr!n s ! c ti o n s !re consist e n t . $ss 2i n 1 th!t the d!t ! b ! s e is initi!ll; in ! consist e n t st!t e, the s;st e 2 0ill ens r e th!t !n; T&#*W d!t ! b ! s e tr!n s ! c ti o n t!8e s the d!t ! b ! s e 6ro2 one consist e n t st!t e to !not h e r.
T&# Bench2!r8I W
&!1e l+++iii
5.1.5.2
#onsist e n c ; #onditions $ consist e n t st!t e 6or the T&#*W d!t ! b ! s e is de6ine d to e+ist 0hen. 1. 2. 5. (. 5. 6. ,. 8. 9. '<S$S<7) is ! v!lid Forei1n >e; re6er e n c e to !n e+istin1 '$S<7) '#S$77?S<7) is ! v!lid Forei1n >e; re6er e n c e to !n e+istin1 '$77?S<7) '=S#S<7) is ! v!lid Forei1n >e; re6er e n c e to !n e+istin1 '#S<7) =SB<@@S$77? !nd '$77?S<7) =SSC<&S$77? !re v!lid Forei1n >e; re6er e n c e s to !n e+istin1
'=@S<S<7) is ! v!lid Forei1n >e; re6er e n c e to !n e+istin1 '<S<7) '=@S=S<7) is ! v!lid Forei1n >e; re6er e n c e to !n e+istin1 '=S<7) '#JS=S<7) is ! v!lid Forei1n >e; re6er e n c e to !n e+istin1 '=S<7) '#JS#=S<7) is ! v!lid Forei1n >e; re6er e n c e to !n e+istin1 '#=S<7) #JSJ$#TS$MT [ =ST=T$@ 0hen #JS=S<7 [ =S<7
10. '$77?S#=S<7) is ! v!lid Forei1n >e; re6er e n c e to !n e+istin1 '#=S<7) 5.1.5.5 $ T&#*W d!t ! b ! s e , 0hen -o- l ! t e d !s de6ine d in #l! s e (.,, 2 st 2e e t the consist e n c ; condition de6ine d in #l! s e 5.1.5.2. <6 d!t ! is re-lic!t e d , !s -er 2it t e d nd er #l! s e 1.6.6, e!c h co-; 2 st 2 e e t the consist e n c ; condition de6ine d in #l! s e 5.1.5.2.Th e i2-le 2 e n t ! t i o n o6 the 0eb inter ! c tio n s 2 st ens r e th!t !ll consist e n c ; condition s de6ine d in #l! s e 5.1.5.2 !re 2!int !i n e d 0itho t rel;in1 on ! li2ite d r!n 1 e o6 in- t d!t !. B t the i2-le 2 e n t ! t i o n o6 the benc h 2 ! r 8 is not re9 ir e d to 2 !int !i n the s e consist e n c ; conditions nd e r !rbitr!r; d!t ! b ! s e tr!n s ! c ti o n s . Com m e n t . This i2-lies th!t no re6er e n ti !l inte 1rit; is re9 ir e d d!t ! b ! s e level. 5.1.5.5 #onsist e n c ; Test The veri6ic!tion o6 the consist e n c ; bet0 e e n the #%ST=MA? !nd $77?ASS t!ble s, bet0 e e n the =?7A?S !nd #%ST=MA? t!bl e s, !nd bet0 e e n the =?7A?S !nd ##SJ$#TS t!bl es is don e !s -!rt o6 e!c h 7 r!bilit; test 'see #l! s e 5.1.5.5). 5.1.5.6 While 2 !int !i nin 1 other consist e n c ; condition s de6ine d in #l! s e 5.1.5.2 is re9 ire d, their veri6ic!tion is o-tion !l. 2so a ti o n <sol!tion &ro- ert ; 7e6inition <sol!tion c!n be de6ine d in ter2 s o6 -he n o 2 e n ! th!t c!n occ r d rin1 the e+ ec tio n o6 conc rr e n t d!t ! b ! s e tr!n s ! c ti o n s . The 6ollo0in1 -he n o 2 e n ! !re consid e r e d , 1iven t0o !to 2i c d!t ! b ! s e tr!n s ! c ti o n s , T1 !nd T2. to be en6orc e d !t the
5.1.5.(
6' & ' 8 5.1.(.1
T&# Bench2!r8I W
&!1e l+++iv
&0 'N7irt; WriteN). 7!t ! b ! s e tr!n s ! c ti o n T1 re! d s ! d!t ! ele 2 e n t !nd 2odi6ies it. 7!t ! b ! s e tr!ns ! c ti o n T2 then 2odi6ies or delet e s th!t d!t ! ele 2 e n t , !nd -er6or 2 s ! #=MM<T. <6 T1 0ere to !tt e 2 - t to re* re!d the d!t ! ele 2 e n t , it 2! ; receiv e the 2odi6ied v!l e 6ro2 T2 or discov e r th!t the d!t ! ele 2 e n t h!s be e n del et e d . &1 'N7irt; ?e!dN). 7!t! b ! s e tr!n s ! c ti o n T1 2odi6ies ! d!t ! ele 2 e n t . 7!t ! b ! s e tr!ns ! c ti o n T2 the n re!d s th!t d!t ! ele 2 e n t be6ore T1 -er6or 2 s ! #=MM<T. <6 T1 0ere to -er6or 2 ! ?=@@B$#>, T2 0ill h!v e re! d ! v!l e th!t 0!s nev e r co2 2i t t e d !nd th!t 2 !; th s be consid e r e d to h!v e nev er e+ist e d. &2 'NNon* re- e ! t ! b l e ?e!dN). 7!t! b ! s e tr!ns ! c ti o n T1 re!d s ! d!t ! ele 2 e n t . 7!t ! b ! s e tr!n s ! c ti o n T2 the n 2odi6ies or del et e s th!t d!t ! ele 2 e n t , !nd -er6or 2 s ! #=MM<T. <6 T1 0ere to !tt e 2 - t to re* re! d the d!t ! ele 2 e n t , it 2! ; rec eiv e the 2odi6ied v!l e or discov er th!t the d!t ! ele 2 e n t h!s be e n delet e d . &5 'N&h! nt o 2 N). 7!t ! b ! s e tr!n s ! c ti o n T1 re! d s ! set o6 v!l e s N th!t s!tis6; so2 e U s e ! r c h condition V . 7!t! b ! s e tr!ns ! c ti o n T2 then e+ec t e s st!t e 2 e n t s th!t 1en e r ! t e one or 2or e d!t ! ele 2 e n t s th!t s!tis6; the Us e ! r c h condition V se d b; d!t ! b ! s e tr!n s ! c ti o n T1. <6 d!t ! b ! s e tr!ns ! c ti o n T1 0ere to re- e ! t the initi!l re! d 0ith the s! 2 e Us e ! r c h condition V , it obt !i ns ! di66ere n t set o6 v!l e s. The 6ollo0in1 t!bl e de6in e s 6o r isol!tion levels 0ith res- e c t to the -he n o 2 e n ! &0, &1, &2, !nd &5. <sol!tio n @evel 0 1 2 5 &0 &1 &2 &5
Not &ossible Not &ossible Not &ossible Not &ossible
&ossibl e Not &ossible Not &ossible Not &ossible
&ossibl e &ossibl e Not &ossible Not &ossible
&ossibl e &ossibl e &ossibl e Not &ossible
The 6ollo0in1 d!t ! b ! s e tr!ns ! c ti o n s !re de6ine d. Tr [ $n; re!d* onl; d!t ! b ! s e tr!ns ! c ti o n T [ $n; -d ! t e d!t ! b ! s e tr!n s ! c ti o n se d to i2-le 2 e n t ! T&#*W 0eb inter ! c tio n se d to i2-le 2 e n t ! T&#*W 0eb inter ! c tio n
Tn [ $n; !rbitr !r ; tr!n s ! c ti o n '$ltho 1 h !rbitr!r;, this tr!n s ! c ti o n 2! ; not do dirt; 0rites)
T&# Bench2!r8I W
&!1e l+++v
%nless oth er0is e s-eci6ied, the s;st e 2 nd e r test 0ill ens r e th!t the isol!tion re9 ir e 2 e n t s de6ine d in the t!ble belo0 !re 2et b; !ll d!t ! b ! s e tr!ns ! c ti o n s. ?e9. ] For tr!n s ! c ti o n s in this set. aT , T b aT , Tn b the s e -he n o 2 e n !. &0, &1, &2, &5 &0, &1, &2 2 st N=T be se e n b; this tr!n s ! c ti o n. T T
Te+t !l 7escri-tion.
1. 2.
@evel 5 isol!tion bet0 e e n !n; t0o T&#*W -d ! t e tr!ns ! c ti o n s. @evel 2 isol!tion 6or !n; T&#*W -d ! t e tr!n s ! c ti o n s rel!tiv e to !n; !rbitr !r ; tr!n s ! c ti o n. @evel 1 isol!tion 6or !n; T&#*W re! d* onl; tr!ns ! c ti o n rel!tiv e to !n; !rbitr !r ; tr!n s ! c ti o n.
5.
aT r , Tn b
&0, &1
Tn
5.1.(.2
<sol!tion Tests The isol!tion test s re9 ire th!t sev er !l 0eb inter ! c tio n s be 2odi6ied so th!t ! 9 er ; or !n -d ! t e to the d!t ! b ! s e 2! ; be h!lt e d 0hile in -ro1r e s s , 0itho t !66ectin 1 the 6in!l o tco 2 e o6 the 9 er; or the -d ! t e , !nd 0itho t !66ectin 1 the !bilit; o6 the S%T to co2 -l et e the 0eb inter ! c ti on.
5.1.(.2. 1 <sol!tion Test 1 To veri6; isol!tion bet0 e e n t0o T&#*W -d ! t e tr!n s ! c ti o n s , -er6or 2 the 6ollo0in1 ste- s. Ste- 1. Fro2 bro0s e r $, re9 e s t !nd co2 -l e t e ! Best Sellers, ! Ne0 &rod ct s or ! Se!rc h ?es lt 0eb inter ! c tio n !nd choos e !n ite2 6ro2 the res-o n s e -!1 e. Ste- 2. Fro2 bro0s e r $, re9 e s t !nd co2 -l e t e ! &rod ct 7et!il 0eb inter ! c tio n 6or the ite2 chos e n in the -revio s ste -. Ste- 5. Fro2 bro0s e r B, re- e ! t ste- s 1 !nd 2 !bov e 6or the s! 2 e ite2. Ste- (. Fro2 bro0s e r $, re9 e s t !n $d2in ?e9 e s t 0eb inter ! c tio n 6ro2 the &rod ct 7et!il &!1e o6 ste- 2. Ste- 5. Fro2 bro0s e r $, 2odi6; the ite2Ls i2!1 e !nd -rice b; initi!tin1 !n instr 2 e n t e d $d2in #on6ir2 0eb inter ! c ti on. Ste- 6. <nterr - t the -roc e s si n 1 o6 the $d2in #on6ir2 0eb inter ! c tion 6ro2 bro0s er $ !6t er -d ! ti n 1 the i2! 1 e , b t be6or e -d ! ti n 1 the -rice. Ste- ,. Fro2 bro0s e r B, re- e ! t ste- ( !bov e. Veri6; th!t the $d2in ?e9 e s t 0eb inter ! c ti on eith er 0!its 6or bro0s e r $ to res 2 e , or co2 -l et e s . <6 the $d2in ?e9 e s t 0eb inter ! c tio n co2 -l et e s , then re- e ! t ste- 5 !bov e , -d ! ti n 1 the ite2 Hs th 2 b n ! il !nd -rice ' sin1 ! di66ere n t v!l e th!n bro0s er $). Ste- 8. Veri6; th!t bro0s er BLs $d2in #on6ir2 0eb inter ! c tio n, i6 re9 e s t e d in ste- ,, eith er 0!its 6or bro0s e r $ to res 2 e , or dis-l! ;s !n $d2in #on6ir2 &!1e cont !i nin 1 the ite2Ls i2!1 e 6ro2 ste - 2 !nd the -rice !nd th 2 b n ! il !s -d ! t e d b; bro0s er B. Ste- 9. ?es 2 e the -roc e s si n 1 o6 the $d2in #on6ir2 0eb inter ! c tio n interr - t e d in ste - 6.
T&# Bench2!r8I W
&!1e l+++vi
Ste- 10. Veri6; th!t bro0s er $ dis-l! ;s !n $d2in #on6ir2 &!1e cont !i nin 1 the ite2Ls ne0 i2!1 e, !nd either the old th 2 b n ! il !nd the -rice !s -d ! t e d b; bro0s e r $, or the ne0 th 2 b n ! il !nd the -rice !s -d ! t e d b; bro0s e r B. 5.1.(.2. 2 <sol!tion Test 2 To veri6; isol!tion bet0 e e n ! T&#*W -d ! t e tr!ns ! c ti o n !nd !n !rbitr!r; tr!n s ! c ti o n, -er6or 2 the 6ollo0in1 ste - s. Ste- 1. Fro2 ! bro0s er, re9 e s t !nd co2 -l e t e ! Best Sellers 0eb inter ! c tion. Ste- 2. Fro2 the s! 2 e bro0s e r, re9 e s t !nd co2 -l e t e ! &rod ct 7et !il 0eb inter ! c tio n 6or the 6irst ite2 6o nd in the -revio s ste-. Ste- 5. Fro2 the s! 2 e bro0s e r, re9 e s t !n $d2in ?e9 e s t 0eb inter ! c ti on 6ro2 the &rod ct 7et!il &!1e o6 the -revio s ste -. Ste- (. Fro2 the s! 2 e bro0s e r, 2odi6; the ite2Ls i2!1 e, th 2 b n ! il !nd -rice b; initi!tin1 !n instr 2 e n t e d $d2in #on6ir2 0eb inter ! c tion. Ste- 5. <nterr - t the -roc e s si n 1 o6 the $d2in #on6ir2 0eb inter ! c tion !6ter i2!1 e, b t be6ore -d ! ti n 1 the -rice !nd the th 2 b n ! il. -d ! ti n 1 the
Ste- 6. %sin1 ! d!t ! b ! s e 9 er; !nd -d ! t e tilit;, re9 e s t !n -d ! t e o6 the descri-tion o6 the 6irst ite2 6o nd in ste - 1. #o2 2it this -d ! t e !s soon !s !llo0e d b; the d!t ! b ! s e . 'The -d ! t e re9 e s t 2! ; h!n 1 0!itin1 6or the -roc e s si n 1 o6 the $d2in #on6ir2 0eb inter ! c tio n to co2 -l et e .) Ste- ,. ?es 2 e the -roc e s si n 1 o6 the $d2in #on6ir2 0eb inter ! c tio n interr - t e d in ste - 5. Ste- 8. Veri6; th!t the bro0s e r dis-l! ;s !n $d2in #on6ir2 &!1e cont !i nin 1 the ite2Ls ne0 i2!1 e, ne0 th 2 b n ! il !nd ne0 -rice. Ste- 9. %sin1 ! d!t ! b ! s e 9 er; !nd -d ! t e tilit;, veri6; th!t the 6irst ite2 6o nd in ste- 1 no0 re6lect s the -d ! t e s 6ro2 Ste- 6 !nd 6ro2 the $d2in #on6ir2 0eb inter ! c tio n. 5.1.(.2. 5 <sol!tion Test 5 To veri6; isol!tion bet0 e e n -er6or 2 the 6ollo0in1 ste- s. ! T&#*W re! d* onl; tr!ns ! c ti o n !nd !n !rbitr !r ; tr!n s ! c ti o n,
Ste- 1. Fro2 ! bro0s er, re9 e s t !nd co2 -l e t e !n =rder 7is-l!; 0eb inter ! c tio n. Ste- 2. %sin1 ! d!t ! b ! s e 9 er; !nd -d ! t e tilit;, re9 e s t !n -d ! t e o6 the 9 ! n tit ; o6 the 6irst line ite2 o6 the order dis-l !;e d in Ste- 1, b t do not co2 2 it this -d ! t e . Ste- 5. Fro2 the s! 2 e bro0s e r, re9 e s t !nd co2 -l e t e !not h e r =rder 7is-l!; 0eb inter ! c tio n to retriev e the s! 2 e order !s in Ste- 1 Ste- (. Veri6; th!t the bro0s e rLs =rder 7is-l!; 0eb inter ! c ti on eith er 0!its 6or the -d ! t e tilit; to co2 2i t, or dis-l! ;s !n =rder 7is-l!; &!1e cont !i nin 1 the s! 2 e in6or2 ! ti o n !s dis-l! ;e d in Ste- 1. Ste- 5. %sin1 ! d!t ! b ! s e 9 er; !nd d!t ! b ! s e . -d ! t e tilit; co2 2i t the -en di n 1 -d ! t e s to the
T&# Bench2!r8I W
&!1e l+++vii
Ste- 6. <6 the bro0s e r 0!s 0!itin1 in Ste- (, veri6; th!t it h!s res 2 e d !nd th!t it dis-l! ;s !n =rder 7is-l!; &!1e cont !i ni n 1 the ne0 9 ! n tit ; 6or the 6irst line ite2. <6 the bro0s e r 0!s not 0!itin1 in Ste- (, re9 e s t !nd co2 -l e t e ! ne0 =rder 7is-l!; 0eb inter ! c ti on to retriev e the s! 2 e order !s in Ste- 1 !nd veri6; th!t the =rder 7is-l!; &!1e cont !i n s the ne0 9 ! n tit ; 6or the 6irst line ite2. 6' & ' : 5.1.5.1 )ura b i i t * 7 r!bilit; &ro- ert ; 7e6inition The s;st e 2 nd e r test 2 st 1 !r ! n t e e th!t d!t ! b ! s e tr!n s ! c ti o n s !re d r! bl e. The s;st e 2 0ill -res e r v e the e66ect s o6 !n; co2 2i t t e d d!t ! b ! s e tr!ns ! c ti o n !6ter recov er ; 6ro2 !n; sin1le -oint o6 6!il re. Com m e n t . No s;st e 2 -rovid e s co2 -l e t e d r! bilit; 'i.e., d r! bilit; nd e r !ll -ossibl e t;-e s o6 6!il re s). The s-eci6ic set o6 sin1l e 6!il res !ddr e s s e d in #l! s e 5.1.5.5 is de e 2 e d s 66icientl; si1ni6ic!n t to E sti6; de 2 o n s t r ! ti o n o6 d r! bilit; !cros s s ch 6!il re s. Co0ev e r, the li2ite d n!t r e o6 the test s listed 2 st not be inter-r e t e d to !llo0 oth er nrec o v e r ! b l e sin1le -oint s o6 6!il re. 5.1.5.2 #o2 2itt e d 7!t! b ! s e Tr!ns ! c tio n 7e6inition $ d!t ! b ! s e tr!n s ! c ti o n is consid e r e d co2 2i t t e d 0he n the tr!ns ! c ti o n 2 ! n ! 1 e r co2 - o n e n t o6 the s;st e 2 h!s eith er 0ritt en the lo1 or 0ritte n the d!t ! 6or the co2 2i t t e d -d ! t e s !sso ci ! t e d 0ith the d!t ! b ! s e tr!ns ! c ti o n to ! d r! bl e 2e di 2 . Com m e n t . 7!t ! b ! s e tr!ns ! c ti o n s c!n be co2 2 it t e d 0itho t the ser s bs e 9 e n t l ; rec eivin 1 noti6ic!tion o6 th!t 6!ct, !s the 0eb inter ! c tio n 2! ; 6!il !6ter the d!t ! b ! s e tr!ns ! c ti o n h!s bee n co2 2 it t e d . 5.1.5.5 @ist o6 Sin1le &oints o6 F!il re The Sin1le &oints o6 F!il re !--l; to co2 - o n e n t s o6 the S%T th!t contrib t e to the d r! bilit; re9 ir e 2 e n t . <n con6i1 r ! ti o n s 0her e 2or e th!n one inst ! n c e o6 !n o-er ! ti n 1 s;st e 2 -er6or 2 s !n identic !l benc h 2 ! r 8 6 nction, the test s 6or the 6!il res listed here 2 st be co2 -l et e d on !t le!st one s ch inst ! n c e . <n !ddition, i6 2 lti-le inst ! n c e s o6 !n o-er ! ti n 1 s;st e 2 2! n ! 1 e d!t ! th!t is 2 !int !i n e d !s ! sin1le i2!1 e 6or the benc h 2 ! r 8 !--lic!tio n 'e.1., ! d!t ! b ! s e cl st er), the n the &o0er F!il re test 2 st !lso be -er6or 2 e d si2 lt ! n e o s l ; on !ll s ch inst ! n c e s . Com m e n t & . $n e+! 2 -l e o6 2 lti-l e s;st e 2 s -er6or 2i n 1 !n identic !l 6 nction is 2 lti-le !--lic!tio n serv er s i2-le 2 e n t i n 1 the Sho--i n 1 #!rt. Com m e n t 4 . $ sin1l e test c!n !de 9 ! t e l ; s!tis6; the re9 ire 2 e n t s o6 2 lti-le sin1l e -oint s o6 6!il re 'e.1., $ sin1le Ns;st e 2 cr!s h testN co ld be se d 6or the 2 e 2 o r ; 6!il re, s;st e 2 6!il re, !nd -o0er 6!il re re9 ir e 2 e n t s .
T&# Bench2!r8I W
&!1e l+++viii
Com m e n t 6 . The -o0er 6!il re re9 ire 2 e n t c!n be s!tis6ied b; incl din1 s 66icient %&SHs to 1 !r ! n t e e s;st e 2 !v!il! bilit; o6 !ll co2 - o n e n t s th!t 6!ll nd e r the -o0er 6!il re re9 ire 2 e n t 6or ! -eriod o6 !t le!st 50 2in t e s. %se o6 ! %&S* -rot e ct e d con6i1 r ! tio n 2 st not introd c e ne0 sin1l e -oints o6 6!il re th!t !re not -rot e c t e d b; oth er -!rt s o6 the con6i1 r ! ti o n. This re9 ir e 2 e n t 2! ; be -rove n eith er thro 1 h ! 2e ! s r e 2 e n t or thro 1 h ! c!lc l !tio n o6 the 50* 2in t e -o0er re9 ire 2 e n t s 'in 0!tt s) 6or the -ortion o6 the S%T th!t is -rot e ct e d 2 lti-lied b; 1.(. Com m e n t 8 . The ter2 Nsi2 lt ! n e o sl ;N !s !--lie d to ! -o0er 6!il re o6 2 lti-l e inst ! n c e s 0ithin the S%T is inter-r e t e d to 2e ! n 0ithin 5 seco n d s to !llo0 6or v!ri!nc e s in ! 2 ! n !l -roc e d r e th!t 2! ; be se d to !cco 2 -lish the test. Me#i u m 5ai ur e . &er2 ! n e n t irrecov er ! bl e d rin1 !n; Me!s r e 2 e n t <nterv !l. 6!il re o6 !n; sin1l e d r! bl e 2e di 2 !ctive
<6 2!in 2 e 2 o r ; is se d !s ! d r! bl e 2e di 2 , then it 2 st be consid er e d !s ! -ot e n ti !l sin1le -oint o6 6!il re. S!2 -l e 2ec h ! ni s 2 s to s rvive sin1l e d r! bl e 2e di 2 6!il re s !re d!t ! b ! s e !rchivin1 in conE n ctio n 0ith ! redo '!6t er i2! 1 e ) lo1, !nd 2irror e d d r! bl e 2e di !. <6 2 e 2 o r ; is the d r! bl e 2 e di 2 !nd 2irrorin1 is the 2 ec h ! ni s 2 se d to ens r e d r! bilit;, then the 2irror e d 2e 2 o ri e s 2 st be inde - e n d e n t l ; -o0er e d . Me m o r * 5ai ur e . F!il re o6 !ll or -!rt o6 2e 2 o r ; 'loss o6 cont e n t s ). This i2-lies th!t !ll or -!rt o6 2e 2 o r ; h!s 6!iled. This 2 !; be c! s e d b; ! loss o6 e+t er n !l -o0er or the -er 2 ! n e n t 6!il re o6 ! bo!rd e9 i- - e d 0ith 2e 2 o r ;. S* s t e m 5ai ur e . <nst ! n t ! n e o s interr - tio n 's;st e 2 cr!s h/ s ;s t e 2 h!n 1) in -roc e s si n 1 0hich c! s e s !ll or -!rt o6 the -roc e s si n 1 o6 !to 2ic tr!n s ! c ti o n s to h!lt. Com m e n t & .This 2 !; i2-l; !bn or 2 ! l s;st e 2 sh t d o 0 n 0hich re9 ire s lo!din1 o6 ! 6resh co-; o6 the o-er ! ti n 1 s;st e 2 6ro2 the boot devic e. <t does not nec e s s ! ril; i2-l; loss o6 vol!tile 2e 2 o r ;. When the recov er ; 2ec h ! ni s 2 relies on the -re* 6!il re cont e n t s o6 vol!tile 2e 2 o r ;, the 2 e ! n s se d to !void the loss o6 vol!tile 2e 2 o r ; 'e.1., !n %n* interr - ti bl e &o0er S --l;) 2 st be incl d e d in the s;st e 2 cost c!lc l !tion. $ s! 2 -l e 2ec h ! ni s 2 to s rvive !n inst ! n t ! n e o s interr - ti on in -roc e s si n 1 is !n ndo/r e d o lo1. Com m e n t 4 . <n con6i1 r ! tio n s 0her e 2ore th! n one inst ! n c e o6 !n o-er ! ti n 1 s;st e 2 c!n -!rtici- ! t e in !n !to 2ic tr!n s ! c ti o n !nd !re conn e c t e d vi! ! -h;sic !l 2e di 2 oth er th!n !n inte 1r ! t e d b s 'e.1., b s e+t e n d e r c!bl e, hi1h s-e e d @$N, or oth er conn e c tio n 2et h o d s bet0 e e n the 2 lti-le inst ! n c e s o6 the o-er ! ti n 1 s;st e 2 th!t co ld be v lner ! bl e to ! loss 6ro2 -h;sic !l disr -tio n), the inst ! n t ! n e o s interr - tio n o6 this co2 2 ni c ! ti o n is incl d e d in this de6inition !s !n ite2 th!t ne e d s to be test e d. <nterr - tio n o6 one inst ! n c e o6 red n d ! n t conn e c tio n s is re9 ir e d. Com m e n t 6 . <t is not the intentio n o6 this cl! s e to re9 ire interr - ti on o6 co2 2 ni c ! ti o n to dis8 to0er s or ! dis8 s bs ;s t e 2 0her e red n d ! n c ; e+ists. For e+ ! 2 -l e , lo1 dis8s c!n be !ss 2 e d to -rovid e red n d ! n c ; 6or d!t ! dis8s. S9T Po " e r 5ai ur e . @oss o6 !ll e+t er n !l -o0er to the S%T 6or !n inde6init e ti2 e -eriod. This 2 st incl d e !t le!st !ll -ortions o6 the S%T th!t -!rtici- !t e in the d!t ! b ! s e -ortion o6 tr!ns ! c ti o n s.
T&# Bench2!r8I W
&!1e l+++i+
This t;-e o6 6!il re is s 66icientl; e+ercis e d b; re2 ovi n 1 -o0er 6ro2 ever; s;st e 2 th!t contrib t e s to s!tis6;in1 the d r! bilit; re9 ir e 2 e n t . <6 ! 1ro - o6 s;st e 2 s is -rovidin1 ! 1ive n 6 nction 'e.1., ! cl st er e d d!t ! b ! s e serv er), the n 6!ilin1 !n; one s;st e 2 in th!t 1ro - is ! s 66icient test sce n ! ri o. Note th!t the #$?T o6 ! Sho- -i n 1 Sessio n 2 st onl; be 8e-t d r! bl e 6or ! 2ini 2 2 o6 t0o ho rs 'se e #l! s e 2.2.6). 5.1.5.( 7 r!bl e Medi 2 7e6inition $ d r! bl e 2e di 2 is ! d!t ! stor! 1 e 2 e di 2 th!t is eith er. 1. 2. $n inher e n tl ; non* vol!tile 2 e di 2 'e.1., 2 ! 1 n e t i c dis8, 2 ! 1 n e t i c t!- e, o-tic!l dis8, etc.) or $ vol!tile 2 e di 2 th!t 0ill ens r e the tr!n s6 er o6 d!t ! ! t o 2 ! t i c !ll;, be6ore !n; d!t ! is lost, to !n inher e n tl ; non* vol!tile 2e di 2 !6ter the 6!il re o6 e+t er n !l -o0er inde - e n d e n t l ; o6 re! - -lic !ti on o6 e+t er n !l -o0er. '$ con6i1 r e d !nd -rice d %n* interr - ti bl e &o0er S --l; '%&S) is not consid er e d e+t er n !l -o0er.)
Com m e n t . $ d r! bl e 2e di 2 c!n 6!ilG this is s !ll; -rot e c t e d !1!i n s t b; re-lic!tion on ! seco n d d r! bl e 2 e di 2 'e.1., 2irrorin1) or lo11in 1 to !not h e r d r! bl e 2e di 2 . Me2or; c!n be consid e r e d ! d r! bl e 2 e di 2 i6 it c!n -res e r v e d!t ! lon1 eno 1 h to s!tis6; the re9 ir e 2 e n t st!t e d in ite2 2 !bov e , 6or e+ ! 2 -l e , i6 it is !cco 2 - ! n i e d b; !n %n* interr - ti bl e &o0er S --l;, !nd the cont e n t s o6 2e 2 o r ; c!n be tr!n s6 e rr e d to !n inher e n tl ; non* vol!tile 2e di 2 d rin1 the 6!il re. Note th!t no distinction is 2 ! d e bet0 e e n 2 !in 2e 2 o r ; !nd 2e 2 o r ; -er6or 2i n 1 si2il!r -er 2 ! n e n t or te2 - o r ! r ; d!t ! stor! 1 e in oth er -!rt s o6 the s;st e 2 'e.1., dis8 controller c!ch e s ). 5.1.5.5 7 r!bilit; Tests For e!c h co2 - o n e n t s sc e - ti bl e to one o6 the 6!il re t;-e s de6ine d in #l! s e 5.1.5.5 -er6or 2 the 6ollo0in1 ste - s. Ste- 1. Veri6; th!t #onsist e n c ; #onditions 2, 5, , !nd 9, !s s-eci6ied in #l! s e 5.1.5.2, !re 2 et. Ste- 2. =bt !in the tot!l n 2 b e r o6 ro0s in the =?7A?S t!bl e to det e r 2i n e the c rre n t co nt o6 orders 'co nt 1) in the d!t ! b ! s e . Ste- 5. St!rt the 2i+ o6 0eb inter ! c tion s se d 6or the Sho--i n 1 <nterv !l 'see #l! s e 5.2.1) 6ro2 ! n 2 b e r o6 ABHs !t le!st 90P o6 the n 2 b e r o6 ABHs se d 6or the re-ort e d W<&S 2 et ric. Ste- (. ? n 6or !t le!st 5 2in t e s onc e !ll ABHs h!v e st!rt e d re9 e s ti n 1 0eb inter ! c tion sG !nd 8ee - ! co nt o6 the n 2 b e r o6 B ; #on6ir2 0eb inter ! c tion s s cc e s s6 ll; co2 -l e t e d b; !ll ABHs. Ste- 5. #! s e the 6!il re select e d 6ro2 the list in #l! s e 5.1.5.5. Ste- 6. Sto- the ?BA !nd collect the tot !l n 2 b e r o6 B ; #on6ir2 0eb inter ! c tio n s s cc e s s6 ll; co2 -l et e d b; !ll ABHs '?BA*co nt). Ste- ,. <6 nec e s s ! r ;, sto- !nd rest ! rt the s;st e 2 -roc e d r e s , 0her e !--lic! bl e. nd er test sin1 nor2 !l recov e r ;
T&# Bench2!r8I W
&!1e
+c
Ste- 8. ?e-e ! t ste - 2 to det er 2 i n e the c rre n t co nt o6 order s 'co nt 2) in the d!t ! b ! s e . Veri6; th!t 'co nt 2* co nt 1) is 1re ! t e r th! n or e9 !l to the n 2 b e r o6 s cc e s s6 ll; co2 -l e t e d B ; #on6ir2 0eb inter ! c ti on s '?BA*co nt). <6 ther e is !n ine9 !lit ;, the di66ere n c e 2 st be less th! n or e9 !l to the n 2 b e r o6 ABHs !ctive d rin1 this test. Com m e n t . This di66ere n c e sho l d be d e onl; to d!t ! b ! s e tr!n s ! c ti o n s 0hich 0ere co2 2 it t e d on the s;st e 2 nd e r test, b t 6or 0hich the ?es-o n s e &!1e 0!s not ret r n e d to the AB be6or e the 6!il re. Ste- 9. Veri6; th!t #onsist e n c ; #onditions 2, 5, 8 !nd 9, !s s-eci6ied in #l! s e 5.1.5.2, !re still 2 et.
6 ' 4 W e b P a g e C o n s i s t e n c * R e B u ir e m e n t s
Most 0eb -!1 e s ret r n e d b; the S%T to the AB re6lect the cont e n t o6 the d!t ! b ! s e b; dis-l! ;in 1 -l!in d!t ! !nd 0eb obEect s 'B<F -ict r e s). $s d!t ! b ! s e tr!n s ! c ti o n s -d ! t e the cont e n t o6 the d!t ! b ! s e , the 0eb -!1 e s 2 st dis-l !; ! consist e n t re6lection o6 the s e -d ! t e s , 0ith the e+ce - tio n o6 the Se!rc h ?es lt -!1 e s 6or Title !nd $ thor se!rc h e s . 6' 4 ' & 5.2.1.1 Web Pa g e Con si s t e n c * Prop e r t * )efi ni ti o n The e66ect s o6 !n; -d ! t e d!t ! b ! s e tr!ns ! c ti o n 2 st be re6lect e d 0ith consist e n c ; in s bs e 9 e n t 0eb -!1 e s ret r n e d b; the S%T to the AB. the 0eb -!1 e s 2 st re6lect eith er the e66ect o6 the entire -d ! t e o-er ! ti o n or non e o6 it. For the - r-o s e s o6 this de6inition, ! 0eb inter ! c tio n res ltin 1 in !n tr!n s ! c ti o n c!n be consid er e d to -roc e e d in thre e -h! s e s . 1. -d ! t e d!t ! b ! s e
5.2.1.2
Be6ore the 0eb inter ! c ti on. the re9 e s t h!s not be e n sent to the S%T. <n this -h! s e non e o6 the e66ect s o6 the -d ! t e d!t ! b ! s e tr!n s ! c ti o n c!n be visible in !n; 0eb -!1 e ret r n e d b; the S%T. 7 rin1 the 0eb inter ! c tion. the re9 e s t h!s bee n sent to the S%T, b t the res- o n s e -!1 e h!s not be e n rec eiv e d b; the AB. <n this -h! s e , !n; 0eb -!1 e s ret r n e d b; the S%T 2 st either re6lect the entire e66ect s o6 the -d ! t e d!t ! b ! s e tr!ns ! c ti o n or 2 st re6lect non e !t !ll. $6ter the 0eb inter ! c ti on. the res- o n s e -!1 e h!s be e n receiv e d in 6 ll b; the AB. <n this -h! s e , the e66ect s o6 the entire -d ! t e d!t ! b ! s e tr!ns ! c ti o n 2 st no0 be re6lect e d in !n; 0eb -!1 e ret rn e d b; the S%T in res-o n s e to re9 e s t s 1en e r ! t e d !6ter the -d ! t e , e+ce - t 6or 0eb inter ! c tion s listed in #l! s e 6.5.5.1. For 0eb inter ! c tio n s listed in #l! s e 6.5.5.1, 0ith the e+ce - ti o n o6 Se!rc h ?es lt -!1 e s 6or $ thor !nd Title se!rc h e s , the e66ect s o6 the entire -d ! t e d!t ! b ! s e tr!ns ! c ti o n 2 st be re6lect e d in !n; 0eb -!1 e ret rn e d b; the S%T in res-o n s e to re9 e s t s 1en e r ! t e d 2ore th!n 50 seco n d s !6t er the -d ! t e . &!1e s ret r n e d b; the S%T less th! n 50 seco n d s !6ter the -d ! t e 2 st eith er re6lect the entire e66ect s o6 the -d ! t e d!t ! b ! s e tr!ns ! c ti o n or 2 st re6lect non e !t !ll.
2.
5.
5.2.1.5
The Se!rc h ?es lt &!1e 6or title !nd ! t h or se!rc h !re the onl; e+ce - ti o n to the 0eb -!1 e consist e n c ; re9 ire 2 e n t . The Se!rc h ?es lt &!1e cont !i n s the res lt o6 ! 9 er;. The inde+ se d to !ns0 e r this 9 er; 2 !; be b!s e d -on the initi!l -o- l !tio n !nd is not re9 ire d to be -d ! t e d !lon1 0ith !n; d!t ! b ! s e -d ! t e s , incl din 1 -d ! t e s 2 ! d e b; the $d2in #on6ir2 0eb inter ! c tio n. T&# Bench2!r8I W St!nd!rd S-eci6ic!tion Version &'( &!1e +ci
Com m e n t A The inten t o6 this cl! s e is to !llo0 the se o6 co2 2 e r ci !ll; !v!il!bl e te+t se !rc h en1in e s to i2-le 2 e n t the Se!rc h ?es lt 0eb inter ! c tion !nd to reco1 ni: e th!t 2! n ; s ch se!rc h en1in e s se st!tic inde+ th!t !re 2 !int !i n e d o tsid e o6 the d!t ! b ! s e !nd re-re s e n t ! sn! - s h o t o6 the d!t ! b ! s e !t so2 e -oint in ti2 e. 6' 4 ' 4 Web Pa g e Con si s t e n c * Tes t This test re9 ir e s th!t ! serie s o6 0eb inter ! c tio n s be re9 e s t e d 6ro2 sev er !l %ser Session s 0hile the s;st e 2 is o-er ! ti n 1 nd e r the 6ollo0in1 lo!d. @o!d 1. The 2i+ o6 0eb inter ! c ti on s se d d rin1 the Sho--i n 1 <nterv !l !nd -rod ci n 1 ! W<&S r!t e 1re ! t e r th!n both 10P o6 the re-ort e d W<&S !nd 100 W<&S 'or 0ithin 90P o6 the re-ort e d W<&S r!t e i6 it is less th! n 100). @o!d 2. $ set o6 50 di66ere n t %ser Session s, e!c h e+ec ti n 1 the &rod ct 7et !il 0eb inter ! c tio n in ! contin o s loo-. $ll %ser Sessio n s 2 st re- e ! t e d l ; 9 er; the s! 2 e ite2, chos e n in ste- 1 belo0, !nd 2 st 2 !int !i n ! lo1 o6 the res- o n s e -!1 e s , incl din 1 the d!t e he ! d e r -rovid e d b; the CTT& 1.1 -rotocol.
The 6ollo0in1 list o6 ste- s 2 st be e+ec t e d in se9 e n c e . Ste- 1. Fro2 %ser Sessio n $, co2 -l e t e ! Ne0 &rod ct s 0eb inter ! c ti on !nd choos e !n ite2 6ro2 the res- o n s e -!1 e , e+cl di n 1 the 6irst ten ite2 s. Ste- 2. St!rt the @o!d 1 !bov e . Ste- 5. St!rt the lo!d 2 !bov e. Ste- (. W!it ! 2ini2 2 o6 t0o 2in t e s . Ste- 5. Fro2 %ser Sessio n $, co2 -l e t e !n $d2in #on6ir2 0eb inter ! c tio n 6or the ite2 chos e n in ste- 1, ch! n 1i n 1 the -rice, the - blish e d d!t e !nd the i2!1 e o6 the ite2. Ste- 6. W!it 50 seco n d s . Ste- ,. Fro2 %ser Sessio n B, i22 e di ! t el ; !6ter ste - 6 co2 -l et e s , co2 -l et e ! Ne0 &rod ct s 0eb inter ! c tio n on the s bEec t o6 the ite2 chos e n in ste - 1. Ste- 8. W!it ! 2ini2 2 o6 t0o 2in t e s . Ste- 9. Ter2in ! t e the lo!d 2 !nd then the lo!d 1. The 6ollo0in1 condition s 2 st be 2et. $ll &rod ct 7et!il &!1e s ret rn e d b; the lo!d 2 2 e e t the re9 ir e 2 e n t s de6ine d in #l! s e 5.2.1.2. The Ne0 &rod ct s &!1e ret rn e d in ste - , cont !i n s the ite2 chos e n in ste - 1 0ithin its 6irst ten entrie s.
T&# Bench2!r8I W
&!1e
+cii
C a u s e 8 , SCA%2N1 AN ) )ATABA SE P . P 9%AT2.N
8 ' & 1e n er a S c a in g Ru e
The thro 1 h - t o6 the T&#*W benc h 2 ! r 8 is drive n b; the !ctivit; o6 the A2 l !t e d Bro0s er s 'ABHs) conn e c t e d to the store 6ront. A!ch AB e2 l !t e s onl; one %ser Session !t ! ti2 e. To incre ! s e the thro 1 h - t de 2 ! n d on the S%T, the n 2 b e r o6 ABHs con6i1 r e d h!s to be incre ! s e d . The stor e 6ront re9 ir e s ! n 2 b e r o6 ro0s to -o- l !t e the t!bl es o6 the d!t ! b ! s e !lon 1 0ith so2 e stor! 1 e s-!c e to 2 !int !i n st!tic CTM@ -!1 e s , 0eb obEect s !nd the d!t ! 1en e r ! t e d d rin1 ! de6in e d -eriod o6 !ctivit; c!lled the 180* d!; -eriod. The 6ollo0in1 re9 ir e 2 e n t s de6ine ho0 stor! 1 e s-!c e !nd d!t ! b ! s e -o- l !tio n sc!l e 0ith thro 1 h - t . (.1.1 The inten t o6 the sc!lin1 re9 ire 2 e n t s is to 2!int !i n the r!tio bet0 e e n the 0eb inter ! c tio n lo!d -res e n t e d to the S%T, the c!rdin !lit; o6 the t!ble s !cc e s s e d b; the inter ! c tio n s, the re9 ire d s-!c e 6or stor ! 1 e , !nd the n 2 b e r o6 ABHs 1en e r ! t i n 1 the tr!n s ! c ti o n lo!d. Sho ld !n; sc!lin1 v!l e in #l! s e (.5 be e+c e e d e d , the other s 2 st -ro-ortion !ll; to 2!int !i n the s! 2 e r!tios !2 o n 1 the 2 !s in #l! s e (.5. be incre ! s e d
(.1.2
(.1.5
The re-ort e d thro 1 h - t 2 !; not e+c e e d the 2 !+i 2 2 !llo0e d b; the sc!lin1 re9 ire 2 e n t s in #l! s e (.2 !nd the -!cin 1 re9 ir e 2 e n t s in #l! s e 5.2. While the re-ort e d thro 1 h - t 2 !; 6!ll short o6 the 2 !+i 2 2 !llo0e d b; the con6i1 r e d s;st e 2 , the -rice/ - e r6or 2 ! n c e co2 - t ! ti o n 'see #l! s e ,.1) 2 st re-ort the -rice 6or the s;st e 2 !s !ct !ll; con6i1 r e d . The con6i1 r e d ABLs 2 st re2 !i n !ctive !nd 1en e r ! t i n 1 0eb inter ! c tio n s thro 1 h o t the entire 2 e ! s r e 2 e n t interv !l.
(.1.(
8 ' 4 S c a i n g R e B u ir e m e n t s
(.2.1 7!t! b ! s e sc!lin1 is de6in e d b; the c!rdin !lit; 'n 2 b e r o6 ro0s) o6 the <TAM t!bl e !nd the n 2 b e r o6 ABHs con6i1 r e d 6or W<&S, i.e., it is de6ine d b; the si:e o6 the store !nd si:e o6 the s - - ort e d c sto 2 e r -o- l !tio n. The c!rdin !lit; o6 the <TAM t!bl e, N%MS<TAMS, 2 st be chos e n 6ro2 the set o6 de6in e d sc!l e 6!ctors !s 6ollo0s. 1,00 0G 10,00 0G 100,0 0 0 G 1,00 0, 0 0 0 G 10,0 0 0, 0 0 0 Test s-on s o r s 2 st choos e the stor e 6ront si:e the; 0!nt to benc h 2 ! r 8 b; selectin 1 ! sc!l e 6!ctor 6ro2 the !bov e de6ine d serie s.
(.2.2
T&# Bench2!r8I W
&!1e
+ciii
(.2.5 (.2.( (.2.5
The c!rdin !lit; o6 the $%TC=? t!bl e is ! 6 nction o6 the <TAM t!bl e, !s de6in e d in (.5 The c!rdin !lit; o6 the #=%NT?K t!bl e is 6i+ed. The initi!l c!rdin !lit; o6 the other t!bl es is ! 6 nction o6 the n 2 b e r o6 ABHs con6i1 r e d 6or the W<&S 2etric. The d!t ! b ! s e -o- l ! tion 2 st not ch!n 1 e 6or the seco n d ! r ; 2 et rics o6 W<&So !nd W<&Sb e+c e - t !s de6ine d in cl! s e (.6.1. Co0ev e r, the n 2 b e r o6 ABHs 2 !; ch!n 1 e 6or the seco n d ! r ; 2etrics The re-ort e d W<&S thro 1 h - t is re9 ire d to s!tis6; the 6ollo0in1 ine9 !liti es. 'n 2 b e r o6 ABHs)/1( U W<&S U 'n 2 b e r o6 ABHs)/, Com m e n t . The intent o6 this cl! s e is to -rev e n t re-ortin 1 ! thro 1 h - t th!t e+c e e d s the 2!+i 2 2 , 0her e the 2 !+i 2 2 thro 1 h - t is !chi ev e d 0ith in6initel; 6!st 0eb inter ! c ti on s res ltin 1 in ! n ll res-o n s e ti2 e !nd 2ini 2 2 re9 ire d thin8 ti2 e s. This is co2 - t e d to be 1/, W<&S -er AB. To -rev e n t over* sc!lin1 the S%T, the thro 1 h - t c!nn o t 6!ll short o6 the !bov e 1/1( W<&S -er AB, 0hich re-r e s e n t s 50P o6 the co2 - t e d 2 !+i 2 2 thro 1 h - t .
(.2.6
8 ' 6 C o n fi g u r a t i o n
The 6ollo0in1 sc!lin1 re9 ir e 2 e n t s re-r e s e n t the initi!l con6i1 r ! tio n 6or the test describ e d in #l! s e 5 . 1. For e!c h t!bl e th!t co2 - o s e s the d!t ! b ! s e , the c!rdin !lit; o6 the initi!l -o- l ! tion is s-eci6ied !s 6ollo0s. Tab e Na m e Car#i n a i t * (in ro" s ) 2880 ^ 'n 2 b e r o6 AB) 92 2 ^ #%ST=MA? .9 ^ #%ST=MA? 5 ^ =?7A?S .25 ^ <TAM 1 ^ =?7A?S 18, 108, 1008, 1M, 10M T*pic a Ro" %en g t $ (in b*t e s ) ,60 ,0 15( 220 152 650 80 860 T*pic a Tab e SiC e (in b*t e s ) 2,18 8, 8 8 8 8 6.(( 8 88,,0 ( 0 8 5,0,2 ( 0 8 1,02 6, ( 5 2 8 1,5, 5 8 20,,5 6 0 8 8,60 0 8
#%ST=MA? #=%NT?K $77?ASS =?7A?S =?7A?S@<NA $%TC=? ##SJ$#TS <TAM
T&# Bench2!r8I W
&!1e
+civ
Not e & . T!ble si:es !re co2 - t e d 6or 1,000 ABHs !nd 10,0 0 0 ite2 s Not e 4 . V!l es 6or the <TAM t!ble do not incl d e the ite2Ls i2!1 e !nd th 2 b n ! il Not e 6 . The t;-ic!l ro0 len1t h s !nd t!bl e si:es 1iven !bov e !re e+ ! 2 -l e s o6 0h!t co ld res lt 6ro2 !n i2-le 2 e n t ! t i o n . The; !re not re9 ir e 2 e n t s . The; do not incl d e stor! 1 e !nd !cce s s overh e ! d s . Not e 8A No v!ri!tion is !llo0e d on t!bl e c!rdin !lit; e+ce - t on =?7A?S@<NA 0her e the c!rdin !lit; 0ill v!r; sli1htl; d e to the r!ndo 2 n 2 b e r o6 ro0s 1en e r ! t e d -er order !s s-eci6ied in cl! s e (.,.1. #!rdin !lit; 2 st 2e e t ! 2ini2 2 re9 ir e 2 e n t o6 2.95 ti2 e s the n 2 b e r o6 ro0s in the =?7A? t!bl e. 2. 5. The incre 2 e n t '1r! n l ! rit ;) 6or sc!lin1 the AB -o- l ! tion is one bro0s e r. T;-ic!l len1t h s !nd si:es 1iven here !re e+! 2 -l e s o6 0h!t co ld res lt 6ro2 !n i2-le 2 e n t ! t i o n . The; !re not re9 ir e 2 e n t s . The; do not incl d e stor ! 1 e / ! c c e s s overh e ! d s . The s;2 b ol Q8R 2e ! n s one tho s ! n d !nd QMR 2 e ! n s one 2illion.
(.
8 ' 8 & ( + , )a* S p a c e Co m p u t a ti o n

The stor! 1 e s-!c e re9 ire d 6or the d!t ! b ! s e 6or the 180* d!; -eriod 2 st be det er 2 i n e d !s 6ollo0s. !) The test d!t ! b ! s e 2 st be b ilt incl din1 the initi!l d!t ! b ! s e -o- l ! tion 'se e #l! s e (.() !nd !ll indice s -res e n t d rin1 the test. b) The test d!t ! b ! s e 2 st be b ilt to s st !i n the re-ort e d thro 1 h - t d rin1 !n ei1ht ho r -eriod. This e+cl d e s -er6or 2i n 1 on the d!t ! b ! s e !n; o-er ! ti o n th!t does not occ r d rin1 !n; Me!s r e 2 e n t <nterv !l 'se e #l! s e 5.5). c) The test d!t ! b ! s e 2 st be b ilt to s - - ort the tot !l reso rc e re9 ire 2 e n t s 6or 1( d!;s o6 contin o s o-er ! ti o n 'se e #l! s e 6.,.1) d) The 1ro0t h o6 the d!t ! b ! s e , B in b;t e s, sho ld be 2e ! s r e d !s the initi!l si:e o6 the d!t ! b ! s e co2 - ! r e d !1!i n st the si:e o6 the d!t ! b ! s e !t the end o6 the Test ? n 'see #l! s e 5.5.1). e) $ss 2i n 1 T< is the tot!l n 2 b e r o6 0eb inter ! c tio n s -roc e s s e d d rin1 the d r!tio n o6 the Test ? n, !nd W<&S is the re-ort e d thro 1 h - t , 180* d!; s-!c e in b;t e s is c!lc l !t e d !s 6ollo0s. 180* 7!;* S-!c e [ <niti!l S-!c e X ''B/T<) ^ W<&S ^ 560 0 ^ 8 ^ 180) 6) The 6ree s-!c e -res e n t in the test d!t ! b ! s e is consid er e d !s -!rt o6 the 180* 7!;* S-!c e.
8 ' : %o g R e B u ir e m e n t s
(.5.1 Web Serv er $ccess @o1 There 2 st be eno 1 h s-!c e con6i1 r e d on the S%T to store Web Server $cces s @o1s, in #o2 2 o n @o1 For2 ! t , !s s-eci6ied in #l! s e 2.2.15, 6or ! -eriod o6 8 ho rs. The s-!c e re9 ir e d 6or this is det e r 2 i n e d !s 6ollo0s. T&# Bench2!r8I W St!nd!rd S-eci6ic!tion Version &'( &!1e +cv
!) The 1ro0t h o6 the lo1 6ile, @, is 2e ! s r e d !s the si:e o6 the lo1 6ile !t the be1in ni n 1 o6 the test d r!tion co2 - ! r e d !1!i n st the si:e o6 the lo1 6ile !t the end o6 the test d r!tio n. $t the end o6 the test, it sho ld be veri6ied th!t the d!t ! 6or the lo1 6ile is co2 -l et el ; 0ritte n to d r! bl e 2e di !. b) $ss 2i n 1 T< is the tot!l n 2 b e r o6 0eb inter ! c tio n s -roc e s s e d d rin1 the test d r!tion !nd W<&S is the re-ort e d thro 1 h - t , 8* ho r* 0eb* lo1* s-!c e is the n co2 - t e d !s 6ollo0s. 8* ho r* 0eb* lo1* s-!c e [ '@/T<) ^ W<&S ^ 5600 ^ 8 Com m e n t . <n !ddition to 2 !int !i ni n 1 the Web Server $ccess @o1 6or ! 2ini 2 2 o6 8 ho rs, the S%T 2 st co2 -l; 0ith the re9 ire 2 e n t 6or 1( d!;s o6 nint err - t e d e+ec ti o n, !s de6ine d in #l! s e 6.,.1. For e+ ! 2 -l e , the re9 ire 2 e n t i2-lies th!t the Web Server $ccess @o1 c!n eith er be s0itch e d !nd b!c8 e d* - 0itho t s;st e 2 interr - ti on ever; 8 ho rs, or th!t 1( d!;s o6 Web Server $ccess @o1 2 st be 2!int !i n e d . (.5.2 7!t! b ! s e @o1 ?e9 ire 2 e n t s 7!t ! b ! s e lo1 s-!c e 2 st be l!r1e eno 1 h to !cco 2 2 o d ! t e , d!;s o6 1ro0t h. The lo1 s-!c e re9 ir e 2 e n t s !re b!s e d on 8 ho rs -er d!; !t the re-ort e d W<&S r!t e. The , 7!; @o1 S-!c e is c!lc l !t e d sin1 the 6ollo0in1 6or2 l !. , 7!; @o1 S-!c e [ <niti!l S-!c e X ''@B/T<) ^ W<&S ^ 5600 ^ 8 ^ ,) Wher e @B is the 1ro0t h o6 the d!t ! b ! s e lo1 in b;t e s, !nd sho l d be 2 e ! s r e d !s the initi!l si:e o6 the d!t ! b ! s e lo1 co2 - ! r e d !1!i n s t the si:e o6 the d!t ! b ! s e lo1 !t the end o6 the Test ? n. T< is the tot !l n 2 b e r o6 0eb inter ! c ti on s -roc e s s e d d rin1 the d r!tion o6 the Test ? n, !nd W<&S is the re-ort e d thro 1 h - t . <t is not nec e s s ! r ; th!t the lo1 s-!c e be !lloc!t e d !nd 6or2 ! t t e d re! d ; to se 6or lo11in1. <t is re9 ir e d th!t the dis8 s-!c e nec e s s ! r ; be on the S%T !nd visible to the o-er ! ti n 1 s;st e 2 . See cl! s e 5.5.2.2 6or 6 rth er restriction s.
8 ' ; ) a t a b a s e P o p u a tio n
(.6.1 The test describ e d in #l! s e 5 re9 ir e s th!t the d!t ! b ! s e be -ro- e rl; sc!l e d 0ith the initi!l -o- l ! tion. <t is !llo0e d, b t not re9 ir e d, to relo! d or rollb!c8 the d!t ! b ! s e to its initi!l -o- l ! tion be6or e !n; Test ? n. No other !lter ! tio n to the de6ine d d!t ! b ! s e -o- l ! tion is !llo0e d !t !n; ti2 e other th!n the se o6 one o6 the 0eb inter ! c tio n 2i+e s de6in e d in #l! s e 5.2.1. 7e6inition o6 Ter2 s The ter 2 ran # o m 2e ! n s inde - e n d e n t l ; select e d !nd r!n 1 e o6 v!l e s. ni6or 2l; distrib t e d over the s-eci6ied
(.6.2 (.6.2.1
(.6.2.2
The not !tion ran # o m a, stri n g F x '' y G re-r e s e n t s ! strin1 o6 ch!r ! c t e r s r!ndo 2 l ; dr!0 n 6ro2 the set o6 ch!r ! c t e r s co2 -risin 1 !ll lett er s in bot h -- er !nd lo0er c!s e, !ll n 2 e ri c di1its 6ro2 0 to 9 incl siv e !nd !ll o6 the 6ollo0in1 s-eci !l ch!r ! c t e r s incl din 1 ! bl!n8 s-!c e.
T&# Bench2!r8I W
&!1e
+cvi
c 3 ] M P d W ^ ' ) S * [ X a b Y Z \ . G , . O / e Us - ! c e V The len1t h o6 the strin1 is r!ndo 2 0ith 2ini2 2 v!l e +, 2!+i 2 2 v!l e ;, !nd 2 e ! n ';X+)/2. (.6.2.5 The not !tion ran # o m n, strin g F x.. y G re-r e s e n t s ! strin1 o6 n 2 e ri c ch!r ! c t e r s r!ndo 2 l ; dr!0 n 6ro2 the set o6 !ll n 2 e ri c di1its. 0 1 2 5 ( 5 6 , 8 9. The len1t h o6 the strin1 is r!nd o 2 0ith 2ini 2 2 v!l e +, 2 !+i 2 2 v!l e ;, !nd 2 e ! n ';X+)/ 2. The not !tio n ni9 e 0ithin Y+Z re-r e s e n t s !n; one v!l e 0ithin ! set o6 + conti1 o s v!l e s, ni9 e 0ithin the 1ro - o6 ro0s bein1 -o- l ! t e d . When sev er !l 1ro - s o6 ro0s o6 the s! 2 e t;-e !re -o- l !t e d , e!c h 1ro - 2 st se the s! 2 e set o6 + conti1 o s v!l e s. The not !tion r!ndo 2 0ithin Y+ .. ;Z re-r e s e n t s ! r!ndo 2 v!l e inde - e n d e n t l ; select e d !nd ni6or2l ; distrib t e d bet0 e e n + !nd ;, incl siv el;, 0ith ! 2e ! n o6 '+ X;)/ 2, !nd 0ith the s! 2 e n 2 b e r o6 di1its o6 -recision !s sho0n. For e+! 2 -l e, Y0.01 .. 100.0 0Z h!s 10,00 0 ni9 e v!l e s, 0her e ! s Y1 ..100Z h!s onl; 100 ni9 e v!l e s. The not !tion r!ndo 2 -er 2 t ! t i o n o6 Y+ .. ;Z re-r e s e n t s ! se9 e n c e o6 n 2 b e r s 6ro2 + to ; !rr! n 1 e d into ! r!nd o 2 order. This is co2 2 o nl ; 8no0n !s ! -er 2 t ! t i o n 'or selection) 0itho t re-l !c e 2 e n t . The not !tion r!ndo 2 d!t e re-r e s e n t s ! d!t e v!l e select e d !t r!nd o 2 0ithin the s-eci6ied r!n 1 e o6 d!t e s. This cl! s e h!s be e n re2 ov e d . The ter 2 7i1S;l 6 nction is se d in this s-eci6ic!tio n to re6er to the 6ollo0in1 6 nction. 7i1S;l'7, N) 0her e. 7 is ! -ositive inte 1 e r. N is !n inte1 e r th!t s-eci6ies the n 2 b e r o6 2* ch!r ! c t e r s;ll!bl e s in the strin1 ret rn e d b; 7i1S;l. N c!n be 0 or 2 st be 1re ! t e r th! n or e9 !l to the n 2 b e r o6 di1its in the deci 2 !l re-r e s e n t ! t i o n o6 7. 7i1S;l'7, N) ret r n s ! strin1 0hich is the conc ! t e n ! t i o n o6 2* ch!r ! c t e r s;ll!bl e s constr c t e d b; re-l !ci n 1 e!c h di1it in the deci 2 !l re-r e s e n t ! t i o n o6 7 0ith the corres - o n di n 1 2* ch!r ! c t e r s;ll!bl e 6ro2 the 6ollo0in1 t!bl e. )igit S* a b e 0 B$ =B 1 2 $@ 5 ?< ( ?A 5 SA 6 $T , %@ 8 <N 9 NB
(.6.2.(
(.6.2.5
(.6.2.6
(.6.2.,
(.6.2.8 (.6.2.9
<6 N is 1re ! t e r th! n the n 2 b e r o6 di1its in the deci 2 !l re-r e s e n t ! t i o n o6 7, the n the deci 2 !l re-r e s e n t ! t i o n is -!d d e d 0ith le!di n 1 :eros ntil the tot !l n 2 b e r o6 deci 2 !l di1its is N. E3a m p e . To obt !i n 7i1S;l'15, 5), 15 is -!d d e d to 000 1 5 , !nd the n 2 ! - - e d into this conc ! t e n ! t i o n o6 s;ll!bl e s. B$B$B$=BSA. 'i.e., 7i1S;l'15, 5) [ B$B$B$=BSA)
T&# Bench2!r8I W
&!1e +cvii
<6 N is 0, the n the n 2 b e r o6 s;ll!bl e s in 7i1S;l'7, 0) is the n 2 b e r o6 deci 2 !l di1its in the re-r e s e n t ! t i o n o6 7. E3a m p e . To obt !i n 7i1S;l'15, 0), 15 is 2! - - e d into. =BSA. 'i.e., 7i1S;l'15, 0) [ =BSA) (.6.2.1 0 The c sto 2 e r 7i1S;l'#S<7, 0). ser n! 2 e ' CD9NAME ) 2 st be 1en e r ! t e d !s the strin1 ret r n e d b;
E3a m p e . Biven ! #S<7 o6 5,1 9, #S%N$MA is 1en e r ! t e d !s. 7i1S;l'5, 1 9, 0) [ ?<%@=BNB. Com m e n t . Bec! s e #S<7Ls !re #S%N$MA. ni9 e n 2 b e r s , 7i1S;l !sso ci ! t e s to e!c h #S<7 ! ni9 e
(.6.2.1 1 The c st o 2 e r -!ss 0 or d ' CDPASS W ) ) 2 st be 1en e r ! t e d 7i1S;l'#S<7, 0) conv er t e d to !ll lo0er c!s e ch!r ! c t e r s.
!s
the
strin1
ret rn e d
b;
E3a m p e A Biven ! #S<7 o6 5,19, the res ltin 1 #S%N$MA is ?<%@=BNB !nd the res ltin1 #S&$SSW7 is ri lo1n 1. (.6.2.1 2 The ite2 s bE ect ' 2DS9B/ECT ) 2 st be chos e n !t r!nd o 2 6ro2 the 6ollo0in1 list. $?TS B<=B?$&C<AS B%S<NASS #C<@7?AN #=M&%TA?S #==><NB CA$@TC C<ST=?K C=MA C%M=? @<TA?$T%?A MKSTA?K N=N*F<#T<=N &$?ANT<NB &=@<T<#S ?AFA?AN#A ?A@<B<=N ?=M$N#A SA@F*CA@& S#<AN#A*N$T%?A S#<AN#A*F<#T<=N S&=?TS K=%TC T?$VA@
(.6.2.1 5 The <TAM i2! 1 e !nd th 2 b n ! il '<S<M$BA, <STC%MBN$<@) !re 1r!- hi c obEect s. <n the eve n t th!t 1r!- hic obEect s !re not store d directl; in the d!t ! b ! s e , then the !ct !l loc!tion o6 the obEect s, eith er in ter2 s o6 the 6ile s;st e 2 s-eci6ic!tion, %?@ or d!t ! b ! s e 8e;, constit t e s the v!l e 6or the <S<M$BA !nd <STC%MBN$<@ 6ields in the <TAM t!bl e. <n !n; eve n t , the stor! 1 e on the S%T 0ill incl d e the c!- ! cit ; nec e s s ! r ; 6or !ll the obEect s. The -o- l ! tion o6 thes e 6ields is i2-le 2 e n t ! t i o n s-eci6ic. (.6.2.1 ( The c sto 2 e r e2 !il !ddr e s s 6ield '#SAM$<@) is 1en e r ! t e d b; the conc ! t e n ! t i o n o6 the corre s - o n di n 1 v!l e in #S%N$MA 6ollo0e d b; the s-eci !l ch!r ! c t e r Q3R 6ollo0e d b; ! r!ndo 2 !* strin1 Y2 .. 9Z 6ollo0ed b; the strin1 o6 ch!r ! c t e r s Q.co2 R. E3a m p e A Biven ! #S%N$MA o6 ?<%@=BNB, #SAM$<@, the c sto 2 e r e2 !il !ddr e s s , 2 !; be ?<%@=BNB3bEs2 ! c>d.co 2 . (.6.2.1 5 The co nt r; n! 2 e ' C.DNAME ) 2 st be chos e n !t r!nd o 2 6ro2 the 6ollo0in1 list, sho0n her e !lon1 0ith their !sso ci ! t e d e+ch ! n 1 e r!t e, C.DE@CHAN1E , !nd c rre n c ;, C.DC9RRENC7 .
T&# Bench2!r8I W
&!1e +cviii
Na m e %nited St!t e s #!n! d ! Fr!nc e Neth erl ! n d s S0it:erl ! n d $l1eri! $r2eni ! $:erb !iE !n B!hr !in B!rb ! d o s Bel1i 2 Bolivi! Br!:il #hile #ro!ti ! #;-r s 7en 2 ! r8
E3c$ a n g e 1 1.(6 , 1 2 6.2( 2 5 8 2.09 , 1 5 1.51 6 ( 5 65.5 8 5 1 5(0.9 2 59,, 0.5,5 , 2 58.5 8 9 2 5.,( 1.,1 (9(.2 ,.50( ( 0.5( 5 ,.0,0 , &esos 5.55 , , 1 1(.9 9 1 2 1.9,2 ( 62,.1 9 9 9 509.2 1 ( ,.,5 ( , 5 ,(.1( , 8100 0.508 5 (.12 0.,0 8 0.506 2 58.5 8 9 2 9.628 , 1.8, 5 5 9 52 5.952 5 151 8 0 . 2
Curre n c * 7oll!rs 7oll!rs Fr!nc s B ilders Fr!nc s 7in!rs 7r!2 M!n!t 7in!r 7oll!rs Fr!nc s Bolivi!no ?e!l 7oll!rs &esos 7oll!rs > n! &o nd s >roner 7oll!rs &o nd s >roon &o nd 7oll!rs Fr!nc 7r!ch 2 ! s 7oll!rs >ron! ? -i!h 7in!r She8 el s 7in!r 7in!r Fr!nc s &esos 7oll!rs ? -e e s Tlot; @e
Na m e Ber2 ! n ; "!-!n <t!l; $ str!li! $r1entin ! $ stri! B!h ! 2 ! s B!n1l ! 7esh Bel!r s Ber2 d ! Bots0 ! n ! B l1!ri ! #h!d #hin! #olo2 bi ! # b!
E3c$ a n g e 1.86 1 2 5 121.9 0 , 18( 2. 6 ( 1.5( 2 0 8 0.99 8 15.0 9 ( 9 1 (8.6 5 2(80 0 0 1 (.,50 ( 18(6 62,.1 9 9 9 8.2, 8 16,, 25
Curre n c * &o nd s 7e t sc h e M!r8s Ken @ir! 7oll!rs &esos Schillin1s 7oll!rs T!8! ?o ble 7oll!rs & l! @ev Fr!nc K !n ?en 2i 2 bi &esos &esos >or n ! 15.8 S cre #olon Birr >rone M!r88! &o nd 7oll!rs Forint ? -e e s ?i!l & nt 7oll!rs Ten1 e &o nd s ?in11it ? -e e s >roner &esos Asc do ? bles &!1e +ci+
%nited >in1do 2 0.625 ( 6 1
#!;2 ! n <sl!nd s 0.828 2 #hrist 2 ! s <sl!nd 1.559 1
#:ech ?e- blic 56.0 1 2 , 7o2inic ! n ?e- blic Ac !d o r Al S!lv!d o r Athio-i ! F!roe <sl!nd Finl!n d Bibr!lt !r B !2 C n1! r ; <ndi! <r!n <rel!n d "!2 !ic ! >!:!8h st ! n @eb!n o n M!l!;si ! M! riti s Nor0!; &hili--in e s &ort 1 !l ? ssi! 9600 8., ,., ,.12 ( 5.65 8 2 2 0.625 5 1 25,.2 5 (2., 5 5000 0.,(9 ( 8 1 5,.( 150 1502 5.8 25.2( 5 ,.85 1 0 1 5,.8 5 0 1 190., 8 8 2(.( 5
A!st er n #!ribb e ! n 2., A1;-t Astoni ! FiEi B!bon Breec e Con1 >on1 <cel!n d <ndon e si ! <r!9 <sr!el "ord!n > 0!it @ +e 2 b o r 1 Me+ico Ne0 Te!l ! n d &!8ist ! n &ol!nd ?o2 ! ni !
F!l8l!nd <sl!nd 0.625 5
T&# Bench2!r8I W
S! di $r!bi! Slov!8i! So t h >ore! S d!n T!i0!n Trinid! d Vene: el !
5.,50 1 (5.9 6 ( 2 119 0. 1 5 5.28 2 52., , 6.1,6 ( 596
?i;!l >or n ! Won 7in!r 7oll!rs 7oll!rs Boliv!r
Sin1! - o r e So t h $6ric! S-!in S0ed e n Th!il!n d T r8e; T!2 bi !
1.,2 9 2 9 6.25 8 ( 5 158.5 ( 8.5( ( , , 5,.1 ( 1 ( (015 0 0 2((,. ,
7oll!rs ?!nd &eset ! s >ron! B!ht @ir! >0!ch !
(.6.2.1 6 The ite2 b!c8in1 ' 2DBACK2N1 ) 2 st be chos e n !t r!ndo 2 6ro2 the 6ollo0in1 list. C$?7B$#> &$&A?B$#> %SA7 $%7<= @<M<TA7*A7<T<=N
(.6.2.1 , The ite2 di2 e n si o n s ' 2D)2MENS2.NS ) 2 st be 1en e r ! t e d b; the conc ! t e n ! t i o n o6 5 r!ndo 2 n 2 e ri c v!l e s 0ithin Y0.01..9 9. 9 9Z, se- ! r ! t e d b; !n Q+Q. E3a m p e A 12.2 5+ 1 6. 5 0 + 1 . 2 5 (.6.2.1 8 The ! t h or id '<S$S<7) !ssoci !t e d 0ith e!c h ite2 2 st 1en e r ! t e d !s 6ollo0s. i6 <S<7 U [ 'N%MS<TAMS/() <S$S<7 [ <S<7 else <S$S<7 [ r!ndo 2 0ithin Y1 .. N%MS<TAMS/() (.6.2.1 9 $ WBAN tilit; 6or 1en e r ! ti n 1 -se d o* l!n1 ! 1 e te+t h!s bee n dev elo - e d to !ssist in -o- l ! tin 1 the d!t ! b ! s e . 7et!ils c!n be 6o nd in $--e n di+ C, !nd the tilit; c!n be obt !in e d 6ro2 the T&# 0eb site. The ite2 title ' 2DT2T%E ) !nd the ! t h or l!st n! 2 e ' AD%NAME ) 2 st be 1en e r ! t e d sin1 WBAN.
8 ' = Ta b e P o p u a t i o n R e B u ir e m e n t s
(.,.1 The initi!l d!t ! b ! s e -o- l ! tion 2 st be co2 -ris e d o6 the 6ollo0in1 '0her e N%MS<TAMS is the n 2 b e r o6 record s in the <te2 t!bl e, N%MS=?7A?S in the =rder t!bl e, N%MS$%TC=?S in the $ thor t!bl e !nd N%MS#%ST=MA?S in the # sto 2 e r t!ble). Y1000, 10,0 0 0, 100,0 0 0, 1,00 0, 0 0 0 , 10,00 0, 0 0 0 Z ro0s in the <TAM t!bl e 'de- e n di n 1 on the sc!l e 6!ctor chos e n ) 0ith. <S<7 ni9 e 0ithin Y1 .. N%MS<TAMSZ <ST<T@A 1en e r ! t e d sin1 the T&#*W 7BBAN tilit; describ e d in $--en di+ C
<S$S<7 1en e r ! t e d !ccor din 1 to #l! s e (.6.2.1 8
T&# Bench2!r8I W
&!1e
<S&%BS7$TA r!ndo 2 d!t e bet0 e e n "!n !r ; 1, 195 0 !nd c rre n t d!t e <S&%B@<SCA? r!ndo 2 !* strin1 Y1( .. 60Z <SS%B"A#T 1en e r ! t e d !ccor din 1 to #l! s e (.6.2.1 2 <S7AS# r!ndo 2 !* strin1 Y100 .. 500Z <S?A@$TA71 to <?A@$TA75 1en e r ! t e d !s 5 r!nd o 2 !nd ni9 e <S<7Hs
<STC%MBN$<@, 1r! - hic obEect, 1en e r ! t e d !ccordi n 1 to #l! s e (.6.2.1 5 <S<M$BA, 1r! - hi c obEect, 1en e r ! t e d !ccordi n 1 to #l! s e (.6.2.1 5 <SS?& r!nd o 2 0ithin Y1.00 .. 9,99 9. 9 9Z <S#=ST 1en e r ! t e d !s <SS?& _ 'r!nd o 2 0ithin Y'0 .. 0.5) ^ <SS?&Z) <S$V$<@ 1en e r ! t e d !s <S&%BS7$TA X 'r!nd o 2 0ithin Y1 .. 50Z d!;s) <SST=#> r!ndo 2 0ithin Y10 .. 50Z <S<SBN r!nd o 2 !* strin1 o6 15 ch!r ! c t e r s <S&$BA r!nd o 2 0ithin Y20 .. 9,99 9Z <SB$#><NB, v!ri!bl e si:e te+t, 1en e r ! t e d !ccordi n 1 to #l! s e (.6.2.1 6 <S7<MANS<=NS 'len1t h + 0idth + hei1ht o6 the boo8), 1en e r ! t e d !ccor din 1 to #l! s e (.6.2.1 ,
92 ro0s in the #=%NT?K t!ble 0ith. #=S<7 ni9 e 0ithin Y1 .. 92Z #=SN$MA select e d 6ro2 the t!bl e in #l! s e (.6.2.1 5 #=SAJ#C$NBA select e d 6ro2 the t!bl e in #l! s e (.6.2.1 5 #=S#%??AN#K select e d 6ro2 the t!bl e in #l! s e (.6.2.1 5
'N%MS<TAMS / () ro0s in the $%TC=? t!bl e 0ith. $S<7 ni9 e 0ithin Y1 .. 'N%MS<TAMS/()Z $SFN$MA r!nd o 2 !* strin1 Y5 .. 20Z $SMN$MA r!nd o 2 !* strin1 Y1 .. 20Z $S@N$MA 1en e r ! t e d sin1 the T&#*W 7BBAN tilit; describ e d in $--e n di+ C
$S7=B r!nd o 2 d!t e bet0 e e n "!n !r; 1, 1800 !nd "!n !r; 1, 1990 $SB<= r!nd o 2 !* strin1 Y125 .. 500Z
'2880 ^ ] ABHs) ro0s in the #%ST=MA? t!bl e 0ith. #S<7 ni9 e 0ithin Y1 .. 288 0 ^ ] ABHsZ #S%N$MA 1en e r ! t e d !ccor din 1 to #l! s e (.6.2.1 0 #S&$SSW7 1en e r ! t e d !ccor din 1 to #l! s e (.6.2.1 1 #S@N$MA r!ndo 2 !* strin1 Y8 .. 15Z #SFN$MA r!nd o 2 !* strin1 Y8 .. 15Z #S$77?S<7 r!nd o 2 0ithin Y1 .. 2 ^ 288 0 ^ ] ABHsZ St!nd!rd S-eci6ic!tion Version &'( &!1e ci
T&# Bench2!r8I W
#S&C=NA r!ndo 2 n* strin1 Y9 .. 16Z #SAM$<@ 1en e r ! t e d !ccor din 1 to #l! s e (.6.2.1 ( #SS<N#A 1en e r ! t e d !s c rre n t d!t e _ r!ndo 2 0ithin Y1 .. ,50Z d!;s #S@$STSV<S<T 1en e r ! t e d !s #SS<N#A X r!ndo 2 0ithin Y0 .. 60Z d!;s, b t not e+c e e di n 1 the c rre n t d!t e #S@=B<N d!t e/ ti 2 e 1iven b; the o-er ! ti n 1 s;st e 2 0hen the t!bl e 0!s -o- l ! t e d #SAJ&<?$T<=N 1en e r ! t e d !s #S@=B<N X 2 ho rs #S7<S#=%NT r!ndo 2 0ithin Y0.00 .. 0.50Z #SB$@$N#A [ 0.00 #SKT7S&MT r!nd o 2 0ithin Y0.00 .. 999.9 9Z #SB<?TC7$TA r!nd o 2 d!t e bet0 e e n "!n !r; 1, 1880 !nd c rre n t d!t e #S7$T$ r!ndo 2 !* strin1 Y100 .. 500Z
'0.9 ^ N%MS#%ST=MA?S) ro0s in the =?7A?S t!bl e 0ith. =S<7 ni9 e 0ithin Y1 .. '0.9 ^ N%MS#%ST=MA?S)Z =S#S<7 r!ndo 2 0ithin Y1 .. N%MS#%ST=MA?SZ =S7$TA 1en e r ! t e d !s c rre n t d!t e !nd ti2 e _ r!nd o 2 0ithin Y1 .. 60Z d!;s =SS%BST=T$@ r!nd o 2 0ithin Y10.00 .. 9999. 9 9Z =ST$J 1en e r ! t e d !s =SS%BST=T$@ ^ 0.08 2 5 =ST=T$@ 1en e r ! t e d !s =SS%BST=T$@ X =ST$J X 5.00 X '1.00 ^ co ntSo6Site 2 sSinSord e r) =SSC<&STK&A select e d !t r!ndo 2 6ro2 the 6ollo0in1. $<?, %&S, FA7AJ, SC<&, #=%?<A?, M$<@ =SSC<&S7$TA 1en e r ! t e d !s =S7$TA X r!ndo 2 0ithin Y0 .. ,Z d!;s =SB<@@S$77?S<7 [ r!nd o 2 0ithin Y1 .. '2 ^ N%MS#%ST=MA?S)Z =SSC<&S$77?S<7 [ r!ndo 2 0ithin Y1 .. '2 ^ N%MS#%ST=MA?S)Z =SST$T%S select e d !t r!ndo 2 6ro2 the 6ollo0in1. &?=#ASS<NB, SC<&&A7, &AN7<NB, 7AN<A7 For e!c h ro0 in the =?7A?S t!bl e, ! n 2 b e r o6 ro0s in the =?7A?S@<NA t!bl e, 0her e the n 2 b e r is select e d !t r!ndo 2 0ithin Y1..5Z 0ith. =@S<7 ni9 e 0ithin Y1 .. 100Z =@S=S<7 [ =S<7 =@S<S<7 r!nd o 2 0ithin Y1 .. N%MS<TAMSZ =@SDTK r!nd o 2 0ithin Y1 .. 500Z =@S7<S#=%NT r!ndo 2 0ithin Y0.00 .. 0.05Z =@S#=MMANTS r!nd o 2 !* strin1 Y20 .. 100Z
'1 ^ N%MS=?7A?S) ro0s in the ##SJ$#TS t!bl e 0ith. St!nd!rd S-eci6ic!tion Version &'( &!1e cii
T&# Bench2!r8I W
(.,.2
#JS=S<7 [ =S<7 #JSTK&A select e d !t r!ndo 2 6ro2 the 6ollo0in1. V<S$, M$STA?#$?7, 7<S#=VA?, $MAJ, 7<NA?S #JSN%M r!ndo 2 n* strin1 o6 16 di1its #JSN$MA r!ndo 2 !* strin1 Y1( .. 50Z #JSAJ&<?K c rre n t d!t e X r!nd o 2 0ithin Y10 .. ,50Z d!;s #JS$%TCS<7 r!ndo 2 !* strin1 o6 15 ch!r ! c t e r s #JSJ$#TS$MT [ =ST=T$@ #JSJ$#TS7$TA [ =SSC<&S7$TA #JS#=S<7 r!nd o 2 0ithin Y1 .. 92Z
'2 ^ N%MS#%ST=MA?S) ro0s in the $77?ASS t!bl e 0ith. $77?S<7 ni9 e 0ithin Y1 .. '2 ^ N%MS#%ST=MA?S)Z $77?SST?AAT1 r!nd o 2 !* strin1 Y15 .. (0Z $77?SST?AAT2 r!nd o 2 !* strin1 Y15 .. (0Z $77?S#<TK r!ndo 2 !* strin1 Y( .. 50Z $77?SST$TA r!ndo 2 !* strin1 Y2 .. 20Z $77?ST<& r!nd o 2 !* strin1 Y5 .. 10Z $77?S#=S<7 r!nd o 2 0ithin Y1 .. 92Z
The i2-le 2 e n t ! t i o n 2 !; not t!8e !dv ! n t ! 1 e o6 the 6!ct th!t so2 e 6ields !re initi!ll; -o- l !t e d 0ith ! 6i+ed v!l e. For e+ ! 2 -l e , stor ! 1 e s-!c e c!n n o t be s!v e d b; de6inin1 ! de6! lt v!l e 6or !n; -!rtic l !r 6ield !nd storin1 this v!l e onl; once in the d!t ! b ! s e .
8 ' ( W1EN ) a t a P o p u a t i o n 1 e n e r a t o r
8' ( ' & (.8.1.1 )e s c ri p ti o n an # 9s e WBAN is so6t0!r e tilit; -rovid e d b; the T&# to e!s e the i2-le 2 e n t ! t i o n o6 critic!l -ortion s o6 the d!t ! -o- l ! tion de6in e d in #l! s e (.,.1 <n !ddition to the f#L so rc e code 6or the d!t ! 1en e r ! ti o n ro tin e s, the WBAN distrib tion -rovid e s ! s! 2 -l e driver ro tin e !nd !ssoci !t e d doc 2 e n t ! t i o n to e! s e !n; re9 ir e d 2odi6ic!tio n or enh ! n c e 2 e n t 'se e #l! s e (.8.2.(). WBAN 2 st be se d to 1en e r ! t e the cont e n t s o6 the <ST<T@A col 2 n in the <TAM t!ble !nd the $S@N$MA col 2 n in the $%TC=?S t!bl e. <n !ddition, the 7i1s;l') ro tin e incl d e d in the WBAN so rc e s 2 !; be se d to -o- l ! t e #S%N$MA !nd #S&$SSW7 in the #%ST=MA? t!bl e. The o t- t o6 WBAN 2! ; be 2odi6ied in the 6ollo0in1 0!;s -rior to bein1 lo!d e d into the 7BMS on the S%T. ?e* orderin 1 or sortin1 o6 the 1en e r ! t e d record s Se- ! r ! ti n 1 the 1en e r ! t e d record s into 2 lti-l e 6iles
(.8.1.2
(.8.1.5
T&# Bench2!r8I W
&!1e
ciii
While !n; co2 bi n ! tio n o6 the s e 2odi6ic!tion s 2 !; be se d, no other 2odi6ic!tion is -er 2it t e d . <n -!rtic l !r, no 2odi6ic!tion o6 the cont e n t s o6 the 1en e r ! t e d record s is !llo0e d. (.8.1.( The benc h 2 ! r 8 s-on s or 2 !; s!tis6; the re9 ir e 2 e n t s o6 #l! s e (.8.1.2 in one o6 t0o 0!;s. %sin1 the -rovid e d e+ ec t ! bl e to 1en e r ! t e 6l!t 6iles 'see #l! s e (.8.2) <ncor-or ! ti n 1 the d!t ! 1en e r ! ti o n ro tin e s o6 WBAN into ! c st o 2 lo!d -ro1r ! 2 'se e #l! s e (.8.5)
$ benc h 2 ! r 8 s-on s o r 0ho 0ish e s to s!tis6; #l! s e (.8.1.2 in so2 e other 2! n n e r 2 st sec r e -rior !--rov !l o6 the T&#*W s bco 2 2 i t t e e . (.8.1.5 $n; res lt th!t 6!ils to s!tis6; the re9 ir e 2 e n t s o6 #l! s e (.8.1.2 or 0hich e2 -lo;s ! 2et h o d other th! n thos e describ e d in #l! s e (.8.1.( in not co2 -li! nt 0ith the T&#*W s-eci6ic!tion. W1EN E3ec u t a b e s The WBAN distrib tion cont !i n s e+ ec t ! bl e s 0hich se the WBAN so rc e s to -rod c e co2 2 ! n d line e+ ec t ! bl e s 0hich !re re!d ; 6or se on so2 e -o- l !r o-er ! ti n 1 s;st e 2 s . A!ch e+ec t ! bl e relies on co2 2 ! n d line s0itch e s, !nd -rod c e s $S#<< o t - t 0ritt e n to st!n d ! r d o t - t. Com m e n t A $ co2 -l et e descri-tion o6 the co2 2 ! n d line s0itch e s s - - ort e d b; the WBAN e+ ec t ! bl e s , !lon 1 0ith ! s! 2 -l e set o6 o t- t 2 !; be 6o nd in $--en di+ C. (.8.2.2 The o t- t o6 one o6 the -re* s --lie d WBAN e+ec t ! bl e s 2 !; be se d to s!tis6; the re9 ire 2 e n t s o6 #l! s e (.8.1.2, -rovid e d th!t !n; 2odi6ic!tio n s 2! d e to the o t - t -rior to its s b 2i s sio n to the d!t ! b ! s e lo!d tilit; s!tis6; the re9 ire 2 e n t s o6 #l! s e (.8.1.5. The version o6 the WBAN e+ec t ! bl e se d to s!tis6; #l! s e (.8.1.2 2 st be disclos e d.
8' ( ' 4 (.8.2.1
(.8.2.5 (.8.2.(
<6 the s-on s or c!n n o t se one o6 the -rovid e d e+ ec t ! bl e s , he 2! ; 2odi6; the so rc e cod e -rovid e d in the WBAN distrib tion to -ort it to the S%T. $n; ch! n 1 e to the so rc e code 2 st be disclos e d, !nd the 2odi6ied so rc e code 2 st be 2! d e !v!il!bl e to the T&# -on re9 e s t to !llo0 its incor-or ! ti o n in 6 t re version s o6 the WBAN distrib tio n. <6 ch!n 1 e s !re 2! d e to the WBAN so rc e s , the res lt ! n t e+ec t ! bl e 2 st 2 e e t the 6ollo0in1 re9 ire 2 e n t s in order to be consid er e d correct. The cont e n t o6 individ !l col 2 n s 2 st 2 !t c h th!t -rod c e d b; WBANG The d!t ! 6or2 ! t o6 individ !l col 2 n s 2 st be identic!l to th!t -rod c e d b; WBANG The n 2 b e r o6 ro0s 1en e r ! t e d 6or ! 1iven sc!l e 6!ctor 2 st 2 !t c h th!t -rod c e d b; WBAN.
(.8.2.5
(.8.2.6
The Version !nd ?evision o6 the WBAN e+ ec t ! bl e se d 2 st 2 !t c h th!t o6 the s-eci6ic!tion !1!i n s t 0hich the res lt is - blish e d . For e+! 2 -l e, ! res lt !1!i n st T&#*W 1.0 2 st e2 -lo; ! WBAN rele! s e o6 1.0.0 or 1re ! t e r th!t is less th! n 1.1.0.
T&# Bench2!r8I W
&!1e
civ
8' ( ' 6 (.8.5.1
Cust o m i C e # %oa# 9ti iti e s The benc h 2 ! r 8 s-on s or 2! ; e2 -l o; the so rc e code -rovid e d in the WBAN distrib tio n to dev el o - ! c sto 2 lo!d tilit; 0hich is se d to s!tis6; the re9 ire 2 e n t s o6 #l! s e (.8.1.2, !nd 2 !; !lso be se d to lo!d the rest o6 the T&#*W d!t ! set. The so rc e cod e o6 !n; c sto 2 lo!d -ro1r ! 2 b!s e d on WBAN 2 st be disclos e d, !nd 2 st e2 -l o; ! 6 ll; s - - ort e d inter6!c e 6or !n; inter ! c ti on 0ith the 7BMS. $n; ch! n 1 e s to the WBAN so rc e code 2 st be cle!rl; identi6ied, !nd the 2odi6ied so rc e code 2 st be 2 ! d e !v!il!bl e to the T&# -on re9 e s t to !llo0 its incor-or ! ti o n in 6 t re version s o6 the WBAN distrib tion. The d!t ! -rod c e d b; the c st o 2 lo!d tilit; 2 st s!tis6; the d!t ! 2odi6ic!tion re9 ir e 2 e n t s o6 #l! s e (.8.1.(, !s 0ell !s thos e o6 #l! s e (.8.2.5. The onl; e+c e - ti o n to this re9 ir e 2 e n t is 0hen 2odi6ic!tion is re9 ir e d b; the s - - ort e d 7BMS inter6! c e 'e.1., b;t e s0! - -i n 1 o6 $S#<< v!l e s or tr!nsl !tio n to AB#7<#).
(.8.5.2
T&# Bench2!r8I W
&!1e
cv
C a u s e : , PER5.RMANCE METR2CS AN ) RES P. N SE T2ME

The t0o -ri2 !r ; 2 etrics o6 the T&#*W benc h 2 ! r 8 !re the n 2 b e r o6 Web <nter! c ti on s &er Seco n d 'W<&S), !nd ! -rice -er6or 2 ! n c e 2etric de6ine d !s 7oll!rs/W<&S 'M/W<&S). The 0eb inter ! c ti on 2i+ se d 6or the -ri2 !r ; 2etrics is inten d e d to re6lect !n !ver ! 1 e sho- -i n 1 scen ! rio. <t is nd er s t o o d th!t so2 e sho- -i n 1 !--lic!tion s !ttr! ct ser s -ri2 !ril; inter e s t e d in bro0sin 1, 0hile oth ers !ttr !c t thos e -l!nni n 1 to - rch ! s e . To -rovid e insi1ht !s to ho0 ! -!rtic l !r s;st e 2 0ill -er6or 2 nd er the s e conditions, t0o !ddition !l 2etrics, n! 2 el ; the W<&Sb !nd the W<&So, h!v e be e n de6ine d.
: ' & ) e f i ni ti o n o f Ter m s

5.1.1 The ter 2 Mea s u r e m e n t 2nter - a is se d in this s-eci6ic!tion to re6er to ! ste ! d ; st!t e -eriod d rin1 the e+ ec ti o n o6 the benc h 2 ! r 8 6or 0hich the test s-on s o r is re-ortin 1 ! -er6or 2 ! n c e 2etric 'se e #l! s e 5.5 6or det !il e d re9 ire 2 e n t s .) The ter2 S$ o p p i n g 2nt er - a is se d in this s-eci6ic!tion to re6er to the re-ort e d Me!s r e 2 e n t <nterv !l 'see #l! s e 5.5) d rin1 the e+ ec tio n o6 ! sho- -i n 1 scen ! rio co2 - o s e d o6 ! 2i+ o6 bro0sin 1 !nd orderin 1 !ctivit;. The ter2 Bro " s i n g 2nt er - a is se d in this s-eci6ic!tio n to re6er to the re-ort e d Me!s r e 2 e n t <nterv !l 'see #l! s e 5.5) d rin1 the e+ ec tio n o6 ! bro0sin 1 sce n ! rio co2 - o s e d o6 si1ni6ic! nt bro0sin 1 !ctivit; !nd rel!tiv el; little orderin 1 !ctivit;. The ter 2 .r# eri n g 2nt er - a is se d in this s-eci6ic!tion to re6er to the re-ort e d Me!s r e 2 e n t <nterv !l 'se e #l! s e 5.5) d rin1 the e+ ec tio n o6 !n orderin 1 scen ! ri o co2 - o s e d o6 si1ni6ic!n t orderin 1 !ctivit; !nd rel!tivel; little bro0sin 1 !ctivit;. The ter2 Web 2nt er a c t i o n Re s p o n s e Time 'W<?T) is se d in this s-eci6ic!tion to re6er to the ti2 e el!- s e d 6ro2 the 6irst b;t e sent b; the AB to re9 e s t ! 0eb inter ! c tio n ntil the l!st b;t e receiv e d b; the AB to co2 -l et e the 0eb inter ! c ti on 'se e #l! s e 5.5 6or det !il e d re9 ir e 2 e n t s .) The ter 2 T$in! Time is se d in this s-eci6ic!tion to re6er to the ti2 e el!-s e d 6ro2 the l!st b;t e receiv e d b; the AB to co2 -l et e ! 0eb inter ! c tio n ntil the 6irst b;t e sent b; the AB to re9 e s t the ne+t 0eb inter ! c ti on 'see #l! s e 5.5 6or det !ile d re9 ir e 2 e n t s .) The ter2 W2PS is se d in this s-eci6ic!tion to re6er to the !ver ! 1 e n 2 b e r o6 Web <nter ! c tio n s &er Secon d co2 -l et e d d rin1 the Sho--i n 1 <nterv !l. The ter2 HIW2PS is se d in this s-eci6ic!tion to re6er to the tot !l cost o6 the S%T 'see #l! s e ,) divide d b; the n 2 b e r o6 W<&S 2e ! s r e d d rin1 the Sho--i n 1 <nterv !l. The ter 2 W2PS b is se d in this s-eci6ic!tion to re6er to the !ver ! 1 e n 2 b e r o6 Web <nter! c ti on s &er Secon d co2 -l et e d d rin1 the Bro0sin 1 <nterv !l. 'W<&Sb is ! seco n d ! r ; 2etric.)
5.1.2
5.1.5
5.1.(
5.1.5
5.1.6
5.1.,
5.1.8
5.1.9
5.1.10 The ter 2 W2PS o is se d in this s-eci6ic!tion to re6er to the !ver ! 1 e n 2 b e r o6 Web <nter! c ti on s &er Secon d co2 -l et e d d rin1 the =rderin 1 <nterv !l. 'W<&So is ! seco n d ! r ; 2etric.)
T&# Bench2!r8I W
&!1e
cvi
5.1.11 The ter 2 Ram p 9p is se d in this s-eci6ic!tion to re6er to the ti2 e bet0 e e n the st!rt o6 the r n !nd the st!rt o6 the 2e ! s r e d interv !l.
: ' 4 W e b 2n t e r a c ti o n Mi3 e s
The T&#*W 0or8lo! d is 2 ! d e - o6 ! set o6 0eb inter ! c tio n s s-eci6ied in det !il in #l! s e 2. <n 1en e r !l, the s e 0eb inter ! c tion s c!n be cl!ssi6ied !s eith er QBro0s e R or Q=rderR de- e n di n 1 on 0het h e r the; involve bro0sin 1 !nd se !rc hi n 1 on the site or 0het h e r the; -l!; !n e+-licit role in the orderin 1 -roc e s s . The c!t e 1 o ri: !tio n se d 6or this benc h 2 ! r 8 is 6o nd in the t!bl e in #l! s e 5.2.1. The benc h 2 ! r 8 de6ine s thre e distinct Me!s r e 2 e n t <nterv !l s, e!c h 6or ! distinct 2i+ o6 0eb inter ! c ti on s, res ltin1 in thre e distinct -er6or 2 ! n c e 2 etrics. W<&S is the -ri2 !r ; -er6or 2 ! n c e 2etric !s it is b!s e d on !n !ver ! 1 e sho- -i n 1 sce n ! rio. W<&Sb !nd W<&So !re seco n d ! r ; -er6or 2 ! n c e 2 etrics. While si2il!r to the W<&S 2etric, the 0eb inter ! c ti on 2i+ 6or W<&Sb is -ri2 !ril; bro0sin 1, !nd the 0eb inter ! c ti on 2i+ 6or W<&So involves ! si1ni6ic!n t -erc e n t ! 1 e o6 orderin 1 res ltin1 in tr!ns ! c ti o n -roc e s si n 1. The ch!r ! c t e ri: ! tio n o6 the v!rio s 0eb inter ! c ti on 2i+e s !re 6o nd in #l! s e 5.2.1 belo0. :' 4 ' & Web 2nter a c t i o n Mi3 ReB u ir e m e n t s =ver e!c h Me!s r e 2 e n t <nterv !l, the ?BA 2 st 2 !int !i n the 2i+ o6 0eb inter ! c ti on s s-eci6ied in the t!ble belo0. The ?BA is e+- e c t e d to devi !t e 6ro2 the s-eci6ied -erc e n t ! 1 e s !s ! n!t r !l res lt o6 the 6inite r!ndo 2 selectio n -roce s s. The 2 !+i 2 2 devi !tion !llo0e d is '0.05 + &) 0her e & is !n; o6 the re9 ir e d 2i+ -erc e n t ! 1 e s . E3a m p e . <6 the Co2 e 0eb inter ! c tio n is 16.00 P '!s in the W<&S 2i+), it is re9 ire d th!t the !ver ! 1 e 2i+ -erc e n t ! 1 e o6 Co2 e d rin1 the Sho--i n 1 Me!s r e 2 e n t <nterv !l 6!lls bet0 e e n 16.80 P !nd 15.20 P. Com m e n t & . For 2e ! s r e 2 e n t s res ltin1 in ! re-ort e d thro 1 h - t o6 less th! n 500 W<&S, the 2!+i 2 2 devi !tion !llo0e d 6or the $d2in ?e9 e s t !nd $d2in #on6ir2 0eb inter ! c tio n is '0.1 + &). Com m e n t 4 . For the - r-o s e o6 co2 - ti n 1 the 2i+, onl; s cc e s s6 l 0eb inter ! c tio n s 2 !; be co nt e d .
T&# Bench2!r8I W
&!1e
cvii
Mi3 of Web 2nt er a c t i o n s Web 2nter a c t i o n Bro " s i n g Mi3 (W2PS b ) >: J 29.0 0 P 11.0 0 P 11.0 0 P 21.0 0 P 12.0 0 P 11.0 0 P : J 2.00 P 0.82 P 0.,5 P 0.69 P 0.50 P 0.25 P 0.10 P 0.09 P S$ o p p i n g Mi3 (W2PS ) .r# eri n g Mi3 (W2PS o ) :+ J 9.12 P 0.(6 P 0.(6 P 12.5 5 P 1(.5 5 P 15.0 8 P :+ J 15.5 5 P 12.8 6 P 12., 5 P 10.1 8 P 0.25 P 0.22 P 0.12 P 0.11 P
Bro" s e
Ho m e Ne " Pro# u c t s Be s t S e er s Pro# u c t )et a i S e a r c $ ReB u e s t S e a r c $ Re s u t s
(+ J 16.0 0 P 5.00 P 5.00 P 1,.0 0 P 20.0 0 P 1,.0 0 P 4+ J 11.6 0 P 5.00 P 2.60 P 1.20 P 0.,5 P 0.66 P 0.10 P 0.09 P
.r# er
S$ o p p i n g Cart Cust o m e r Re gi s t r a t i o n Bu* ReB u e s t Bu* Confir m .r# er 2nBuir* .r# er )is p a * A# mi n ReB u e s t A# mi n Confir m :' 4 ' 4 5.2.2.1 Main t ai n i n g t$ e Web 2nt er a c t i o n Mi3
7 rin1 the e!c h Me!s r e 2 e n t <nterv !l, e!c h AB c;cles thro 1 h ! -roce s s o6 re9 e s t i n 1 ! 0eb inter ! c tio n, rec eivin 1 !nd -!rsin 1 the res- o n s e -!1 e, 2 e ! s ri n 1 the ti2 e re9 ir e d to receiv e it 'W<?T), selectin 1 the ne+t n!vi1 ! ti o n o-tion, -re- ! ri n 1 the ne+t re9 e s t !nd 0!itin1 the b!l! n c e o6 Thin8 Ti2e be6ore re9 e s ti n 1 the ne+t 0eb inter ! c tio n. The re9 ir e d 2i+ o6 0eb inter ! c tio n s is 2 !int !i n e d b; controllin1 the selection o6 the ne+t n!vi1! tio n o-tion. This cl! s e s-eci6ies ho0 this control 2 st be i2-le 2 e n t e d b; the ?BA. A!ch 0eb inter ! c ti on res lt s in the -res e n t ! t i o n o6 ! -!1 e to the AB. $6ter receivin1 th!t -!1 e , the AB select s the 0eb inter ! c tio n to be re9 e s t e d ne+t. Aver; v!lid selection is one o6 the set o6 n!vi1 ! ti o n o-tion s -er 2it t e d 6or the c rre n t 0eb inter ! c ti on !s s-eci6ied in #l! s e 2. C!vin1 rec eiv e d the res-o n s e -!1 e 6or ! -!rtic l !r 0eb inter ! c tio n, the AB select s the ne+t 0eb inter ! c tio n sin1 the 2et h o d describ e d in #l! s e 5.2.2.5, 0hich is e+- e c t e d to s!tis6; the 0eb inter ! c tio n 2i+ re9 ir e 2 e n t s de6ine d in #l! s e 5.2.1. A!ch 0eb inter ! c ti on h!s ! set o6 n!vi1 ! ti o n o-tion s. $n inte 1 e r bet0 e e n 1 !nd 9,99 9, c!lled ! T$re s $ o # , is !ssi1n e d to e!c h n!vi1 ! ti o n o-tion. To select its ne+t re9 e s t the AB 1en e r ! t e s ! r!nd o 2 n 2 b e r , 0ith !t le!st 51 bits o6 -recision, 6ro2 ! ni6or 2 distrib tion bet0 e e n 1 !nd 9,999. <t the n select s the n!vi1 ! ti o n o-tion 6or 0hich the Thres h ol d is e9 !l to or 2ost i22 e di ! t el ; 1re ! t e r th!n the r!nd o 2 n 2 b e r. The 6ollo0in1 t!ble s list the Thres h ol d s th!t 2 st be se d b; the AB to select e!c h n!vi1 ! ti o n o-tion d rin1 e!c h o6 the thre e Me!s r e 2 e n t <nterv !l s. T&# Bench2!r8I W St!nd!rd S-eci6ic!tion Version &'( &!1e cviii
5.2.2.2
5.2.2.5
5.2.2.(
T$re s $ o # s for t$ e S$ o p p i n g 2nter - a A# mi n Confir m Bu* Confir m Cus t o m e r Re gi s t ' .r# er )is p a * Be s t S e er s Ho m e A# mi n ReB u e s t Ne " Pro# u c t s Bu* ReB u e s t To t$i s Web 2nter a c t i o n 5ro m t$i s Res p o n s e Pa g e A# mi n Confir m A# mi n ReB u e s t Be s t Se e r s Bu* Confir m Bu* ReB u e s t Cust o m e r Regi s t ' Hom e Ne " Pro # u c t s .r# er )is p a * .r# er 2nBuir* Pro # u c t )et a i Se ar c $ ReB u e s t Se ar c $ Res u t s S$ o p p i n g Cart
258 5 58 512 ( 156 69 ,2 852 655 265 , 955 2 88, 2 (61 ( 866 6
(W2PS ) S e a r c $ ReB u e s t S e a r c $ Re s u t s &!1e S e a r c $ Re s u t s Pro# u c t )et a i S$ o p p i n g Cart

9999 9999 999 9 9999 9999 9999 915 9999 5 929 ( 950 ( 9999 9999
995 2 899 9 999 9 16, 8( 65( 6 8,6 0 62( 9 6,1 8 9,5 5 (,2
.r# er 2nBuir*
999 9
992 , 999 9
,02 6 9,8 ( 999 9 999 9 128 8 860 5
T$re s $ o # s for t$ e Bro " s i n g 2nt er - a A# mi n Confir m Bu* Confir m Cus t o m e r Re gi s t ' A# mi n ReB u e s t Ne " Pro# u c t s .r# er )is p a * Be s t S e er s Bu* ReB u e s t Ho m e To t$i s Web 2nter a c t i o n 5ro m t$i s Res p o n s e Pa g e
(W2PS b ) S e a r c $ ReB u e s t Pro# u c t )et a i S$ o p p i n g Cart ci+ .r# er 2nBuir*
T&# Bench2!r8I W
A# mi n Confir m A# mi n ReB u e s t Be s t Se e r s Bu* Confir m Bu* ReB u e s t Cust o m e r Regi s t ' Hom e Ne " Pro # u c t s .r# er )is p a * .r# er 2nBuir* Pro # u c t )et a i Se ar c $ ReB u e s t Se ar c $ Res u t s S$ o p p i n g Cart
(09 9 (, 5,9 2 919 9 91( 5 899 9
98, , 999 9 (60 , 5(2 959 5 961 9 ,58 5 299 802 525 85( 6 ,88 56, ( 888 5 986 8 885 6 9,( 9 ,68 8 986 , 525 9
999 9
99( 2 999 9
9999
9999 999 9 955 9 99( 1 999 9 999 9 989 0 9999 995 9999 5 99( 2 9999 9999 9999 9999
T$re s $ o # s for t$ e .r# eri n g 2nt er - a A# mi n Confir m Bu* Confir m Cus t o m e r Re gi s t ' .r# er )is p a * Be s t S e er s Ho m e A# mi n ReB u e s t Ne " Pro# u c t s Bu* ReB u e s t To t$i s Web 2nter a c t i o n 5ro m t$i s Res p o n s e Pa g e A# mi n Confir m A# mi n ReB u e s t Be s t Se e r s Bu* Confir m Bu* ReB u e s t T&# Bench2!r8I W
,99
(W2PS o ) S e a r c $ ReB u e s t S e a r c $ Re s u t s &!1e Pro# u c t )et a i S$ o p p i n g Cart

9999 9999
85( 8 899 9 999 9 1 2 9(5 555
.r# er 2nBuir*
999 9
999 8 999 9
c+
5 989 9 990 1 999 50( 995 9 116 8 996 8 562 1 126 9 99( 2 999 9 129 5 99, 6 999 9 999 9 65( 1 9999 981 9999 5 ,81 , 999 8 9999 9999 9999 9999
Cust o m e r Regi s t ' Hom e Ne " Pro # u c t s .r# er )is p a * .r# er 2nBuir* Pro # u c t )et a i Se ar c $ ReB u e s t Se ar c $ Res u t s S$ o p p i n g Cart
99 (99
5,5 0 815 (86 9(9 9 991 8
Com m e n t & . Follo0in1 is !n e+ ! 2 -l e o6 ho0 the !bov e t!bl e s sho ld be se d d rin1 ! Sho- -i n 1 <nterv !l. $6ter co2 -l e ti n 1 ! Co2 e 0eb inter ! c ti on the AB 1en e r ! t e s the r!ndo 2 n 2 b e r 65, 1. No Thres h ol d is e9 !l to th!t r!nd o 2 n 2 b e r !nd the Thres h ol d th!t is 2ost i22 e di ! t el ; 1re ! t e r th!n 65, 1 is 6,18. This indic!t e s th!t !n =rder <n9 ir; 0eb inter ! c tio n 2 st be select e d . Com m e n t 4 . M!n; cells o6 the !bov e t!bl e s cont !i n no Thres h ol d. This 2e ! n s th!t no n!vi1! tio n o-tion e+ists to 2ov e in th!t direction. =ne 2 !; not, 6or e+ ! 2 -l e , select the B ; ?e9 e s t 0eb inter ! c tio n 6ro2 the Co2 e &!1e. Com m e n t 6 . A!ch AB 2 st se the Thres h ol d s s-eci6ied in the !bov e t!bl e s, eve n tho 1 h oth er Thres h ol d s e+ist th!t co ld be se d to !lso con6or 2 to the t!bl e in #l! s e 5.2.1 !nd to obt !i n the s! 2 e over !ll 2i+ o6 0eb inter ! c tio n s.
T&# Bench2!r8I W
&!1e
c+i
5.2.5
A+!2 -l e o6 AB $ctivit; on the T&#*W Site The 6ollo0in1 6i1 re ill str!t e s !n e+! 2 -l e o6 ho0 !n AB 2i1ht 2ov e thro 1 h the T&#*W 0eb site.
SUT
E+ecute Home Web Interaction
Nav !at o"
Em ulated Brow ser

Enter TPC-W site Measure WIRT Parse Home Page Select threshold f rom Home Page Wait balance of Think Time Request est Seller !"sub#ect$ link% Measure WIRT
Home Page
E+ecute est Seller Web Interaction
est Seller Page

E+ecute Product &etail Web Interaction
Parse est Seller Page Select threshold f rom est Seller Page Wait balance of Think Time Request Product &etail !"item$ link% Measure WIRT
Product &etail Page

E+ecute Sho''ing Cart Web Interaction
Parse Product &etail Page Select threshold f rom Product &etail Page Wait balance of Think Time Request Sho''ing Cart !"(dd to Cart$ button% Measure WIRT
Sho''ing Cart Page

E+ecute Customer Regist) Web Interaction
Parse Sho''ing Cart Page Select threshold f rom Sho''ing Cart Page Wait balance of Think Time Request Customer Regist) !"Checkout$ button% Measure WIRT
Customer Regist) Page

E+ecute u* Request Web Interaction
Parse Customer Regist) Page Select threshold f rom Customer Regist) Page Wait balance of Think Time Request u* Request !"Continue u* $ button% Measure WIRT
u* Request Page
E+ecute u* Conf irm Web Interaction
Parse u* Request Page Select threshold f rom u* Request Page Wait balance of Think Time Request u* Conf irm !"Conf irm u* $ button% Measure WIRT
u* Confirm Page
E+ecute Home Web Interaction
Parse u* Conf irm Page Select threshold f rom u* Conf irm Page Wait balance of Think Time Request Home !"Home$ button% Measure WIRT
Home Page etc)
#l$_"av !
T&# Bench2!r8I W
&!1e
c+ii
: ' 6 T$i n ! Ti m e a n # R e s p o n s e Ti m e
:' 6 ' & T$in! Time The Thin8 Ti2e 'TT) is de6ine d b;. TT [ T2 * T1 0her e. T1 !nd T2 !re 2 e ! s r e d !t the ABG T1 [ ti2 e 2 e ! s r e d !6ter the l!st b;t e o6 the l!st 0eb inter ! c ti on is receiv e d b; the AB 6ro2 the S%TG !nd T2 [ ti2 e 2 e ! s r e d be6ore the 6irst b;t e o6 the 6irst CTT& re9 e s t o6 the ne+t 0eb inter ! c tio n is sent b; the AB to the S%T. Com m e n t & . The resol tion o6 the ti2 e st! 2 - s 2 st be !t le!st 0.1 seco n d s . 5.5.1.1 A!ch Thin8 Ti2e 2 st be t!8e n inde - e n d e n t l ; 6ro2 ! ne1 ! tiv e e+-o n e n ti !l distrib tion. A!ch Thin8 Ti2e, T, 2 st be co2 - t e d 6ro2 the 6ollo0in1 e9 ! ti o n. T [ * ln'r) ^ 0her e. ln [ n!t r !l lo1 'b!s e e) r [ r!nd o 2 n 2 b e r , 0ith !t le!st 51 bits o6 -recision, 6ro2 ! th!t '0 U r 1)
[ , to 8 seco n d s incl siv e
ni6or 2 distrib tion s ch
Com m e n t & . A!ch distrib tio n 2 st be tr nc ! t e d !t 10 ti2 e s b; re-l!cin1 !n; v!l e hi1h er
th! n 10 ti2e s 0ith the v!l e 10 ti2e s !nd sin1 th!t v!l e.
Com m e n t 4 A The v!l e 6or 2!; not be ch!n 1 e d d rin1 the Me!s r e 2 e n t <nterv!l. The s! 2 e v!l e
o6 2 s t be se d 6or !ll 0eb inter! c tion s.
5.5.1.2
The !ver ! 1 e d r!tio n o6 the Thin8 Ti2e over e!c h Me!s r e 2 e n t <nterv !l, !11r e 1 ! t e d !cros s !ll 0eb inter ! c tio n s, 2 st be no less th!n sev e n ',) seco n d s !nd no 2ore th!n ei1ht '8) seco n d s . <t is e+- e c t e d th!t the AB does so2 e !2 o n t o6 -roc e s si n 1 d rin1 the Thin8 Ti2e 'e.1., -!rsin 1 the res-o n s e -!1 e , 1en e r ! t i n 1 the ne+t re9 e s t , lo11in 1 st!tistics, etc.) $s ! res lt, the !2 o n t o6 ti2 e th!t the AB 2 st 0!it !6t er co2 -l e ti n 1 !ll -roc e s si n 1 !nd be6or e sen di n 1 the 6irst b;t e o6 the ne+t re9 e s t to the S%T c!n be red c e d to the b!l! n c e o6 the co2 - t e d Thin8 Ti2e 6or th!t 0eb inter ! c ti on. Web 2nter a c t i o n Re s p o n s e Tim e (W2RT) The Web <nter! c ti on ?es-o n s e Ti2e 'W<?T) is de6ine d b;.
5.5.1.5
:' 6 ' 4
T&# Bench2!r8I W
&!1e
c+iii
W<?T [ T2 * T1 0her e. T1 !nd T2 !re 2 e ! s r e d !t the ABG T1 [ ti2 e 2 e ! s r e d be6ore the 6irst b;t e o6 the 6irst CTT& re9 e s t o6 the 0eb inter ! c tio n is sent b; the AB to the S%TG !nd T2 [ ti2 e 2 e ! s r e d !6ter the l!st b;t e o6 the l!st CTT& res- o n s e th!t co2 -l e t e s the 0eb inter ! c tio n is rec eiv e d b; the AB 6ro2 the S%T. Com m e n t & . The resol tion o6 the ti2 e st! 2 - s 2 st be !t le!st 0.1 seco n d s . Com m e n t 4 . $ltho 1 h the intent o6 the benc h 2 ! r 8 is to 2 e ! s r e res-o n s e ti2 e !s e+- eri e n c e d b; !n !ct !l ser, the ti2 e nee d e d 6or the bro0s er to dis-l !; the 0eb -!1 e s !nd obEect s is not incl d e d in the W<?T. Com m e n t 6 . For the - r-o s e o6 c!lc l !ti n 1 the W<?T, onl; s cc e s s6 l 0eb inter ! c tio n s 2! ; be incl d e d . Com m e n t 8 . <6 the 0eb inter ! c ti on re9 ir e s settin1 - ! conn e c tio n to the 0eb serv er '!s in the c!s e o6 the 6irst Co2 e inter ! c tio n or the 6irst sec r e 0eb inter ! c tio n), T1 sho ld be t!8e n -rior to the conn e c ti o n re9 e s t .
5.5.2.1
7 rin1 the e!c h Me!s r e 2 e n t <nterv !l, !t le!st 90P o6 0eb inter ! c tio n s o6 e!c h t;-e 2 st h!v e ! W<?T o6 less th! n the constr !i n t s-eci6ied 'in seco n d s ) 6or th!t 0eb inter ! c tio n in the t!bl e belo0. For e+ ! 2 -l e , !t le!st 90P o6 !ll Co2 e 0eb inter ! c tion s 2 st h!v e ! W<?T o6 less th! n 5 seco n d s . A# mi n Confir m Cus t o m e r Re gi s t ' A# mi n ReB u e s t S e a r c $ ReB u e s t Se a r c $ Res u t s 10 Pro # u c t )et ai S$ o p p i n g Cart 5 c+iv Ne " Pro# u c t s .r# er )is p a * 5 .r# er 2nBuir* 5 Bu* Confir m Be s t Se e r s Bu* ReB u e s t Hom e 5
>+J W2RT Con s t r ai n t 5.5.2.2
20
=ver the e!c h Me!s r e 2 e n t <nterv !l, the !ver ! 1 e W<?T 6or e!c h t;-e o6 0eb inter ! c ti on 2 st be no 2or e th! n 0.1 seco n d lon1er th!n the 90 th -erc e n til e W<?T 6or th!t 0eb inter ! c ti on.
T&# Bench2!r8I W
&!1e
: ' 8 C o m p u t a t i o n o f T$r o u g $ p u t R a ti n g
5.(.1 The thro 1 h - t 6or e!c h o6 the thre e Me!s r e 2 e n t <nterv !l s is co2 - t e d !s the tot !l n 2 b e r o6 0eb inter ! c ti on s re9 e s t e d !nd co2 -l e t e d s cc e s s6 ll; 0ithin th!t Me!s r e 2 e n t <nterv !l divide d b; the len1t h o6 th!t Me!s r e 2 e n t <nterv !l in seco n d s . Com m e n t . Web inter ! c tio n s c!n be incl d e d in the co2 - t ! t i o n o6 the re-ort e d thro 1 h - t onl; i6 their W<?T is 6 ll; 0ithin the bo n d s o6 the e!c h Me!s r e 2 e n t <nterv !l. 5.(.2 $ll re-ort e d thro 1 h - t s 2 st be 2 e ! s r e d , r!th e r th!n inter- ol !t e d or e+tr ! - ol ! t e d , !nd e+-r e s s e d to e+ !ctl; one deci 2 !l -l!c e, ro n d e d do0n to the tent h s -l!c e. For e+ ! 2 -l e , s - - o s e 105.5 ( 8 W<&S is 2e ! s r e d on test 6or 0hich !ll 90P W<?T constr !i nt s !re 2et !nd 11,.5 , 2 W<&S is 2e ! s r e d on test 6or 0hich so2 e 90P W<?T constr !i nt s !re e+c e e d e d . Then the re-ort e d W<&S is 105.5 r!th e r th!n so2 e inter-ol ! t e d v!l e bet0 e e n 105.5 ( 8 !nd 11,.5 , 2.
: ' : M e a s u r e m e n t 2n t e r - a R e B u ir e m e n t s
This #l! s e de6ine s the re9 ir e 2 e n t s 6or the thre e Me!s r e 2 e n t <nterv !l s * one 6or Sho- -i n 1, one 6or Bro0sin1 !nd one 6or =rderin1. :' : ' & 5.5.1.1 Tes t Run $ Test ? n consist s o6 one or 2ore Me!s r e 2 e n t <nterv !l s. The 6irst Me!s r e 2 e n t <nterv !l 2 st be -rec e d e d b; ! r!2 -* - -eriod o6 !t le!st 10 2in t e s !t the end o6 0hich ! ste ! d ; st!t e thro 1 h - t level 2 st be re!c h e d . S bs e 9 e n t Me!s r e 2 e n t interv !l s 2 st not be1in 0ithin 10 2in t e s o6 the close o6 the -revio s Me!s r e 2 e n t <nterv !l !nd the S%T 2 st be in ste ! d ; st!t e be6or e be1i n ni n 1 the s bs e 9 e n t Me!s r e 2 e n t <nterv !l. Me!s r e 2 e n t <nterv !l s 2 !; not overl ! -. <22 e di ! t el ; 6ollo0in1 the l!st Me!s r e 2 e n t <nterv !l in ! Test ? n, the ste ! d ; st!t e thro 1 h - t level o6 th!t Me!s r e 2 e n t <nterv !l 2 st be 2 !int !i n e d 6or !t le!st 5 2in t e s . The thre e Me!s r e 2 e n t <nterv !l s c!n be e+ ec t e d eith er !s thre e individ !l Test ? ns, or !s one or t0o Test ? ns 0her e t0o or 2ore Me!s r e 2 e n t <nterv !l s !re e+ec t e d seri!ll; 0ithin the s! 2 e Test ? n. <6 2or e th!n one Me!s r e 2 e n t <nterv !l is e+ec t e d 0ithin the s! 2 e Test ? n, the 2i+ o6 0eb inter ! c tio n s 2 st be !dE st e d d rin1 the -eriod bet0 e e n thos e Me!s r e 2 e n t <nterv !l s. No h!rd0 ! r e or so6t0!r e ch!n 1 e s c!n be 2! d e to the S%T bet0 e e n the Sho--i n 1, Bro0sin1 !nd =rderin 1 <nterv !l s. Co0ev er, the n 2 b e r o6 ABHs !nd c st o 2 e r t n ! bl e -!r! 2 e t e r s 2 !; be ch! n 1 e d bet0 e e n the 2e ! s r e 2 e n t interv !l s. The n 2 b e r o6 ABHs 2 !; be ch!n 1 e d 6or the seco n d ! r ; 2etrics 0itho t ch!n 1i n 1 the d!t ! b ! s e -o- l ! tion. The <TAM sc!l e 6!ctor c!n not be ch!n 1 e d . A+!2 -l e s o6 !cc e - t ! b l e c sto 2 e r t n ! bl e -!r ! 2 e t e r s !re. ?elo! d the d!t ! b ! s e ?eb ild <ndices 7!t! b ! s e t nin 1 -!r ! 2 e t e r s Web serv er t nin 1 !nd lo11in 1 o-tion s =-er !ti n 1 s;st e 2 !nd !--lic!tio n con6i1 r ! ti o n -!r ! 2 e t e r s T&# Bench2!r8I W St!nd!rd S-eci6ic!tion Version &'( &!1e c+v
5.5.1.2
5.5.1.5
5.5.1.(
A+!2 -l e s o6
n!c c e - t ! bl e t nin1 !ction s !re.
?ede6inition o6 the d!t ! b ! s e sch e 2 ! #h!n 1 e s to the n 2 b e r o6 re-lic!tio n s o6 the d!t ! b ! s e #h!n 1 e s to -h;sic !l -l!c e 2 e n t / di st rib tio n o6 the d!t ! #h!n 1 e s or reboot to ! di66ere n t t;-e, co-; or version o6 the o-er ! ti n 1 s;st e 2 #h!n 1 e revision or version o6 !n; so6t0!r e ?eco 2 -il !tio n or relin8 o6 !n; so6t0!r e <nst!ll!tion, reinst !ll !tio n o6 !n; so6t0!r e 5.5.1.5 <n order to 2e e t the re9 ire 2 e n t th!t !ll ABHs re2 !i n !ctive thro 1 h o t e!c h 2e ! s r e 2 e n t interv !l, '#l! s e (.1.(), !n AB, 0hich enco n t e r s !n error or 6!il re d rin1 !n 0eb inter ! c tio n th!t is ! B ; #on6ir2, Sho--i n 1 #!rt ?e6res h, or B ; ?e9 e s t , sho l d close the c rre n t ser sessio n !nd st!rt ! ne0 ser sessio n !s s-eci6ied in #l! s e 6.2.2.2. <6 !n AB enco n t e r s !n error or 6!il re d rin1 !n 0eb inter ! c ti on th!t is not ! B ; #on6ir2, Sho- -i n 1 #!rt ?e6res h or B ; ?e9 e s t , the AB 2! ; choos e to retr; the 0eb inter ! c tio n or close the c rre n t ser sessio n !nd st!rt ! ne0 ser sessio n !s s-eci6ied in #l! s e 6.2.2.2. N=TA. $n AB c!nn o t si2-l; retr; ! 6!iled B ; #on6ir2, Sho- -i n 1 #!rt ?e6res h, or ! B ; ?e9 e s t 0eb inter ! c ti on since ! retr; o6 the s e inter ! c tio n s is nd e6in e d . :' : ' 4 5.5.2.1 St e a # * Sta t e The re-ort e d thro 1 h - t 2 st be co2 - t e d over ! Me!s r e 2 e n t <nterv !l d rin1 0hich the thro 1 h - t level is in ! ste ! d ; st!t e condition th!t re-r e s e n t s the tr e s st !i n ! bl e -er6or 2 ! n c e o6 the S%T. $ltho 1 h e!c h Me!s r e 2 e n t <nterv !l 2! ; be !s short !s 50 2in t e s , the S%T 2 st be con6i1 r e d so th!t it is -ossi bl e to r n the 2i+ o6 0eb inter ! c tio n s d rin1 1( d!;s o6 nint e rr - t e d e+ec ti on '!s de6in e d in #l! s e 6.,.1) 0hile 2 !int !i ni n 1 6 ll $#<7 -ro- e rti e s. Com m e n t &A For e+ ! 2 -l e , the 2 e di ! se d to stor e the d!t ! b ! s e lo1 d!t ! ntil it c!n be !rchiv e d 0itho t interr - tio n o6 -roc e s si n 1 2 st be con6i1 r e d i6 re9 ir e d to recov er 6ro2 !n; sin1l e -oint o6 6!il re Com m e n t 4A $n e+! 2 -l e o6 ! con6i1 r ! tio n th!t 0o ld not co2 -l ; is one 0her e ! lo1 6ile !lloc!t e d s ch th!t bett er -er6or 2 ! n c e is !chi ev e d d rin1 the 2 e ! s r e d -ortion o6 the r th!n d rin1 the re2 !i ni n 1 -ortion o6 !n; 6 ll thro 1 h - t -eriod, -erh ! - s bec ! s e dedic ! t e d devic e 0!s se d initi!ll; b t s-!c e on ! sh!r e d device is se d l!ter in the 6 thro 1 h - t -eriod. is n ! ll
5.5.2.2
Com m e n t 6A Ste ! d ; st!t e is e!s ; to de6in e 'e.1., s st !i n ! bl e thro 1 h - t ) b t di66ic lt to -rov e. The test s-on s o r '!nd/or the ! dit or) is re9 ire d to re-ort the 2et h o d se d to veri6; ste ! d ; st!t e s st !i n ! bl e thro 1 h - t !nd the re-ro d ci bilit; o6 2e ! s r e d res lts. The ! dit or is enco r ! 1 e d to se !v!il! bl e 2onitorin 1 tools to hel- det er 2 i n e the ste ! d ; st!t e. Com m e n t 8 . $n e+ ! 2 -l e o6 ! co2 -li !n t i2-le 2 e n t ! t i o n 0o ld be one 0her e the entire d!t ! b ! s e is -l!c e d on red n d ! n t stor ! 1 e !nd the d!t ! b ! s e lo1 d!t ! is stor e d on circ l!r 6iles l!r1e eno 1 h to s-! n ! co2 -l et e chec8- oi nt c;cle.
T&# Bench2!r8I W
&!1e
c+vi
5.5.2.5
So2 e !s- e c t s o6 the benc h 2 ! r 8 i2-le 2 e n t ! t i o n c!n res lt in s;st e 2 ! t i c b t s2 !ll in s st !i n e d thro 1 h - t over !n 8 ho r -eriod. Thes e v!ri!tion s 2 st be li2ited to re-ort e d thro 1 h - t . This i2-lies th!t no interv !l o6 ! d r!tio n e9 !l to the Me!s r e 2 e n t <nterv !l '0ith ! 1r! n l ! rit ; o6 50 seco n d s over 8 ho rs) c!n h!v e ! thro 1 h - t th!t v!ries 6ro2 the re-ort e d thro 1 h - t b; 2or e th!n 5P.
v!ri!tion s 5P o6 the Sho- -i n 1 co2 - t e d
Com m e n t . There is no s-eci6ic re9 ire 2 e n t to e+ec t e !n 8 ho r Test ? n, b t the ! dit or 2! ; 6ind it nec e s s ! r ; to e+ec t e - to ! 6 ll 8 ho r Test ? n to de 2 o n s t r ! t e s st !i n e d thro 1 h - t . 5.5.2.( To -rev e n t si1ni6ic!n t !lter ! tio n to the -ro- e rl; sc!l e d d!t ! b ! s e -o- l !tio n, the 2i+ o6 0eb inter ! c tio n s !nd the re9 ir e 2 e n t s s 2 2 ! ri: e d in #l! s e 5.5 2 st be 6ollo0ed d rin1 the entire Test ? n !s 0ell !s d rin1 !n; oth er ti2 e bet0 e e n Test ? ns. )ura ti o n A!ch Me!s r e 2 e n t <nterv !l 2 st. 5.5.5.2 Be1in !6ter the s;st e 2 h!s re!c h e d ste ! d ; st!t e 0ith the corre s - o n di n 1 2i+ o6 0eb inter ! c tio n s. Be lon1 eno 1 h to 1en e r ! t e re-rod ci bl e thro 1 h - t res lts 0hich !re re-r e s e n t ! t i v e o6 the -er6or 2 ! n c e 0hich 0o ld be !chi ev e d d rin1 ! s st !i n e d 8 ho r -eriod. A+ten d nint err - t e d 6or ! 2ini 2 2 o6 50 2in t e s.
:' : ' 6 5.5.5.1
So2 e s;st e 2 s do not 0rite 2odi6ied d!t ! b ! s e record s/ - ! 1 e s to d r! bl e 2 e di ! !t the ti2 e o6 2odi6ic!tion, b t inst e ! d de6er the s e 0rites. $t so2 e s bs e 9 e n t ti2 e, the 2odi6ied record s/ - ! 1 e s !re 0ritt en to 2!8 e the d r! bl e co-; c rre n t . This -roc e s s is de6ine d !s ! chec8- oi nt in this doc 2 e n t . <t is ! re9 ir e 2 e n t th!t no recov er ; d!t ! older th!n 15 2in t e s -rior to !n inst ! n t ! n e o s interr - ti on be se d 6or recov er ;. The cons e 9 e n c e o6 this re9 ir e 2 e n t is th!t the d!t ! b ! s e cont e n t s store d on d r! bl e 2e di ! c!n n o t !t !n; ti2 e d rin1 the Test ? n be 2or e th! n 15 2in t e s older th! n the 2ost c rre n t st!t e o6 the d!t ! b ! s e 'g 5 P). $ll 0or8 re9 ire d to -er6or 2 ! chec8 - oi nt 2 st occ r in 6 ll !t le!st once be6ore e!c h Me!s r e 2 e n t <nterv !l be1in s b t !6t er ste ! d ; st!t e h!s bee n re!c h e d . Com m e n t . ?e1!r dl e s s o6 the chec8 -ointin1 2 et h o d se d 'e.1., discret e chec8- oi nt s, contin o s chec8 - oi n t s, tric8le chec8 - oi nt s) ! 6 ll c;cle o6 chec8 -ointin1 2 st be co2 -l et e d be6or e e!c h Me!s r e 2 e n t <nterv !l.
5.5.5.5
5.5.5.(
5.5.5.5
?oll*b!c8 recov e r ; d!t ! 2 st be eith er in 2 e 2 o r ; or in on* line stor! 1 e !t le!st tr!n s ! c ti o n s !re co2 2 it t e d . ?oll*6or0!r d recov er ; d!t ! 2 st be store d on* line. Repr o # u c i b i i t *
ntil
:' : ' 8 5.5.(.1
To de 2 o n s t r ! t e the re-ro d ci bilit; o6 the ste ! d ; st!t e condition d rin1 the Sho- -i n 1 <nterv !l, ! 2ini2 2 o6 one !ddition !l '!nd non* overl ! - -i n 1) Sho- -i n 1 <nterv !l o6 the s! 2 e d r! tion !s the re-ort e d Sho--i n 1 <nterv !l 2 st be 2 e ! s r e d !nd its W<&S 2 st be disclos e d !nd be e9 !l to or 1re ! t e r th! n the re-ort e d W<&S. This re-rod ci bilit; interv !l is re9 ire d to be 0ithin 5P o6 the re-ort e d W<&S. The re-ro d ci bilit; test is not re9 ir e d 6or eith er the Bro0sin1 <nterv !l or the =rderin1 <nterv !l.
T&# Bench2!r8I W
&!1e c+vii
5.5.5 5.5.5.1
Ran # o m Nu m b e r )e-i a t i o n s The r!ndo 2 n 2 b e r 1en e r ! t o r se d b; the ABHs 2 st 2e e t the 6ollo0in1 re9 ire 2 e n t s 6or e!c h Me!s r e 2 e n t <nterv !l to be co2 -li !n t.
EB )at a $ver! 1 e Thin8 Ti2e $ver! 1 e %SM7 &erce n t ! 1 e o6 ne0 c sto 2 e r s &erce n t ! 1 e -d ! t e d o6 shi--in 1 !ddr e s s
)istri b u t i o n ReB uir e m e n t Mini2 2 , seco n d s , 2!+i 2 2 o6 8. Bet0e e n 1(2 1 5 s !nd 15 2 ( 5 s Bet0e e n 19P !nd 21P Bet0e e n (.,5P !nd 5.25P Bet0e e n 51.6P !nd 5(.9P
$ver! 1 e o6 e!c h o6 $ thor, Title !nd S bEect se!rc h e s
: ' ; R e B u ir e # R e p o r ti n g
T&# Bench2!r8I W
&!1e c+viii
5.6.1 5.6.2
This re9 ire 2 e n t h!s be e n delet e d . For !ll thre e Me!s r e 2 e n t <nterv !l s, ! 1r! - h o6 the 2e ! s r e d 'i.e., 0!ll cloc8 ti2 e) 2 st be re-ort e d 6or the entire Test el!-s e d ti2 e 6ro2 the st!rt o6 the r n. The ;* !+is re-r e s e n t s 60 di66ere n t interv !l s 2 st be se d 0ith ! 2 !+i 2 2 interv !l !nd the closin1 o6 the Me!s r e 2 e n t <nterv !l 2 st !lso be 1r!- h is sho0n belo0. thro 1 h - t vers s el!- s e d ti2 e ? n. The +*!+is re-re s e n t s the the thro 1 h - t in W<&S. $t le!st si:e o6 50 seco n d s . The o-e ni n 1 re-ort e d . $n e+ ! 2 -l e o6 s ch !
.-,,
.,,, 6'en -,, Clos e
, . .. /. 0. 1. -. 2. 3. Ela%sed T me 4. 5. .,. ... ./. .0.
: ' = A # # i ti o n a P e r f or m a n c e S t a t i s t i c s
<n order to -rovid e !ddition !l in6or2 ! ti o n to the benc h 2 ! r 8 c st o 2 e r , the T&#*W 0or8lo! d re9 ir e s the disclos r e o6 ! s2 !ll set o6 -er6or 2 ! n c e st!tistics th!t !re !v!il! bl e 6ro2 co2 2 o n co2 2 e r ci !l s;st e 2 2onit orin1 6!cilities. A+! 2 -l e s o6 thes e 6!cilities !re the %N<J* b!s e d s!r 2 e ! s r e 2 e n t 6!cilities, the =S/59 0* b!s e d ?MF 6!cilities, the Windo0s NT -er6or 2 ! n c e 2onitor, !nd the co2 2 o nl ; !v!il!bl e set o6 7BMS 2onitorin 1 6!cilities b ilt* in to e!c h d!t ! b ! s e ven d orLs -rod ct s. The obEectiv e in -rovidin 1 this -er6or 2 ! n c e 2onitor d!t ! in the F ll 7isclos r e ?e-ort is to enh ! n c e the c sto 2 e r H s !bilit; to 6 ll; nd er s t ! n d !nd inter-r e t the res lts o6 the benc h 2 ! r 8 2e ! s r e 2 e n t . <n this 0!; the ser o6 the d!t ! 0ill h!v e ! 2 c h hi1h e r level o6 con6ide n c e in the re-ort e d 2e ! s r e 2 e n t !nd 0ill be bett er !bl e to 1!in the nec e s s ! r ; insi1ht to -ro- erl ; inter-r e t the res lts. $lso, the d!t ! 0ill hel- the ser !--l; the benc h 2 ! r 8 res lt s to his o0n !--lic!tio n environ 2 e n t bec ! s e the det !il e d -er6or 2 ! n c e d!t ! c!n be se d to identi6; si2il!rities !nd dissi 2il!rities bet0 e e n the c st o 2 e r H s environ 2 e n t !nd the ven d orH s benc h 2 ! r 8 . There !re thre e cl!ss e s o6 -er6or 2 ! n c e st!tistics.
T&# Bench2!r8I W
&!1e
c+i+
The st!tistics de6in e d in 5.,.2 !re re9 ir e d onl; 6or s;st e 2 s th!t r n !--lic!tio n code, !nd !ll s;st e 2 s th!t serv e !s the -ri2 !r ; store o6 d!t ! b ! s e t!ble s !nd i2! 1 e s . &ri2 !r; store is de6ine d !s the -l!c e the d!t ! is store d !ss 2 i n 1 !ll c!ch e s !re e2 -t ;. This does not 2 e ! n the dis8 s bs ;s t e 2 s or ?$<7 controllers, b t the s;st e 2 th!t 2! n ! 1 e s thes e co2 - o n e n t s . For s;st e 2 s th!t do not r n !--lic!tio n cod e !nd do not serv e !s the -ri2 !r ; stor e o6 d!t ! b ! s e t!bl es !nd i2! 1 e s , the onl; t0o -er6or 2 ! n c e st!tistics re9 ir e d !re #&% %tili:!tion !s de6ine d in 5.,.2.1 !nd CTT& B;tes -er seco n d !s de6in e d in cl! s e 5.,.2.6. <6 the CTT& b;t e -er seco n d d!t ! collection nd l ; i2-! ct s -er6or 2 ! n c e or is not !n !--lic! bl e 2 et ric 6or the s;st e 2 , then the net0or8 b;t e s -er seco n d -er6or 2 ! n c e d!t ! c!n be s bstit t e d . The tools to collect thes e -er6or 2 ! n c e st!tistics nee d not be co2 2 e r ci !ll; !v!il!bl e -rod ct s th!t 2 st be re-ort e d !nd -riced !s s-eci6ied in cl! s e 5.,.1.5. <6 ! s! 2 -lin 1 tech ni 9 e is se d to obt !in the -er6or 2 ! n c e d!t !, then the s! 2 -lin 1 interv !l nee d not be ! 2 !+i 2 2 o6 1 seco n d !s describ e d in cl! s e 5.,.1.5. Co0ev er, the s! 2 -lin1 interv !l 2 st be re-ort e d !nd !t le!st 10 s! 2 -l e s 2 st be collect e d !nd the !ver ! 1 e o6 the 10 s! 2 -l e s re-ort e d . Thos e th!t !re o-tion !l, in th!t the; 2 !; -rovid e ! level o6 det !il ni9 e to ! s-eci6ic ven d or or !rchit e c t r e th!t -ro 2 o t e s ! bett e r nd e r s t ! n d i n 1 o6 the ven d orLs s;st e 2 . This bro! d e r set o6 o-tion !l d!t ! is se6 l b t is not re9 ir e d. =-tion !l d!t ! sho ld be re-ort e d s ch th!t its 2e ! ni n 1 !nd inter-r e t ! ti o n !re the s! 2 e !s -rovid e d b; the ven d orH s -re do 2 i n ! n t st! n d ! r d -er6or 2 ! n c e 2onitor.
$ c!re6 l de6inition o6 the d!t ! 6ields re-ort e d 2 st be -rovid e d to !llo0 the d!t ! to be nd e r s t o o d !nd -ro- erl ; inter-r e t e d . <t is !ntici- !t e d th!t 2ost o6 the d!t ! de6inition !nd descri-tiv e in6or2 ! tio n 0ill be t!8e n 6ro2 the ven d orH s -rod c t doc 2 e n t ! t i o n. Not e A &er6or2 ! n c e 2onit or d!t ! is se d to -ro 2 o t e ! 2or e co2 -l et e nd er s t ! n d i n 1 o6 individ !l -l!t6or 2 res lt s, !nd is not 6or direct co2 - ! ri so n bet0 e e n di66ere n t -l!t6or 2 s . :' = ' & 5.,.1.1 1en e r a 1ui# e i n e s
The set o6 re9 ir e d -er6or 2 ! n c e st!tistics, !s s-eci6ied in #l! s e 5.,.2, 2 st be disclos e d 6or the Sho- -i n 1, Bro0sin 1, !nd =rderin 1 <nterv !l s sin1 the 6or2 ! t s-eci6ied in #l! s e 8.,.15. 7!t! 6or thes e re-ort e d 2etrics 2 st be collect e d d rin1 the s! 2 e Me!s r e 2 e n t <nterv !l s 6ro2 0hich the re-ort e d W2PS , W2PS b < an # W2PS o r!t e s !re -rod c e d . Com m e n t . The inte nt o6 this cl! s e reco1 ni: e s th!t 2onitorin 1 6!cilities 2! ; 1en e r ! t e 2e ! s r ! bl e !2 o n t s o6 overh e ! d d rin1 o-er ! ti o n. This cl! s e !lso reco1 ni: e s th!t the s e 2onitor 6!cilities !re s !ll; -res e n t in c sto 2 e r environ 2 e n t s , !nd th!t the benc h 2 ! r 8 -er6or 2 ! n c e indic!t e d b; the T&#*W benc h 2 ! r 8 sho l d re6lect their -res e n c e .
5.,.1.2
5.,.1.5
The 2onitorin 1 tools se d to -rovid e thes e -er6or 2 ! n c e st!tistics 2 st be co2 2 e r ci !ll; !v!il!bl e, re-ort e d !nd -riced. <2-le 2 e n t ! t i o n s th!t involve 2 lti-l e s;st e 2 s 'e.1., 2 lti* tier con6i1 r ! ti o n s) 2 st re-ort ! se- !r ! t e set o6 -er6or 2 ! n c e st!tistics 6or e!c h s;st e 2 . <6 2 lti-le s;st e 2 s -er6or 2 the s! 2 e 6 nction sin1 the s! 2 e h!rd0 ! r e !nd so6t0!r e con6i1 r ! tio n, the d!t ! sho0n 2 st re-re s e n t eith er the !11r e 1 ! t e d 2etric o6 !ll the s;st e 2 s in th!t 1ro - or the s;st e 2 in th!t 1ro - 0ith the hi1h e s t !ver ! 1 e #&% tili:!tion over the 2e ! s r e 2 e n t interv !l.
5.,.1.(
T&# Bench2!r8I W
&!1e
c++
Com m e n t & . <n this cl! s e ! s;st e 2 is de6in e d !s r nnin 1 ! sin1l e co-; o6 the o-er ! ti n 1 s;st e 2 sh!rin 1 ! sin1le 2 e 2 o r ; s-!c e . Com m e n t 4A <6 ! host s;st e 2 i2-le 2 e n t s 2 lti-le 6 nction s, the 2etrics ne e d not be re-ort e d on ! -er 6 nction b!sis. The o-er ! tio n !l 2et h o d se d to obt !i n 2onit orin1 d!t ! 2 st be re-ort e d . For e+ ! 2 -l e , th!t the 2onitor 0!s invo8e d !s ! st!rt e d t!s8, !nd th!t bin!r; d!t ! 0!s record e d to !n e+t er n !l dis8 or t!- e 6ile 6or -ost* -roc e s si n 1. 5.,.1.5 <6 ! s! 2 -lin1 tech ni 9 e is se d to obt !in -er6or 2 ! n c e d!t ! then the s! 2 -l e r!t e '-er seco n d) 2 st be re-ort e d . The d!t ! collection s! 2 -lin1 interv !l is re9 ire d to be ! 2 !+i 2 2 o6 1 seco n d . The re-ortin 1 re9 ire 2 e n t s !re de6ine d in 5.,.2. Com m e n t . The inte nt o6 this cl! s e is to re-ort the s! 2 -l e r!t e 6or non* eve n t* driven s;st e 2 2onitor 6!cilities. $n e+ ! 2 -l e o6 this s! 2 -l e r!t e is 6o nd in det e r 2i ni n 1 Qch! n n el* b s;R, 0her e the st!t s o6 the ch!n n e l 2 st be s! 2 -l e d in order to det er 2 i n e i6 the reso rc e is inde e d b s;. <6 the s;st e 2 2onitorin 1 6!cilit; is !n eve n t co nt e r, it is not s! 2 -lin 1. 5.,.1.6 <6 ther e is no relev ! n c e or 2 e ! ni n 1 to ! s-eci6ic -er6or 2 ! n c e st!tistic 6or the s;st e 2 !nd -rod c t s se d in this s-eci6ic benc h 2 ! r 8 i2-le 2 e n t ! t i o n, then the s;2 b ol 'N/$) 6or not !--lic! bl e 2! ; be se d. This e+cl sio n 2 !; not be se d to !void re-ortin 1 relev ! n t b t ncollect e d d!t !. ReB u ir e # Perf or m a n c e Sta ti s t i c s This cl! s e describ e s the set o6 re9 ire d -er6or 2 ! n c e st!tistics. ?e6er to the t!bl e in $--en di+ B 6or s-eci6ic det !ils o6 re-ortin 1 l!;o t s !nd !cc r ! c ;.
:' = ' 4
5.,.2.1
#&% %tili:!tion $ 8e; -!r! 2 e t e r o6 !n; c!- ! cit ; 2 e ! s r e 2 e n t is #&% tili:!tion. $ll ent e r - ris e* cl!ss s;st e 2 2onitorin 1 6!cilities -rovid e ! 2e ! n s o6 recordin 1 #&% tili:!tion.
5.,.2.1. 1 The re9 ire d re-ortin 1 2et h o d is to record #&% 0hich the #&% 0!s b s;.
tili:!tion, i.e. the -erc e n t ! 1 e o6 ti2 e 6or
5.,.2.1. 2 For e!c h Me!s r e 2 e n t <nterv !l 'W<&S, W<&So !nd W<&Sb), ! 1r!- h ill str!ti n 1 #&% tili:!tion 6or e!c h s;st e 2 2 st be re-ort e d . <6 2 lti-l e s;st e 2 s -er6or 2 the s! 2 e 6 nction sin1 the s! 2 e h!rd0 ! r e !nd so6t0!r e con6i1 r ! ti o n, the 1r! - h sho0n 2 st re-r e s e n t the s;st e 2 in th!t 1ro - 0ith the hi1h e s t !ver ! 1 e #&% tili:!tion over the 2 e ! s r e 2 e n t interv !l. The +* !+is re-r e s e n t s the el!- s e d ti2 e 6ro2 the st!rt o6 the Me!s r e 2 e n t <nterv !l. The ;* !+is re-re s e n t s the #&% tili:!tion on ! sc!l e o6 0 to 100P. 7iscret e one 2in t e interv !l s 2 st be 1r! - h e d !cros s the Me!s r e 2 e n t <nterv !l, 0her e e!c h v!l e is the s;st e 2L s !ver ! 1 e #&% tili:!tion over th!t one 2in t e interv !l. The thre e Me!s r e 2 e n t <nterv !l s c!n be co2 bi n e d on ! sin1l e 1r! - h. $n e+! 2 -l e o6 s ch ! 1r! - h is sho0n belo0.
T&# Bench2!r8I W
&!1e
c++i
5.,.2.2
Me2or; %tili:!tion The 2 ! n n e r in 0hich 2e 2 o r ; is !lloc!t e d !nd controlled b; the host o-er ! ti n 1 s;st e 2 c!n indic!t e ho0 e66icientl; the ven d or o-er ! ti n 1 s;st e 2 !nd/ or 7BMS s -- ort s the de 2 ! n d s o6 the T&#*W benc h 2 ! r 8. To 6 rth e r this nd er s t ! n d i n 1.
5.,.2.2. 1 The tot !l !2 o n t o6 -h;sic !l 2 e 2 o r ; !v!il! bl e to the S%T d rin1 e!c h Me!s r e 2 e n t <nterv !l 2 st be re-ort e d . 5.,.2.2. 2 The tot !l !2 o n t o6 dedic !t e d d!t ! b ! s e Q-oolR, co2 2 o nl ; 8no0n !s sh!r e d 2 e 2 o r ;, 2 st be re-ort e d . <n i2-le 2 e n t ! t i o n s 0her e 2 lti-le -ools or -roc e s si n 1 re1ion s !re se d 6or di66ere n t d!t ! b ! s e ele 2 e n t s , onl; the !11r e 1 ! t e s 2 o6 !ll s ch -ools nee d be re-ort e d . 5.,.2.2. 5 The o-er ! ti n 1 s;st e 2 -!1 e si:e 2 st be re-ort e d . Co m m e n t A <t is e+- e c t e d th!t the d!t ! -rovid e d 0ill be identic !l to th!t 0hich is re-ort e d b; the st!n d ! r d -er6or 2 ! n c e 2onitor se d. 5.,.2.5 &!1e/S0 ! - $ctivit; The !ver ! 1 e &!1e* in, &!1e* o t, S0!-* in, !nd S0!-* o t r!t e s '0her e !--lic! bl e) !re to be re-ort e d . 5.,.2.( 7!t! b ! s e </= $ctivit; There !re 6o r re9 ire d r!t e s 're-ort e d !s r!t e s -er seco n d). The; !re @o1ic!l ?A$7S, &h;sic !l ?A$7S, @o1ic!l W?<TAS, !nd &h;sic !l W?<TAS. The st!n d ! r d 2e ! s r e s o6 @o1ic!l ?A$7/W?<TA 6or ! -!rtic l !r s;st e 2 sho ld be se d !lon1 0ith ! s 66icientl; det !ile d de6inition to !llo0 -ro- e r inter-r e t ! ti o n. Com m e n t A The obEective is to -rovid e so2 e vie0 o6 ho0 e66icientl; the s;st e 2 h!s c!ch e d d!t ! to s!tis6; -co 2i n 1 !--lic!tio n d!t ! nee d s . T&# Bench2!r8I W St!nd!rd S-eci6ic!tion Version &'( &!1e nd e r test
c++ii
5.,.2.5
S;st e 2 </= $ctivit;
5.,.2.5. 1 The tot !l s;st e 2 </= r!t e 'incl din 1 net0or8 </=) !nd the tot !l dis8 </= r!t e, c!lc l !t e d !s sin1l e !ver ! 1 e s !cros s e!c h Me!s r e 2 e n t <nterv !l !re re9 ir e d. The !ver ! 1 e </= r!t e, d!t ! tr!n s6 e r si:e !nd service ti2 e 6or e!c h dis8 devic e !s see n b; the s;st e 2 2 st !lso be re-ort e d . M!--in 1 o6 the lo1ic!l str ct r e s to the dis8 device s 2 st be re-ort e d . The tot !l </= r!t e s 2 !; not be c!lc l !t e d !s !n !ver ! 1 e o6 the individ !l </= r!t e s, b t 2 st be c!lc l !t e d !s the tot !l n 2 b e r o6 </=Hs divide d b; the Me!s r e 2 e n t <nterv !l. 5.,.2.5. 2 The tot !l </= r!t e s !ttrib t ! bl e to d!t ! b ! s e !nd tr!ns ! c ti o n 2 ! n ! 1 e 2 e n t e+! 2 -l e ! dit or be6ore i2!1 e Eo rn !l) 2 st be re-ort e d se- ! r ! t e l ;. 5.,.2.6 Web Serv er St!tistics The 6ollo0in1 Web Serv er st!tistics 'so2 e o6 0hich 2 !; be 6o nd in the Web Server $ccess @o1) !re re9 ire d to be re-ort e d. #onn e c ti on s -er seco n d * The n 2 b e r o6 conn e c ti o n s re9 e s t e d b; the ?BA !nd !cc e - t e d b; the S%T -er seco n d . The inten t is to co nt onl; the n 2 b e r o6 ne0 conn e c tio n s 2 ! d e s cc e s s6 ll; b; the ?BA in 1en e r ! t i n 1 the lo!d 6or the benc h 2 ! r 8 . Com m e n t . T;-ic!ll;, 6or ! soc8 et s b!s e d i2-le 2 e n t ! t i o n, this st!tistic 0o ld be the n 2 b e r o6 s cc e s s6 l ret r n s 6ro2 c!lls to the !cc e - t ') 6 nction. This st!tistic is not the n 2 b e r o6 conc rr e n t conn e c ti o n s the Web Server h!n dl e s !t !n; 1ive n -oint in ti2 e. CTT& re9 e s t s -er seco n d * The n 2 b e r o6 CTT& re9 e s t s rec eiv e d -er seco n d . The intent is to co nt onl; the re9 e s t s 1en e r ! t e d b; the ?BA in 1en e r ! t i n 1 the lo!d 6or the benc h 2 ! r 8. Com m e n t . For the - r-o s e s o6 the benc h 2 ! r 8 , ! re9 e s t is 9 it e li8el; ! BAT or ! &=ST re9 e s t 6ro2 the ?BA. The n 2 b e r o6 ret rn s 6ro2 the recv') 6 nction 2 !; not correctl; co nt the n 2 b e r o6 re9 e s t s sinc e it is -ossi bl e 6or ! re9 e s t to s-! n 2 lti-l e c!lls. <n CTT& 1.1, 2 lti-le re9 e s t s 2! ; !lso be sent over one -!c8 e t '-i-elinin1). The n 2 b e r o6 re9 e s t s receiv e d is best co nt e d b; the -!rsin 1 cod e. CTT& errors -er seco n d * The n 2 b e r o6 ?BA re9 e s t s th!t res lt in !n error res- o n s e -er seco n d . Com m e n t . This st!tistic 2 !; be obt !i n e d b; -ost* -roc e s si n 1 the Web Server $ccess @o1 !nd co ntin 1 !ll (++ !nd 5++ res- o n s e code s. The CTT& s-eci6ic!tion s de6in e the 6ollo0in1 res-o n s e cod e s. 1++ <n6or2 ! ti o n !l 2++ S cc e s s6 l 5++ ?edirection (++ #lient Arror 5++ Serv er Arror B;tes -er seco n d * The n 2 b e r o6 b;t e s sent to the ?BA -er seco n d. lo11in1 '6or
S cc e s s6 l ret r n s -er seco n d * The n 2 b e r o6 CTT& 2++ res-o n s e cod e s sent -er seco n d .
T&# Bench2!r8I W
&!1e c++iii
:' = ' 6 5.,.5.1
.pti o n a
Perf or m a n c e Sta ti s t i c s
Ther e !re 2 ! n ; !ddition !l d!t ! ele 2 e n t s 0hich 0o ld be o6 consid e r ! bl e v!l e to ! -er6or 2 ! n c e !n!l;st b t !re be;o n d the sco- e o6 the re9 ir e d d!t ! describ e d !bov e . <n 2ost c!s e s this d!t ! is !lre ! d ; bein1 re-ort e d b; the -er6or 2 ! n c e 2onit or bein1 se d !nd 0o ld re9 ire little !ddition !l 0or8. $n; o-tion !l d!t ! re-ort e d 2 st be -rovid e d b; ! co2 2 e r ci !ll; !v!il!bl e -er6or 2 ! n c e 2onit or. So2 e e+! 2 -l e s o6 d!t ! 0hich h!v e tr!dition !ll; be e n o6 inter e s t incl d e. Bre!8o t o6 #&% b s; b; >e;, St!t e, %s!1 e, or So6t0!r e co2 - o n e n t Bre!8o t o6 tr e #&% idle !nd idle 0!it 6or </= D e e st!tistics 6or 0or8 nits 0!itin1 6or the #&% reso r c e
&!1e/S0 ! - bre ! 8 o t over s-eci6ic devic e s incl din 1 service ti2 e s &!1e/S0 ! - bre ! 8 o t b; 6 nction or d!t ! t;-e &!1e/S0 ! - e66icienc ; !s -!1 e s -er </= </= st!tistics b; devic e 2od el or -er6or 2 ! n c e cl!ss %tili:!tion !nd cont e n ti o n 6or </= co2 - o n e n t s conc e n t r ! t o r s, <=&s, </= b s, !nd inter6!c e s Web c!ch e hit r!t e s s ch !s -!t h s, control nits, s0itch e s,
T&# Bench2!r8I W
&!1e c++iv
C a u s e ; , S 9T< RBE AN ) NETW.RK )E52N2T2.N S
; ' & R e m o t e Br o " s e r Em u a t o r (RBE)

6.1.1 The ?e2 ot e Bro0ser A2 l!t or '?BA) is the so6t0!r e co2 - o n e n t th!t drives the T&#*W 0or8lo! d s. <t e2 l ! t e s %sers sin1 0eb bro0s e r s to re9 e s t service s 6ro2 the S;st e 2 %nder Test 'S%T). The ?BA cre! t e s !nd 2 ! n ! 1 e s !n A2 l!t e d Bro0s er 'AB) 6or e!c h e2 l ! t e d %ser. The ter 2 ?BA, 0hen se d in this s-eci6ic!tio n, incl d e s the entire -o- l ! tion o6 AB. The ?BA co2 2 ni c ! t e s 0ith the S%T sin1 T#&/<& soc8 et s. The ?BA is res-o n si bl e 6or the 6ollo0in1. 6.1.5 #on6or 2i n 1 to !ll e+ec ti o n r les s-eci6ied in this doc 2 e n t #on6or 2i n 1 to !ll ind st r; st!n d ! r d s s-eci6ied in this doc 2 e n t , e.1. SS@ Ben er ! ti n 1 benc h 2 ! r 8 r!ndo 2 n 2bers, ti2 e s t ! 2 - s , strin1s !s re9 ir e d to i2-le 2 e n t the
6.1.2
6.1.5 6.1.(
Selectin 1 n!vi1! tio n o-tions 6or ABHs ?ecordin 1 the co2 -l e t e d co nt s !nd -erc e n t ! 1 e s o6 2i+ o6 0eb inter ! c ti on s re9 e s t e d !nd
?ecordin 1 W<?T !nd thro 1 h - t in !ccord ! n c e 0ith the re9 ire 2 e n t s o6 #l! s e 5 #on6or 2i n 1 to !ll sessio n ti2 eo t s s-eci6ied in this doc 2 e n t
The ?BA 2 !; not -er6or 2 !n; -roc e s si n 1 ordin !ril; -er6or 2 e d b; the S%T. This incl d e s, b t is not li2ite d to. #!chin1 Web obEect s, 6iles or d!t ! b ! s e t!bl e s, e+c e - t !s s-eci6ic!ll; not e d in #l! s e 2, !s re9 ire d to e+ec t e the ?BA 6 nction s. Se!rc hi n 1 6iles or d!t ! b ! s e s e+ce - t !s re9 ir e d to e+ ec t e ?BA 6 nction s #!chin1 dis8 !ddr e s s e s or -oint er s to d!t ! b ! s e record s on the S%T #o2-o si n 1 d;n ! 2 i c 0eb -!1 e s or 0eb obEect s &er6or 2i n 1 co2 - t ! t i o n s s ch !s shi--in 1 cost, t!+, etc. th!t belon 1 to the S%T #ontrib ti n 1 to the &ro2 otion !l &roce s si n 1 s-eci6ied in #l! s e 2 Storin1 sho- -i n 1* c!rt in6or2 ! tio n to !void -roc e s si n 1 b; the S%T #o2 2 ni c ! ti n 1 in6or2 ! tio n to the S%T re1!r di n 1 6 t re 0eb inter ! c ti on s or n!vi1 ! ti o n A+ec ti n 1 !ctive ele 2 e n t s 'e.1., "!v! scri-ts or !--l et s) co2 2 ni c ! t e d b; the S%T $n; lo!d b!l! n ci n 1 or ro tin1 !cros s 2 lti-l e co2 - o n e n t s o6 the S%T
T&# Bench2!r8I W
&!1e
c++v
6.1.6
The ?BA 2 !; not se -ro-ri et ! r ; co2 2 ni c ! ti o n -rotoc ols 0he n co2 2 ni c ! ti n 1 0ith the S%T. The ?BA is re9 ir e d to se T#&/<& soc8 et s 'i.e. ?F# 1122, etc.) 6or !ll net0or8 co2 2 ni c ! ti o n. $ ne0 soc8et 2 st be cre! t e d 6or e!c h %ser Session. %ser Sessio n s c!n n o t sh!r e ! soc8e t conn e c ti o n. Co0ev er, the ?BA 2! ; o-e n 2 lti-l e soc8 et conn e c tio n s -er %ser Session. The S%T !nd ?BA 2 st o-e n ! ne0 soc8et conn e c ti o n 6or e!c h AB. $ soc8e t conn e c ti o n c!nn o t be se d b; 2or e th!n one AB. F rth er 2 o r e , i6 the S%T !llo0s -ersist e n t ses sion s, !lso 8no0n !s 8ee-* !live '!s s-eci6ied in CTT& 1.1), the d r!tio n -!r! 2 e t e r s 6or -ersist e n t ses sion s 'i.e. ti2 e li2it !nd re9 e s t li2it) 2 st be disclos e d. The co2 2 ni c ! ti o n bet0 e e n the ABHs !nd the S%T 2 st not 'MSS) 1re ! t e r th!n 1,(6 0 b;t e s. The v!l e o6 T#& T<MASW$<T 2 st be !t le!st 60 seco n d s . se ! T#& M!+i2 2 Se1 2 e n t Si:e
6.1.,
6.1.8
6.1.9
6.1.10 ?e9 ire !ll ABHs to se the identic !l %?@ to invo8e the 6irst ho2 e - ! 1 e !nd in !ddition tr!n sl !ti on o6 the host n ! 2 e -ortion o6 the %?@, i6 don e b; the s;st e 2 0her e the ?BA is r nnin 1, 2 st res lt in ! sin1le <& !ddr e s s 0hich is identic !l 6or !ll ABHs. The onl; -!rt o6 the %?@ th!t c!n ch! n 1 e is the -!r! 2 e t e r th!t ni9 el ; identi6ies the c st o 2 e r . Com m e n t A <t is re!li: ed th!t d;n ! 2 i c 7NS c!ch e s 0ill !llo0 the ?BAHs to c!ch e the <& !ddr e s s !nd this is believ e d to h!v e no si1ni6ic! nt -er6or 2 ! n c e !dv ! n t ! 1 e .
; ' 4 9 s e r S e s s i o n ) u r a ti o n
6.2.1 6.2.1.1 7e6inition o6 Ter2 s The ter 2 9s er S e s s i o n Curre n t )ura ti o n is se d in this s-eci6ic!tion to re6er to the ti2 e, 2 e ! s r e d b; the AB, th!t h!s el!-s e d from the ti2 e E st be6or e the 6irst re9 e s t b; the AB o6 the Co2 e 0eb inter ! c tio n to the c rre n t ti2 e d rin1 the %ser Session. The ter 2 9s er Se s s i o n Mini m u m )urati o n ' 9SM) ) is se d in this s-eci6ic!tio n to re6er to the 2ini2 2 d r!tio n, 2 e ! s r e d b; the AB, 6or 0hich ! s-eci6ic %ser Session 2 st l!st. For e!c h %ser Session, the AB 1en e r ! t e s ! %SM7 r!nd o 2 l ; select e d 6ro2 ! ne1 ! ti v e e+-o n e n t i !l distrib tion. A!ch %SM7 is 1en e r ! t e d sin1 the 6ollo0in1 e9 ! ti o n. %SM7 [ * ln'r) ^ 0her e. ln [ n!t r !l lo1 'b!s e e) r
6.2.1.2
[ r!nd o 2 n 2 b e r
ni6or2l; distrib t e d bet0 e e n 0 !nd 1.0
[ 2e ! n d r!tion o6 15 2in t e s
Com m e n t & . The resol tion o6 the ti2 e st! 2 - s 2 st be !t le!st 0.1 seco n d s . Com m e n t 4 . A!ch distrib tio n 2 st be tr nc ! t e d !t ( ti2 e s b; re-l!cin1 !n; v!l e hi1h er
th! n ( ti2e s 0ith the v!l e ( ti2e s !nd sin1 th!t v!l e.
T&# Bench2!r8I W
&!1e c++vi
Com m e n t 6 . The %SM7 is de6ine d to s -- ort the re9 ir e 2 e n t th!t ! %ser Session doe s not end ntil its %SM7 h!s el!-s e d !nd the ne+t 0eb inter ! c tio n is 1oin1 to be ! Co2 e 0eb inter ! c ti on '!s de6ine d in #l! s e 6.2.2.1). Bec! s e ther e 0ill be on !ver ! 1 e ! non* :ero ti2 e bet0 e e n the %SM7 el!-si n 1 !nd the ne+t selection o6 ! Co2 e 0eb inter ! c tio n, the !ct !l !ver ! 1 e d r!tio n 6or %ser Session s 0ill be so2 e 0 h ! t 1re ! t e r th! n %SM7. The re!s o n the %ser Sessio n doe s not end ntil the ne+t Co2 e 0eb inter ! c tio n is bec ! s e it is nec e s s ! r ; to 2!int !i n the re9 ire d 2i+. 6.2.1.5 For ! 1iven Me!s r e 2 e n t <nterv !l, the !ver ! 1 e %SM7 is co2 - t e d !s the !ver ! 1 e o6 the %SM7 6or !ll sessio n s be1i n ni n 1 d rin1 th!t Me!s r e 2 e n t <nterv !l. <6 the sessio n doe s not end be6or e the close o6 the Me!s r e 2 e n t <nterv !l, the %SM7 c!lc l !t e d 6or th!t sessio n sho l d still be incl d e d in the !ver ! 1 e %SM7. 9s er S e s s i o n Termi n a t i o n $ %ser Session ends 0hen !ll o6 the 6ollo0in1 conditions hold. The AB h!s E st co2 -l et e d the Thin8 Ti2e 6ollo0in1 the co2 -l eti on o6 ! 0eb inter ! c tio n. The n!vi1 ! ti o n o-tion chos e n b; the AB 6or the ne+t 0eb inter ! c ti on is the Co2 e 0eb inter ! c tio n. The %ser Session # rre nt 7 r!tion is 1re ! t e r th! n or e9 !l to the %ser Session Mini2 2 7 r!tion.
;' 4 ' 4 6.2.2.1
6.2.2.2
When the %ser Session ends, the AB t!8e s the 6ollo0in1 !ction s. The AB close s !n; SS@ ses sion th!t is c rre n tl ; est ! blish e d 6or the %ser Session. The AB close s !ll net0or8 conn e c tio n s th!t !re c rre n tl ; est ! blis h e d 6or the %ser Sessio n. $6ter t!8in1 thes e !ction s, the AB is !llo0e d to i22 e di ! t el ; st!rt ! ne0 %ser Sessio n.
; ' 6 S * s t e m 9 n # e r Te s t ( S 9T)
The S%T co2 -ris e s !ll co2 - o n e n t s 0hich !re -!rt o6 the Q!--lic!tionR bein1 si2 l !t e d . This incl d e s net0or8 conn e c tio n s, Web Serv er s, !--lic!tion serv er s, d!t ! b ! s e serv er s, etc. ;' 6 ' & S9T Cont e n t s The S%T consist s o6. The host s;st e 2 ' s) 'incl din 1 h!rd0 ! r e !nd so6t0!r e ) re9 ir e d to s -- ort the $--lic!tion !nd d!t ! b ! s e ' s ). $ll net0or8 co2 - o n e n t s 'h!rd0 ! r e !nd so6t0!r e) bet0 e e n host 2 !c hi n e s 0hich h!n dl e intr!* S%T !--lic!tion co2 2 ni c ! ti o n s !re -!rt o6 the S%T. #o2-o n e n t s 0hich -rovid e !--lic!tio n lo!d b!l! n ci n 1 The net0or8 inter6! c e to the S%T. $n; co2 - o n e n t o6 the co2 2 ni c ! ti o n s net0or8 0hich se !--lic!tion d!t ! 0ithin ! -!c8 e t !re -!rt o6 the S%T. Com m e n t . The intentio n is to re9 ir e !n; co2 - o n e n t s 0hich !re re9 ire d to 6or2 the -h;sic !l T#&/<& conn e c tio n s 'co2 2 o nl ; 8no0n !s the N<#, Net0or8 <nter6!c e #!rd) to be -!rt o6 the S%T. The <ntern e t co2 2 ni c ! ti o n s -rovid er s !re not incl d e d in the S%T. T&# Bench2!r8I W St!nd!rd S-eci6ic!tion Version &'( &!1e c++vii
;' 6 ' 4 6.5.2.1
<t does not incl d e the ?BA or the &BA.
5un c ti o n s of t$ e S9T The S%T servic e s the 6ollo0in1. CTT& BAT re9 e s t s vi! the CTT& server, either b; ret r nin 1 st!tic in6or2 ! tio n 6ro2 6iles stor e d in the 6ile s;st e 2 or b; 1en e r ! ti n 1 d;n ! 2 i c -!1 e s sin1 in6or2 ! tio n retriev e d 6ro2 ! d!t ! b ! s e . The d!t ! b ! s e 2! ; be !cce s s e d sin1 !n; co2 2 e r ci !ll; !v!il! bl e inter6! c eG CTT& &=ST re9 e s t s vi! the CTT& server, b; invo8in1 the !--ro - ri ! t e tr!ns ! c ti o n in the !--lic!tion d!t ! b ! s e . The d!t ! b ! s e 2 !; be !cc e s s e d sin1 !n; co2 2 e r ci !ll; !v!il!bl e inter6! c eG
6.5.2.2
The S%T -er6or 2 s the 6ollo0in1 o-er ! ti o n s. $ll d!t ! b ! s e !cce s s e s G $ll co2 2 ni c ! ti o n 6 nction s to the AB !nd &BAG $ll !--lic!tio n 6 nction !lit; re9 ire d to i2-le 2 e n t the 0eb inter ! c tio n s.
;' 6 ' 6 6.5.5.1
S9T Re s tri c t i o n s #!chin1 o-er ! ti o n s -er6or 2 e d b; the S%T !re restrict e d to the co2 2 e r ci !ll; !v!il! bl e co2 - o n e n t s o6 the s;st e 2 . #onsist e n c ; o6 d!t ! 0ith the d!t ! b ! s e !nd 6ile s;st e 2 2 st be 2 !int !i n e d 0he n c!chi n 1 is e2 -l o;e d , e+c e - t in the 6ollo0in1 !re ! s. Se!rc h ?es lt 0eb inter ! c tio n. The res- o n s e -!1 e 6or ! t hor or title se !rc h e s nee d not re6lect !n; ch!n 1 e s co2 2 it t e d to the d!t ! b ! s e sinc e the initi!l -o- l !tio n. Se!rc h ?es lt 0eb inter ! c tio n. The res- o n s e -!1 e 6or s bEect se!rc h e s 2 st re6lect the e66ect s o6 !n; ch! n 1 e s co2 2 it t e d to the d!t ! b ! s e b; !n; 0eb inter ! c ti on 0hich co2 -l e t e d !t le!st 50 seco n d s be6or e the Se!rc h ?es lt 0eb inter ! c ti on 0!s re9 e s t e d . Ne0 &rod ct s 0eb inter ! c ti on. The e66ect s o6 !n; ch!n 1 e s co2 2 it t e d to the d!t ! b ! s e b; !n; 0eb inter ! c ti on 0hich co2 -l e t e d !t le!st 50 seco n d s be6ore the Ne0 &rod ct s 0eb inter ! c tio n 0!s re9 e s t e d 2 st be re6lect e d in the res-o n s e -!1 e. Best Seller 0eb inter ! c tio n. The e66ect s o6 !n; ch!n 1 e s co2 2i t t e d to the d!t ! b ! s e b; !n; 0eb inter ! c ti on 0hich co2 -l et e d !t le!st 50 seco n d s be6or e the Best Seller 0eb inter ! c tio n 0!s re9 e s t e d 2 st be re6lect e d in the res-o n s e -!1 e. &rod ct 7et!il 0eb inter ! c tio n. The e66ect s o6 !n; ch! n 1 e s co2 2 it t e d to the d!t ! b ! s e b; !n; 0eb inter ! c ti on 0hich co2 -l e t e d !t le!st 50 seco n d s be6ore the &rod ct 7et !il 0eb inter ! c tio n 0!s re9 e s t e d 2 st be re6lect e d in the res-o n s e -!1 e.
Com m e n t & . The intentio n is to enco r ! 1 e the se o6 c!chin 1 co2 - o n e n t s 0ithin the benc h 2 ! r 8 . To ens r e !cc e s si bilit; to c sto 2 e r s it is re9 ire d th!t c!chi n 1 co2 - o n e n t s e2 -lo;e d in the benc h 2 ! r 8 be ! -!rt o6 the co2 2 e r ci !ll; !v!il! bl e co2 - o n e n t s o6 the S%T. ?e!l 0orld 0eb sites co2 2 o nl ; tr!d e d!t ! consist e n c ; !1!i n st -er6or 2 ! n c e to !tt !i n hi1h er s;st e 2 thro 1 h - t . The stor ! 1 e !nd retriev !l o6 CTM@ -!1 e s !nd -!rt s o6 CTM@ -!1 e s 2! ; onl; be h!n dl e d b; co2 2 e r ci !ll; !v!il!bl e co2 - o n e n t s o6 the S%T. <n !ddition, 0eb server !nd d!t ! b ! s e d!t ! c!chi n 1 2! ; be se d to the e+t e n t th!t the c!chin 1 co2 - o n e n t s !re re!dil; !v!il! bl e in the co2 2 e r ci !l co2 - o n e n t s o6 the S%T.
T&# Bench2!r8I W
&!1e c++viii
Com m e n t 4 . The !--lic!tion -ro1r ! 2 2! ; e2 -lo; CTT&1.1 c!chi n 1 directiv e s in the res- o n s e he ! d e r to co2 2 ni c ! t e c!chi n 1 in6or2 ! ti o n to ! co2 2 e r ci !ll; !v!il! bl e 0eb c!ch e .
Com m e n t 6A ?e6res hi n 1 o6 c!ch e d CTM@ -!1 e s in ! 0eb serv er 2 !; be -er6or 2 e d 0he n ! Web <nter ! c tio n is re9 e s t e d , or 0he n so2 e other t!s8 or 2 ec h ! n i s 2 is invo8e d th!t 2!8 e s ! re9 e s t 6or the s! 2 e CTM@ -!1 e !s ! Web <nter ! ctio n. $ll sch e d lin 1 -rod c t s !nd e+t er n !l 2ec h ! ni s 2 s se d to invo8e ! c!ch e re6res h 6 nction 2 st be co2 2 e r ci !ll; !v!il! bl e. Com m e n t 8A $ 6 nction tri11er e d b; ! Web <nter ! c tio n to re6res h the CTM@ c!ch e 2 st be li2ited to re6re s hi n 1 the c!ch e 6or the s-eci6ic CTM@ -!1 e re9 e s t e d b; th!t inter ! c ti on. Si2il!rl; !n; e+t er n !l 2 ec h ! ni s 2 , 0hich tri11e r s ! 6 nction to re6res h !n CTM@ c!ch e 6or ! sin1le CTM@ res-o n s e -!1 e 6or ! Web <nter ! ction, 2 st be li2ite d to re6res hi n 1 the -!1 e 6or its corre s - o n di n 1 Web <nter ! c tio n. Nothin1 c!n e+-licitl; re9 e s t d!t ! 0hich is o tsid e the d!t ! re9 ir e d to s!tis6; this Web <nter ! c tio n re9 e s t . Com m e n t :A The Best Seller, Ne0 &rod ct, !nd Se!rc h ?es lt s on s bE ect 0eb inter ! c ti on s e!c h incl d e 2( di66ere n t 9 eri e s b!s e d on the selection s bE ect. $ltho 1 h thes e 9 eri e s di66er onl; b; the s bEect !nd e+ec t e ver; si2il!r -roc e s si n 1 ste - s, this 6!ct c!n not be se d to i2-rov e -er6or 2 ! n c e o6 the i2-le 2 e n t ! t i o n . For inst ! n c e , the -roc e s si n 1 o6 !n; one o6 thes e 9 eri e s 2! ; not incl d e ste - s th!t !re s-eci6ic to one or 2or e o6 the oth er 25 9 eri e sG the d!t ! b ! s e 2 !; not incl d e ! +ili!r; d!t ! str ct r e s th!t t!8e !dv ! n t ! 1 e o6 the si2il!rities o6 the 2( 9 eri e s. Com m e n t ;A <t sho l d be not e d th!t the -ro2 o tio n !l -roc e s si n 1 incl d e s the 1en e r ! t i o n o6 ! r!ndo 2 <S<7 th!t is inde - e n d e n t o6 ch! n 1 e s to the d!t ! b ! s e . Th s, it is re9 ire d th!t the res lt o6 -ro 2 o tio n !l -roc e s si n 1 !s dis-l !;e d on the res-o n s e -!1 e s be derive d 6ro2 the r!ndo 2 <S<7 6or Best Sellers, Ne0 &rod ct s, !nd Se!rc h ?es lts. For e!c h re9 e s t 6ro2 the ?BA 6or the s e inter ! c ti on s, the -ro2 o tion !l ite2 s tr!ns6 err e d to the ?BA 0ill be derive d 6ro2 the r!ndo 2 l ; select e d <S<7 6or the re9 e s t . 6.5.5.2 The S%T 2 st not !llo0 !n; e+ch ! n 1 e s o6 in6or2 ! tio n bet0 e e n %ser Session s. The cont e+ t o6 e!c h %ser Session 2 st be isol!t e d.
; ' 8 P a * m e n t 1 a t e " a * Em u a t o r ( P1E)

6.(.1 The &!;2 e n t B!t e0 ! ; A2 l!t or '&BA) re-re s e n t s !n e+t er n !l -!;2 e n t o6 6 nds !s -!rt o6 - rch ! si n 1 tr!n s ! c ti o n s . The &BA is not incl d e d in the S%T. The &BA 2 st -er6or 2 the 6ollo0in1 6 nction s. Ast! blish !n SS@ sessio n !t the S%TLs re9 e s t ?eceive 2 es s ! 1 e s 6ro2 the S%T For e!c h 2 es s ! 1 e rec eiv e d 6ro2 the S%T. 7ecr;-t the 2e s s ! 1 e A+tr!ct the =S<7 in6or2 ! ti o n 6ro2 the 2 es s ! 1 e St!nd!rd S-eci6ic!tion Version &'( &!1e c++i+ s;st e 2 0hich ! t h ori: e s
6.(.2 6.(.5
T&# Bench2!r8I W
Ben er ! t e !n ! t hori: ! tion cod e, $%TCS<7, !s ! r!ndo 2 !* strin1 o6 15 ch!r ! c t e r s Within the decr;- t e d 2 es s ! 1 e !t ! r!nd o 2 loc!tion st!rtin 1 !6t er the U/=<7 V t!1, e2 b e d $%TCS<7 -rec e d e d b; the U#=7A V t!1 !nd 6ollo0ed b; the U/#=7A V t!1. ?ecord the =S<7 !nd ! t h ori: !tio n n 2 b e r on ! d r! bl e 2 e di 2 Ancr;-t the -d ! t e d res- o n s e 2 es s ! 1 e
Sen d the encr;- t e d res- o n s e 2 es s ! 1 e b!c8 to the S%T
A!ch SS@ res- o n s e 2 st be sent se- ! r ! t e l ;. 6.(.( The res- o n s e ti2 e bet0 e e n the rece - ti o n o6 ! 1iven 2 es s ! 1 e 6ro2 the S%T !nd the co2 2 ni c ! ti o n o6 the &BALs res- o n s e 2 es s ! 1 e to the S%T 2 st be no less th!n 2 seco n d s.
; ' : M o # e o f t $ e C o m p e t e Te s t e # S * s t e m
The 6ollo0in1 di!1r ! 2 sho0s !n e+! 2 -l e l!;o t o6 ?BA, &BA !nd S%T co2 - o n e n t s . $ll co2 - o n e n t s on the ri1ht o6 the line !re -!rt o6 the S%T !nd, !s s ch, 2 st be -riced 'see #l! s e ,).
Pa*ment 9ate7a* Emulator P9E Remote ro7ser Emulator R E
Web 6b#ect Storage
SUT
C9I: IS(PI: etc)
Networ&
HTTP Ser8er
n (''lication ns &atabase
Remote ro7ser Emulator R E
(''lication Ser8er
(''lication Transactions
; ' ; C o m m u n i c a t i o n s 2n t e r f a c e s ) e f i n i ti o n s
;' ; ' & Net " o r ! Prot o c o The net0or8 -rotocol 6or co2 2 ni c ! ti n 1 bet0 e e n the S%T !nd the ?BA !s 0ell !s bet0 e e n the S%T !nd the &BA 2 st be T#&/<&. The net0or8 -rotoc ol 6or co2 2 ni c ! ti o n 0ithin the S%T is not restrict e d .
T&# Bench2!r8I W
&!1e
c+++
;' ; ' 4
App i c a t i o n Prot o c o The !--lic!tion -rotoc ol is the d!t !* level -rotocol 0hich is se d bet0 e e n the ?BA !nd the S%T. $ll -rotoc ols 0hich !re se d 2 st be co2 2 e r ci !ll; !v!il! bl e. $ll 0eb inter ! c ti on s 2 st se the htt- &rotocol, version 1.1 or !bov e. $ll sec r e 0eb inter ! c tio n s 2 st se the SS@ -rotocol, version 5 or !bov e .
;' ; ' 6
Com m u n i c a t i o n s Wit$i n t$ e S9T The co2 2 ni c ! ti o n s -rotoc ols 0ithin the S%T !re not restrict e d.
; ' = . p e r a ti o n a C$ ar a c t e ri s ti c s o f t $ e M e r c $ a n t C o m m e r c e A p p i c a t i o n
The obEectiv e o6 this benc h 2 ! r 8 is to re-re s e n t ! ,J2( o-er ! ti n 1 environ 2 e n t 6or ! 0eb* b!s e d est ! blish 2 e n t . The 6ollo0in1 !re re9 ire 2 e n t s o6 the benc h 2 ! r 8 !--lic!tio n th!t 2!8 e it consist e n t 0ith ! ,J2( o-er ! tio n !l 2od el. So2 e o6 the s e 6 nction !l ch!r ! c t e ri stics 2! ; not be !ct !ll; e+ ercis e d d rin1 the benc h 2 ! r 8Ls Me!s r e 2 e n t <nterv !l s. ;' = ' & 9nin t e r r u p t e # E3ec u t i o n The benc h 2 ! r 8 !--lic!tio n 2 st be c!- ! bl e o6 contin e d e+ ec tio n 6or !t le!st 1( d!;s, 0her e contin e d e+ ec ti o n 2e ! n s ! 2ini 2 2 o6 50P !nd !n !ver ! 1 e o6 55P o6 the re-ort e d W<&S thro 1 h - t . This is e9 iv !l e n t to 8 ho rs !t 6 ll thro 1 h - t . The thro 1 h - t re9 ir e 2 e n t s !--l; 0ithin !n; !rbitr!r; h!l6 ho r interv !l 'se e !lso #l! s e 5.5.2.2). To de 2 o n s t r ! t e contin e d e+ec tio n c!- ! bilit;, the 6ollo0in1 d!t ! 2 st be collect e d 6or e!c h s;st e 2 th!t is -!rt o6 the S%T !t the st!rt !nd end o6 the test r n 6or the re-ort e d Sho--i n 1 <nterv !l 'see #l! s e 5.1.2), -rior to !n; sh t d o 0 n o6 the !--lic!tion. Tot!l dis8 s-!c e tili:!tion in b;t e s
7is8 s-!c e 6or s;st e 2 s0! - -i n 1 !nd -!1in 1
The tot !l 1ro0t h in the s e reso rc e s '?B) sho ld be e+tr ! - ol ! t e d to ! -eriod o6 1( d!;s, !ss 2 i n 1 !n 8* ho r d!; !nd sin1 the 6ollo0in1 6or2 l ! 6or e!c h reso rc e . ?B [ <? X 'B / T< ^ W<&S ^ 5600 ^ 8 ^ 1() Where. T< is the tot !l inter ! c ti on s d rin1 the test r n, B is the 1ro0t h over the test r n, !nd <? is the initi!l reso rc e tili:!tionG benc h 2 ! r 8 s !re r n, 2 st be c!- ! bl e o6 1( d!;s o6 contin o s o-er ! tio n, !s de6ine d lt, the reso rc e re9 ire 2 e n t s 6or dis8, !s o6 the s;st e 2 .
The s;st e 2 con6i1 r ! tio n on 0hich T&#*W s -- orti n 1 the tot !l reso rc e re9 ire 2 e n t s 6or !bov e. To be consid e r e d ! v!lid T&#*W res co2 - t e d !bov e , 2 st not e+c e e d the c!- ! cit ;
Com m e n t . <6 the !bov e re9 ir e 2 e n t is i2-le 2 e n t e d b; b!c8in 1* - so2 e 6iles, s ch !s the Web Server $cces s @o1s, to t!- e s !t re1 l !r interv !l s, the stor! 1 e s-!c e !rchiv e d to t!- e c!n be e+cl d e d 6ro2 the !bov e stor ! 1 e re9 ire 2 e n t . T&# Bench2!r8I W St!nd!rd S-eci6ic!tion Version &'( &!1e c+++i
;' = ' 4
Non, )isru p t i - e Main t e n a n c e The 6ollo0in1 !ctivities !re consid e r e d indis- e n s ! b l e 6or nor2 !l s;st e 2 2 !int e n ! n c e !nd 2 st be -ossi bl e d rin1 the 1( d!;s o6 nint err - t e d e+ ec tio n, !s de6ine d !bov e. Site !d 2i nistr ! tio n Sec rit; !d 2i ni str ! ti o n =66lo!d or !rchive o6 s;st e 2 , d!t ! b ! s e , !--lic!tio n or Web Serv er lo1s &roce s si n 1 !cco n ti n 1 in6or2 ! tio n #re!tin 1 7!t! b ! s e #hec8-oi nt s &roce s si n 1 7!t! b ! s e <2!1 e #o-ies
Site !d 2i ni str ! ti o n incl d e s the !ctivities o6 !ddi n 1 or ch! n 1i n 1 ht 2l !nd 1r!- hi csG !ddin 1 or ch!n 1i n 1 sho- - e r disco n t s !nd !dv er tisin 1 2 es s ! 1 e s G !nd !ddi n 1 or ch!n 1i n 1 s-eci !l o66ers. Sec !nd sec !nd rit; !d 2i ni str ! ti o n involves -rot e cti n 1 reso rc e s s ch !s d!t ! set s, d!t ! b ! s e s , -ro1r ! 2 s o-er ! t o r co2 2 ! n d s 6ro2 !cc e s s b; n! t h o ri: e d ser s. <t incl d e s cre !ti n 1 1en e ric rit ; -ro6iles, ch! n 1i n 1 -er 2i s sio n s 6or ser s !nd reso rc e s , !llo0in1 the !cc e s s , -d ! t e cre !ti on o6 d!t ! set s, !nd res et ti n 1 -!s s0 or d s, i6 nec e s s ! r ;.
&roces si n 1 !cco n ti n 1 in6or2 ! ti o n re6ers to the !n !l;sis !nd re-ortin 1 o6 !cco n ti n 1 d!t ! sin1 ! -ro1r ! 2 or !n !cco n ti n 1 so6t0!r e -!c8 ! 1 e . 7e- e n di n 1 -on s-eci6ic -l!t6or 2 i2-le 2 e n t ! t i o n s , ther e 2! ; !lso be ! re9 ire 2 e n t to d 2 - or o66lo!d !cco n ti n 1 record s be6or e the !n!l ;si s -ro1r ! 2 ' s ) c!n o-er ! t e -on the 2 . 7!t ! b ! s e chec8 - oi nt s !re sn! - s h o t s o6 the d!t ! b ! s e !t so2 e s-eci6ic 2o 2 e n t in ti2 e, 6or the - r-o s e s o6 est ! blishin 1 ! consist e n t st!t e 0hich c!n be se d 6or recov er ;, i6 nec e s s ! r ;. #hec8-oi nt s nor2 !ll; occ r !t -red e t e r 2 i n e d ti2 e interv !l s 'e.1. ever; 25 2in t e s ), 0he n s0itchin 1 6ro2 one !ctive lo1 d!t ! set to !not h e r, !6t er ! s cc e s s6 l rest !r t or !t nor 2 !l ter2i n ! tio n. 7!t ! b ! s e <2!1 e #o-ies !re nor2 !ll; cre !t e d sin1 ! d!t ! b ! s e tilit; -ro1r ! 2 to c!-t r e ! li8en e s s o6 the d!t ! !nd/or control in6or2 ! tio n. <2!1 e co-ie s 2! ; be s bs e 9 e n t l ; se d in ! recov e r ; o-er ! tio n. Most 7BMS s -- ort bot h 6 ll i2!1 e co-i es 'i.e. ! d 2 - o6 the entire d!t ! b ! s e ' s )) !nd incre 2 e n t ! l i2!1 e co-ie s 'i.e., ! co-; o6 the in6or2 ! ti o n th!t h!s ch!n 1 e d since the l!st i2!1 e co-;). Com m e n t . There is no s-eci6ic re9 ir e 2 e n t 6or ! de 2 o n s t r ! ti o n o6 non* disr - tiv e 2!int e n ! n c e , b t the ! dit or h!s the o-tion to re9 ire ! de 2 o n s t r ! t i o n o6 non* disr -tiv e 2!int e n ! n c e .
T&# Bench2!r8I W
&!1e c+++ii
C a u s e = , PR2C2N1
= ' & Pri ci n g M e t $ o # o o g *

,.1.1 The intent o6 this section is to de6in e the 2 et h o d ol o 1 ; to be se d in c!lc l !tin 1 the 5* ;e !r -ricin1 !nd the -rice/ - e r6or 2 ! n c e '-rice/W<&S). The 6 nd ! 2 e n t ! l -re 2i s e is th!t 0h!t is test e d !nd/or e2 l ! t e d is -riced !nd 0h!t is -rice d is test e d !nd/or e2 l ! t e d . A+ce-tio n s to this -re 2i s e !re not e d belo0. The -ro-o s e d s;st e 2 to be -riced is the !11r e 1 ! t i o n o6 the S%T co2 - o n e n t s th!t 0o ld be o66ere d to !chi ev e the re-ort e d -er6or 2 ! n c e level, !s de6in e d in #l! s e 6. #!lc l !tion o6 the -rice d s;st e 2 consist s o6. &rice o6 the S%T !s test e d !nd de6ine d in #l! s e 6, e+cl di n 1 bro0s e r s. &rice o6 on* line stor! 1 e re9 ir e d 6or the initi!l d!t ! b ! s e -o- l !tio n !nd d!t ! 1en e r ! t e d over 180 8* ho r d!;s o6 -roc e s si n 1 !t the re-ort e d W<&S, !llo0in1 6or ! 2ini 2 2 o6 1( d!;s o6 nint err - t e d -roc e s si n 1. The s;st e 2 so6t0!r e !--lic!tion -ro1r ! 2 . nec e s s ! r ; to cre! t e , o-er ! t e , !d 2i ni st e r, !nd 2 !int !i n the
,.1.2
&rice o6 !ddition !l -rod ct s th!t !re re9 ir e d 6or the o-er ! ti o n, -er6or 2 ! n c e 2onit orin 1 or 2!int e n ! n c e o6 the -rice d s;st e 2 . se d.
!d 2i ni str ! ti o n,
,.1.5
The 6ollo0in1 -ricin1 2et h o d ol o 1 ; 2 st be
$ll h!rd0 ! r e !nd so6t0!r e se d in the -ricin1 c!lc l !tion s 2 st be !nn o n c e d !nd order ! bl e b; c st o 2 e r s . For !n; -rod ct not !lre ! d ; 1en e r !ll; rele ! s e d , the F ll 7isclos r e ?e-ort 2 st incl d e ! co2 2i t t e d 1en e r !l deliver; d!t e 'see #l! s e 8.1.8). Th!t d!t e 2 st not e+ce e d 6 2ont h s be;o n d the F ll 7isclos r e ?e-ort s b 2it t !l d!t e. Com m e n t A <ncl sion o6 ! -rod ct in ! T&#*W F7? constit t e s - blic !nn o n c e 2 e n t o6 th!t -rod ct . =nce the -rice o6 ! -rod c t is 9 ot e d in ! T&#*W F7? !nd once c st o 2 e r s c!n se the so rc e o6 the 9 ot e to initi!t e ! tr!n s ! c ti o n th!t 0ill 1 !r ! n t e e deliver; o6 th!t -rod c t, it is consid e r e d order ! bl e .
Ben er !ll; !v!il! bl e disco n t s 6or the -rice d con6i1 r ! tio n !re -er 2i s si bl e. Ben er !ll; !v!il! bl e -!c8 ! 1 e d -ricin1 is !cc e - t ! bl e . @oc!l ret !il -ricin1 !nd disco n t str ct r e sho l d be res lts !re - blish e d . se d in e!c h co ntr ; 6or 0hich
&rice sho l d be re-r e s e n t e d b; the c rre n c ; 0ith 0hich the c sto 2 e r 0o ld - rch ! s e the s;st e 2 . $ll h!rd0 ! r e co2 - o n e n t s or -revio sl; o0n e d). se d in the -riced s;st e 2 2 st be ne0 'i.e., not recon dition e d
For test s-on s or 's) 0ho h!v e onl; indirect s!le s ch!n n e l s, -ricin1 2 st be !ct !l 1en e r !ll; !v!il! bl e -ricin1 6ro2 indirect ch! n n el s 0hich 2e e t !ll oth er re9 ire 2 e n t s o6 #l! s e ,. &rices sho ld be sho0n !s 0hole inte 1 e r !2 o n t s 'e.1., doll!rs b t not cent s). $ll 6r!ction !l !2 o n t s sho ld be ro n d e d - to the ne !r e s t inte 1 e r v!l e.
T&# Bench2!r8I W
&!1e c+++iii
Com m e n t &A The inten t o6 the -ricin1 2 et h o d ol o 1 ; is to !llo0 -!c8 ! 1i n 1 !nd -ricin1 th!t is 1en e r !ll; !v!il!bl e to c sto 2 e r s !nd to e+-licitl; e+cl d e -ro2 o tio n !l !nd/ or li2ite d !v!il! bilit; o66erin1s. Com m e n t 4A ?even e disco n t s b!s e d on tot!l -rice !re -er 2i s si bl e. $n; disco n t 2 st be onl; 6or the con6i1 r ! tio n bein1 -rice d !nd c!nn o t be b!s e d on -!st or 6 t r e - rch ! s e s . <ndivid !ll; ne1o ti !t e d disco n t s !re not -er 2it t e d . S-eci !l c st o 2 e r disco n t s 'e.1. BS$ sch e d l e, ed c ! ti o n !l sch e d l e) !re not -er 2it t e d . Com m e n t 6A The intent is to benc h 2 ! r 8 the !ct !l s;st e 2 0hich the c st o 2 e r 0o ld - rch ! s e . Co0ev e r, it is re!li:e d th!t vend or s 2 !; !nno n c e ne0 -rod ct s !nd disclos e benc h 2 ! r 8 res lt s be6or e the -rod ct s h!v e !ct !ll; shi-- e d . This is !llo0e d, b t !n; se o6 one* o6* !* 8ind h!rd0 ! r e / s o6t 0 ! r e con6i1 r ! ti o n s , 0hich the ven d or doe s not inten d to shi- in the 6 t re is s-eci6ic!ll; e+cl d e d . $ll -rod ct s 2 st be 1en e r !ll; !nno n c e d !nd order ! bl e in the co ntr; 0her e the S%T is -rice d. ,.1.( ,.1.5 The test s-on s or 's) 2 st disclos e !ll -ricin1 so rc e s !nd e66ective d!t e' s) o6 the -rices. The s-on s or is re9 ir e d to st!t e e+-licitl; !ll the ite2 s !nd servic e s 0hich !re not directl; !v!il!bl e thro 1 h the s-on s or. A!ch s --lierLs ite2 s !nd -rices, incl din1 disco n t s, 2 st be listed se- ! r ! t el ;. 7isco nt s 2 !; not be de- e n d e n t on - rch ! s e s 6ro2 !n; oth er s --liers. Non, Sp o n s o r Pricin g <n the eve n t th!t !n; h!rd0 ! r e , so6t0!r e, or 2!int e n ! n c e is -rovid e d b; ! vend or 0ho is not ! s-on s o r o6 the benc h 2 ! r 8, the -ricin1 2 st s!tis6; !ll re9 ir e 2 e n t s 6or 1en e r !l !v!il! bilit;, st! n d ! r d vol 2 e disco n t s , !nd 6 ll disclos r e. F rth er 2 o r e , !n; -ricin1 0hich is not directl; o66ere d b; the test s-on s or' s) !nd not derive d 6ro2 the non* s-on s o rin 1 ven dor Hs 1en e r !ll; !v!il!bl e -ricin1 !nd disco n t s 2 st be 1 !r ! n t e e d b; the ven d or in ! 0ritt e n -rice 9 ot ! tio n 6or ! -eriod not less th!n 60 d!;s 6ro2 the d!t e the res lt s !re s b 2i tt e d . This 0ritt en 9 ot ! ti o n 2 st be incl d e d in the F ll 7isclos r e ?e-ort !nd st!t e th!t the 9 ot e d -rice s !re 1en e r !ll; !v!il! bl e, the ti2 e -eriod 6or 0hich the -rice s !re v!lid, the b!sis o6 !ll disco n t s , !nd !n; ter 2 s !nd condition s 0hich 2 !; !--l; to the 9 ot e d -rices. The test s-on s or 2 st still co2 -l; 0ith -rice ch! n 1 e s !s describ e d in #l! s e 8. For ite2 s -rovid e d b; ! ven d or 0ho is not ! s-on s or o6 the benc h 2 ! r 8, !nd 6or 0hich the !11r e 1 ! t e d -rice is less th!n 1P o6 the tot!l -rice, the re9 ir e 2 e n t 6or ! 0ritt en -rice 9 ot ! tio n 6ro2 the vend or c!n be re-l !c e d b; incl din 1 in the F7? ! co-; o6 the so rc e doc 2 e n t 6ro2 0hich the -rice 0!s obt !i n e d 'e.1., -rint e d !dv e rti s e 2 e n t or on* line c!t !lo 1 e -!1 e ). &ricin1 sho0n in the F ll 7isclos r e so6t0!r e, !nd 2!int e n ! n c e 6ro2 the one -ricin1 0ith det !ils -rovidin1 the or !--lie d to over !ll doll!r v!l e 6ro2 ?e-ort 2 st re6lect line ite2 -ricin1 6or h!rd0 ! r e , vend or Hs -rice boo8s. @ine ite2 s 2 st re6lect 9 ! n tit ; b!sis o6 !n; disco n t s , 0het h e r !--lied to the line ite2 ! vend or, disclos e d se- !r ! t el ;.
=' & ' ; ,.1.6.1
,.1.6.2
,.1.,
Com m e n t . The inte nt o6 this cl! s e is th!t the -ricin1 re6lect the level o6 det !il th!t !n !ct !l c sto 2 e r 0o ld see on !n ite2i: e d billin1. The -ricin1 e+cl d e s do2 e s ti c t!+ e s !nd shi--in 1 ch!r1 e s th!t 0o ld be inc rr e d in the co nt r; 6or 0hich the res lts !re - blish e d . <t is not inten d e d to e+cl d e t!ri66s, c sto 2 d ti es/6e e s , !nd shi--in 1 to ! do2 e s ti c -ort o6 entr; i6 the co2 - o n e n t ori1in !t e s in !not h e r co nt r;.
T&# Bench2!r8I W
&!1e c+++iv
,.1.8
For - blishin 1 in !not h e r co ntr; oth er th! n the co ntr; 6or 0hich the res lt s !re ori1in !ll; - blish e d , it is -er 2itt e d to s bstit t e loc!l co2 - o n e n t s 6ro2 the ori1in !l re-ort -rovidin 1 the s bstit t e d -rod c t s !re sold to the s! 2 e -rod c t descri-tion or s-eci6ic!tio n s. Com m e n t . The inte nt o6 this cl! s e is to enco r ! 1 e loc!l co ntr ; -ricin1 b; !llo0in1 s bstit tio n o6 e9 i - 2 e n t 6or co ntr ; s-eci6ic re!s o n s s ch !s volt!1 e , -rod ct n 2 b e ri n 1, ind st ri !l/s !6 e t ;, 8e;bo ! r d di66ere n c e s , etc., 0hich do not !66ect -er6or 2 ! n c e .
= ' 4 Pri c e # S * s t e m
=' 4 ' & S9T The entire -rice o6 the S%T !s con6i1 r e d d rin1 the test 2 st be se d, incl din1 !ll h!rd0 ! r e 'ne0 - rch ! s e -rice), so6t0!r e 'licen s e ch!r 1 e s ) !nd h!rd0 ! r e / s o6t 0 ! r e 2!int e n ! n c e ch!r1 e s over ! -eriod o6 5 ;e!r s '56 2ont h s). <n the c!s e 0her e the 7river S;st e 2 -rovid e s 6 nction !lit; in !ddition to the ?BA describ e d in #l! s e 6, then the -rice o6 the e2 l ! t e d h!rd0 ! r e / s o6t 0 ! r e describ e d in #l! s e ,.2.2.1 !re to be incl d e d. Com m e n t & . The intent is to -rice the test e d s;st e 2 !t the 6 ll -rice ! c sto 2 e r 0o ld -!;. S-eci6ic!ll; -rohibit e d !re the !ss 2 - t i o n o6 oth er - rch ! s e s , oth er sites 0ith si2il!r s;st e 2 s , or !n; other !ss 2 - t i o n 0hich relies on the -rinci-l e th!t the c sto 2 e r h!s 2! d e !n; other - rch ! s e 6ro2 the vend or. This is ! one ti2 e, st! n d* !lon e - rch ! s e . Com m e n t 4 . The n 2 b e r o6 sers 6or T&#*W is de6ine d to be e9 !l to the n 2 b e r o6 bro0s e r s e2 l ! t e d in the test e d con6i1 r ! ti o n. $n; s! 1 e -ricin1 6or the !bov e n 2 b e r o6 ser s sho ld be b!s e d on the -ricin1 -olic; o6 the co2 - ! n ; s - -l;in 1 the -rice d co2 - o n e n t . =' 4 ' 4 ,.2.2.1 Bro " s e r s an # Net " o r ! Pricin g The -rice o6 the ?e2ot e Bro0s er A2 l !t or '?BA) !nd the -rice o6 the &!;2 e n t B!t e0 ! ; A2 l!t or '&BA) !re not incl d e d in the -ricin1 c!lc l !tio n. &le!s e re6er to #l! s e ,.2.1 6or ! descri-tion o6 the co2 - o n e n t s o6 the S%T, !ll o6 0hich 2 st be -riced. )at a b a s e Stor a g e an # Rec o - e r * %og Prici n g Within the -riced s;st e 2 , ther e 2 st be s 66icient on* line stor! 1 e to s -- ort !n; e+- ! n di n 1 s;st e 2 6iles !nd the d r! bl e d!t ! b ! s e -o- l !tio n res ltin1 6ro2 e+ ec ti n 1 the T&#*W tr!n s ! c ti o n 2i+ 6or 180 ei1ht ho r d!;s !t the re-ort e d W<&S 'see #l! s e (.(), !llo0in1 6or ! 2ini2 2 o6 1( d!;s o6 nint err - t e d -roc e s si n 1. Stor! 1 e is consid e r e d on* line, i6 !n; record c!n be !cce s s e d r!nd o 2 l ; !nd -d ! t e d 0ithin 1 seco n d . =n* line stor! 1 e 2 !; incl d e 2 ! 1 n e t i c dis8s, o-tic!l dis8s, or !n; co2 bi n ! ti o n o6 thes e , -rovid e d th!t the !bov e 2 e ntion e d !cc e s s criteri! is 2 et. Com m e n t & . The inte nt o6 this cl! s e is to consid er !s on* line !n; stor! 1 e device c!- ! bl e o6 -rovidin1 !n !cc e s s ti2 e to d!t !, 6or r!nd o 2 re! d or -d ! t e , o6 one seco n d or less, eve n i6 this !cc e s s ti2 e re9 ir e s the cre !tio n o6 ! lo1ic!l !cc e s s -!t h not -res e n t in the test e d d!t ! b ! s e . For e+ ! 2 -l e , ! dis8 b!s e d se9 e n t i !l 6ile 2i1ht re9 ire the cre! tio n o6 !n inde+ to s!tis6; the !cc e s s ti2 e re9 ire 2 e n t .
=' 4 ' 6 ,.2.5.1
T&# Bench2!r8I W
&!1e c+++v
,.2.5.2
<t is -er 2i s si bl e to not h!v e the stor! 1 e re9 ir e d 6or the 180* d!; s-!c e on the test e d s;st e 2 . Co0ev er, !n; !ddition !l stor! 1 e devic e incl d e d in the -rice d s;st e 2 b t not con6i1 r e d on the test e d s;st e 2 2 st be o6 the t;- e' s) !ct !ll; se d d rin1 the test !nd 2 st s!tis6; nor2 !l s;st e 2 con6i1 r ! ti o n r les. Com m e n t . Stor! 1 e devic e s !re consid er e d to be o6 the s! 2 e t;-e i6 the; !re identic !l in !ll !s- e c t s o6 their -rod ct descri-tion !nd tech nic !l s-eci6ic!tion s.
=' 4 ' 8 ,.2.(.1
A##i ti o n a
.p er a ti o n a
Comp o n e n t s
$ddition !l -rod ct s th!t 2i1ht be incl d e d on ! c st o 2 e r inst !lle d con6i1 r ! tio n, s ch !s o-er ! t o r consol e s !nd 2! 1 n e t i c t!- e drives, !re !lso to be incl d e d in the -rice d s;st e 2 i6 e+-licitl; re9 ire d 6or the o-er ! tio n, !d 2i nistr ! tio n, or 2!int e n ! n c e , o6 the -rice d s;st e 2 . #o-ies o6 the so6t0!r e, on !--ro - ri ! t e 2 e di !, !nd ! so6t0!r e lo!d devic e, i6 re9 ire d 6or initi!l lo!d or 2 !int e n ! n c e -d ! t e s , 2 st be incl d e d . The -rice o6 !n %nint err - ti bl e &o0er S --l;, s-eci6ic!ll; contrib ti n 1 to ! d r! bilit; sol tion, 2 st be incl d e d 'se e #l! s e 5.1.5). The -rice o6 !ll c!bl e s A##i ti o n a Sof t " a r e se d to conn e c t co2 - o n e n t s o6 the s;st e 2 2 st be incl d e d .
,.2.(.2
,.2.(.5
,.2.(.( =' 4 ' : ,.2.5.1
The -rice d s;st e 2 2 st incl d e the so6t0!r e licens e s nec e s s ! r ; to cre! t e , co2 -il e, lin8, !nd e+ec t e this benc h 2 ! r 8 !--lic!tion !s 0ell !s !ll r n* ti2 e licens e s re9 ir e d to e+ ec t e on the S%T. <n the eve n t th!t the !--lic!tio n -ro1r ! 2 is dev el o - e d on ! s;st e 2 other th! n the S%T, the -rice o6 th!t s;st e 2 !nd !n; co2 -il ers !nd oth er so6t0!r e se d 2 st !lso be incl d e d !s -!rt o6 the -riced s;st e 2 . <n the eve n t th!t ! se- ! r ! t e te+t se!rc h en1i n e is se d in the S%T, the -riced s;st e 2 2 st !lso incl d e !n; !--lic! bl e h!rd0 ! r e !nd so6t0!r e costs !nd licensi n 1 6ees.
,.2.5.2
,.2.5.5
= ' 6 M ai n t e n a n c e
,.5.1.1 C!rd0 !r e !nd so6t0!r e 2!int e n ! n c e 2 st be 6i1 re d !t ! st!n d ! r d -ricin1 0hich cover s !t le!st , d!;s/ 0 e e 8, 2( ho rs/ d ! ; cover ! 1 e , eith er on* site, or i6 !v!il!bl e !s st! n d ! r d o66erin1, vi! ! centr !l s - - ort 6!cilit;. C!rd0 !r e 2 !int e n ! n c e 2 !+i 2 2 res- o n s e ti2 e 2 st not e+ce e d ( ho rs, on !n; -!rt 0hos e re-l !c e 2 e n t is nec e s s ! r ; 6or the res 2 - ti o n o6 o-er ! ti o n. The (* ho r 2!int e n ! n c e res- o n s e ti2 e re9 ire 2 e n t 2 !; be 2et b; c st o 2 e r s-!r e ! b l e !nd re-l!c e ! bl e h!rd0 ! r e , !s describ e d in #l! s e ,.5.(. Com m e n t & . ?es 2 - t i o n o6 o-er ! tio n 2e ! n s the -riced s;st e 2 2 st be ret rn e d to the s! 2 e con6i1 r ! ti o n th!t 0!s -res e n t be6or e the 6!il re.
T&# Bench2!r8I W
&!1e c+++vi
Com m e n t 4 . The inte nt o6 h!rd0 ! r e 2!int e n ! n c e -ricin1 is not 2et b; -ricin1 b!s e d on the cost to 6i+ s-eci6ic 6!il re s, eve n i6 the 6!il re r!t e is c!lc l !t e d 6ro2 Me!n Ti2e Bet0e e n F!il re 'MTBF). The 2!int e n ! n c e -ricin1 2 st be inde - e n d e n t o6 !ct !l 6!il re r!t e s over the 5 ;e!r -eriod, no 2 !t t e r ho0 2 ! n ; 6!il re s occ r d rin1 th!t -eriod. The inten t is to -recl d e the se o6 MTBF to directl; co2 - t e the 2 !int e n ! n c e cost 6or this benc h 2 ! r 8 . ,.5.2 <6 centr !l s - - ort is cl!i2 e d , then the !--ro -ri !t e conn e c tio n device, s ch !s ! to* di!l 2od e 2 2 st be incl d e d in the h!rd0 ! r e -rice. $lso !n; so6t0!r e re9 ire d to r n the conn e c ti o n to the centr !l s - - ort, !s 0ell !s !n; di!1n o s tic so6t0!r e 0hich the centr !l s -- ort 6!cilit; re9 ire s to be resid e n t on the test e d s;st e 2 , 2 st not onl; be incl d e d in -ricin1, b t 2 st !lso be inst !lle d d rin1 the benc h 2 ! r 8 r ns. So6t0!r e 2 !int e n ! n c e 2 st incl d e 2!int e n ! n c e -d ! t e distrib tion 6or bot h the so6t0!r e !nd its doc 2 e n t ! t i o n. <6 so6t0!r e 2!int e n ! n c e -d ! t e s !re se- ! r ! t e l ; -riced, the n -ricin1 2 st incl d e !t le!st 2 -d ! t e s over the 5 ;e!r -eriod. Com m e n t . So6t0!r e 2 !int e n ! n c e , !s de6ine d !bov e, 2 e ! n s ! st!n d ! r d o66erin1 0hich incl d e s !c8no0l e d 1 2 e n t o6 ne0 !nd e+istin1 -robl e 2 s 0ithin ( ho rs !nd ! co2 2i t 2 e n t to 6i+ de6ect s 0ithin ! re!s o n ! bl e ti2 e. ,.5.( <t is !cc e - t ! b l e to incor-or ! t e , 6or -ricin1 - r-o s e s , the re-l!c e ! bl e h!rd0 ! r e ite2 s nd e r the 6ollo0in1 conditions. $n !ddition !l 10P o6 the n 2 b e r o6 con6i1 r e d 2ini2 2 o6 2, 2 st be -riced 6or s-!r e s. se o6 c sto 2 e r s-!r e ! b l e !nd
,.5.5
nits o6 the re-l!c e ! bl e ite2 s, 0ith !
The vend or 2 st incl d e ! s -- ort service 0hich 1 !r ! n ti e s re-l e nis h 2 e n t on* site 0ithin , d!;s thro 1 h o t the 5 ;e!r 2!int e n ! n c e -eriod !nd covers ever; nit o6 the re-l!c e ! bl e ite2 s 'i.e., con6i1 r e d nits !nd s-!r e nits). The ite2 s 2 st be 1en e r !ll; !v!il! bl e !s s-!r e ! bl e !nd re-l!c e ! bl e 6or !n; c st o 2 e r inst !ll!tion. The desi1n ! t i o n o6 the ite2 s !s s-!r e ! bl e !nd re-l!c e ! bl e c!n n o t de- e n d on ! thres h ol d o6 - rch ! s e d 9 ! n tit ;. <t 2 st be veri6i!bl e th!t the !ction o6 di!1n o si n 1 the s-!r e ! bl e !nd re-l!c e ! bl e ite2 s !s h!vin 1 6!iled c!n be -ositivel; !cco 2 -lish e d b; the c sto 2 e r 0ithin ( ho rs o6 6!il re. The 2 et h o d 6or di!1n o si s !nd re-l !c e 2 e n t o6 the re-l!c e ! bl e ite2 s 2 st h!v e co2 -l et e c st o 2 e r doc 2 e n t ! t i o n.
Com m e n t &A 7i!1no si s 2 !; t!8e the 6or2 o6 ! h!rd0 ! r e indic!t or or ! di!1n o si s -roc e d r e . The inten t is th!t the di!1n o si s 2 st re!c h ! -ositive concl sio n !s to the st!t e o6 the ite2 0ithin ( ho rs. Com m e n t 4A The se o6 s-!r e s is inten d e d to !ssist in co2 -l ;in 1 0ith the (* ho r 2!+i 2 2 h!rd0 ! r e 2 !int e n ! n c e res- o n s e re9 ir e 2 e n t . <t c!nn o t be ! s bstit t e 6or 2 !int e n ! n c e s -- ort, !s the -rice d con6i1 r ! tio n 2 st 2 !int !i n the s! 2 e 9 ! n titi e s o6 co2 - o n e n t s , incl din 1 s-!r e s , 6or 5 ;e!r s.
T&# Bench2!r8I W
&!1ec+++vii
= ' 8 R e B u ir e # R e p o r ti n g
,.(.1 T0o 2 etrics 0ill be re-ort e d 0ith re1! r d to -ricin1. The 6irst is the tot!l 5 ;e!r -ricin1 !s describ e d in the -revio s cl! s e s . The seco n d is the tot!l 5 ;e!r -ricin1 divide d b; the re-ort e d Web <nter ! c tio n s &er Seco n d 'W<&S), !s de6ine d in #l! s e 5.(. The 5* ;e !r -ricin1 2etric 2 st be 6 ll; re-ort e d in the b!sic 2on e t ! r ; nit o6 c rre n c ; 'see #l! s e ,.1.5) ro nd e d - !nd the -rice/ - e r6or 2 ! n c e 2 et ric 2 st be to ! 2ini 2 2 -recision o6 thre e si1ni6ic!n t di1its ro nd e d -. Neither 2etric inter- ol !t e d or e+tr! - ol ! t e d . For e+! 2 -l e, i6 the tot !l -rice is %SM 5,,5(, ( 1 , . 8 9 re-ort e d thro 1 h - t is 105 W<&S, the n the 5 ;e !r -ricin1 is %SM 5,,5(, ( 1 8 -rice/ - e r6or 2 ! n c e is %SM 5(,,0 0/W<&S '5,,5 (, ( 1 8 / 1 0 5 ). the loc!l re-ort e d 2! ; be !nd the !nd the
,.(.2
T&# Bench2!r8I W
&!1e c+++viii
C a u s e ( , 59%% )2 SC%.S 9RE REP.RT
( ' & 1 e n e r a R e B u ir e m e n t s
8.1.1 $ F ll 7isclos r e re-ort is re9 ir e d in order 6or res lts to be consid e r e d co2 -li !n t 0ith the T&#* W benc h 2 ! r 8 s-eci6ic!tion. Com m e n t . The inte nt o6 this disclos r e is 6or ! c sto 2 e r to be !bl e to re-lic!t e the res lts o6 this benc h 2 ! r 8 1iven the !--ro - ri ! t e doc 2 e n t ! t i o n !nd -rod ct s. This section incl d e s ! list o6 re9 ire 2 e n t s 6or the F ll 7isclos r e re-ort. 8.1.2 The order !nd titles o6 section s in the Test S-on s orLs F ll 7isclos r e re-ort 2 st corres - o n d 0ith the order !nd titles o6 section s 6ro2 the T&#*W st! n d ! r d s-eci6ic!tion 'i.e., this doc 2 e n t ). The intent is to 2 !8 e it !s e! s ; !s -ossibl e 6or re!d e r s to co2 - ! r e !nd contr ! s t 2 !t e ri !l in di66ere n t F ll 7isclos r e re-ort s. $ll section s o6 the re-ort, e+c e - t the !-- e n di c e s , 2 st be -rint e d sin1 ! 2ini2 2 6ont si:e o6 10 -oint s. The !-- e n di c e s 2 st be -rint e d sin1 ! 2ini2 2 6ont si:e o6 8 -oints. The T&# A+ec tiv e S 2 2 ! r ; St!t e 2 e n t 2 st be incl d e d !s the 6irst -!1 e s o6 the F ll 7isclos r e re-ort. $n e+! 2 -l e o6 the A+ec tiv e S 2 2 ! r ; St!t e 2 e n t is -res e n t e d in $--e n di+ B. The l!te st version o6 the re9 ir e d 6or2 ! t is !v!il! bl e 6ro2 the T&# $d2inistr ! t or. $ st!t e 2 e n t identi6;in1 the benc h 2 ! r 8 s-on s or' s) !nd other -!rtici- !ti n 1 co2 - ! ni e s 2 st be -rovid e d . The n 2 e ri c !l 9 ! n titi e s listed belo0 2 st be incl d e d in the A+ec tiv e S 2 2 ! r ; det !ilin1 the 6ollo0in1 9 ! n titie s <n t!b l !r 6or2 the 6ollo0in1 in6or2 ! tio n 6or the W<&S Me!s r e 2 e n t <nterv !l. The <nter ! ction 90P res-o n s e ti2 e $ver! 1 e thin8 ti2 e <nter ! ctio n co nt Mi+ -erc e n t ! 1 e <n t!b l !r 6or2 6or e!c h o6 the re-ort e d W<&S, W<&Sb !nd W<&So Me!s r e 2 e n t <nterv !l s. The ?!2 -* - ti2 e in 2in t e s The len1t h o6 the Me!s r e 2 e n t <nterv !l in 2in t e s The !ver ! 1 e %ser Session 7 r!tion
8.1.5
8.1.(
8.1.5
Com m e n t . $--en di+ B cont !i n s !n e+! 2 -l e o6 s ch ! s 2 2 ! r ;. The inten t is 6or d!t ! to be conv e ni e n tl ; !nd e!sil; !cc e s si bl e in ! 6!2ili!r !rr! n 1 e 2 e n t !nd st;le. <t is not re9 ir e d to -recis el ; 2i2ic the l!;o t sho0n in $--en di+ B.
T&# Bench2!r8I W
&!1e c+++i+
8.1.6
The so rc e cod e o6 the !--lic!tio n -ro1r ! 2 or -ro1r ! 2 s !s de6ine d in #l! s e 1.2.1 0, !s 0ell !s !ll in- t 6or -rod c t 1en e r ! t e d cod e, 2 st be disclos e d . Settin1s 2 st be -rovid e d 6or !ll c st o 2 e r* t n ! bl e -!r ! 2 e t e r s !nd o-tion s 0hich h!v e bee n ch! n 1 e d 6ro2 the de6! lt s 6o nd in !ct !l -rod ct s, incl din1 b t not li2ite d to. 7!t! b ! s e t nin 1 -!r ! 2 e t e r s . Web serv er t nin 1 !nd lo11in 1 o-tion s. ?ecov e r ;/ c o 2 2 i t o-tion s. #onsist e n c ;/l oc8in 1 o-tion s. =-er !ti n 1 s;st e 2 !nd !--lic!tio n con6i1 r ! ti o n -!r ! 2 e t e r s . #o2-il!tion !nd lin8!1 e o-tion s !nd r n* ti2 e o-ti 2i: !tio n s se d to cre !t e /i n s t !ll/r n !--lic!tion s, =S, 7BMS, 0eb serv er, !nd/or !n; other co2 2 e r ci !l -rod c t.
8.1.,
Com m e n t & . This re9 ir e 2 e n t c!n be s!tis6ied b; -rovidin1 ! 6 ll list o6 !ll -!r ! 2 e t e r s , o-tions, !nd 6l!1s. Com m e n t 4 . The inten t o6 the !bov e cl! s e is th!t !n;o n e !tt e 2 - t i n 1 to recre ! t e the benc h 2 ! r 8 environ 2 e n t h!s s 66icient in6or2 ! ti o n to co2 -ile, lin8, o-ti2i: e, !nd e+ ec t e !ll so6t0!r e se d to -rod c e the disclos e d benc h 2 ! r 8 res lt. 8.1.8 7i!1r! 2 s o6 bot h 2e ! s r e d !nd -riced con6i1 r ! ti o n s 2 st be -rovid e d , !cco 2 - ! n i e d b; ! descri-tion o6 the di66ere n c e s . This incl d e s, b t is not li2ite d to. N 2 b e r !nd t;-e o6 -roc e s s o r s. &h;sic!l 2 e 2 o r ; !ct !ll; -res e n t on the S%T. Si:e o6 !lloc!t e d 2e 2 o r ;, !nd !n; s-eci6ic 2 ! - -i n 1/ - ! r titioni n 1 o6 2 e 2 o r ; the test. N 2 b e r !nd t;-e o6 dis8 nits !nd controllers. nits, incl din1 their -rotoc ol t;- e. ni9 e to
N 2 b e r o6 ch!n n el s or b s conn e c tio n s to dis8
N 2 b e r o6 @$N 'e.1., Ather n e t ) conn e c tio n s, incl din1 ro t er s, 0or8st ! tio n s, ter2i n !l s, etc., th!t 0ere -h;sic !ll; se d in the test or !re incor-or ! t e d into the -ricin1 str ct r e . T;-e !nd the r n* ti2 e e+ ec ti o n loc!tion o6 so6t0!r e co2 - o n e n t s 'e.1., 7BMS, 0eb serv er, !--lic!tio n serv er or -ro1r ! 2 , tr!n s ! c ti o n 2onitors, etc.) N 2 b e r !nd t;-e o6 cr;-t o 1r ! - h i c -roc e s s o r s or cr;-t o 1r ! - hi c !ccel er ! t o r s, i6 !--lic! bl e.
Com m e n t . 7et!iled di!1r ! 2 s 6or s;st e 2 con6i1 r ! ti o n s !nd !rchit e c t r e s c!n 0idel; v!r;, !nd it is i2-os si bl e to -rovid e e+!ct 1 id elin e s s it ! bl e 6or !ll i2-le 2 e n t ! t i o n s. The intent here is to describ e the s;st e 2 co2 - o n e n t s !nd conn e c tio n s in s 66icient det !il to !llo0 inde - e n d e n t recon s t r c tio n o6 the 2e ! s r e 2 e n t environ 2 e n t .
T&# Bench2!r8I W
&!1e
c+l
( ' 4 E3 e c u t i - e S u m m a r *
The A+ec tive S 2 2 ! r ; is 2 e ! n t to be ! hi1h level overvi e0 o6 ! T&#*W i2-le 2 e n t ! t i o n. <t sho ld -rovid e the s!lient ch!r ! c t e ri stics o6 ! benc h 2 ! r 8 e+ ec tio n '2etrics, con6i1 r ! ti o n, -ricin1, etc.) 0itho t the e+h ! s ti v e det !il 6o nd in the F7?. The A+ec tiv e S 2 2 ! r ; h!s thre e co2 - o n e n t s . (' 4 ' & =vervie0 &!1e &ricin1 &!1e N 2 eric !l D !n titie s S 2 2 ! r ; &!1e
Pa g e %a*o u t A!ch co2 - o n e n t o6 the A+ec tiv e S 2 2 ! r ; sho l d !-- e ! r on ! -!1 e b; itsel6. A!ch -!1 e sho ld se ! st! n d ! r d he! d e r !nd 6or2 ! t , incl din1. 1/2 inch 2 !r 1i n s, to- !nd bott o 2 G 5/( inch le6t 2 !r 1i n, 1/2 inch ri1ht 2!r 1i nG !t le!st 2 -t. 6r!2 e !ro n d the bod; o6 the -!1 e. $ll interior lines sho l d be 1 -t e+ce - t 6or the hori:ont !l line th!t -rec e d e s the so6t0!r e descri-tion s 'be6or e Web Server) 0hich is 5 -t.G S-ons or identi6ic!tio n !nd S;st e 2 ' s) n! 2 e ' s), e!c h set !-!rt b; ! 1 -t. r le, in 16* 20 -t. bold Ti2es 6ontG Bench 2 ! r 8 n! 2 e 'i.e., T&#*W), revision sin1 thre e tier versionin 1 'e.1., 1.2.5) !nd re-ort d!t e, se- !r ! t e d 6ro2 other he! d e r ite2 s !nd e!c h oth er b; ! 1 -t. ? le, in 9* 12 -t. bold Ti2es 6ontG The t0o -ri2 !r ; 2etrics. The &rice &er6or 2 ! n c e in 12* 1( -t. bold Ti2es 6ont. The &er6or2 ! n c e in 12* 1( -t. bold Ti2es 6ont.
The $v!il!bilit; d!t e in 10* 12 -t bold. Ti2es 6ont.
Com m e n t &A <t is -er 2i s si bl e to
se or incl d e co2 - ! n ; lo1os 0hen identi6;in1 the s-on s or.
Com m e n t 4A The re-ort d!t e !nd !v!il! bilit; d!t e 2 st be disclos e d 0ith ! -recision o6 1 d!;. The -recis e 6or2 ! t is le6t to the test s-on s o r. (' 4 ' 4 .-er-i e " Pa g e $--en di+ B cont !i n s ! s! 2 -l e A+ec tive S 2 2 ! r ;. The s! 2 -l e s-eci6ies the 2 ! n d ! t o r ; 6or2 ! t !nd l!;o t o6 the overvie0 -!1 e. The s! 2 -l e 6or the -ricin1 -!1 e !nd n 2 e ri c !l 9 ! n titie s s 2 2 ! r ; -!1 e !re incl d e d to hel- cl!ri6; the re9 ir e 2 e n t s in #l! s e 8.2 !nd !re -rovid e d solel; !s e+ ! 2 -l e s . The overvie0 -!1 e cont !i n s ( set s o6 d!t !, e!c h l!id o t !cros s the -!1 e !s ! se9 e n c e o6 bo+ e s sin1 1 -t. r le, 0ith ! title !bov e the re9 ir e d 9 ! n tit ;. Both titles !nd 9 ! n titi es sho ld se ! 9* 12 -t. Ti2es 6ont nles s oth er0is e not e d.
T&# Bench2!r8I W
&!1e
c+li
8.2.2.1
The 6irst section cont !i n s the 6ollo0in1 2 et rics th!t 0ere obt !in e d 6ro2 the re-ort e d Test ? ns in 10* 12 -t Ti2e 6ont.
Tit e (in bo # ) Tot!l S;st e 2 #ost W<&So3Sc!l eF ! c t or W<&Sb3Sc !l eF ! c t o r Sc!le F!ctor N 2 b e r o6 %sers 6or W<&S N 2 b e r o6 S;st e 2 s
Kua n ti t * 5* ;e !r cost o6 o0n er s hi W<&So W<&Sb N 2 b e r o6 <te2 s N 2 b e r o6 %sers N 2 b e r o6 S;st e 2 s
Pre ci s i on 1 0.1 0.1 1 1 1
9nit s M1 W<&S W<&S <te2 s %sers S;st e 2 s
&
&ricin1 sho l d be re-ort e d in the c rre n c ; o6 the co nt r; 0her e the s;st e 2 is -riced.
8.2.2.2
The seco n d section det !ils the s;st e 2 con6i1 r ! ti o n in 10* 12 -t Ti2e 6ont.
Pri m ar * 5un c ti o n (in bo # ) Web Serv er $--lic!tion Serv er 7!t! b ! s e M!n! 1 e r @o!d B!l!nc e r Web #!ch e <2!1 e So6t0!r e =ther So6t0!r e
)e s c ri p ti o n Br!nd, So6t0!r e Version o6 Web Server Br!nd, So6t0!r e Version o6 $--lic!tion Serv er or fc sto 2L i6 not ! co2 2 e r ci !l -rod c t Br!nd !nd version o6 7BMS se d Br!nd, So6t0!r e Version o6 @o!d b!l! n c e r 'i6 !--lic! bl e) Br!nd, So6t0!r e Version o6 Web #!ch e Br!nd, So6t0!r e Version o6 <2!1 e Serv er Br!nd, So6t0!r e Version o6 other so6t0!r e co2 - o n e n t s
8.2.2.5 8.2.2.(
The third section cont !i n s ! con6i1 r ! tio n di!1r ! 2 o6 the -riced s;st e 2 . The 6o rt h !nd 6in!l section o6 the <2-le 2 e n t ! t i o n =vervie0 cont !i n s ! s;no - si s o6 the S%THs 2 !Eor s;st e 2 co2 - o n e n t s , incl din1 6or e!c h s;st e 2 in the con6i1 r ! ti o n. T&# Bench2!r8I W St!nd!rd S-eci6ic!tion Version &'( &!1e c+lii
(' 4 ' 6
S;st e 2L s -ri2 !r ; 6 nction !s describ e d in 8.2.2.2 'e.1. 7!t! b ! s e Server, Web Server, etc.)G S;st e 2 br! n d n! 2 e !nd t;-e '2od el) N 2 b e r o6 nod e sG =-er !ti n 1 s;st e 2 G &roce s s o r t;-e, co nt !nd s-e e d in MC:G M!in !nd c!ch e 2 e 2 o r ; si:esG
Pricin g Pa g e The -ricin1 s-re ! d s h e e t re9 ire d b; Section , 2 st be re-rod c e d in its entiret ; on the &ricin1 &!1e. <t 2 st incl d e ! section 6or e!c h tier or s;st e 2 th!t -er6or 2 s ! di66ere n t 6 nction. A!ch section 2 st incl d e the h!rd0 ! r e !nd so6t0!r e 6or th!t 6 nction. ?e6er to $--en di+ B 6or ! s! 2 -l e -ricin1 s-re ! d s h e e t .
(' 4 ' 8
Nu m e r i c a
Kua n t i ti e s Su m m a r * Pa g e
The N 2 eric !l D !ntitie s S 2 2 ! r ; &!1e cont !i n s thre e section s se d to s 2 2 ! ri : e 9 ! n titie s in ! concis e 2! n n e r . <t is not inten d e d to be !n e+h ! s t iv e collection o6 !ll re-ort e d n 2 b e r s , b t r!th e r ! hi1h level overvi e0 o6 so2 e o6 the 2or e -ertin e n t re-ort e d 2etrics. 8.2.(.1 8.2.(.2 The 6irst section cont !i n s the W<&S <nter ! ctio n S 2 2 ! r ; !s describ e d in $--en di+ B. The seco n d section cont !i n s thre e set s o6 d!t !, -res e n t e d in t!b l !r 6or2, det !ilin1 e!c h Me!s r e 2 e n t <nterv !l, e!c h 0ith. ?!2 -* - ti2 e, in deci 2 !l 2in t e s 0ith ! -recision o6 1/10
th
o6 ! 2in t e.
th
@en1t h o6 Me!s r e 2 e n t <nterv !l, in deci 2 !l 2in t e s 0ith ! -recision o6 1/10 $ver! 1 e %ser Sessio n d r!tio n, in deci 2 !l 2in t e s 0ith ! -recision o6 1/10 $ver! 1 e Thin8 Ti2e, in deci 2 !l seco n d s 0ith ! -recision o6 1/10 N 2 b e r o6 %sers, in 0hole n 2 b e r s .
th th
o6 ! 2in t e .
o6 ! 2in t e.
o6 ! seco n d .
T&# Bench2!r8I W
&!1e c+liii
( ' 6 C a u s e & , W e b . bE e c t a n # %o gi c a ) a t a b a s e ) e s i g n
8.5.1 The loc!tion o6 the "&AB !nd B<F i2! 1 e s se d in the benc h 2 ! r 8 2 st be disclos e d . This in6or2 ! tio n 2 st incl d e on 0hich s;st e 2 !nd in 0h!t lo1ic!l str ct r e the i2! 1 e s !re stor e d 'd!t ! b ! s e or 6ile s;st e 2 ). @istin1s 2 st be -rovid e d 6or !ll t!bl e de6inition st!t e 2 e n t s !nd !ll other st!t e 2 e n t s set* - the d!t ! b ! s e . se d to
8.5.2
8.5.5
The -h;sic !l or1! ni: ! tio n o6 t!bl e s !nd indice s, 0ithin the d!t ! b ! s e , 2 st be disclos e d. When lo1ic!l dis8 !rr! ;s '6or e+! 2 -l e, ?$<7) !re se d, the 2! - -i n 1 o6 d!t ! b ! s e entities '6or e+! 2 -l e, t!bl es, vie0s) 2 st be s-eci6ied. $ddition !ll; the 2 ! - -i n 1 o6 lo1ic!l nits to -h;sic !l dis8s 2 st be disclos e d . Com m e n t . The conc e - t o6 -h;sic !l or1! ni: ! tion incl d e s, b t is not li2ite d to. record cl st erin 1 'i.e., ro0s 6ro2 di66ere n t lo1ic!l t!ble s !re co* loc!t e d on the s! 2 e -h;sic !l d!t ! -!1 e), inde+ cl st erin 1 'i.e., ro0s !nd le!6 nod e s o6 !n inde+ to the s e ro0s !re co* loc!t e d on the s! 2 e -h;sic !l d!t ! -!1 e), !nd -!rti !l 6ill*6!ctors 'i.e., -h;sic !l d!t ! -!1 e s !re le6t -!rti!ll; e2 -t ; eve n tho 1 h !ddition !l ro0s !re !v!il!bl e to 6ill the 2 ).
8.5.(
$n; hori:ont !l or vertic!l -!rtitionin 1 o6 t!ble s or ro0s in the T&#*W benc h 2 ! r 8 2 st be disclos e d 'see #l! s e 1.6.( !nd 1.6.5). ?e-lic!tion o6 t!bl e s, i6 se d, 2 st be disclos e d 'se e #l! s e 1.6.6). $ddition !l !nd/ or d -lic!t e d !ttrib t e s in !n; t!bl e 2 st be disclos e d !lon 1 0ith ! st!t e 2 e n t on the i2-! ct on -er6or 2 ! n c e 'se e #l! s e 1.6.,).
8.5.5
T&# Bench2!r8I W
&!1e c+liv
( ' 8 C a u s e 4 , W e b 2n t e r a c ti o n s a n # Wo r! o a #
8.(.1 8.(.2 8.(.5 The 2 et h o d o6 r!nd o 2 n 2 b e r 1en e r ! ti o n 2 st be disclos e d. The n 2 b e r o6 A2 l !t e d Bro0ser s se d in the 2e ! s r e d interv !l s 2 st be disclos e d. <nterv !l 0ith 8no0n
The -erc e n t ! 1 e o6 %ser ses sion s st!rt e d d rin1 e!c h Me!s r e 2 e n t # sto 2 e r s 2 st be disclos e d 0ith !t le!st 1 deci 2 !l -l!c e.
8.(.(
The i2-le 2 e n t ! t i o n o6 the #$?T d!t ! 2 st be e+-l !i n e d in s 66icient det !il to !llo0 ! re-lic!tion o6 the benc h 2 ! r 8 incl din 1 the d r! bilit; o6 the #$?T d!t ! over ! sin1l e -oint o6 6!il re. $ descri-tion o6 ho0 the sec rit ; re9 ir e 2 e n t s 0ere 2 et !s de6in e d in #l! s e 2.2.1, 2 st be disclos e d incl din1 8e; len1t h s . The CTM@ code 6or one re-re s e n t ! t i v e 0eb -!1 e 6or e!c h 0eb inter ! c tion 2 st be incl d e d in the F ll 7isclos r e ?e-ort. $ st!t e 2 e n t 2 st be -rovid e d describin 1 the dev elo - 2 e n t l!n1 ! 1 e ' s ) !nd the t;-e s o6 $&<Ls se d bet0 e e n co2 2 e r ci !l co2 - o n e n t s to i2-le 2 e n t the inter ! c tion s. This incl d e s, b t is not li2ited to, the inter6!c e s to the d!t ! b ! s e serv er, 0eb serv er, co2 2 e r c e -!c8 ! 1 e or !--lic!tion, or !n; oth er co2 2 e r ci !l -rod c t se d. For e+ ! 2 -l e . The co2 2 e r c e -!c8 ! 1 e c!lls !--lic!tion code thro 1 h st! n d ! r d #B< inter6!c e . The !--lic!tio n is 0ritt e n in # !nd inter6! c e s to the d!t ! b ! s e 0ith =7B# c!lls th!t initi!t e stor e d -roc e d r e s .
8.(.5
8.(.6
8.(.,
( ' : C a u s e 6 , ) a t a b a s e Tra n s a c t i o n a n # S * s t e m P r o p e r ti e s
8.5.1 The res lt s o6 the $#<7 test s 2 st be disclos e d !lon 1 0ith ! descri-tion o6 ho0 the $#<7 re9 ire 2 e n t s 0ere 2 et. The 2 et h o d 6or 2e e ti n 1 Web &!1e consist e n c ; re9 ir e 2 e n t s '#l! s e 5.2) 2 st be describ e d.
8.5.2
( ' ; C au s e 8 , S c a in g a n # ) a t a b a s e P o p u a tio n
8.6.1 The c!rdin !lit; 'e.1., n 2 b e r o6 ro0s) o6 e!c h t!bl e, !s initi!ll; -o- l !t e d 'se e #l! s e (.5 W (.(), 2 st be disclos e d . The s-!c e re9 ir e d to s st !i n 180 d!;s o6 the re-ort e d thro 1 h - t !s de6in e d in #l! s e (.( 2 st be disclos e d. The s-!c e re9 ir e d 6or 8 ho rs o6 Web* Server !cc e s s lo1s !s de6ine d in #l! s e (.5 2 st be disclos e d. The 2et h o d 6or distrib tin 1 t!bl e !nd lo1 d!t ! !cros s !ll 2 e di ! 2 st be describ e d . $ det !il e d di!1r ! 2 or listin1 o6 d!t ! b ! s e 6iles indic!ti n 1 the dis8s or vol 2 e s on 0hich the; resid e 2 st be incl d e d. Si2-l e di!1r ! 2 s c!n be se d 6or cl!ri6ic!tion.
8.6.2
8.6.5
8.6.(
T&# Bench2!r8I W
&!1e
c+lv
Com m e n t . 7et!iled di!1r ! 2 s 6or l!;o t o6 d!t ! b ! s e 6iles on dis8s c!n 0idel; v!r;, !nd it is di66ic lt to -rovid e e+ !ct 1 idelin e s it! bl e 6or !ll i2-le 2 e n t ! t i o n s . The intent is to -rovid e s 66icient det !il to !llo0 inde - e n d e n t recon s t r c tio n o6 the test d!t ! b ! s e !nd !cc e s s lo1s.
( ' = C a u s e : P e r f or m a n c e M e t ri c s a n # R e s p o n s e Ti m e s
8.,.1 The W<&S3sc!l e 6!ctor !nd -rice -er W<&S3sc !l e 6!ctor 2 st be disclos e d. W<&Sb3sc !l e 6!ctor !nd W<&So3sc !l e 6!ctor !re seco n d ! r ; 2 et rics !nd 2 st be incl d e d in the A+ec tiv e S 2 2 ! r ;. $ descri-tion o6 the 2et h o d se d to det e r 2 i n e the re-ro d ci bilit; o6 the 2 e ! s r e 2 e n t res lt s 2 st be re-ort e d !s 0ell !s the W<&S 6ro2 the re-rod ci bilit; r n. The d r!tio n, st!rt ti2 e !nd sto- ti2 e o6 e!c h Me!s r e 2 e n t <nterv !l 2 st be disclos e d . For Me!s r e 2 e n t <nterv !l s re-ort e d 6ro2 the s! 2 e r n, the ti2in1 -recision 2 st be s 66icientl; s2 !ll to de 2 o n s t r ! t e e!c h Me!s r e 2 e n t <nterv !l is non* overl ! - -i n 1. The -erc e n t ! 1 e o6 e!c h 0eb inter ! c ti on e+ ec t e d d rin1 e!c h 2e ! s r e d interv !l 2 st be dis-l !;e d in t!b l !r 6or2 !s in the 6ollo0in1 e+ ! 2 -l e . &erce n t ! 1 e s 2 st be re-ort e d to 2 deci 2 !l -oints.
8.,.2
8.,.5
8.,.(
T&# Bench2!r8I W
&!1e c+lvi
Web 2nt er a c t i o n
Bro " s i n g Mi3 (W2PS b ) >:' + + J 29.0 0 P 11.0 0 P 11.0 0 P 21.0 0 P 12.0 0 P 11.0 0 P :' + + J 2.00 P 0.82P 0.,5P 0.69P 0.50P 0.25 P 0.10P
S$ o p p i n g Mi3 (W2PS ) (+' + + J 16.0 0 P 5.00P 5.00 P 1,.0 0 P 20.0 0 P 1,.0 0 P 4+' + + J 11.6 0 P 5.00P 2.60P 1.20P 0.,5P 0.66P 0.10P
.%TP Mi3 (W2PS o ) :+ ' + + J 9.12 P 0.(6P 0.(6 P 12.5 5 P 1(.5 5 P 15.0 8 P :+ ' + + J 15.5 5 P 12.8 6 P 12., 5 P 10.1 8 P 0.25P 0.22P 0.12P
Bro" s e
Ho m e Ne " Pro# u c t Be s t S e er Pro# u c t )et a i Searc$ ReB u e s t S e a r c $ Re s u t s
.r# er
S$ o p p i n g Cart Cust o m e r Re g ' Bu* ReB u e s t Bu* Confir m .r# er 2nBuir* .r# er )is p a * A# mi n ReB u e s t
T&# Bench2!r8I W
&!1e c+lvii
A# mi n Confir m
0.09P
0.09P
0.11P
T&# Bench2!r8I W
&!1e c+lviii
8.,.5
The 2ini 2 2 , 2!+i 2 2 , !ver ! 1 e !nd 90 th -erc e n til e res- o n s e ti2 e 2 st be re-ort e d 6or e!c h 0eb inter ! c tio n, in t!b l !r 6or2 0ith ! col 2 n 6or e!c h o6 the Me!s r e 2 e n t <nterv !l s o6 W<&S, W<&So !nd W<&Sb. The 2ini2 2 , 2!+i 2 2 !nd !ver ! 1 e o6 !ll thin8 ti2 e s e+ec t e d d rin1 e!c h Me!s r e 2 e n t <nterv !l 2 st be re-ort e d . The n 2 b e r o6 chec8 - oi nt s in e!c h Me!s r e 2 e n t <nterv !l, the ti2 e in seco n d s 6ro2 the st!rt o6 the Me!s r e 2 e n t <nterv !l to the 6irst chec8 - oi n t !nd the #hec8- oi nt <nterv !l 2 st be disclos e d. The Web &!1e $sse 2 bl ; descri-tion !s s-eci6ied in cl! s e 8.8.5 2 st be incl d e d in the F ll 7isclos r e ?e-ort. The 2 e ! s r e d thro 1 h - t o6 e!c h 2e ! s r e d interv !l 2 st be 1r!- h e d !s describ e d in #l! s e 5.6.2 !nd the 1r!- h s be incl d e d in the F ll 7isclos r e ?e-ort.
8.,.6
8.,.,
8.,.8
8.,.9
8.,.10 $ set o6 -er6or 2 ! n c e st!tistics is re9 ir e d !nd 2 st be re-ort e d . #l! s e 5.,.1 !nd 5.,.2 de6ine ho0 the s e 2onitor e d 2etrics !re to be !11r e 1 ! t e d . 8.,.11 The 2onit orin1 tools se d d rin1 e!c h Me!s r e 2 e n t <nterv !l 2 st be describ e d !nd the o-er ! ti o n !l 2 et h o d s invo8e d 2 st be re-ort e d . For e+ ! 2 -l e , the 2onit or 0!s invo8e d !s ! st!rt e d t!s8, !nd bin!r; d!t ! 0!s record e d ever; 15 seco n d s to ! dis8 6or -ost* -roc e s si n 1. 8.,.12 <6 ! s! 2 -lin1 tech ni 9 e is se d to obt !i n -er6or 2 ! n c e d!t ! then the s! 2 -l e r!t e '-er seco n d) 2 st be re-ort e d !s s-eci6ied in #l! s e 5.,.1.6 8.,.15 The 2onitor e d 2 etrics !s de6ine d in #l! s e 5., 2 st be re-ort e d in ! t!bl e or t!bl e s si2il!r to the 6ollo0in1 e+ ! 2 -l e .
T&# Bench2!r8I W
&!1e
c+li+
Metric P #&% b s; &h;sic!l 2 e 2 o r ; Me2or; -ool dedic. o6 to sh!r e d 2e2or;
CTT& Server $11re 1 ! t e s
7B Server $11re 1 ! t e s
&!1e si:e 2!n! 1er
&!1e <n / &!1e = t S0!- <n / S0!- = t @o1ic!l ?A$7S -er seco n d &h;sic!l ?A$7S -er seco n d @o1ic!l W?<TAS -er seco n d &h;sic!l W?<TAS -er seco n d S;st e 2 </= r!t e Tot!l 7is8 </= r!t e $v1 device tili:!tion $v1 servic e ti2 e $v1 dis8 d!t ! tr!n s6 e r si:e Tot!l lo11in 1 </= r!t e s T#&/<& conn e c tio n s / seco n d CTT& re9 e s t s / sec CTT& errors / sec CTT& b;t e s / sec CTT& s cc e s s e s / sec $ c!re6 l de6inition o6 the d!t ! 6ields re-ort e d 2 st be -rovid e d to !llo0 the d!t ! to be nd e r s t o o d !nd -ro- erl ; inter-r e t e d . For s;st e 2 s 'se e cl! s e 5.,) th!t !re onl; re9 ir e d to re-ort #&% %tili:!tion !nd CTT& or Net0or8 B;tes -er seco n d -er6or 2 ! n c e st!tistics, ! s2 !ll t!ble 0ith onl; thes e t0o -er6or 2 ! n c e st!tistics 2 st be re-ort e d in the F ll 7isclos r e ?e-ort. The t!bl e 2 st cle!rl; identi6; i6 CTT& b;t e s -er seco n d or Net0or8 B;tes -er seco n d d!t ! is bein1 dis-l !;e d !nd identi6; the d!t ! collection 2 et h o d ol o 1 ; i6 it devi!t e s 6ro2 the &er6or 2 ! n c e St!tistics Ben er !l B idelin e s o6 cl! s e 5.,.1.
T&# Bench2!r8I W
&!1e
cl
8.,.1( The #&% tili:!tion 2 st be 1r! - h e d '!s de6in e d in cl! s e 5.,.2.1. 2) !nd the 1r! - h 2 st be incl d e d in the F ll 7isclos r e ?e-ort.
( ' ( C a u s e ; , S 9T< RBE a n # N e t " o r !

8.8.1 $ co2 -l et e 6 nction !l di!1r ! 2 o6 the 2e ! s r e d con6i1 r ! tio n 2 st be disclos e d. $ det !ile d list o6 !ll so6t0!r e !nd h!rd0 ! r e 6 nction !lit; bein1 -er6or 2 e d on the 7river S;st e 2 , !nd its inter6! c e to the S%T 2 st be disclos e d 'see #l! s e 6.6.5.6). The r!t e d b!n d 0i dt h o6 the net0or8's) co2 - o n e n t se d in the 2 e ! s r e d con6i1 r ! ti o n 2 st be disclos e d !lon1 0ith !n; settin 1 restrictin 1 th!t b!n d0i dt h. This incl d e s, b t is not li2ite d to, the inter* nod e conn e c tio n s 0ithin the S%T, bet0 e e n the S%T !nd the ?BA, !nd bet0 e e n the S%T !nd the &!;2 e n t B!t e0 ! ; A2 l !t or. <6 the con6i1 r ! ti o n re9 ire s o-er ! t or interv e n ti o n to 2e e t the re9 ire 2 e n t s o6 -er6or 2 ! n c e levels !nd nint err - t e d o-er ! ti o n s , the 2 ec h ! ni s 2 !nd the 6re9 e n c ; o6 this interv e n ti o n 2 st be disclos e d. <t 2 st be disclos e d i6 the ?BA is co2 2 e r ci !ll; !v!il!bl e or -ro-ri et ! r ;. $ Web &!1e $sse 2 bl ; descri-tion is re9 ir e d th!t describ e s ho0 the Web <nter! c ti on -!1 e s !re !ss e 2 b l e d . When ! 0eb -!1 e is ret rn e d to the ?BA, it 2 !; cont !i n %?@s to 6r!2 e s !nd/or i2! 1 e s th!t 2 st be !c9 ir e d b; the ?BA to co2 -l e t e the Web <nter ! cti on -!1 e. The Web &!1e $sse 2 bl ; -rovid e s ! hi1h level descri-tion in e!s ; to re!d te+t th!t describ e s 0hich serv er s !re -rovidin 1 0hich 6r!2 e s !nd/or i2! 1 e s . Th s ! 9 ic8 1l!nc e o6 the Web &!1e $sse 2 bl ; descri-tion -rovid e s !n overvie0 o6 the T&#*W sol tion 0itho t ! det !il e d e+! 2i n ! ti o n o6 the so rc e code -rovid e d in the F7?. 7escrib e d her e in !re r les 6or 1en e r ! t i n 1 the Web &!1e $sse 2 bl ; descri-tion 6ollo0e d b; !n e+! 2 -l e. The descri-tion is in o tline 6or2 0ith the o tline he ! d e r s describin 1 the n 2 b e r o6 s;st e 2 s -er6or 2i n 1 the e+ !ct s! 2 e Web $sse 2 bl ; 6 nctions, the s;st e 2 Ls -ri2 !r ; 6 nction !nd the s;st e 2 br!n d n! 2 e !nd t;-e !s s-eci6ied in cl! s e 8.2.2.(, 'i.e. the conc ! t e n ! t i o n o6 the n 2 b e r o6 s;st e 2 s 0ith the QF nctionR !nd QS;st e 2 R col 2 n s o6 the s;no - si s t!ble !t the botto 2 o6 the A+ec tiv e S 2 2 ! r ; -!1 e). A+!2 -l e o tline he ! d e r s !re Q2 Web #!ch e ?e!ll;F!s t #!ch e 2000 s R or Q9 Web Serv er Wi:B!n 1 9000 s R. The s;st e 2 s s-eci6ied in the o tline he! d e r s 2 st -er6or 2 the e+!ct s! 2 e Web $sse 2 bl ; 6 nction s sin1 the s! 2 e h!rd0 ! r e !nd so6t0!r e con6i1 r ! ti o n, th s the n 2 b e r o6 s;st e 2 s s-eci6ied in the Web $sse 2 bl ; o tline he! d e r s 2 !; not be the s! 2 e !s the QN 2 b e r o6 NodesR !s s-eci6ied in cl! s e 8.2.2.(. For e+! 2 -l e, the A+ec tiv e S 2 2 ! r ; 2 !; s-eci6; 5 Web #!ch e s b t the Web $sse 2 bl ; 2 !; re9 ir e 5 se- ! r ! t e o tline he ! d e r s i6 the Web #!ch e s !re not -er6or 2i n 1 the e+!ct s! 2 e Web $sse 2 bl ; 6 nction s. =nl; thos e serv er s res- o n di n 1 to ?BA CTT& re9 e s t s $sse 2 bl ; descri-tion. Follo0in1 e!c h o6 the he ! d e r s descri-tion s th!t s-eci6; the Web $sse 2 bl ; 6 nctions, the server's), describ e d in the he! d e r o tline, -rovid e s the one* line descri-tion s !re !s 6ollo0s. ne e d be incl d e d in the Web &!1e 'inde n t e d !nd b llet e d ) !re one* line i.e. 0h!t -iec e o6 ! Web <nter! c ti on to the ?BA. The r les 6or 1en e r ! t i n 1
8.8.2
8.8.5
8.8.( 8.8.5
The Web <nter ! ctio n is s-eci6ied in the one* line descri-tion s b; sin1 the n! 2 e o6 the Web <nter ! c tio n 'Co2 e, Best Sellers, Ne0 &rod ct s, ...) e+c e - t 6or the Se!rc h ?es lt 0eb inter ! c tio n 0hich 2 st be 6 rth e r 9 !li6ied b; -re6i+in1 the se !rc h t;- e, 6or e+! 2 -l e St!nd!rd S-eci6ic!tion Version &'( &!1e cli
T&# Bench2!r8I W
QTitle Se!rc h ?es ltR, Q$ thor Se!rc h ?es ltR or QS bE ect Se!rc h ?es ltR. <6 the Web <nter ! ctio n is not s-eci6ied, then it is !ss 2 e d th!t the server res-o n d s to the ?BAs 6or !ll T&#*W 0eb inter ! c tio n s th!t re9 ir e the s-eci6ied d!t !. %se the 1r! - hi c !l obEect n! 2 e s in section 1.5.1 to deno t e the E-e1 !nd 1i6 obEect s 6ollo0e d b; the ter2 Qi2! 1 e R to describ e the 1r!- hic !l obEect s, 6or e+ ! 2 -l e <te2 i2!1 e s , Th 2 b n !il i2!1 e s , b tt o n i2!1 e s or T&# lo1o i2!1 e. %se ! r!n1 e 9 !li6ier to s-eci6; ! s bs e t o6 ! Web $sse 2 bl ; ite2 or obEect. The r!n1 e 9 !li6ier c!n be s-eci6ied !s ! list, ! r!n1 e s-eci6ic!tion 2in * 2!+, or E st 2in * 2 !+ th!t is !ss 2 e d to be ! n 2 b e r r!n1 e. A+!2 -l e o6 one* line descri-tion s 0ith r!n1 e s !re Q$?TS, B<=B?$&C<AS W B%S<NASS S bEect Se!rc h Fr!2 e R, Q$l-h! b e t i c !l r!n 1 e $?TS * MKSTA?K S bE ect Se!rc h Fr!2 e R or Q1 _ 5,00 0 <te2 i2! 1 e s R . Witho t ! r!n1 e s-eci6ic!tio n it is !ss 2 e d th!t the Web $sse 2 bl ; 6 nction s-eci6ied in the one* line descri-tion is 6or the entire r!n 1 e o6 obEect s. %se the ter2 Q6r! 2 e R to deno t e ! -iec e or s bs e t o6 ! Web <nter! c ti on -!1 e . %se the ter2 Q-!1 e R to den ot e the initi!l Web <nter! c ti on res-o n s e th!t 2! ; or 2 !; not incl d e 6r!2 e s !nd/or i2!1 e s . %se the ter2 Qnon* sec r e -!1 e s R to deno t e !ll non* SS@ encr;- t e d Web <nter ! ctio n -!1 e s . %se the ter2 Qsec r e -!1 e s R to deno t e !ll SS@ encr;- t e d Web <nter ! ctio n -!1 e s . S-eci6; 0hich serv er resolve s !n; st!l e Web #!ch e d!t ! 0ith the -hr! s e Q?esolv e s Uo n e* line descri-tion 6ro2 Web #!ch e list V st!l e d!t ! R. %se the ter2 Q!llR to s-eci6; !ll st!l e Web #!ch e d!t !. <6 the Q?esolve s !ll st!l e Web #!ch e d!t ! R -hr! s e !-- e ! r s nd e r ! Web #!ch e o tline he ! d e r , this den ot e s th!t the Web #!ch e itsel6 is r nnin 1 !--lic!tion cod e th!t co2 2 ni c ! t e s directl; 0ith the 7!t! b ! s e serv er to resolve the st!l e Web #!ch e d!t !. <6 ! -!1 e is 6 rth er bro8e n into s2 !ller 6r!2 e s , se ! descri-tiv e -hr! s e th!t cont !i n s the QWeb <nter ! ctio n n! 2 e R, ! short descri-tiv e -hr! s e o6 the 6r!2 e !nd the 0ord Q6r! 2 e R . For e+ ! 2 -l e ! s2 !ll 6r!2 e cont !i nin 1 ! list o6 %?@s to -ro2 o tio n !l th 2 b n ! il 1i6s 6or ! Title Se!rc h ?es lt 0o ld be 0ritte n !s QTitle Se!rc h ?es lt -ro2 o tion !l list 6r!2 e R. %se the -hr! s e Q$ll other Web <nter ! c tio n -!1 e s /6r ! 2 e s / i 2 ! 1 e s R to den ot e ever;t hi n 1 else th!t is not listed in !n; other one* line descri-tion s o6 the Web &!1e $sse 2 bl ;.
The -rec e di n 1 one* line descri-tion r les !re b; no 2 e ! n s co2 -l e t e . <6 !ddition !l descri-tiv e -hr! s e s or 0ordin1 is se d, ! descri-tion o6 ho0 the -hr! s e or 0ordin1 sho l d be inter-r e t e d 2 st 6ollo0 the Web &!1e $sse 2 bl ; descri-tion nd e r the he ! d e r Q$ddition !l Web &!1e $sse 2 bl ; de6initionsR. Follo0in1 is !n e+! 2 -l e o6 ! Web &!1e $sse 2 bl ; descri-tion. 1 Web #!ch e ?e!ll;F!s t #!ch e 200 0 Title Se!rc h ?es lt s 6r!2 e Title Se!rc h ?es lt s -ro 2 o ti on !l list 6r!2 e $ thor Se!rc h ?es lt s 6r!2 e St!nd!rd S-eci6ic!tion Version &'( &!1e clii
1 Web #!ch e ?e!ll;F!s t #!ch e 200 0
T&# Bench2!r8I W
$ thor Se!rc h ?es lt s -ro 2 o ti on !l list 6r!2 e Best Sellers 6r!2 e Ne0 &rod ct s 6r!2 e S bEect Se!rc h ?es lts 6r!2 e &rod ct 7et !il 6r!2 e <te2 i2!1 e s Th 2 b n !il i2!1 e s B tton i2! 1 e s 6or non* sec r e -!1 e s T&# lo1o i2!1 e $ll oth er Web <nter! c ti on -!1 e s /6r ! 2 e s /i 2 ! 1 e s $ll oth er Web <nter! c ti on -!1 e s /6r ! 2 e s /i 2 ! 1 e s ?esolve s !ll st!l e Web #!ch e d!t !
5 Web #!ch e ?e!ll;F!s t #!ch e 200 0 s
2 <2!1 e Serv er @!r1e/Me 2 o r ; 5200 0 s
9 Web Serv er %ltr!Thin 2200 s 1 Web Serv er %ltr!Thin 2200
T&# Bench2!r8I W
&!1e
cliii
8.8.6
The t;- e s o6 errors th!t res lt in !n AB sessio n bein1 close d !nd re* initi!li:ed '!s de6ine d in 5.5.1.5) 2 st be disclos e d. $n; error h!n dlin 1 2 et h o d th!t is not disclos e d is !ss 2 e d to be ! retr;. The ?BA 2 et h o d o6 1en e r ! ti n 1 the th!t the st!rt see d s !re di66ere n t onl; be se d to 1en e r ! t e ! ni9 -revio s st!rt se e d s is not se d, 1re ! t e r then 10,0 0 0. st!rt see d s 6or the ABs 2 st be disclos e d . <t sho l d be cle!r 6or e!c h AB. >no0led 1 e o6 -revio sl; se d st!rt see d s 2! ; e set o6 st!rt se e d s 6or !ll s bs e 9 e n t r ns. <6 8no0led 1 e o6 then the -eriod o6 the selection 6or ne0 se e d s set s 2 st be
8.8.,
Com m e n t . <t is the inten t o6 this cl! s e to -rev e n t 1en e r ! ti n 1 si2il!r st!rt see d s th!t 0ill res lt in ! red ction o6 insert s to the d!t ! b ! s e '6or e+! 2 -l e, $77?ASS t!bl e) 8.8.8 The n 2 b e r o6 r!ndo 2 n 2 b e r 1en e r ! t o r s se d 6or e!c h AB 2 st be disclos e d !lon1 0ith their - r-o s e ' s). A+!2 -l e s o6 - r-o s e s incl d e. choosi n 1 the ne+t 0eb inter ! c tio n, b ildin1 r!nd o 2 te+t strin1s, decidin1 0het h e r the shi--in 1 !ddr e s s is ch! n 1 e d , thin8 ti2 e 1en e r ! ti o n, etc`
( ' > C a u s e = , Pri ci n g

8.9.1 $ det !ile d list o6 h!rd0 ! r e !nd so6t0!r e se d in the -riced s;st e 2 2 st be re-ort e d in the A+ec tiv e S 2 2 ! r ;. A!ch se- !r ! t el ; order ! bl e ite2 2 st h!v e ven d or -!rt n 2 b e r , descri-tion, !nd rele ! s e / r e vi sion level, !nd eith er 1en e r !l !v!il! bilit; st!t s or co2 2i t t e d deliver; d!t e. <6 -!c8 ! 1 e * -ricin1 is se d, vend or -!rt n 2 b e r o6 the -!c8 ! 1 e !nd ! descri-tion ni9 el ; identi6;in1 e!c h o6 the co2 - o n e n t s o6 the -!c8 ! 1 e 2 st be disclos e d . &ricin1 so rc e' s) !nd e66ective d!t e' s) o6 -rice's) 2 st !lso be re-ort e d . $n e+! 2 -l e o6 the A+ec tiv e S 2 2 ! r ; St!t e 2 e n t is -res e n t e d in $--e n di+ C. The tot!l 5* ;e!r -rice o6 the entire con6i1 r ! tio n 2 st be re-ort e d , incl din1. h!rd0 ! r e , so6t0!r e, !nd 2!int e n ! n c e ch!r 1 e s . Se- ! r ! t e co2 - o n e n t -ricin1 is reco 2 2 e n d e d . The b!sis o6 !ll disco n t s se d 2 st be disclos e d . The co2 2 it t e d deliver; d!t e 6or 1en e r !l !v!il! bilit; '!v!il! bilit; d!t e) o6 -rod c t s se d in the -rice c!lc l !tion s 2 st be re-ort e d . When the -riced s;st e 2 incl d e s -rod ct s 0ith di66ere n t !v!il!bilit; d!t e s, the re-ort e d !v!il! bilit; d!t e 6or the -riced s;st e 2 2 st be the d!t e !t 0hich !ll co2 - o n e n t s !re co2 2 it t e d to be !v!il! bl e. This sin1l e d!t e 2 st be re-ort e d on the 6irst -!1 e o6 the A+ec tiv e S 2 2 ! r ;. $ll !v!il!bilit; d!t e s, 0het h e r 6or individ !l co2 - o n e n t s or 6or the S%T !s ! 0hole, 2 st be disclos e d to ! -recision o6 one d!;. For !n; s! 1 e -ricin1, the s-on s or 2 st disclos e.
8.9.2
8.9.5
8.9.(
%s!1 e level !t 0hich the co2 - o n e n t 0!s -riced. $ st!t e 2 e n t o6 the co2 - ! n ; -olic; !llo0in1 s ch -ricin1.
Com m e n t A %s!1 e -ricin1 2! ; incl d e, b t is not li2ite d to, the o-er ! ti n 1 s;st e 2 !nd d!t ! b ! s e 2 ! n ! 1 e 2 e n t so6t0!r e . S;st e 2 -ricin1 2 st incl d e line ite2 indic!tion 0her e non* s-on s o rin 1 co2 - ! ni e s H br!n d s !re se d. S;st e 2 -ricin1 2 st !lso incl d e line ite2 indic!tion o6 third -!rt ; -ricin1.
T&# Bench2!r8I W
&!1e
cliv
('&+
C a u s e > , A u # i t R e a t e # 2t e m s
8.10.1 The ! dit orHs n! 2 e , !ddr e s s , -hon e n 2 b e r , !nd ! co-; o6 the ! ditorHs !tt e s t ! ti o n lett er indic!tin 1 co2 -li! n c e 2 st be incl d e d in the F ll 7isclos r e ?e-ort. 8.10.2 $ revie0 o6 the -ricin1 2od el is re9 ire d to ens r e th!t !ll co2 - o n e n t s re9 ire d !re -riced 'see #l! s e 9.2.8). The ! dit or is not re9 ire d to revie0 the 6in!l F ll 7isclos r e ?e-ort or the 6in!l -ricin1 -rior to iss in1 the !tt e s t ! ti o n lett er.
(' &&
A- a i a b i i t * o f t $ e 5u
)i s c o s u r e R e p o r t
8.11.1 The F ll 7isclos r e ?e-ort 2 st be re!dil; !v!il!bl e to the - blic !t ! re! s o n ! bl e ch!r1 e , si2il!r to ch!r 1 e s 6or si2il!r doc 2 e n t s b; th!t test s-on s o r. 8.11.2 The re-ort 2 st be 2! d e !v!il! bl e 0he n res lt s !re 2! d e - blic. 8.11.5 The o66ici!l 6 ll disclos r e !ddition !l l!n1 ! 1 e s . re-ort 2 st be !v!il!bl e in An1lish b t 2 !; be tr!nsl !t e d to
('&4
R e - i s i o n s t o t $ e 5u
)i s c o s u r e R e p o r t
(' & 4 ' & ReB u ir e # Re-i si o n s ?evision s to the 6 ll disclos r e doc 2 e n t ! t i o n !re reB u ir e # 6ollo0in1 circ 2 s t ! n c e s . to be - blish e d nd er the
8.12.1.1 7 rin1 the nor2 !l -rod c t li6e c;cle -robl e 2 s 0ill be ncov e r e d th!t re9 ir e ch! n 1 e s , so2 e ti 2 e s re6err e d to !s A#=s, F#=s, &!tch e s , %-d!t e s , etc. When the c 2 l ! tiv e res lt o6 !--lied ch! n 1 e s c! s e s the W<&S r!tin1 o6 the s;st e 2 to decr e ! s e b; 2ore th!n 2P 6ro2 the re-ort e d W<&S, the n the test s-on s or is re9 ir e d to re* v!lid!t e the benc h 2 ! r 8 res lt s !nd - blish the revise d -er6or 2 ! n c e !nd -rice/ - e r6or 2 ! n c e . 8.12.1.2 When c 2 l ! tiv e -rice ch!n 1 e s h!v e res lt e d in !n incre ! s e o6 2P or 2or e 6ro2 the re-ort e d -rice/ - e r6or 2 ! n c e , the test s-on s or 2 st s b 2it revis e d -rice/ - e r6or 2 ! n c e res lt s to the T&# 0ithin 50 d!;s o6 the e66ective d!t e o6 the -rice ch!n 1 e ' s ) to re2 !i n in co2 -li !n c e . The benc h 2 ! r 8 nee d not be re* r n to re2 !i n co2 -li! nt . Com m e n t . The inte nt o6 this cl! s e is th!t - blish e d -rice/ - e r6or 2 ! n c e re6lect !ct !l c rre n t -rice/ - e r6or 2 ! n c e . 8.12.1.5 ?e* -ricin1 o6 c rre n t res lts 2 st be revie0 e d !nd !--rov e d b; the ! dit or i6 ther e is ! ch! n 1 e to the -ricin1 2od el. #h!n 1 e s in -rices o6 line ite2 co2 - o n e n t s do not constit t e ! -ricin1 2od el ch! n 1 e . 8.12.1.( $ ch! n 1 e in the co2 2 it t e d !v!il! bilit; d!t e 6or the -rice d s;st e 2 0hich is l!ter th!n the - blish e d !v!il!bilit; d!t e 2 st - blish e d in ! revise d F ll 7isclos r e ?e-ort. 8.12.1.5 C!rd0!re or So6t0!re -rod ct s bstit tions 0ithin the S%T, 0ith the e+ce-tions noted belo0 re9 ire the bench2!r8 to be re*r n 0ith the ne0 co2-onents in order to re*est!blish co2-li!nce. The e+ce-tions !re. T&# Bench2!r8I W St!nd!rd S-eci6ic!tion Version &'( &!1e clv
Second!r; co2-onents s ch !s ter2in!l servers, ro ters, brid1es, re-e!ters !nd the li8e 2!; be s bstit ted. The s bstit te 2 st be de2onstr!ted to be !t le!st e9 iv!lent to the ori1in!l in -er6or2!nce. The -er6or2!nce tests !nd d!t! sed to de2onstr!te e9 !l or 1re!ter -er6or2!nce 2 st be disclosed. 7is8s 2!; be s bstit ted onl; nder the 6ollo0in1 conditions. To s bstit te dis8 drives, the -revio s drives sed in the S%T 2 st h!ve the s!2e inter6!ce t;-e !nd no lon1er be !v!il!ble. The s bstit ted drives tr!c8 to tr!c8 see8 ti2e, inter6!ce s-eed, on dis8 b 66er si:e, rot!tion!l s-eed, !nd 2edi! densit; 2 st be !t le!st the s!2e The n 2ber o6 ne0 drives s bstit ted 6or drives th!t !re no lon1er !v!il!ble, 2 st be 1re!ter th!n or e9 !l to the n 2ber o6 drives in the - blished res lt.
$ c- s bstit tion re9 ires the s!2e 2icro!rchitect re, 0or8 in the s!2e soc8et !s the s bstit ted c!nd is o6 ! hi1her 6re9 enc; 0ith s!2e si:e or l!r1er c!che 6or !ll c!che levels. So6t0!re -!tches 6or =S, 7BMS, T& Monitor, WebServer, or Webc!che so6t0!re 2 st be 6or the s!2e 2!Eor !nd 2inor revision level !nd 2 st be -er6or2!nce ne tr!l.
#o22ent 1. The intent is to !llo0 s bstit tions 0hen the ch!n1e 0o ld -rod ce -er6or2!nce !t le!st e9 iv!lent to the re-orted W<&S. The ! ditor 2!; re9 ire !ddition!l tests to be r n i6 the -roo6 b; doc 2ent!tion is not considered !de9 !te. The ! ditorLs letter o6 !ttest!tion 2 st be !tt!ched to the revised 6 ll disclos re re-ort.
#o22ent 2. S bstit tion o6 !n; other co2-onent not s-eci6ied !bove is not !llo0ed. #o22ent 5. The co2-onent s bstit tion 0ill be o-en to ch!llen1e 6or ! 60 d!; -eriod. 8.12.1.6 C!rd0 !r e or So6t0!r e -rod ct s bstit tion s 0ithin the S%T, 0ith the e+ce - ti o n s not e d belo0 re9 ire the benc h 2 ! r 8 to be re* r n 0ith the ne0 co2 - o n e n t s in order to re* est ! blis h co2 -li! n c e . The e+c e - tio n s !re. Secon d ! r ; co2 - o n e n t s s ch !s ter2i n !l serv er s, net0or8 !d ! - t e r s, ro t er s, brid1 e s, re- e ! t e r s !nd the li8e 2 !; be s bstit t e d . The s bstit t e 2 st be de 2 o n s t r ! t e d to be !t le!st e9 iv !l e n t to the ori1in !l in -er6or 2 ! n c e . The -er6or 2 ! n c e test s !nd d!t ! se d to de 2 o n s t r ! t e e9 !l or 1re ! t e r -er6or 2 ! n c e 2 st be disclos e d . 7is8s 2 !; be s bstit t e d nd er the 6ollo0in1 condition s.
To s bstit t e dis8 drives o6 t;-e =ld 6or drives o6 t;-e Ne0, !t le!st one drive o6 t;-e Ne0 2 st be incl d e d in the test e d con6i1 r ! tio n. 7is8 2onitorin 1 st!tistics 2 st be collect e d over ! co2 -li! nt W<&S Me!s r e 2 e n t <nterv !l e9 !l in d r!tion !nd B lo!d to the re-ort e d Me!s r e 2 e n t <nterv !l !nd !t ! thro 1 h - t 0ithin 90P o6 the re-ort e d W<&S. The collect e d dis8 2onit orin 1 st!tistics 2 st ill str! t e th!t the drives o6 t;-e Ne0 deliver e9 iv !l e n t or bett er -er6or 2 ! n c e th!n the drives o6 t;-e =ld in re1! r d s to !ver ! 1 e servic e ti2 e !nd 9 e e de-t h or e9 iv !l e n t -er6or 2 ! n c e st!tistics 'service ti2 e re-ort e d in 1/10 2illiseco n d , 9 e e de-t h re-ort e d in tent h s). The </= lo!d serv e d b; the drives o6 t;-e =ld 2 st be s bst ! n ti !ll; e9 !l 'in ter2 s o6 d!t ! bein 1 !cce s s e d , !cc e s s -!tt er n s !nd </= r!t e s) to the </= lo!d serv e d b; the drives o6 t;- e Ne0.
T&# Bench2!r8I W
&!1e
clvi
The 2ini2 2 n 2 b e r o6 dis8 drives to s bs tit t e 2 st be !n inte 1 e r 2 lti-l e o6 0h!t the 7is8 2onitorin1 tool c!n ni9 el ; 2 e ! s r e .
<n !ddition, the c!- ! cit ; o6 the s bstit t e '2e 2 o r ;, slots 6or s;st e 2 s , 6or2 ! t t e d MB 6or dis8s, etc.) 2 st be !t le!st e9 iv!l e n t to the ori1in !l.
Com m e n t &A The inten t is to !llo0 s bstit tio n s 0hen the ch! n 1 e 0o ld -rod c e -er6or 2 ! n c e !t le!st e9 iv !l e n t to the re-ort e d W<&S. The ! dit or 2 !; re9 ire !ddition !l test s to be r n i6 the -roo6 b; doc 2 e n t ! t i o n is not consid e r e d !d e 9 ! t e . The ! dit orLs lett er o6 !tt e s t ! t i o n 2 st be !tt !c h e d to the revise d 6 ll disclos r e re-ort. Com m e n t 4A S bstit tion o6 !n; -ri2 !r ; co2 - o n e n t o6 the CTT& serv er or 7B serv er is not !llo0e d. This incl d e s , b t is not li2ite d to, #&%s, controllers, intern o d e conn e c t or s, ch! n n el !d! - t e r s or 2 e 2 o r ; chi-s. Ne0 version s o6 the =S, 7BMS, or T& Monitor !re not !llo0e d nd e r !n; circ 2 s t ! n c e s . Com m e n t 6A The co2 - o n e n t s bstit tio n 0ill be o-e n to ch!lle n 1 e 6or ! 60 d!; -eriod. 8.12.1., F ll 7isclos r e ?e-ort revision s 2! ; be re9 ir e d 6or other re!s o n s !ccordi n 1 to T&# -olicies 'see T&# &olic; 7oc 2 e n t ). 8.12.1.8 The revise d re-ort sho l d be s b 2it t e d !s de6in e d in #l! s e 8.10. (' & 4 ' 4 Per mi t t e # Re-i si o n s ?evision s to the 6 ll disclos r e doc 2 e n t ! t i o n !re per mi t t e # 6ollo0in1 circ 2 s t ! n c e s . to be - blish e d nd er the
8.12.2.1 When c 2 l ! tiv e -rice ch!n 1 e s h!v e res lt e d in ! decr e ! s e o6 2P or 2or e 6ro2 the re-ort e d -rice/ - e r6or 2 ! n c e , the test s-on s o r 2! ; s b 2i t revise d -rice/ - e r6or 2 ! n c e res lts to the T&#. The benc h 2 ! r 8 ne e d not be re* r n to re2 !i n co2 -li !n t. 8.12.2.2 ?e* -ricin1 o6 c rre n t res lts 2 st be revie0 e d !nd !--rov e d b; the ! dit or i6 ther e is ! ch! n 1 e to the -ricin1 2od el. #h!n 1 e s in -rices o6 line ite2 co2 - o n e n t s do not constit t e ! -ricin1 2od el ch! n 1 e . 8.12.2.5 $ ch!n 1 e in the co2 2 it t e d !v!il!bilit; d!t e 6or the -riced s;st e 2 0hich is e!rlier th!n the - blish e d !v!il!bilit; d!t e 2 !; be - blish e d in ! revise d F ll 7isclos r e ?e-ort. The !v!il!bilit; d!t e c!n not be 2ov e d e!rlier th!n the s b 2i s si o n d!t e o6 the revise d F7?. 8.12.2.( $ re-ort 2! ; be revis e d to !dd or delet e #l! s e , rel!t e d ite2 s 6or co nt r; s-eci6ic -riced con6i1 r ! tio n s. 8.12.2.5 The revise d re-ort sho l d be s b 2it t e d !s de6in e d in #l! s e 8.10.
T&# Bench2!r8I W
&!1e
clvii
C a u s e > , A9)2T
> ' & 1e n er a Ru e s

9.1.1 $n inde - e n d e n t ! dit o6 the benc h 2 ! r 8 res lts b; !n ! ditor certi6ied b; the T&# is re9 ir e d. $n ! dit chec8list is -rovid e d !s -!rt o6 this s-eci6ic!tio n. &le!s e obt !i n the c rre n t ! dit chec8list 6ro2 one o6 the ! ditors. The ter 2 Ninde - e n d e n t N is de6in e d !s. Nthe o tco 2 e o6 the benc h 2 ! r 8 c!rries no 6in!nci !l ben e6it to the ! ditin1 !1e n c ; oth er th!n 6ees e!rn e d directl; rel!t e d to the ! dit.N <n !ddition, the ! ditin1 !1e n c ; c!nn o t h!v e s - -lie d !n; -er6or 2 ! n c e cons ltin 1 nd er contr ! c t 6or the benc h 2 ! r 8 nd er ! dit. The ter2 Ncerti6iedN is de6in e d !s. Nthe T&# h!s revie0 e d the 9 !li6ic!tion o6 the ! ditor !nd certi6ied th!t the ! ditor is c!- ! bl e o6 veri6;in1 co2 -li !n c e o6 the benc h 2 ! r 8 res lt.N &le!s e see the T&# $ dit &olic; 6or ! det !ile d descri-tion o6 the ! ditor certi6ic!tion -roc e s s . <n !ddition, the 6ollo0in1 condition s 2 st be 2et. 1. The ! ditin1 !1e n c ; c!nn o t be 6in!nci !ll; rel!t e d to the s-on s or. For e+! 2 -l e, the ! ditin1 !1e n c ; is 6in!nci !ll; rel!t e d i6 it is ! de- e n d e n t division, the 2!Eorit; o6 its stoc8 is o0n e d b; the s-on s or, etc. The ! ditin1 !1e n c ; c!nn o t be 6in!nci !ll; rel!t e d to !n; one o6 the s - -liers o6 the 2 e ! s r e d or -riced co2 - o n e n t s . This incl d e s b t is not li2ite d to the 7BMS s - -lier, the 0eb server s - -lier, or !n; oth er h!rd0 ! r e or so6t0!r e s - -lier se d in the s;st e 2 nd er test.
2.
9.1.2
The ! dit orHs !tt e s t ! t i o n lett er 2 st be 2 ! d e re! dil; !v!il! bl e to the - blic !s -!rt o6 the F ll 7isclos r e ?e-ort, b t ! det !il e d re-ort 6ro2 the ! ditor is not re9 ire d. <n the c!s e o6 ! dit e d T&#*W res lts 0hich !re bein1 revise d 6or -ricin1 or s bstit tion ch! n 1 e s , the ! dit re9 ire 2 e n t s !re c!lled o t in #l! s e 8.11. The ! ditor is not re9 ir e d to 6ollo0 !n; o6 the re2 !i ni n 1 ! dit orHs chec8 list ite2 s 6ro2 #l! s e 9.2.
9.1.5
> ' 4 A u # i t o r L s C$ e c ! %i s t
>' 4 ' & 9.2.1.1 C au s e + M Com m e r c i a pro # u c t s
Veri6; th!t the -rod ct s 2 e ! s r e d !nd -rice d !re order ! bl e b; c st o 2 e r !s de6ine d in #l! s e ,.1.5. C au s e & M Web .bEe c t an # %ogi c a )at a b a s e )e s i g n
>' 4 ' 4 9.2.2.1
Veri6; th!t s-eci6ied 2ini 2 2 str ct r e 'i.e., list o6 6ields) e+ist 6or e!c h t!bl e, !nd th!t the; con6or 2 to the s-eci6ied re9 ire 2 e n t s . Veri6; the 0eb obEect s !re 1en e r ! t e d !ccordi n 1 to #l! s e 1.5. Veri6; th!t the ni9 e identi6iers in e!c h t!bl e !re not dis8 or 6ile o66set s.
9.2.2.2 9.2.2.5 9.2.2.(
Veri6; th!t the stor! 1 e o6 the 0eb obEect s co2 -li es 0ith the i2-le 2 e n t ! t i o n r les. T&# Bench2!r8I W St!nd!rd S-eci6ic!tion Version &'( &!1e clviii
9.2.2.5
Veri6; th!t 0or8lo! d.
!ll t!bl e s
s - - ort
retriev !l s, insert s
!nd delet e s
0hile s - - ortin 1
! T&#*W
Com m e n t . For this veri6ic!tion, the 0or8lo! d doe s not h!v e to be e9 !l to the re-ort e d -er6or 2 ! n c e . 9.2.2.6 Veri6; 0het h e r !n; hori:ont !l !nd/ or vertic!l -!rtitionin 1 h!s bee n the det !ils o6 th!t -!rtitionin 1 !re disclos e d. se d, !nd, i6 so, 0het h e r
9.2.2.,
Veri6; 0het h e r !n; re-lic!tion o6 t!bl es h!s bee n se d, !nd, i6 so, 0het h e r !t le!st one co-; is d r! bl e !nd i6 the det !ils o6 th!t re-lic!tio n !re disclos e d . Veri6; th!t the inte1rit; r les de6in e d in #l! s e 1., !re 6ollo0e d. Veri6; th!t the re9 ir e 2 e n t s 6or tr!n s - ! r e n t d!t ! !cc e s s , !s de6in e d in #l! s e 1.8, !re 2 et. C au s e 4 M Web 2nt er a c t i o n s an # Wor! o a # Profi e Veri6; th!t the !to 2ic set o6 o-er ! ti o n s 2 e e t s the re9 ir e 2 e n t s de6ine d in #l! s e 2.1.1 0. Veri6; th!t the sec r e 0eb inter ! c tio n s 2.2.1. se encr;- t e d co2 2 ni c ! ti o n !s de6in e d in #l! s e
9.2.2.8 9.2.2.9 >' 4 ' 6 9.2.5.1 9.2.5.2
9.2.5.5 9.2.5.(
Veri6; th!t %ser Session s !re correctl; st!rt e d !s de6in e d in #l! s e 2.2.5. Veri6; th!t the co2 2 ni c ! ti o n o6 the # sto 2 e rLs identit; to the S%T co2 -li es 0ith the re9 ire 2 e n t s o6 #l! s e 2.2.( !nd th!t Session tr!c8in 1 is i2-le 2 e n t e d !ccor din 1 to #l! s e 2.2.5. Veri6; th!t the i2-le 2 e n t ! t i o n o6 the Sho--i n 1 #!rt 2 e e t s the re9 ir e 2 e n t s o6 #l! s e 2.2.6. Veri6; th!t 0eb lo11in 1 is t rn e d on 6or #o2 2 o n @o1 For2 ! t '#@F) 6ro2 the htt- serv er, !nd 2 e e t s the re9 ir e 2 e n t s de6in e d in #l! s e 2.2.15. Veri6; th!t the !--lic!tio n -ro1r ! 2 correctl; i2-le 2 e n t s the 1en e ric &ro2 otio n !l &roces si n 1. Veri6; the co2 -li !n t i2-le 2 e n t ! t i o n o6 the Co2 e 0eb inter ! c ti on. Veri6; the co2 -li !n t i2-le 2 e n t ! t i o n o6 the Sho--i n 1 #!rt 0eb inter ! c tio n.
9.2.5.5 9.2.5.6
9.2.5., 9.2.5.8 9.2.5.9
9.2.5.1 0 Veri6; the co2 -li !n t i2-le 2 e n t ! t i o n o6 the # sto 2 e r ?e1istr ! ti on 0eb inter ! c tion. 9.2.5.1 1 Veri6; the co2 -li !n t i2-le 2 e n t ! t i o n o6 the B ; ?e9 e s t 0eb inter ! c ti on. 9.2.5.1 2 Veri6; the co2 -li !n t i2-le 2 e n t ! t i o n o6 the B ; #on6ir2 0eb inter ! c tio n. 9.2.5.1 5 Veri6; the co2 -li !n t i2-le 2 e n t ! t i o n o6 the =rder <n9 ir; 0eb inter ! c ti on. 9.2.5.1 ( Veri6; the co2 -li !n t i2-le 2 e n t ! t i o n o6 the =rder 7is-l!; 0eb inter ! c tio n. 9.2.5.1 5 Veri6; the co2 -li !n t i2-le 2 e n t ! t i o n o6 the Se!rc h ?e9 e s t 0eb inter ! c ti on.
T&# Bench2!r8I W
&!1e
cli+
9.2.5.1 6 Veri6; the co2 -li !n t i2-le 2 e n t ! t i o n o6 the Se!rc h ?es lt 0eb inter ! c tio n. 9.2.5.1 , Veri6; the co2 -li !n t i2-le 2 e n t ! t i o n o6 the Ne0 &rod ct s 0eb inter ! c ti on. 9.2.5.1 8 Veri6; the co2 -li !n t i2-le 2 e n t ! t i o n o6 the Best Sellers 0eb inter ! c tion. 9.2.5.1 9 Veri6; the co2 -li !n t i2-le 2 e n t ! t i o n o6 the &rod ct 7et!il 0eb inter ! c tion. 9.2.5.2 0 Veri6; the co2 -li !n t i2-le 2 e n t ! t i o n o6 the $d2in ?e9 e s t 0eb inter ! c ti on. 9.2.5.2 1 Veri6; the co2 -li !n t i2-le 2 e n t ! t i o n o6 the $d2in #on6ir2 0eb inter ! c tio n. 9.2.5.2 2 %sin1 one o6 the con6i1 r e d bro0s er s, veri6; th!t the in- t/o t - t scre e n 6or e!c h t;-e o6 0eb inter ! c tio n h!s the re9 ire d loo8 !nd 6eel !nd -rovid e s !ll the re9 ire d 6e!t r e s , s ch !s d!t ! entr; !nd n!vi1 ! ti o n. >' 4 ' 8 9.2.(.1 C au s e 6 , )at a b a s e Tran s a c t i o n an # S* s t e m Prop e r t i e s Veri6; th!t the benc h 2 ! r 8. re9 ir e d !to 2i cit; -ro- er t ; is -rovid e d b; the i2-le 2 e n t ! t i o n o6 the
9.2.(.2
Veri6; the -ro- er e+ec tio n o6 the !to 2i cit; test, !nd de6in e !nd veri6; the e+ec tio n o6 !ddition !l test s i6 nec e s s ! r ; to s 66icientl; de 2 o n s t r ! t e the !to 2i cit; -ro- er t ;. Veri6; th!t the re9 ir e d consist e n c ; -ro- er t ; is -rovid e d b; the i2-le 2 e n t ! t i o n o6 the benc h 2 ! r 8. Veri6; the -ro- er e+ec tio n o6 the consist e n c ; test, !nd de6in e !nd veri6; the e+ ec tio n o6 !ddition !l test s i6 nec e s s ! r ; to s 66icientl; de 2 o n s t r ! t e the consist e n c ; -ro- e rt ;. Veri6; th!t the benc h 2 ! r 8. re9 ir e d isol!tion -ro- er t ; is -rovid e d b; the i2-le 2 e n t ! t i o n o6 the
9.2.(.5
9.2.(.(
9.2.(.5
9.2.(.6
Veri6; the -ro- er e+ ec ti o n o6 the isol!tion test s, !nd de6ine !nd veri6; the e+ec tio n o6 !ddition !l test s i6 nec e s s ! r ; to s 66icientl; de 2 o n s t r ! t e the isol!tion -ro- e rt ;. Veri6; th!t the benc h 2 ! r 8. re9 ire d d r! bilit; -ro- er t ; is -rovid e d b; the i2-le 2 e n t ! t i o n o6 the
9.2.(.,
9.2.(.8
7eter 2i n e 0hich co2 - o n e n t o6 the S%T 2 e e t the de6inition o6 ! sin1le -oint o6 6!il re !s de6in e d in #l! s e 5.1.5.5. Veri6; the -ro- er e+ ec ti o n o6 the d r! bilit; test s involvin1 e!c h sin1le -oint o6 6!il re, !nd de6in e !nd veri6; the e+ ec tio n o6 !ddition !l test s i6 nec e s s ! r ; to s 66icientl; de 2 o n s t r ! t e the d r! bilit; -ro- er t ;.
9.2.(.9
9.2.(.1 0 Veri6; th!t the re9 ir e d 0eb -!1 e consist e n c ; -ro- e rt ; is -rovid e d b; the i2-le 2 e n t ! t i o n o6 the benc h 2 ! r 8 . 9.2.(.1 1 Veri6; the -ro- er e+ ec ti o n o6 the 0eb -!1 e consist e n c ; test, !nd de6in e !nd veri6; the e+ec ti on o6 !ddition !l test s i6 nec e s s ! r ; to s 66icientl; de 2 o n s t r ! t e the consist e n c ; -ro- e rt ;. T&# Bench2!r8I W St!nd!rd S-eci6ic!tion Version &'( &!1e cl+
9.2.(.1 2 Veri6; th!t the <SST=#> 9 ! n tit ; on h!n d in the <te2 t!bl e is bein1 >' 4 ' : 9.2.5.1 9.2.5.2 9.2.5.5 C au s e 8 , Sca i n g an # )at a b a s e Pop u a t i o n
-d ! t e d .
Veri6; th!t the initi!l d!t ! b ! s e -o- l ! tion is -ro- e rl; sc!l e d, !s de6in e d in #l! s e (.2. Veri6; th!t the d!t ! b ! s e -o- l ! tion 0!s 1en e r ! t e d !ccor din 1 to #l! s e s (.6 !nd (.,. Veri6; the correct c!rdin !lities o6 the d!t ! b ! s e t!ble s, !t the st!rt o6 the Test ? n !s 0ell !s !t the end o6 it, !nd th!t the 1ro0t h in the =?7A?S t!bl e, in -!rtic l !r, is consist e n t 0ith the re-ort e d W<&S r!t e. Veri6; th!t the 180* d!; s-!c e re9 ir e 2 e n t is co2 - t e d !ccordi n 1 to #l! s e (.(. Veri6; th!t the re9 ire 2 e n t s . si:e o6 the Web Serv er $ccess @o1s is c!lc l !t e d !ccordi n 1 to the
9.2.5.( 9.2.5.5
9.2.5.6 >' 4 ' ; 9.2.6.1
Veri6; th!t the re9 ir e d n 2 b e r o6 ABLs !re !ctive d rin1 the entire Test ? n. C au s e : , Perf or m a n c e Metri c s an # Re s p o n s e Time Veri6; th!t the 2i+ o6 0eb inter ! c tion s !s see n b; the ?BA s!tis6ies the re9 ire d 2i+ 6or e!c h Me!s r e 2 e n t <nterv !l. Veri6; th!t the thres h ol d s 1ive n in #l! s e 5.2.2. se d to !chi ev e the re9 ir e d 2i+ o6 0eb inter ! c ti on s !re thos e
9.2.6.2
9.2.6.5
Veri6; th!t the c;cle o6 0eb inter ! c tio n s ill str! t e d in #l! s e s 5.2.2.1 !nd 5.5.1.
6ollo0e d b; the ?BA 2e e t s
the re9 ir e 2 e n t s
9.2.6.( 9.2.6.5 9.2.6.6
Veri6; th!t the Thin8 Ti2es !re -ro- e rl; 1en e r ! t e d , 2 e ! s r e d !nd re-ort e d b; the ?BA. Veri6; the d r! tion o6 the re-ort e d Me!s r e 2 e n t <nterv !l s. Veri6; the v!lidit; o6 the 2 et h o d se d to !cc r ! t el ; 2 e ! s r e !nd re-ort the Web <nter! c ti on ?es-o n s e Ti2es 'W<?T) !t the ?BA. Veri6; th!t !ll 2 e ! s r e d W<?TLs 2 e e t the res- o n s e ti2 e constr !i n t s de6in e d in #l! s e 5.5.(.1. Veri6; th!t the re-ort e d W<?TLs !re 2e ! s r e d d rin1 the s! 2 e ti2 e Me!s r e 2 e n t <nterv !l 6ro2 0hich the re-ort e d thro 1 h - t is 2e ! s r e d . Veri6; th!t the thro 1 h - t !ccordi n 1 to #l! s e 5.(. r!tin1s 6or the thre e Me!s r e 2 e n t <nterv !l s interv !l !s the
9.2.6., 9.2.6.8
9.2.6.9
!re
co2 - t e d
9.2.6.1 0 Veri6; th!t the re9 ir e 2 e n t s 6or the Test ? n's), !s s-eci6ied in #l! s e 5.5.2, !re 2et. 9.2.6.1 1 Veri6; the 2et h o d se d to det er 2 i n e th!t the S%T h!d re!c h e d co2 2 e n ci n 1 the Me!s r e 2 e n t <nterv !l s, !s s-eci6ied in #l! s e 5.5.2. ste ! d ; st!t e -rior to
T&# Bench2!r8I W
&!1e
cl+i
9.2.6.1 2 Veri6; th!t the S%T is c!- ! bl e o6 r nnin 1 nint err - t e d 6or 1( d!;s, !s de6in e d in #l! s e 5.5.2.2. While !n !ct !l 1( d!; Test ? n 0o ld be hi1hl; i2-r !c tic !l, the ! dit or 2 st concl d e 0ith ! hi1h de1r e e o6 con6id e n c e th!t this re9 ir e 2 e n t is 2et b; the S%T. This c!n be !chi ev e d thro 1 h theor e tic !l e+-l! n ! t i o n s !nd, i6 nee d e d , the de6inition !nd e+ ec tio n o6 !ddition !l test s. 9.2.6.1 5 Veri6; th!t !ll 0or8 nor2 !ll; don e in ! ste ! d ; st!t e environ 2 e n t , s ch !s chec8 - oi nt s or redo/ n d o lo11in 1, !ct !ll; occ rr e d d rin1 the Me!s r e 2 e n t <nterv !l s in order to 8ee thro 1 h - t v!ri!tion s over !n 8 ho r -eriod nd e r 5P. 9.2.6.1 ( Veri6; the 2et h o d se d to det er 2 i n e the re-ro d ci bilit; o6 the 2 e ! s r e 2 e n t res lt s.
9.2.6.1 5 Veri6; th!t !ll re9 ire d re-ortin 1 2 etrics, incl din 1 the !ddition !l -er6or 2 ! n c e st!tistics de6in e d in #l! s e 5., !re collect e d !cc r ! t el ; !nd d rin1 the s! 2 e ti2 e interv !l !s the Me!s r e 2 e n t <nterv !l 6ro2 0hich the re-ort e d thro 1 h - t is 2e ! s r e d . 9.2.6.1 6 This re9 ire 2 e n t h!s be e n delet e d . 9.2.6.1 , Veri6; th!t the &BA ret r n s the ! t h ori: !tio n <7 !t ! r!ndo 2 2 es s ! 1 e . loc!tion 0ithin the encr;- t e d
9.2.6.1 8 Veri6; the r!ndo 2 n 2 b e r devi!tion s !s s-eci6ied in cl! s e 5.5.5.
+' & ' &
C au s e ; , S9T< )ri- er < an # Com m u n i c a t i o n s )efi ni ti o n
9.2.6.1 8 Veri6; the !cc r ! t e e2 l ! ti on o6 the test e d bro0s e r -o- l ! tion b; the ?BA. 9.2.6.1 9 Veri6; th!t the ?BA correctl; i2-le 2 e n t s the #%?@, !s de6in e d in #l! s e 2.2.1(. 9.2.6.2 0 Veri6; th!t the restrictions -l!c e d on the !ctivit; o6 the ?BA, !s de6ine d in #l! s e 6.1.5, !re obs erv e d . 9.2.6.2 1 Veri6; th!t the re9 ir e d co2 2 ni c ! ti o n -rotocol is se d bet0 e e n the ?BA !nd the S%T. 9.2.6.2 2 Veri6; th!t e!c h AB o-e n s its o0n soc8 et conn e c ti o n to the S%T inst e ! d o6 sh!rin 1 ! soc8 et 0ith other ABs. 9.2.6.2 5 Veri6; th!t the T#& M!+i2 2 Se1 2 e n t Si:e 'MSS) bet0 e e n the ABHs !nd the S%T is li2ited !s de6in e d in #l! s e 6.1.,. 9.2.6.2 ( Veri6; th!t the ABHs 1en e r ! t e !nd obs erv e %SM7Hs !s de6in e d in #l! s e 6.1.9.2. 9.2.6.2 5 Veri6; th!t the S%T 2!int !i n s %ser cont e + t !s re9 ire d. 9.2.6.2 6 Veri6; th!t the restrictions -l!c e d on the !ctivit; o6 the S%T !re obs erv e d . 9.2.6.2 , Veri6; the S%T 2e e t s the o-er ! ti o n !l re9 ir e 2 e n t s de6in e d in #l! s e 6.6. 7oc 2 e n t ! t i o n is s 66icient to 2 e e t this re9 ire 2 e n t s bE ect to the ! dit or discre tion. 9.2.6.2 8 Veri6; the !cc r ! t e i2-le 2 e n t ! t i o n o6 the &BA 6 nctions. T&# Bench2!r8I W St!nd!rd S-eci6ic!tion Version &'( &!1e cl+ii
9.2.6.2 9 Veri6; the 0eb -!1 e !ss e 2 b l ; !s de6in e d in 8.8.5. >' 4 ' = 9.2.,.1 C au s e = , Pricin g Veri6; th!t the -ricin1 2od el incl d e s !ll the h!rd0 ! r e !nd so6t0!r e co2 - o n e n t s re9 ir e d to -rod c e ! co2 -li! nt benc h 2 ! r 8 res lt, incl din1 b t not li2ite d to s 66icient d!t ! b ! s e !nd lo1 stor ! 1 e . Veri6; the -ricin1 s-re ! d s h e e t th!t det !ils ho0 the 5* ;e!r cost o6 o0ner s hi - is co2 - t e d . Veri6; th!t, 0he n se d, c sto 2 e r s-!r e ! b l e co2 - o n e n t s !re -riced in s 66icient 9 ! n tit ; to 2 e e t the re9 ir e 2 e n t s . Veri6; the co2 -li !n c e o6 !n; disco n t , 0!rr! n t ; or 2 !int e n ! n c e re9 ire 2 e n t s . se d to 2 e e t the -ricin1
9.2.,.2 9.2.,.5
9.2.,.(
9.2.,.5 9.2.,.6
Veri6; the co2 -li !n c e o6 !ll -rice 9 ot e s 6or co2 - o n e n t s 6ro2 third -!rt ; so rc e s . The ! ditor is not re9 ire d to veri6; the -ricin1 o6 co2 - o n e n t s s - -lie d b; the benc h 2 ! r 8 s-on s or. Veri6; th!t the -rice -er6or 2 ! n c e r!tio is co2 - t e d !ccordi n 1 to #l! s e ,.(. C au s e ( , 5)R Veri6; th!t the F ll 7isclos r e ?e-ort is co2 -l et e !nd !cc r ! t e . $ ditors c!n li2it their revie0 o6 the F7? to the 6ollo0in1 section s. A+ec tiv e s 2 2 ! r ; section S;st e 2 con6i1 r ! tio n section 7!t! b ! s e -o- l !tio n !nd s-!c e c!lc l !tion section Section s th!t incl d e -er6or 2 ! n c e st!tistics. the disclos r e o6 2e!s r e 2 e n t d!t !, e+cl di n 1 !ddition !l
9.2.,., >' 4 ' ( 9.2.8.1
$n; oth er section re9 e s t e d b; the ! dit or Com m e n t A The intent is to li2it the revie0 to so2 e t hi n 1 less th! n ! line b; line chec8 0hile still -rovidin1 6or ! re!s o n ! bl e !ss r ! n c e th!t the d!t ! is !cc r ! t e .
T&# Bench2!r8I W
&!1e cl+iii
A p p e n # i 3 A , C9 ST.MER E?ENT )2A1RAM
A' &
2n tr o # u c t o r * E3 p a n a t i o n s
This !-- e n di + di!1r ! 2 s the eve n t s rel!t e d to the -roc e s si n 1 o6 #S<7, %N$MA, &$SSW7, ?AT%?N<NBSF@$B !nd the cre !tio n o6 ne0 #%ST=MA? record s d rin1 ! %ser Session. There !re t0o di!1r ! 2 s . Avent 7i!1r! 2 1 cover s the c!s e in 0hich !n AB st!rt s ! %ser Session !nd is not ! # sto 2 e r . Avent 7i!1r! 2 2 covers the c!s e in 0hich !n AB st!rt s ! %ser Sessio n !nd is ! 'ret rni n 1) # sto 2 e r. %eg e n # . The rect ! n 1 l ! r 's9 ! r e corn er e d ) bo+ e s sho0 eve n t s !nd/or !ction s t!8e n b; the AB. The bo+ e s 0ith ro n d e d corn er s sho0 !ctions t!8e n b; the S%T. Ti2e 1en e r !ll; 6lo0s do0n the -!1 e , in the sen s e th!t tr!n sition s th!t occ r l!ter in ! %ser Session !re sho0n 6 rth er do0n the -!1 e. The ter 2 Nintr.N is !n !bbr e vi ! tio n 6or N0eb inter ! c ti onN.
T&# Bench2!r8I W
&!1e cl+iv
A' 4
E- e n t )i a g r a m &
The 6ollo0in1 st!t e # sto 2 e r. tr!n sition di!1r ! 2 ill str!t e s the sit ! tion 0hen the %ser is no t !
E randoml* decides it 7ill not be a !returning% Customer and randoml* selects a =SM&
=ser Session starts on the E
.st Home intr) ;o C<I& communicated to S=T

6rder &is'la* intrBs 'rior to . u* Request intr > E selects C<I& 'er Clause /)0)/: and 'resents =;(ME E P(SSW& to S=T
st
S%T ret rns to AB

order info) for this C<I&
=ser Session ends before .st u* Request intr)
=ser Session ends> ;o ne7 Customer record nor ne7 C<I& created S=T assigns ne7 C<I& and creates ne7 Customer record) S=T returns C<I& and C<=;(ME 8alues to E S=T obtains C<P(SSW& E C<I& for this =;(ME) S=T com'ares P(SSW& and C<P(SSW&)
.st u* Request intr)> E communicates RET=R;<?@(9 A ;
Subsequent u* Request intrBs > E 'resents RET=R;I;9<?@(9ACDC: =;(ME and P(SSW& for ne7l* assigned C<I&
6rder &is'la* intrBs after . u* Request intr > E 'resents =;(ME E P(SSW& for ne7l* assigned C<I&
st
S=T returns to E order information for ne7l* assigned C<I&
=ser Session ends after .st u* Request intr)
=ser Session ends> ;e7 Customer record and ne7 C<I& ha8e been created
T&# Bench2!r8I W
&!1e
cl+v
A' 6
E- e n t )i a g r a m 4
The 6ollo0in1 st!t e tr!nsition di!1r ! 2 ill str!t e s the sit !tio n 0hen the %ser is ! # sto 2 e r. E randoml* decides it 7ill be a !returning% Customer and randoml* selects a =SM&) C<I& is selected using ;=Rand function)
=ser Session starts on the E
.st Home intr) E communicates C<I& to S=T
S=T obtains C<?;(ME and C<@;(ME for this Customer to return in HTM@ Res'onse Page
u* Request interactions > E communicates =;(ME: P(SSW& and RET=R;<?@(9 A D
S=T obtains C<I& and C<P(SSW& for this Customer) S=T com'ares P(SSW& to C<P(SSW&
6rder &is'la* interactions > E 'resents =;(ME E P(SSW&
6or its #S<7.
S=T returns to E order information for ne7l* assigned C<I&
=ser Session ends
=ser Session ends> ;o ne7 Customer nor record ne7 C<I& ha8e been created
T&# Bench2!r8I W
&!1e cl+vi
A p p e n # i 3 B , S H. P P2N1 STATE )2A1RAM S
B'&
2n tr o # u c t o r * E3 p a n a t i o n s
The S-eci6ic!tion s!;s the 6ollo0in1 0ith res- e c t to Sho- -i n 1 Session, SC=&&<NBS<7, !nd #$?T. $ SC=&&<NBS<7 c!n be !ssi 1n e d to ! %ser Session be6ore ! Sho- -i n 1 Session h!s be e n est ! blish e d . <t 2i1ht be hel-6 l to thin8 o6 ! SC=&&<NBS<7 !s ! 0eb ses sion <7 se d b; the S%T to tr!c8 the %ser Session. $s s ch, it doe s not nec e s s ! ril; ent !il the e+ist e n c e o6 ! Sho- -i n 1 Session. '<t 0!s de e 2 e d se6 l 6or the S%T to h!v e the 6le+ibilit; to tr!c8 %ser Session s sin1 ! SC=&&<NBS<7 -rior to cre !tio n o6 ! #$?T.) =n the oth er h!n d, the e+ist e n c e o6 ! Sho--i n 1 Session re9 ire s both the !ssi1n 2 e n t o6 ! SC=&&<NBS<7 !nd the cre! tio n o6 !n initi!li:ed #$?T. $ Sho- -i n 1 Session c!n be est ! blish e d e!rlier th!t the 6irst Sho--i n 1 #!rt 0eb inter ! c tio n, b t once the 6irst Sho--i n 1 #!rt 0eb inter ! c ti on is e+ ec t e d , the Sho--i n 1 Session mu s t be est ! blish e d . '#l! s e 2.1.,.) The st!t e tr!n sition di!1r ! 2 th!t 6ollo0s is !n ill str!tio n o6 the !bov e .
B'4
T$ e S t a t e ?a u e s
The di!1r ! 2 sho0s tr!n sition s in the st!t e s o6 thre e ite2 s !sso ci ! t e d 0ith ! %ser Sessio n. Thes e thre e ite2 s, !lon 1 0ith ho0 their st!t e s !re re-r e s e n t e d in the di!1r ! 2 , !re. 2te m SC=&&<NBS<7 Po s s i b e st a t e s of ite m SC=&&<NBS<7 [ No SC=&&<NBS<7 [ Kes Sho--i n 1 Sessio n Sho--i n 1 Ses sio n [ No Sho--i n 1 Ses sio n [ Kes #$?T #$?T [ No #$?T [ A2-t ; #$?T [ N ite2 s %eg e n # . The rect ! n 1 l ! r 's9 !r e st!t e. The bo+ e s 0ith ro n d e d 1en e r !ll; 6lo0s do0n the -!1 e, in !re sho0n 6 rth e r do0n the -!1 e . $ #$?T doe s not e+ist. $n initi!li:ed #$?T e+ist s 0ith :ero ite2 s in it. $ #$?T e+ists 0ith N ite2 s in it. corn er e d ) bo+ e s re-r e s e n t eve n t s th!t c! s e ch! n 1 e s in corn er s sho0 -ossibl e st!t e s o6 the thre e ite2 s. Ti2e the sens e th!t tr!n sition s th!t occ r l!ter in ! %ser Session The ter2 intr. is !n !bbr e vi ! tio n 6or 0eb inter ! c tio n. Mea n i n g %ser Session does not h!v e ! SC=&&<NBS<7 !ssi1n e d . %ser Session does h!v e ! SC=&&<NBS<7 !ssi1n e d . $ Sho- -i n 1 Sessio n h!s not be e n est ! blish e d . $ Sho- -i n 1 Sessio n h!s be e n est ! blis h e d .
T&# Bench2!r8I W
&!1e cl+vii
B'6
T$ e s t a t e Tr a n s i ti o n )i a g r a m
E randoml* selects a =SM& and starts the =ser Session
.st Home intr) SH6PPI;9<I& A Des Sho''ing Session A Des C(RT A Em't* S=T can establish either of these states 'rior to .st Sho''ing Cart intr)
SH6PPI;9<I& A Des Sho''ing Session A ;o C(RT A ;o S=T maintains Sho''ing Session $A / hours from creation of C(RT: after 7hich Sho''ing Session can be destro*ed !C(RT deleted: SH6PPI;9<I& can be reused%
If Sho''ing Session A Des =ser Session ends before .st Sho''ing Cart intr)
If Sho''ing Session A ;o
SH6PPI;9<I& can be reused
.st Sho''ing Cart intr) or subsequent Sho''ing Cart interactions 7 Cart em't*
SH6PPI;9<I& A Des Sho''ing Session A Des C(RT A . Item
Sho''ing Cart intr) 7hen C(RT not em't*
SH6PPI;9<I& A Des Sho''ing Session A Des C(RT $A . Item
u* Confirm intr) succeeds
SH6PPI;9<I& A Des Sho''ing Session A Des C(RT A Em't*
=ser Session ends after .st Sho''ing Cart intr)
S=T maintains Sho''ing Session $A / hours from creation of C(RT: after 7hich Sho''ing Session can be destro*ed !C(RT deleted: SH6PPI;9<I& can be reused%
T&# Bench2!r8I W
&!1e cl+viii
B'8 C o m m u n i c a t i o n b e t " e e n RBE a n # S 9T o f e 3 i s t e n c e o f S $ o p p i n g S e s sion

The 6ollo0in1 in6or2 ! tio n is not c!-t r e d in the 6ore1oi n 1 st!t e tr!n sition di!1r ! 2 . =nce ! Sho--i n 1 Session h!s be e n est ! blish e d , #l! s e 2.1., re9 ire s th!t in !ll s bs e 9 e n t 0eb inter ! c tio n s the ?BA co2 2 ni c ! t e s to the S%T th!t ! Sho- -i n 1 Sessio n is !ctive. Bec! s e the S%T h!s the 6le+ibilit; to est ! blish ! Sho- -i n 1 Session -rior to the 6irst Sho--i n 1 #!rt 0eb inter ! c ti on o6 the %ser Sessio n, the ?BA, c!nn o t de- e n d on the e+ec ti on o6 the 6irst Sho- -i n 1 #!rt 0eb inter ! c ti on !s ! tri11er 6or it to st!rt co2 2 ni c ! ti n 1 to the S%T th!t ! Sho- -i n 1 Sessio n e+ist s. Ther e6or e, the S%T 2 st co2 2 ni c ! t e to the ?BA est ! blis h e d . =nce the ?BA receiv e s this in6or2 ! ti o n, b!c8 to the S%T in !ll s bs e 9 e n t 0eb inter ! c tion s. ?BA, th!t det e r 2 i n e s 0hen ! Sho- -i n 1 Session h!s $nd it is the S%T th!t instr ct s the ?BA on ho0 to in6or2 ! tio n b!c8 to the S%T d rin1 s bs e 9 e n t e+ch ! n 1 e o6 ! #oo8ie is !n e+! 2 -l e o6 ! 2ec h ! ni s 2 0hen ! Sho- -i n 1 Sessio n h!s be e n it 2 st co2 2 ni c ! t e this s! 2 e 6!ct <n other 0ords, it is the S%T, not the bee n st!rt e d on beh !l6 o6 the %ser. co2 2 ni c ! t e the Sho--i n 1 Session re9 e s t s 6or 0eb inter ! c tion s. The th!t co ld be se d 6or this - r-o s e .
T&# Bench2!r8I W
&!1e
cl+i+
A p p e n # i 3 C , 2NTR.)9CT2.N T. S S%
C' &
.- er-i e "
SS@ is the !cron ; 2 6or Sec r e Soc8et @!;er, ! -rotoc ol dev elo - e d b; Netsc ! - e 6or 2 ! n ! 1i n 1 sec r e 'encr;- t e d ) co2 2 ni c ! ti o n s in ! net0or8. Netsc ! - e h!s o66ere d SS@ !s ! -ro-o s e d st!n d ! r d -rotoc ol to the World Wide Web #onsorti 2 'W5#) !nd the <ntern e t An1in e e ri n 1 T!s8 Force '<ATF) !s ! st! n d ! r d sec rit ; !--ro ! c h 6or Web bro0s er s !nd serv er s. Netsc ! - e H s SS@ se s the - blic* !nd* -riv!t e 8e; encr;- tio n s;st e 2 6ro2 ?S$, 0hich !lso incl d e s the se o6 ! di1it !l certi6ic!t e 6or the serv er. ?S$ i2-le 2 e n t e d - blic/-riv! t e 8e; encr;- ti on, c!lled !s;2 2 e t ri c encr;- ti on, 0hich ses t0o nli8e 8e;s 6or sec r e co2 2 ni c ! ti o n. The SS@ -rotoc ol is initi!t e d b; ! h!n d s h ! 8 e 0her ei n client !nd serv er e+ch ! n 1 e in6or2 ! tio n !nd !1r e e on ci-her s. <t is the h!n d s h ! 8 e -h! s e o6 the SS@ co2 2 ni c ! ti o n, th!t 2 !8 e s s e o6 the serv erLs di1it !l certi6ic!t e. =-tion !ll;, the client s c!n !lso h!v e di1it !l certi6ic!t e s. Co0ev er this benc h 2 ! r 8 does not re9 ir e si2 l !t e d client s 'the ABLs) to se di1it !l certi6ic!t e s 6or SS@. $ di1it !l certi6ic!t e is !n electro nic Ncredit c!rdN th!t est ! blis h e s the hold er s cred e n t i !l s 6or doin1 b sin e s s or oth er tr!n s ! c ti o n s on the Web. <t is iss e d b; ! certi6ic!tion ! t h orit; '#$). <t cont !i n s his n! 2 e , ! seri!l n 2 b e r , e+-ir!tion d!t e s, ! co-; o6 the certi6ic!t e holderHs - blic 8e; ' se d 6or encr;- ti n 1 !nd decr;- ti n 1 2 es s ! 1 e s !nd di1it!l si1n ! t r e s ), !nd the di1it!l si1n ! t r e o6 the certi6ic!t e* iss in1 ! t h orit; so th!t ! reci-i en t c!n veri6; th!t the certi6ic!t e is re!l. So2 e di1it!l certi6ic!t e s con6or 2 to ! st! n d ! r d , J.509. 7i1it!l certi6ic!t e s c!n be 8e-t in re1istrie s so th!t ! t h e n t i c ! t e d ser s c!n loo8 - other sers H - blic 8e;s. 7i1it!l certi6ic!t e s cont !i n the hold erLs &%B@<# 8e;. T;-ic!ll;, the certi6ic!t e hold er 'in this c!s e the serv er) sen d s his certi6ic!t e to his -!rt n e r 'in this c!s e the client). The client ses the server - blic 8e;, 6o nd in the certi6ic!t e, to encr;- t in6or2 ! tio n. =nl; the holder o6 the 2!t c hi n 1 &?<V$TA 8e; c!n decr;- t this d!t !. @in8s to s! 2 -l e di1it!l certi6ic!t e s c!n be 6o nd !t the 6ollo0in1 0eb site. htt-.//sit e s e ! r c h . n e t s c ! - e . c o 2 / - r o d c t s / s e c ri t ;/ t e c h n ol o 1 ;/ c e r ti6ic!t e s . h t 2 l. $noth er 1ood so rc e o6 in6or2 ! tio n is on the 0eb !t. htt-.//000.so6t0 ! r e .i b 2 . c o 2 / c o 2 2 e r c e / r e 1i s t r ;/ -ri 2 e r. h t 2 l 7!t ! encr;- t e d b; the client d rin1 the SS@ h!n d s h ! 8 e !ct !ll; 6or2 s the b!sis o6 the 8e; th!t 0ill be se d 0ith the select e d ci-her 'e.1. 7AS) to encr;- t the d!t ! cont e n t sent bet0 e e n client !nd serv er. Follo0in1 the h!n d s h ! 8 e !nd est ! blish 2 e n t o6 !n SS@ ses sion, !ll sec r e 0eb inter ! c ti on s 6lo0in1 on this SS@ ses sion 2 st be encr;- t e d sin1 the select e d ci-her !nd the ses sion 8e; est ! blish e d 6or this ses sion.
T&# Bench2!r8I W
&!1e
cl++
C' 4
S S% ? 6 S p e c i fi c a t i o n s
SS@ V5 s-eci6ic!tio n s !re !v!il! bl e !t v!rio s 0eb sites incl din1 the 6ollo0in1 '!s o6 Se-t. 1999). htt-.//ho 2 e . n e t s c ! - e . c o 2 / e n 1 / s sl 5/ s sl* toc.ht 2 l htt-.//000.l! nl.1ov/ -roE e ct s/i !/ s t d s /i ! 8 5 0 8 1 0 . h t 2 l &le!s e not e, %?@ re6er e n c e s 6o nd in this doc 2 e n t 0ere !cc r ! t e !t the ti2 e it 0!s 0ritte n. B t %?@ lin8s !re notorio sl; e-h e 2 e r ! l . Sho ld ;o discov er the re6er e n c e s to be inv!lid, -le! s e noti6; the T&#*W s bco 2 2 i t t e e !nd this doc 2 e n t 0ill be -d ! t e d .
C' 6
S S% ? 6 2m p e m e n t a t i o n To o !i t s
There !re 2! n ; version s o6 SS@ tool8its !nd encr;- tio n libr!rie s !v!il! bl e to dev el o - e r s 0ishin1 to en ! bl e Web Serv ers 6or SS@ or b ild bro0s e r e2 l ! tio n tools. Netsc ! - e H s NSS -ro1r ! 2 libr!r; c!n be do0nlo ! d e d 6or nonco 2 2 e r ci !l se or licens e d 6or co2 2 e r ci !l se. The 2ost -o- l !r SS@ libr!r; is SS@e!;, 0hich c!n be do0nlo ! d e d htt-.//000.ssl e ! ;. or 1/ . SS@e!; is ! 6ree i2-le 2 e n t ! t i o n o6 Sec r e Soc8et @!;er. SS@e!; is -rono n c e d S*S*@*e* !* ; 'i.e. e!c h lett er is -rono n c e d individ !ll;). SS@e!; i2-le 2 e n t s both SS@v2 'version 2) !nd SS@v5 'version 5) !nd T@Sv1 !s o6 the rele ! s e o6 SS@e!;* 0.9.0. 7oc 2 e n t ! t i o n 6or b ildin1 !nd sin1 the libr!r; c!n be 6o nd !t htt-.//000.- s ;. 9 . e d . ! / e 6 t - /#r;- t o/ s sl e ! ;/ . #r;-tS o6t &t; @td !ct s !s ! 6oc!l -oint 6or cons ltin1 !ctivities b!s e d !ro n d intern e t cr;-t o 1r ! - h ; 0ith s-eci6ic 6oc s on SS@e!; !nd SS@!-- s. $noth er se6 l so rc e o6 in6or2 ! tio n is htt-.//000.rs !. c o 2 / r s !l ! b / . 6ro2
C' 8
. b t a i n i n g a S e r - e r )i g i t a C er tifi c a t e f o r Te s t i n g
7i1it!l certi6ic!t e s !re iss e d b; ! #erti6ic!t e $ thorit; '#$). The; s !ll; cost sev er !l h ndr e d doll!rs !nd e!c h Web Server host 2!c hi n e s !ll; h!s its o0n certi6ic!t e . The host n! 2 e !nd do2 !i n n! 2 e !re enco d e d in the certi6ic!t e . %sin1 ! certi6ic!t e 6or ! di66ere n t serv er 1en e r !ll; does not 0or8. There !re sev er !l 2et h o d s 6or obt !inin 1 ! di1it !l certi6ic!t e 6or testin 1 - r-o s e s 0itho t inc rrin1 the licens e 6ee. #erti6ic!t e $ thorities 0ill 1en e r !ll; -rovid e ! 6ree test certi6ic!t e, v!lid 6or so2 e short ti2 e -eriod o6 ti2 e. For e+ ! 2 -l e , ;o c!n obt !i n ! 6ree certi6ic!t e , v!lid 6or t0o 0ee8 s, 6ro2 Verisi1n #or-. $lso Th!0t e -rovid e s 6ree di1it!l certi6ic!t e s 6or testin 1. See the 6ollo0in1 0eb site. htt- s.//000.t h ! 0 t e . c o 2 / c 1i/ s e r v e r/ t e s t . e + e . So2 e oth er #erti6ic!t e $ thorities !re BTA*#;berTr s t, >e;0itn e s s , !nd Tr!d e 0 ! v e .
T&# Bench2!r8I W
&!1e
cl++i
$n e!si er 2 et h o d 6or obt !i ni n 1 ! test certi6ic!t e is to b ild it ;o rs el6. This c!n be !cco 2 -lis h e d 0ith the SS@e!; tool8it. See htt-.//000.int er tr ! d e r . c o 2 /libr !r ;/S S@e ! ;/ n oSrs !. c6 2 ] o 0 n c ! . M!n; Web Serv ers !lso h!v e the !bilit; to !ct !s ! #erti6ic!t e $ thorit; !nd sel6* certi6; their o0n certi6ic!t e s . This is not reco 2 2 e n d e d 6or -rod ctio n s;st e 2 s , b t it is se6 l 6or testin 1. ?e!d the doc 2 e n t ! t i o n 6or ;o r -!rtic l !r Web Server. <ntel o66ers 7i1it!l #erti6ic!t e M!n! 1 e r so6t0!r e ;o c!n do0nlo ! d. The 7i1it!l #erti6ic!t e M!n! 1 e r is ! s! 2 -l e !--lic!tion th!t !llo0s end* sers to vie0 e+istin1 di1it!l certi6ic!t e s !nd cre !t e ne0 di1it!l certi6ic!t e s. The certi6ic!t e 2 ! n ! 1 e r dis-l !;s st!n d ! r d n! 2 e !nd !ddr e s s 6ields -res e n t in 2ost t;-e s o6 certi6ic!t e s , !s 0ell !s 1r!- hi c !l d!t ! s ch !s ! -hot o o6 the certi6ic!t e o0ner or ! di1iti:e d c rsive si1n ! t r e o6 th!t o0ner. See. htt-.//000.int el.co 2 /i !l/s e c rit ;/ c d s ! / d c 2 . h t 2
T&# Bench2!r8I W
&!1e cl++ii
A p p e n # i 3 ) , )ATABA SE P . P 9%AT2.N RAT2.NA%E
)'&
) e ri - a t i o n o f 4 ( ( + Cu s t o m e r s p e r Br o " s e r
Thin8 ti2 e -er inter ! c tio n ?es-o n s e ti2 e -er inter ! c ti on Ti2e -er ses sion Me!s r e 2 e n t <nterv !l Sessio n s -er Me!s r e 2 e n t <nterv !l T;-e s o6 Me!s r e 2 e n t interv !l s [ [ [ [ [ [ , seco n d s '0ith ne1 ! tiv e e+-o n e n ti !l distrib tion) 5 seco n d s !v1. 90P U 20 seco n d s 15 2in t e s 50 2in t e s 2 W<&S, W<&Sb, W<&So
0.1( 2 8 inter ! c tio n s -er seco n d -er conc rr e n t bro0s e r !ss 2 i n 1 ! res-o n s e ti2 e o6 :ero Cust o m e r s ( (0 (00 Bro " s e r Hour s 1 10 100 6+ )a* Tota Cust o m e r s 2,880 28,8 0 0 288,0 0 0
%sin1 50 d!;s o6 ser in6or2 ! ti o n. 50 d!;s + 2( ho rs + ( sessio n s -er bro0s er ho r [ 2880 c st o 2 e r sessio n s -er 50 d!; -eriod -er bro0s e r The c!rdin !lit; o6 c st o 2 e r t!bl e is. 2880 ^ 'n 2 b e r. o6 conc rr e n t bro0s e r s) Ther e6or e, 1,00 0 conc rr e n t bro0s er s ;ields. 2,88 0, 0 0 0 c sto 2 e r t!bl e ro0s M!+i2 2 o6 1(2.8 W<&S ''1/, inter ! c ti on / thin8 ti2 e) ^ 1,000) $ver! 1 e o6 100.0 W<&S ''1 / ', X 5) inter ! c ti on / 'thin8 ti2 e X res-o n s e ti2 e)) ^ 1,00 0)
)'4
9 s i n g ( $ r s o f P e a ! T$r o u g $ p u t t o C o m p u t e S t o r a g e
Aven tho 1 h the environ 2 e n t bein1 2od el e d is ! 2( ho r o-er ! tio n, the tr!66ic to the site is not ni6or 2l; distrib t e d thro 1 h o t the d!;. <t t;-ic!ll; 1oe s thro 1 h ! co -l e o6 ho rs o6 -e!8 tr!66ic 6ollo0ed b; ! l ll, to be -ic8e d - !1!i n, !nd so 6orth. Feed b ! c 8 6ro2 e+istin1 sites indic!t e -e !8 thro 1 h - t to be 2.6 to 5.5 ti2 e s the !ver ! 1 e thro 1 h - t . This is e9 iv !l e n t to 9.2 to ,.2 ho rs o6 -e !8 thro 1 h - t . There6or e, the 8hrs o6 -e!8 thro 1 h - t is !n !tt e 2 - t !t 2od elin 1 the vol 2 e 6l ct ! tio n t;-ic!ll; se e n in ! 2( ho r environ 2 e n t .
T&# Bench2!r8I W
&!1e cl++iii
A p p e n # i 3 E , S AM P%E P SE9 ) .,C.)E
Co2 e 0eb inter ! c ti on
Select 7<ST<N#T #SFN$MA,#S@N$MA 6ro2 #%ST=MA? 0her e #S%N$MA[3#S%N$MA select to- 50 <S<7,<ST<T@A,$SFN$MA,$S@N$MA 6ro2 <TAM , $%TC=? 0her e $S<7 [ <S$S<7 $N7 <SS%B"A#T @<>A 3#!t e 1 o r ;<7 order b; <S&%BS7$TA desc,<ST<T@A
Ne0 &rod ct s 0eb inter ! c ti on
Best Sellers 0eb inter ! c tio n
decl!r e 3l!stSo n 2 e ri c'1 0) select to- 5555 =S<7 into ] t e 2 - 6ro2 =?7A?S order b; =S7$TA desc select 3l!stSo [ 2in'=S<7) 6ro2 ] t e 2 select to- 50 <S<7,<ST<T@A,$SFN$MA,$S@N$MA 6ro2 <TAM, $%TC=? ,=?7A?S@<NA 0her e =@S=S<7 V 3l!stSo $N7 <S<7 [ =@S<S<7 $N7 <S$S<7 [ $S<7 $N7 <SS%B"A#T [ 3#!t e 1 o r ;<7 1ro - b; <S<7,<ST<T@A,$SFN$MA,$S@N$MA order b; S%M'=@SDTK) desc SA@A#T 7<ST<N#T ^ F?=M <TAM,$%TC=? WCA?A $%TC=?.$S<7 [ <TAM.<S$S<7 $N7 <TAM.<S<7 [ 3Boo8<7 SA@A#T to- 50 <ST<T@A,<S<7,$SFN$MA, $S@N$MA F?=M <TAM,$%TC=? WCA?A <S$S<7 [ $S<7 $N7 ' $S@N$MA @<>A HP H X 3$ thor X HPH =? $S@N$MA @<>A 3$ thor X HPH ) order b; <ST<T@A SA@A#T T=& 50 <ST<T@A, <S<7, $SFN$MA, $S@N$MA F?=M <TAM, $%TC=? WCA?A <S$S<7 [ $S<7 $N7 ' <ST<T@A @<>A HP H X 3Title X HPH =? <ST<T@A @<>A 3Title X HPH ) order b; <ST<T@A
&rod ct 7et!il 0eb inter ! c ti on Se!rc h ?es lt 0eb inter ! c tio n 'b; $ thor)
Se!rc h ?es lt 0eb inter ! c tio n 'b; Title)
Se!rc h ?es lt 0eb inter ! c tio n 'b; S bEect)
SA@A#T T=& 50 <ST<T@A,<S<7, $SFN$MA, $S@N$MA F?=M <TAM, $%TC=? WCA?A <S$S<7 [ $S<7 $N7 <SS%B"A#T @<>A 3#!t e 1 o r ;<7 order b; <ST<T@A select #S<7 6ro2 #%ST=MA? 0her e #S%N$MA[3#S%N$MA !nd #S&$SSW7* 3#S&$SSW7 7A#@$?A 3=S<7 n 2 e ric'1 0) =?7A?S 0her e =S#S<7[3#S<7 select 3=S<7 [ 2 !+'=S<7)6ro2
=rder 7is-l!; 0eb inter ! c tio n
T&# Bench2!r8I W
&!1e cl++iv
SA@A#T #SFN$MA,#S@N$MA,#SAM$<@,#S&C=NA, =S<7,=S7$TA,=SS%BT=T$@,=ST$J,=ST=T$@,=SSC<&STK&A,=SSC<&S7$TA, =SB<@@S$77?,=SSC<&S$77?,=S##STK&A,=SST$T%S, $77?SST?AAT1,$77?SST?AAT2,$77?S#<TK,$77?SST$TA,$77?ST<&,#= SN$MA F?=M #%ST=MA?,$77?ASS,#=%NT?K,=?7A?S 0her e =S<7[3=S<7 !nd #S<7[3#S<7 !nd =SB<@@S$77?[$77?S<7 $N7 $77?S#=S<7[#=S<7
Select $77?SST?AAT1,$77?SST?AAT2,$77?S#<TK, $77?SST$TA,$77?ST<&,#=SN$MA 6ro2 $77?ASS,#=%NT?K0her e $77?S<7[3$S<7 !nd $77?S#=S<7[#=S<7 select =@S<S<7,<ST<T@A,<S&%B@<SCA?, <S#=ST,=@SDTK,=@S7<S#=%NT,=@S#=MMANTS6ro2 =?7A?S@<NA,<TAM 0her e =@S<S<7[<S<7 !nd =@S=S<7[3=S<7 <nsert into SC=&&<NBS#$?T v!l e s'3S e s si o n, 0,3Boo8<7,1, 3Title,3S?&,3#=ST,3B!c8in1,B e t 7 ! t e ')) %-d!t e SC=&&<NBS#$?T set S#SDTK[3DTK 0her e S#S<7[3%s e r<7 !nd S#S<S<7[3Boo8<7 7elet e 6ro2 SC=&&<NBS#$?T 0her e S#S<7[3%s e r<7 !nd S#S<S<7[3Boo8<7
Sho- -i n 1 #!rt 0eb inter ! c ti on '$dd to #!rt) Sho- -i n 1 #!rt 0eb inter ! c ti on '?e6res h 7is-l!;)
T&# Bench2!r8I W
&!1e cl++v
B ; ?e9 e s t 0eb inter ! c ti on 'Ne0 # sto 2 e r)
7A#@$?A 3n 2 n 2 e ri c'1 0) SA@A#T 3n 2 [ c o n t '^) F?=M #%ST=MA? WCA?A #S%N$MA [ 3# st<7 select 3n 2 7A#@$?A 3#=S<7 n 2 e ri c'() 7A#@$?A 3$77?S<7 n 2 e ri c'1 0) Select 3#=S<7 [ #=S<7 6ro2 #=%NT?K 0her e #=SN$MA[3#=SN$MA SA@A#T $77?S<7 F?=M $77?ASS WCA?A $77?SST?AAT1 [ 3$77?SST?AAT1 !nd $77?SST?AAT2 [ 3$77?SST?AAT2 !nd $77?S#<TK[3$77?S#<TK !nd $77?SST$TA[3$77?SST$TA !nd $77?ST<&[3$77?ST<& !nd $77?S#=S<7 [ 3#=S<7 7A#@$?A 3#=S<7 n 2 e ri c'()7A#@$?A 3$77?S<7 n 2 e ri c'1 0)7A#@$?A 3#%STS<7 n 2 e ri c'9)S el e c t 3#=S<7 [ #=S<7 6ro2 #=%NT?K 0her e #=SN$MA[3#=SN$MA <nsert into $77?ASS v!l e s'3$77?SST?AAT1,3$77?SST?AAT2,3$77?S#<TK,3$77?SST$T A,3$77?ST<&,3#=S<7) select 3$77?S<7 [ 33ide ntit ; <nsert into #%ST=MA? v!l e s'3#S%N$MA,3#S&$SSW7,3#SFN$MA,3#S@N$MA,3$77?S<7,3# S&C=NA,3#SAM$<@,1et d ! t e '),1 e t d ! t e ' ),N%@@,N%@@,3#S7<S#=%NT,0,0,3 #SB<?CT7$K,3#S7$T$1,3#S7$T$2) select 3#%STS<7 [ 33ide ntit ; select 3#%STS<7 select #S<7 6ro2 #%ST=MA? 0her e #S%N$MA[3#S%N$MA !nd #S&$SSW7[3#S&$SSW7 SA@A#T #S%N$MA,#S&$SSW7,#SFN$MA,#S@N$MA,#S&C=NA, #SAM$<@,#SB<?TC7$TA,#S7$T$1,#S7$T$2,$77?SST?AAT1, $77?SST?AAT2,$77?S#<TK,$77?SST$TA,$77?ST<&,#=SN$MA F?=M #%ST=MA?,$77?ASS,#=%NT?K 0her e #S$77?S<7[$77?S<7 !nd $77?S#=S<7[#=S<7 !nd #S<7 [ 3#S<7 7A#@$?A 3#=S<7 n 2 e ri c'() 7A#@$?A 3$77?S<7 n 2 e ri c'1 0) Select 3#=S<7 [ #=S<7 6ro2 #=%NT?K 0her e #=SN$MA[3#=SN$MA SA@A#T $77?S<7 F?=M $77?ASS WCA?A $77?SST?AAT1 [ 3$77?SST?AAT1 !nd $77?SST?AAT2 [ 3$77?SST?AAT2 !nd $77?S#<TK[3$77?S#<TK !nd
B ; ?e9 e s t 0eb inter ! c ti on 'A+istin1 # sto 2 e r)
B ; #on6ir2 0eb inter ! c tio n
T&# Bench2!r8I W
&!1e cl++vi
$77?SST$TA[3$77?SST$TA !nd $77?ST<&[3$77?ST<& !nd $77?S#=S<7[3#=S<7 Select 3#=S<7 [ #=S<7 6ro2 #=%NT?K 0her e #=SN$MA[3#=SN$MA <nsert into $77?ASS v!l e s'3$77?SST?AAT1, 3$77?SST?AAT2,3$77?S#<TK,3$77?SST$TA,3$77?ST<&, 3#=S<7) select 3$77?S<7 [ 33ide ntit ; select #S<7,#S7<S#=%NT,#S$77?S<7 6ro2 #%ST=MA? 0her e #S%N$MA[3%s er<7 7A#@$?A 3=S<7 n 2 e ric'9) <nsert into =?7A?S v!l e s '3=S#S<7,1et d ! t e '),3=SS%BT=T$@, 3=ST$J,3=ST=T$@,3=SSC<&STK&A,N%@@,3=SB<@@S$77?, 3=SSC<&S$77?,3=S##STK&A,3=S##SN%M,3=S##SN$MA, 3=S##SAJ&,H&en di n 1H) select 3=S<7 [ 33ide ntit ; <nsert =?7A?S@<NA '=@S=S<7,=@S<S<7,=@SDTK, =@S7<S#=%NT,=@S#=MMANTS) Select 3=S<7,S#S<S<7,S#SDTK,1,Hco 2 2 e n t H 6ro2 SC=&&<NBS#$?T -d ! t e <TAM set <SST=#> [ <SST=#> * S#@S<SDTK X c!s e 0hen '<SST=#> * S#@S<SDTK U 10) the n 21 else 0 end 6ro2 SC=&&<NBSB$S>AT 0her e S#SSC=&&<NBS<7[3S e s si o n !nd S#SC=ST[3S#SC=ST !nd S#@S<S<7 [ <S<7 7elet e 6ro2 SC=&&<NBS#$?T 0her e S#S<7[3S e s si o n <nsert into ##SJ$#TS v!l e s'3=S<7,3=S##STK&A,3=S##SAJ&,3=S##S$%TC,3=ST=T$@,1et d !t e'),3#=S<7) Select 3=S<7 SA@A#T 7<ST<N#T ^ F?=M <TAM,$%TC=? WCA?A $%TC=?.$S<7 [ <TAM.<S$S<7 $N7 <TAM.<S<7 [ 3Boo8<7 %-d!t e <TAM set <S#=ST[3#ost,<S&%BS7$TA [ 37!it, <S<M$BA [ 3Bi6S@oc 0her e <S<7[3<te 2 S<7 decl!r e 3=S<7 n 2 e ri c'9)
$d2in ?e9 e s t 0eb inter ! c ti on $d2in #on6ir2 0eb inter ! c ti on
T&# Bench2!r8I W
&!1e cl++vii
select to- 1000 0 =S<7 into ] t e 2 - 6ro2 =?7A?S order b; =S7$TA desc s el e c t 3=S<7 [ 2in'=S<7) 6ro2 ] t e 2 select =S#S<7 into ] t e 2 6ro2 =?7A?S, =?7A?S@<NA 0her e =S<7 V 3=S<7 !nd =S<7[=@S=S<7 !nd =@S<S<7[3<S<7 1ro - b; =S#S<7, =S7$TA order b; =S7$TA desc select to- 5 =@S<S<7 6ro2 =?7A?S, ] t e 2 - , =?7A?S@<NA 0her e =S<7 V 3=S<7 $N7 =?7A?S.=S#S<7[ ] t e 2 - . =S#S<7 !nd =S<7[=?7A?S@<NA.=@S=S<7 !nd not'=?7A?S@<NA.=@S<S<7[3<S<7) 1ro - b; =@S<S<7 order b; s 2'=?7A?S@<NA.=@SDTK)
T&# Bench2!r8I W
&!1ecl++viii
A p p e n # i 3 5 , S AM P%E HTM% C.)E
5' &
A # m i n C o n fir m
UCTM@V UCA$7V UT<T@AVT&#* W $d2in #on6ir2 &!1e U /T<T@AV U /CA$7 V UB=7K BB#=@=? [N ] FFFFFFNV UC1 $@<BN[N#ANTA?NVT&# Web #o22 e r c e Bench 2 ! r 8 'T&#*W)U/C1 V UC2 $@<BN[N#ANTA?NV U <MB S?#[Nt - cl o1o. 1i6N $@<BN[NB=TT=MN B=?7A?[N0N W<7TC[N2 8 8 N CA<BCT[N6 ,N V U / C 2 V UC2 $@<BN[N#ANTA?NV$d 2i n #on6ir2 &!1e U / C 2 V UC2 V & r o d c t %-d! t e d U / C 2 V UC2 V Ti tl e. Fi+ed, othe r v!l e s 0ill h!ve to B$B$=B%@SASAB$ 2e e t U / C 2 V U& V$ t h o r. X d,N B$B$B$%@?AB$$TU/& V U& V 7 e s c ri - ti on. U<V / !3! d c b 8 9 h 5@v&5S<shln0><%N6^=3 8BM/5N$ n00 -W ! 2 - GE MB+;0 a O Y? ] oJK* d<W ! 2 - G :%o5 vP [ - d -EF8W! 2 -G 8=EV"9iA2;v^$M9h^2$vhV0i ] ! 5 ] vKO8&Y:Y=2;TM ] ] [ = ?V& e 1"&5vYr70 6S"da+b. 0CWT>%O##( a<JcJ<^W! 2 -G cW ! 2 - GY d ] t * W!2-G"',G#6J' X@7 X 0B ("#d1.'%* &9 ]BCY\o.v3BbK5c86,%!c 8=v+ ] C a 8 5S bB 2 [ '@ MCVTC.c>(@6si: d , ! E e D : P 5 2 M +K)/5+#KcXW 9W ! 2 - G DD X 0)>#@9W! 2 - GBc=h9/B^ TCa>Yts)rnd \= O@E>5YS7e 0e O ( 9 b ] 3 a Ml* [ dBGSo1Z<'<0d;SZO 5 ;'"1Mv- e* *S0bVrh 2. ! K[.@cTo+ 0T3-dW \a 0 \K70nVicSB?* 1 KW!2-G.l U /<V U / & V U <MB S?#[Ni12 5 ( 5 .E - 1N $@<BN[N?<BCTN B=?7A?[N0N W<7TC[N2 0 0N CA<BCT[N20 0N V U <MB S?#[Nt 8 8 5 6 2 .E - 1N $@<BN[N?<BCTN B=?7A?[N0N W<7TC[N1 0 0N CA<BCT[N1 5 0N V UB@=#>D%=TA V U& V U B V S 1 1 e s t e d ?et !il. M556. ( ( U / B V U B ? V U B V = r &rice. U /B V U F =NT #=@=? [N ] 77 0 0 0 0 N V U B V M5(5. 5 5 U /B V U / F =NT V U B ? V U B V K o S!ve. U /B V U F =NT #=@=? [N ] 77 0 0 0 0 N V U B V M210. 9 1 U /B V U / F =NT V U / & V U / B@=#>D%=TAV U7@ V U7T V U F =NT S<TA[N2N V C$?7B$#>, 295 -!1e s U B ? V & blis h e d b; ] X M VS b 0d bKS/ [ 6 c 8O 9 d r ( P U B ? V & blic ! tio n d!t e. 10* 29* 1999 U B? V 7i 2 e n si o n s 'in inche s). (0.20 + 28.9( + 69.05 U B? V <SBN. EWc2cai>OKcM*U/F=NTV U / 7T V U / 7@ V U& $@<BN[N#ANTA?NV U $ C?AF[Nt- c 0. dllOs e ! r c hWS e s sio n [ 1 5 , 0 W#S<7 [ 0N V U <MB S?#[Ns e ! r c h . 1i6N $@T[NSe ! r c hN B=?7A?[N0N W<7TC[N1 2 0 N CA<BCT[N5 0N V U / $ V U $ C?AF[Nt - c 0. dllO ho 2 e W S e s si o n [ 1 5 , 0 W#S<7 [ 0N V U <MB S?#[Nh o 2 e . 1i6N $@T[NCo 2 e N B=?7A?[N0N W<7TC[N1 2 0N CA<BCT[N5 0N V U / $ V U / & V U / B =7K V U / CTM@V
5' 4
A# min R e B u e s t
UCTM@V UCA$7V UT<T@AVT&#* W $d2in ?e9 e s t &!1e U /T<T@AV U / CA$7 V UB=7K BB#=@=? [N ] FFFFFFNV UC1 $@<BN[N#ANTA?NVT&# Web #o22 e r c e Bench 2 ! r 8 'T&#*W)U/C1 V UC2 $@<BN[N#ANTA?NV U <MB S?#[Nt - cl o1o. 1i6N $@<BN[NB=TT=MN B=?7A?[N0N W<7TC[N2 8 8 N CA<BCT[N6 ,N V U / C 2 V UC2 $@<BN[N#ANTA?NV$d 2i n ?e9 e s t &!1e U / C 2 V UC2 $@<BN[N#ANTA?NVTitle. Fi+ed, other v!l e s 0ill h!ve to B$B$=B%@SASAB$ 2e e t U / C 2 V U& $@<BN[N@AFTNV$ t h o r X d,N B$B$B$%@?AB$$TUB? V U / & V U <MB S?#[Ni88 5 6 2 .E - 1N $@<BN[N?<BCTN B=?7A?[N0N W<7TC[N2 0 0N CA<BCT[N20 0N V U <MB S?#[Nt 8 8 5 6 2 .E - 1N $@<BN[N?<BCTN B=?7A?[N0N W<7TC[N1 0 0N CA<BCT[N1 5 0N V U& V U B ? V U B ? V U / & V UF=?M $#T<=N[Nt -c 0. dllO#h ! n 1 e<n6oWSe s sio n [ 1 5 , 0 W#S<7 [ 0W<S<7[ 8 8 5 6 2 N MATC=7[N&=STN V UT$B@A B=?7A? [N0N V UT? V UT7 V U B V S 1 1 e s t e d ?et!il. U /B V U / T7 V UT7 V U B V M 5 5 6 . ( ( U / B V U / T 7 V U / T? V
T&# Bench2!r8I W
&!1e cl++i+
UT? V UT7 V U B V = r # rre nt &rice. U / B V U / T7 V UT7 V U F =NT #=@=? [N ] d d 0 0 0 0 N V U B V M 5 5 5 . 5 5 U / B V U / F =NT V U / T7 V U / T? V UT? V UT7 V U B V A n t e r Ne0 &rice U / B V U / T7 V UT7 $@<BN[N?<BCTNV M U <N&%T TK&A[Nte +tN N$MA[N-riceN V U / T7 V U / T? V UT? V UT7 V U B V A n t e r Ne0 &ict r e U / B V U / T7 V UT7 $@<BN[N?<BCTNV U <N&%T TK&A[Nt e+tN N$MA[N-icN V U / T7 V U / T? V UT? V UT7 V U B V A n t e r Ne0 Th 2 b n ! il U /B V U / T7 V UT7 $@<BN[N?<BCTNV U <N&%T TK&A[Nt e+tN N$MA[N-icN V U / T7 V U / T? V U / T$B@AV U& $@<BN[N#ANTA?NV U <N&%T TK&A[N<M$BAN N$MA[NS b 2i t #h!n 1 e s N S?#[Nch ! n 1 e s . 1i6N B=?7A?[N0N CA<BCT[N5 0N W<7TC[N1 5 0N V U $ C?AF[Nt - c 0. dllO s e ! r c hWS e s si o n [ 1 5 , 0 W#S<7 [ 0N V U <MB S?#[Ns e ! r c h . 1i6N $@T[NSe ! r c hN B=?7A?[N0N W<7TC[N1 2 0 N CA<BCT[N5 0N V U / $ V U $ C?AF[Nt - c 0. dllO ho 2 e W S e s si o n [ 1 5 , 0 W#S<7 [ 0N V U <MB S?#[Nh o 2 e . 1i6N $@T[NCo 2 e N B=?7A?[N0N VS&$#A[N0N CS&$#A[N0N W<7TC[N1 2 0 N CA<BCT[N5 0N V U / $ V U / & V U / F =?M V U / B =7K V U / CTM@V
5' 6
B e s t S e er s
UCTM@V UCA$7V UT<T@AVB e s t Sellers &!1e * S bEect. $?TSU/T<T@AV U / CA$7 V UB=7K BB#=@=? [N ] 666666NV UC1 $@<BN[Nc e n t e r N V T&# Web #o22 e r c e Bench 2 ! r 8 'T&#*W)U/C1 V U& $@<BN[Nc e n t e r N V U <MB $@<BN[Nbot t o 2 N B=?7A?[N0N CA<BCT[N6,N S?#[Nt - clo 1o. 1i6N W<7TC[N2 8 8N V U / & V U& V U / & V UC2 $@<BN[Nc e n t e r N V B e s t Sellers &!1e * S bEect. $?TSU/C2 V UT$B@A $@<BN[N#ANTA?N B=?7A?[N0N W<7TC[N6 6 0 N V UT? $@<BN[N#ANTA?N V$@<BN[Nto -N V UT7 #=@S&$N[N5N V U B V U F = NT #=@=?[N ] 660 0 0 0 N S<TA[N X 1 N V #lic8 on one o6 o r l!tes t boo8s to 6ind o t 2or e cU/F=NT V U / B V U / T7 V U / T? V UT? $@<BN[N#ANTA?N V$@<BN[Nto -N V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 5 9 2 2 , WS e s sio n [ 6 2 5 0 W#S<7 [ 0 N V U <MB S?#[N5 9 2 2 , .E - 1N $@T[NBoo8 ] 5 9 2 2 , N W<7TC[N1 0 0 N CA<BCT[N1 5 0 N V U /$ V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 2 ( 5 6 8 WS e s sio n [ 6 2 5 0 W#S<7 [ 0 N V U <MB S?#[N2 ( 5 6 8 .E - 1N $@T[NBoo8 ] 2 ( 5 6 8 N W<7TC[N1 0 0 N CA<BCT[N1 5 0 N V U /$ V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 9 ( ( 2 9 WS e s sio n [ 6 2 5 0 W#S<7 [ 0 N V U <MB S?#[N9 ( ( 2 9 .E - 1N $@T[NBoo8 ] 9 ( ( 2 9 N W<7TC[N1 0 0 N CA<BCT[N1 5 0 N V U /$ V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 6 8 6 5 9 WS e s sio n [ 6 2 5 0 W#S<7 [ 0 N V U <MB S?#[N6 8 6 5 9 .E - 1N $@T[NBoo8 ] 6 8 6 5 9 N W<7TC[N1 0 0 N CA<BCT[N1 5 0 N V U /$ V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ ( 9 1 ( 5 WS e s sio n [ 6 2 5 0 W#S<7 [ 0 N V U <MB S?#[N( 9 1 ( 5 .E - 1N $@T[NBoo8 ] ( 9 1 ( 5 N W<7TC[N1 0 0 N CA<BCT[N1 5 0 N V U /$ V U / T7 V U / T? V U / T$B@AV UT$B@A B=?7A? [N1N #A@@&$77<NB[N1N #A@@S&$#<NB[N1N $@<BN[N#ANTA?NV UT? V UT7 V U F =NT S<TA[N X 1 N V $ t h o r U / F=NT V U / T7 V UT7 V U F =NT S<TA[N X 1 N V Ti tl e U /F=NTV U / T7 V U / T? V UT? V UT7 V U < V N s<PN B$B$B$SA<NB$SA!s1c 0W U /< V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 5 1 9 1 5 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V B$B$=B?<<N$T=B $lone, bi1 iss e s U / $ V U / T7 V U / T? V UT? V UT7 V U < V YT&&8 n?V>Z-Ac8+;* , B$B$B$?<=BNB$TU/<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 1 2 , 5 0 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V # o 2 2 e r c i !l, B$B$=B$@%@SAB$ lon1 U /$ V U / T7 V U / T? V UT? V UT7 V U < V $ s + ! 26 $ B$B$B$?<$T=B=BU /<V U /T7 V
T&# Bench2!r8I W
&!1e cl+++
UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 1 8 5 ( 5 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V W o r d s B$B$=B<N?<?A?<stic8. %--er, res-o n sible rel!tion s hi- s U /$ V U / T7 V U / T? V UT? V UT7 V U < V % M ;VS! 8N$ B$B$B$SAB$SA%@U/<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ ( 5 1 5 8 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V = v e r ! ll, n!tion !l B$B$=B$@<N%@=B-l!nt s 0ill h!ve to de6en d. U /$ V U / T7 V U / T? V UT? V UT7 V U < V h ! \ W ! 2 - G ] B$B$B$%@$T<NSAU/<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 5 1 5 6 ( W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V M e n co ld h!ve to en1! 1 e B$B$B$B$$@%@%@6or the t;-e s. @e6t, U /$ V U / T7 V U / T? V UT? V UT7 V U < V ] r ( o V8:"D.8B6TF#c b<c B$B$B$NB?<%@$@U/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 5 2 9 8 2 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V F e e t B$B$=B=B<NNB?A c!n t!8e in the U /$ V U / T7 V U / T? V UT? V UT7 V U < V @ a . b 2 ; X @TY B$B$B$<N$@NBNBU/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 1 2 9 8W ! 2 - G S e s si o n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V F ! 2 o s , !v!il! bl e st di e s 0ill B$B$B$=B$@NB<N-res e r v e belo0 U /$ V U / T7 V U / T? V UT? V UT7 V U < V Z P a B$B$B$SANBNB?<U/<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 5 5 0 5W ! 2 - G S e s si o n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V S h o - s 2 s t B$B$B$?<?<B$SA cont ! c t . British, si2-le U /$ V U / T7 V U / T? V UT? V UT7 V U < V P 9 5 B$B$B$<NB$?<=B&c U /< V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllO Boo8<n6o [ ( 5 9 ( W ! 2 - G S e s si o n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V B$B$B$?ASANB?ATr!dition !l, 2!Eor 2ont h s cost !bo t the U /$ V U / T7 V U / T? V UT? V UT7 V U < V O TN)9AD.odD \+:#$c B$B$B$B$<NNB=BU/<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ ( 8 0 0W ! 2 - G S e s si o n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V = t h e r , lo0 seco n d s B$B$B$?A<NB$B$1!in !s in the 0ron1, U /$ V U / T7 V U / T? V UT? V UT7 V U < V ' = 1 B$B$B$?AB$=B%@U/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 6 0 0 ,W ! 2 - G S e s si o n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V & ! r t s B$B$B$$TB$B$%@s 66erG A;es 2i1ht 8ee-. ?e1ion !l U /$ V U / T7 V U / T? V UT? V UT7 V U < V t ] 7 b B 8 [ B$B$B$SA<N?A?<%0h@( U /<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 6 6 5 0W ! 2 - G S e s si o n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N VKe ! r s 0ill B$B$B$$T$TSAB$ h!ve to 6etch. <2-ort ! n t U /$ V U / T7 V U / T? V UT? V UT7 V U < V V/ d ! r F 3 8 ( v B$B$B$B$B$?ASAU/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ , ( 6 6W ! 2 - G S e s si o n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V $ bl e, 6or2 !l B$B$B$%@?A$T$T -!ti e n t s sho ld t rn into the U /$ V U / T7 V U / T? V UT? V UT7 V U < V Z - ! 0 G - ;.i ! ! d 2 Z * K! B$B$B$NBSA$T?<U/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllO Boo8<n6o [ 8 2 0 ( W ! 2 - G S e s si o n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V B$B$B$<N$@B$?AAlectronic, tr!dition !l 2e n U /$ V U / T7 V U / T? V UT? V UT7 V U < V # v. v=i B$B$B$?<?ASAB$U/<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllO Boo8<n6o [ 8 5 1 9 W ! 2 - G S e s si o n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V B$B$B$<N?<=BNB<de ! s sh!ll re-re s e n t . <te 2 s sh!ll 2e e t b;U /$ V U / T7 V U / T? V UT? V UT7 V U < V C C</ d B$B$B$<N?A?A<NU/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 1 1 1 , 5 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V Bl ! c 8, B$B$=B=B=B%@?< 1ood U /$ V U / T7 V U / T? V UT? V UT7 V U < V N . , c b.$\! 2 B$B$B$?AB$?<NBU/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 1 1 5 0 8 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V $ r e ! s B$B$=B=B?<B$<N ride. Tr e, cold ti2e s 2!; hel-. U /$ V U / T7 V U / T? V UT? V
T&# Bench2!r8I W
&!1e cl+++i
UT7 V U < V s ) 6 sM:VG5 [ d a B$B$B$<NNB?ANBU/<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 1 1 9 8 , W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V F o r c e s t!8e. S2!ll, B$B$=B=BNB<N%@ s-eci!l -rod ct s 0ith U /$ V U / T7 V U / T? V UT? V UT7 V U < V 6 b # 7 o O 9 B$B$B$$@%@?<B$U/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllO Boo8<n6o [ 1 2 5 0 5W ! 2 - G S e s s i o n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V B$B$=B$@SAB$?<7i66eren c e s c!n tr!vel. Friends do 2ove . U /$ V U / T7 V U / T? V UT? V UT7 V U < V o & c<=^(3T;s8 \^* B B$B$B$NB=BNB$@U/<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 1 5 1 5 ( W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V C ! n d s B$B$=B?<=BSA?A o 1ht to thin8. $ver!1 e ch!n 1 e s 0illU/$ V U /T7 V U / T? V UT? V UT7 V U < V KDD@c? B$B$B$$T?<$T$TU/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 1 5 ( 1 , W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V Bl ! c 8 B$B$=B?<?A=B%@ childre n U /$ V U / T7 V U / T? V UT? V UT7 V U < V 2 J \3 FW 8C ! = n <8 B$B$B$?<<NB$$@U/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 1 5 ( 5 5 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V = - e n , 6in!l B$B$=B?<?A?<SA o-er ! ti on s U /$ V U / T7 V U / T? V UT? V UT7 V U < V e e 9 A B$B$B$SASA=B=B U /< V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 1 5 5 , ( W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V @oc !l, british ti2e s e+! 2i n e on the B$B$=B?<SA%@?A short, U /$ V U / T7 V U / T? V UT? V UT7 V U < V 0 l"2"Jid= B$B$B$<N$@?<%@U/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 1 5 5 8 ( W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V # ! r s 6or B$B$=B?<SA<N?A the levels do h rt 6or the 6 ll, d e U /$ V U / T7 V U / T? V UT? V UT7 V U < V d - TK&. B$B$B$SA=BSA$TU/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 1 5 8 ( 8 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V & e r s o n !l B$B$=B?<<N?A<N 6in1er s b; the U /$ V U / T7 V U / T? V UT? V UT7 V U < V T [ 9 s 3 #Kci6 B$B$B$<N$TB$$TU/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 1 ( 1 9 6 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V Vit !l, en1lish 6!ctors B$B$=B?A=BNB$Tsho ld U /$ V U / T7 V U / T? V UT? V UT7 V U < V B G d. 2>1 B$B$B$<N?<<NB$U/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 1 ( 2 2 6 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V M e t h o d s be1in b!c8, B$B$=B?A$@$@$T1ood le!ve s. #oncer n e d , U /$ V U / T7 V U / T? V UT? V UT7 V U < V $>t<3BD:K0Vs.6NN\O B$B$B$=B%@?<?<U/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllO Boo8<n6o [ 1 ( 2 5 6W ! 2 - G S e s s i o n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V B$B$=B?A$@SA$TVictori!n, soci!l e;e s U /$ V U / T7 V U / T? V UT? V UT7 V U < V b 5 : 7 B$B$B$?<B$%@$@U/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 1 ( ( 6 1 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V 7 r ! 2 ! t i c, B$B$=B?A?A$T=B 1ood -!rt n e r s U /$ V U / T7 V U / T? V UT? V UT7 V U < V Y 8 T v B$B$B$%@B$?<%@U/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 1 ( 5 5 5 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V B o o d , B$B$=B?ASA?<SA little 2ont h s sho ld sho0. &eriods U /$ V U / T7 V U / T? V UT? V UT7 V U < V + +&M/T B$B$B$?AB$$T=BU/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 1 5 1 2 9 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V $ c tive, s bEe c t tre e s B$B$=BSA=B$@NB co ld h!ve to cre! t e inU/$ V U / T7 V U / T? V UT? V UT7 V U < V t % 9 . = 2 , 9A 2 # B$B$B$$@$@NBSAU/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 1 5 1 5 ( W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V 7 e t e r 2 i n e d , d e B$B$=BSA=BSA?A s;st e 2 s set. @e6t, U /$ V U / T7 V U / T? V UT? V
T&# Bench2!r8I W
&!1e cl+++ii
UT7 V U < V 0 6/ cS%OdDGd?VPB;=^ B$B$B$=BNB?<$Tr#E>5 U/<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 1 6 6 5 5 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V W e e 8 s co ld h!ve to B$B$=B$T$T?<SA st!;. U /$ V U / T7 V U / T? V UT? V UT7 V U < V d J T W ! 2 - G -KoK8 B$B$B$<N$T<N$TU/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 1 , 5 5 5 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V <n t e r e s t s thro0 the n on the 2ile s. B$B$=B%@SA?<SA #le!r, U /$ V U / T7 V U / T? V UT? V UT7 V U < V 3 T c C t 8 B$B$B$<N$TB$=B8: U /<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 1 , 9 9 , W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V B$B$=B%@NBNB%@ #h!-t e r s 0ill h!ve to !dvise . Wide, U /$ V U / T7 V U / T? V UT? V UT7 V U < V C ?@"+b?.TA'FN(,27 B$B$B$?<NB?ASAU/<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 1 8 0 0 9 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V Vie 0s 6!ce. #!se s B$B$=B<NB$B$NB be6ore the U /$ V U / T7 V U / T? V UT? V UT7 V U < V t J^PD. t^Z\VW! 2 - G c^tS B$B$B$NB$T$@SAU/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 1 8 1 6 ( W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V M o d e r n , -olitic !l B$B$=B<N=B$T?A d!;s 2 st U /$ V U / T7 V U / T? V UT? V UT7 V U < V V 2 T d i \ B$B$B$NB?A<NNBU/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 1 8 2 6 ( W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V S 2 ! ll B$B$=B<N$@$T?A sho ld e r s 0o ld obt!in 6!st, U /$ V U / T7 V U / T? V UT? V UT7 V U < V % 06W s B$B$B$SAB$NB?<o6&t2$ U /<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 1 8 ( , ( W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V S e c o n d s co ld h!ve to B$B$=B<N?A%@?Athin8. U /$ V U / T7 V U / T? V UT? V UT7 V U < V 9 1V di bG 8YvB;V B$B$B$NB<N$@$TU/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 1 9 5 ( 2 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V = t h e r ite 2 s on the 6or2 !l, 6ine -erso n n el B$B$=BNB?<?A$@U/$V U /T7 V U / T? V UT? V UT7 V U < V s % l7TB- B$B$B$%@<N$@=BU/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 1 9 6 9 ( W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V F e e lin 1 s B$B$=BNB$TNB?A 6or the -erso n !l, l!r1e U /$ V U / T7 V U / T? V UT? V UT7 V U < V i ] 3 X 9 1 ST oB>#C ] B$B$B$$T?<B$=BU/<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 1 9 8 8 5 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V B$B$=BNB<N<N?< Nervo s, str! n 1 e U / $ V U / T7 V U / T? V UT? V UT7 V U < V @& [ 9 i 5?T ] 3 l>9E B$B$B$$TB$$T%@U/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 2 0 5 5 , W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V @ e 1 !l, old 2ile s B$B$B$$@$TSASA 2! ; love. ? r!l, U /$ V U / T7 V U / T? V UT? V UT7 V U < V [ N h 8 B$B$B$<N?ANB$TT2,60 U /< V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 2 0 , 1 , W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V # h ! n 1 e s 0!l8 B$B$B$SA$T$T=B 6 ll, U/$ V U / T7 V U / T? V UT? V UT7 V U < V " \>9,Z ] 0V -B>- B$B$B$?<=BB$=B=01 U /< V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 2 1 2 8 ( W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V ? o ;!l, cri2in !l childre n 6or B$B$B$B$B$SASA the U /$ V U / T7 V U / T? V UT? V UT7 V U < V T [ > v B$B$B$$@?A=B%@U/<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 2 1 5 0 1 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V B$B$B$=B$@<NNB Ne0, intern ! ti o n !l desi1n s 0ill s-e n d. U /$ V U / T7 V U / T? V UT? V UT7 V U < V ?J5 2 [ B$B$B$$@?A$T=B@A<60 U /<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 2 1 5 2 1 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V Al e c t r o nic, othe r s 11 e s t i o n s 1et. Forei1n, B$B$B$<N?<$T%@U/$V U /T7 V U / T? V UT? V UT7 V U < V 1 5 B FN.S'#sNSMA1VT B$B$B$SAB$<N%@,U/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 2 1 8 0 , W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V N o r 2 ! l,
T&# Bench2!r8I W
&!1ecl+++iii
1ood B$B$B$<N=B?A=B-olic e sh!ll hold 0ith the U /$ V U / T7 V U / T? V UT? V UT7 V U < V h 2 - B$B$B$?<B$B$NBd?& U/<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 2 2 2 6 1 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V B$B$B$=B?<$T?< @iber!l, en1lish U /$ V U / T7 V U / T? V UT? V UT7 V U < V $" , X' sB -:,6 B$B$B$?<SASAB$!+9 U /< V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 2 2 5 5 5 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V M !i n, e 2otion !l 2ove 2 e n t s B$B$B$$T?<NBB$ he!r. U /$ V U / T7 V U / T? V U / T$B@AV U& $@<BN[Nc e n t e r N V U $ C?AF[Nt - c 0. dllOSho - -i n 1B ! s 8 e t W ! 2 - G$77SF@$B[NW! 2 - GS e s si o n [ 1 5 6 ( W ! 2 - G #S<7 [ 0 N V U <MB $@T[NSho - -i n 1 #!rtN B=?7A? [N0N CA<BCT[N5 0N S?#[Nc ! r t. 1i6N W<7TC[N1 2 0N V U / $ V U $ C?AF[Nt - c 0. dllO s e ! r c hW ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0 N V U <MB $@T[NSe ! r c hN B=?7A? [N0N CA<BCT[N5 0N S?#[Ns e ! r c h . 1i6N W<7TC[N1 2 0N V U / $ V U $ C?AF[Nt - c 0. dllO ho 2 e W ! 2 - G S e s si o n [ 1 5 6 ( W ! 2 - G #S<7 [ 0 N V U <MB $@T[NCo 2 e N B=?7A?[N0N CA<BCT[N50N S?#[Nho 2 e . 1i6N W<7TC[N1 2 0N V U / $ V U / & V U / B =7KV U / CTM@V
5' 8
B u * Co n fir m
UCTM@V UCA$7V UT<T@AVB ; #on6ir2 &!1e U / T<T@AV U /CA$7 V UB=7K BB#=@=? [ 57N ] FFFFFFNV UC1 $@<BN[57N#ANTA?NVT&# Web #o2 2 e r c e Bench 2 ! r 8 'T&#* W)U/C1 V UC2 $@<BN[57N#ANTA?NVB ; #on6ir2 &!1e U / C 2 V UB@=#>D%=TA V UB@=#>D%=TA V UB@=#>D%=TA V UB@=#>D%=TA V UC2 $@<BN[57N@AFTNV=rd e r <n6or2! tio n. U / C 2 V UT$B@A B=?7A? [ 57N1N #A@@S&$#<NB[ 57N0N #A@@&$77<NB[ 57N0N V UT? V UT7 V U B V D t ; U / B V U / T 7 V UT7 V U B V & r o d c t U / B V U / T7 V U / T? V UT? V UT7 V$@<BN[57NT=&NV 1 U / T7 V UT7 V$@<BN[57NT=&NV U < V Ti tl e. @oc!l, 2en t !l [ B$B$B$%@%@?A=Bindivid !l s U /< V * B!c8in1. %SA7UB? V S?&. M((5. 5 5, UF=NT #=@=?[ 57N ]$$00 0 0 N V U B V K o r &rice. [ M(56. 0 0 U / B V U / F =NT V U / T7 V U / T? V UT? V UT7 V$@<BN[57NT=&NV 2 U / T7 V UT7 V$@<BN[57NT=&NV U < V Ti tl e. =r1! nic, 2!in side s sho ld B$B$=B%@B$SANB [ h!ve to s!; U /< V * B!c8in1. $%7<=UB? V S?&. M518. 9 8, UF=NT [ #=@=? [ 57N ] $$0 0 0 0N V U B V K o r &rice. M215. , 2 U / B V U / F =NT V U / T7 V U / T? V U / T$B@AV UC2 $@<BN[57N@AFTNVKo r =rder h!s bee n -roce s s e d . U / C 2 V UT$B@A B=?7A? [ 57N1N #A@@&$77<NB[ 57N5N #A@@S&$#<NB[ 57N0N V UT? V UT7 V UC( V S b t o t ! l 0ith disco n t '(2P). U /C ( V U / T7 V UT7 V UC( V M 5 0 0 . 8 0 U / C ( V U / T7 V U / T? V UT? V UT7 V UC( V T ! + '8.25P). U / C ( V U / T7 V UT7 V UC( V M ( 1 . 5 2 U / C ( V U / T 7 V U / T? V UT? V
T&# Bench2!r8I W
&!1ecl+++iv
UT7 V UC( V S hi - -i n 1. U / C ( V U / T 7 V UT7 V UC( V M 9 . 0 0 U / C ( V U / T7 V U / T? V UT? V UT7 V UC( V T o t ! l . U / C ( V U / T 7 V UT7 V UC( V M 5 5 1 . 1 1 U / C ( V U / T7 V U / T? V U / T$B@AV U& V U B ? V U / & V UC2 V = r d e r N 2b e r. 52 U / C2 V UC1 V T h ! n 8 ;o 6or sho- -i n 1 !t T&#*WU/C1 V U& V U / & V U#ANTA? V U $ C?AF[ 57Nt -c 0. dllOs e ! r c hWS e s sio n [ 5 7 1 5 , 0 W#S<7 [ 57 5 ( , 9 8 8 , N V U <MB S?#[ 57Ns e ! r c h . 1i6N $@T[57NSe ! r c h <te2N B=?7A?[ 57N0N VS&$#A[ 57N0N [ CS&$#A [ 57N0N W<7TC[ 57N12 0N CA<BCT[ 57N5 0N V U / $ V U $ C?AF[ 57Nt - c 0. dllO ho 2 e W S e s si o n [ 5 7 1 5 , 0W#S<7 [ 57 5 ( , 9 8 8 , N V U <MB S?#[ 57Nho 2 e . 1i6N $@T[57NCo 2 e &!1eN B=?7A?[ 57N0N VS&$#A[ 57N0N [ CS&$#A [ 57N0N W<7TC[ 57N12 0N [ CA<BCT[ 57N50N V U / $ V U / # ANTA? V U / B@=#>D%=TAV U /B@=#>D%=TAV U /B@=#>D%=TAV U /B@=# [ >D%=TAV U / B =7KV U / CTM@V
5' :
Bu* ReBu e s t
UCTM@V UCA$7V UT<T@AVT&#* W B ; ?e9 e s t &!1e U /T<T@AV U / CA$7 V UB=7K BB#=@=? [N666666NV UC1 $@<BN[N#ANTA?NVT&# Web #o22 e r c e Bench 2 ! r 8 'T&#*W)U/C1 V UC? W<7TC[N, 0 0 N #=@=?[N ] 2 0 2 0 2 0 N V UC2 $@<BN[N#ANTA?NVB ; ?e9 e s t &!1e U / C 2 V UC? W<7TC[N, 0 0 N V UF=?M $#T<=N[Nht t - s . // 000. t - c 0. c o 2 / t - c 0. dllOB ;#on6ir 2WSe s sio n [ 5 6 , 8 W#S<7 [ 2 8 8 0 0 0 5 N MATC=7[N&=STN V UT$B@A B=?7A? [N0N W<7TC[N9 0 PN V UT? $@<BN[N@AFTN V$@<BN[NT=&NV UT7 V$@<BN[NT=&N W<7TC[N( 5 PN V UC2 V Billin1 <n6or2 ! t io n. U / C 2 V UT$B@A W<7TC[N1 0 0 PN B=?7A?[N0N V UT? V UT7 V Firs t n ! 2 e . U / T7 V UT7 V "ohn U /T7 V U / T? V UT? V UT7 V@ ! s t n ! 2 e . U/T7 V UT7 V 7oe U /T7 V U / T? V UT? V UT7 V$d d rSs t r e e t S1. U / T7 V UT7 V 1 So2 e &l!c e U /T7 V U / T? V UT? V UT7 V$d d rSs t r e e t S2. U / T7 V UT7 V $-t. (2 U /T7 V U / T? V UT? V UT7 V #it ;. U /T7 V UT7 V 7 llsville U /T7 V U / T? V UT? V UT7 V S t ! t e . U / T7 V UT7 V #$U/T7 V U / T? V UT? V UT7 V Ti -. U / T7 V UT7 V 9 1 2 5 ( U / T7 V U / T? V
T&# Bench2!r8I W
&!1e cl+++v
UT? V UT7 V # o n t r ;. U / T7 V UT7 V $ndorr! U / T7 V U / T? V UT? V UT7 V A 2 ! il. U /T7 V UT7 V 2e 3 2 ;c o 2 - ! n ;. c o 2 U / T7 V U / T? V UT? V UT7 V & h o n e . U / T7 V UT7 V 125* (56* ,890 U / T7 V U / T? V UT? V UT7 V %SA?N$MA. U/T7 V UT7 V$@<N<NB$B$B$SAU/T7 V U / T? V UT? V UT7 V #S<7 U /T7 V UT7 V 2 8 8 0 0 0 5 U / T7 V U / T? V U / T$B@AV U /T7 V UT7 V$@<BN[NT=&N W<7TC[N( 5 PN V UC2 V S hi - -i n 1 <n6or2 ! t i on. U / C 2 V UT$B@A B=?7A? [N0N #A@@S&$#<NB[N0N #A@@&$77<NB[N0N W<7TC[N1 0 0 P N V UT? V UT7 W<7TC[N5 0 PN V $ d d rSs t r e e tS 1. U /T7 V UT7 W<7TC[N5 0 PN V U <N&%T N$MA[Nshi- ! d d 1 N S<TA[N( 0N V$@%A[N1 So2e &l!ceN V U / T7 V U / T? V UT? V UT7 V$d d rSs t r e e t S2. U / T7 V UT7 V U <N&%T N$MA[Ns hi- ! d d 2 N S<TA[N( 0N V$@%A[N$-t. (2N V U / T7 V U / T? V UT? V UT7 V #it ;. U /T7 V UT7 V U <N&%T N$MA[Ns hi-cit ;N S<TA[N5 0N V$@%A[N7 llsvilleN V U / T7 V U / T? V UT? V UT7 V S t ! t e . U / T7 V UT7 V U <N&%T N$MA[Ns hi- s t ! t e N S<TA[N2 0N V$@%A[N#$NV U /T7 V U / T? V UT? V UT7 V Ti -. U / T7 V UT7 V U <N&%T N$MA[Ns hi-:i -N S<TA[N1 0N V$@%A[N91 2 5 (N V U / T7 V U / T? V UT? V UT7 V # o n t r ;. U / T7 V UT7 V U <N&%T N$MA[Ns hi-c o n t r ;N V$@%A[N$ndorr !N S<TA[N( 0N V U / T7 V U / T? V U / T$B@AV U /T7 V U / T? V U / T$B@AV UC? W<7TC[N, 0 0 N V UC2 V = r d e r <n6or2 ! t i on. U / C 2 V UT$B@A B=?7A? [N1N #A@@S&$#<NB[N0N #A@@&$77<NB[N0N V UT? V UT7 V U B V D t ; U / B V U / T 7 V UT7 V U B V & r o d c t U / B V U / T7 V U / T? V UT? V UT7 V$@<BN[NT=&NV 1 U / T7 V UT7 V$@<BN[NT=&NVTitl e. U<VB$B$B$B$NB$T=B<ndivid !l, ethnic res lts sho ld 1o. Fi1 re s U / < V * B!c8in1. %SA7UB? V S?&. M,90. , 9, UF=NT #=@=?[N ] $$0 0 0 0 N V U B V K o r &rice. M6,(. 5 ( U / B V U / F =NT V U / T7 V U / T? V UT? V UT7 V$@<BN[NT=&NV 2 U / T7 V UT7 V$@<BN[NT=&NVTitl e. U<VKe ! r s cover ne!r the 1re ! t, B$B$=B$T$TSA?<-ri2e ite 2 s. U /< V * B!c8in1. &$&A?B$#>UB? V S?&. M518. , 5, UF=NT #=@=?[N ]$$00 0 0N V U B V K o r &rice. M208. ( 6 U / B V U / F =NT V U / T7 V U / T? V U / T$B@AV U& V U B ? V U / & V UT$B@A B=?7A? [N0N V UT? V UT7 V U B V S b t o t ! l 0ith disco n t '28P). U /B V U / T7 V UT7 $@<BN[N?<BCTNV U B V M , 8 5 . 8 5 U / B V U / T7 V U / T? V UT? V UT7 V U B V T ! + U / B V U / T 7 V UT7 $@<BN[N?<BCTNV U B V M 6 ( . 8 5 U / B V U / T7 V U / T? V UT? V
T&# Bench2!r8I W
&!1ecl+++vi
UT7 V U B V S h i - -i n 1 W!2-G C!ndlin1 U /B V U / T7 V UT7 $@<BN[N?<BCTNV U B V M 9 . 0 0 U / B V U / T7 V U / T? V UT? V UT7 V U B V T o t ! l U / B V U / T7 V UT7 $@<BN[N?<BCTNV U B V M 8 5 9 . 6 8 U / B V U / T7 V U / T? V U / T$B@AV UC? W<7TC[N, 0 0 N V U& V U B ? V U / & V UT$B@A B=?7A? [N1N #A@@&$77<NB[N5N #A@@S&$#<NB[N0N V UT? V UT7 V # r e di t #!rd T;-e U / T7 V UT7 V U <N&%T TK&A[N?$7<=N N$MA[Ncct;- e N V$@%A[NV<S$N #CA#>A7[N#CA#>A7NVV<S$U<N&%T TK&A[N?$7<=N N$MA[Ncc t ;- e N V$@%A[NM$STA?#$?7NVM$STA?#$?7U<N&%T TK&A[N?$7<=N N$MA[Ncc t ;- e N V$@%A[N7<S#=VA?NV7<S#=VA?U<N&%T TK&A[N?$7<=N N$MA[Ncc t ;- e N V$@%A[N$MAJNV$MA?<#$N AJ&?ASS U<N&%T TK&A[N?$7<=N N$MA[Ncc t ;- e N V$@%A[N7<NA?SNV7<NA?S U /T7 V U / T? V UT? V UT7 V N ! 2 e on #redit #!rd U /T7 V UT7 V U <N&%T N$MA[Ncc n ! 2 e N S<TA[N5 0N V U / T7 V U / T? V UT? V UT7 V # r e di t #!rd N 2b e r U / T7 V UT7 V U <N&%T N$MA[Ncc n 2 N S<TA[N1 6N V U / T7 V U / T? V UT? V UT7 V # r e di t #!rd A+-ir!tion 7!te U /T7 V UT7 V U <N&%T N$MA[Ncc d ! t e N S<TA[N1 5N V U / T7 V U / T? V UT? V UT7 V S hi - -i n 1 Method U / T7 V UT7 V U <N&%T TK&A[N?$7<=N N$MA[Ns hi- 2 e t h o d N V$@%A[N$<?N #CA#>A7[N#CA#>A7NV$<?U<N&%T TK&A[N?$7<=N N$MA[Ns hi- 2 e t h o d N V$@%A[N%&SN V %&S U<N&%T TK&A[N?$7<=N N$MA[Ns hi- 2 e t h o d N V$@%A[NFA7AJNVFA7AJU<N&%T TK&A[N?$7<=N N$MA[Ns hi- 2 e t h o d N V$@%A[NSC<&NV SC<& U<N&%T TK&A[N?$7<=N N$MA[Ns hi- 2 e t h o d N V$@%A[N#=%?<A?NV#=%?<A?U<N&%T TK&A[N?$7<=N N$MA[Ns hi- 2 e t h o d N V$@%A[NM$<@NVM$<@U/T7 V U / T? V U / T$B@AV U& $@<BN[N#ANTA?NV U <N&%T TK&A[N<M$BAN N$MA[N#on6ir2 B ;N S?#[N-r oc e s s . 1i6N CA<BCT[N5 0N W<7TC[N1 2 0N V U $ C?AF[Nht t - .// 000. t - c 0. c o 2 / t - c 0. dllO Sho--i n1B ! s 8 e t W$77SF@$B[NWSes sio n [ 5 6 , 8 W#S<7 [ 2 8 8 0 0 0 5 N V U <MB S?#[Nc ! r t . 1i6N $@T[NSho - -i n 1 #!rtN B=?7A?[N0N VS&$#A[N0N CS&$#A[N0N W<7TC[N1 2 0 N CA<BCT[N5 0N V U / $ V U $ C?AF[Nht t - .// 000. t - c 0. c o 2 / t - c 0. dllOho 2 e WS e s si o n [ 5 6 , 8 W#S<7 [ 2 8 8 0 0 0 5 N V U <MB S?#[Nh o 2 e . 1i6N $@T[NCo 2 e N B=?7A?[N0N VS&$#A[N0N CS&$#A[N0N W<7TC[N1 2 0 N CA<BCT[N5 0N V U / $ V U / & V U / F =?M V U / B =7K V U / CTM@V
5' ;
Cu s t o m e r R e g i s t r a t i o n
UCTM@V UCA$7V UT<T@AV# s t o 2 e r ?e1istr ! ti on &!1e U /T<T@AV U / CA$7 V UB=7K BB#=@=? [N ] 666666NV UC1 $@<BN[Nc e n t e r N V T&# Web #o22 e r c e Bench 2 ! r 8 'T&#*W)U/C1 V UC? W<7TC[N, 0 0 N #=@=?[N ] 2 0 2 0 2 0 N V UC1 $@<BN[Nc e n t e r N V U <MB S?#[Nt - cl o1o. 1i6N $@<BN[NB=TT=MN B=?7A?[N0N W<7TC[N2 8 8 N CA<BCT[N6 ,N V U / C 1 V UC2 $@<BN[Nc e n t e r N V # s t o 2 e r ?e1istr ! tio n &!1e U / C 2 V UF=?M $#T<=N[Nht t - s . // 000. t - c 0. c o 2 / t - c 0. dllO%s erT;- eW ! 2 - G S e s s io n [ 5 6 , 8 W ! 2 - G #S<7 [ 0 N MATC=7[N&=STN V UB@=#>D%=TA V UB@=#>D%=TA V UC? V UT$B@A B=?7A? [N0N V UT? V
T&# Bench2!r8I W
&!1e cl+++vii
UT7 V U <N&%T #CA#>A7[N#CA#>A7N N$MA[N?AT%?N<NBSF@$BN TK&A[Nr! dioN V$@%A[NKNV < ! 2 !n e+istin1 c st o 2 e r U/T7 V U / T? V UT? V UT7 V U <N&%T N$MA[N?AT%?N<NBSF@$BN TK&A[Nr! dioN V$@%A[NNN V < !2 ! 6irst ti2e c sto 2 e r U / T7 V U / T? V U / T$B@A V UC? V U& V U B V <6 ;o Hr e !n e+istin 1 c sto 2 e r , ente r ;o r %sern ! 2 e !nd &!ss0or d. U /B V U B ? V U B ? V U / & V UT$B@AV UT? $@<BN[Nle6tN V UT7 V % s e r n ! 2 e . U<N&%T N$MA[N s e r n ! 2 e N S<TA[N2 5N V U / T7 V U / T? V UT? $@<BN[Nle6tN V UT7 V & ! s s 0o r d . U<N&%T S<TA[N1 (N TK&A[N- ! s s 0o r d N V$@%A[N- ! s s 0o r d N V U / T7 V U / T? V U / T$B@AV UC? V U& V U B V <6 ;o Hr e ! 6irst ti2e c sto 2 e r , ent er the det !ils belo0. U /B V U B ? V U/& V UT$B@AV UT? V UT7 V A n t e r ;o r birth d!t e '22/ d d/ ;;;;). U /T7 V UT7 V U<N&%T N$MA[Nbirth d ! ;N S<TA[N1 0N V U / T7 V U / T? V UT? V UT7 V A n t e r ;o r First N!2 e . U / T7 V UT7 V U<N&%T N$MA[N6irstn ! 2 e N S<TA[N1 5N V U / T7 V U / T? V UT? V UT7 V A n t e r ;o r @!st N!2 e . U / T7 V UT7 V U<N&%T N$MA[Nl!s t n ! 2 e N S<TA[N1 5N V U / T7 V U / T? V UT? V UT7 V A n t e r ;o r $ddre s s 1. U /T7 V UT7 V U<N&%T N$MA[N!d d r e s s 1 N S<TA[N( 0N V U / T7 V U / T? V UT? V UT7 V A n t e r ;o r $ddre s s 2. U /T7 V UT7 V U<N&%T N$MA[N!d d r e s s 2 N S<TA[N( 0N V U / T7 V U / T? V UT? V UT7 V A n t e r ;o r #it;, St!t e , Ti-. U /T7 V UT7 V U<N&%T N$MA[Ncit;N S<TA[N5 0N V U<N&%T N$MA[Nst ! t e N V U<N&%T N$MA[N:i-N S<TA[N1 0N V U / T7 V U / T? V UT? V UT7 V A n t e r ;o r #o ntr;. U /T7 V UT7 V U<N&%T N$MA[Nco n t r ;N S<TA[N5 0N V U / T7 V U / T? V UT? V UT7 V A n t e r ;o r &hone . U /T7 V UT7 V U<N&%T N$MA[N-h o n e N S<TA[N1 6N V U / T7 V U / T? V UT? V UT7 V A n t e r ;o r A*2!il. U /T7 V UT7 V U<N&%T N$MA[Ne 2 !ilN S<TA[N5 0N V U / T7 V U / T? V U / T$B@AV UC? V UT$B@AV UT? V UT7 #=@S&$N[N2N V = t h e r # sto 2 e r 7!t!. UTAJT$?A$ #=@S[N6 5N N$MA[Nd ! t ! N ?=WS [ N(N V U / TAJT$?A$V U /T7 V U / T? V U / T$B@AV UC? V U / B@=#>D%=TA V U / B@=#>D%=TAV U#ANTA? V U <N&%T TK&A[N<M$BAN N$MA[NAnt e r =rderN S?#[Ns b 2i t. 1i6N B=?7A?[N0N CA<BCT[N5 0N W<7TC[N1 2 0N V U $ C?AF[Nht t - .//6ishb o 0l (/ s c ri -t s/ t - c 0. dllOs e ! r c hWS e s sio n [ 5 6 , 8 W#S<7 [ 0 N V U <MB S?#[Ns e ! r c h . 1i6N $@T[NSe ! r c h <te2N B=?7A?[N0N CS&$#A[N0N W<7TC[N1 2 0 N CA<BCT[N5 0N V U / $ V U $ C?AF[Nht t - .//6ishb o 0l (/ s c ri -t s/ t - c 0. dllOho 2 e WS e s sio n [ 5 6 , 8 W#S<7 [ 0 N V U <MB S?#[Nh o 2 e . 1i6N $@T[NCo 2 e &!1eN B=?7A?[N0N CS&$#A[N0N W<7TC[N1 2 0N CA<BCT[N5 0N V U /$ V U& V U / & V U / # ANTA? V U / F=?M V U / B=7KV U /CTM@V
T&# Bench2!r8I W
&!1e cl+++viii
5' =
Hom e
UCTM@V UCA$7V UT<T@AVT&#* W Co2 e &!1e U / T<T@AV U /CA$7 V UB=7K BB#=@=? [N ] 666666NV UC1 $@<BN[Nc e n t e r N V T&# Web #o22 e r c e Bench 2 ! r 8 'T&#*W)U/C1 V UC? W<7TC[N, 0 0 N #=@=?[N ] 2 0 2 0 2 0 N V U& $@<BN[N#ANTA?NV U <MB S?#[Nt - cl o1o. 1i6N $@<BN[NB=TT=MN B=?7A?[N0N W<7TC[N2 8 8 N CA<BCT[N6 ,N V U / & V UC2 $@<BN[Nc e n t e r N V C o 2 e &!1e U /C 2 V UC5 $@<BN[Nc e n t e r N V W e l c o 2 e b!c8 UF=NT #=@=?[N ] , , 0 0 0 0 N V "o h n 7oe U /F=NT V U / C 5 V UT$B@A $@<BN[N#ANTA?N B=?7A?[N0N W<7TC[N6 6 0 N V UT? $@<BN[N#ANTA?N V$@<BN[Nto -N V UT7 #=@S&$N[N5N V U B V U F = NT #=@=?[N ] 660 0 0 0 N S<TA[N X 1 N V #lic8 on one o6 o r l!tes t boo8s to 6ind o t 2or e cU/F=NT V U / B V U / T7 V U / T? V UT? $@<BN[N#ANTA?N V$@<BN[Nto -N V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 5 9 2 2 , WS e s sio n [ 6 2 5 0 W#S<7 [ 0 N V U <MB S?#[N5 9 2 2 , .E - 1N $@T[NBoo8 ] 5 9 2 2 , N W<7TC[N1 0 0 N CA<BCT[N1 5 0 N V U /$ V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 2 ( 5 6 8 WS e s sio n [ 6 2 5 0 W#S<7 [ 0 N V U <MB S?#[N2 ( 5 6 8 .E - 1N $@T[NBoo8 ] 2 ( 5 6 8 N W<7TC[N1 0 0 N CA<BCT[N1 5 0 N V U /$ V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 9 ( ( 2 9 WS e s sio n [ 6 2 5 0 W#S<7 [ 0 N V U <MB S?#[N9 ( ( 2 9 .E - 1N $@T[NBoo8 ] 9 ( ( 2 9 N W<7TC[N1 0 0 N CA<BCT[N1 5 0 N V U /$ V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 6 8 6 5 9 WS e s sio n [ 6 2 5 0 W#S<7 [ 0 N V U <MB S?#[N6 8 6 5 9 .E - 1N $@T[NBoo8 ] 6 8 6 5 9 N W<7TC[N1 0 0 N CA<BCT[N1 5 0 N V U /$ V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ ( 9 1 ( 5 WS e s sio n [ 6 2 5 0 W#S<7 [ 0 N V U <MB S?#[N( 9 1 ( 5 .E - 1N $@T[NBoo8 ] ( 9 1 ( 5 N W<7TC[N1 0 0 N CA<BCT[N1 5 0 N V U /$ V U / T7 V U / T? V U / T$B@AV UT$B@A $@<BN[Nc e n t e rN BB#=@=? [N ] c 0 c 0 c 0 N B=?7A?[N0N #A@@&$77<NB[N6N #A@@S&$#<NB[N0N W<7TC[N, 0 0N V UT? $@<BN[N#ANTA?N BB#=@=?[N ] 666666N V$@<BN[Nto-N V UT7 #=@S&$N[N2N V$@<BN[NM<77@AN W<7TC[N5 0 0N V U <MB S?#[Nn e 0. 1i6N $@T[NNe0 &rod c tN W<7TC[N5 0 0N V U / T7 V UT7 BB#=@=?[N ] 666666N W<7TC[N1 0 0N V U / T7 V UT7 #=@S&$N[N2N W<7TC[N5 0 0 N V U <MB S?#[Nb e s t . 1i6N $@T[NBest SellerN W<7TC[N5 0 0N V U / T 7 V U / T? V UT? V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO ne0Ws bE e c t [ $?TSWSe s si on [ 6 2 5 0 W#S<7 [ 0 N V $?TS U /$ V U / & V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt - c 0. dllO n e 0W s bE e c t [ N =N* F<#T<=NWSes sion [ 6 2 5 0 W#S<7 [ 0N V N =N* F<#T<=NU/$ V U / & V U / T 7 V UT7 BB#=@=?[N ] 666666N W<7TC[N5 0N V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO be stWs bE e c t [ $?TSWSe s sio n [ 6 2 5 0 W#S<7 [ 0N V $?TS U /$ V U / & V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt - c 0. dllO b e s tW s bE e c t [ N =N* F<#T<=NWSession [ 6 2 5 0 W#S<7 [ 0N V N =N* F<#T<=NU/$ V U / & V U / T 7 V U / T? V UT? V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt - c 0. dllO ne0Ws bE e c t [ B<=B?$&C<ASWSes sion [ 6 2 5 0 W#S<7 [ 0 N V B<=B?$&C<AS U/$ V U / & V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO ne0Ws bE e c t [ &$?ANT<NBWSe ssion [ 6 2 5 0 W#S<7 [ 0N V &$?ANT<NBU/$ V U / & V U / T7 V UT7 BB#=@=?[N ] 666666N W<7TC[N5 0N V U / T7 V UT7 V
T&# Bench2!r8I W
&!1ecl+++i+
U& $@<BN[Nc e n t e r N V U $ C?AF[Nt - c 0. dllO be stWs bE e c t [ B<=B?$&C<ASWSe ssio n [ 6 2 5 0 W#S<7 [ 0N V B<=B?$&C<ASU /$ V U / & V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO be stWs bE e c t [ &$?ANT<NBWSe ssion [ 6 2 5 0 W#S<7 [ 0 N V &$?ANT<NBU/$ V U / & V U / T7 V U / T? V UT? V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO ne0Ws bE e c t [ B %S<NASSWSe s si on [ 6 2 5 0 W#S<7 [ 0 N V B%S<NASS U /$ V U / & V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO ne0Ws bE e c t [ & =@<T<#SWSes sio n [ 6 2 5 0 W#S<7 [ 0N V & =@<T<#SU /$ V U / & V U / T7 V UT7 BB#=@=?[N ] 666666N W<7TC[N5 0N V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO be stWs bE e c t [ B %S<NASSWSe s sio n [ 6 2 5 0 W#S<7 [ 0N V B%S<NASS U /$ V U / & V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO be stWs bE e c t [ & =@<T<#SWSe s si on [ 6 2 5 0 W#S<7 [ 0 N V & =@<T<#S U /$ V U / & V U / T7 V U / T? V UT? V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO ne0Ws bE e c t [ # C<@7?ANWSes sio n [ 6 2 5 0 W#S<7 [ 0N V # C<@7?ANU/$ V U / & V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO ne0Ws bE e c t [ ? AFA?AN#AWSe ssio n [ 6 2 5 0 W#S<7 [ 0N V ?AFA?AN#AU /$ V U / & V U / T7 V UT7 BB#=@=?[N ] 666666N W<7TC[N5 0N V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO be stWs bE e c t [ # C<@7?ANWSes sio n [ 6 2 5 0 W#S<7 [ 0 N V #C<@7?ANU/$ V U / & V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO be stWs bE e c t [ ? AFA?AN#AWSes sion [ 6 2 5 0 W#S<7 [ 0 N V ?AFA?AN#AU/$ V U / & V U / T7 V U / T? V UT? V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO ne0Ws bE e c t [ # =M&%TA?SWSe s sio n [ 6 2 5 0 W#S<7 [ 0N V # =M&%TA?S U /$ V U / & V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO ne0Ws bE e c t [ ? A@<B<=NWSes sio n [ 6 2 5 0 W#S<7 [ 0N V ?A@<B<=NU /$ V U / & V U / T7 V UT7 BB#=@=?[N ] 666666N W<7TC[N5 0N V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO be stWs bE e c t [ # =M&%TA?SWSe s sion [ 6 2 5 0 W#S<7 [ 0 N V # =M&%TA?S U /$ V U / & V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO be stWs bE e c t [ ? A@<B<=NWSe ssion [ 6 2 5 0 W#S<7 [ 0 N V ?A@<B<=NU/$ V U / & V U / T7 V U / T? V UT? V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO ne0Ws bE e c t [ # ==><NBWSes sio n [ 6 2 5 0 W#S<7 [ 0N V # = =><NBU /$ V U / & V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO ne0Ws bE e c t [ ? =M$N#AWSes si on [ 6 2 5 0 W#S<7 [ 0 N V ? =M$N#A U/$ V U / & V U / T7 V UT7 BB#=@=?[N ] 666666N W<7TC[N5 0N V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO be stWs bE e c t [ # = =><NBWSe s si on [ 6 2 5 0 W#S<7 [ 0 N V # ==><NBU/$ V U / & V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO be stWs bE e c t [ ? =M$N#AWSe ssio n [ 6 2 5 0 W#S<7 [ 0N V ? =M$N#AU /$ V U / & V U / T7 V U / T? V
T&# Bench2!r8I W
&!1e
c+c
UT? V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO ne0Ws bE e c t [ C A$@TCWSe ssio n [ 6 2 5 0 W#S<7 [ 0 N V CA$@TCU /$ V U / & V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllOne 0W s bE e c t [ S A@F* CA@&WSession [ 6 2 5 0 W#S<7 [ 0N V SA@F* CA@&U/$ V U / & V U / T7 V UT7 BB#=@=?[N ] 666666N W<7TC[N5 0N V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO be stWs bE e c t [ CA$@TCWSes si on [ 6 2 5 0 W#S<7 [ 0N V CA$@TCU/$ V U / & V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllObe s tWs bE e c t [ S A@F* CA@&WSession [ 6 2 5 0 W#S<7 [ 0 N V S A@F* CA@&U/$ V U / & V U / T7 V U / T? V UT? V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO ne0Ws bE e c t [ C<ST=?KWSession [ 6 2 5 0 W#S<7 [ 0N V C<ST=?KU/$ V U / & V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt - c 0. dllO n e 0W s bE e c t [ S #<AN#A* N$T%?AWSession [ 6 2 5 0 W#S<7 [ 0N V S #<AN#A* N$T%?AU/$ V U / & V U / T7 V UT7 BB#=@=?[N ] 666666N W<7TC[N5 0N V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO be stWs bE e c t [ C<ST=?KWSession [ 6 2 5 0 W#S<7 [ 0N V C<ST=?KU/$ V U / & V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt - c 0. dllO b e s tW s bE e c t [ S #<AN#A* N$T%?AWSession [ 6 2 5 0 W#S<7 [ 0 N V S #<AN#A* N$T%?AU/$ V U / & V U / T7 V U / T? V UT? V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO ne0Ws bE e c t [ C =MAWSe s si on [ 6 2 5 0 W#S<7 [ 0N V C =MA U /$ V U / & V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt - c 0. dllO n e 0W s bE e c t [ S #<AN#A* F<#T<=NWSession [ 6 2 5 0 W#S<7 [ 0N V S #<AN#A* F<#T<=NU/$ V U / & V U / T 7 V UT7 BB#=@=?[N ] 666666N W<7TC[N5 0N V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO be stWs bE e c t [ C =MAWSe s sio n [ 6 2 5 0 W#S<7 [ 0N V C =MA U /$ V U / & V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt - c 0. dllO b e s tW s bE e c t [ S #<AN#A* F<#T<=NWSession [ 6 2 5 0 W#S<7 [ 0 N V S #<AN#A* F<#T<=NU/$ V U / & V U / T 7 V U / T? V UT? V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO ne0Ws bE e c t [ C %M=?WSe s si on [ 6 2 5 0 W#S<7 [ 0N V C%M=? U /$ V U / & V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO ne0Ws bE e c t [ S & =?TSWSe s sio n [ 6 2 5 0 W#S<7 [ 0N V S & =?TS U /$ V U / & V U / T7 V UT7 BB#=@=?[N ] 666666N W<7TC[N5 0N V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO be stWs bE e c t [ C%M=?WSe s sio n [ 6 2 5 0 W#S<7 [ 0N V C%M=? U /$ V U / & V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO be stWs bE e c t [ S & =?TSWSe s si on [ 6 2 5 0 W#S<7 [ 0 N V S & =?TS U /$ V U / & V U / T7 V U / T? V UT? V UT7 V
T&# Bench2!r8I W
&!1e
c+ci
U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO ne0Ws bE e c t [ @<TA?$T%?AWSession [ 6 2 5 0 W#S<7 [ 0 N V @<TA?$T%?AU/$ V U / & V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO ne0Ws bE e c t [ T?$VA@WSession [ 6 2 5 0 W#S<7 [ 0N V T?$VA@U/$ V U / & V U / T7 V UT7 BB#=@=?[N ] 666666N W<7TC[N5 0N V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt - c 0. dllO b e s tW s bE e c t [ @<TA?$T%?AWSession [ 6 2 5 0 W#S<7 [ 0N V @<TA?$T%?AU/$ V U / & V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO be stWs bE e c t [ T?$VA@WSession [ 6 2 5 0 W#S<7 [ 0N V T?$VA@U/$ V U / & V U / T7 V U / T? V UT? V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO ne0Ws bE e c t [ MKSTA?KWSession [ 6 2 5 0 W#S<7 [ 0N V MKSTA?KU/$V U / & V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO ne0Ws bE e c t [K=%TCWSe s sio n [ 6 2 5 0 W#S<7 [ 0N VK=%TC U /$ V U / & V U / T7 V UT7 W<7TC[N5 0N BB#=@=? [N ] 666666NV U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO be stWs bE e c t [ MKSTA?KWSession [ 6 2 5 0 W#S<7 [ 0N V MKSTA?KU/$ V U / & V U / T7 V UT7 V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt- c 0. dllO be stWs bE e c t [ T?$VA@WSession [ 6 2 5 0 W#S<7 [ 0N VK=%TC U /$ V U / & V U / T7 V U / T? V U / T$B@AV U& $@<BN[N#ANTA?NV U $ C?AF[Nt - c 0. dllOSho - -i n 1B ! s 8 e t W$77SF@$B[NWSes sion [ 6 2 5 0 W#S<7 [ 0 N V U <MB S?#[Nc ! r t . 1i6N $@T[NSho - -i n 1 #!rtN B=?7A?[N0N W<7TC[N1 2 0 N CA<BCT[N5 0N V U / $ V U $ C?AF[Nt - c 0. dllO s e ! r c hWS e s si o n [ 6 2 5 0 W#S<7 [ 0N V U <MB S?#[Ns e ! r c h . 1i6N $@T[NSe ! r c hN B=?7A?[N0N W<7TC[N1 2 0 N CA<BCT[N5 0N V U / $ V U $ C?AF[Nht t - s . / / 000. t - c 0. c o 2 / t - c 0. dllO=rd e rS t ! t s WS e s sio n [ 6 2 5 0 W#S<7 [ 0N V U <MB S?#[Ns t ! t s . 1i6N $@T[N=rd e r St!t sN B=?7A?[N0N W<7TC[N1 2 0N CA<BCT[N5 0N V U / $ V U / & V U / B =7K V U / CTM@V
5' (
N e " Pr o # u c t s
UCTM@V UCA$7V UT<T@AVNe 0 &rod c t s &!1e. S bEect. $?TSU/T<T@AV UMAT$ #=NTANT[Nt e +t / h t 2 l G ch!rs e t [ 0i n d o 0s * 1252N CTT&*AD%<V[N#ont e n t* T;-eN V UMAT$ #=NTANT[NMSCTM@ 5.00.2 5 1 ( . 1 0 0 0 N N$MA[NBANA?$T=?NV U / CA$7 V UB=7K BB#=@=? [N ] 666666NV UC1 $@<BN[Nc e n t e r N V T&# Web #o22 e r c e Bench 2 ! r 8 'T&#*W)U/C1 V U& $@<BN[Nc e n t e r N V U <MB $@<BN[Nbot t o 2 N B=?7A?[N0N CA<BCT[N6,N S?#[Nt - clo 1o. 1i6N W<7TC[N2 8 8N V U / & V UC2 $@<BN[Nc e n t e r N V N e 0 &rod c t s &!1e * S bEect. $?TSU/C2 V UT$B@A $@<BN[N#ANTA?N B=?7A?[N0N W<7TC[N6 6 0 N V UT? $@<BN[N#ANTA?N V$@<BN[Nto -N V UT7 #=@S&$N[N5N V U B V U F = NT #=@=?[N ] 660 0 0 0 N S<TA[N X 1 N V #lic8 on one o6 o r l!tes t boo8s to 6ind o t 2or e cU/F=NT V U / B V U / T7 V U / T? V UT? $@<BN[N#ANTA?N V$@<BN[Nto -N V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 5 9 2 2 , WS e s sio n [ 6 2 5 0 W#S<7 [ 0 N V U <MB S?#[N5 9 2 2 , .E - 1N $@T[NBoo8 ] 5 9 2 2 , N W<7TC[N1 0 0 N CA<BCT[N1 5 0 N V U /$ V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 2 ( 5 6 8 WS e s sio n [ 6 2 5 0 W#S<7 [ 0 N V U <MB S?#[N2 ( 5 6 8 .E - 1N $@T[NBoo8 ] 2 ( 5 6 8 N W<7TC[N1 0 0 N CA<BCT[N1 5 0 N V U /$ V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 9 ( ( 2 9 WS e s sio n [ 6 2 5 0 W#S<7 [ 0 N V U <MB S?#[N9 ( ( 2 9 .E - 1N $@T[NBoo8 ] 9 ( ( 2 9 N W<7TC[N1 0 0 N CA<BCT[N1 5 0 N V U /$ V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 6 8 6 5 9 WS e s sio n [ 6 2 5 0 W#S<7 [ 0 N V U <MB S?#[N6 8 6 5 9 .E - 1N $@T[NBoo8 ] 6 8 6 5 9 N W<7TC[N1 0 0 N CA<BCT[N1 5 0 N V U /$ V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ ( 9 1 ( 5 WS e s sio n [ 6 2 5 0 W#S<7 [ 0 N V U <MB
T&# Bench2!r8I W
&!1e
c+cii
S?#[N( 9 1 ( 5 .E - 1N $@T[NBoo8 ] ( 9 1 ( 5 N W<7TC[N1 0 0 N CA<BCT[N1 5 0 N V U /$ V U / T7 V U / T? V U / T$B@AV UT$B@A B=?7A? [N1N #A@@&$77<NB[N1N #A@@S&$#<NB[N1N $@<BN[N#ANTA?NV UT? V UT7 V U F =NT S<TA[N X 1 N V $ t h o r U / F=NT V U / T7 V UT7 V U F =NT S<TA[N X 1 N V Ti tl e U /F=NTV U / T7 V U / T? V UT? V UT7 V U < V # BKF7h>WAb B$B$B$SAB$?A=BU/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ , ( 1 1 6 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V B o o d , B$B$B$NB%@NB%@ li8el; l!0s to the U /$ V U / T7 V U / T? V UT? V UT7 V U < V CKT.hO .W! 2 - GFi8lDY B$B$B$?AB$%@SA8+h U /< V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 9 8 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V ? o n d , co2in 1 ch! n 1 e s B$B$B$B$B$NB<N 2 st U /$ V U / T7 V U / T? V UT? V UT7 V U < V # e 6 s X A S 8 (B 2 S6tVT.T B$B$B$=BB$B$$T>v+#0 U /< V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ , , 6 6 0 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V Si d e s 2 s t tr!vel. B$B$B$$@<NB$SA $ver!1 e , U /$ V U / T7 V U / T? V UT? V UT7 V U < V $Z( , B$B$B$NB$T?A?AU/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ ( 2 2 6W ! 2 - G S e s si o n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V B$B$B$?A$@$@$T 7!r8, -ossi bl e U /$ V U / T7 V U / T? V UT? V UT7 V U < V )^VB5#. -;lc \dA B$B$B$$T$T=B<NU/<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 5 6 5 ( ( W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V & o - l ! r belie6s 2 st B$B$=B%@$TSA?Ah!ve to 0!st e. Sill;, U /$ V U /T7 V U / T? V UT? V UT7 V U < V T a W ! 2 - G / G b d 2 ; = 1J B$B$B$?A?A?AB$U/<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 1 , 8 8 , W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V B o o d , B$B$=B%@<N<N%@ - blic -o0e r s U /$ V U / T7 V U / T? V UT? V UT7 V U < V P Y h 9 1 5 X B$B$B$$@?<<N%@U/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllO Boo8<n6o [ 8 5 1 9 6W ! 2 - G S e s s i o n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V B$B$=B=B?<NB$@S 66icient, soci!l U /$ V U / T7 V U / T? V UT? V UT7 V U < V 8 \ )<V\. ( h>Bo1 B$B$B$?<$T?ASAU/<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 9 , 5 9 5 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V B$B$B$<NNB$T$T & blic, co2i n1 U /$ V U / T7 V U / T? V UT? V UT7 V U < V M?/ eT',@#0! t B$B$B$<NNB?ASAU/<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 2 , ( 8 6 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V B ! n d s 0ith the si2il!r, v!rio s B$B$B$?<B$SA%@ !r1 2 e n t s s!; U /$ V U / T7 V U / T? V UT? V UT7 V U < V T i #6MSN-O. 0\>%BB^ B$B$B$B$B$?<NBU/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ ( 0 0 0 0 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V A ;e s B$B$=B?<B$?<$@ l!st in the U /$ V U / T7 V U / T? V UT? V UT7 V U < V n . 5 n , b a 6 B$B$B$=B?<<N?AU/<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 6 1 ( 0W ! 2 - G S e s si o n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V <n t e r e s t s sh!ll h!ve to B$B$B$$T=B?AB$ cre !t e 6or U /$ V U /T7 V U / T? V UT? V UT7 V U < V d 0 [ b 6 C . d * 6+d0,. e 9 B$B$B$%@?<NB?<CKU/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 6 8 ( 9W ! 2 - G S e s si o n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V $ c tive he ! d s 0o ld set. N!tion !l, B$B$B$$T<N?ANB vis !l U /$ V U / T7 V U / T? V UT? V UT7 V U < V S 9 8M5>! 2S. 1& b& ! O? sBb B$B$B$$T$T<N?AU/<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 2 ( 6 ( 2 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V" dici!l, loc!l B$B$=BSA$T?A<N s!le s let U /$ V U / T7 V U / T? V UT? V UT7 V U < V = , .Vt -T oT< B$B$B$$T=B$@%@U/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 2 , 1 2W ! 2 - G S e s si o n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V N e 0, B$B$B$$@%@=B$@ cert !i n ho s e s co ld U /$ V U / T7 V U / T? V
T&# Bench2!r8I W
&!1e c+ciii
UT? V UT7 V U < V 2 8 9 V h 5 B$B$B$B$NB=B<NU/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 2 5 ( 5 2 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V % ni t e d , B$B$=BB$=BNBSA -s;c h olo 1ic !l !66!irs sho ld see. U /$ V U / T7 V U / T? V UT? V UT7 V U < V W ! 2 - G d B B$B$B$$T?AB$?AU/<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllO Boo8<n6o [ 5 1 0 9 W ! 2 - G S e s si o n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V B$B$B$?<=BB$NB&olitic!l, distinc tive U /$ V U / T7 V U / T? V UT? V UT7 V U < V K0lT?h?lF5rP B$B$B$B$?<?ASAU/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 2 ( 5 5 9 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V = t h e r , B$B$B$B$B$SANB s-e ci !l U /$ V U / T7 V U / T? V UT? V UT7 V U < V Kl:MG#&3T1:$s;b B$B$B$$@NBSA<NU/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ , , 9 8W ! 2 - G S e s si o n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V B$B$B$%@%@NB<N S bs e 9 e n t , co2 2 o n -roble 2 s c!n U /$ V U / T7 V U / T? V UT? V UT7 V U < V = r ] - ? D B$B$B$B$?A?<?AU/<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 5 0 1 2 0 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V A ! rl; 6resh ch! n 1 e s o 1ht to B$B$=B%@?ANBB$ h!-- e n . A!s;, U /$ V U / T7 V U / T? V UT? V UT7 V U < V 2 G @i^/%15 M) b +%i B$B$B$<NNB?<NBo+U /< V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 9 5 ( ( 5 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V & o - l ! r, en1lish d!;s B$B$=B$@?A?A$@ rele! s e . S8ills 1ro0. U /$ V U / T7 V U / T? V UT? V UT7 V U < V * vOC??t5ib;#(B,M. B$B$B$%@$@$T<NU/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 8 5 8 1 ( W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V <d e n ti c !l, B$B$=B$T$@%@?< othe r U /$ V U / T7 V U / T? V UT? V UT7 V U < V G , * VMt 2h (, )T- B$B$B$?A<N$TNBU/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 8 , 0 5 1 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V S o ci !l, B$B$=BSASA=B<N 6ollo0in1 !re ! s do s-e ! 8. U /$ V U / T7 V U / T? V UT? V UT7 V U < V \ W 2 \ 2 d ? B$B$B$%@?ANB$TU/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 2 5 5 8 , W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V <n t e r n ! l, - blic !re ! s B$B$B$NB%@%@$Tsh!ll h!ve to 8no0 inU/$ V U / T7 V U / T? V UT? V UT7 V U < V A 6 r O v8a - vC: vr0K B$B$B$=B?ASANBU /<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ , 6 ( 6 , W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V M c h british 2e n tell cert !i n, B$B$B$$T?<$T<N co2- e titive U /$ V U / T7 V U / T? V UT? V UT7 V U < V * v<r5ABT+St B$B$B$?ANB?<$@U/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ , ( 6 6 0 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V B$B$B$<N%@?A=B =the r, 6ine s bEe c t s in the historic!l, U /$ V U / T7 V U / T? V UT? V UT7 V U < V c ( * $A2S2% [ )= B$B$B$?A=B?<=BU/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 6 5 5 8 5 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V B$B$B$?A=B<N?< =r1! ni s ! ti on s c!n U /$ V U / T7 V U / T? V UT? V UT7 V U < V < oCG v! ,B d VVW! 2 - G 5 , + M , O B$B$B$%@B$=B$@!A,T2 U /< V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ , 0 9 5W ! 2 - G S e s si o n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V & blic, othe r B$B$B$%@B$NB?< 2e t h o d s 2 st h!ve to s-ell inU/$ V U /T7 V U / T? V UT? V UT7 V U < V 9 G B CDirs 9 X S - si B$B$B$$T$@NBSAU/<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 8 , 0 ( 5 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V B$B$B$<NNB=B=B Bri1ht !ctivitie s thin8. U /$ V U / T7 V U / T? V UT? V UT7 V U < V E BN B$B$B$?<$T$T?<U/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 5 1 ( 5 5 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V S t r e e t s 2e ! n - to the B$B$B$$TSA=B?A 6 t r e, U /$ V U / T7 V U / T? V UT? V
T&# Bench2!r8I W
&!1e c+civ
UT7 V U < V c + t %Y6N72, \r M0t2PW B$B$B$NB?<B$%@U/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 8 ( 9 ( 0 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V N cl e ! r, B$B$=B$@=B%@$T 6ine 2ont h s s!; inU/$ V U /T7 V U / T? V UT? V UT7 V U < V 0 n [ - ( #V \9 B$B$B$$TSA?<$@U/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 5 0 6 8 , W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V # e n t r ! l, christi ! n B$B$B$<N?A$T$@ -hoto 1r ! - h s U / $ V U / T7 V U / T? V UT? V UT7 V U < V C e t@ ] E 3 s ' B$B$B$<NNBNBB$U/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 5 1 2 1 2 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V # h ri s ti! n, B$B$=B$T?ANB?Aenviron 2 e n t ! l U /$ V U / T7 V U / T? V UT? V UT7 V U < V $>t<3BD:K0Vs.6NN\O B$B$B$=B%@?<?<U/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllO Boo8<n6o [ 1 ( 2 5 6W ! 2 - G S e s s i o n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V B$B$=B?A$@SA$TVictori!n, soci!l e;e s U /$ V U / T7 V U / T? V UT? V UT7 V U < V - - ) 5J 9" B$B$B$$T$@SANB7FU/<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 9 6 0 8 2 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V = nl ;, initi!l B$B$=B=B=B=B$@ service s U /$ V U / T7 V U / T? V UT? V UT7 V U < V 0 d ] C <YS<YY(r B$B$B$NBB$SA=B U/<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 9 5 2 1 5 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V S - e c i !l, nec e s s ! r ; B$B$B$<N=BB$?A ! th oritie s !ct U /$ V U / T7 V U / T? V UT? V UT7 V U < V i O l/M@+nS0W2 eM<F B$B$B$<N?A?<?AU/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 5 5 9 5 8 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V F e e s B$B$B$?<?<?<$T 6or the election s co ld !ct 6orU /$ V U / T7 V U / T? V UT? V UT7 V U < V / SJa%MM6 B$B$B$$T%@?<?AU/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 5 8 6 , 6 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V Tr ! di tio n !l, 0est e r n ho2 e s 8ee - B$B$=B$@?A=B$@ in the lon1, U /$ V U / T7 V U / T? V UT? V UT7 V U < V ( M MD c'Y>n?\ B$B$B$?<?<$@?<U/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 8 ( 8 9 5 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V S o ci !l, 8een B$B$=B=B?A?<B$ troo-s 2 st U /$ V U / T7 V U / T? V UT? V UT7 V U < V i ] 3 X 9 1 ST oB>#C ] B$B$B$$T?<B$=BU/<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 1 9 8 8 5 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V B$B$=BNB<N<N?< Nervo s, str! n 1 e U / $ V U / T7 V U / T? V UT? V UT7 V U < V B T t 1NY5 9, ! b 9 M B$B$B$?A$T%@NBU/<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 1 , ( 5 1 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V W e e 8 s 1o B$B$=B%@?ASA=B in the U /$ V U / T7 V U / T? V UT? V UT7 V U < V S ( P>hc+KP;h@E#. B$B$B$B$NB$@SAU/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllO Boo8<n6o [ 9 6 6 1 0W ! 2 - G S e s s i o n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V B$B$=B?AB$<N$T?i1ht, !c! d e 2 i c U / $ V U / T7 V U / T? V UT? V UT7 V U < V & 1 h , 1 W ! 2 - G 5 & )+t 1 d) B$B$B$NB$T?<=BU/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 5 2 5 9 1 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V B r o 8 e n , 6 ll 2o 2 e n t s into the B$B$=B=BSA?<$T stron 1 de!t h s U /$ V U / T7 V U / T? V UT? V UT7 V U < V = 8 S 1 ;Y<%)iF B$B$B$B$$@<N=Bb( 9 U /< V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 6 , 6 0 5 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V S o vi e t , -olitic !l B$B$B$=B?<%@$@ 2e 2 b e r s 6or1et in the U /$ V U / T7 V U / T? V UT? V UT7 V U < V 5 Y = B$B$B$B$$@NBSAJ!6U /<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 5 9 9 0 2 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V B$B$B$<NNB?ASA &!-er s 0o ld be1in. U /$ V U / T7 V U / T? V UT? V
T&# Bench2!r8I W
&!1e
c+cv
UT7 V U < V . %V5 *" B$B$B$?<NB=B$TU/<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ ( 1 2 5W ! 2 - G S e s si o n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V @o c !l, B$B$B$?A=B$@?< -ossi bl e ;e !r s 2 s t sho0 ri1ht. U /$ V U / T7 V U / T? V UT? V UT7 V U < V B X D t <% d [ 9 h B$B$B$NBB$=B%@U/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 8 9 ( 1 5 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V B$B$=B$T?A<N%@ Fe2 !l e, re!l ne e d s sho ld 2!8e. ?e1 l!r, U /$ V U / T7 V U / T? V UT? V UT7 V U < V o ' rB 1 v1 v hW d 5 b 8 e G %Jc B$B$B$%@NB?A=BU/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ , 6 , 0W ! 2 - G S e s si o n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V 7ir e c t o r s co2 b ! t in the hi1h, B$B$B$%@$T%@B$ 0ides - r e ! d U /$ V U / T7 V U / T? V UT? V UT7 V U < V % t / 1 SFM 2ScO c 9D& ] 0 / B$B$B$$@=BSA?<U/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 5 1 2 1 ( W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V @oc !l B$B$=B$TNB%@?A 6eet -!; 6or the U /$ V U / T7 V U / T? V UT? V UT7 V U < V 0l G ] 0 B$B$B$=BSA%@<N"1 7, U /< V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 2 9 9 5 , W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V Bi 1, e! st e r n res lt s B$B$B$%@?<<NSA sh!ll t!8e. Miles U /$ V U / T7 V U / T? V UT? V UT7 V U < V - AVM+1tSF(tS= 2 B$B$B$?<$T=BSAU/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ ( 1 6 , 6 W ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0N V S 66icien t, 6ede r !l st di e s cli2b. B$B$B$?<$TSA%@U/$ V U /T7 V U / T? V U / T$B@AV U& $@<BN[Nc e n t e r N V U $ C?AF[Nt - c 0. dllOSho - -i n 1B ! s 8 e t W ! 2 - G$77SF@$B[NW! 2 - GS e s si o n [ 1 5 6 ( W ! 2 - G #S<7 [ 0 N V U <MB $@T[NSho - -i n 1 #!rtN B=?7A? [N0N CA<BCT[N5 0N S?#[Nc ! r t. 1i6N W<7TC[N1 2 0N V U / $ V U $ C?AF[Nt - c 0. dllO s e ! r c hW ! 2 - G S e s s io n [ 1 5 6 ( W ! 2 - G #S<7 [ 0 N V U <MB $@T[NSe ! r c hN B=?7A? [N0N CA<BCT[N5 0N S?#[Ns e ! r c h . 1i6N W<7TC[N1 2 0N V U / $ V U $ C?AF[Nt - c 0. dllO ho 2 e W ! 2 - G S e s si o n [ 1 5 6 ( W ! 2 - G #S<7 [ 0 N V U <MB $@T[NCo 2 e N B=?7A?[N0N CA<BCT[N50N S?#[Nho 2 e . 1i6N W<7TC[N1 2 0N V U / $ V U / & V U / B =7KV U / CTM@V
5' >
.r # e r )i s p a *
UCTM@V UCA$7V UT<T@AVT&#* W =rde r 7is-l! ; &!1e U /T<T@AV U / CA$7 V UB=7K BB#=@=? [ 57N ] FFFFFFNV UC1 $@<BN[57N#ANTA?NVT&# Web #o2 2 e r c e Bench 2 ! r 8 'T&#* W)U/C1 V UC? W<7TC[ 57N, 0 0 N #=@=?[ 57N ] 2 0 2 0 2 0 N V UC2 $@<BN[57N#ANTA?NV=rd e r 7is-l!; &!1e U / C 2 V UB@=#>D%=TA V UB@=#>D%=TA V UB@=#>D%=TA V UB@=#>D%=TA V UC? V U& V = r d e r <7. 2592 0 1 5 U B ? V $ t h o ri: ! tio n <7. 12(6 , U B? V = r d e r &l!ced on [ (/1/19 9 9 U B ? V S hi - -i n 1 T;-e. ?e1 l !r U B? V S hi - 7!te. (/1/19 9 9 U B? V = r d e r S btot !l. M1,25 9. 0 1 [ 2 0 UB? V =r d e r T!+. M102. 2 2 [ 2 0 UB? V =r d e r Tot!l. M1,5( 1. 2 5 [ 2 0 UB? V U / & V UT$B@A B=?7A? [ 57N0N W<7TC[ 57N80 PN V UT? V UT7 V U B V B ill To. U /B V U / T7 V UT7 V U B V S h i - To. U/B V U / T7 V U / T? V UT? V UT7 #=@S&$N[ 57N2N V UC( V"o h n 7oe U /C ( V U / T 7 V U / T? V UT? V UT7 W<7TC[ 57N5 0 PN V U $ 77?ASS V 1 So2e &l!ce U B? V $ - t 1UB? V 7 llsville U B? V #$ [
T&# Bench2!r8I W
&!1e c+cvi
9269 1 U B ? V @ib;! U B ? V U B ? V A 2 ! il. 2e3 0o r8. co 2 U B? V & h o n e . [ 125* (56* ,890 U /$77?ASS V U B ? V U& V # r e di t #!rd T;-e. Vis! U B? V = r d e r St!t s. &endin1 U / & V U / T7 V UT7 V$@<BN[57NT=&N W<7TC[ 57N5 0 PN V U $ 77?ASS V 1 So2e &l!ce U B? V $ - t [ 1 UB? V 7 llsville U B? V #$ [ 9269 1 U B ? V @ib;! U /$77?ASS V U / T7 V U / T? V U / T$B@AV U /B@=#>D%=TAV U /B@=#>D%=TAV U /B@ [ =#>D%=TA V U / B@=#>D%=TA V U#ANTA? V UT$B@A B=?7A? [ 57N1N #A@@&$77<NB[ 57N5N #A@@S&$#<NB[ 57N0N V UT? V UT7 V UC( V <t e 2 ] U / C ( V U / T7 V UT7 V UC( V Ti tl e U / C ( V U / T 7 V UT7 V UC( V # o s t U / C ( V U / T7 V UT7 V UC( V D t ; U / C ( V U / T 7 V UT7 V UC( V 7i s c o n t U / C ( V U / T 7 V UT7 V UC( V # o 2 2 e n t U / C ( V U / T 7 V U / T? V UT? V UT7 V UC( V 5 5 1 ( U / C ( V U / T 7 V UT7 V$@<BN[57Nt o-N V UC( V Ti tl e. JBro0n, rec e n t B$B$=B$@<NB$SA-olicies sho ld 2!8 e. [ $r2s U B? V & bli sh e r. 9JVW"7?8WB=A-s ( U / C ( V U / T 7 V UT7 V UC( V M 9 5 0 . 2 5 U / C ( V U / T7 V UT7 V UC( V 1 U / C ( V U / T7 V UT7 V UC( V 1 2 PU /C( V U / T7 V UT7 V UC( V c o 2 2 e n t U / C ( V U / T 7 V U / T? V UT? V UT7 V UC( V 6 2 ( ( 0 U / C ( V U / T 7 V UT7 V$@<BN[57Nt o-N V UC( V Ti tl e. @!te, B$B$B$NB?<B$NB rece n t tree s 0o ld si1n. &ri2!r; b!n8s [ UB? V & blis h e r. 5dBC10 , ;2 o + e B= 9W +KM!EVT88:08 h TdC , U / C ( V U / T7 V UT7 V UC( V M 6 5 8 . 2 5 U / C ( V U / T7 V UT7 V UC( V 1 U / C ( V U / T7 V UT7 V UC( V 1 2 PU /C( V U / T7 V UT7 V UC( V c o 2 2 e n t U / C ( V U / T 7 V U / T? V U / T$B@AV U B? V U $ C?AF[ 57Nt - c 0. dllO s e ! r c hWS e s si o n [ 5 7 0 W#S<7 [ 57 0N V U <MB S?#[ 57Ns e ! r c h . 1i6N $@T[57NSe ! r c hN B=?7A?[ 57N0N W<7TC[ 57N12 0N [ CA<BCT[ 57N50N V U / $ V U$ C?AF[ 57Nt - c 0. dllO ho 2 e W S e s sio n [ 5 7 0 W#S<7 [ 57 0N V U <MB S?#[ 57Nho 2 e . 1i6N $@T[57NCo 2 e N B=?7A?[ 57N0N W<7TC[ 57N1 2 0 N [ CA<BCT[ 57N50N V U / $ V U / # ANTA? V U / B=7KV U /CTM@V
T&# Bench2!r8I W
&!1e c+cvii
5' & +
.r # e r 2n B u ir *
UCTM@V UCA$7V UT<T@AVT&#* W =rde r <n9 ir; &!1e U /T<T@AV U /CA$7 V UB=7K BB#=@=? [N ] 666666NV UC1 $@<BN[Nc e n t e r N V T&# Web #o22 e r c e Bench 2 ! r 8 'T&#*W)U/C1 V UC? W<7TC[N, 0 0 N #=@=?[N ] 2 0 2 0 2 0 N V UC2 $@<BN[Nc e n t e r N V = r d e r <n9 ir; &!1e U / C 2 V UF=?M $#T<=N[Nht t - s . // 000. t - c 0. c o 2 / t - c 0. dllO=rd e r?e s l tW ! 2 - G S e s si o n [ 0 W ! 2 - G #S<7 [ 0N MATC=7[N&=STN V UT$B@A $@<BN[N#ANTA?NV UT? V UT7 V UC( V % s e r n ! 2 e . U / C ( V U / T 7 V UT7 V U<N&%T N$MA[N s e r n ! 2 e N S<TA[N2 5N V U / T7 V U / T? V UT? V UT7 V UC( V & ! s s 0o r d . U / C ( V U / T7 V UT7 V U<N&%T N$MA[N- ! s s 0o r d N S<TA[N1 (N TK&A[N- ! s s 0o r d N V$@%A[N- ! s s 0o r d N V U / T7 V U / T? V U / T$B@AV U& $@<BN[N#ANTA?NV U B? V U <N&%T TK&A[N<M$BAN N$MA[N7is-l ! ; @!st =rderN S?#[Nor dSs t !. 1i6N CA<BCT[N5 0N W<7TC[N1 2 0N V U $ C?AF[Nht t - .// 000. t - c 0. c o 2 / t - c 0. dllOs e ! r c hWS e s sio n [ 0 W#S<7 [ 0 N V U <MB S?#[Ns e ! r c h . 1i6N $@T[NSe ! r c hN B=?7A?[N0N W<7TC[N1 2 0 N CA<BCT[N5 0N V U / $ V U $ C?AF[Nht t - .// 000. t - c 0. c o 2 / t - c 0. dllOho 2 e WS e s si o n [ 0 W#S<7 [ 0 N V U <MB S?#[Nh o 2 e . 1i6N $@T[NCo 2 e N B=?7A?[N0N W<7TC[N1 2 0N CA<BCT[N5 0N V U / $ V U / & V U / F =?M V U / B =7K V U / CTM@V
5' & &
Pro # u c t ) e t ai
UCTM@V UCA$7V UT<T@AVT&#* W &rod c t 7et!il &!1e U /T<T@AV U /CA$7 V UB=7K BB#=@=? [N ] 666666NV UC1 $@<BN[Nc e n t e r N V T&# Web #o22 e r c e Bench 2 ! r 8 'T&#*W)U/C1 V U#ANTA? V U <MB $@<BN[Nbot t o 2 N B=?7A?[N0N CA<BCT[N6,N S?#[Nt e 2 -S&?=7%#TS6iles/t-clo1o. 1i6N W<7TC[N2 8 8N V U / # ANTA? V UC2 $@<BN[Nc e n t e r N V & r o d c t 7et!il &!1e U / C 2 V UC2 V Ti tl e. Br!nd, B$B$=BB$SANB<N re! so n ! bl e U / C 2 V U& V$ t h o r. hv-- \ B$B$B$?A?<$T%@UB? V S bE e c t . &$?ANT<NBU/& V U& V U <MB $@<BN[Nri1ht N B=?7A?[N0N CA<BCT[N20 0N S?#[Nt e 2 -S&?=7%#TS6iles/i50 9 2 0 .E- 1N W<7TC[N2 0 0N V 7 e s c ri - ti on. U<V & . d + B s =OM59')M1Z) d S D ] b ;* ZhPS-B! 8 57W! 2 - G v tY* ;8. [ ;1 b d Y>$(5 d 2 c + 3 +Kv2v<WFK:h;M5. b?2M28 d X 1 T 1 : ,%VM>C1M* GB !2\?V=)96 X ] , i * i.9??9>5!V0$b3BEYE9<. 6%7slPh/a e& 0 oOV@?1B<)1;MZ\9t P SSVWnSM"#v^%Nrb+BDa>%'B,S^K/A<1b 2= X"11 8 - 8 S. PF;i ] 0B 3l -/& BGT)t5NW! 2 - G .K2S dW ! 2 - G t 1 ? d s> d h 9 BGTe o 0 r 2 , 8' 9 o= bW ! 2 - G 9 0%W! 2 - GO 8<a hW ! 2 - G '^rCn5 +d , , * c K;d^@6+.,% aWd [ hA@s1Nc eSnVdi? ] + ] 2 i c^ [K2* (%28T//ls"Y@d^5J,%)5SM+=D#bZK88ZP b 2idEcb* ?T/8 ^2K>9SW0)6D2T;6vbi"88"E^6:N2;6V d d 0 t SKSv d . lW;;)M"MO2<GV8ad ] S NW/ ] e Jl# Sv8 U /<V U / & V UB@=#>D%=TA V U& V U B V S 1 1 e s t e d ?et !il. M82.1 6 U / B V U B ? V U B V = r &rice. U /B V U F =NT #=@=?[N ] d d 0 0 0 0 N V U B V M,8.8 , U / B V U / F =NT V U B ? V U B V K o S!ve. U /B V U F =NT #=@=?[N ] d d 0 0 0 0 N V U B V M5.29 U / B V U / F =NT V U / & V U / B@=#>D%=TAV U7@ V U7T V U F =NT S<TA[N2N V B ! c 8i n 1. $%7<=, (502 9 -!1e s U B? V & blish e d b; D')#O !7SPbTPVdtZh U B? V & blic ! ti on d!t e. 9* 50* 199( U B? V $v !il d!te. 10* 9* 199( U B? V 7i 2 e n si o n s
T&# Bench2!r8I W
&!1e c+cviii
'in inche s). 29.59 + 91.58 + 69.50 U B? V <SBN. %Xvn.Tn6 2^01 8 U B? V U / F =NT V U / 7T V U / 7@ V U& $@<BN[Nc e n t e r N V U $ C?AF[Nt - c 0. dllOSho - -i n 1B ! s 8 e t W ! 2 - G$77SF@$B[KW!2 -G<S<7[ 5 0 9 2 0 W ! 2 - GTitle [ B r ! n d P 2 # P20B$B$=BB$SANB<N P20r e ! s o n ! b l e W ! 2 - G S?& [ 8 2 . 1 6W ! 2 - G # o s t [ , 8 . 8 , W ! 2 - G& ! c 8in 1 [ $%7<=W! 2 - GS e s sio n [ 1 5 , 0 W ! 2 - G #S<7[ 0W ! 2 - G DTK[ 1N V U <MB S?#[N! d d . 1i6N $@T[N$dd to B!s8e tN B=?7A?[N0N W<7TC[N1 2 0 N CA<BCT[N5 0N V U / $ V U $ C?AF[Nt - c 0. dllO s e ! r c hW ! 2 - G S e s s io n [ 1 5 , 0 W ! 2 - G #S<7 [ 0 N V U <MB S?#[Ns e ! r c h . 1i6N $@T[NSe ! r c hN B=?7A?[N0N W<7TC[N1 2 0 N CA<BCT[N5 0N V U / $ V U $ C?AF[Nt - c 0. dllO ho 2 e W ! 2 - G S e s si o n [ 1 5 , 0 W ! 2 - G #S<7 [ 0 N V U <MB S?#[Nh o 2 e . 1i6N $@T[NCo 2 e N B=?7A?[N0N W<7TC[N1 2 0N CA<BCT[N5 0N V U /$ V U $ C?AF[Nt - c 0. dllOSho 0B oo8W ! 2 - G<S<7 [ 5 0 9 2 0W ! 2 - G S e s s io n [ 1 5 , 0 W ! 2 - G #S<7 [ 0 N V U <MB S?#[N - d ! t e . 1i6N $@T[N%-d ! t e N B=?7A?[N0N W<7TC[N1 2 0N CA<BCT[N5 0N V U / $ V U / & V U / B =7K V U / CTM@V
5' & 4
S e arc$ ReB u e s t
UCTM@V UCA$7V UT<T@AVSe ! r c h ?e9 e s t &!1e U / T<T@AV U / CA$7 V UB=7KV UC1 $@<BN[Nc e n t e r N V T&# W #o2 2 e r c e Bench 2 ! r 8 'T&#* W)U/C1 V UC? W<7TC[N, 0 0 N #=@=?[N ] 2 0 2 0 2 0 N V UC2 $@<BN[Nc e n t e r N V U <MB S?#[Nt - cl o1o. 1i6N $@<BN[NB=TT=MN B=?7A?[N0N W<7TC[N2 8 8 N CA<BCT[N6 ,N V U / C 2 V UC2 $@<BN[Nc e n t e r N V S e ! r c h ?e9 e s t &!1e U / C 2 V UT$B@A $@<BN[N#ANTA?N B=?7A?[N0N W<7TC[N6 6 0 N V UT? $@<BN[N#ANTA?N V$@<BN[Nto -N V UT7 #=@S&$N[N5N V U B V U F = NT #=@=?[N ] 660 0 0 0 N S<TA[N X 1 N V #lic8 on one o6 o r l!tes t boo8s to 6ind o t 2or e cU/F=NT V U / B V U / T7 V U / T? V UT? $@<BN[N#ANTA?N V$@<BN[Nto -N V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 5 9 2 2 , WS e s sio n [ 6 2 5 0 W#S<7 [ 0 N V U <MB S?#[N5 9 2 2 , .E - 1N $@T[NBoo8 ] 5 9 2 2 , N W<7TC[N1 0 0 N CA<BCT[N1 5 0 N V U /$ V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 2 ( 5 6 8 WS e s sio n [ 6 2 5 0 W#S<7 [ 0 N V U <MB S?#[N2 ( 5 6 8 .E - 1N $@T[NBoo8 ] 2 ( 5 6 8 N W<7TC[N1 0 0 N CA<BCT[N1 5 0 N V U /$ V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 9 ( ( 2 9 WS e s sio n [ 6 2 5 0 W#S<7 [ 0 N V U <MB S?#[N9 ( ( 2 9 .E - 1N $@T[NBoo8 ] 9 ( ( 2 9 N W<7TC[N1 0 0 N CA<BCT[N1 5 0 N V U /$ V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 6 8 6 5 9 WS e s sio n [ 6 2 5 0 W#S<7 [ 0 N V U <MB S?#[N6 8 6 5 9 .E - 1N $@T[NBoo8 ] 6 8 6 5 9 N W<7TC[N1 0 0 N CA<BCT[N1 5 0 N V U /$ V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ ( 9 1 ( 5 WS e s sio n [ 6 2 5 0 W#S<7 [ 0 N V U <MB S?#[N( 9 1 ( 5 .E - 1N $@T[NBoo8 ] ( 9 1 ( 5 N W<7TC[N1 0 0 N CA<BCT[N1 5 0 N V U /$ V U / T7 V U / T? V U / T$B@AV UF=?M $#T<=N[Nt -c 0. dllOre s l tW! 2 - G S e s si o n [ 5 6 , 8 W ! 2 - G #S<7 [ 2 8 8 0 0 0 5 N MATC=7[N-o s t N V UT$B@A $@<BN[Nc e n t e r N V UT? V UT7 $@<BN[Nri1ht N V UC5 V S e ! r c h b;. U / C5 V U / T7 V UT7 W<7TC[N1 0 0N V U / T7 V U / T? V UT? V UT7 $@<BN[Nri1ht N V USA@A#T N$MA[Ns e ! r c h N S<TA[N1N V U=&T<=N SA@A#TA7[NSA@A#TA7N V$@%A[N! t h o rN V $ t h o r U/=&T<=NV U=&T<=N V$@%A[NtitleN V Title U/=&T<=NV U=&T<=N V$@%A[Ns bE e c t N V S bE e c t U / = &T<=N V U / SA@A#TV U /T7 V UT7 V U<N&%T N$MA[NtitleS6ieldN S<TA[N5 0N V U / T7 V U / T? V U / T$B@AV U& $@<BN[Nc e n t e r N V U <N&%T TK&A[N<M$BAN N$MA[NSe ! r c h N S?#[Ns b 2i t. 1i6N CA<BCT[N5 0N W<7TC[N1 2 0N V U $ C?AF[Nt - c 0. dllO ho 2 e W S e s si o n [ 5 6 , 8 W#S<7 [ 2 8 8 0 0 0 5 N V U <MB S?#[Nh o 2 e . 1i6N $@T[NCo 2 e N B=?7A?[N0N W<7TC[N1 2 0N CA<BCT[N5 0N V U /$ V U $ C?AF[Nt - c 0. dllOSho - -i n 1B ! s 8 e t W$77SF@$B[NWSes sion [ 5 6 , 8 W#S<7 [ 2 8 8 0 0 0 5 N V U <MB S?#[Nc ! r t . 1i6N $@T[NSho - -i n 1 #!rtN B=?7A?[N0N W<7TC[N1 2 0 N CA<BCT[N5 0N V U / $ V U/& V U / F =?M V U / B =7KV U / CTM@V
T&# Bench2!r8I W
&!1e c+ci+
5' & 6
S e arc$ Re s u t s
UCTM@V UCA$7V UT<T@AVSe ! r c h ?es lt U /T<T@AV U /CA$7 V UB=7KV UC1 $@<BN[N#ANTA?NVT&# Web #o22 e r c e Bench 2 ! r 8 'T&#*W)U/C1 V UC2 $@<BN[N#ANTA?NV U <MB S?#[Nt - cl o1o. 1i6N $@<BN[NB=TT=MN B=?7A?[N0N W<7TC[N2 8 8 N CA<BCT[N6 ,N V U / C 2 V UC2 $@<BN[N#ANTA?NV S e ! r c h ?es lts * Title. B$B$=B<N?<?A?<U/C2 V UT$B@A $@<BN[N#ANTA?N B=?7A?[N0N W<7TC[N6 6 0 N V UT? $@<BN[N#ANTA?N V$@<BN[Nto -N V UT7 #=@S&$N[N5N V U B V U F = NT #=@=?[N ] 660 0 0 0 N S<TA[N X 1 N V #lic8 on one o6 o r l!tes t boo8s to 6ind o t 2or e cU/F=NT V U / B V U / T7 V U / T? V UT? $@<BN[N#ANTA?N V$@<BN[Nto -N V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 5 9 2 2 , WS e s sio n [ 6 2 5 0 W#S<7 [ 0 N V U <MB S?#[N5 9 2 2 , .E - 1N $@T[NBoo8 ] 5 9 2 2 , N W<7TC[N1 0 0 N CA<BCT[N1 5 0 N V U /$ V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 2 ( 5 6 8 WS e s sio n [ 6 2 5 0 W#S<7 [ 0 N V U <MB S?#[N2 ( 5 6 8 .E - 1N $@T[NBoo8 ] 2 ( 5 6 8 N W<7TC[N1 0 0 N CA<BCT[N1 5 0 N V U /$ V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 9 ( ( 2 9 WS e s sio n [ 6 2 5 0 W#S<7 [ 0 N V U <MB S?#[N9 ( ( 2 9 .E - 1N $@T[NBoo8 ] 9 ( ( 2 9 N W<7TC[N1 0 0 N CA<BCT[N1 5 0 N V U /$ V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 6 8 6 5 9 WS e s sio n [ 6 2 5 0 W#S<7 [ 0 N V U <MB S?#[N6 8 6 5 9 .E - 1N $@T[NBoo8 ] 6 8 6 5 9 N W<7TC[N1 0 0 N CA<BCT[N1 5 0 N V U /$ V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ ( 9 1 ( 5 WS e s sio n [ 6 2 5 0 W#S<7 [ 0 N V U <MB S?#[N( 9 1 ( 5 .E - 1N $@T[NBoo8 ] ( 9 1 ( 5 N W<7TC[N1 0 0 N CA<BCT[N1 5 0 N V U /$ V U / T7 V U / T? V U / T$B@AV UT$B@A B=?7A? [N1N #A@@&$77<NB[N1N #A@@S&$#<NB[N1N $@<BN[N#ANTA?NV UT? V UT7 V U F =NT S<TA[N X 1 N V $ t h o r U / F=NT V U / T7 V UT7 V U F =NT S<TA[N X 1 N V Ti tl e U /F=NTV U / T7 V U / T? V UT? V UT7 V U < V $ s + ! 26 $ B$B$B$?<$T=B=BU /<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 1 8 5 ( 5 WS e s sio n [ 1 5 6 6 W#S<7 [ 0 N V W o r d s B$B$=B<N?<?A?<stic8. %--er, res-o n sible rel!tion s hi- s U /$ V U / T7 V U / T? V UT? V UT7 V U < V = s 2 h>+nc^#2Ml B$B$B$=B=BSAB$U/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 5 5 , ( 9 WS e s sio n [ 1 5 6 6 W#S<7 [ 0 N V C 1 e , ed c ! tion !l B$B$=B<N?<?A?<bo!t s re! c t . U /$ V U / T7 V U / T? V UT? V UT7 V U < V ;) b l/ B$B$B$SA?<=B%@U/<V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ ( 2 8 9 5 WS e s sio n [ 1 5 6 6 W#S<7 [ 0 N V S 2 ! ll, B$B$=B<N?<?A?< e! st e r n 6!cts !t the 2od e s t , ne0 U /$ V U / T7 V U / T? V UT? V UT7 V U < V c 9K d c d , t 6 B$B$B$<N$T<N=Bbv1 U /< V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 5 ( 2 8 2 WS e s sio n [ 1 5 6 6 W#S<7 [ 0 N V & - . tell in the B$B$=B<N?<?A?< the n 6 ll bone s. White U /$ V U / T7 V U / T? V UT? V UT7 V U < V : c$ b6nSO \5>,TcTo- c M B$B$B$$TB$?A?<U/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllO Boo8<n6o [ 6 0 6 8 0W S e s si o n [ 1 5 6 6 W#S<7 [ 0 N V B$B$=B<N?<?A?<Be! ti6 l U /$ V U / T7 V U / T? V UT? V UT7 V U < V ( X * 'N" B$B$B$$T?<?<B$U/<V U /T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 9 5 8 ( 8 WS e s sio n [ 1 5 6 6 W#S<7 [ 0 N V B o o d , B$B$=B<N?<?A?< soci!l e;e s 6i+O =the r not e s 2! 8e here. U /$ V U / T7 V U / T? V U / T$B@AV U& $@<BN[N#ANTA?NV U $ C?AF[Nt - c 0. dllOSho - -i n 1B ! s 8 e t W$77SF@$B[NWSes sion [ 1 5 6 6 W#S<7 [ 0 N V U <MB S?#[Nc ! r t . 1i6N $@T[NSho - -i n 1 #!rtN B=?7A?[N0N W<7TC[N1 2 0 N CA<BCT[N5 0N V U / $ V U $ C?AF[Nt - c 0. dllO s e ! r c hWS e s si o n [ 1 5 6 6 W#S<7 [ 0N V U <MB S?#[Ns e ! r c h . 1i6N $@T[NSe ! r c hN B=?7A?[N0N W<7TC[N1 2 0 N CA<BCT[N5 0N V U / $ V U $ C?AF[Nt - c 0. dllO ho 2 e W S e s si o n [ 1 5 6 6 W#S<7 [ 0N V U <MB S?#[Nh o 2 e . 1i6N $@T[NCo 2 e N B=?7A?[N0N W<7TC[N1 2 0N CA<BCT[N5 0N V U / $ V U / & V U / B =7K V U / CTM@V
T&# Bench2!r8I W
&!1e
cc
5' & 8
S $ o p p i n g Car t
UCTM@V UCA$7V UT<T@AVT&# W Sho--in 1 #!rt &!1e U /T<T@AV U / CA$7 V UB=7K BB#=@=? [N ] FFFFFFNV UC1 $@<BN[N#ANTA?NVT&# Web #o22 e r c e Bench 2 ! r 8 'T&#*W)U/C1 V U#ANTA? V U <MB S?#[Nt - cl o1o. 1i6N $@<BN[NB=TT=MN B=?7A?[N0N W<7TC[N2 8 8 N CA<BCT[N6 ,N V U / #ANTA? V UC2 $@<BN[N#ANTA?NV Sh o - -i n 1 #!rt &!1e U / C 2 V UT$B@A $@<BN[N#ANTA?N B=?7A?[N0N W<7TC[N6 6 0 N V UT? $@<BN[N#ANTA?N V$@<BN[Nto -N V UT7 #=@S&$N[N5N V U B V U F = NT #=@=?[N ] 660 0 0 0 N S<TA[N X 1 N V #lic8 on one o6 o r l!tes t boo8s to 6ind o t 2or e cU/F=NT V U / B V U / T7 V U / T? V UT? $@<BN[N#ANTA?N V$@<BN[Nto -N V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 5 9 2 2 , WS e s sio n [ 6 2 5 0 W#S<7 [ 0 N V U <MB S?#[N5 9 2 2 , .E - 1N $@T[NBoo8 ] 5 9 2 2 , N W<7TC[N1 0 0 N CA<BCT[N1 5 0 N V U /$ V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 2 ( 5 6 8 WS e s sio n [ 6 2 5 0 W#S<7 [ 0 N V U <MB S?#[N2 ( 5 6 8 .E - 1N $@T[NBoo8 ] 2 ( 5 6 8 N W<7TC[N1 0 0 N CA<BCT[N1 5 0 N V U /$ V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 9 ( ( 2 9 WS e s sio n [ 6 2 5 0 W#S<7 [ 0 N V U <MB S?#[N9 ( ( 2 9 .E - 1N $@T[NBoo8 ] 9 ( ( 2 9 N W<7TC[N1 0 0 N CA<BCT[N1 5 0 N V U /$ V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ 6 8 6 5 9 WS e s sio n [ 6 2 5 0 W#S<7 [ 0 N V U <MB S?#[N6 8 6 5 9 .E - 1N $@T[NBoo8 ] 6 8 6 5 9 N W<7TC[N1 0 0 N CA<BCT[N1 5 0 N V U /$ V U / T7 V UT7 V U $ C?AF[Nt -c 0. dllOBoo8<n6o [ ( 9 1 ( 5 WS e s sio n [ 6 2 5 0 W#S<7 [ 0 N V U <MB S?#[N( 9 1 ( 5 .E - 1N $@T[NBoo8 ] ( 9 1 ( 5 N W<7TC[N1 0 0 N CA<BCT[N1 5 0 N V U /$ V U / T7 V U / T? V U / T$B@AV UF=?M $#T<=N[Nt -c 0. dllO$dE st 2 e n tWS e s sio n [ 1 5 , 0 W#S<7 [ 0 N MATC=7[N&=STN V U#ANTA? V U& V U / & V UT$B@A B=?7A? [N0N V UT? V UT7 V U B V D t ; U / B V U / T 7 V UT7 V U B V & r o d c t U / B V U / T7 V U / T? V UT? V UT7 V$@<BN[NT=&NV U <N&%T TK&A[NC<77ANN N$MA[N<S<7N V$@%A[N55 , 0 8 N V U <N&%T N$MA[NDTKN V$@%A[N1N S<TA[N5N V U / T7 V UT7 V$@<BN[NT=&NV U < V S c o t t i s h, hi1h r!te s B$B$B$$@$TSA=B 6eel vit!l U /< V * B!c8in1. $%7<=UB? V S?&. M(26. 2 1, UF=NT #=@=?[N ] $$0 0 0 0 N V U B V K o r &rice. M266. 8 1 U / B V U / F =NT V U / T7 V U / T? V UT? V UT7 V$@<BN[NT=&NV U <N&%T TK&A[NC<77ANN N$MA[N<S<7N V$@%A[N50 9 2 0 N V U <N&%T N$MA[NDTKN V$@%A[N1N S<TA[N5N V U / T7 V UT7 V$@<BN[NT=&NV U < V B r ! n d , B$B$=BB$SANB<N re!s o n ! bl e U /< V * B!c8in1. $%7<=UB? V S?&. M82. 16, UF=NT #=@=? [N ] $$0 0 0 0N V U B V K o r &rice. M,8. 8, U / B V U / F =NT V U / T7 V U / T? V U / T$B@AV U B V U < V S b t o t ! l -rice. M5(5. 6 8 U/<V U / B V U B ? V @ ! s t %-d!t e d. 05/10/ 2 0 0 0 16.25. 5 ( U& V U B ? V U <N&%T TK&A[N<M$BAN N$MA[N&roc e e d to #hec8o tN S?#[Nch e c 8 o t. 1i6N CA<BCT[N5 0N W<7TC[N1 2 0N V U <N&%T TK&A[N<M$BAN N$MA[N#onti n e Sho--in1N S?#[Nho 2 e . 1i6N CA<BCT[N50N W<7TC[N1 2 0 N V U / & V U& V<6 ;o h!ve ch! n 1 e d the 9 !n titie s !nd/or t!8e n !n;thin 1 o t U B? V o6 ;o r sho- -i n 1 c!rt, clic8 here to re6re s h ;o r sho- -in 1 c!rt. U /& V U& V U <N&%T TK&A[N<M$BAN N$MA[N?e6re s h Sho--in 1 #!rtN S?#[Nr e6re s h . 1i6N CA<BCT[N50N W<7TC[N1 2 0N V U / & V U / # ANTA? V U /F=?M V U /B=7KV U / CTM@V
T&# Bench2!r8I W
&!1e
cci
A p p e n # i 3 1 , E@EC9T2?E S 9MMAR7
This !-- e n di + incl d e s ! s! 2 -l e A+ec tiv e S 2 2 ! r ;, 0hich incl d e s the 6ollo0in1 5 -!1 e s . =vervie0 &!1e &ricin1 &!1e N 2 eric !l D !n titie s S 2 2 ! r ; &!1e.
#l! s e s , !nd 8.2 1ive ! det !il e d descri-tion o6 the re9 ire d 6or2 ! t !nd cont e n t o6 the A+ec tiv e S 2 2 ! r ;. This s! 2 -l e is -rovid e d onl; !s !n ill str! tion o6 the re9 ir e 2 e n t s set 6orth in this s-eci6ic!tion. <n the eve n t o6 ! con6lict bet0 e e n this e+! 2 -l e !nd the s-eci6ic!tion, the s-eci6ic!tion '#l! s e s 8.2 !nd ,) sh!ll -rev !il. The re9 ir e d 6or2 ! t o6 the T&#*W A+ec tiv e S 2 2 ! r ; 2 !; ch!n 1 e 6ro2 ti2 e to ti2 e. The l!te st version o6 the re9 ir e d 6or2 ! t is !v!il! bl e -on re9 e s t 6ro2 the T&W !d 2i ni str ! t o r 'se e cover -!1 e).
1' &
2m p e m e n t a t i o n . - e r -i e " P a g e
The 6ollo0in1 -!1 e de 2 o n s t r ! t e s ho0 the =vervie0 -!1 e sho ld !-- e ! r.
T&# Bench2!r8I W
&!1e
ccii
S -er7oo - e r
Pric e Perf or m a n c e
&eri1e e 5000 0ith 7!t!M!rt 2001

Perf or m a n c e
T&#*W ?ev 1.5

A-ai a b e
H@<@@@@ -er W<&S310,0 0 0

Tota Cos t MJJJ,JJJ Sca e 10,0 0 0 ite2 s Web Ser - e r &ern e s e <ntern e t <n6or2 ! tio n Server 5.0 )at a b a s e Man a g e r &ern e s e SD@ Serv er 2000
JJJJ.J W<&S310,0 0 0
W2PS oN & + < + + + J,JJJ.J Nu m b e r of 9s er s 1(,0 0 0 App i c a t i o n S er- e r &ern e s e <S$&< %oa# Ba a n c e r &ern e s e Web S0itch 2(0+
1* $ 1* 01
W2PS bN & + < + + + J,JJJ.J Nu m b e r of S* s t e m s 8 2ma g e Ser - e r &ern e s e <ntern e t <n6or2 ! ti o n Serv er 5.0 Web Cac$ e #l!2 2.5 on Bl e Shoe s @in + 6.2
.t$ er Sof t " a r e A Wi:b! n 1 <nde+ M!n! 1 e r (.2 'te+t se !rc h en1in e)
5un c ti o n Web Server $--lic!tion Serv er <2!1 e Serv er
S* s t e m
O of S* s t e m s (
.p er a ti n g S* s t e m Wi:b! n 1 200 0 Server Wi:b!n 1 2000 $dv!nc e d Serv er n!
Proc e s s o r s 2 JKT 800 MC: 256>B ( JKT <<< ,00MC: 2MB n!
Me m o r *
&eri1e e 500 0
512 MB
7!t! b ! s e M!n! 1 e r 7!t!M!rt 2000 @o!d B!l!nc e r &ern e s e 2(0+ s0itch
1 1
( BB5 n!
T&# Bench2!r8I W
&!1e
cciii
Web #!ch e =ther So6t0!r e
&eri1e e 500 0 &eri1e e 500 0
1 1
Bl e Shoe s @in + 6.2 Wi:b! n 1 200 0 Server
2 JKT <<< 800 MC: 256>B 2 Me1!F ! s t 800 MC:
1 BB 512 MB
T&# Bench2!r8I W
&!1e
cciv
1' 4
Pri ci n g P a g e
TPC, W Re-' &' 4 ' 6
Sp o n s o r ( s )
S* s t e m ( s ) Nam e ( s )
Perf or m a n c e
Rep o r t )at e &4I 4 + I & > > >
A-ai a b i it * )at e .cto b e r &: < 4+ + +

Kt* ' E3t e n# e # Pric e 6 *r'Mai nt' Pric e
H&< > + & p er W2PSN & + < + + +

)e s c ri p t i o n
&4 6 ' 8
Part No'
W2PSN & + < + + + T$ir# Part *

Bran # Pric e
9nit Pric e
)ire c t o r * Na m e Ser - e r
Web S er- e r
Su b t ota
App ic a ti o n Ser- e r
Su b t ota
)at a b a s e Ser- e r
Su b t ota
Su b t ota 6 7ear Cost of ."n e r s $W2PSN ip &+<++ + H I W2PSN & + < + + +
2n# e p e n # e n t * Au#it e # b*A Au#it orL s na m e og o
Au#it
firmL s
na m e
or
T&# Bench2!r8I W
&!1e
ccv
1' 6
N u m e ri c a K u a n t i ti e s S u m m a r * P a g e
TPC, W Re-' &' 4 ' 6
Sp o n s o r ( s )
S* s t e m ( s ) Nam e ( s )
Perf or m a n c e
Rep or t )at e &4I 4 + I & > > >
A-ai a b i it * )at e .cto b e r &: < 4+ + +
H& > + & p er W2PSN & + < + + +

W2PS 2nt er a c t i o n Su m m a r *
2nt er a c t i o n Co2 e Sho--i n 1 #!rt # sto 2 e r ?e1istr ! tio n. B ; ?e9 es t B ; #on6ir2 =rder <n9 ir; =rder 7is-l!; Se!rc h ?e9 e s t Se!rc h ?es lt s Ne0 &rod ct s Best Sellers &rod ct 7et !il $d2in. ?e9 e s t $d2in. #on6ir2
&4 6 ' 8 Nu m e ri c a
W2PSN & + < + + +
Kuan t i t i e s Su m m a r *
Cou n t 5555 2 25,, 6 666 6 5,, 8 266 , 166 , 1(6 , (((( 0 5,,, ( 1111 0 1111 0 5,,, ( 225 200 >+J Res p o n s e 0.1 0.9 1.1 0.2 5.5 0.8 1.2 0.5 8.5 0.(2 0.(5 0.9 18.6 0.5
Mi3 16.0 0 P 11.6 0 P 5.00P 2.60P 1.20P 0.,5P 0.66P 20.0 0 P 1,.0 0 P 5.00P 5.00P 1,.0 0 P 0.10P 0.09P
Mea s u r e m e n t 2nt er - a s Su m m a r *
S$ o p p i n g Ramp , up tim e (mi n ' ) %en g t $ of Mea s u r e m e n t 2nt er - a (mi n ' ) A A-er a g e T$in! Time (s e c ' ) A-er a g e 9s er S e s s i o n #ura ti o n (mi n ) Nu m b e r of 9s er s 2,.5 50 ,.1 15.1 100 Bro " s i ng 2,.5 50 ,.2 15.1 150 .r# eri n g 2,.5 50 ,.5 15.1 ,5
T&# Bench2!r8I W
&!1e
ccvi
A p p e n # i 3 H , W1EN 9T2%2T7
This !-- e n di + is ! 1en e r !l descri-tion o6 WBAN, ! s! 2 -l e i2-le 2 e n t ! t i o n o6 so2 e o6 the d!t ! b ! s e * -o- l !tio n* 1en e r ! t i o n ro tin e s re9 ire d in T&#W.
H' &
) e s c ri p ti o n
WBAN is ! d!t ! b ! s e -o- l !tio n -ro1r ! 2 6or se 0ith the T&#*W benc h 2 ! r 8 s . <t is 0ritt en in $NS< H#H 6or -ort ! bilit;, !nd is b!s e d on cod e th!t h!s be e n s cc e s s6 ll; -ort e d to over ! do: e n di66ere n t s;st e 2 s . The so rc e cod e h!s be e n -rovid e d to 2!8 e the -roc e s s o6 b ildin1 ! co2 -li! nt d!t ! b ! s e -o- l !tio n !s si2-l e !s -ossibl e . WBAN cont !i n s the t;-e s o6 6 nction !lit; th!t 0ill be re9 ir e d in ! d!t ! b ! s e 1en e r ! t o r 6or the T&#*W benc h 2 ! r 8. <t -rod c e s s! 2 -l e o t- t 6or t0o o6 the 6ields in the benc h 2 ! r 8 de6inition, $S@N$MA !nd <ST<T@A. The n 2 b e r o6 s! 2 -l e s -rod c e d , !lon1 0ith rel!t e d v!ri!bl e settin 1s li8e n 2 b e r o6 ite2 s !nd ! t h or s c!n be controlled 6ro2 the co2 2 ! n d line. $ll o t - t is sent to stdo t . The WBAN tilit; is cont !i n e d in the 6ollo0in1 6iles. rnd.YchZ t-c0.YchZ b2S tils.c 2 !in.c 1r! 2 2 ! r . t - c 0 $ -ort ! bl e r!nd o 2 * n 2 b e r 1en e r ! t o r The T&#*W*s-eci6ic ro tin e s Ben eric ro tin e s b!s e d on thos e $ si2 -l e driver ro tin e The WBAN 1r! 2 2 ! r se d in T&#*7Hs 7BBAN
To b ild WBAN on ! ne0 s;st e 2 , do the 6ollo0in1.

&' 4'
#re!t e !n !--ro - ri ! t e 2!8 e6ile, 2 !8 e
sin1 2 !8 e6ile.s it e !s ! b!sis.
Not e . The re9 ir e d ch!n 1 e s to the 2!8 e6ile sho ld be li2ite d to the 6irst 6e0 lines.
H' 4
9 s i n g W1EN
<t is ! re9 ir e 2 e n t o6 the T&#*W benc h 2 ! r 8 th!t s-on s or s se WBAN to 1en e r ! t e the te+t th!t is se d to -o- l !t e the <ST<T@A !nd $S@N$MA 6ields in the d!t ! b ! s e . WBAN 2! ; be se d !s 6ollo0s. The s-on s o r 2 !; se the e+ ec t ! bl e -rovid e d. The $S#< d!t ! it 1en e r ! t e s cont !i n s d!t ! th!t c!n be re!d b; ! lo!d e r -ro1r ! 2 !nd se d to -o- l ! t e the d!t ! b ! s e . The s-on s or 2 !; b ild !n e+ ec t ! bl e -ro1r ! 2 b!s e d on the so rc e 6iles -rovid e d . The e+ec t ! bl e is se d to 1en e r ! t e the d!t ! se d b; the lo!d er to -o- l !t e the d!t ! b ! s e . Com m e n t & A <6 !n e+ ec t ! bl e other th!n th!t -rovid e d b; the T&# is se d, the n! 2 e !nd version o6 the co2 -iler se d to b ild it 2 st be disclos e d, !lon 1 0ith !n; co2 -ile* ti2 e s0itch e s or o-tion settin 1s. T&# Bench2!r8I W St!nd!rd S-eci6ic!tion Version &'( &!1e ccvii
Com m e n t 4 A Modi6ic!tion s to the WBAN so rc e 2 st be li2ited to thos e re9 ire d 6or -ort ! bilit; or s-e e d . <6 ! 2odi6ied version o6 WBAN is se d, the 2odi6ied so rc e 6iles 2 st be disclos e d in 6 ll. The s-on s or 2 !; incl d e the s! 2 -l e -ro1r ! 2 th!t c!lls the 28Stitle') !nd the co2 -il er se d !nd the so rc e o6 !n; co2 -il e* ti2 e or r nti 2 e o-tions so rc e 6iles, o2ittin 1 2 !in.c, in his o0n lo!d e r 28S! t h or') 6 nctions. The n! 2 e !nd version o6 the lo!d e r 2 st be disclos e d in 6 ll, !lon1 0ith se d to lo!d the d!t ! b ! s e .
?e1!r dl e s s o6 the 2! n o r in 0hich WBAN is se d, the ! ditor 2 st veri6; th!t the v!l e s se d to -o- l !t e the <ST<T@A !nd $S@N$MA 6ields 2 !t c h thos e -rod c e d b; the T&#* s --lie d tools.
H' 6
C o m m a n # %in e . p ti o n s
WBANHs o t- t is controlle d b; ! co2 bi n ! tio n o6 co2 2 ! n d line o-tions !nd environ 2 e n t v!ri!bl e s. #o2 2 ! n d line o-tion s !re !ss 2 e d to be sin1le lett er 6l!1s -rec e d e d b; ! 2in s si1n. The; 2! ; be 6ollo0e d b; !n o-tion !l !r1 2 e n t .
.pti o n *h *s *! *< *d *2
arg u m e nt
#ef a u t
acti o n 7is-l!; ! s! 1 e s 2 2 ! r ;
Us!2 -le sV U! thors V Uit e 2 s V U6ile V U2ode V
1 250 1000 1r! 2 2 ! r . t c0 0
N 2 b e r o6 s! 2 -l e 1en e r ! t e d Set the n 2 b e r o6 ! t h or s Set the n 2 b e r o6 ite2 s ?e!d distrib tion s 6ro2 U6ile V Set the o t - t 2od e s !re. 0 ** <ST<T@A 1 ** $S@N$MA 2od e . 7e6ine d
H' 8
En -ir o n m e n t ?ari a b e s
Anviron 2 e n t v!ri!bl e s !re se d to control 6e!t r e s o6 WBAN th!t !re 6ro2 one e+ec ti o n to !not h e r. nli8el; to ch!n 1 e
?ariab e
)ef a u t
Acti o n
T&# Bench2!r8I W
&!1e ccviii
T&#WS#=NF<B T&#WS7<ST 1r! 2 2 ! r . t c0
7irector; in 0hich to 6ind con6i1 r ! ti o n 6iles N!2 e o6 distrib tio n de6inition 6ile
H' :
W1EN . u t p u t
Mo# e + M 2DT2T%E <n this 2od e WBAN tili:es the 7i1S;l 6 nction describ e d in cl! s e (.6.2.9 to 1en e r ! t e the d!t ! se d to -o- l !t e <ST<T@A. 7i1S;l is c!lled !s 6ollo0s. <6 <S<7 U [ N%MS<TAMS/5 7i1S;l'<S<7,,) else 7i1S;l'r!n d o 2 0ithinY1 .. <S<7/5Z,,) The o t - t 6ro2 7i1S;l is e2 b e d d e d in -se d o* An1lish te+t strin1s th!t !re 1en e r ! t e d !ccor din 1 to the 1r! 2 2 ! r de6inition 6ile Q1r! 2 2 ! r . t - c 0R. The 1en e r ! t e d te+t strin1s !re o6 len1t h r!ndo 2 0ithin Y1( .. 60Z -l s !n; !ddition !l ch!r ! c t e r s re9 ire d to co2 -l e t e -!rti!l 0ords. ,5P o6 the 7i1S;l strin1s !re insert e d !s 0hole 0ords. The re2 !i ni n 1 25P !re insert e d !s -re6i+e s to e+istin1 0ords cont !i n e d 0ithin the -se d o* te+t. Sa m p e 2DT2T%E #at a The te+t belo0 sho0s s! 2 -l e o t- t 6ro2 the WBAN 0he n se d 0ith 2od e [ 0 .
Com m a n # . 01en. e + e *s25 *!25 0 *i1000 _20 V<ST<T@ASS$M&@A.t+t

B$B$B$B$B$B$=B &riv!te, #hildren 0ith B$B$B$B$B$B$$@ the other, 1ene r !l Ke!rs sh!ll 6!ll B$B$B$B$B$B$?< 6ir2, bl!c8 -!tient s* * ?i1ht, short schools 0o ld loo8 B$B$B$B$B$B$?A 2ore O &!-ers co ld love. &olitic!l, B$B$B$B$B$B$SAecono2ic Soviet, B$B$B$B$B$B$$Tind stri!l d ties 2 st 8no0 in Ti2es in the res-on sible, B$B$B$B$B$B$%@ soci!l --. 2e ! n 6or Necess ! r ;, B$B$B$B$B$B$<Nloc!l 6e!t r e s re 2e 2 b e r . Bo!ls 8no0. Me2be r s B$B$B$B$B$B$NB 0o ld nee d. Tot!l, B$B$B$B$B$=BB$ To-, -ositive co2-on e n t s 2 st 8ee -. &oints Fin1er s sho ld B$B$B$B$B$=B=B dr!0 in the B$B$B$B$B$=B$@Birls 0o ld r n. N 2be r s sho ld 1ive l!te, 6!2ili!r B$B$B$B$B$=B?< 2en. Ke!rs B$B$B$B$B$=B?A belon1. $ctivities 0ith the Se+ !l, B$B$B$B$B$=BSA he! v; c sto 2 e r s b ild schools. @e1!l, Wor8in1, re!l B$B$B$B$B$=B$T 2e 2b e r s sh!ll !--l; -erson !l, ?es lts B$B$B$B$B$=B%@ en! ble. A+tr!, ni9 e,
T&# Bench2!r8I W
&!1e
cci+
=ther, !ble B$B$B$B$B$=B<N bene6its 0ill h!ve to 0!nt @i1ht, B$B$B$B$B$=BNBco2 2 o n B$B$B$B$B$$@B$ &roble 2s o 1ht B$B$B$B$B$$@=B<ndivid !l st!t e s c!n tell. B$B$B$B$B$$@$@ Fi1 res c!n ch!n1e . ?e1 l!r, -o- l!r --. B$B$B$B$B$$@?< %se6 l, di66erent Ko n1, -ri2! r ; B$B$B$B$B$$@?Ao-er ! tions sh!ll Ne0 -!tte r n s notice B$B$B$B$B$$@SA in
Mo# e & , AD%NAME <n this 2od e WBAN tili:es the 7i1S;l 6 nction describ e d in cl! s e (.6.2.9 to 1en e r ! t e the d!t ! se d to -o- l !t e $S@N$MA. 7i1S;l is c!lled !s 6ollo0s. <6 $S<7 U [ N%MS$%TC=?S/2.5 7i1S;l'$S<7,,) Alse 7i1S;l'r!n d o 2 0ithinY1 .. $S<7/2.5Z,,) Sa m p e AD%NAME .utp u t The o t - t 6ro2 7i1S;l is se d directl; 6or ,5P o6 the 1en e r ! t e d $S@N$MAs. For the re2 !i ni n 1 25P the o t- t o6 7i1S;l is -!d d e d 0ith so2 e r!nd o 2 ch!r ! c t e r s.Th e te+t belo0 sho0s s! 2 -l e o t - t 6ro2 the WBAN tilit; 0he n it is se d 0ith 2od e [ 1 . Com m a n # . 01en. e + e *s25 *!25 0 *i1000 *21 V$S@N$MASS$M&@A.t+t S!2 -l e $S@N$MA d!t !
B$B$B$B$B$B$=Bl,+F B$B$B$B$B$B$$@0C B$B$B$B$B$B$?< B$B$B$B$B$B$?A B$B$B$B$B$B$SA B$B$B$B$B$B$$TK9 B$B$B$B$B$B$%@2 B$B$B$B$B$B$<N B$B$B$B$B$B$NB B$B$B$B$B$=BB$ B$B$B$B$B$=B=B B$B$B$B$B$=B$@ B$B$B$B$B$=B?< B$B$B$B$B$=B?A@N% B$B$B$B$B$=BSA06#%(; B$B$B$B$B$=B$T B$B$B$B$B$=B%@ B$B$B$B$B$=B<NJAbC B$B$B$B$B$=BNB B$B$B$B$B$$@B$hE8 B$B$B$B$B$$@=B
T&# Bench2!r8I W
&!1e
cc+
B$B$B$B$B$$@$@ B$B$B$B$B$$@?< B$B$B$B$B$$@?A B$B$B$B$B$$@SA
T&# Bench2!r8I W
&!1e
cc+i
A p p e n # i 3 2 , STAN )AR) RE5ERENCES
2' & 2n t e r n e t R5C s

The 6ollo0in1 re6er e n c e s to <ntern e t ?e9 e s t s 6or #o2 2 e n t s '?F#) !re relev ! n t to the benc h 2 ! r 8. C;-ert e + t Tr!ns6er &rotocol 1.1 'CTT& 1.1), !s de6ine d in ?F# 2068 htt-.//000.i et6.or1/r6c/r6c2 0 6 8 . t + t <ntern e t &rotocol '<&v(), !s de6in e d in ?F# ,91 htt-.//000.i et6.or1/r6c/r6c0 , 9 1 . t + t Tr!ns 2i s si o n #ontrol &rotocol 'T#&), !s de6in e d in ?F# ,95 htt-.//000.i et6.or1/r6c/r6c0 , 9 5 . t + t <ntern e t J.509 & blic >e; <n6r!str c t r e #erti6ic!t e &olic; !nd #erti6ic!tion &r!ctic e s Fr!2 e 0 o r8 !s in ?F# 252, htt-.//000.iet6.or 1/r6c/r6c2 5 2 , . t + t &>#S ] 1 ?S$ #r;-t o 1r ! - h ; S-eci6ic!tion Version 2.0 !s de6in e d in ?F# 2(5 , htt-.//000.i et6.or1/r6c/r6c2 ( 5 , . t + t SS@ V5 is ! de* 6!cto st! n d ! r d !nd does not h!v e !n ?F# n 2 b e r. The s-eci6ic!tio n s c!n be 6o nd !t htt-.//ho 2 e . n e t s c ! - e . c o 2 / e n 1 / s sl 5/ s sl* toc.ht 2l Tr!ns - or t @!;er Sec rit;. The s-eci6ic!tio n s c!n be 6o nd !t htt-.//000. iet6.or1/r6c/r6c2 2 ( 6 . t + t ?#( is ! tr!d e 2 ! r 8 o6 the ?S$ #or-or ! tio n
2' 4 C o m m o n %o g 5or m a t
The #o2 2 o n @o1 For2 ! t is ! st!n d ! r d o6 the W5#, World0id e Web #onsorti 2 . W5# is !n intern ! ti o n !l ind str ; consorti 2 , Eointl; host e d b; the M!ss ! c h s e t t s <nstit t e o6 Technolo 1 ; @!bor! t or ; 6or #o2- t e r Scienc e YM<T/@#SZ in the %nited St!t e sG the <nstit t N!tion !l de ?ech er c h e en <n6or2 ! ti 9 e et en $ to2 ! ti 9 e Y<N?<$Z in A ro- eG !nd the >eio %niversit; Shon ! n F Eis!0 ! #!2 - s in "!-!n. Service s -rovid e d b; the #onsorti 2 incl d e. ! re-o sit or; o6 in6or2 ! tio n !bo t the World Wide Web 6or dev elo - e r s !nd sersG re6er e n c e code i2-le 2 e n t ! t i o n s to e2 b o d ; !nd -ro2 o t e st! n d ! r d s G !nd v!rio s -rotot ;- e !nd s! 2 -l e !--lic!tio n s to de 2 o n s t r ! t e se o6 ne0 tech n ol o 1;. <niti!ll;, the W5# 0!s est ! blis h e d in coll!bor ! tio n 0ith #A?N, 0her e the Web ori1in !t e d , 0ith s - - ort 6ro2 7$?&$ !nd the A ro- e ! n #o2 2is si on $ descri-tion o6 #o2 2 o n @o1 For2 ! t c!n be 6o nd !t. htt-.//000.05.or 1/7 ! e 2 o n / % s e r/#on6i1/@o11i n 1. h t 2 l
T&# Bench2!r8I W
&!1e
cc+ii
htt-.//d elin6o.c er n.c h/W e b =66ice/S ervic e s/WWWlo16iles/#o 2 2 o n@o 1For 2 ! t . h t 2 l
T&# Bench2!r8I W
&!1e cc+iii

TPC Benchmark W (Web Commerce) : Specification

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

TPC Benchmark W (Web Commerce) : Specification

Uploaded by

Copyright:

Available Formats

TPC BENCHMARK TM W (We b Com m e r c e )

Sp e c i f i c a t i o n Version 1.8 Feb 19, 2002

Tran s a c t i o n Proc e s s i n g Perf or m a n c e Cou n ci (TPC)

St!nd!rd S-eci6ic!tion Version &'(

re9 ire 2 e n t s 6or s;st e 2 s .

St!nd!rd S-eci6ic!tion Version &'(

C ause 4 , WEB 2NTERACT2.NS AN) W.RK%.A) PR.52%E

C ause : , PER5.RMANCE METR2CS AN) RESP.NSE T2ME

5., $ 77<T<=N$@ & A?F=?M$N#A ST$T<ST<#S....................................................................................................................#J<J

C ause ; , S9T< RBE AN) NETW.RK )E52N2T2.NS

C ause ( , 59%% )2SC%.S9RE REP.RT

C ause > , A9)2T Appen#i3 A , C9ST.MER E?ENT )2A1RAM

Appen#i3 B , SH.PP2N1 STATE )2A1RAMS

Appen#i3 C , 2NTR.)9CT2.N T. SS%

Appen#i3 ) , )ATABASE P.P9%AT2.N RAT2.NA%E Appen#i3 E , SAMP%E PSE9).,C.)E

St!nd!rd S-eci6ic!tion Version &'(

Appen#i3 5 , SAMP%E HTM% C.)E

Appen#i3 1 , E@EC9T2?E S9MMAR7

Appen#i3 H , W1EN 9T2%2T7

Appen#i3 2 , STAN)AR) RE5ERENCES

St!nd!rd S-eci6ic!tion Version &'(

St!nd!rd S-eci6ic!tion Version &'(

St!nd!rd S-eci6ic!tion Version &'(

St!nd!rd S-eci6ic!tion Version &'(

St!nd!rd S-eci6ic!tion Version &'(

C a u s e & , WEB .B/ECT 0 %.12CA% )ATABA SE )E S21N

& ' & B u s i n e s s a n # A p p i c a t i o n En -ir o n m e n t

St!nd!rd S-eci6ic!tion Version &'(

& ' 4 ) e f i ni ti o n o f Ter m s

St!nd!rd S-eci6ic!tion Version &'(

& ' 6 ) a t a b a s e En ti ti e s < R e a ti o n s $ i p s < a n # C$ ar a c t e ri s t i c s

St!nd!rd S-eci6ic!tion Version &'(

St!nd!rd S-eci6ic!tion Version &'(

St!nd!rd S-eci6ic!tion Version &'(

St!nd!rd S-eci6ic!tion Version &'(

St!nd!rd S-eci6ic!tion Version &'(

&ri2 !r; >e;. '$77?S<7) '$77?S#=S<7) Forei1n >e;, re6er e n c e s '#=S<7)

& ' : W e b . bE e c t s < C$ ar a c t e ri s t i c s a n # R e a ti o n s $ i p " i t $ ) a t a b a s e

St!nd!rd S-eci6ic!tion Version &'(

St!nd!rd S-eci6ic!tion Version &'(

St!nd!rd S-eci6ic!tion Version &'(

& ' ( ) a t a A c c e s s Tra n s p a r e n c * R e B u ir e m e n t s

St!nd!rd S-eci6ic!tion Version &'(

St!nd!rd S-eci6ic!tion Version &'(

C a u s e 4 , WEB 2NTERACT2.N S AN ) W.RK%.A) PR.52%E

4 ' & ) e f i ni ti o n o f Ter m s

St!nd!rd S-eci6ic!tion Version &'(

The ter 2 Web %og g i n g is $ccess @o1.

se d in this s-eci6ic!tion to re6er to entrie s in the Web Server

St!nd!rd S-eci6ic!tion Version &'(

St!nd!rd S-eci6ic!tion Version &'(

St!nd!rd S-eci6ic!tion Version &'(

The S%T select s ! r!ndo 2 <S<7 6ro2 ! de6ine d in #l! s e (.,.1.

St!nd!rd S-eci6ic!tion Version &'(

St!nd!rd S-eci6ic!tion Version &'(

Ke*A St!rt %ser Session

USe!rchV $d2in #on6ir2

USe!rchV US b2itV $d2in ?e9 est USe!rchV

Sho--in1 #!rt USho--in1 #!rt V U#on6ir2 %-d!tes V U#hec8o tV

Se!rch ?e9 est

# sto2er ?e1istr!tion U#ontin e B ;V

B ; ?e9 est U#on6ir2 B ;V B ; #on6ir2

=rder <n9 ir; U=rder St!t sV