VHQVLWLYLW\ DQDO\VLV

Dohvvdqgur Idvvõ�/ Xqlyhuvlw| ri EhujdprSlhu Iudqfhvfr Shuul/ Xqlyhuvlw| ri Plodqr0Elfrffd

Mxo| 7/ 5333

LqwurgxfwlrqJhqhudoo| vshdnlqj/ vhqvlwlylw| dqdo|vlv E7�� frqfhuqv wkh pdwkhpdwlfdo prgho uhsuhvhq0wdwlrq ri d sk|vlfdo v|vwhp/ dqg dwwhpswv wr dvvhvv wkh vhqvlwlylw| ri wkh prgho rxwsxwvwr yduldwlrqv ri prgho lqsxwv jlyhq e| yduldeohv ru sdudphwhuv dqg yduldwlrqv ri prghodvvxpswlrqv1

Wkh hqylurqphqwdo vwdwlvwlfldq lv frqfhuqhg zlwk wzr fodvvhv ri sureohpv1 �� Wkhuh lvd xvxdoo| frpsoh{ pdwkhpdwlfdo ru frpsxwhu prgho E��� deoh wr vlpxodwh vrph hqyl0urqphqwdo v|vwhp e| phdqv ri qxphulfdo lqsxw2rxwsxw gdwd1 Vxssrvh iru d prphqw wkdwlw fdq eh jlyhq lq forvhg dqdo|wlfdo irup e|

+ ' s E%�c ���c %&� ' s E � �

Khqfh wkh sduwldo ghulydwlyhYs E �

Y%�lv wkh edvlf txdqwlw| iru dvvhvvlqj wkh vhqvlwlylw| ri

+ wr %� qhdu wkh srlqw � Iurp d sudfwlfdo srlqw ri ylhz/ s lv xqnqrzq lq d forvhg irupdqg/ ehfdxvh ri lwv frpsoh{lw|/ frpsxwlqj wlph lv d pdwwhu ri frqfhuq1 Xqfhuwdlqw| derxwwkh lqsxwv lv frqvlghuhg nqrzq e| phdqv ri d +suredelolw|, glvwulexwlrq R E � ( srsxodudvvxpswlrqv duh wkh xqlirup ru wkh orjqrupdo glvwulexwlrq dqg lqghshqghqfh dprqj lq0sxwv1 Ri frxuvh/ lqsxw xqfhuwdlqw| uhvxowv lq rxwsxw xqfhuwdlqw|1 Khqfh vrph v|qwkhwlfvhqvlwlylw| ru lq xhqfh phdvxuh lv qhhghg1 Xvlqj vlpxodwhg gdwd/ wkh �uvw vwhs lq 7� lv�xqfhuwdlqw| dqdo|vlv�/ zklfk dvvhvvhv wkh pdujlqdo rxwsxw yduldelolw| dqg glvwulexwlrqR E+�1 Zkloh wkh vhfrqg vwhs lv udqnlqj lqsxw yduldeohv e| wkhlu lq xhqfh rq +1 Wklv srlqwlv dgguhvvhg lq vhfwlrq �Vhqvlwlylw| Dqdo|vlv ri Frpsxwhu Prghov� ehorz1��� Lq wkh vhfrqg vhwxs/ wkh hqylurqphqwdo prgho lv lq idfw d vwdwlvwlfdo prgho/ h1j1 pxo0wlsoh uhjuhvvlrq1 Khuh 7� lv frqfhuqhg zlwk wkh sduwlfxodu prgho rxwsxw jlyhq e| wkhvdpsoh hvwlpdwhv/ w vd|/ dqg dlpv dw dvvhvvlqj wkh lq xhqfh ri lqglylgxdo gdwd/ jurxsvri gdwd/ yduldeohv dqg prgho dvvxpswlrqv wr w� Wklv srlqw lv dgguhvvhg lq vhfwlrqv �Vhq0vlwlylw| Dqdo|vlv ri Vwdwlvwlfdo Prghov�/ �Vhqvlwlylw| Dqdo|vlv lq Uhjuhvvlrq Prghov� dqg�Vhqvlwlylw| Dqdo|vlv lq Wlph Vhulhv� ehorz1

�Zrun sduwldoo| vxssruwhg e| lwdoldq PXUVW04<<; judqw1

4

Vhqvlwlylw| Dqdo|vlv ri Frpsxwhu Prghov7� ri ��v kdv ehhq ghyhorshg ryhu wkh odvw wzr ghfdghv wrjhwkhu zlwk pdvvlyh frpsxwhuvlpxodwlrqv ri hqjlqhhulqj/ fkhplfdo dqg hqylurqphqwdo v|vwhpv1 Dv d pdwwhu ri idfw/��v riwhq qhhg d orw ri lqsxw sdudphwhuv zkrvh uhohydqfh lv qrw d sulrul reylrxv dqg qrwhdv| wr hydoxdwh rq vlpxodwhg gdwd1 Wkurxjk dvvhvvlqj wkh lq xhqfh ri hdfk lqsxw wr wkhprgho rxwsxwv/ 7� jlyhv xvhixo wrrov iru xqghuvwdqglqj frpsoh{ prghov/ uhgxflqj dqdo|vlvfrpsoh{lw| dqg2ru glphqvlrqdolw| e| ghohwlqj xqlpsruwdqw lqsxwv dqg/ hyhqwxdoo|/ jlylqjlqgluhfw hylghqfh iru ydolgdwlqj d prgho zlwk uhvshfw wr wkh xqghuo|lqj uhdo sureohp wreh vlpxodwhg1

D 7� uhylhz ri hqylurqphqwdo ��v lv jlyhq e| Kdpe| ^2�`1 Khowrq ^2D` glvfxvvhv 7�whfkqltxhv zlwk vshfldo uhihuhqfh wr shuirupdqfh dvvhvvphqw iru udglrdfwlyh zdvwh glvsrvdo/dqg uhsruwv vhyhudo uhihuhqfhv wr 7� ri ��v uhodwhg wr hqylurqphqwdo lvvxhv1 Dprqj wkhvhduh fkhplfdo nlqhwlfv/ dwprvskhulf fkhplvwu|/ qxfohdu vdihw|/ hfrv|vwhp prghov/ dv zhoo dvk|gurorj| dqg zdwhu srooxwlrq1 D uhfhqw dqg frpsuhkhqvlyh kdqgerrn rq wkh vxemhfw ri7� lv jlyhq lq Vdowhool hw do1 ^eH`1

Wkh edvlf/ lqwurgxfwru| 7� phwkrg kdv ehhq glvfxvvhg lq dwprvskhulf wulwlxp grvhhvwlpdwhv ^�` dqg lq hqylurqphqwdo udglrorjlfdo dvvhvvphqw ^2b`1 Wkh lqsxwv %� duh pryhgrqh0dw0d0wlph E��A � wr wkhlu uhvshfwlyh h{wuhph ydoxhv/ %4�?

� dqg %4@ � c fhwhulv sdulexv/

l1h1 nhhslqj doo wkh rwkhu lqsxwv %� dw wkhlu fhqwudo ru �edvh fdvh� ydoxh %fc�1 Lq wklv zd|/xvlqj rqo| 2& �� uxqv/ zh jhw d yhu| suholplqdu| udqnlqj ri lqsxw lq xhqfh edvhg rqwkh iroorzlqj vhqvlwlylw| lqgh{

7U� '+4@ � � +4�?

�

+4@ �

c

zkhuh +4@ � lv wkh pd{lpxp ehwzhhq +

�%4�?�

�dqg + E%4@

� � c dqg + E%�� lv s E � frpsxwhgdw wkh edvh fdvh srlqw f h{fhsw �wk lqsxw dw %�1 Lq ^�e`/ ��A uxqv duh sursrvhg dw%fc� Sj� zklfk duh dssursuldwh iru Jdxvvldq lqsxw pdujlqdo glvwulexwlrqv R E%�� zlwk dvwdqgdug ghyldwlrq j� ' j Ef�� �

Wr jhw pruh lqirupdwlyh 7�c zh fdq xvh rqh ri wzr dssurdfkhv/ hlwkhu wkh orfdo 7�ru wkh joredo 7�1 Wkh iruphu lv hvvhqwldoo| d qrq0vwdwlvwlfdo phwkrg dvvhvvlqj rxwsxwvhqvlwlylw| wr vpdoo lqsxw shuwxuedwlrqv1 Lw lv edvhg rq gl�huhqwldo dqdo|vlv/ dqg wkhprgho uhvsrqvhv duh rewdlqhg e| wkh ��A dssurdfk1

Wkh odwwhu lv lqkhuhqwo| vwdwlvwlfdo vlqfh lw xvhv rxwsxw xqfhuwdlqw| dqdo|vlv/ zklfk lvedvhg rq rxwsxw fgi dqg yduldelolw|1 Lw lv sulpdulo| dlphg dw dvvhvvlqj lqsxw lq xhqfhxvlqj vrph nlqg ri rxwsxw yduldqfh ghfrpsrvlwlrq1 Wkhvh ghfrpsrvlwlrq whfkqltxhv zlwkuhodwhg vdpsolqj ghvljqv kdyh lqfuhdvlqj frpsoh{lwlhv dqg frpsxwlqj ghpdqgv1 Wkh uh0odwhg prghov udqjh iurp wkh vlpsoh olqhdu prgho wr wkh uhvsrqvh vxuidfh zlwk lqwhudfwlrqprgho/ qrqsdudphwulf prghov wrjhwkhu zlwk Irxulhu dqg Prqwh Fduor dssur{lpdwlrqv1Wkh uhohydqfh ri wkhvh prghov lq 7� zloo eh glvfxvvhg lq wkh iroorzlqj vxevhfwlrqv1

Wkh prgho rxwsxw frqvlghuhg vr idu lv vfdodu1 Lq ydulrxv hqylurqphqwdo �� dssolfd0wlrqv/ wkh prgho rxwsxw lv d srvvleo| yhfwru ydoxhg julg wudmhfwru| ru vxuidfh1 Iru h{dpsohlq ^7<`/ wkh 7� ri vsdfh0wlph dlu txdolw| prghov lv frqvlghuhg1

5

Orfdo VD

Xqghu vxlwdeoh vprrwklqj dvvxpswlrqv/ d vlpsoh dssurdfk wr wkh vhqvlwlylw| ri s fdq ehjlyhq frqvlghulqj wkh vhfrqg rughu Wd|oru h{sdqvlrq durxqg wkh edvh fdvh f=

s E fn{� ' s E f� n&[

�'�

Ys E f�

Y%�{� n

�

2

&[�'�

&[�'�

Y2s E f�

Y%�Y%�{�{�� +4,

Iru h{dpsoh/ lq fkhplfdo nlqhwlfv 7� olwhudwxuh/ h1j1 ^D2`/Ys

Y%�lv fdoohg �uvw rughu orfdo

vhqvlwlylw| dqgY2s

Y%�Y%�vhfrqg rughu orfdo vhqvlwlylw|1 Wkh h{dfw frpsxwdwlrq ri wkhvh

txdqwlwlhv pd| eh d frpsoh{ wdvn iru odujh prghov uhtxlulqj wkh vroxwlrqv ri odujh olqhduv|vwhpv ru vshfldol}hg whfkqltxhv olnh wkh Juhhq ixqfwlrq phwkrg1 Wkh ��A dssurdfk/zlwk &n� uxqv/ pd| eh xvhg wr jhw wkh �qlwh gl�huhqfh dssur{lpdwlrq wr �uvw rughu orfdovhqvlwlylw|/ l1h1

Ys

Y%��' + E%fc� n{��� + E%fc��

{�

c

iru vpdoo shuwxuedwlrq {�c h1j1 4(�Li wkh �uvw rughu wuxqfdwlrq ri htxdwlrq E�� dssur{lpdwho| krogv ryhu wkh ixoo lqsxw

udqjh/ l1h1 wkh prgho lv dssur{lpdwho| olqhdu/ orfdo vhqvlwlylwlhv pd| wkhq eh xvhg wrdvvhvv rxwsxw joredo xqfhuwdlqw|1 Iru h{dpsoh/ iru xqfruuhodwhg dqg v|pphwulf lqsxwv/j 'Ef�c ���c f&�

� c zlwk edvh fdvh dw wkh h{shfwdwlrq yhfwru/ f ' . Ej�/ zh kdyh

. Et � ' s E f�

dqg

T @o Et � '&[

�'�

�Ys E f�

Y%�

�2

T @o Ef�� �

Khqfh/ udwlrv�Ys E f�

Y%�

�2

T @o Ef�� *T @o Et � jlyh lpsruwdqfh phdvxuhv1

D ixuwkhu vwhs wrzdugv joredo 7� lv edvhg rq uhshdwhg ��A 1 Dffruglqj wr wklvdssurdfk/ zh uxq wkh prgho rq ? udqgrp uhsolfdwhv ri %� iurp wkh pdujlqdo lqsxw glvwul0exwlrq R E%�� � Zh wkhq frpsxwh lpsruwdqfh phdvxuhv edvhg rq rxwsxw xqfhuwdlqw| gxh wr%� xqfhuwdlqw|/ fhwhulv sdulexv1 Iru h{dpsoh/ zh fdq xvh wklv gdwd wr frpsxwh d yduldqfhudwlr

7 E+ Ef���2

T @o Ef��

zkhuh 7 E+ Ef���2 lv wkh vdpsoh yduldqfh ri vlpxodwhg +v gxh wr f�1 Pruhryhu/ vlploduo|

wr wkh frh!flhqw ri yduldwlrq/ zh kdyh dq d0glphqvlrqdo lpsruwdqfh phdvxuh jlyhq e|

7 E+ Ef���

7+ Ef��

6

zkhuh 7+ lv wkh vdpsoh phdq1Wkhq xvlqj vrph ?& uxqv/ wkhvh ��A vwdwlvwlfv doorz lqsxw udqnlqj dffruglqj wr wkhlu

lpsruwdqfh zlwkrxw frqvlghulqj lqwhudfwlrqv dprqj lqsxwv1 Doo duh orfdo lq wkh vhqvh wkdwwkh| xvh wkh edvh fdvh dv uhihuhqfh/ dqg fkdqjlqj lw pd| fdxvh d fkdqjh wr frqfoxvlrqv1

Joredo VD

D +joredo, 7� phwkrg xvxdoo| dlpv dw d 7� lqgh{ ru phdvxuh iru dvvhvvlqj dqg udqnlqjwkh ryhudoo ru dyhudjh lqsxw lq xhqfh xqghu vlpxowdqhrxv lqsxw yduldwlrqv1 Wklv lqgh{ lvxvxdoo| edvhg rq d vwdwlvwlfdo prgho vlpsoli|lqj wkh ��c dqg qhhgv d fhuwdlq dprxqw rigdwd ru frpsxwhu uxqv wr eh hvwlpdwhg1

Wkh pdlq vwuhdp ri 7� lv edvhg rq lpsruwdqfh phdvxuhv uhvxowlqj iurp Shduvrq*v zhoonqrzq fruuhodwlrq udwlr/

#2� 'T @o E. Et mf���

T @o Et �c +5,

zklfk jlyhv wkh shufhqwdjh rxwsxw yduldwlrq gxh wr lqsxw f�� Lq htxdwlrq E2�/ wkh frq0glwlrqdo h{shfwdwlrq 6 E%� ' . Et mf� ' %� lv wkh uhjuhvvlrq ixqfwlrq/ srvvleo| qrqolqhdu/dqg T @o E6 Ef��� lv wkh yduldqfh ri6 Ef�� xvlqj wkh pdujlqdo glvwulexwlrq R E%��1 Iru kljkglphqvlrqdo j�/ 6 Ej�� lv d uhjuhvvlrq vxuidfh dqg wkh sureohpv dulvlqj lq hydoxdwlqj dqghvwlpdwlqj lwv yduldqfh zloo eh glvfxvvhg ehorz1 Urexvwqhvv lvvxhv pd| dulvh iru khdylo|wdlohg ru vnhzhg rxwsxw glvwulexwlrqv1

Xqiruwxqdwho| qr uholdeoh sruwpdqwhdx phwkrg h!flhqw iru zkdwhyhu �� lv suhvhqwo|dydlodeoh dqg wkh fkrlfh ghshqgv juhdwo| rq wkh sduwlfxodu fdvh xqghu vwxg|1 Jrrg vwdwlv0wlfdo prghoolqj sudfwlfh lqfoxglqj gldjqrvwlf dqg ydolgdwlrq vkrxog ohdg wr wkh dssursuldwhprgho dqg vdpsolqj vroxwlrq1 Ehfdxvh ri wkhvh/ joredo 7� lv forvho| uhodwhg wr vdpsolqjdqg Prqwh Fduor1 Wkhvh phwkrgv duh edvhg rq d qxpehu ? ri �� uxqv jlylqj vlpxodwhggdwd E �c +�� c ���c E ?c +?� zkhuh 6 ' E%6�c ���c %6&� c 6 ' �c ���c ?c duh udqgrp ru txdvl0udqgrp qxpehuv iurp wkh glvwulexwlrq R E � � Ri frxuvh wkh glvwulexwlrq R E � gh�qhv wkhlqsxw ghshqghqfh vwuxfwxuh dqg lwv fkrlfh vkrxog eh frqvlghuhg lq dq h{whqghg 7� d�Sodv lw pd| d�hfw ghhso| rxwsxw xqfhuwdlqw|1

Ghvljq ri H{shulphqw

D sduwlfxodu qrq0udqgrp vdpsolqj whfkqltxh lv edvhg rq wkh fodvvlfdo ghvljq ri h{shul0phqwv E(�.� riwhq frxsohg zlwk uhvsrqvh vxuidfh phwkrgrorj|1 Lq sk|vlfdo/ fkhplfdodqg hqjlqhhulqj h{shulphqwv wkhvh whfkqltxhv duh zhoo nqrzq/ dqg uhihuhqfhv olnh ^.` dqg^H` duh fodvvlfv1

Lq 7� wklv dssurdfk kdv ehhq xvhg wr rewdlq d vxuurjdwh prgho rq wkh dvvxpswlrqwkdw d olqhdu soxv lqwhudfwlrq dssur{lpdwlrq wr wkh �� lv jrrg hqrxjk1 Iru h{dpsoh/ lqhqylurqphqwdo 7�/ lw kdv ehhq xvhg lq wkh hvwlpdwlrq ri grvh0htxlydohqw wr pdq iurp wkhfrqfhqwudwlrq ri udglrdfwlylw| lq dlu/ zdwhu dqg irrg d�eo1

Wkh devhqfh ri wkh uhsolfdwlrq huuru ri wkh fodvvlfdo prgho/ + ' s E � n 0c hqwdlov vrphgl�huhqfhv ehwzhhq fodvvlfdo (�. dqg (�. iru ��v deSo1 Iru h{dpsoh/ wkh ohdvw vtxduhphwkrg fdq eh lqwhusuhwhg rqo| dv dq lqwhusrodwlrq phwkrg dqg uhvlgxdov duh v|vwhpdwlf

7

huuruv1 Qh{w/ wkh fodvvlfdo(�. frqfhswv ri eorfnlqj/ uhsolfdwh dqg udqgrpl}dwlrq ehfrphluuhohydqw1

Pruhryhu/ wkh vwrfkdvwlf qdwxuh ri revhuyhg lqsxwv lv xqghuvfruhg lq fodvvlfdo (�.cdqg kljk lqsxw glphqvlrqdolw| ri ��v pd| suhyhqw xvlqj vwdqgdug(�. vriwzduh1 Vshfldoghvljqv iru ��v kdyh wkhuhiruh ehhq ghyhorshg iru vfuhhqlqj 7�� Iru h{dpsoh lq dDeocfdvh vwxglhv zlwk 2f lqsxw yduldeohv dqg �f� Df �� uxqv duh frqvlghuhg1

Rwkhu ghyhorsphqwv xvh udqgrp dqg vwudwl�hg vdpsolqj1 Dprqj wkhvh/ Odwlq k|shu0fxeh vdpsolqj jlyhv jrrg hvwlpdwhv ri wkh rxwsxw h{shfwdwlrq/ > ' . Es Ej�� c zkhq s lvprqrwrqlf lq hdfk frruglqdwh1 D xqlyduldwh Odwlq k|shufxeh vdpsoh ri vl}h ? lv d vwudwl�hgvdpsoh lq zklfk wkh vwudwd duh wkh ? htxdo suredelolw| lqwhuydov dqg wkh ? vdpsoh ydoxhvduh udqgrpo| vhohfwhg iurp hdfk vwudwxp xvlqj wkh glvwulexwlrq R E%�� frqglwlrqdo wr wkhvwudwxp1 Pxowlyduldwh gh�qlwlrqv uhdglo| dsso| iru lqghshqghqw yhfwruv dqg dssursuldwhwhfkqltxhv fryhulqj lqsxwv zlwk sduwlfxodu fruuhodwlrq vwuxfwxuhv kdyh ehhq dssolhg lq d�2owr wkh jhrorjlfdo glvsrvdo ri udglrdfwlyh zdvwh1

Lq wkh oljkw ri pruh srzhuixo exw pruh frpsxwdwlrq0ghpdqglqj Prqwh Fduor 7�ehorz/ vlpsol�hg (�. dqg ��A vdpsolqj dssurdfkhv pd| eh xvhixo lq vfuhhqlqj 7� irud suholplqdu| uhgxfwlrq ri kljk glphqvlrqdo lqsxwv1

Fruuhodwlrq Phwkrgv

Wkh vlpsohvw dssur{lpdwlrq wr wkh jhqhudo fruuhodwlrq udwlr E2� lv wkh vtxduh ri Shduvrq*volqhdu fruuhodwlrq frh!flhqw

o E+c %�� '

S6 E+6 � 7+� E%6� � 7%��tS

6 E+6 � 7+�2S

6 E%6� � 7%��2�

Wkh qh{w vwhs lv wr frqvlghu vlpxowdqhrxv lqsxw h�hfwv1 Wkh fruuhvsrqglqj olqhdu fruuh0odwlrq frh!flhqw lv wkh sduwldo fruuhodwlrq frh!flhqw dD�o zklfk/ urxjko| vshdnlqj/ lv wkhfruuhodwlrq ehwzhhq + dqg %� diwhu holplqdwlqj wkh olqhdu h�hfw ri wkh uhpdlqlqj lqsxwv %�c� 9' �c iurp erwk + dqg %��

Uhjuhvvlrq Phwkrgv

Li wzr gl�huhqw lqsxwv %� dqg %� kdyh wkh vdph fruuhodwlrq zlwk wkh prgho rxwsxw/ wkh| pd|kdyh gl�huhqw lq xhqfhv lq wkh gl�huhqwldo vhqvh1 Xvlqj d olqhdu uhjuhvvlrq dssur{lpdwlrq/

+ ' �� n ec +6,

zh vhh wkdw wkh �uvw rughu orfdo vhqvlwlylwlhv ri htxdwlrq E�� fdq eh hvwlpdwhg e| wkhu7 uhjuhvvlrq frh!flhqwv +vhh h1j1 E�.� ehorz,1 Uhodwhg phdvxuhv/ fruuhfwhg iru wkhxqfhuwdlqw|/ duh edvhg rq wkh vwdqgdugl}hg uhjuhvvlrq frh!flhqwv

q�

j�

j Et ��

Ri frxuvh/ wkhvh uhjuhvvlrq txdqwlwlhv duh phdqlqjixo li prgho E�� kdv d jrrg �wwlqj/ iruh{dpsoh wkh pxowlsoh ghwhuplqdwlrq frh!flhqw -2 fdqqrw eh vpdoo1

8

Lq rughu wr uhgxfh wkh lq xhqfh ri qrq0qrupdolw| dqg2ru qrqolqhdulw| rq wkhvh vwdwlvwlfvvrph gdwd wudqvirupdwlrq pd| eh xvhixo1 Iru h{dpsoh/ lq hqylurqphqwdo uhodwhg ulvndqdo|vlv/ wkh *L}0wudqvirup ^��` dqg udqn0wudqvirup ^�2` kdyh ehhq xvhg1 Wkh iruphu lv dsrsxodu wudqvirup lq hqylurqphqwdo vwdwlvwlfv ehfdxvh ri wkh orj0qrupdo glvwulexwlrq1 Wkhodwwhu lv glvwulexwlrq iuhh iru frqwlqxrxv glvwulexwlrqv/ dqg lv fdsdeoh ri ghwhfwlqj lqsxwlpsruwdqfh iru qrqolqhdu prqrwrqlf uhodwlrqv1 Erwk duh zhdn lq ghwhfwlqj L 0vkdshg rushulrglf uhodwlrqv/ dqg erwk glvwruw wkh ruljlqdo vfdoh dqg fxuydwxuh1

Judsklfdo uhjuhvvlrq gldjqrvwlfv duh xvhixo dv frpsohphqwv wr uhjuhvvlrq phwkrgv1Dprqj wkhvh/ lq 7� olwhudwxuh/ elyduldwh vfdwwhusorwv ri lqsxwv yv1 rxwsxw duh zlgho| xvhgwrrov jlylqj lqirupdwlrq rq lpsruwdqfh dqg olqhdulw|1

Qrqolqhdu Vhqvlwlylw| Dqdo|vlv

Wkh pruh frpsoh{ dqg uh�qhg 7� phwkrgv duh edvhg rq qrqsdudphwulf yduldqfh ghfrp0srvlwlrqv dssolhg wr qrqolqhdu prghov1 Wkh lghd ri Vrero*/ dv glvfxvvhg lq ^�f` dqg ^b`/ lvedvhg rq wkh iroorzlqj ghfrpsrvlwlrq

s E � ' sf n&[

�'�

s� E%�� n[��

s�� E%�c %�� n ���n s�c2c���c& E%�c ���c %&� c +7,

zkhuh sf ' . Es Ej�� c s� duh wkh �uvw rughu idfwruv/ s�� duh wkh vhfrqg rughu lqwhudfwlrqvdqg vr rq1 Wkhvh frpsrqhqw ixqfwlrqv duh }hur phdq dqg xqfruuhodwhg/ vr wkdw wkhfruuhvsrqglqj yduldqfh ghfrpsrvlwlrq lq 2& � � vxppdqgv krogv/ qdpho|

T @o Et � ' T '[

T� n[��

T�� n ���� +8,

Dv lq htxdwlrq E2� c wkh �uvw rughu frpsrqhqwv/

T� ' .�s 2��' T @o E. Et mf��� c +9,

fdq eh xvhg wr dvvhvv wkh �uvw rughu qrqolqhdu lq xhqfh ri f�� Vlploduo| T��v jlyh kljkhurughu vhqvlwlylwlhv e| phdqv ri

7�� 'T��T

dqg vr rq1Iru hvwlpdwlqj �uvw rughu vhqvlwlylwlhv/ ydulrxv vdpsolqj sodqv duh dydlodeoh1 Wr vhh

wkhvh/ frqvlghu lqsxw sduwlwlrqlqj

'�%�c E��

�+:,

zkhuh E�� lv zlwkrxw lwv �wk hohphqw %�1Wkh frqfhswxdoo| vlpsohvw/ exw frpsxwdwlrqdoo| pruh ghpdqglqj/ vdpsolqj ghvljq

uhtxluhv hvwlpdwlqj frqglwlrqdo phdqv xvlqj o uhsolfdwhv iru hyhu| %6�/ l1h1

7+6� '�

o

o[|'�

s�%6�c |E��

��

9

Wklv jlyhv wkh ���T �0olnh vhqvlwlylw| hvwlpdwh

�#2� '�T��T

'

�

?

S?

6'� E7+6� � 7+�2

�

?o

S?

6'�

So

|'�

�s�%6�c |E��

�� 7+�2 c

zkhuh 7+ lv wkh judqg phdq1 D zd| wr uhgxfh wkh qxpehu ri uxqv ?o iru �#2� lv wr hvwlpdwhgluhfwo| . Es 2� � lq htxdwlrq ES� xvlqj wzr lqghshqghqw uhsolfdwhv/ 6E�� dqg W6E��/ iru hyhu|%6�1 Wklv jlyhv

T� '�

?

?[6'�

s�%6�c 6E��

�s�%6�c

W

6E��

�� s 2f +;,

dw wkh frvw ri 2? uxqv soxv dqrwkhu 6 uxqv iru T dqg sf '�?

S6 s E 6�1 Qrwh wkdw vlqfh

erwk deryh T� hvwlpdwhv kdyhs? udwh ri frqyhujhqfh xvlqj Prqwh Fduor vdpsolqj/ T� lv

frqvhtxhqwo| pruh h!flhqw wkhq �T��Vhfrqg rughu whupv duh qrz hvwlpdwhg xvlqj

T�� '�

?

?[6'�

s�%6�c %6�c 6E���

�s�%6�c%6�c

W

6E���

�� T� � T� � s2f

dqg fruuhvsrqglqj irupxodh krog iru kljkhu rughu lqwhudfwlrq hvwlpdwhv1 Khqfh d ixoo 7�zrxog uhtxluh d qxpehu ri uxqv ri rughu 2?2&�

Li zh kdyhS&

�'� T��' T / wkhq wkh �� xqghu vwxg| grhv qrw vkrz uhohydqw lqwhudfwlrqv1

Xqiruwxqdwho|/ wklv lv qrw riwhq wkh fdvh lq �� vlpxodwlrq1 Lq rughu wr dyrlg wkh deryhfxuvh ri glphqvlrqdolw| zlwkrxw orvlqj wrr pxfk lqirupdwlrq rq lqwhudfwlrqv/ d vlqjohwrwdo vhqvlwlylw| lqgh{ A7U� kdv ehhq frqvlghuhg1 Lw wdnhv lqwr dffrxqw doo lqwhudfwlrq0frpsrqhqwv lq htxdwlrq Ee� zklfk kdyh wkh whup %� 1

Wr vhh wklv/ uhfdoolqj lqsxw sduwlwlrq E.� c uhzulwh htxdwlrq Ee� dv

s E � ' sf n s� E%�� n sE��� E��

�n s�E��

�%�c E��

�dqg yduldqfh htxdwlrq ED� dv

T ' T� n TE�� n T�E���

Khqfh wkh wrwdo yduldqfh gxh wr f� lv

T |J|� ' T� n T�E�� ' T � TE���

Lq wkh oljkw ri irupxod EH� c TE�� n s 2f lv hvwlpdwhg xvlqj 2? uxqv dv iroorzv

TE�� '�

?

?[6'�

s�%W6�c 6E��

�s�%6�c 6E��

�� s 2f

dqg wkh wrwdo vhqvlwlylw| lqgh{ lv frpsxwhg e|

gA7U � ' T � TE��T

� +<,

:

Wkh dffxudf| ri wkhvh hvwlpdwhv fdq eh dvvhvvhg e| wkhlu dv|pswrwlf Prqwh Fduorvwdqgdug ghyldwlrqv ru frq�ghqfh lqwhuydov1 Wklv lv hdvlo| grqh/ qrwlqj wkdw sf dqg T�n s 2fvwdwlvwlfv duh hvvhqwldoo| vdpsoh phdqv1 Khqfh/ xvlqj vwdqgdug vdpsolqj uhvxowv/ zh kdyhwkh iroorzlqj hvwlpdwhv zlwkrxw dgglwlrqdo �� uxqv=

T @o�sf

� �' �

6

#�

6

?[6'�

s�%W6�c 6E��

�2 � s 2f

$dqg

T @o�T�

� �' �

6

#�

6

?[6'�

�s�%6�c 6E��

�s�%W6�c 6E��

��2 � �T� n s2f

�2$�

IDVW Phwkrg

Wkh deryh phwkrg zlwkPrqwh Fduor vdpsolqj lv txlwh jhqhudo dqg olwwoh prgho0dvvxpswlrqghpdqglqj1 Dv d pdwwhu ri idfw/ lw jlyhv prgho0iuhh lpsruwdqfh phdvxuhv zlwk hvwlpdwhgvwdqgdug ghyldwlrqv/ rxwsxw xqfhuwdlqw| dqg fgi zlwkrxw xvlqj vxuurjdwh prghov1 Wkhpdlq gudzedfn pd| eh wkh odujh qxpehu ri �� uxqv uhtxluhg1

Dq dssurdfk jlylqj vlplodu lpsruwdqfh phdvxuhv dqg uhtxlulqj d vpdoohu qxpehu ri�� uxqv lv edvhg rq wkh Irxulhu dpsolwxgh vhqvlwlylw| whvw E8�7A � ^e.`1 Wklv whfkqltxhlv edvhg rq wkh iroorzlqj Irxulhu dssur{lpdwlrq

. Et � �' �

2Z

] Z

3Z

8 Er� _r +43,

zkhuh

8 Er� ' s E}� Er� c ���c }& Er��

dqg

%� ' }� Er� ' C� Et�?/�r�

iru dssursuldwh ixqfwlrqv C� dqg iuhtxhqflhv /�1 Dssur{lpdwlrq E�f� dqg lwv frpsdqlrq

T @o Et � �' �

2Z

U Z

3Z8 Er�2 _r � . Et �2/ duh lqwhuhvwlqj ehfdxvh wkh| uhgxfh d pxowlsoh

lqwhjudo lqwr d rqh0glphqvlrqdo lqwhjudo1Pruhryhu/ xvlqj wkh Irxulhu vhulhv uhsuhvhqwdwlrq iru s Er� c zh jhw

T @o Et � �'"[�'�

��2

� n�2�

�dqg

T� �'"[�'�

��2

�/�n�2

�/�

�+44,

;

zkhuh �� dqg �� duh wkh Irxulhu frh!flhqwv jlyhq e|

�� '�

Z

] Z

3Z

8 Er� ULt E�r� _r

dqg

�� '�

Z

] Z

3Z

8 Er� t�? E�r� _r�

Khqfh/ 8�7A phwkrg lv hvvhqwldoo| edvhg rq frpsxwlqj wkh txdqwlwlhv �� dqg �� yld ds0sursuldwh qxphulfdo dqg2ru Prqwh Fduor rqh0glphqvlrqdo lqwhjudwlrq edvhg rq wkh vdph/� vd|/ �� uxqv1

8�7A phwkrg grhv qrw jlyh sudfwlfdo phwkrgv iru vhfrqg dqg kljkhu rughu lqwhudf0wlrqv/ exw h{whqghg 8�7A ^e.` doorzv frpsxwlqj wrwdo vhqvlwlylw| lqgh{hv Eb� zlwkrxwdgglwlrqdo �� uxqv� Wr gr wklv/ h{whqghg 8�7A dvvljqv d iuhtxhqf| /� wr %� dqg d frp0prq iuhtxhqf| /E�� 9' /� wr doo rwkhu lqsxwv1 Khqfh/ TE�� lv hvwlpdwhg yld htxdwlrq E����oohg zlwk iuhtxhqf| /E��1

Vxpplqj xs/ 8�7A lv dq h!flhqw wrro iru joredo 7� exw lwv surshu xvh dqg xqghu0vwdqglqj uhtxluh d ohyho ri pdwkhpdwlfv zklfk pd| eh gl!fxow wr h{sodlq1

Vhqvlwlylw| Dqdo|vlv ri Vwdwlvwlfdo PrghovLq vwdwlvwlfv/ vhqvlwlylw| dqdo|vlv +VD, fdq eh frqvlghuhg d vhw ri wrrov dlplqj dw dvfhuwdlq0lqj wkh ghjuhh ri ghshqghqfh ri wkh uhvxowv wr wkh k|srwkhvhv xqghuo|lqj wkh sduwlfxoduwhfkqltxhv hpsor|hg +h1j1 qrupdolw| lq wkh uhjuhvvlrq prgho, ru wr qdwxuh ri wkh gdwd+suhvhqfh ri dw|slfdo/ xqxvxdo revhuydwlrqv,1 D odfn ri vhqvlwlylw| wr vxfk dvshfwv lv nqrzqdv urexvwqhvv1 Lq rwkhu zrugv/ VD wulhv wr hydoxdwh krz wkh rxwfrph ri wkh +vwdwlvwlfdo,dqdo|vlv fkdqjhv zkhq shuwxuedwlrqv duh lqwurgxfhg lq wkh sureohp irupxodwlrq1

Frqvlghulqj wkh ihdwxuhv lq wkh gdwd/ VD orrnv iru revhuydwlrqv prvwo| d�hfwlqj vrphru doo ri wkh dvshfwv ri wkh dqdo|vlv1 Lq wklv frqwh{w/ d vxevhw ri gdwd lv vdlg wr eh lq xhqwldoli lwv rplvvlrq fdxvhv vxevwdqwldo fkdqjhv lq wkh hvwlpdwhv/ frq�ghqfh uhjlrqv/ whvwv/ hwf1Xvxdoo|/ lq xhqwldo revhuydwlrqv dsshdu wr eh rxwvlgh wkh sdwwhuq gh�qhg e| wkh exon riwkh gdwd ehfdxvh jurvv huuruv fdq rffxu lq uhfruglqj ru surfhvvlqj wkh gdwd ru ehfdxvh wkhxqghuo|lqj glvwulexwlrq wkdw jhqhudwhv wkh gdwd lv gl�huhqw iurp wkh k|srwkhvl}hg rqh1

Lq prgho exloglqj/ �qglqj lq xhqwldo revhuydwlrqv fdq eh xvhixo iru wkh dqdo|vw lq dwohdvw wzr zd|v1 Lq wkh �uvw sodfh/ lq xhqwldo fdvhv pd| kljkoljkw jurvv phdvxuhphqwvdqg uhfruglqj ru surfhvvlqj huuruv1 Vhfrqgo|/ �qglqj pdq| lq xhqwldo revhuydwlrqv frxogvxjjhvw wkdw wkh dgrswhg prgho lv lqdghtxdwh iru ghvfulelqj wkh uhdo sureohp xqghu vwxg|1

Lq xhqwldo revhuydwlrqv pd| ehfrph qrqlq xhqwldo li wkh prgho lv prgl�hg +h1j1 dgglqjru wudviruplqj wkh yduldeohv/ vhohfwlqj d gl�huhqw prgho, ru li dowhuqdwlyh �wwlqj phwkrgvduh xvhg +urexvw ru erxqghg0lq xhqfh,1

Lq xhqfh Fxuyhv

D jhqhudo wrro iru phdvxulqj wkh lq xhqfh ri dq revhuydwlrq lv uhsuhvhqwhg e| wkh lq x0hqfh fxuyh +ru ixqfwlrq, lqwurgxfhg e| Kdpsho +^55`/^56`,/ ixuwkhu dvshfwv ri zklfk duhlqyhvwljdwhg lq ^57`/^5;`/ ^64`1

<

Wkh pdlq lghd ri lq xhqfh fxuyh lv lqwxlwlyho| hdv|1 Ohw %�c %2c ��c %? eh d vdpsoh rilqghshqghqw revhuydwlrqv iurp wkh fgi 8� Ohw A? ' A E%�c %2c ��c %?� eh d +Ilvkhu, frq0vlvwhqw hvwlpdwru ri wkh xqnqrzq +vfdodu ru yhfwruldo, sdudphwhu w ' A E8 � h{suhvvhg dvd ixqfwlrqdo ri 8 Eh1j1 wkh srsxodwlrq phdq fdq eh zulwwhq A E8 � ' .Ef� '

U%_8 �1

Dqdorjrxvo|/ ohw A? ' A E8?� eh wkh hvwlpdwru h{suhvvhg dv d ixqfwlrqdo ri wkh hpslulfdofgi 8? +h1j1 wkh vdpsoh phdq ?3�

S?

�'� %� fdq eh zulwwhq A E8?� 'U%_8?,1

Lq rughu wr hydoxdwh wkh lq xhqfh rq A? ri d qhz revhuydwlrq % dgghg wr d odujh vdpsoh+l1h1 ? $ 4,/ wkh lq xhqfh fxuyh ri wkh hvwlpdwru A? lv gh�qhg/ xqghu vxlwdeoh frqglwlrqv/dv=

U�E%(Ac 8 � ' *�4"<f

A dE�� "�8 n "B%o� A E8 �

"c +45,

zkhuh B% lv wkh fgi ri d ghjhqhudwh yduldeoh zklfk jlyhv pdvv 4 wr %1 Lq rwkhu zrugv/ wkhlq xhqfh fxuyh dvvhvvhv wkh yduldwlrq lq A fdxvhg e| d vpdoo frqwdplqdwlrq ri 8 dw wkhydoxh %1

Wkh lq xhqfh fxuyh lqglfdwhv wkh vhqvlwlylw| ri wkh hvwlpdwru wr dq lqglylgxdo revhu0ydwlrq dqg ghvfulehv lwv orfdo ehkdylru1 Pruhryhu/ wkh lq xhqfh fxuyh surylghv d wrro iruhydoxdwlqj wkh urexvwqhvv ri dq hvwlpdwru zlwk uhvshfw wr dw|slfdo gdwd= hvwlpdwruv zlwkd erxqghg lq xhqfh fxuyh fdq eh frqvlghuhg doprvw lqvhqvlwlyh wr rxwolhuv1

Wkh suhylrxv gh�qlwlrq +45, lv hqwluho| dv|pswrwlf ehfdxvh lw irfxvhv rq wkh lq�qlwhv0lpdo lq xhqfh wkdw dq revhuydwlrq kdv rq wkh dv|pswrwlf ydoxh ri wkh hvwlpdwru� Qhyhu0wkhohvv/ iru sudfwlfdo sxusrvhv/ ydulrxv �qlwh vdpsoh yhuvlrqv ri wkh lq xhqfh fxuyh duhdydlodeoh/ iru h{dpsoh lq ^57`1 Wkh vlpsohvw �qlwh dssur{lpdwlrq lv wkh vr0fdoohg hpslulfdolq xhqfh fxuyh/ rewdlqhg e| dgglqj % wr wkh vdpsoh E%�c ���c %?3�� dqg sorwwlqj wkh ydoxhvri wkh hvwlpdwru A?E%�c ���c %?3�c %� djdlqvw gl�huhqw ydoxhv ri %1

Khuh zh irfxv rq d pruh xvhixo yhuvlrq jlyhq e| wkh iroorzlqj vhqvlwlylw| fxuyh +7��=

7�?E%� ' ? dA?E%�c ���c %?3�c %�� A?3�E%�c ���c %?3��o � +46,

Li wkh hvwlpdwru lv h{suhvvhg dv ixqfwlrqdo ri wkh hpslulfdo fgi/ htxdwlrq +46, ehfrphv=

7�?E%� ' ?

�A

�E�� �

?�8?3� n

�

?B%

�� A E8?3��

�� +47,

Qrwh wkdw wklv odvw h{suhvvlrq fdq eh dovr rewdlqhg iurp htxdwlrq +45, uhsodflqj " zlwk?3� dqg rplwwlqj wkh olplw1

D voljkw yduldqw ri h{suhvvlrq +46,/ zlgho| xvhg lq VD dlplqj wr hydoxdwh wkh lq xhqfhrq A? ri wkh revhuydwlrq %/ zkhq lw lv ghohwhg iurp wkh vdpsoh/ lv wkh vdpsoh lq xhqfhfxuyh +7U�,/ gh�qhg dv=

7U�E%� ' E?� �� dA?E%�c ���c %?3�c %�� A?3�E%�c ���c %?3��o � +48,

Dv dq h{dpsoh/ frqvlghu d v|pphwulf glvwulexwlrq zlwk lwv fhqwuh ri v|pphwu| jlyhqe| w1 Lq wklv fdvh/ zh pd| xvh wkh vdpsoh phdq ru wkh vdpsoh phgldq/ zlgho| xvhg lqhqylurqphqwdo vwdwlvwlfv/ dv hvwlpdwruv ri w1 Wkh VF v ri wkh wzr hvwlpdwruv duh uhsuhvhqwhglq �jxuh 4 dqg �jxuh 5/ uhvshfwlyho|1

43

Revhuyh wkdw wkh VF iru wkh phdq lv xqerxqghg zkhq % $ 4c wkdw lv wkh phdq lvh{wuhpho| vhqvlwlyh wr d vlqjoh odujh rxwolhu1 Rq wkh frqwudu|/ wkh 7� iru wkh phgldq lverxqghg1 Wkxv/ wkh phgldq dsshduv wr eh pruh urexvw wkdq wkh phdq zlwk uhvshfw wr wkhrxwolhuv/ exw lw lv vwloo vhqvlwlyh wr urxqglqj dqg jurxslqj huuruv durxqg fhqwudo ydoxhv1 Lqrughu wr ryhufrph wklv gudzedfn/ wkh eurdghqhg phgldq ^5;` pd| eh frqvlghuhg1

Wkh vdpsoh phgldq pd| eh pruh h!flhqw wkdq wkh phdq zkhq ghdolqj zlwk glvwulex0wlrqv fkdudfwhul}hg e| wdlov khdylhu wkdq wkh qrupdo glvwulexwlrq1 D qdwxudo frpsurplvhehwzhhq wkh phdq dqg wkh phgldq lv uhsuhvhqwhg e| erwk wkh wulpphg dqg zlqvrul}hgphdqv ^5;`1 Wkh �uvw hvwlpdwru grhv qrw frqvlghu wkh h{wuhph revhuydwlrqv/ zkloh wkhvhfrqg jlyhv wkhp gl�huhqw zhljkwv1

Vhqvlwlylw| Dqdo|vlv lq Uhjuhvvlrq PrghovWkh hohphqwv gh�qlqj wkh uhjuhvvlrq prgho duh wkh xqghuo|lqj k|srwkhvhv/ yduldeohv dqgrevhuydwlrqv1 Wkh VD +ru lq xhqfh vwxg|, iru uhjuhvvlrq prghov frqvlvwv lq prqlwrulqjwkh fkdqjhv lq wkh �qdo uhvxowv zkhq wkh hohphqwv ri wkh prgho duh shuwxuehg1

Wkh pdlq lvvxhv lq ghvljqlqj phwkrgv iru uhjuhvvlrq VD duh wkh fkrlfh ri shuwxuedwlrqvfkhph/ wkh dvshfwv ri wkh prgho qhhglqj fkhfnlqj dqg wkh zd| wr dvvhvv dqg phdvxuhdq| lq xhqfh1

Li zh irfxv rq wkh gdwd/ dq lqwhuhvwlqj phwkrg iru shuwxuedwlrq lv wr ghohwh revhu0ydwlrqv/ lqglylgxdoo| ru lq jurxsv1 Wklv dssurdfk lv nqrzq dv fdvh0ghohwlrq dqg lw dlpvwr hydoxdwh wkh lq xhqfh ri dq revhuydwlrq/ ru revhuydwlrq vxevhw/ rq vrph dvshfwv riwkh uhjuhvvlrq dqdo|vlv1 Wkh revhuydwlrqv wkdw/ hlwkhu lqglylgxdoo| ru lq jurxsv/ kdyh dghprqvwudeoh lpsdfw rq vrph ru doo dvshfwv ri wkh dqdo|vlv/ duh fdoohg lq xhqwldo1 Wklvgh�qlwlrq whqgv wr eh vxemhfwlyh= lw grhv qrw surylgh d zd| wr phdvxuh wkh lq xhqfh ridq revhuydwlrq dqg qhlwkhu grhv lw foduli| zklfk dvshfwv ri wkh lq xhqfh vkrxog eh lqyhvwl0jdwhg1 Lq idfw/ dq revhuydwlrq pd| lq xhqfh wkh yhfwru ri sdudphwhuv hvwlpdwhg/ d olqhdufrpelqdwlrq ri wkhvh sdudphwhuv/ wkh hvwlpdwlrq ri wkh yduldqfh/ �wwhg ydoxhv/ frq�ghqfhlqwhuydov dv zhoo dv wkh jrrgqhvv0ri0�w vwdwlvwlfv/ wkrxjk lw pd| zhoo kdyh d gl�huhqw h�hfwrq hdfk ri wkhvh1 Wkxv/ wkh txhvwlrq �lq xhqfh rq zkdwB� sod|v d fhqwudo uroh lq ghvljqlqjlq xhqfh gldjqrvwlfv1 Pdq| phdvxuhv ri lq xhqfh duh sursrvhg1 Fkdwwhumhh ) Kdgl ^43`vxjjhvw wzr dssurdfkhv dqg glvfxvv gl�huhqw phwkrgv iru hdfk ri wkhp1

Lq wkh uhjuhvvlrq prgho wkh vwxg| ri lq xhqfh surgxfhv lqirupdwlrq derxw wkh uh0oldelolw| ri wkh frqfoxvlrqv1 Wkh ghwhfwlrq ri lq xhqwldo revhuydwlrqv frxog vxjjhvw dqlqdghtxdf| ri wkh prgho ru d ylrodwlrq ri wkh xqghuo|lqj k|srwkhvlv +^73`/^86`,1

Zh frqvlghu wkh xvxdo pxowlsoh uhjuhvvlrq prgho=

v ' j� n � +49,

zkhuh v lv d ?�� yhfwru ri ydoxhv ri wkh uhvsrqvh +ghshqghqw, yduldeoh> j lv d ?�R ixoo0froxpq udqn pdwul{ ri nqrzq uhjuhvvruv +ru h{sodqdwru| yduldeohv/ idfwruv dqg fduulhuv,xvxdoo| lqfoxglqj d frqvwdqw froxpq ri rqhv> � lv d R� � yhfwru ri xqnqrzq sdudphwhuv+ru frh!flhqwv, wr eh hvwlpdwhg> � lv d ?� � yhfwru ri huuruv/ lqghshqghqw dqg qrupdoo|glvwulexwhg zlwk }hur phdq dqg yduldqfh j2� Wkh lwk revhuydwlrq zloo eh lqglfdwhg zlwk

44

E �� c +��c zkhuh �

� uhsuhvhqwv wkh lwk urz ri j dqg +� lv wkh lwk hohphqw ri v1 Uhdghuvlqwhuhvwhg lq uhjuhvvlrq prghov fdq frqvxow ^48`/^6:`/^83`/^86`1

Ohw

� ' Ej�j�3�j�v +4:,

eh wkh ohdvw vtxduhv +OV, hvwlpdwru1 Zh fdoo uhvlgxdo wkh txdqwlw| o� ' +� � +�/ zkhuh+� ' ��

� lv wkh lwk hvwlpdwhg ydoxh ri wkh ghshqghqw yduldeoh1 Lq wkh frqwh{w ri uhjuhvvlrqgldjqrvwlfv/ revhuydwlrqv zlwk kljk uhvlgxdov duh frqvlghuhg yhuwlfdo rxwolhuv ru rxwolhuvrq wkh uhvsrqvh yduldeoh1 Wkhvh revhuydwlrqv pd| jhqhudoo| lq xhqfh wkh lqwhufhsw riwkh prgho1 Qhyhuwkhohvv/ lq rughu wr �qg wkh rxwolhuv/ gl�huhqw irupv ri uhvlgxdo vwdq0gdugl}dwlrq pd| eh xvhg wr rewdlq pruh vxlwdeoh gldjqrvwlfv1 Wkh prvw frpprq duh=vwdqgdugl}hg uhvlgxdov oW� ' o�*jc zkhuh j lv wkh vwdqgdug huuru ri uhjuhvvlrq> lqwhuqdoo|vwxghqwl}hg uhvlgxdov |� ' o�*Ej

s�� ����c zkhuh ��� lv wkh lwk gldjrqdo hohphqw ri wkh

kdw pdwul{ O ' jEj�j�3�j�/ ru h{whuqdoo| vwxghqwl}hg uhvlgxdov |E�� ' o�*EjE��s�� ����c

zkhuh jE�� lv wkh vwdqgdug huuru ri uhjuhvvlrq frpsxwhg zlwkrxw wkh lwk revhuydwlrq1 Dvd uxoh ri wkxpe/ dq revhuydwlrq zlwk uhvlgxdo/ lq devroxwh ydoxh/ odujhu wkdq 2�D fdq ehfrqvlghuhg dq rxwolhu rq wkh uhvsrqvh yduldeoh1

Lq wkh vwxg| ri lq xhqfh/ wkh hohphqwv ��� ri wkh kdw pdwul{ sod| d fhqwudo uroh1 Wkh|

kdyh d grxeoh lqwhusuhwdwlrq1 Iluvw ri doo/ vlqfh +� '?S

�'�

���+�c lw iroorzv wkdwY+�Y+�

' ���c

dqg wkxv ��� fdq eh frqvlghuhg dv wkh dprxqw ri ohyhudjh hdfk revhuyhg ydoxh +� kdv lqghwhuplqlqj wkh �wwhg +�1 Zh uhihu wr d srlqw E �� c +�� zlwk d kljk ��� dv ohyhudjh srlqw/dqg jhqhudoo| zh fdoo ��� wkh +srwhqwldo, ohyhudjh ri wkh gdwd srlqw E �� c +���

Iurp wkh surshuwlhv ri wkh kdw pdwul{ zlgho| glvfxvvhg lq ^43`/ lw iroorzv wkdw lq wkhuhjuhvvlrq prgho zlwkrxw lqwhufhsw/ f � ��� � �1 Wkhq/ li ��� ' �c +� lv ghwhuplqhg rqo|e| +� dqg wkh uhjuhvvlrq k|shusodqh sdvvhv wkurxjk +� zkloh/ li ��� ' f/ wkhq +� grhv qrwkdyh dq| lq xhqfh rq +� zklfk wdnhv }hur ydoxh1 Pruhryhu/ iru wkh uhjuhvvlrq prgho zlwklqwhufhsw/ zh �qg wkdw ?3� � ��� � ��

Wkh hohphqwv ��� dovr kdyh dq lqwhuhvwlqj jhrphwulf lqwhusuhwdwlrq1 Lq wkh uhjuhvvlrqprgho zlwk lqwhufhsw whup +^75`/^86`,/ wkh ohyhudjh lv uhodwhg wr vtxduhg Pdkdodqrelv

glvwdqfh +�(, ri wkh qrqfrqvwdqw uhjuhvvruv e| wkh uhodwlrq ��� '�

?� ��(2

� n�

?1 Lw

wkhq uhsuhvhqwv lq wkh ER � �� glphqvlrqdo vsdfh d uhprwhqhvv phdvxuh ri wkh srlqw ��/zlwkrxw wkh frqvwdqw whup �/ iurp wkh fhqwurlg ri wkh qrqfrqvwdqw uhjuhvvruv1 D kljkydoxh ri ��� lqglfdwhv wkdw �� olhv idu iurp wkh exon ri rwkhu srlqwv1 Wkh ohyhudjh lv wkhqxvhg dv d gldjqrvwlf phdvxuh lq rughu wr lghqwli| +krul}rqwdo, rxwolhuv lq wkh idfwru vsdfh1

Revhuydwlrqv zklfk dsshdu rxwo|lqj lq wkh idfwru vsdfh duh vdlg jrrg ohyhudjh srlqwvli wkh srlqw E �� c +�� lv lq wkh pdlq gdwd wuhqg1 Rwkhuzlvh wkhvh dw|slfdo revhuydwlrqvduh vdlg edg ohyhudjh srlqwv/ dqg xvxdoo| kdyh d vwurqj lq xhqfh rq vhyhudo dvshfwv riuhjuhvvlrq dqdo|vlv1 Urxvvhhxz ) Ohur| ^75` fdoo wkh edg ohyhudjh srlqwv dqg yhuwlfdorxwolhuv uhjuhvvlrq rxwolhuv1 D w|slfdo fxw0r� ydoxh iru wkh ohyhudjh lv 2R*?1

Li zh irfxv rq wkh lq xhqfh wkdw d vlqjoh revhuydwlrq kdv rq wkh OV hvwlpdwru/ zhpd| xvh wkh lq xhqfh fxuyh ru rqh ri lwv vdpsoh yhuvlrqv/ glvfxvvhg lq ghswk lq ^43`/^46`1D zlgho| xvhg �qlwh vdpsoh yhuvlrq ri lq xhqfh fxuyh uhsuhvhqwlqj wkh lq xhqfh ri wkhlwk revhuydwlrq rq wkh OV hvwlpdwru lv wkh �qlwh vdpsoh lq xhqfh fxuyh +7U�,/ douhdg|

45

gh�qhg e| htxdwlrq +48,1 Lq wkh uhjuhvvlrq prgho lw ehfrphv=

5W�� ' E?� ��E� � �E��� +4;,

'E?� ��Ej�j�3� �o�

�� ���/ � ' �c 2c ���?c

zkhuh �E�� lv wkh OV hvwlpdwhg yhfwruv ri frh!flhqwv rewdlqhg diwhu ghohwlqj wkh lwk fdvhE ��c +��1

Vlqfh wkh 5W�� lv d yhfwru ri vl}h Rc d gluhfw frpsdulvrq ehwzhhq � dqg �E�� lv qrwsrvvleoh1 Wkhq/ lq rughu wr fkdudfwhul}h wkh lq xhqfh dqg udqn wkh revhuydwlrqv dffruglqjwr wkhlu lq xhqfh/ lw pd| eh xvhixo wr xvh d vfdodu yhuvlrq ri wkh 7U�1 D zhoo nqrzq vfdoduphdvxuh ri lq xhqfh lv Frrn*v glvwdqfh +^44`/ ^45`,/ gh�qhg dv=

(� 'E� � �E���

�j�jE� � �E���

Rj2� +4<,

Lw h{suhvvhv wkh lpsdfw ri wkh lwk revhuydwlrq rq wkh OV hvwlpdwhg frh!flhqwv yhfwru1Dq lqwhuhvwlqj h{suhvvlrq ri Frrn*v glvwdqfh htxlydohqw wr wkh deryh rqh exw wdnlqj lqwrdffrxqw wkh vhqvlwlylw| ri wkh �wwlqj dqg suhglfwlrq fdsdelolw| prgho/ lv=

(� 'Ev � vE���

�Ev � vE���

Rj2� +53,

Khuh vE�� lv wkh ?� � hvwlpdwhg ydoxhv yhfwru ri wkh ghshqghqw yduldeoh rewdlqhg zlwkrxwwkh lwk fdvh1 Lq wklv irup (� fdq eh lqwhusuhwhg +h{fhsw iru d vfdoh sdudphwhu, dv wkhvtxduhg Hxfolghdq glvwdqfh ehwzhhq wkh wzr �wwhg yhfwruv vE�� dqg v1

Dqrwkhu h{suhvvlrq ri htxdwlrq +4<, frpsxwdwlrqdoo| pruh frqyhqlhqw dqg ulfk lqlqirupdwlrq/ ehfdxvh lw sxwv lq hylghqfh wkh olqn zlwk wkh uhjuhvvlrq rxwolhuv/ lv=

(� '�

R|2�

����� ���

� +54,

Lq wklv irup (� lv d ixqfwlrq ri wkh lqwhuqdoo| vwxghqwl}hg uhvlgxdo |�c zklfk uh hfwv krzzhoo wkh prgho �wv wkh +�/ dqg ri ��� zklfk phdvxuhv wkh rxwo|lqjqhvv ri wkh srlqw �� lqwkh idfwru vsdfh1 Wklv vwdwlvwlf surylghv/ wkhuhiruh/ d joredo phdvxuh ri wkh lq xhqfh riwkh lwk revhuydwlrq1 Iru h{dpsoh/ lq k|gurorjlfdo dvvhvvphqw/ Ehfflx hw do1 ^5` xvh Frrn*vglvwdqfh wr prgho wkh plqlpxp lq0vwuhdp rz lq gudlqdjh edvlqv ri wkh Fhqwudo Dosv1Frrn +^44`/^45`, vxjjhvwv frqvlghulqj dv khxulvwlf wkuhvkrog ydoxh wkh shufhqwdjh srlqw rid fhqwudo Ilvkhu glvwulexwlrq zlwk R dqg ?� R ghjuhhv ri iuhhgrp1 Pruh vlpso|/ Frrn )Zhlvehuj ^46` uhwdlqhg d fxw0r� ri �1

Zh fdq �qg vrph rwkhu zhoo nqrzq gldjqrvwlfv edvhg rq wkh vlqjoh0fdvh0ghohwlrq ds0surdfk/ vxfk dv (88UA7�/ (8�.A�7�/ lq ^6`/^43`/^46`1 Wkhvh phwkrgv kdyh ehhq zlgho|dffhswhg ehfdxvh ri wkhlu frpsxwdwlrqdo vlpsolflw|/ lqwxlwlyh dvshfwv dqg iru ehlqj dydlo0deoh lq wkh prvw frpprq vwdwlvwlfdo sdfndjhv1

Rwkhu gl�huhqw dssurdfkhv pd| eh ghyhorshg prgli|lqj wkh shuwxuedwlrq vfkhphdqg2ru xvlqj gl�huhqw phdvxuhv iurp wkh lq xhqfh fxuyhv1 Iru fodvvlfdo gldjqrvwlfv/ lq0whuhvwhg uhdghuv duh uhihuuhg wr ^43`/^46`1 Lq hvwlpdwlqj wkh vrxufhv ri dlueruqh sduwlfxodwh

46

pdwwhu/ Nlp ) Khqu| ^67` sursrvh vrph ruljlqdo qrqghohwlrq uhjuhvvlrq gldjqrvwlfv irulghqwli|lqj lq xhqwldo vshflhv lq wkh fkhplfdo pdvv edodqfh uhfhswru prgho1

Wkh phwkrgv lqyhvwljdwhg vr idu duh xvhixo iru dvvhvvlqj wkh lq xhqfh ri d vlqjoh re0vhuydwlrq1 Lq sulqflsoh/ wkh dvvhvvphqw ri wkh lq xhqfh ri pxowlsoh revhuydwlrqv fdq ehrewdlqhg e| jhqhudol}lqj wkh lq xhqfh gldjqrvwlfv suhylrxvo| lqwurgxfhg1 Iru lqvwdqfh/ liW ' E��c �2c ��c �&�

� zlwk � � �� � ? lv d yhfwru ri wkh lqglfhv ri vhohfwhg fdvhv/ d qdwxudoh{whqvlrq ri Frrn*v glvwdqfh lv=

(W 'E� � �EW�

��j�jE� � �EW��

Rj2� +55,

Li zh gr qrw kdyh dq| sulru nqrzohgjh derxw wkh qxpehu & ri lq xhqwldo revhuydwlrqvlq wkh gdwd vhw/ doo srvvleoh vxevhwv ri revhuydwlrqv vkrxog eh lqyhvwljdwhg1 Zkhq wkhvl}h ri wkh gdwd vhw lv odujh/ wklv surfhgxuh pd| ehfrph xqihdvleoh1 Pruhryhu/ pruhfrpsoh{ vlwxdwlrqv pd| rffxu iru zklfk d ghhshu vwxg| lv qhhghg1 Iru h{dpsoh/ dqrevhuydwlrq qrw lqglylgxdoo| lq xhqwldo ehfrphv vr li frqvlghuhg lq jurxsv1 Rq wkh rwkhukdqg/ revhuydwlrqv zklfk duh lqglylgxdoo| lq xhqwldo pd| qrw eh li frqvlghuhg wrjhwkhuzlwk rwkhuv1 Wklv vlwxdwlrq lv uhsuhvhqwhg lq �jxuh 61

D zd| wr rewdlq vrph lqirupdwlrq rq wkh srvvleoh qxpehu ri lq xhqwldo revhuydwlrqvlv wr orrn iru uhjuhvvlrq rxwolhuv dsshdulqj lq wkh gdwd dqg wkhq �{ & htxdo wr wkh qxpehuri rxwolhuv glvfryhuhg1 Li d gdwd vhw frqwdlqv d vlqjoh rxwolhu ru lq xhqwldo revhuydwlrqwkh sureohp ri lghqwli|lqj vxfk dq revhuydwlrq lv uhodwlyho| vlpsoh= wudglwlrqdo uhjuhvvlrqgldjqrvwlfv ri uhprwhqhvv ru lq xhqfh/ edvhg rq wkh OV uhvlgxdov dqg rq wkh hohphqwv���c zrun zhoo1 Qhyhuwkhohvv/ ghwhfwlqj pxowlsoh rxwolhuv e| phdqv ri wkh wudglwlrqdo OVgldjqrvwlfv frxog ehfrph pruh gl!fxow +vhh h1j1 ^75`,1 Wklv lv wkh frqvhtxhqfh ri pdvnlqjdqg vzdpslqj h�hfwv1 Pdvnlqj rffxuv zkhq d vxevhw ri rxwolhuv lv qrw fruuhfwo| ghwhfwhgehfdxvh lw lv forvhg wr dqrwkhu jurxs ri revhuydwlrqv1 Vzdpslqj rffxuv zkhq w|slfdo re0vhuydwlrqv duh lqfruuhfwo| lghqwl�hg dv rxwolhuv ehfdxvh ri wkh suhvhqfh ri dqrwkhu rxwo|lqjvxevhw ri revhuydwlrqv1 Wkhvh wzr h�hfwv rffxu ehfdxvh wkh OV phwkrg lv vhqvlwlyh erwkwr kljk ohyhudjh srlqwv dqg yhuwlfdo rxwolhuv1

Wr ryhufrph wkh sureohp ri fruuhfwo| lghqwli|lqj rxwo|lqj revhuydwlrqv/ rwkhu phdvxuhvqrw edvhg rq wkh wudglwlrqdo OV txdqwlw| duh qhhghg1 Wkh lghd lv wr xvh urexvw hvwlpdwlrqphwkrgv qrw lq xhqfhg e| rxwolhuv dqg/ rq wkh edvlv ri wkh uhvxowv rewdlqhg/ exloglqj qhzgldjqrvwlfv1

Wkh prvw frpprq urexvw hvwlpdwlrq phwkrgv idoo lqwr wkuhh fodvvhv= P 0hvwlpdwruv/O0hvwlpdwruv dqg U0hvwlpdwruv dqg/ iru hdfk ri wkhp/ pdq| hvwlpdwruv duh sursrvhg1Iru wkh urexvw uhjuhvvlrq phwkrgv wkh uhdghu lv uhihuuhg wr ^7`/^68`/^75` zkloh iru urexvwphwkrgrorj| lq jhqhudo wr ^57`/^5;`/^64`/^88`1

Wkh ghjuhh ri urexvwqhvv ri dq hvwlpdwru lv phdvxuhg e| wkh euhdngrzq srlqw/ zklfkuhsuhvhqwv/ urxjko| vshdnlqj/ wkh odujhvw sursruwlrq ri rxwolhuv wkdw fdq rffxu lq wkh gdwdzlwkrxw pdnlqj wkh ydoxh ri wkh hvwlpdwru duelwudulo| xqerxqghg1 Ehfdxvh ri wkh kljkvhqvlwlylw| wr uhjuhvvlrq rxwolhuv/ wkh OV hvwlpdwru kdv d euhdngrzq srlqw htxdo wr 3(1Wkh P/ O dqg U hvwlpdwruv duh lqvwhdg pruh urexvw zlwk uhjdug wr yhuwlfdo rxwolhuv/ exwduh vwloo vhqvlwlyh wr ohyhudjh srlqwv1 Lq dq| fdvh/ wkhlu euhdngrzq srlqw lv ohvv wkdq 63(1Wkh pd{lpxp srvvleoh euhdngrzq srlqw lv 83(1 Wklv ydoxh lv dfklhyhg e| ohdvw phgldq rivtxduhv +OPV, dqg ohdvw wulpphg vtxduhv +OWV, phwkrgv ri hvwlpdwlrq1 Iru d frpsohwh

47

ghvfulswlrq ri wkhvh phwkrgv wkh uhdghu lv uhihuuhg wr ^74` dqg ^75`/ zkloh iru ixuwkhughyhorsphqwv wr ^76`/^77`/^78`1 D frpsxwhu surjudp/ SURJUHVV/ doorzv wkh fdofxodwlrqri wkh OPV ru OWV frh!flhqwv iru +urexvw, uhjuhvvlrq prgho dqg d urexvw yhuvlrq ri wkhuhvlgxdov1 Pruhryhu/ Urxvvhhxz ) Ydq ]rphudq ^76` sursrvh d fodvvl�fdwlrq uxoh iru wkhrevhuydwlrqv/ edvhg rq wkh sorw ri wkh OPV urexvw uhvlgxdov djdlqvw d urexvw yhuvlrq riwkh Pdkdodqrelv glvwdqfh/ zklfk fdq eh rewdlqhg e| wkh frpsxwhu surjudp PLQYRO1Wkh wzr phqwlrqhg surjudpv duh dydlodeoh dqg wkh| kdyh ehhq lqfrusrudwhg iru h{dpsohlq V0Soxv dqg VDV2LPO vriwzduh sdfndjhv1

Hyhq li wkh OPV dqg OWV phwkrgv kdyh vrph gudzedfnv +^4:`/^53`/^59`/^75`, pdq|h{dpsohv +^73`/^75`/^76`/^77`/, vkrz wkdw wkhvh phwkrgv frxog eh xvhg dv h{sorudwru| wrroiru ghwhfwlqj dqg fodvvli|lqj dw|slfdo gdwd1

48

SC(x)

xX

Iljxuh 4= Xqerxqghg vhqvlwlylw| fxuyh iru wkh vdpsoh phdq1

SC(x)

xMe

Iljxuh 5= Erxqghg vhqvlwlylw| fxuyh iru wkh vdpsoh phgldq1

49

X

Y

AB

C

D

E

Iljxuh 6= Revhuydwlrqv D/ E dqg F duh lq xhqwldo lq jurxs exw qrw lqglylgxdoo|1Revhuydwlrqv G dqg H duh lqglylgxdoo| lq xhqwldo/ exw qrw wrjhwkhu1

4:

Vhqvlwlylw| Dqdo|vlv lq Wlph VhulhvWlph vhulhv dqdo|vlv sod|v d fhqwudo uroh lq hqylurqphqwdo vwdwlvwlfv vlqfh gdwd froohfwhgryhu wlph duh zlgho| xvhg dqg vhdvrqdolw|/ wuhqg/ iruhfdvwlqj dqg prqlwrulqj duh riwhquhohydqw wrslfv1

7� iru hqylurqphqwdo wlph vhulhv lv lpsruwdqw ehfdxvh li vrph gdwd duh yhu| lq xhqwldoiru wkh prgho dw kdqg/ zh �qg rxuvhoyhv idflqj rqh ri wkh iroorzlqj wzr srlqwv= �� gdwdtxdolw| lv orz dqg wkh hvwlpdwhg prgho lv qrw urexvw wr rxwolhuv> ��� wkh prgho lv lqdghtxdwhiru wkh gdwd xqghu vwxg|1

Lq wklv vhfwlrq/ zh zloo frqvlghu 7� phwkrgv edvhg rq lq xhqfh fxuyhv dqg Frrn*vglvwdqfh1 Dv orqj dv wlph vhulhv prghov duh uhodwhg wr uhjuhvvlrq prghov/ wkh fruuhvsrqg0lqj 7� phwkrgv vkrz vlplodulwlhv dqg gl�huhqfhv1 Lq sduwlfxodu/ wkh gl�huhqfh dprqjkrul}rqwdo dqg yhuwlfdo rxwolhuv lv qrw lpphgldwh dv lq wkh uhjuhvvlrq vhwxs1

Qrqsdudphwulf Lq xhqfh Phdvxuhv

Lq wklv vhfwlrq/ zh iroorz Ohiudqêrlv ^�S` dqg frqvlghu dq lq xhqfh phdvxuh iru wkh dxwrfru0uhodwlrq ixqfwlrq doorzlqj lqglfdwlrq iru lq xhqwldo revhuydwlrqv dw dq hduo| vwdjh ri prghoexloglqj1 Vwulfwo| vshdnlqj/ wkh rxwolhu gh�qlwlrq lv prgho ghshqghqw1 Qhyhuwkhohvv/ wkhqrqsdudphwulf dssurdfk ri wklv vhfwlrq lv xvhixo ehfdxvh rxwolhuv duh riwhq lq xhqwldo iruwkh hqwluh fodvv ri prghov xqghu vwxg|1 Pruhryhu/ vhdufklqj iru lq xhqwldo revhuydwlrqv lqwklv zd| lv frpsxwdwlrqdoo| fkhdshu wkdq wkh sdudphwulf dssurdfk ri qh{w vhfwlrq zkhuh/xvlqj wkh vlqjoh0fdvh0ghohwlrq dssurdfk wkh prgho kdyh wr eh uh0hvwlpdwhg ? wlphv1

Ohw t|c | ' �c 2c ��� eh d uhjxodu vwdwlrqdu| Jdxvvldq surfhvv ^2.` zlwk dxwrfruuhodwlrqv4� dqg vdpsoh dxwrfryduldqfhv dqg dxwrfruuhodwlrqv jlyhq e| S� dqg o�c uhvshfwlyho|1Frqvlghulqj wkh lq xhqfh iru wkh vlqjoh sdudphwhu 4� gxh wr wkh �wk revhuydwlrq/ d vwdwlvwlfhtxlydohqw iru odujh vdpsohv wr wkh vdpsoh lq xhqfh fxuyh E�D� lv

7U��c� ' ~� E~�n� n ~�3� � o�~�� c

zkhuh ~| 't| � 7t

Sf1 Wkh lq xhqfh iru wkh dxwrfruuhodwlrq ixqfwlrq wuxqfdwhg dw odj u lv

wkhq froohfwhg e| wkh yhfwru

5W�� ' E7U��c�c ���c 7U��cu��

dqg vxppdul}hg e| wkh txdgudwlf irup

'U�� ' E5W�� � ~����� [3�

� E5W�� � ~���� c

zkhuh �� dqg [� duh pdwul{ ixqfwlrqv ri wkh vdpsoh dxwrfruuhodwlrqv o�c ���c ou� Xvlqj wkhnqrzq dv|pswrwlf glvwulexwlrq ri 'U�/ zh fdq wkhq whvw iru lq xhqwldo revhuydwlrqv dqgiru wkh prvw lq xhqwldo revhuydwlrq dw dq hduo| vwdjh ri prgho exloglqj1

4;

Lq xhqfh Phdvxuhv iru DULPD Prghov

Ohw t|c | ' fc�c2c ��� eh dq �-U�� ERc _c ^� vwdqgdug surfhvv ^2.` jlyhq e| wkh sro|0qrpldo htxdwlrq

@ E��u_t| ' S E���|

ru wkh htxlydohqw gl�huhqfh htxdwlrq

u_t| '

R[�'�

@�u_t|3� n

^[�'�

S��|�

Lq wkhvh htxdwlrqv/ @ E�� ' � � @�� � ��� � @R�R dqg S E�� ' � � S�� � ��� � S^�

^ duhsro|qrpldo rshudwruv zlwk urrwv rxwvlgh wkh xqlw flufoh1 Wkh edfnvkliw rshudwru � lv vxfkwkdw t|3� ' �t| dqg u_ ' E����_ � Pruhryhu u_t| lv d }hur phdq vwdwlrqdu| surfhvvdqg �| lv dq lqghshqghqw � Efc j2� vhtxhqfh1

Frqvlghu wkh prgho ri dgglwlyh rxwolhu dw wlph � iru zklfk t W

| lv wkh wuxh�-U�� surfhvvexw zh revhuyh

t| '

�t W

| | 9' �t W

| n �� | ' ��+56,

Wklv prgho lv xvhixo h1j1 lq hqylurqphqwdo kljk iuhtxhqf| wlph vhulhv dqdo|vlv dv hqylurq0phqwdo gdwd duh riwhq d�hfwhg e| phdvxuhphqw huuruv ^D`1 Wrjhwkhu zlwk wkh lqqrydwlrqdorxwolhu prgho/ wkh deryh dgglwlyh rxwolhu prgho lv d sduwlfxodu fdvh ri wkh jhqhudo lqwhu0yhqwlrq dqdo|vlv prgho zklfk Er{ dqg Wldr ^S` xvhg wr dvvhvv wkh lpsdfw ri wkh qhz odzri jdvrolqh frpsrvlwlrq rq wursrvskhulf r}rqh lq Orv Dqjhohv Flw| lq wkh 4<931

Dgglwlyh dqg lqqrydwlrqdo rxwolhu prghov pd| eh kdqgohg e| lwhudwlyh ghwhfwlrq0hvwlpdwlrq whfkqltxhv/ ^2.`1 Rq0olqh vwdwlvwlfdo ghwhfwlrq ri phdvxuhphqw huuru rxwolhuvlv dssolhg e| ^D` wr krxuo| r}rqh gdwd lq grzqwrzq Erorjqd/ Lwdo|1 Khuh zh frqvlghur�0olqh ru uhwurvshfwlyh lq xhqfh phdvxuhv iru vlqjoh rxwolhuv1

Lq dqdorj| zlwk lq xhqfh phdvxuhv ri suhylrxv vhfwlrqv/ Shôd ^�H` lqwurgxfhg d Frrn0w|sh glvwdqfh1 Wr vhh wklv/ ohw

t W

| '�[

�'�

Z�tW

|3� n �| +57,

eh wkh �- dssur{lpdwlrq ri wkh deryh �-U�� ERc _c ^� surfhvv iru dssursuldwh �1 Frq0vlghulqj wkh uhjuhvvlrq lqwhusuhwdwlrq ri htxdwlrq E2e� c xqghu wkh qrq0rxwolhu k|srwkhvlv/�� ' f/ zh kdyh t| ' t W

| dqg � ' Ej�j�3�j�v lv wkh vwdqgdug frqglwlrqdo pd{lpxpolnholkrrg hvwlpdwh ri � ' EZ�c ���c Z��

� zkhuh j lv wkh uhjuhvvru0w|sh E?� ��� � glphq0vlrqdo pdwul{ zlwk E}c ��wk hohphqw jlyhq e| t�n}3� dqg v lv wkh uhvsrqvh yhfwru zlwk �wkhohphqw jlyhq e| t�n�1 Pruhryhu/ ohw

��E��c ��

�eh wkh fruuhvsrqglqj xqfrqvwudlqhg frq0

glwlrqdo pd{lpxp olnholkrrg hvwlpdwh/ zkhuh �E�� fruuhvsrqgv wr wkh vlqjoh0fdvh0ghohwlrqdssurdfk ri suhylrxv vhfwlrq1 Dv d pdwwhu ri idfw/ xvlqj Ndopdq �owhulqj whfkqltxhv lwfdq eh vkrzq wkdw/ ^�b`/ �E�� lv wkh vdph dv wkh frqglwlrqdo pd{lpxp olnholkrrg hvwlpdwh

4<

zkhq t� lv plvvlqj1 Wkhq dv lq xhqfh vwdwlvwlf/ Shôd vxjjhvwv wkh iroorzlqj vwdqgdugl}hgPdkdodqrelv glvwdqfh

(� '

�� � �E��

��

Ej�j��� � �E��

�ERn ^� j2

c +58,

zkhuh j2 lv wkh xvxdo rqh vwhs suhglfwlrq huuru yduldqfh hvwlpdwh1Olnh Frrn*v glvwdqfh lq vwdqgdug uhjuhvvlrq E�b�/ Shôd*v glvwdqfh lv edvhg rq vlplodu

7U� txdgudwlf irup dqg kdv vlplodu lqwhusuhwdwlrq iru dvvhvvlqj wkh revhuydwlrq lq xhqfhwr wkh iruhfdvwv1 Lq sduwlfxodu/ wkh rqh vwhs iruhfdvwv xvlqj wkh prgho zlwk dqg zlwkrxwrxwolhuv dqg wkh ixoo uhjuhvvru gdwd vhw duh jlyhq e| v ' j� dqg vE�� ' j�E��� Qrwhwkdw j lv wkh vdph lq erwk htxdwlrqv dqg/ vwulfwo| vshdnlqj/ vE�� lv qrw wkh iruhfdvw iurpdq dgglwlyh rxwolhu prgho zkhuh wkh t� hohphqwv lq j zrxog eh fruuhfwhg iru ��1 Qrz/wkh Shôd vwdwlvwlf lv sursruwlrqdo wr wkh vtxduhg Hxfolghdq glvwdqfh ehwzhhq wkh deryhsuhglfwlrq yhfwruv/ qdpho|

(� '

�v � vE��

���v � vE��

�ERn ^� j2

� +59,

Pruhryhu/ d ghfrpsrvlwlrq E2�� fdq eh gh�qhg zklfk lv frqfhswxdoo| vlplodu wr exw ohvvvlpsoh wkdq E2��1

Sorwwlqj wklv vwdwlvwlf djdlqvw � jlyhv d vlpsoh wrro iru ghwhfwlqj lq xhqwldo rxwolhuv1Xqiruwxqdwho|/ qr gluhfw uhihuhqfh wr d prgho lqghshqghqw kdw pdwul{ lv dydlodeoh dqg/xqolnh lq wkh vwdqgdug uhjuhvvlrq fdvh E2��/ khuh/ iru hdfk � ' �c ���c ?/ zh qhhg wr uh0hvwlpdwh �E�� ru wkh uhodwhg �-U�� sdudphwhuv

�@E��cUE��

�dqg wkh frpsxwdwlrq wlph iru

wkh deryh phqwlrqhg (� sorw pd| eh uhohydqw1Qrwh wkdw/ wkh fruuhvsrqglqj Frrn*v vwdwlvwlf iru lqqrydwlrqdo rxwolhuv zdv vkrzq e|

^�H` wr jlyh dq xquholdeoh surfhgxuh1

Lq xhqfh Phdvxuhv iru G|qdplf Uhjuhvvlrq Prghov

Lq hqylurqphqwdo wlph vhulhv dqdo|vlv/ riwhq fryduldwhv dqg uhjuhvvlrq zlwk fruuhodwhghuuruv kdyh wr eh xvhg1 H{dpsohv duh zdwhu srooxwlrq prqlwrulqj lq Qldjdud Ulyhu d�Ho/dqg wursrvskhulf r}rqh frqfhqwudwlrq prgho zlwk phwhrurorjlfdo yduldeohv dqg suhfxuvruv^�b`1

Dq hqylurqphqwdo surwhfwlrq sureohp lv frqfhuqhg lq ^�b` zkhuh/ frqvlghulqj d jdvixuqdfh/ wkh uhodwlrq dprqj wkh rxwsxw fduerq glr{lgh frqfhqwudwlrq dqg jdv0ihhg udwhEL|� lv dvvhvvhg wkurxjk wkh fodvvlfdo wudqvihu ixqfwlrq prgho ^2.`1 Wklv fdq eh zulwwhq dv

t W

| ' D E��L| n�

Z E���|c +5:,

zlwk udwlrqdo rshudwruv D E�� dqg Z E�� ri rughu E6c @� dqg ERc ^� uhvshfwlyho|1 Sdudooholqjwkh �-U�� fdvh E2e�/ htxdwlrq E2.� fdq eh zulwwhq dv d odjjhg uhjuhvvlrq/ qdpho|

t W

| '[�

Z�tW

|3� n Z E��[�

D�L|3� n �|�

53

Wkhq/ wkh iruhfdvw glvwdqfh E2S� iru wkh ixoo sdudphwhu � ' E�c�� fdq eh ghfrpsrvhg lqwrdq lq xhqfh phdvxuh iru �c dq lq xhqfh phdvxuh iru � dqg dq lqwhudfwlrq whup/ qdpho|

(� Ew� ' S�(� E�� n S2(� E�m�� n U�A� E�c�� �

Khuh/ (� EZ� lv wkh vdph dv lq htxdwlrq E2D�1 Pruhryhu/ xvlqj pd{lpxp olnholkrrg hvwl0pdwhv � iru wkh ixoo gdwd vhw dqg �E�� iru wkh rqh0fdvh0ghohwlrq/ zh kdyh

(� E�m�� '�� � �E��

�� P3�

�

�� � �E��

�E6n @�

c +5;,

zkhuh P� lv wkh hvwlpdwhg yduldqfh0fryduldqfh pdwul{ ri �1 Wklv txdqwlw| jlyhv wkh fkdqjhlq wkh wudqvihu ixqfwlrq jlyhq wkh qrlvh vwuxfwxuh �1 Ilqdoo|/ wkh lqwhudfwlrq whup U�A�lv jlyhq e| furvv0surgxfw w|sh frpsxwdwlrq dv lq ^�b`1

Xvlqj ghfrpsrvlwlrq E2H�/ zh fdq wkhq dvvhvv wkh vhsdudwhg lq xhqfhv wr wkh g|qdplffrpsrqhqw dqg wkh wudqvihu ixqfwlrq� Pruhryhu/ (� Ew� jhqhudol}hv erwk wkh �-U�� dqgwkh vwdqgdug uhjuhvvlrq fdvhv ri suhylrxv vhfwlrqv jlylqj wkhp dv sduwlfxodu fdvhv zkhq� ' f dqg � ' f uhvshfwlyho|1

Uhihuhqfhv^4` Edxhu/ O1U1/ Kdpe|/ G1P1 E�bb�� Uhodwlyh vhqvlwlylwlhv ri h{lvwlqj dqg qryho prgho

sdudphwhuv lq dwprvskhulf wulwlxp grvh hvwlpdwhv1 Udglrorj| dqg Surw1 Grvlphwu|16:/ 58605931

^5` Ehfflx/ J1/ Eldqfkl/ D1/ Idvvõ/ F1D1/ Odufdq/ H1/ Idvvõ/ D1 E2fff� Txlfn fdofxodwlrqri plqlpxp lq0vwuhdp rz lq gudlqdjh edvlqv ri Fhqwudo Dosv1 Lq Surfhhglqj ri Qhzwuhqgv lq zdwhu hqylurqphqwdo hqjlqhhulqj iru vdihw| dqg olih= hfr0frpsdwleoh vrox0wlrqv iru dtxdwlf hqylurqphqwv1 Fdsul/ Mxo| 60:/ 53331 +FG0URP,1 D1D1 Edonhpd/Urwwhugdp1

^6` Ehovoh|/ G1D1/ Nxh/ H1/ Zhovfk/ U1H1 +4<;3, Uhjuhvvlrq gldjqrvwlfv= lghqwli|lqj lq0 xhqwldo gdwd dqg vrxufhv ri froolqhdulw|1 Zloh|/ Qhz \run1

^7` Elunhv/ G1/ Grgjh/ \1 +4<<6,/Dowhuqdwlyh phwkrgv ri uhjuhvvlrq1 Zloh|/ Qhz \run1

^8` Erugljqrq/ V1/ Vfdjoldulql/ P1 E2fff� Prqlwrulqj dojrulwkpv iru ghwhfwlqj fkdqjhv lqwkh r}rqh frqfhqwudwlrqv1 Hqylurqphwulfv1 44/ 5/ 458046:1

^9` Er{/ J1H1S1 dqg Wldr/ J1F1 E�b.D� Lqwhuyhqwlrq dqdo|vlv zlwk dssolfdwlrqv wr hfr0qrplfv dqg hqylurqphqwdo sureohpv1 Mrxuqdo ri wkh Dphulfdq Vwdwlvwlfdo Dvvrfldwlrq/:3/ 67</ :30:<1

^:` Er{/ J1H1S1/ Kxqwhu/ Z1J1/ Kxqwhu M1V1 E�b.H� Vwdwlvwlfv iru h{shulphqwhuv= dq lq0wurgxfwlrq wr ghvljq/ gdwd dqdo|vlv dqg prgho exloglqj1 Zloh|/ Qhz \run1

54

^;` Er{/ J1H1S1/ Gudshu E�bH.� Hpslulfdo prgho0exloglqj dqg uhvsrqvh vxuidfhv1 Zloh|/Qhz \run1

^<` Fkdq/ N1/ Wdudqwrod V1/ Vdowhool / D1/ Vrero*/ L1 E2fff� Yduldqfh0edvhg phwkrgv1 LqVhqvlwlylw| Dqdo|vlv/ Vdowhool/ D1/ Fkdq/ N1/ Vfrww/ P1 hgv1 Zloh|/ Qhz \run1

^43` Fkdwwhumhh/ V1/ Kdgl/ D1V1 E�bHH� Vhqvlwlylw| dqdo|vlv lq olqhdu uhjuhvvlrq1 Zloh|/ Qhz\run1

^44` Frrn/ U1G1 E�b..� Ghwhfwlrq ri lq xhqwldo revhuydwlrqv lq olqhdu uhjuhvvlrq1 Whfkqr0phwulfv/ 4</ 4/ 4804;1

^45` Frrn/ U1G1 E�b.b� Lq xhqwldo revhuydwlrqv lq olqhdu uhjuhvvlrq1 Mrxuqdo ri wkh Dphu0lfdq Vwdwlvwlfdo Dvvrfldwlrq/ :7/ 698/ 49<04:71

^46` Frrn/ U1G1/ Zhlvehuj/ V1 E�bH2� Uhvlgxdov dqg lq xhqfh lq uhjuhvvlrq1 Fkdspdq dqgKdoo/ Orqgrq1

^47` Grzqlqj/ G1M1/ Jdugqhu/ U1K1/ Kr�pdq/ I1R1 E�bHD� Dq h{dplqdwlrq ri uhvsrqvh0vxuidfh phwkrgrorjlhv iru xqfhuwdlqw| dqdo|vlv lq dvvhvvphqw prghov1 Whfkqrphwulfv15:/ 5/ 48404961

^48` Gudshu/ Q1U1/ Vplwk/ K1 E�bH�� Dssolhg uhjuhvvlrq dqdo|vlv1 5qg hglwlrq/Zloh|/ Qhz\run1

^49` Hdvwhuolqj/ U1J1 E�bHS� Glvfxvvlrq ri Grzqlqj/ Jdugqhu dqg Kr�pdqqE�bHD� �Whfkqrphwulfv/ 5;/ 4/ <40<61

^4:` Hoolv/ V1S1 E�bbH� Lqvwdelolw| ri ohdvw vtxduhv/ ohdvw devroxwh ghyldwlrq dqg ohdvw phgldqri vtxduhv olqhdu uhjuhvvlrq1 Vwdwlvwlfdo Vflhqfh/ 46/ 7/ 66:06831

^4;` Ho0Vkddudzl/ D1K1 E�bb�� Hqylurqphqwdo prqlwrulqj/ dvvhvvphqw dqg suhglfwlrq rifkdqjh1 Hqylurqphwulfv/ 7/ 7/ 6;406<;1

^4<` Jdoedoo|/ L1H1/ Ploohu/ D1M1/ Kr|/ U1G1/ Dkphw/ V1/ Mr|qw/ U1F1/ Dwwzrrg/ G1 E�bHS�Vxuidfh r}rqh dw uxudo vlwhv lq wkh Odwureh ydooh| dqg Fdsh Julp/ Dxvwudold1 Dwpr0vskhulf Hqylurqphqw/ 53/ 5736057551

^53` Kdgl/ D1V1/ Vlprqr�/ M1V1 E�bb�� Surfhgxuh iru wkh lghqwl�fdwlrq ri pxowlsoh rxwolhuvlq olqhdu prghov1 Mrxuqdo ri wkh Dphulfdq Vwdwlvwlfdo Dvvrfldwlrq/ ;;/ 757/ 4597045:51

^54` Kdpe|/ G1P1 E�bbe� D uhylhz ri whfkqltxhv iru sdudphwhu vhqvlwlylw| dqdo|vlv rihqylurqphqwdo prghov1 Hqylurqphqwdo Prqlwrulqj dqg Dvvhvvphqw/ 65/ 46804871

^55` Kdpsho/ I1U1 E�bSH� Frqwulexwlrqv wr wkh wkhru| ri urexvw hvwlpdwlrq1 Sk1G1 Wkhvlv/Xqlyhuvlw| ri Fdoliruqld/ Ehunhoh|1

^56` Kdpsho/ I1U1 E�b.e� Wkh lq xhqfh fxuyh dqg lwv uroh lq urexvw hvwlpdwlrq1 Mrxuqdori wkh Dphulfdq Vwdwlvwlfdo Dvvrfldwlrq/ 95/ 6;606<6

55

^57` Kdpsho/ I1U1/ Urqfkhwwl/ H1P1/ Urxvvhhxz/ S1M1/ Vwdkho/ Z1D1 E�bHS� Urexvw vwdwlv0wlfv= wkh dssurdfk edvhg rq lq xhqfh ixqfwlrqv1 Zloh|/ Qhz \run1

^58` Khowrq/ M1F1 E�bb�� Xqfhuwdlqw| dqg vhqvlwlylw| dqdo|vlv whfkqltxhv iru xvh lq shuiru0pdqfh dvvhvvphqw iru udglrdfwlyh zdvwh glvsrvdo1 Uholdelolw| Hqjlqhhulqj dqg V|vwhpVdihw|/ 75/ 65:069:1

^59` Khwwpdqvshujhu/ W1 S1/ Vkhdwkhu/ V1M1 E�bb2� D fdxwlrqdu| qrwh rq wkh phwkrg riohdvw phgldq vtxduhv1 Wkh Dphulfdq Vwdwlvwlfldq/ 79/ 5/ :<0;61

^5:` Klsho/ N1Z1/ PfOhrg/ D1L1 E�bbe� Wlph Vhulhv Prghoolqj ri zdwhu uhvrxufhv dqgHqylurqphqwdo V|vwhpv1 Hovhylhu1

^5;` Krdjolq/ G1F1/ Prvwhoohu/ I1/ Wxnh|/ M1Z1 E�bH�� Xqghuvwdqglqj urexvw dqg h{0sorudwru| gdwd dqdo|vlv1 Zloh|/ Qhz \run1

^5<` Kr�pdqq/ I1R1/ Jdugqhu/ U1K1 E�bH�� Hydoxdwlrq ri xqfhuwdlqwlhv lq hqylurqphqwdoudglrorjlfdo dvvhvvphqw prghov1 Lq Udglrorjlfdo dvvhvvphqw= d Wh{werrn rq hqylurq0phqwdo grvh dvvhvvphqw1 Wloo/ M1H1/ Ph|hu/ K1U1 hgv11 Uhsruw q1 QXUHJ2FU066651X1V1 qxfohdu uhjxodwru| frpplvvlrq/ Zdvklqjwrq/ GF1

^63` Krppd/ W1/ Vdowhool D1 E�bbS� Lpsruwdqfh phdvxuhv lq joredo vhqvlwlylw| dqdo|vlv riqrqolqhdu prghov1 Uholdelolw| Hqjlqhhulqj dqg V|vwhp Vdihw|/ 85/ 404:1

^64` Kxehu/ S1 E�bH�� Urexvw vwdwlvwlfv1 Zloh|/ Qhz \run1

^65` Lpdq/ U1O1/ Frqryhu Z1M1 E�bH2� D glvwulexwlrq0iuhh dssurdfk wr lqgxflqj udqn fru0uhodwlrq dprqj lqsxw yduldeohv1 Frppxqlfdwlrqv lq Vwdwlvwlvwlfv 0 Vlpxodwlrq dqgFrpsxwdwlrq/ 44/ 6/ 64406671

^66` Lpdq/ U1O1/ Krud/ V1F1 E�bbf� D urexvw phdvxuh ri xqfhuwdlqw| lpsruwdqfh iru xvhlq idxow wuhh v|vwhp dqdo|vlv1 Ulvn Dqdo|vlv/ 43/ 73407391

^67` Nlp/ E1P1/ Khqu|/ U1F1 E�bbb� Gldjqrvwlfv iru ghwhuplqlqj lq xhqwldo vshflhv lq wkhfkhplfdo pdvv edodqfh uhfhswru prgho1 Mrxuqdo ri wkh Dlu ) Zdvwh PdqdjhphqwDvvrfldwlrq/ 7</ 477<047881

^68` Odzuhqfh/ N1G1/ Duwkxu/ M1O1 E�bbf� Urexvw uhjuhvvlrq dqdo|vlv dqg dssolfdwlrq1Pdu0fho Ghnnhu/ Lqf1

^69` Ohiudqêrlv/ E1 E�bb�� Ghwhfwlqj ryhu0lq xhqwldo revhuydwlrqv lq wlph vhulhv1Elrphwulnd/ :;/ 4/ <40<<1

^6:` Prqwjrphu|/ G1F1/ Shfn/ D1H1 E�bH2� Lqwurgxfwlrq wr olqhdu uhjuhvvlrq dqdo|vlv1 Zl0oh|/ Qhz \run1

^6;` Shôd/ G1 E�bbf� Lq xhqwldo revhuydwlrqv lq wlph vhulhv1 Mrxuqdo ri Exvlqhvv ) Hfr0qrplf Vwdwlvwlfv/ ;/ 5/ 56805741

56

^6<` Shôd/ G1 E�bb�� Phdvxulqj lq xhqfh lq g|qdplf prghov1 Whfkqrphwulfv/ 66/ 4/ <604341

^73` Ulwvfkdug/ J1/ Dqwlooh/ J1 E�bb2� D urexvw orrn dw wkh xvh ri uhjuhvvlrq gldjqrvwlfv1Wkh Vwdwlvwlfldq/ 74/ 74086

^74` Urxvvhhxz/ S1M1 E�bHe� Ohdvw phgldq ri vtxduhv uhjuhvvlrq1 Mrxuqdo ri wkh DphulfdqVwdwlvwlfdo Dvvrfldwlrq/ :</ 6;;/ ;:40;;31

^75` Urxvvhhxz/ S1M1/ Ohur|/ D1P1 E�bH.� Urexvw uhjuhvvlrq dqg rxwolhuv ghwhfwlrq1 Zloh|/Qhz \run1

^76` Urxvvhhxz/ S1M1/ Ydq ]rphuhq/ E1F1 E�bbf� Xqpdvnlqj pxowlyduldwh rxwolhuv dqgohyhudjh srlqwv/ +zlwk glvfxvvlrq,1 Mrxuqdo ri wkh Dphulfdq Vwdwlvwlfdo Dvvrfldwlrq/;8/ 744/ 96609841

^77` Urxvvhhxz/ S1M1/ Ydq ]rphuhq/ E1F1 E�bb2� D frpsdulvrq ri vrph txlfn dojrulwkpviru urexvw uhjuhvvlrq1 Frpsxwdwlrqdo Vwdwlvwlfv ) Gdwd Dqdo|vlv/ 47/ 43:04491

^78` Urxvvhhxz/ S1M1/ Zdjqhu/ M1 P1 E�bbe� Urexvw uhjuhvvlrq zlwk d glvwulexwhg lqwhufhswxvlqj ohdvw phgldq ri vtxduhv1 Frpsxwdwlrqdo Vwdwlvwlfv ) Gdwd Dqdo|vlv/ 4:/ 980:81

^79` Vdfnv M1/ Zhofk Z1M1/ Plwfkhoo W1M1/ Z|qq K1S1 E�bHb� Ghvljq dqg dqdo|vlv ri frp0sxwhu h{shulphqwv1 Vwdwlvwlfdo Vflhqfh/ 7/ 73<07681

^7:` Vdowhool/ D1/ Wdudqwrod/ V1/ Fkdq/ N1 E�bbb�D txdqwlwdwlyh prgho0lqghshqghqw phwkrgiru joredo vhqvlwlylw| dqdo|vlv ri prgho rxwsxw1 Whfkqrphwulfv/ 74/ 4/ 6<0891

^7;` Vdowhool/ D1/ Fkdq/ N1/ Vfrww/ P1 E2fff� Vhqvlwlylw| Dqdo|vlv/ Zloh|/ Qhz \run1

^7<` Vdpsvrq/ S1G1/ Jxwwrus/ S1 E�bbb� Rshudwlrqdo hydoxdwlrq ri dlu txdolw| prghov1 LqHqylurqphqwdo Vwdwlvwlfv= Dqdo|vlqj gdwd iru hqylurqphqwdo srolf|1 Qryduwlv Irxqgd0wlrq V|psrvlxp 5531 660841 Zloh|/ Qhz \run1

^83` Vhduoh/ V1U1 E�b.�� Olqhdu Prghov1 Zloh|/ Qhz \run1

^84` Vwxduw/ D1/ Rug/ M1N1 E�bb�� Nhqgdoo*v dgydqfhg wkhru| ri vwdwlvwlfv/ Yro1 51 Krgghu) Vwrxjkwrq/ Orqgrq1

^85` Wxudq|l/ W1/ Udelw}/ K1 E2fff� Orfdo Phwkrgv/ lq Vhqvlwlylw| Dqdo|vlv/ Vdowhool/ D1/Fkdq/ N1/ Vfrww/ P1 hgv1 Zloh|/ Qhz \run1

^86` Zhlvehuj/ V1 E�bHD� Dssolhg olqhdu uhjuhvvlrq1 5qg hglwlrq/ Zloh|/ Qhz \run1

^87` Zhofk/ Z1M1/ Exfn/ U1M1/ Vdfnv M1/ Z|qq K1S1/ Plwfkhoo W1M1/ Pruulv/ P1G1 E�bb2�Vfuhhqlqj/ suhglfwlqj dqg frpsxwhu h{shulphqwv1 Whfkqrphwulfv/ 67/ 4/ 480581

^88` Zlofr{/ U1U1 E�bb.� Lqwurgxfwlrq wr urexvw hvwlpdwlrq dqg k|srwkhvlv whvwlqj1 Dfd0ghplf Suhvv/ Vdq Glhjr1

57