UPPSALA DISSERTATIONS IN MATHEMATICS 113
Optimal adaptive designs and adaptive randomization techniques for clinical trials
Yevgen Ryeznik
Department of Mathematics Uppsala University UPPSALA 2019 Dissertation presented at Uppsala University to be publicly examined in Ång 4101, Ångströmlaboratoriet, Lägerhyddsvägen 1, Uppsala, Friday, 26 April 2019 at 09:00 for the degree of Doctor of Philosophy. The examination will be conducted in English. Faculty examiner: Associate Professor Franz König (Center for Medical Statistics, Informatics and Intelligent Systems, Medical University of Vienna).
Abstract Ryeznik, Y. 2019. Optimal adaptive designs and adaptive randomization techniques for clinical trials. Uppsala Dissertations in Mathematics 113. 94 pp. Uppsala: Department of Mathematics. ISBN 978-91-506-2748-0.
In this Ph.D. thesis, we investigate how to optimize the design of clinical trials by constructing optimal adaptive designs, and how to implement the design by adaptive randomization. The results of the thesis are summarized by four research papers preceded by three chapters: an introduction, a short summary of the results obtained, and possible topics for future work. In Paper I, we investigate the structure of a D-optimal design for dose-finding studies with censored time-to-event outcomes. We show that the D-optimal design can be much more efficient than uniform allocation design for the parameter estimation. The D-optimal design obtained depends on true parameters of the dose-response model, so it is a locally D-optimal design. We construct two-stage and multi-stage adaptive designs as approximations of the D-optimal design when prior information about model parameters is not available. Adaptive designs provide very good approximations to the locally D-optimal design, and can potentially reduce total sample size in a study with a pre-specified stopping criterion. In Paper II, we investigate statistical properties of several restricted randomization procedures which target unequal allocation proportions in a multi-arm trial. We compare procedures in terms of their operational characteristics such as balance, randomness, type I error/ power, and allocation ratio preserving (ARP) property. We conclude that there is no single “best” randomization procedure for all the target allocation proportions, but the choice of randomization can be done through computer-intensive simulations for a particular target allocation. In Paper III, we combine the results from the papers I and II to implement optimal designs in practice when the sample size is small. The simulation study done in the paper shows that the choice of randomization procedure has an impact on the quality of dose-response estimation. An adaptive design with a small cohort size should be implemented with a procedure that ensures a “well-balanced” allocation according to the D-optimal design at each stage. In Paper IV, we obtain an optimal design for a comparative study with unequal treatment costs and investigate its properties. We demonstrate that unequal allocation may decrease the total study cost while having the same power as traditional equal allocation. However, a larger sample size may be required. We suggest a strategy on how to choose a suitable randomization procedure which provides a good trade-off between balance and randomness to implement optimal allocation. If there is a strong linear trend in observations, then the ARP property is important to maintain the type I error and power at a certain level. Otherwise, a randomization- based inference can be a good alternative for non-ARP procedures.
Keywords: optimal designs, optimal adaptive designs, randomization in clinical trials, restricted randomization, adaptive randomization, unequal cost, allocation ratio preserving randomization procedures, heterogeneous costs, multi-arm clinical trials, randomization-based inference, unequal allocation
Yevgen Ryeznik, Department of Mathematics, Box 480, Uppsala University, SE-75106 Uppsala, Sweden.
© Yevgen Ryeznik 2019
ISSN 1401-2049 ISBN 978-91-506-2748-0 urn:nbn:se:uu:diva-377552 (http://urn.kb.se/resolve?urn=urn:nbn:se:uu:diva-377552) 'HGLFDWHG WR P\ IDPLO\ DQG P\ WHDFKHUV
/LVW RI SDSHUV
7KLV WKHVLV LV EDVHG RQ WKH IROORZLQJ SDSHUV ZKLFK DUH UHIHUUHG WR LQ WKH WH[W E\ WKHLU 5RPDQ QXPHUDOV
, ,, ,,, ,9 2OHNVDQGU 6YHUGORY DQG 5HSULQWV ZHUH PDGH ZLWK SHUPLVVLRQ IURP WKH SXEOLVKHUV 7KH IROORZLQJ SDSHUV KDYH DOVR EHHQ SXEOLVKHG GXULQJ WKH 3K' VWXG\ SHULRG EXW DUH QRW LQFOXGHG LQ WKH WKHVLV 2OHNVDQGU 6YHUGORY &RQWHQWV ,QWURGXFWLRQ &OLQLFDO 7ULDOV LQ 'UXJ 'HYHORSPHQW 2SWLPDO 'HVLJQV 6WDWLVWLFDO %DFNJURXQG 'HVLJQLQJ D 'RVH5HVSRQVH 7ULDO ZLWK 7LPHWR(YHQW 2XWFRPHV 'HVLJQLQJ D 0XOWLDUP &RPSDUDWLYH 7ULDO ZLWK +HWHURJHQHRXV 7UHDWPHQW &RVWV $GDSWLYH 'HVLJQV 5DQGRPL]DWLRQ 6WDWLVWLFDO ,QIHUHQFH 3DUDPHWHU (VWLPDWLRQ IRU D 'RVH)LQGLQJ 6WXG\ 3RSXODWLRQ DQG 5DQGRPL]DWLRQEDVHG 7HVWV 6XPPDU\ RI WKH 5HVXOWV 5HVXOWV RI WKH 7KHVLV 3DSHU , 3DSHU ,, 3DSHU ,,, 3DSHU ,9 )XWXWUH :RUN ([WHQVLRQV WR JOREDO RSWLPDO DGDSWLYH GHVLJQV &RPSDULVRQ RI WKH ORFDOO\ 'RSWLPDO GHVLJQ DQG JOREDO '2SWLPDO GHVLJQ ,QFRUSRUDWLQJ FRYDULDWHV ([WHQVLRQV WR PL[HG HIIHFWV DQG H[SRVXUHUHVSRQVH PRGHOV 6WDWLVWLFDO ,QIHUHQFH 6DPPDQIDWWQLQJ Sn 6YHQVND $FNQRZOHGJHPHQWV 5HIHUHQFHV ,QWURGXFWLRQ ,Q WKLV 3K' WKHVLV ZH FRQVLGHU VHYHUDO VWUDWHJLHV WR RSWLPL]H WKH GHVLJQ RI FOLQLFDO WULDOV ZLWK GRVHILQGLQJ REMHFWLYHV 7KH RSWLPL]DWLRQ RI D WULDO GHVLJQ PHDQV WKDW DQ H[SHULPHQWHU FDQ DFKLHYH KLJKHU TXDOLW\ UHVXOWV HJ PRUH DFFX UDWH HVWLPDWHV RI WKH SDUDPHWHUV RI LQWHUHVW IRU D JLYHQ VDPSOH VL]H RU UHGXFH WKH VDPSOH VL]H WR UHDFK WKH WDUJHWHG OHYHO RI REMHFWLYHV¶ TXDOLW\ :H GHYHORS VRPH QRYHO VWDWLVWLFDO GHVLJQV WKDW IDFLOLWDWH HIILFLHQW OHDUQLQJ IURP DFFXPXODWLQJ GDWD LQ WKH WULDO DQG SHUIRUP DGDSWLYH DOORFDWLRQ RI VWXG\ VXEMHFWV WR WUHDWPHQW JURXSV GRVH OHYHOV WR PD[LPL]H WKH DPRXQW RI LQIRUPD WLRQ WKDW FDQ EH REWDLQHG XQGHU PRGHO XQFHUWDLQW\ :H VKRZ WKURXJK H[WHQVLYH VLPXODWLRQV WKDW RXU RSWLPDO DGDSWLYH GHVLJQV FDQ EH PRUH HIILFLHQW WKDQ PRUH FRQYHQWLRQDO IL[HG DOORFDWLRQ GHVLJQV :H DOVR LQYHVWLJDWH LPSOHPHQWDWLRQ LV VXHV RI RSWLPDO GHVLJQV WKURXJK LQFRUSRUDWLRQ RI DGDSWLYH UDQGRPL]DWLRQ 7KH XVH RI UDQGRPL]DWLRQ LV DQ LPSRUWDQW SUDFWLFDO DVSHFW DV UDQGRPL]DWLRQ KHOSV SURWHFW WKH VWXG\ IURP YDULRXV H[SHULPHQWDO ELDVHV DQG HQVXUH WKDW WULDO UHVXOWV DUH VWDWLVWLFDOO\ ULJRURXV )LQDOO\ ZH LQYHVWLJDWH VWDWLVWLFDO DQDO\VLV LVVXHV IRO ORZLQJ WKH SURSRVHG DGDSWLYH GHVLJQV :H FRQFOXGH WKDW RSWLPL]DWLRQ RI D WULDO GHVLJQ WKH FKRLFH RI D UDQGRPL]DWLRQ SURFHGXUH WR LPSOHPHQW WKH RSWLPDO GH VLJQ DQG WKH FKRLFH RI SURSHU VWDWLVWLFDO PHWKRGRORJLHV WR DQDO\]H WKH GDWD DUH DOO YHU\ LPSRUWDQW FRPSRQHQWV WR DFKLHYH YDOLG DQG UREXVW FOLQLFDO WULDO UHVXOWV ,Q VHFWLRQ ZH GHVFULEH FOLQLFDO WULDOV LQ WKH GUXJ GHYHORSPHQW SURFHVV ZLWK SDUWLFXODU DWWHQWLRQ WR GRVHUHVSRQVH WULDOV DQG JLYH D PRWLYDWLRQ IRU WKH FXUUHQW UHVHDUFK 6HFWLRQ SURYLGHV VWDWLVWLFDO EDFNJURXQG RQ RSWLPDO GH VLJQV IRU GRVHUHVSRQVH VWXGLHV ZLWK WLPHWRHYHQW RXWFRPHV DQG RSWLPDO GH VLJQ IRU FRPSDUDWLYH VWXG\ ZLWK XQHTXDO WUHDWPHQW FRVW 6HFWLRQ GHVFULEHV WKH FRQFHSW RI DGDSWLYH PXOWLVWDJH GHVLJQ 6HFWLRQ GHDOV ZLWK WKH UDQ GRPL]DWLRQ WHFKQLTXH DQG KRZ LW FDQ EH XVHG WR LPSOHPHQW RSWLPDO GHVLJQV LQ SUDFWLFH 6HFWLRQ GHVFULEHV VRPH PHWKRGV RI VWDWLVWLFDO DQDO\VLV RI GDWD IROORZLQJ DGDSWLYH GHVLJQV )LQDOO\ VHFWLRQ JLYHV D KLJK OHYHO RYHUYLHZ RI WKH IRUWKFRPLQJ UHVXOWV WKDW DUH GHVFULEHG LQ GHWDLO LQ &KDSWHU &OLQLFDO 7ULDOV LQ 'UXJ 'HYHORSPHQW %\ WKH WHUP FOLQLFDO WULDO ZH DVVXPH D UHVHDUFK VWXG\ FRQGXFWHG WR DVVHVV WKH XWLOLW\ HJ VDIHW\ WROHUDELOLW\ HIILFDF\ ULVNEHQHILW UDWLR RI DQ LQWHUYHQWLRQ HJ GUXJV ELRORJLFV PHGLFDO GHYLFHV VFUHHQLQJ PHWKRGV QRYHO VXUJLFDO SUR FHGXUHV QRYHO WKHUDSLHV HWF LQ YROXQWHHUV KHDOWK\ VXEMHFWV RU SDWLHQWV ZLWK WKH GLVHDVH RI LQWHUHVW >@ ,Q WKH FRQWHPSRUDU\ ZRUOG FRQWLQXRXV GHYHORSPHQWV LQ ELRWHFKQRORJ\ JH QRPLFV DQG PHGLFLQH OHDG WR VLJQLILFDQW GLVFRYHULHV WKDW FDQ SRWHQWLDOO\ EH FRPH WUHDWPHQWV IRU KLJK XQPHW PHGLFDO QHHGV VXFK DV FDQFHU $O]KHLPHU¶V GLVHDVH +,9$,'6 HWF 7KH GHYHORSPHQW RI D QHZ GUXJ LV D ORQJ DQG FRP SOH[ SURFHVV WKDW FDQ WDNH \HDUV DQG HYHQ GHFDGHV 0RVW FRPPRQO\ GUXJ GH YHORSPHQW LV FDUULHG RXW E\ SKDUPDFHXWLFDO RU ELRWHFKQRORJ\ FRPSDQLHV DQG WKLV SURFHVV LV VSOLW LQWR VHYHUDO VWDJHV >@ 7KH SURFHVV VWDUWV ZLWK GUXJ GLV FRYHU\ DQG SUHFOLQLFDO GUXJ GHYHORSPHQW ZKLFK LQYROYHV LGHQWLILFDWLRQ RI WKH ULJKW ELRORJLFDO WDUJHW V OLQNHG WR WKH GLVHDVH RI LQWHUHVW LGHQWLILFDWLRQ RI WKH FDQGLGDWH FRPSRXQG WKDW PRGXODWHV DFWLYLW\ RI WKH WDUJHW V DQG WHVWLQJ VDIHW\ SKDUPDFRNLQHWLFV DQG SKDUPDFRG\QDPLFV RI WKH FRPSRXQG LQ DQLPDO VWXGLHV ,I WKH GUXJ LV IRXQG WR EH DFFHSWDEO\ VDIH DQG EHQHILFLDO LQ DQLPDOV WKH QH[W VWHS LV WR WDNH LW LQWR FOLQLFDO GHYHORSPHQW VWXGLHV LQ KXPDQV 7KH FOLQLFDO GUXJ GHYHORSPHQW LV W\SLFDOO\ VSOLW LQWR SKDVHV YLVXDOL]HGLQ )LJ )LJXUH &OLQLFDO WULDO SKDVHV 3KDVH , WULDOV ´ILUVWLQKXPDQ´ XVXDOO\ LQYROYHV DURXQG VXEMHFWV SULPDU\ KHDOWK\ YROXQWHHUV 7KH JRDO RI WKLV VWXG\ LV WR H[SORUH GUXJ¶V VDIHW\ WROHUDELOLW\ DQG SKDUPDFRNLQHWLFV 3. RI WKH FRPSRXQG DQG WR LGHQ WLI\ D PD[LPXP WROHUDWHG GRVH 07' LH WKH GRVH DW ZKLFK VLGH HIIHFWV EH FRPH WRR VHYHUH WR[LFLW\ DV ZHOO DV WKH UDQJH RI GRVHV VXLWDEOH IRU IXUWKHU LQ YHVWLJDWLRQ 6RPH GUXJV HJ FDQFHU WKHUDSHXWLFV PD\ EH WRR WR[LF WR MXVWLI\ WKHLU WHVWLQJ LQ KHDOWK\ YROXQWHHUV 7KHUHIRUH IRU HWKLFDO UHDVRQV PDQ\ SKDVH , FDQFHU WULDOV DUH FRQGXFWHG LQ ODWHVWDJH FDQFHU SDWLHQWV ZKR KDYH IDLOHG VWDQGDUG WKHUDS\ RSWLRQV ,Q DGGLWLRQ WR VDIHW\ WROHUDELOLW\ DQG 3. SKDVH , WULDOV DOVR DVVHVV HDUO\ VLJQDOV RI HIILFDF\ ³WDUJHW HQJDJHPHQW´ 3KDUPD FRNLQHWLF3KDUPDFRG\QDPLF 3.3' PRGHOLQJ LV SHUIRUPHG WR VWXG\ FRUUH ODWLRQ EHWZHHQ FRQFHQWUDWLRQV RI WKH GUXJ LQ WKH ERG\ DQG FKDQJHV LQ UHOHYDQW ELRPDUNHU SDUDPHWHUV $W WKH HQG RI 3KDVH , LI WKH UHVXOWV DUH HQFRXUDJLQJ D GHFLVLRQ LV PDGH WR FRQWLQXH GHYHORSPHQW LQ 3KDVH ,, 3KDVH ,, FDQ EH FDWHJRUL]HG LQWR SDUWV 3KDVH ,,D ³SURRIRIFRQFHSW´ DQG 3KDVH ,,E ³GRVH UDQJLQJ´ ,Q 3KDVH ,,D VWXGLHV WKH SULPDU\ REMHFWLYH LV WR GHPRQVWUDWH FOLQLFDO SURRIRIFRQFHSW 3R& E\ VKRZLQJ WKDW WKH FDQGLGDWH GUXJ H[KLELWV SURPLVLQJ WKHUDSHXWLF HIIHFW LQ WKH WDUJHW SRSXODWLRQ RI SDWLHQWV $ W\SLFDO 3KDVH ,,D 3R& VWXG\ LV D UDQGRPL]HG WZRDUP WULDO FRPSDULQJ WKH HIIHFWV RI WKH GUXJ¶V 07' YHUVXV SODFHER RU DFWLYH FRQWURO ZLWK UHVSHFW WR VRPH HDUO\ HIILFDF\ RXWFRPH >@ ,Q 3KDVH ,,E VWXGLHV WKH JRDOV DUH WR FKDUDFWHUL]H WKH WKHUDSHXWLF GRVH UDQJH E\ HVWLPDWLQJ GRVHUHVSRQVH SURILOH DQG WR LGHQWLI\ D GRVH RU GRVHV WR EH WHVWHG LQ VXEVHTXHQW FRQILUPDWRU\ 3KDVH ,,, WULDOV >@ 3KDVH ,,, FOLQLFDO WULDOV DOVR UHIHUUHG WR DV FRQILUPDWRU\ WULDOV DUH GHVLJQHG WR FRPSDUH ³PRVW SURPLVVLQJ´ GRVH UHJLPHQ V IRXQG LQ 3KDVH ,,E YHUVXV VWDQGDUGRIFDUH 6WDQGDUGRIFDUH LV HLWKHU D WUHDWPHQW WKDW LV DFFHSWHG E\ PHGLFDO H[SHUWV DV D SURSHU WUHDWPHQW IRU D FHUWDLQ W\SH RI GLVHDVH RU D SODFHER RU ERWK ,Q FRQWUDVW WR 3KDVH , DQG 3KDVH ,, WKH 3KDVH ,,, WULDOV XVXDOO\ LQYROYH PDQ\ PRUH SDWLHQWV ZLWK D GLVHDVH RI LQWHUHVW 7\SLFDOO\ KHDOWK DX WKRULWLHV >86 )RRG DQG 'UXJ $GPLQLVWUDWLRQ )'$ (XURSHDQ 0HGLFLQHV $JHQF\ (0$ @ UHTXLUH HYLGHQFH IURP WZR VHSDUDWH 3KDVH ,,, FOLQLFDO WUL DOV GHPRQVWUDWLQJ WKDW WKH GUXJ LV FOLQLFDOO\ HIILFDFLRXV DQG VKRZV IDYRUDEOH ULVN EHQHILW SURSHUWLHV )ROORZLQJ VXFFHVVIXO SKDVH ,,, WULDOV UHJXODWRU\ GRF XPHQWV VXPPDUL]LQJ DOO DYDLODEOH SUHFOLQLFDO DQG FOLQLFDO GDWD DUH VXEPLWWHG WR WKH KHDOWK DXWKRULWLHV LQ UHTXHVW IRU PDUNHWLQJ DXWKRUL]DWLRQ 3KDVH ,9 WULDOV DUH SHUIRUPHG DIWHU WKH QHZ GUXJ UHFHLYHV UHJXODWRU\ DSSURYDO DQG LV PDUNHWHG 7KH JRDO RI WKHVH VWXGLHV LV WR ILQG RXW PRUH DERXW ORQJWHUP VDIHW\ DQG VLGH HIIHFWV RI WKH GUXJ 7KH GUXJ LV WHVWHG LQ VHYHUDO KXQGUHGV RU WKRXVDQGV RI SDWLHQWV 7KLV LV EHFDXVH VRPH UDUH DGYHUVH HYHQWV PD\ RQO\ EH IRXQG LQ ODUJH JURXSV RI SHRSOH ,QYHVWLJDWRUV PD\ DOVR ZDQW WR OHDUQ PRUH DERXW KRZ ZHOO WKH GUXJ ZRUNV ZKHQ LW LV XVHG PRUH ZLGHO\ DQG LQ FRPEL QDWLRQ ZLWK RWKHU WUHDWPHQWV $OVR IRU VSHFLIDO SRSXODWLRQ LQYHVWLJDWLRQV OLNH SHGLDWULFV 7KH PHWKRGRORJLHV GHYHORSHG LQ WKH FXUUHQW UHVHDUFK DUH PDLQO\ DSSOLFDEOH IRU 3KDVH ,,E GRVH UDQJLQJ WULDOV ZKLFK DUH UDQGRPL]HG SDUDOOHO JURXS PXOWL DUP GHVLJQV 5DQGRPL]HG PHDQV WKDW D VHTXHQFH RI WUHDWPHQW DVVLJQPHQWV LV JHQHUDWHG XVLQJ VRPH NQRZQ UDQGRP PHFKDQLVP 7KH LPSRUWDQFH RI UDQGRPL]DWLRQ LQ FOLQLFDO WULDOV LV ZHOOGRFXPHQWHG >@ 5DQGRPL]DWLRQ KHOSV PLWLJDWH H[SHU LPHQWDO ELDVHV HQVXUHV ³FRPSDUDELOLW\´ RI WUHDWPHQW JURXSV ZLWK UHVSHFWWR LPSRUWDQW FRYDULDWHV DQG IRUPV WKH EDVLV IRU VWDWLVWLFDO LQIHUHQFH 3DUDOOHO JURXS PHDQV WKDW HDFK VXEMHFW LQ WKH VWXG\ LV UDQGRPL]HG WR RQO\ RQH WUHDWPHQW JURXS VXFK DV SODFHER FRQWURO RU RQH RI WKH JLYHQ GRVH OHYHOV 0XOWLDUP PHDQV WKDW WKHUH DUH K ≥ 2 WUHDWPHQW DUPV LQ WKH VWXG\ )RU H[DPSOH D DUP WULDO FDQ LQFOXGH ]HUR GRVH d0 =0 ORZ GRVH d1 DQG KLJK GRVH d2 :H FRQVLGHU RSWLPL]DWLRQ RI WKH WULDO GHVLJQ LQ WZR GLIIHUHQW FRQWH[WV ,Q D GRVHUHVSRQVH WULDO ZLWK FHQVRUHG WLPHWRHYHQW RXWFRPHV ZKHUH WKH JRDO LV WR ILQG RSWLPDO GRVH OHYHOV DQG FRUUHVSRQGLQJ DOORFDWLRQ SURSRUWLRQV WR PD[LPL]H HVWLPDWLRQ DFFXUDF\ RI WKH XQGHUO\LQJ GRVH UHVSRQVH UHODWLRQVKLS ,Q D PXOWLDUP WULDO ZLWK FRQWLQXRXV QRUPDO RXWFRPHV FRPSDULQJ WKH HIIHFWV RI H[SHULPHQWDO WUHDWPHQWV YV FRQWURO ZKHQ WKH WUHDWPHQW FRVWV DUH YDULDEOH DFURVV WKH WUHDWPHQW DUPV ,Q WKH QH[W VHFWLRQV ZH JLYH VWDWLVWLFDO EDFNJURXQG WR WKHVH SUREOHPV DQG GLVFXVV RSWLPDO DQG DGDSWLYH GHVLJQV 2SWLPDO 'HVLJQV 6WDWLVWLFDO %DFNJURXQG 5HJUHVVLRQ 0RGHO &RQVLGHU WKH SUREOHP RI GHVLJQLQJ D FOLQLFDO WULDO ZLWK D FRQWLQXRXV UHVSRQVH YDULDEOH Y PRGHOOHG DV Y = f(x) β + ε, ZKHUH f(x)=(f1(x),...,fp(x)) DUH JLYHQ UHJUHVVLRQ IXQFWLRQV DQG β = (β1,...,βp) LV D YHFWRU RI UHJUHVVLRQ FRHIILFLHQWV 7KH YDULDEOH x LV FRQWUROOHG E\ DQ H[SHULPHQWHU DQG LW EHORQJV WR VRPH FRPSDFW VHW ³GHVLJQ VSDFH´ X LH x ∈X 7KH UDQGRP HUURU WHUP ε LV DVVXPHG WR IROORZ VRPH FRQWLQXRXV GLVWULEXWLRQ ZLWK DQRWKHU FRPPRQ DVVXPSWLRQ WKDW E (ε)=0DQG Var(ε)= σ2(x) X LV HLWKHU D FORVHG LQWHUYDO ZKLFK FRUUHVSRQGV WR D FRQWLQXXP RI GRVH OHY HOV RU D GLVFUHWH VHW ZKLFK UHSUHVHQWV K ≥ 2 GLVWLQFW WUHDWPHQW JURXSV ,Q PRUH JHQHUDO VHWWLQJV X PD\ KDYH PRUH FRPSOH[ VWUXFWXUH HJ LQ SKDUPD FRNLQHWLFV 3. VWXGLHV LW FDQ EH D K\SHUFXEH ZKLFK HOHPHQWV DUH YHFWRU RI 3. VDPSOLQJ WLPH SRLQWV ([SHULPHQWDO 'HVLJQ )RU D WULDO RI VL]H n OHW x1,...,xK EH D VHW RI GLVWLQFW SRLQWV LQ X ni GHQRWH WKH QXPEHU RI REVHUYDWLRQV WR EH WDNHQ DW xi DQG ρi = ni/n GHQRWH WKH FRUUH VSRQGLQJ DOORFDWLRQ SURSRUWLRQ DW xi i =1,...,K$KSRLQW H[SHULPHQWDO GHVLJQ LV GHWHUPLQHG DV D GLVFUHWH SUREDELOLW\ PHDVXUH >@ x1 ... xK ξ = . ρ1 ... ρK K 2EYLRXVO\ WKDW 0 ≤ ρi ≤ 1 ∀i DQG i=1 ρi =1 )RU H[DPSOH D SRLQW XQLIRUP DOORFDWLRQ GHVLJQ = x1 x2 x3 ξU 1/3 1/3 1/3 DVVLJQV HTXDO SUREDELOLW\ PDVV WR HDFK RI WKH SRLQWV x1,x2,x3 DQG IRU D WULDO RI VL]H n RQH KDV n/3 LQGLYLGXDOV DW HDFK RI WKHVH GHVLJQ SRLQWV 2SWLPL]DWLRQ RI D WULDO GHVLJQ FDQ KHOS PD[LPL]H WKH DPRXQW RI LQIRUPDWLRQ IURP DQ H[SHULPHQW JLYHQ VWXG\ REMHFWLYHV )LVKHU ,QIRUPDWLRQ 0DWUL[ 7KH NH\ REMHFW LQ RSWLPDO GHVLJQ WKHRU\ LV WKH )LVKHU LQIRUPDWLRQ PDWUL[ ),0 )RU PRGHO DQG D KSRLQW GHVLJQ ξ WKH ),0 LV D pVTXDUH ZKLFK FDQ EH ZULWWHQ DV K ( )= ( ) M ξ,β n ρiM xi β , i=1 ( )= ( ) ( ) / 2( ) ZKHUH M xi β f xi f xi σ xi GHQRWHV WKH LQIRUPDWLRQ PDWUL[ IRU β DW GHVLJQ SRLQW xi ∈X i =1,...,K >@ 7KH ),0 M (ξ,β) PHDVXUHV WKH DPRXQW RI LQIRUPDWLRQ IRU β WKDW FDQ EH REWDLQHG ZLWK D JLYHQ H[SHULPHQWDO −1 GHVLJQ ξ DQG VDPSOH VL]H n M (ξ,β) SURYLGHV DQ DV\PSWRWLF ORZHU ERXQG IRU WKH YDULDQFH RI DQ XQELDVHG HVWLPDWRU RI β 2SWLPDO 'HVLJQ 3UREOHP $Q RSWLPDO GHVLJQ SUREOHP PHDQV ILQGLQJ D GHVLJQ ξ∗ ZKLFK PD[LPL]HV VRPH FRQFDYH IXQFWLRQ RI M (ξ,β) RU HTXLYDOHQWO\ PLQLPL]HV VRPH FRQYH[ IXQF −1 WLRQ RI M (ξ,β) ,Q JHQHUDO LI WKH GHVLJQ VSDFH LV D FRQWLQXXP VD\ RQ WKH LQWHUYDO [0, 1] WKH VHDUFK RI DQ RSWLPDO GHVLJQ ZLOO LQYROYH GHWHUPLQDWLRQ RI WKH QXPEHU RI ∗ ∗ RSWLPDO GHVLJQ SRLQWV K WKH ORFDWLRQ RI WKHVH SRLQWV LQ WKH LQWHUYDO xi i = 1 ∗ ∗ 0 ∗ 1 ,...,K DQG WKH DOORFDWLRQ SURSRUWLRQV DW WKHVH SRLQWV ρi <ρi < DQG K∗ ∗ i=1 ρi =1 ,I WKH GHVLJQ VSDFH LV GLVFUHWH HJ K JLYHQ WUHDWPHQW JURXSV WKH RSWLPL]DWLRQ SUREOHP LV PXFK VLPSOHU ± LW LQYROYHV RQO\ GHWHUPLQDWLRQ RI WKH RSWLPDO DOORFDWLRQ SURSRUWLRQV ∗ $ FRPPRQ RSWLPDO GHVLJQ SUREOHP LV WR ILQG WKH 'RSWLPDO GHVLJQ ξD PLQ LPL]LQJ WKH FULWHULRQ − ORJ GHWM(ξ,β) >@ ∗ ξD = DUJ PLQ {− ORJ GHWM(ξ,β)} . ξ 6XFK D GHVLJQ PLQLPL]HV WKH YROXPH RI WKH FRQILGHQFH HOOLSVRLG IRU β ZKLFK OHDGV WR WKH PRVW DFFXUDWH HVWLPDWLRQ RI WKH GRVHUHVSRQVH UHODWLRQVKLS ,Q SUDFWLFH WKH *HQHUDO (TXLYDOHQFH 7KHRUHP *(7 LV XVHG WR YHULI\ 'RSWLPDOLW\ RI WKH GHVLJQ 7KH *(7 DVVHUWV HTXLYDOHQFH RI WKH IROORZLQJ WKUHH FRQGLWLRQV >@ ∗ 7KH GHVLJQ ξD PLQLPL]HV − ORJ GHWM (ξ,β) ∗ −1 7KH GHVLJQ ξD PLQLPL]HV PD[ WUDFH M (ξ,β) M x (β) − p x∈X )RU DOO x ∈X WKH GHULYDWLYH IXQFWLRQ −1 d(x, ξ, β)=WUDFH M (ξ,β) M x (β) − p ≤ 0, ∗ ZLWK HTXDOLW\ KROGLQJ DW HDFK VXSSRUW SRLQW RI ξD 7KHUHIRUH IRU D JLYHQ GHVLJQ ξ ZH FDQ FKHFN LWV RSWLPDOLW\ E\ SORWWLQJ WKH GHULYDWLYH IXQFWLRQ d(x, ξ, β) GHILQHG LQ FRQGLWLRQ ,I d(x, ξ, β) ≤ 0 DQG LW DWWDLQV WKH YDOXH RI DW WKH SRLQWV RI ξ WKHQ ZH FDQ FRQFOXGH WKDW GHVLJQ ξ LV 'RSWLPDO +RZHYHU LQ SUDFWLFH WKH PRGHO PD\ EH TXLWH FRPSOH[ DQG WKH VWUXFWXUH RI WKH 'RSWLPDO GHVLJQ PD\ QRW EH LQ FORVHG IRUP 7KH RSWLPDO VROXWLRQ FDQ EH IRXQG QXPHULFDOO\ XVLQJ IRU LQVWDQFH D ILUVWRUGHU H[FKDQJH DOJRULWKP > @ ZKLFK LV DQ LWHUDWLYH SURFHGXUH WKDW VWDUWV IURP VRPH LQLWLDO GHVLJQ DQG DW HDFK LWHUDWLRQ VWHS DLPV WR ³LPSURYH´ WKH GHVLJQ ZLWK UHVSHFW WR VHOHFWHG RSWLPDOLW\ FULWHULRQ HJ 'RSWLPDOLW\ ,W LV DOVR LPSRUWDQW WR PHQWLRQ WKDW WKH 'RSWLPDO GHVLJQ PD\ EH D IXQFWLRQ RI WKH WUXH PRGHO SDUDPHWHUV β LH ORFDOO\ 'RSWLPDO DQG FDQQRW EH LPSOH PHQWHG GLUHFWO\ 7R RYHUFRPH WKLV OLPLWDWLRQ RQH FDQ XVH DGDSWLYH 'RSWLPDO GHVLJQV ZKLFK ZH ZLOO GLVFXVV ODWHU LQ 6HFWLRQ 'HIILFLHQF\ ∗ 2QFH WKH 'RSWLPDO GHVLJQ ξD LV IRXQG LW FDQ EH XVHG DV D EHQFKPDUN IRU FRPSDULQJ PHULWV RI RWKHU GHVLJQV 7KH 'HIILFLHQF\ RI D GHVLJQ ξ UHODWLYH WR ∗ WKH 'RSWLPDO GHVLJQ ξD LV GHILQHG DV IROORZV