GPU-friendly EBCOT variant with single-pass scan order and raw bit plane coding

*38)5,(1'/<(%&279$5,$17:,7+6,1*/(3$666&$125'(5$1'5$:%,7 3/$1(&2',1*  9RONHU%UXQV0LJXHOÈ0DUWtQH]GHO$PRU+HLNR6SDUHQEHUJ  )UDXQKRIHU,QVWLWXWHIRU,QWHJUDWHG&LUFXLWV(UODQJHQ*HUPDQ\  $%675$&7  $ PDMRU GUDZEDFN RI -3(*  LV WKH FRPSXWDWLRQDO FRPSOH[LW\ RI LWV HQWURS\ FRGHU QDPHG (PEHGGHG %ORFN &RGHU ZLWK 2SWLPL]HG 7UXQFDWLRQ (%&27 7KLV SDSHU SURSRVHVWZRDOWHUDWLRQVWRWKHRULJLQDODOJRULWKPWKDWVHHN WR LPSURYH WKH WUDGHRII EHWZHHQ FRPSUHVVLRQ HIILFLHQF\ DQGWKURXJKSXW)LUVWO\PDJQLWXGHELWVZLWKLQDELWSODQHDUH QRW SULRULWL]HG E\ WKHLU VLJQLILFDQFH DQ\PRUH EXW LQVWHDG FRGHGLQDVLQJOHSDVVLQVWHDGRIWKUHHUHGXFLQJWKHDPRXQW RI H[SHQVLYH PHPRU\ DFFHVVHV DW WKH FRVW RI IHZHU WUXQFDWLRQ SRLQWV 6HFRQGO\ ORZ ELW SODQHV FDQ HQWLUHO\ E\SDVV WKH DULWKPHWLF FRGHU DQG WKXV GR QRW UHTXLUH DQ\ FRQWH[WPRGHOOLQJ %RWK WKH HQFRGHU DQG GHFRGHU FDQ SURFHVVVXFKELWSODQHVLQDVDPSOHSDUDOOHOIDVKLRQ ([SHULPHQWVVKRZDYHUDJHVSHHGXSVRI[[IRU WKHHQFRGHUDQG[[IRUWKHGHFRGHUZKHQEHJLQQLQJ UDZFRGLQJDIWHUWKHIRXUWKWKLUGELWSODQHZKLOHWKHGDWD UDWHLQFUHDVHVRQO\E\[[  ,QGH[7HUPV²-3(**3*38(%&27  ,1752'8&7,21  $ SRSXODU ILHOG RI XVH IRU -3(*  >@ LV LQ YLGHR SRVWSURGXFWLRQ ZKHUH LW ZDV FKRVHQ E\ WKH 6RFLHW\ RI 0RWLRQ 3LFWXUH 7HFKQRORJ\ ([SHUWV 6037( WR EH HPSOR\HG LQ ERWK WKH 'LJLWDO &LQHPD 3DFNDJH'&3 IRUPDW>@DQGPRUHUHFHQWO\ LQWKH,QWHURSHUDEOH0DVWHU )RUPDW,0)>@7KHDXWKRUVKDYHGHYHORSHGDQHQFRGHU DQG GHFRGHU WKDW UXQ RQ D *38 XVLQJ 19,',$V &8'$ WHFKQRORJ\7KHPDMRULW\RIWKHWLPHLVVSHQWLQ(%&27V FRQWH[W PRGHOOLQJ DQG DULWKPHWLF FRGLQJ URXWLQHV )RU '&3V D PD[LPXP GDWDUDWH RI  0ELWV LV GHILQHG IRU ,0)SDFNDJHVLWFDQEHDVKLJKDV0ELWV,Q>@LWZDV VKRZQ WKDW DW KLJK GDWD UDWHV WKH (%&27 FRPSUHVVLRQ HIILFLHQF\ LV SRRU IRU WKH ORZHU ELW SODQHV WKDW FRQWDLQ PDLQO\QRLVH$KLJKWKURXJKSXWYDULDQWRI(%&27WKDWFDQ EH XVHG GXULQJ SRVW SURGXFWLRQ DQG SHUPLWV GRZQVWUHDP ORVVOHVV FRQYHUVLRQ WR '&, RU ,0) SURILOHV ZRXOG EH YHU\ EHQHILFLDOWRKDYH7KHVWDQGDUGDGGUHVVHVWKHKLJKGDWDUDWH VFHQDULRE\GHILQLQJ WKH RSWLRQDO VHOHFWLYH E\SDVVLQJPRGH ZKHUH SDUW RI WKH VDPSOHV E\SDVV WKHDULWKPHWLF FRGHU DQG DUHFRGHGUDZ,WRQO\LPSRVHVDPLQRUSHQDOW\LIDQ\RQ WKHFRPSUHVVLRQHIILFLHQF\+RZHYHUWKHVSHHGXSDFKLHYHG ZLWKWKDWPRGHLQD*38LPSOHPHQWDWLRQZDVVKRZQWREH RQO\PHGLRFUH>@ 7KLV SDSHU SURSRVHV WZR QHZ PRGHV WKDW GHFUHDVH WKH FRPSOH[LW\ IXUWKHU DQG DUH HVSHFLDOO\ XVHIXO WR FRGHUV UXQQLQJ RQ PDVVLYHO\ SDUDOOHO DUFKLWHFWXUHV 7KH UHVHDUFK TXHVWLRQV WKDW DULVH DUH +RZ PXFK RI D VSHHGXS FDQ EH DFKLHYHG" :KDW LV WKH FRVW LQ WHUPV RI GLPLQLVKHG FRPSUHVVLRQHIILFLHQF\" 6HFWLRQVDQGSURYLGHWKHUHTXLUHGEDFNJURXQGDERXW (%&27 LWV ODWHVW YDULDQWV DQG FXUUHQW *38 LPSOHPHQWDWLRQV 6HFWLRQV  DQG  GLVFXVV WKH SURSRVHG VLQJOHSDVV DQG UDZ PRGHV ([SHULPHQWDO UHVXOWV DUH SUHVHQWHGLQVHFWLRQDQGVXPPDUL]HGLQVHFWLRQ  %$&.*5281'  5HYLHZRI(%&27  )ROORZLQJ WKH PXOWL FRPSRQHQW WUDQVIRUP ZDYHOHW WUDQVIRUPDQGTXDQWL]DWLRQVXEEDQGVRITXDQWL]HGZDYHOHW FRHIILFLHQWVDUHVSOLWLQWRQRQRYHUODSSLQJFRGHEORFNVWKDW DUHFRPSUHVVHGLQGHSHQGHQWO\LQWRELWVWUHDPV5DWHFRQWURO LVFDUULHGRXWE\VXEVHTXHQWO\WUXQFDWLQJWKHVHHPEHGGHGELW VWUHDPV LQ RUGHU WR PHHW D JOREDO PD[LPXP GDWD UDWH FRQVWUDLQW $ VLQJOH ELW VWUHDP LV IRUPHG E\ IHHGLQJ WKH PDJQLWXGH DQG VLJQELWV RI HDFK VDPSOH LQWR D FRQWH[W DGDSWLYH ELQDU\ DULWKPHWLF FRGHU 04FRGHU7KHVFDQ RUGHU JRHV ILUVW E\ ELW SODQH VWDUWLQJ IURP WKH PRVW VLJQLILFDQWPDJQLWXGHELWSODQHWKDWGRHVQRWFRQVLVWHQWLUHO\ RI]HURELWV DQGWKHQ E\ VWULSHZKHUHHDFK VWULSH FRQWDLQV IRXUURZV$WDQ\JLYHQELWSODQHWKHJRDOLVWRFRGHVDPSOHV WKDW DUH OLNHO\ WR WXUQ VLJQLILFDQW EHIRUH ELWV WKDW PHUHO\ UHILQHDQDOUHDG\QRQ]HURPDJQLWXGH7KLVLVDFKLHYHGE\ VFDQQLQJ HDFK ELW SODQH LQ WKUHH SDVVHV 7KH VLJQLILFDQFH SURSDJDWLRQSDVV633FRGHVDOOWKRVHVDPSOHVWKDWDUHVWLOO ]HURWRWKHGHFRGHU¶V NQRZOHGJH EXWDUHSUHGLFWHG WR WXUQ VLJQLILFDQW DV LQIHUUHG IURP WKHLU [QHLJKERUKRRG 7KH PDJQLWXGH UHILQHPHQW SDVV 053 FRGHV VDPSOHV WKDW DOUHDG\WXUQHGVLJQLILFDQWLQDSUHYLRXVELWSODQH7KHFOHDQ XS SDVV &83 FRGHV DOO UHPDLQLQJ VDPSOHV $ VDPSOH¶V VLJQELWLVFRGHGLPPHGLDWHO\IROORZLQJLWVILUVWVLJQLILFDQW PDJQLWXGHELW>@      6WDWHRIWKH$UW  2WKHU YDULDQWV RI (%&27 KDYH SUHYLRXVO\ EHHQ VXJJHVWHGLQWKHOLWHUDWXUH>@SURSRVHVDQ³XOWUDIDVW´PRGH ZKHUH(%&27LVUHSODFHGZLWKDIL[HGFRGHERRN+XIIPDQ FRGHU SUHFHGHG E\ DQ RSWLRQDO SUHGLFWLRQ VWHS $ FRPSDULVRQRI&38LPSOHPHQWDWLRQVUHVXOWVLQDQDFKLHYHG VSHHGXSRI[IRUWKHHQFRGHUDQG[[IRUWKH GHFRGHU 2Q WKH GRZQ VLGH WKHUHVXOWLQJ FRGHVWUHDP LVQR ORQJHUHPEHGGHGDQGDSRVWFRPSUHVVLRQUDWHFRQWUROLVQRW SRVVLEOHDQ\PRUH (%&27 YDULDQWV HVSHFLDOO\ WDLORUHG IRU *38 DUFKLWHFWXUHV DUH GHVFULEHG LQ >@ DQG >@ >@UHSODFHV WKH 04FRGHU ZLWKD FODVVLFDODULWKPHWLF FRGHU DQG HODERUDWHV KRZWR SDUDOOHOL]HLW ,W DOVR H[DPLQHV KRZ WKHFRGHEORFN VL]HLPSDFWVWKH*38RFFXSDQF\DQGPHPRU\XWLOL]DWLRQ ,Q>@DFRGHEORFNLVVSOLWLQWRFROXPQVWKDWDUHFRGHG LQSDUDOOHOE\PXOWLSOHDULWKPHWLFFRGHUVWKDW HDFKSURGXFH IL[HGOHQJWK FRGH ZRUGV ZKLFK FDQ EH LQWHUOHDYHG LQ D GHWHUPLQLVWLF ZD\ 7R JHW DURXQG WKH SUREOHP WKDW HDFK FRGHUZRXOGKDYHWRLQLWLDOO\DGDSWLWVSUREDELOLW\HVWLPDWHV WR WKH FRQWHQW DWKDQG D VWDWLRQDU\ SUHWUDLQHG SUREDELOLW\ PRGHOLVXVHGLQVWHDG7KHFRPSUHVVLRQHIILFLHQF\KDVEHHQ HYDOXDWHG DQG LV UHSRUWHG WR EH HTXDO WR (%&27 7KURXJKSXW PHDVXUHPHQWV DUH QRW \HW DYDLODEOH EXW DUH H[SHFWHGWREHYHU\FRPSHWLWLYH  (%&27RQDSDUDOOHO$UFKLWHFWXUH  :KHQWDUJHWLQJDPDVVLYHO\SDUDOOHODUFKLWHFWXUHVXFKDV D*38WKHJRDOLVWREUHDNGRZQWKHSUREOHPDWKDQGLQWR DVPDQ\SDUDOOHOL]DEOHZRUNXQLWVDVSRVVLEOH)RUHDFK ELW SODQH DQ HQFRGHU FDQ PRGHO WKH VDPSOHV¶ FRQWH[WV LQ D VDPSOHSDUDOOHO IDVKLRQ E\ XVLQJ WKH LWHUDWLYH VLJQLILFDQFH SURSDJDWLRQDOJRULWKPSUHVHQWHGLQ>@7KHUHVXOWLQJVHWRI FRQWH[WGHFLVLRQ SDLUV LV VXEVHTXHQWO\ IHG LQWR WKH 04 FRGHU'XHWRLWVFRQWH[WDGDSWLYHQDWXUHWKLVVWHSGRHVQRW H[SRVH DQ\ LQWUDEORFN SDUDOOHOLVP 7KHUHIRUH DQ LQWHUOHDYHGWZRNHUQHOVWUXFWXUHSUHVHQWVLWVHOI)RUHDFKELW SODQHSZKHUHS LVWKH/6%WKHKRVWODXQFKHVDVDPSOH SDUDOOHOFRQWH[WPRGHOOLQJNHUQHO&0NHUQHOSIROORZHGE\ DEORFNSDUDOOHODULWKPHWLFFRGLQJNHUQHO04NHUQHOS 7KH(%&27GHFRGLQJURXWLQHGRHVQRWH[SRVHDQ\LQWUD EORFNSDUDOOHOLVPVLQFHWKHVLJQLILFDQFHSURSDJDWLRQIRUDELW SODQHFDQQRWEHSUHFRPSXWHG&RQWH[WPRGHOOLQJDQG04 GHFRGLQJDUHWLJKWO\FRXSOHGLQDIHHGEDFNORRS7KHFRQWH[W RIDQ\VDPSOH;>Q@SZKHUHQLVWKHORFDWLRQ[\ZLWK[ EORFNZLGWKDQG\EORFNKHLJKWFDQQRWEHFRPSXWHG ZLWKRXW ILUVW GHFRGLQJ VDPSOH ;>Q@S $ *38 LPSOHPHQWDWLRQFDQWKHUHIRUHFRPELQHERWKWDVNVLQDVLQJOH NHUQHODQGQHHGQRWODXQFKLWLQGLYLGXDOO\IRUHDFKELWSODQH ,QVWHDGWKHNHUQHOORRSVRYHUDOOELWSODQHVZLWKWKUHHSDVVHV HDFK 2QDPRGHUQ*38ZLWKWKRXVDQGVRIFRUHVWKHEORFN ZLVH 04NHUQHOWHQGVWRXQGHURFFXS\WKH*38GXHWRLWV FRDUVH SDUDOOHOLVP 7KLV HIIHFW ZRUVHQV DV WKH QXPEHU RI FRGHEORFNV ZLWK RXWVWDQGLQJ ELW SODQHV WR EH SURFHVVHG GHFUHDVHV ZLWK HYHU\ SURFHVVHG ELW SODQH,PSOHPHQWDWLRQV FDQ FRXQWHUDFW E\ SURFHVVLQJ EORFNV IURP D JURXSRI SLFWXUHV *23 VLPXOWDQHRXVO\ DW WKH FRVW RI DQ LQFUHDVHG ODWHQF\7KHLPSOHPHQWDWLRQDWKDQGVDWXUDWHVDWD*23VL]H RI  IRU . LPDJHV ZLWK DSSUR[LPDWHO\  EORFNV SHULPDJH  6,1*/(3$6602'(  7KH &0 DQG 04NHUQHOV DUH PHPRU\ ERXQG ZKLFK PHDQVWKDWWKHH[HFXWLRQRILQVWUXFWLRQVLVRIWHQVWDOOHGE\ SHQGLQJPHPRU\UHTXHVWV$FFRUGLQJO\WKHWKURXJKSXWFDQ EHLQFUHDVHGE\UHGXFLQJUHTXLUHGUHDGRUZULWHDFFHVVHVWR PHPRU\7KHHQFRGHU¶V&0NHUQHOFDQEHODXQFKHGZLWKD OD\RXWDVILQHO\JUDLQHGDVRQHWKUHDGSHUVDPSOH$IWHUWKH LQLWLDO LWHUDWLYH VLJQLILFDQFH SURSDJDWLRQ HDFK WKUHDG GHWHUPLQHV WKHLU VDPSOH¶V FRQWH[W E\ H[DPLQLQJ WKH QHLJKERUV 'XH WR WKH WKUHHSDVVVFDQRUGHU WKH FRQWH[W GHFLVLRQSDLUVQHHGWREHVRUWHGE\SDVVW\SHEHIRUHWKH\FDQ EHKDQGHGRYHUWRWKH04NHUQHOYLDJOREDOPHPRU\(DFK WKUHDGQHHGVWRILQGRXWDWZKLFKRIIVHWWRZULWHWKHLU633 053RU&83FRQWH[WGHFLVLRQSDLUV7KLVFDQEHDFKLHYHG FROODERUDWLYHO\E\UXQQLQJWKUHHSUHIL[VXPVFDQV>@ 7KH SURSRVHG VLQJOHSDVV PRGH UHQGHUV WKLV DGGLWLRQDO EXUGHQ XQQHFHVVDU\ E\ JLYLQJ XS WKH VHSDUDWLRQLQWR WKUHH SDVVHV DOWRJHWKHU 7KH HQFRGHU¶V &0NHUQHO WKHQ UHTXLUHV RQO\ D VLQJOH SUHIL[VXP VFDQ LQ RUGHU IRU HDFK WKUHDG WR GHWHUPLQH ZKHUH WR ZULWH WKHLU FRQWH[WGHFLVLRQ SDLUV &RQWH[WODEHOLQJLVQRWDIIHFWHGE\WKHQHZVFDQRUGHUDQG FDQUHPDLQXQFKDQJHG7KHGHFRGHUEHQHILWVDVZHOOLQWKDW LWGRHVWKHQRQO\QHHGWRVFDQWKURXJKDOOVDPSOHVRQFHSHU ELW SODQH $GGLWLRQDOO\ WKH VDPSOH VWDWH UHSUHVHQWDWLRQ LV VLPSOLILHG E\ RQH ELW DV LW LV QR ORQJHU QHFHVVDU\ WR UHPHPEHUIRULQVLJQLILFDQWVDPSOHVZKHWKHURUQRWWKH\KDG DOUHDG\ EHHQ FRGHG LQ WKH 633 LQ RUGHU WR GHWHUPLQH WKHLU PHPEHUVKLS WR WKH &83 7KH DOWHUHG FRGLQJ SURFHGXUH LV ODLGRXWLQ$OJRULWKP 7KHUH DUH WZR GRZQVLGHV WR JLYLQJ XS WKH SDVV VHSDUDWLRQ)LUVWO\WKHQXPEHURIHOLJLEOHWUXQFDWLRQSRLQWV LVGHFUHDVHGWRDWKLUGOHDYLQJWKH3RVW&RPSUHVVLRQ5DWH $OJRULWKP±VLQJOHSDVVPRGH 1.foreach bit plane 2. foreach sample in stripe-oriented scan-order 3. if (sample is not significant and 4. any neighbor is significant) 5. zeroCoding() 6. if (magnitude bit is 1) 7. markSampleAsSignificant() 8. signCoding() 9. else if (sample is significant) 10. magnitudeRefinementCoding() 11. else if (first row in stripe and 12. all stripe-column neighbors insignificant) 13. runLengthCoding() 14. jumpToEndOfRun() 15. else 16. zeroCoding() 17. if (magnitude bit is 1) 18. markSampleAsSignificant() 19. signCoding() 'LVWRUWLRQ2SWLPL]HU3&5'2SWOHVVIOH[LELOLW\ ZKHQWKH PD[LPXPGDWDUDWHFRQVWUDLQWLVH[FHHGHG,WFDQEHDUJXHG WKDWWKLVOLPLWDWLRQLVQRWVHYHUHZKHQFRPSUHVVLQJWRKLJK GDWDUDWHVDVLVWKHFDVHLQWKHXVHFDVHH[DPLQHGLQWKLV SDSHU 5HVHDUFK KDV VKRZQ WKDW WKH FRGLQJ SHUIRUPDQFH DFKLHYHG E\ YDULRXV VFDQQLQJ RUGHU VWUDWHJLHV LV YLUWXDOO\ LGHQWLFDODWWKHHQGRIHDFKELWSODQH>@ 6HFRQGO\ WKH QHLJKERUKRRG WDNHQ LQWR FRQVLGHUDWLRQ ZKHQ FRPSXWLQJ WKH FRQWH[W IRU DQ\ RI WKH IRXU W\SHV RI FRGLQJRSHUDWLRQQHHGVWREHFRQVWUDLQHGWRWKHVFDQRUGHU SDVW :KHUHDV LQ WKH RULJLQDO PRGH RSHUDWLRQV FDUULHG RXW GXULQJ WKH 053 RU &83 FDQ DOUHDG\ OHYHUDJH WKH LQIRUPDWLRQ ZKHWKHU RU QRW DQ\ RI WKH QHLJKERUV SDVW RU IXWXUHKDVWXUQHGVLJQLILFDQWGXULQJWKHFXUUHQW ELWSODQH¶V 633WKLVLVQRWSRVVLEOHDQ\PRUHLQWKHSURSRVHGYDULDQW 7KLVPLJKWVOLJKWO\LPSDFWWKHFRPSUHVVLRQHIILFLHQF\  5$:&2',1*02'(  3DUW RI WKH VWDQGDUG GHILQHV WKH VHOHFWLYH E\SDVVLQJ PRGH:KHQHQDEOHGDOOV\PEROVFRGHGGXULQJWKH63DQG 05SDVVHVVWDUWLQJIURPWKHILIWKFRGHGPDJQLWXGHELWSODQH DUHQRWDULWKPHWLFDOO\FRGHGDQ\PRUHEXWLQVWHDGDSSHQGHG GLUHFWO\WRWKHELWVWUHDP7KHXQGHUO\LQJDVVXPSWLRQLVWKDW WKHFRPSUHVVLRQHIILFLHQF\IRUWKHVHWZRSDVVW\SHVLVSRRU DWORZELWSODQHVZKLOHIRUWKH&83LWLVVWLOOUHDVRQDEOHWR LQYRNHWKH04FRGHU7KHELWVWUHDPLVWKHQWHUPLQDWHGDW HYHU\VZLWFKEHWZHHQWKHUDZ DQGFRGHGPRGH$SDUDOOHO LPSOHPHQWDWLRQ FDQ EHQHILW IURP WKLV PRGH E\ VHSDUDWLQJ WKH UDZ FRGLQJ SKDVHV LQWR D VHSDUDWH NHUQHO WKDW FDQ EH H[HFXWHGLQDVDPSOHSDUDOOHOIDVKLRQ>@+RZHYHUHYHQWKH SDUWLDOO\E\SDVVHGELWSODQHVVWLOOQHFHVVLWDWHWKHH[WUDWDVNV RI HYDOXDWLQJ DQG XSGDWLQJ HDFK VDPSOH¶V VWDWH LQFOXGLQJ WKHVLJQLILFDQFHSURSDJDWLRQLQRUGHUWREHDEOHWRFROOHFWDOO V\PEROVDQGRUGHUWKHPE\SDVVW\SH ,Q OLQH ZLWK WKH VLQJOHSDVV PRGH WKH SURSRVHG UDZ FRGLQJPRGHLVDOVRSURFHVVHGELWSODQHZLVHZLWKRXWDSDVV VHSDUDWLRQ,QVWHDGPDJQLWXGHELWVDUHGLUHFWO\FRQFDWHQDWHG LQWRDELWVWUHDP$EORFNZLGWKRIZKLFKLVXVHGLQ'&, DQG ,0) SURILOHV FRQYHQLHQWO\ PDWFKHV WKH 6,0' JURXS VL]H DQG UHJLVWHU VL]H IRU 19,',$ &8'$ GHYLFHV 7KH HQFRGHU FDQ FROOHFW WKH PDJQLWXGH ELWV IURP D VLQJOH URZ LQWRDELWUHJLVWHUE\XVLQJWKHZDUSEDOORWLQWULQVLFDQG WKHQZULWHLWRXWWRPHPRU\$OOURZVRIDOOEORFNVFDQEH ZULWWHQLQSDUDOOHO)RUDEORFNVL]HRI[WKHPDJQLWXGH ELWVDPRXQWWRDWRWDORIE\WHVSHUELWSODQH 6LQFHLWLVQRWJXDUDQWHHGWKDWHYHU\VDPSOHKDVDOUHDG\ WXUQHGVLJQLILFDQWE\WKHSRLQWWKHILUVWE\SDVVHGELWSODQHLV SURFHVVHGQRWDOOVLJQELWVKDYHQHFHVVDULO\EHHQFRGHG\HW :LWKWKHJRDORIPDLQWDLQLQJWKHHPEHGGHGQHVVSURSHUW\RI WKHFUHDWHGFRGHVWUHDPDVDPSOH¶VVLJQELWVKRXOGEHFRGHG LPPHGLDWHO\ IROORZLQJ LWV ILUVW VLJQLILFDQW PDJQLWXGH ELW +RZHYHUGXHWRWKHODFNRIVXEELWSODQHWUXQFDWLRQSRLQWV PDJQLWXGHDQGVLJQELWVIURPRQHELWSODQHGRQ¶WQHHGWREH LQWHUOHDYHG,QVWHDGVLJQELWVIRUQHZO\VLJQLILFDQWVDPSOHV DUH VWRUHG DIWHU WKH PDJQLWXGH ELWV 7KLV HQDEOHV D *38 LPSOHPHQWDWLRQWRH[SORLWWKDWPDJQLWXGHELWVDUHODLGRXWLQ DUHJXODUJULGDQGFDQEHDFFHVVHGLQSDUDOOHO)LJXUHVKRZV WKHUHVXOWLQJFRGHVWUHDPVWUXFWXUH 7KHSURSRVHGLPSOHPHQWDWLRQVWUDWHJ\LVWRILUVWFROOHFW WKH VLJQELWV URZZLVH E\ DJDLQ XVLQJ WKH ZDUS EDOORW LQWULQVLF $ ILUVW EDOORW FROOHFWV ZKLFK SRVLWLRQV LQ D URZ KDYH WXUQHG VLJQLILFDQWD VHFRQG EDOORW FROOHFWV WKH DFWXDO VLJQELWV 2QH WKUHDG SHU URZ WKHQ ZULWHV WKH URZV¶ QHZ VLJQELWV WLJKWO\ SDFNHG WR WKH ELW VWUHDP 6LQFH PXOWLSOH WKUHDGVPLJKWVLPXOWDQHRXVO\QHHGWRZULWHWRWKHVDPHE\WH ELWVDUHVWRUHGXVLQJDELWZLVHDWRPLFRURSHUDWLRQ>@7KH RIIVHW EH\RQG WKH HQG RI WKH PDJQLWXGH ELWV FDQ EH FRPSXWHGE\VFDQQLQJWKHSUHIL[VXPDFURVVWKHQXPEHUVRI VLJQELWVLQHDFKURZ  (;3(5,0(17$/5(68/76  )LJXUHFRPSDUHVWKH(%&27HQFRGLQJUXQWLPHRIWKH RULJLQDO WKUHHSDVV PRGH ZLWK DQG ZLWKRXW VHOHFWLYH DULWKPHWLF FRGLQJ ZLWK WKH QHZ SURSRVHG VLQJOHSDVV DQG UDZFRGLQJ PRGHV $OO H[SHULPHQWVKDYH EHHQ FDUULHG RXW RQ DQ 19,',$ *H)RUFH *7;  7KH VSHHGXS GXH VROHO\ WR WKH SURSRVHG VLQJOHSDVV PRGH LV DSSUR[LPDWHO\ [DQGFDQEHVHHQE\FRPSDULQJWKHWZR VLQJOHFRORUHG EDUV ZKHUH ELW SODQHV QHYHU E\SDVV WKH DULWKPHWLF FRGHU 7KH VWDQGDUGFRPSOLDQW E\SDVVLQJ PRGH EULQJV RQO\ OLWWOH EHQHILWIRUWKHWKURXJKSXWIRUD*38LPSOHPHQWDWLRQ7KH SURSRVHG UDZ FRGLQJ RI WKH ORZHU ELW SODQHV RQ WKH RWKHU KDQG \LHOGVDQDGGLWLRQDOVSHHGXSWKDWJURZVDVPRUH ELW SODQHVDUHE\SDVVHG   )LJXUH±VRXUFH7HDUVRI6WHHOIUDPHV[  )LJXUH(%&27HQFRGLQJVSHHGXSUHODWLYHWRRULJLQDOWKUHHSDVVPRGH ZLWKRXWE\SDVVLQJ  )LJXUH ±&RGHVWUHDPVWUXFWXUHZKHQUDZFRGLQJLVHQWHUHGDIWHUWKHQG  VLJQLILFDQWELWSODQH&RGHEORFNVL]H[ )LJXUHSUHVHQWVDQRYHUYLHZRIWKHDFKLHYHGVSHHGXSV IRU D UDQJH RI KLJKUHVROXWLRQ  ELW 5*%  LPDJH VHTXHQFHV 7KHVH VHTXHQFHV ZHUH FKRVHQ LQVWHDG RI WKH VWDQGDUG WHVW VWLOO LPDJHV VLQFH SURFHVVLQJ EORFNV IURP PXOWLSOH LPDJHV LQ SDUDOOHO LQFUHDVHV WKH WKURXJKSXW VLJQLILFDQWO\ 'XSOLFDWLQJ D VWLOO LPDJH ZRXOG SURGXFH XQUHDOLVWLFUHVXOWVVLQFHWKHQWKHH[HFXWLRQGLYHUJHQFHGXHWR GLIIHUHQWLPDJHFRQWHQWVLVQRWWDNHQLQWRDFFRXQW 7KHJDLQLVKLJKHVWIRULPDJHVZLWKDORZHQWURS\VLQFH WKHQ WKH *38 LV PRVW KHDYLO\ XQGHURFFXSLHG ZLWKRXW WKH SURSRVHG PRGHV DV RQO\ IHZ FRGHEORFNV UHPDLQ DFWLYH LQ WKH ORZHU ELWSODQHV 7KHDYHUDJH VSHHGXS IRU WKH VLQJOH SDVVPRGHLV[ZLWKDIDFWRURI[RQWKHORZHQGIRU WKHGHWDLOULFK94(*RU6W(0VHTXHQFHVDQGDOPRVW[RQ WKHKLJKHQGIRUWKHORZHQWURS\LPDJHVIURPWKH6LQWHORU %LJ%XFN%XQQ\VHTXHQFHV:KHQHQDEOLQJWKHUDZFRGLQJ PRGH DIWHU WKH IRXUWK WKLUG VLJQLILFDQW ELW SODQH WKH DYHUDJHVSHHGXSLVLQFUHDVHGWR[[ 7KH LPSDFW RI WKH VLQJOHSDVV PRGH RQ WKH GHFRGHU LV ORZHU EXW VWLOO \LHOGV DQ DYHUDJH VSHHGXS RI [ 7KH SURSRVHG UDZFRGLQJ PRGH ZRUNV EHWWHU LQ WKH GHFRGHU WKRXJK ZLWK VSHHGXSV RI [ DQG [ ZKHQ HQDEOLQJLW DIWHUWKHIRXUWKRUWKLUGSODQHUHVSHFWLYHO\ 7KH GRZQ VLGH WR WKH SURSRVHG PRGHV LV D GLPLQLVKHG FRPSUHVVLRQ HIILFLHQF\ )LJXUH  SORWV KRZ WKH DFKLHYHG FRPSUHVVLRQUDWHGHFUHDVHVDVPRUHELWSODQHVDUHVXEMHFWHG WR UDZ FRGLQJ 7KH FRPSUHVVLRQ UDWH LQFUHDVH GXH WR WKH VLQJOHSDVVPRGHLVRQO\DERXW$VH[SHFWHGLWJURZV VLJQLILFDQWO\DVPRUHELWSODQHVDUHFRGHGUDZ $OOVHTXHQFHVKDYHEHHQFRPSUHVVHGZLWKDVXIILFLHQWO\ KLJK PD[LPXP GDWD UDWH VR WKDW QR ELW VWUHDPVKDG WR EH WUXQFDWHG ,W KDV \HW WR EH H[DPLQHG KRZ WKH TXDOLW\ FRPSDUHVZKHQFRPSUHVVLQJWRDIL[HGWDUJHWUDWHJLYHQWKDW WKHVLQJOHSDVVPRGH\LHOGVIHZHUWUXQFDWLRQSRLQWV 8OWLPDWHO\ DQ DVVHVVPHQW RI ZKHWKHU WKH JDLQ LQ WKH IRUP RI LQFUHDVHG HQFRGLQJ RU GHFRGLQJ WKURXJKSXW RXWZHLJKV WKH FRVW LQ WHUPV RI DQ LQFUHDVHG GDWD UDWH GHSHQGV RQ WKH XVH FDVH $Q DWWHPSW LV PDGH KHUH E\ SORWWLQJ WKH VSHHGXS YV WKH UHODWLYH LQFUHDVH LQ GDWD UDWH )LJXUH  (YHU\ FXUYH FRQQHFWV ILYH SRLQWV ZKLFK UHSUHVHQWWKHUHVXOWIRUQRE\SDVVLQJE\SDVVLQJDIWHU RUVLJQLILFDQWELWSODQHV)RUWKRVHSRLQWVWKDWOLHEHORZWKH GLDJRQDOGDVKHGOLQHWKHVSHHGXSLVKLJKHUWKDQWKHUHODWLYH LQFUHDVHLQGDWDUDWH $OOH[FHSWWZRVHTXHQFHVVWD\HQWLUHO\EHORZWKHGDVKHG OLQH 7KH WZR H[FHSWLRQV FRUUHVSRQG WR ORZ HQWURS\ VHTXHQFHV WKDW KDG D KLJK FRPSUHVVLRQ HIILFLHQF\ DQG WKURXJKSXWWREHJLQZLWKDQGFRXOGWKHUHIRUHEHUHJDUGHGDV XQFULWLFDO &21&/86,21  %DVHG RQDQH[DPLQDWLRQRIWKHERWWOHQHFNVRID -3(*  LPSOHPHQWDWLRQ IRU *38V ZH SURSRVHG WZR QHZ PRGHV IRU LWV HQWURS\ FRGHU (%&27 WKDW OHDG WR D KLJKHU WKURXJKSXW7KHYDULDQWLV FRPSDWLEOHZLWKWKH-3(* IUDPHZRUNDQGFDQEHORVVOHVVO\WUDQVFRGHGLQWRVWDQGDUG FRPSOLDQW SURILOHV 7KH UHVXOWLQJ FRGHVWUHDP LV VWLOO HPEHGGHGVRWKDWGHFRGHUVFDQDSSO\WKHWHFKQLTXHRIFRGH SDVV VNLSSLQJ LQ RUGHU WR LQFUHDVH WKHLU WKURXJKSXW IXUWKHU ZKHQ LW LV QRW D VWULFW UHTXLUHPHQW WR IXOO\ GHFRGH WKH FRPSUHVVHGLPDJHVHJZKHQSUHYLHZLQJELW'&3VRQD ELWFRPSXWHUPRQLWRU>@ 7KH VLQJOHSDVV PRGH DORQH \LHOGV VSHHGXSV EHWZHHQ [ DQG [ IRU WKH HQFRGHU DQG [ WR [ IRU WKH GHFRGHUDWYLUWXDOO\QRLQFUHDVHLQFRPSUHVVLRQUDWH 7KHWKURXJKSXWFDQEHIXUWKHULQFUHDVHGE\HQDEOLQJWKH UDZFRGLQJPRGHRQWRSRIWKHVLQJOHSDVVPRGH,QFRQWUDVW WR WKH VHOHFWLYHDULWKPHWLF FRGLQJ E\SDVV PRGH GHILQHG LQ WKH -3(*  VWDQGDUG WKLV SURSRVHG PRGH FDQ EH OHYHUDJHG E\ D *38 LPSOHPHQWDWLRQ WR LQFUHDVH WKH WKURXJKSXW VLJQLILFDQWO\ 7KLV FRPHV DW WKH FRVW RI DQ LQFUHDVHGGDWDUDWHEXWWKHUHODWLYHVSHHGXSRXWZHLJKVWKH UHODWLYH LQFUHDVH LQ GDWD UDWH IRU DOO WHVWHG GHWDLOULFK VHTXHQFHV ,W SUHVHQWV DQ RSSRUWXQLW\ WR IOH[LEO\ FRQILJXUH WKHWUDGHRIIEHWZHHQVSHHGDQGFRPSUHVVLRQUDWH  5()(5(1&(6  >@ 0 %ROLHN (G ´,QIRUPDWLRQ 7HFKQRORJ\  7KH -3(* LPDJHFRGLQJV\VWHP3DUW´,62,(&  >@$%LOJLQ0:0DUFHOOLQJ³-3(*IRU'LJLWDO&LQHPD´ ,(((,QWHUQDWLRQDO6\PSRVLXPRQ&LUFXLWVDQG6\VWHPVSS 0D\  >@ 6037( 67  ,QWHURSHUDEOH 0DVWHU )RUPDW ± $SSOLFDWLRQ([WHQGHG  )LJXUH±$FKLHYHGFRPSUHVVLRQUDWHPHDVXUHGLQELWVVDPSOHESV  )LJXUH±'DWDUDWHLQFUHDVHYVVSHHGXS >@ 9 %UXQV DQG 0 $ 0DUWtQH]GHO$PRU ³6DPSOH3DUDOOHO ([HFXWLRQ RI (%&27 LQ )DVW 0RGH´ QG 3LFWXUH &RGLQJ 6\PSRVLXP1XUHPEHUJ(UODQJHQ'HF  >@'7DXEPDQ³+LJKSHUIRUPDQFHVFDODEOHLPDJHFRPSUHVVLRQ ZLWK (%&27´ ,((( 7UDQVDFWLRQV RQ ,PDJH 3URFHVVLQJ 9RO  1RSS  >@75LFKWHUDQG66LPRQ³2QWKH-3(*XOWUDIDVWPRGH´ WK ,((( ,QWHUQDWLRQDO &RQIHUHQFH RQ ,PDJH 3URFHVVLQJ 2FW   >@ 5 /H ,5 %DKDU DQG -/ 0XQG\ ³$ QRYHO SDUDOOHO 7LHU FRGHU IRU -3(* XVLQJ *38V´ ,((( WK 6\PSRVLXP RQ $SSOLFDWLRQ6SHFLILF3URFHVVRUVSS-XQ  >@ ) $XOt/OLQjV 3 (QIHGDTXH -& 0RXUH DQG 9 6DQFKH] %LWSODQH,PDJH&RGLQJ:LWK3DUDOOHO&RHIILFLHQW3URFHVVLQJ,((( 7UDQVDFWLRQVRQ,PDJH3URFHVVLQJ9RO1R-DQ  >@ - 0DWHOD 9 5XVQDN DQG 3 +ROXE ³*38%DVHG 6DPSOH 3DUDOOHO &RQWH[W 0RGHOOLQJ IRU (%&27 LQ -3(*´ 6L[WK 'RFWRUDO :RUNVKRS RQ 0DWK DQG (QJ 0HWKRGV LQ &RPSXWHU 6FLHQFH0(0,&6¶SS  >@*(%OHOORFK³6FDQVDV3ULPLWLYH3DUDOOHO2SHUDWLRQV´,((( 7UDQVDFWLRQVRQ&RPSXWHUV9RO1RSS1RY   >@ ) $XOt/OLQjV DQG 0: 0DUFHOOLQ ³6FDQQLQJ 2UGHU 6WUDWHJLHV IRU %LWSODQH ,PDJH &RGLQJ´ ,((( 7UDQVDFWLRQ RQ ,PDJH3URFHVVLQJ9RO1R$SULO  >@ $ %DOHYLF ³3DUDOOHO YDULDEOHOHQJWKHQFRGLQJ RQ *3*38V´ 3URFHHGLQJV RI WKH  LQWHUQDWLRQDO FRQIHUHQFH RQ 3DUDOOHO 3URFHVVLQJ(XUR3DU¶%HUOLQSS  >@ 9 %UXQV DQG + 6SDUHQEHUJ ³&RPSDULVRQ RI &RGH3DVV 6NLSSLQJ 6WUDWHJLHV IRU $FFHOHUDWLQJ D -3(*  'HFRGHU´  ,7*)DFKWDJXQJIU(OHNWURQLVFKH0HGLHQ'RUWPXQG)HE