Fractal Beauty of Programming Style

174 Int'l Conf. Software Eng. Research and Practice | SERP'16 |

)UDFWDO%HDXW\RI3URJUDPPLQJ6W\OH 5RQ&ROHPDQ3ULWHVK*DQGKL &RPSXWHU6FLHQFH'HSDUWPHQW0DULVW&ROOHJH3RXJKNHHSVLH1<8QLWHG6WDWHV FDVHWKH. 5VW\OH>@7KHPRGHUQVXFFHVVRURIFEIRUWKH $EVWUDFW - The literature on how to write programs with good /LQX[ HQYLURQPHQW LV indent ZKLFK FDQ JHQHUDWH . 5 DV style is extensive but it contains almost no references to ZHOODV*18%6'DQG/LQX[VW\OHV>@Linux source as the test bed indicate the model is PHWULFV &ROHPDQ DQG *DQGKL >@ K\SRWKHVL]HG WKDW only weakly or moderately correlated with software SURJUDPPLQJVW\OHPLJKWEHUHODWHGIUDFWDOVVLQFHIUDFWDOVDUH complexity yet in directions consistent with anecdotal RIWHQDVVRFLDWHGZLWKEHDXW\>@7RWHVWWKHLUK\SRWKHVLV prescriptions for good style. The data further indicates WKH\VWXGLHG&SURJUDPVIURPWKH*18/LQX[UHSRVLWRU\DQG removing comments do not improve source beauty but neither VKRZHG WKDW FKDQJHV LQ VW\OH ZHUH V\VWHPDWLFDOO\ FRUUHODWHG does adding them, a finding at odds with advice in some style ZLWK FKDQJHV LQ IUDFWDO GLPHQVLRQ >@ 7KH DXWKRUVGLGQRW guides. Yet mnemonics are correlated with software SURSRVHWKHIUDFWDOGLPHQVLRQZDVLWVHOIDPHDVXUHRIEHDXW\ complexity, which comports with model predictions and some EXWQRWHGLQVWHDGDZHDNFRUUHODWLRQZLWKOLQHVRIFRGH style guide recommendations to make code “self- documenting.” These results suggest the model may help ,QWKLVSDSHUZHH[WHQGWKHZRUNRI&ROHPDQDQG*DQGKL>@ developers craft and maintain beautiful codes as a best DQG SURSRVH D VLPSOH UHODWLYLVWLF IUDFWDO PRGHO RI VRXUFH practice. EHDXW\ VRXUFH FDOOHG WKHbeauty factor:H K\SRWKHVL]H WKDW WKHPRGHOLVVWDWLVWLFDOO\UHODWHGWR\HWGLIIHUHQWIURPVRIWZDUH .H\ZRUGV 3URJUDPPLQJ VW\OH IUDFWDO DQDO\VLV VRIWZDUH FRPSOH[LW\7RWHVWRXUK\SRWKHVLVZHXVHWKHVDPHWHVWEHG FRPSOH[LW\UHDGDELOLW\ DV &ROHPDQ DQG *DQGKL >@ :H VKRZ WKDW EHDXW\ IDFWRUV IURPGHEHDXWLI\LQJDQGEHDXWLI\LQJWUHDWPHQWVDUHFRUUHODWHG ,QWURGXFWLRQ ZLWK VRIWZDUH FRPSOH[LW\ LQ H[SHFWHG GLUHFWLRQV DQG DUH PRVWO\FRQVLVWHQWZLWKSUHVFULSWLRQVLQVW\OHJXLGHV+RZHYHU ,Q 'RQDOG .QXWK DXWKRU RI The Art of Computer WKHFRUUHODWLRQVDUHZHDNPRGHUDWH,QRWKHUZRUGVVRIWZDUH Programming>@JDYHDWDONRQFRPSXWHUSURJUDPPLQJDV FRPSOH[LW\DQGEHDXW\IDFWRUVDUHLQGHHGUHODWHGEXWWKH\DUH DQDUW>@+HQRWHGWKDWLQZKHQWKHCommunications QRWSUR[LHVIRURQHDQRWKHU%HDXW\IDFWRUVDSSHDUWRPHDVXUH of the ACM ILUVW EHJDQ SXEOLFDWLRQ WKH HGLWRUV KDG KRSHG RWKHU YDOXHV LQ VRXUFH WKDW PD\ DLG LQ FUDIWLQJ DQG VRPHGD\WRVHH³DWUDQVLWLRQRISURJUDPPLQJIURPDQDUWWRD PDLQWDLQLQJEHDXWLIXOFRGHV GLVFLSOLQHG VFLHQFH´ >@ 7KH LPSOLFDWLRQ .QXWK REVHUYHG ZDV WKDW ³WKHUH LV VRPHWKLQJ XQGHVLUDEOH DERXW DQ DUHD RI KXPDQ DFWLYLW\ WKDW LV FODVVLILHG DV DQ µDUW¶ LW KDV WR EH D 5HODWHGZRUN 6FLHQFHEHIRUHLWKDVDQ\UHDOVWDWXUH´)RU.QXWKDUWLQWKH $OWKRXJK WKH OLWHUDWXUH RQ SURJUDPPLQJ VW\OH LV FRQWH[W RI SURJUDPPLQJ ZDV V\QRQ\PRXV ZLWK WKH FODVVLFDO H[WHQVLYH > @ LW JLYHV YHU\ OLWWOH GHILQLWLRQ RI DUW QDPHO\ VNLOO RU DSSOLFDWLRQ RI NQRZOHGJH DWWHQWLRQ WR PHDVXULQJ DHVWKHWLF YDOXHV LQ VRXUFH FRGH 7KH ³:KHQ , VSHDN DERXW FRPSXWHU SURJUDPPLQJ DV DQ DUW´ KH MXVWLILFDWLRQV IRU JRRG VW\OH DUH IUHTXHQWO\ UHDGDELOLW\ DQG VDLG ³, DP SULPDULO\ WKLQNLQJ RI LW DV DQ DUW IRUP LQ DQ ³GHIHQVLYHSURJUDPPLQJ´DOWKRXJKWKHUHODWLRQVKLSEHWZHHQ DHVWKHWLF VHQVH 7KH FKLHIJRDO RI P\ ZRUN DV HGXFDWRU DQG UHDGDELOLW\ DQG GHIHFWVIDLOXUHV LV FRQWURYHUVLDO > DXWKRU LV WR KHOS SHRSOH OHDUQ KRZ WR ZULWH beautiful @7KHDVVXPSWLRQLVWKDWUHDGLQJFRGHLVVLPLODUWRUHDGLQJ programs´ KLVHPSKDVLV SURVH>@7KXVUHDGDELOLW\LVDERXWXQGHUVWDQGLQJFRGH>@ .QXWK ZDV QRW DGGUHVVLQJ ZKDW LV EHDXW\ LQ WKH RQWRORJLFDO DQGDHVWKHWLFVDSSUHFLDWLQJLW>@7HDJXHDQG/LVWHU>@ILQG VHQVH EXW UDWKHU ZKDW LV NQRZDEOH DERXW VXFK EHDXW\ LQ WKH UHDGLQJ FRGH SUHFHGHV ZULWLQJ LW ZH SRVLW ORRNLQJ DW FRGH HSLVWHPRORJLFDO VHQVH WKDW KH FRXOG DSSO\ DQG WHDFK HJ SUHFHGHV HYHQ XQGHUVWDQGLQJ LW DQG WKDW DFW KDV YDOXH $Q JRRGSURJUDPPLQJVW\OH+HGLGQRWJLYHGHWDLOHGLQVWUXFWLRQV H[DPSOHLVDistellamap>@DYLVXDOL]DWLRQRIWKHPac-Man EXW LQVWHDG UHIHUUHG WR The Elements of Programming Style FRGH IRXQG LQ DQ $WDUL FDUWULGJH >@ :KLOH VRPH >@ ZKLFK GLG 6RIWZDUH HQJLQHHUV DW $7 7 %HOO /DEV LQGLYLGXDOV PD\ FRPSUHKHQG DVVHPEO\ FRGH ZKLFK LV DXWRPDWHGVRPHRIWKHVHLGHDVLQcbWKH&EHDXWLILHU>@WKH QRWNQRZQIRULWVKLJKGHJUHHRIUHDGDELOLW\WKDWWKDWFRGHLV ILUVWSURJUDPWREHDXWLI\RWKHUSURJUDPVLQDFFRUGDQFHZLWK RQ H[KLELW DW WKH 0XVHXP RI 0RGHUQ $UW LV SULPD IDFLH ZKDWZDVNQRZQDERXWUHOLDEOH ZHOOZULWWHQ FRGH LQ WKLV HYLGHQFH RI LWV DHVWKHWLF YDOXH Beautiful Code >@ VWXGLHV

ISBN: 1-60132-446-4, CSREA Press © Int'l Conf. Software Eng. Research and Practice | SERP'16 | 175

FRQFHSWXDOEHDXW\LQWKHGHVLJQDQGHIILFLHQF\RIDOJRULWKPV *18>@. 5>@%6'>@ DQG GDWD VWUXFWXUHV WHVWLQJ DQG GHEXJJLQJ WKH\ DUH QRW %HDXWLI\ /LQX[>@VW\OHV FRQVLGHULQJ VW\OH .RNRO HW DO UHSRUWHG HYLGHQFH RI IUDFWDO 0QHPRQLFUHIDFWRULQJ VWUXFWXUH DQG ORQJUDQJH FRUUHODWLRQV LQ VRXUFH > 5HFRPPHQW @KRZHYHUWKH\ZHUHLQYHVWLJDWLQJQRWVW\OHEXWVRIWZDUH FRPSOH[LW\ XVLQJ OH[LFDO DQDO\VLV RI D VPDOO VDPSOH RI 5HPRYLQJLQGHQWDWLRQVWULSVDOOZKLWHVSDFHRQWKHOHIWVLGHRI UDQGRPO\ JHQHUDWHG 3DVFDO SURJUDPV &ROHPDQ DQG *DQGKL HDFKOLQH5DQGRPL]LQJLQGHQWDWLRQLQVHUWVUDQGRPL]HG >@XVHG)UDFWRS>@DQGIRXQGVWURQJFRUUHODWLRQVEHWZHHQ VSDFHV RQ OHIW VLGH RI HDFK OLQH 'HFRPPHQW UHPRYHV DOO VW\OH DQG IUDFWDO GLPHQVLRQ 7KH\ DOVR LGHQWLILHG ZHDN H[WHUQDO WR D IXQFWLRQ FRPPHQWV LQWHUQDO FRPPHQWV DUH FRUUHODWLRQVZLWKOLQHVRIFRGHZKLFKWKHDXWKRUVLQWHUSUHWHG QRW DIIHFWHG 1RQPQHPRQLF UHIDFWRULQJ FKDQJHV WKH DVHYLGHQFHRIUREXVWQHVVRIWKHIUDFWDOPHDVXUH,QWKLVSDSHU RFFXUUHQFHRIKLJKIUHTXHQF\QDPHVWREHOHVVPQHPRQLF ZHXVHWKHVDPHWHVWEHGRI&ILOHVDV&ROHPDQDQG 6HH&ROHPDQDQG*DQGKL>@IRUWKHDOJRULWKP7KHLQGHQW *DQGKL>@H[FHSWZHVWULSWKHILOHVRIQRQIXQFWLRQDOV\QWD[ FRPPDQG DSSOLHV RQH RI *18 . 5 %6' RU /LQX[ H[WHUQDOWRIXQFWLRQVDQGJHQHUDWHVHSDUDWHILOHVHDFKZLWKRQH GHYLFH GULYHU VW\OHV WR D ILOH 0QHPRQLF UHIDFWRULQJ IXQFWLRQ ZKLFK LQFUHDVHV WKH QXPEHU RI ILOHV WR DQDO\]H E\ FKDQJHVWKHRFFXUUHQFHRIKLJKIUHTXHQF\QDPHVWREHPRUH DOPRVWWHQIROG2XUZRUNLVVLPLODUWR>@H[FHSW PQHPRQLF $JDLQ VHH &ROHPDQ DQG *DQGKL >@ IRU WKH WKHVH HIIRUWV ZHUH PHDVXULQJ DHVWKHWLF DSSHDO LQ DUWLILFLDOO\ DOJRULWKP 5HFRPPHQWV LQVHUWV DW OHDVW RQH UDQGRPO\ LQWHOOLJHQW SDWKILQGLQJ LQ YLGHRJDPHV :KLOH RXU IRFXV LV VHOHFWHG FRPPHQW IURP D GDWDEDVH RI FRPPHQWV FRPSLOHG VRIWZDUH GHYHORSPHQW RXU DSSURDFK LPSOLHV SURJUDPV DUH IURPWKHWHVWEHG ZRUNV RI DUW DQG WKXV ZH ERUURZ FRQFHSWXDOO\ IURP RWKHUV $UWHIDFWV ZKRKDYHZRUNHGLQWKLVDUHDLQYHVWLJDWLQJIUDFWDODQDO\VLVRI SDLQWLQJV DQG PDVWHUSLHFHV >@ LQ SDUWLFXODU 3ROODFN¶V $IWHUPDQLSXODWLQJWKHVRXUFHVW\OHZHJHQHUDWHDQDUWHIDFW ³DFWLRQSDLQWLQJV´>@ ZKLFK LV DQ LQPHPRU\ ELWPDS UHSUHVHQWDWLRQ RI WKH VRXUFH FRGH,WLVHQFRGHGLQWZRZD\VOLWHUDODUWHIDFWPHWKRG /$0 RU EORFN DUWHIDFW PHWKRG %$0 /$0 EXLOGV D ³OLWHUDO´ 0HWKRGV UHSUHVHQWDWLRQWKDWLVDVLWZRXOGDSSHDUVD\LQDWH[WHGLWRU ZLWKIL[HGZLGWKIRQW&RQVLGHUhello.cLQWKHILJXUHEHORZ 6RPHZRUNLQJGHILQLWLRQV 7KLVLVLWV/$0HQFRGLQJLILWZHUHZULWWHQWRDQLPDJHILOH )RU WKH SXUSRVHV RI WKLV SDSHU ZH GHILQH styleDVWKH #include OH[LFDOIRUPRUVWUXFWXUHRIVRXUFHFRGH&ROHPDQDQG*DQGKL int main(int argc, char** argv) { >@ VXUYH\HG GLIIHUHQW VW\OH JXLGHV DQG IRXQG JHQHUDO printf("Hello, world!"); DJUHHPHQWRQWKUHHUXOHVWKH\FDOOHGWKH³EDVLFWHQHWV´ return 0; 8VHZKLWHVSDFH } &KRRVHPHDQLQJIXORUPQHPRQLFQDPHV )LJXUHKHOORFZLWK/$0HQFRGLQJ ,QFOXGHGRFXPHQWDWLRQ %$0 EXLOGV D ³EORFN´ UHSUHVHQWDWLRQ ,Q WKLV FDVH HDFK :HGHILQHbeautyDVWKHPHDVXUHRIVW\OH7KHPRGHOZHJLYH FKDUDFWHUH[FHSWIRUVSDFHVLVUHSUHVHQWHGE\DJUDSKLFDILOOHG EHORZDVVLJQVDTXDQWLWDWLYHYDOXH UHFWDQJXODUEORFN6SDFHVDUHEODQNVZLWKRXWEORFNV7KDWLVLW 7KHUHLVQRFRQVHQVXVRQZKDWsoftware complexityLVZKLFK REOLWHUDWHV WKH WH[W LQ IDYRU RI WKHVH JUDSKLFV 7KH VDPH PD\H[SODLQZK\WKHUHDUHPRUHWKDQGLIIHUHQWVRIWZDUH hello.cILOH%$0HQFRGLQJLVVKRZQLQWKHILJXUHEHORZLI FRPSOH[LW\PHWULFV>@7KXVDVDVWDUWLQJSRLQWZHGHILQH LWZHUHZULWWHQWRDQLPDJHILOH VRIWZDUH FRPSOH[LW\ DV OLQHV RI FRGH /2& RU 0F&DEH¶V F\FORPDWLFFRPSOH[LW\0>@+DWWRQ>@IRXQG/2&DQG 0DUHVWURQJO\FRUUHODWHG 7UHDWPHQWV )LJXUHKHOORFZLWK%$0HQFRGLQJ 7KHILUVWVWHSDIWHUH[WUDFWLQJWKH&ILOHIURPWKHGDWDEDVH %$0 UHPRYHV ODQJXDJH GHSHQGHQFLHV RI WKH SURJUDPPLQJ LVWRPDQLSXODWHLWVVW\OHWKURXJKRQHRIWKHGHEHDXWLI\LQJRU ODQJXDJH DQG FRPSOHPHQWV WKH PQHPRQLF UHIDFWRULQJ DQG EHDXWLI\LQJUHJLPHVEHORZ GRFXPHQWDWLRQ DQDO\VLV ZKLOH SUHVHUYLQJ WKH OD\RXW )LQDOO\ 7DEOH6RXUFHFRGHWUHDWPHQWV GDWD IURP &ROHPDQ DQG *DQGKL >@ VKRZV /$0 DQG %$0 HQFRGLQJV DUH FRUUHODWHG 7KXV ZH XVH RQO\ %$0 7UHDWPHQW 7\SH 7HQHW HQFRGLQJLQRXULQYHVWLJDWLRQKHUH 1RQH %DVHOLQH 5HPRYHLQGHQWV 6RIWZDUHFRPSOH[LW\ 'HEHDXWLI\ 5DQGRPL]HLQGHQWV /2&LVWKHVLPSOHOLQHE\OLQHFRXQWLQFOXGLQJFRPPHQWVLI 1RQPQHPRQLFUHIDFWRULQJ DQ\00F&DEH¶VF\FORPDWLFFRPSOH[LW\>@LVJLYHQE\WKH 'HFRPPHQW

ISBN: 1-60132-446-4, CSREA Press © 176 Int'l Conf. Software Eng. Research and Practice | SERP'16 |

IROORZLQJHTXDWLRQ UDQJHUHSUHVHQWDWLRQVEHFRPHLQFUHDVLQJO\PHUHO\OLQHVRUXQ 0 ʌ WH[WXUHG VXUIDFHV >@ :KHQ % WKH EHDXW\ UHPDLQV ZKHUHʌLVWKHQXPEHURIGHFLVLRQSRLQWVLQWKHIXQFWLRQ)RU XQFKDQJHGE\7WKDWLV6 6¶ WKH&ODQJXDJHWKHGHFLVLRQSRLQWVDUHifVZLWFKcasefor 7KH PRGHO SUHGLFWV SRVLWLYH FRUUHODWLRQV ZLWK /2& DQG 0 whiledo-whileWKHRSHUDWRUV&&||DQG?: ZKHQ 7GHEHDXWLILHV WKH FRGH DFFRUGLQJ WR WKHEDVLF WHQHWV 7KH PRGHO IXUWKHU SUHGLFWV QHJDWLYH FRUUHODWLRQV ZLWK /2& )UDFWDOGLPHQVLRQ DQG0ZKHQ7EHDXWLILHVWKHFRGH,QRWKHUZRUGVGHFUHDVLQJ 7KH ILQDO SKDVH PHDVXUHV WKH IUDFWDO GLPHQVLRQ RI WKH %LVFRQFRPLWDQWZLWKORQJHUPRUHFRPSOLFDWHGFRGHVDQGWKH DUWHIDFW ZKLFK LV LQSXW WR % WKH EHDXW\ PRGHO VHH EHORZ RSSRVLWH IRU LQFUHDVLQJ % 6HFRQG 7 WKDW UDQGRPO\ GLVWRUWV 0DQGHOEURW >@ GHVFULEHG IUDFWDOV DV JHRPHWULF REMHFWV WKHVW\OHLQDVLJQLILFDQWZD\UHVXOWVLQOLWWOHRUQRFRUUHODWLRQ ZKLFKDUHQRZKHUHGLIIHUHQWLDEOHDQGVHOIVLPLODUDWGLIIHUHQW RI%ZLWK/2&DQGRU0 VFDOHV:HXVHWKHJHRPHWULFLQWHUSUHWDWLRQEDVHGRQUHWLFXODU FHOOFRXQWLQJRUWKHER[FRXQWLQJGLPHQVLRQ0DQGHOEURWDOVR ([SHULPHQWDOGHVLJQ VDLGIUDFWDOREMHFWVKDYHIUDFWLRQDOGLPHQVLRQ'DQRQZKROH :H XVH ILOHV RI WKH *18 &RUH 8WLOLWLHV YHUVLRQ QXPEHU FDOOHG WKH IUDFWDO GLPHQVLRQ 0DWKHPDWLFDOO\ ' LV >@ H[FHSW ZH UHGXFH HDFK ILOH WR H[DFWO\ RQH IXQFWLRQ RU JLYHQE\WKH+DXVGRUIIGLPHQVLRQ>@ SURFHGXUH DQG LQWHUQDO FRPPHQWV LI DQ\ ZKLFK JHQHUDWHV D WRWDO RI ILOHV :H PHDVXUH /2& DQG 0 RQFH IRU HDFK ܰ ሺܵሻ ܦሺܵሻ ൌ ఢ ILOH DQG ' DQG % IRU HDFK WUHDWPHQW LQ 7DEOH 7KH ఢ՜଴ ͳȀ߳ .ROPRJRURY6PLUQRY WHVW >@ LQGLFDWHV WKH GLVWULEXWLRQV RI ZKHUH 6 UHSUHVHQWV D VHW RI SRLQWV RQ D VXUIDFH LH FRDVW WKHVH YDOXHV RYHU DOO ILOHV DUH QRQ*DXVVLDQ DQG WKXV ZH OLQHV EUXVK VWURNHV RU LQ RXU FDVH VRXUFH OLQHV RI FRGH LQ DVVHVV DOO FRUUHODWLRQV QRQSDUDPHWULFDOO\ XVLQJ 6SHDUPDQ¶V UKRRUȡ>@6RXUFHFRGHXVHWRSURFHVVWKHILOHVDQGUXQWKH DUWHIDFWIRUP ࣅLVWKHVL]HRIWKHPHDVXULQJWRRODQGN׫(S)LV WKH QXPEHU RI REMHFWV RU VXEFRPSRQHQWV FRYHUHG E\ WKH H[SHULPHQWVFDQEHIRXQGRQOLQH>@ PHDVXULQJWRRO)RUIUDFWDOREMHFWVlog N׫(S)ZLOOEHJUHDWHU WKDQlog 1/׫E\DIUDFWLRQDODPRXQW,IWKHWRROLVDXQLIRUP 5HVXOWV JULGRIVTXDUHFHOOVWKHQDVWUDLJKWOLQHSDVVHVWKURXJKWZLFH DVPDQ\FHOOVLIWKHFHOOOHQJWKLVUHGXFHGE\DIDFWRURIWZR ,QWKLVVHFWLRQZHJLYHWKHUHVXOWVRIH[SHULPHQWVRQWKHWHVW $ IUDFWDO REMHFW SDVVHV WKURXJK PRUH WKDQ WZLFH DV PDQ\ EHGRI&ILOHVIURPWKH*18&RUH8WLOLWLHV FHOOV7KHDUWHIDFWLV6LQ(TXDWLRQ)RUࣅZHXVHJULGVL]HV /2&0DQG' RIDQGPHDVXUHGLQSL[HOV 7KHWDEOHEHORZJLYHVWKHFRUUHODWLRQPDWUL[IRU/2& ZKLFKDUHWKHGHIDXOWVHWWLQJVRI)UDFWRS>@ 0DQG' 6 %HDXW\PRGHO 7DEOH&RUUHODWLRQPDWUL[RI/2&0DQG' 6 /HW6EHVRPHVRXUFHFRGHWKH³EDVHOLQH´EHIRUHWUHDWPHQW /2&0' 6 /HW7EHDWUHDWPHQWVXFKWKDW7 6 6¶LVVRXUFHZKHUH6¶LV /2& IXQFWLRQDOO\LGHQWLFDOWR6:KHQ7 WKHQ6 6¶LQIXQFWLRQ 0 DV ZHOO DV VW\OH )LQDOO\ OHW ' 6 EH WKH EDVHOLQH IUDFWDO ' 6 GLPHQVLRQEHIRUHVXEPLWWLQJ6WRWUHDWPHQW7DQG' 7 6 7KHILJXUHEHORZJLYHVWKHVFDWWHUSORWRI/2&YV0 ' 6¶ LVWKHIUDFWDOGLPHQVLRQDIWHUVXEPLWWLQJ6WRWUHDWPHQW 7 7KXV ZH GHILQH % 6_6¶ WR EH WKH EHDXW\ IDFWRU RU ʹͷͲ ³EHDXW\´ RI6UHODWLYHWR6¶ZKHUH%ࣅ51DPHO\ ܦሺܵሻ ܤሺܵȁܵԢሻ ൌ ͳͲ݈݋݃ ʹͲͲ ଵ଴ ܦሺܵԢሻ 7KHXQLWVDUHGHFLEHOV:HKDYHWKHIROORZLQJLQWHUSUHWDWLRQV ͳͷͲ RI% 0 ,I% WKHEHDXW\RI6LPSURYHVJLYHQFKDQJHVLPSOLHG ͳͲͲ E\7 ,I%WKHEHDXW\RI6GRHVQRWLPSURYHJLYHQFKDQJHV ͷͲ LPSOLHGE\7 :KHQ %! WKH DHVWKHWLF DSSHDO GHFUHDVHV XVLQJ 7 LQ RWKHU Ͳ ZRUGVWRRPXFKRIDJRRGWKLQJPD\ZRUNDJDLQVWWKHFRGH Ͳ ͷͲͲ ͳͲͲͲ MXVWDVWRROLWWOHZKHQ% 7KLVLVDUHDVRQ'E\LWVHOILVQRW /2& QHFHVVDULO\ D PHDVXUH RI EHDXW\ )RU LQVWDQFH VRPH RI 3ROODFN¶VPDVWHUSLHFHVKDYHD'WRDQGRXWVLGHWKLV )LJXUH6FDWWHUSORWRI/2&YV0

ISBN: 1-60132-446-4, CSREA Press © Int'l Conf. Software Eng. Research and Practice | SERP'16 | 177

7KHWZRILJXUHVEHORZJLYHVFDWWHUSORWVRI' 6 YV/2&DQG *18VW\OH ' 6 YV0 . 5VW\OH %6'VW\OH ͳǤͻ /LQX[VW\OH ͳǤͺ 5HFRPPHQW ͳǤ͹ 0QHPRQLF D(S) ͳǤ͸ (DFK WUHDWPHQW KHUH LV VLPLODUO\ VWDWLVWLFDOO\ VLJQLILFDQW ZLWK ͳǤͷ P 7KHH[FHSWLRQLVUHFRPPHQWZKLFKGRHVQRWLPSURYH ͳǤͶ WKHDHVWKHWLFDSSHDOZLWKP§ Ͳ ͷͲͲ ͳͲͲͲ LOC 'LVFXVVLRQ &RUUHODWLRQPDWUL[ )LJXUH6FDWWHUSORWRI/2&YV' 6 7KH FRUUHODWLRQ PDWUL[ RI 7DEOH DQG WKH VFDWWHUSORW RI ͳǤͻ )LJXUHFRQILUPWKDW/2&DQG0DUHVWURQJO\FRUUHODWHGZLWK HDFKRWKHUDV+DWWRQ>@KDGIRXQG+RZHYHUWKHUHDUHRQO\ ͳǤͺ ZHDNFRUUHODWLRQVRI/2&ZLWK'DQG0ZLWK',QGHHGWKH ͳǤ͹ VFDWWHUSORWVLQ)LJXUHDQG)LJXUHDUHJHQHUDOO\IODW7KLV VXJJHVWV/2&DQG0DUHUHODWHGWR'EXWWKH\DUHQRWSUR[LHV D(S) ͳǤ͸ IRU ' :H QRWH IXUWKHUPRUH WKDW VLQFH IUDFWDOV DUH E\ ͳǤͷ GHILQLWLRQVFDOHLQYDULDQWXQOLNH/2&DQG0WKHPHDVXUH' ͳǤͶ LVLQVHQVLWLYHWRILOHVL]H,QRWKHUZRUGV7DEOHVXJJHVWVWKDW Ͳ ͳͲͲ ʹͲͲ ͵ͲͲ 'LVDPRUHUREXVWPHDVXUHWKDQ/2&DQG0 M 'HEHDXWLI\LQJWUHDWPHQWV 5HIHUULQJ WR 7DEOH WKH GDWD VKRZV WKDW GHEHDXWLI\LQJ )LJXUH6FDWWHUSORWRI0YV' 6 WUHDWPHQWV JHQHUDOO\ GRHV QRW LPSURYH WKH DHVWKHWLF DSSHDO VLQFH JHQHUDOO\ % 7KH H[FHSWLRQ LV UHPRYLQJ LQGHQWDWLRQ %HDXW\DQDO\VLV ZKHUH % +RZHYHU DV &ROHPDQ DQG *DQGKL >@ IRXQG ,QWKLVVHFWLRQZHJLYHUHVXOWVRIWKHEHDXW\DQDO\VLVXVLQJ UHPRYLQJLQGHQWVLVDFRQWUDULDQLQGLFDWRUDQGWKXVUHPRYLQJ WKHEHDXW\IDFWRU%7KHWDEOHEHORZJLYHVWKHIUHTXHQFLHVRI LQGHQWDWLRQGRHVQRWDGGDHVWKHWLFDSSHDO WKH GLIIHUHQW EHDXW\ IDFWRUV ZKHQ GHEHDXWLI\LQJ DQG WKHLU $VIRUWKHFRUUHODWLRQVLQ7DEOHWKHGDWDLQGLFDWHVWKDW%YV FRUUHODWLRQVZLWK/2&DQG0 /2& DQG % YV 0 KDYH YLUWXDOO\ QR UHODWLRQ ZKHQ 7DEOH%HDXW\IDFWRUVIRUGHEHDXWLI\LQJWUHDWPHQWV UDQGRPL]LQJ LQGHQWDWLRQ 7KLV DJUHHV ZLWK FRPPRQVHQVH VLQFHE\GHILQLWLRQWKHUHLVQRSDWWHUQWRUDQGRPLQGHQWDWLRQ )UHTXHQFLHV ȡ +RZHYHUUHPRYDORILQGHQWDWLRQLVPRGHUDWHO\DQWLFRUUHODWHG %Y %Y LQERWK/2&DQG0LQUHODWLRQWR%7RDFFRXQWIRUWKLVZH 7UHDWPHQW % % %! /2& 0 UHIHU WR +LQGOH *RGIUH\ DQG +ROW >@ ZKR VKRZHG WKDW 5DQGRP LQGHQWV LQGHQWDWLRQ LV VWURQJO\ FRUUHODWHG ZLWK 0 ,Q RWKHU ZRUGV 1 KLJKHU 0 LPSOLHV GHHSHU QHVWLQJ DQG FRQVHTXHQWO\ PRUH 5DQGRP LQGHQWV LQGHQWDWLRQ WR UHPRYH &RQVHTXHQWO\ QR LQGHQWDWLRQ DQG 1 DHVWKHWLFDSSHDOWHQGWRZRUNLQRSSRVLWHGLUHFWLRQVZKLFKLV 5HPRYHLQGHQWV FRQVLVWHQWZLWKH[SHULHQFHDQGDQHFGRWDOSUHVFULSWLRQVLQVW\OH 'HFRPPHQW JXLGHV >@ 7DEOH RIIHUV VWDWLVWLFDO VXSSRUW IRU WKLV 1RQPQHPRQLF FRQFOXVLRQ 7KHDHVWKHWLFDSSHDORIUHPRYLQJFRPPHQWVLVQRWFRUUHODWHG 'LYLGLQJ % DQG % DV %HUQRXOOL WULDOV DFFRUGLQJ WR ZLWK0ZKLFKZHZRXOGH[SHFWVLQFHWKHUHLVQRIXQFWLRQDO LQWHUSUHWDWLRQV RI WKH EHDXW\ PRGHO LQ 6HFWLRQ HDFK FRGHLQFRPPHQWV+RZHYHUUHPRYLQJFRPPHQWVLVZHDNO\ WUHDWPHQWLVVWDWLVWLFDOO\VLJQLILFDQWZLWKP FRUUHODWHG ZLWK /2& :H GRQ¶W EHOLHYH WKLV GLIIHUHQFH 7DEOH%HDXW\IDFWRUVIRUEHDXWLI\LQJWUHDWPHQWV EHWZHHQ/2&DQG0LVPHDQLQJIXOIRUSUDFWLFDOSXUSRVHV

ISBN: 1-60132-446-4, CSREA Press © 178 Int'l Conf. Software Eng. Research and Practice | SERP'16 |

1RQPQHPRQLFUHIDFWRULQJDQGVRIWZDUHFRPSOH[LW\ WKHODVW $VIRUFRPPHQWVUHPRYLQJWKHPGRHVQRWDSSHDUWRLPSURYH URZLQ7DEOH DUHPRGHUDWHO\FRUUHODWHGZKLFKVHHPHGWRXV VRXUFHEHDXW\ 7DEOH EXWQHLWKHUGRHVDGGLQJWKHP 7DEOH LQLWLDOO\VXUSULVLQJ@ WKLQJV )XWXUH UHVHDUFK QHHGV WR LQYHVWLJDWH WKLV TXHVWLRQ )XWXUHZRUNPLJKWDOVRORRNLQWRWKHDOWHUQDWHLQWHUSUHWDWLRQV 1RQPQHPRQLF UHIDFWRULQJ 7DEOH DQG PQHPRQLF RI EHDXW\ IDFWRUV :H RQO\ ORRNHG DW WKH & ODQJXDJH DQG DW UHIDFWRULQJ 7DEOH DUHYLUWXDOO\RSSRVLWHVRIRQHDQRWKHULQ WKDW WKH *18/LQXV UHSRVLWRU\ )XWXUH UHVHDUFK ZLOO VWXG\ WHUPVRIEHDXW\ZKLFKLVZKDWWKHPRGHOSUHGLFWV7KDWWKHUH RWKHUODQJXDJHVDQGUHSRVLWRULHVWRXQGHUVWDQGKRZWKHIUDFWDO DUH PRUH FRXQWV ZKHUH % IRU PQHPRQLF VXJJHVWV WKH GLPHQVLRQDQGEHDXW\IDFWRUVUHODWHWRWKHP DQDO\VLV LGHQWLILHG PRUH ORQJHU QDPHV WR GHEHDXWLI\ WKDQ VKRUWHU QDPHV WR EHDXWLI\ +RZHYHU WKH GLIIHUHQFH YV 5HIHUHQFHV LVQRWVWDWLVWLFDOO\VLJQLILFDQW 3§ >@ 'RQDOG(.QXWKThe Art of Computer Programming 7KH RWKHU FDVH ZKHUH WKHUH LV % IUHTXHQF\ FRXQW LV *18 9ROV$$GGLVRQ:HVOH\ VW\OLQJ ,W DJUHHV ZLWKRXU H[SHFWDWLRQVVLQFH WKH *18 &RUH 8WLOLWLHV LV D *18 SURMHFW SUHVXPDEO\ IROORZLQJ WKH *18 >@ 'RQDOG(.QXWK³&RPSXWHU3URJUDPPLQJDVDQ$UW´ VW\OH JXLGH 7KXV ZH ZRXOG H[SHFW 6 6¶ DQG FRQVHTXHQWO\ Communications of the ACM % 7KDW WKLV LV XQLTXH DPRQJ WKH LQGHQW VW\OHV LV FRQILUPDWLRQWKDWEHDXW\IDFWRUVGHWHFWWKH*18VW\OHZKHUH >@ %ULDQ .HUQLJKDQ DQG 3- 3ODXJHU The Elements of ZHH[SHFWWRILQGLW@ 2UDFOH ,QF ³FE ± & SURJUDP EHDXWLILHU´ ZRXOGH[SHFW,QGHHGWKLVLVZKDWWKHGDWDVKRZVLQ7DEOH KWWSVGRFVRUDFOHFRPFG(BKWPO(FEKWP EHORZWKHPHGLDQ% LQGHFLEHOV IRU*18VW\OHLVFORVHVWWR OUHWULHYHG$SULO ]HURWKDQWKHRWKHUVW\OHV >@ %ULDQ .HUQLJKDQ DQG 'HQQLV 5LWFKLH The C 7DEOH0HGLDQ%E\VW\OHLQGHFLEHOV Programming Language3UHQWLFH+DOO 6W\OH G% >@ &DUOR:RRG-RVHSK$UFHQHDX[-LP.LQJGRQDQG *18 'DYLG,QJDPHOOV³,QGHQW´HGLWLRQIRU,QGHQW9HUVLRQ . 5 -XO\ %6' KWWSVZZZJQXRUJVRIWZDUHLQGHQWPDQXDOLQGHQWSGI /LQX[ UHWULHYHG$SULO $IXUWKHULQWHUSUHWDWLRQRI%PLJKWEHDVDTXDQWLWDWLYHVW\OH >@ 5RQ&ROHPDQDQG3ULWHVK*DQGKL³)UDFWDO$QDO\VLVRI FKHFNHU :KLOH D GHWDLOHG FRPSDULVRQ RI *18 . 5 %6' *RRG3URJUDPPLQJ6W\OH´Proceedings Second International DQG /LQX[ VW\OHV LV EH\RQG WKH VFRSH RI RXU VWXG\ 7DEOH Conference on Computer Science & Engineering 'XEDL VXJJHVWVWKH*18&RUH8WLOLWLHVGLYHUJHOHDVWIURPWKH*18 8$($XJ VW\OH ZKLFK DJDLQ LV ZKDW ZH H[SHFW )XUWKHUPRUH WKDW REVHUYHGVW\OHLQDFWXDOVRXUFHFRGHRIWKHWHVWEHGGLYHUJHV >@ +HLQ]2WWR 3HOWJHQ DQG 3+ 5LFKWHU The Beauty of PRVWIURPWKH/LQX[VW\OHDQGOHDVWIURPWKH%6'VW\OHVHHP Fractals6SULQJHU WRXVFRQVLVWHQWZLWKJHQHUDOEXWUHDVRQDEOHLQWHUSUHWDWLRQVRI UHFRPPHQGDWLRQVLQWKHUHVSHFWLYHVW\OHPDQXDOV>@

ISBN: 1-60132-446-4, CSREA Press © Int'l Conf. Software Eng. Research and Practice | SERP'16 | 179

>@ -HQQLIHU 2XHOOHWWH ³3ROORFN¶V )UDFWDOV´ Discover the 2014 conference on Innovation & technology in computer Magazine1RYHPEHU science educationS

>@ %HQRvW 0DQGHOEURW Fractal Geometry of Nature >@ %HQ )U\ Distellamap 0XVHXP RI 0RGHUQ $UW )UHHPDQ 1<&1<8QLWHG6WDWHV

>@ *RRJOH ,QF ³*RRJOH VW\OH JXLGH´ >@ %HQ)U\Visualizing Data2 5HLOO\ KWWSVJLWKXEFRPJRRJOHVW\OHJXLGH UHWULHYHG 1RYHPEHU >@ $QG\ 2UDP DQG *UHJ :LOVRQ HGV Beautiful Code: Leading Programmers Explain How They Think 2 5HLOO\ >@ 7ZLWWHU ,QF ³(IIHFWLYH 6FDOD´ KWWSWZLWWHUJLWKXELRHIIHFWLYHVFDODUHWULHYHG1RYHPEHU >@ 3HWHU.RNRO³6HDUFKLQJIRUIUDFWDOVWUXFWXUHLQFRPSXWHU SURJUDPV´SIGPLAN notices >@ 12$$³*HQHUDO6RIWZDUH'HYHORSPHQW6WDQGDUGVDQG *XLGHOLQHV´ 12$$ 1DWLRQDO :HDWKHU 6HUYLFH 2IILFH RI >@ 3HWHU .RNRO DQG -DQH] %UHVW ³)UDFWDO VWUXFWXUH RI +\GURORJLF'HYHORSPHQW12$$ UDQGRPSURJUDPV´SIGPLAN notices

>@ 6WHYH2XOOLQHC Elements of Style: The Programmer’s >@ 3HWHU .RNRO -DQH] %UHVW DQG 9LOMHP =XPHU ³/RQJ Style Manual for Elegant C and C++ Programs0 7 UDQJH FRUUHODWLRQV LQ FRPSXWHU SURJUDPV´ Cybernetics and systems >@ 7UHYRU 0LVIHOGW *UHJRU\ %XPJDUGQHU $QGUHZ *UD\ DQG /XR;LDRSLQJThe Elements of C++ Style &DPEULGJH >@ 3HWHU .RNRO 9LOL 3RGJRUHOHF DQG -DQH] %UHVW ³$ ZLVKIXOFRPSOH[LW\PHWULF´LQ+&RPEHV HG FESMAS >@ $OODQ9HUPHXOHQDQG6FRWW:$PEOHUThe Elements of Java Style&DPEULGJH >@ 'DYLG &RUQIRUWK +HUEHUW -HOLQHN DQG /HR 3HLFKO ³)UDFWRS $ 7RRO IRU $XWRPDWHG %LRORJLFDO ,PDJH >@ 9LQFHQW<6KHQ7]H-LH@ 5RQ &ROHPDQ ³)UDFWDO $QDO\VLV RI 3DWKILQGLQJ $HVWKHWLFV´ International Journal of Simulation Modeling >@ :LOOLDP 7 :DUG ³6RIWZDUH 'HIHFW 3UHYHQWLRQ 8VLQJ 9ROXPH1XPEHU 0F&DEH V &RPSOH[LW\ 0HWULF´ Hewlett-Packard Journal S >@ 5RQ &ROHPDQ ³)UDFWDO $QDO\VLV RI 6WHDOWK\ 3DWKILQGLQJ´ International Journal of Computer Games >@ 1RUPDQ()HQWRQDQG0DUWLQ1HOO³$FULWLTXHRI Technology VRIWZDUH GHIHFW SUHGLFWLRQ PRGHOV´ IEEE Transactions on Software Engineering9ROXPH,VVXH6HSW >@ 5RQ &ROHPDQ ³/RQJ0HPRU\ RI 3DWKILQGLQJ S $HVWKHWLFV´ International Journal of Computer Games Technology >@ $QGUHDV=HOOHU³%XJV5HVLGHLQ&RPSOH[&RGH´IURP 0\WKV LQ 6RIWZDUH (QJLQHHULQJ >@ 3HWHU *HUO &DUROD 6FK|QOLHE DQG .XQJ &KLHK :DQJ KWWSZZZVOLGHVKDUHQHWDQGUHDV]HOOHUP\WKVLQVRIWZDUH ³7KH8VHRI)UDFWDO'LPHQVLRQLQ$UWV$QDO\VLV´Harmonic HQJLQHHULQJUHWULHYHG$SULO and Fractal Image AnalysisS

>@ 5XGROI)OHVK³$QHZUHDGDELOLW\\DUGVWLFN´Journal of >@ -LP &RGGLQJWRQ -RKQ (OWRQ 'DQLHO 5RFNPRUH DQG Applied Psychology S @ 'DU\O3RVQHWW$EUDP+LQGOH3UHPNXPDU'HYDQEX³$ in the Study of Art 63,( GRL VLPSOHU PRGHO RI VRIWZDUH UHDGDELOLW\´ Proceedings of the 8th Working Conference on Mining Software Repositories 065 S >@ 537D\ORU5*X]PDQ730DUWLQ*5'+DOO$3 0LFROLFK ' -RQDV %& 6FDQQHOO 06 )DLUEDQNV &$ >@ 'RQQD 7HDJXH DQG 5D\PRQG /LVWHU ³3URJUDPPLQJ 0DUORZ ³$XWKHQWLFDWLQJ 3ROORFN SDLQWLQJV XVLQJ IUDFWDO UHDGLQJ ZULWLQJ DQG UHYHUVLQJ´ ITiCSE ’14 Proceedings of JHRPHWU\´Pattern Recognition Letters9ROXPH,VVXH S

ISBN: 1-60132-446-4, CSREA Press © 180 Int'l Conf. Software Eng. Research and Practice | SERP'16 |

>@ 5LFKDUG 3 7D\ORU $GDP 3 0LFROLFK $ DQG 'DYLG -RQDV³)UDFWDODQDO\VLVRI3ROORFN¶VGULSSDLQWLQJV´Nature -XQH GRL

>@ 0RKDPPDG ,UIDQ DQG 'DYLG 6WRUN ³0XOWLSOH YLVXDO IHDWXUHVIRUWKHFRPSXWHUDXWKHQWLFDWLRQRI-DFNVRQ3ROORFN¶V GULS SDLQWLQJV %H\RQG ER[ FRXQWLQJ DQG IUDFWDOV´ Proc. SPIE 7251,PDJH3URFHVVLQJ0DFKLQH9LVLRQ$SSOLFDWLRQV ,,4

>@ 'H 7UDQ&DR *KLVODLQ /pYHVTXH DQG -HDQ*X\ 0HXQLHU³$)LHOG6WXG\RI6RIWZDUH)XQFWLRQDO&RPSOH[LW\ 0HDVXUHPHQW´ Proc. 14th International Workshop on Software Measurement

>@ 7KRPDV 0F&DEH ³$ &RPSOH[LW\ 0HDVXUH´ IEEE Transactions on Software Engineering6(

>@ /HV +DWWRQ ³7KH UROH RI HPSLULFLVP LQ LPSURYLQJ WKH UHOLDELOLW\ RI IXWXUH VRIWZDUH´ Proc. Practice and Research Techniques 7$,& 3$57 7HVWLQJ $FDGHPLF ,QGXVWULDO&RQIHUHQFH

>@ 6WDOOPDQ5 GNU Coding Standards6DPXUDL 0HGLD/LPLWHG

>@ )UHH%6' ³)UHH%6' .HUQHO 'HYHORSHU V 0DQXDO´ KWWSVZZZIUHHEVGRUJFJLPDQFJL"TXHU\ VW\OH VHNWLRQ UHWULHYHG0D\

>@ /LQXV 7RUYDOGV ³/LQX[ .HUQHO &RGLQJ 6W\OH´ KWWSVOXUPVFKHGPGFRPFRGLQJBVW\OHSGIUHWULHYHG0D\

>@ %HQRvW0DQGHOEURW³+RZORQJLVWKHFRDVWRI%ULWDLQ" 6WDWLVWLFDO VHOIVLPLODULW\ DQG IUDFWLRQDO GLPHQVLRQ´Science

>@ )UHH 6RIWZDUH )RXQGDWLRQ 1RYHPEHU &RUHXWLOV±*18FRUHXWLOLWLHV5HWULHYHG1RYHPEHU IURP )UHH 6RIWZDUH )RXQGDWLRQ KWWSZZZJQXRUJVRIWZDUHFRUHXWLOVFRUHXWLOVKWPO

>@ :- &RQRYHU Practical Non-Parametric Statistics :LOH\

>@ 5RQ&ROHPDQKWWSVJLWKXEFRPURQFROHPDQ3UHWW\ UHWULHYHG1RYHPEHU

>@ $EUDP +LQGOH 0LFKDHO : *RGIUH\ DQG 5LFKDUG & +ROW ³5HDGLQJ EHVLGH WKH OLQHV ,QGHQWDWLRQ DV D SUR[\ IRU FRPSOH[LW\´ Proc. 16th IEEE International Conference on Program Comprehension,&3&,(((S