'LJLWDO+LVWRU\_$SSHQGL[ Digital History: A Guide to Gathering, Preserving, and Presenting the Past on the Web Appendix: Database Software, Scripting Languages, and XML Introduction KDSWHURXWOLQHGVRPHRIWKHEDVLFVRIFUHDWLQJDZHEVLWHEXWWKRVHFRQWHPSODWLQJPRUH FRPSOH[VLWHVQHHGWRWKLQNDERXWPRUHLQYROYHGWHFKQLFDOLQIUDVWUXFWXUHVHVSHFLDOO\WKHSRVVLELOLW\RI RUJDQL]LQJH[SDQVLYHUHVRXUFHVWKURXJKGDWDEDVHVRU;0/,I\RXSODQRQKDYLQJPRUHWKDQDKXQGUHG GLJLWDOREMHFWVLQDKLVWRULFDODUFKLYHFROOHFWLQJPRUHWKDQDKXQGUHGKLVWRULFDODUWLIDFWVRUGRFXPHQWV WKURXJK\RXUZHEVLWHRUDUHUHVSRQVLEOHIRUWKHPHPEHUVKLSUROORIDKLVWRULFDOVRFLHW\\RXVKRXOG FRQVLGHUDWWDFKLQJDZHEHQDEOHGGDWDEDVHWR\RXUVLWH,I\RXDUHGLJLWL]LQJDVLPLODUO\ODUJHQXPEHURI KLVWRULFDOGRFXPHQWVWKDWDUHPRVWO\RUFRPSOHWHO\WH[W\RXVKRXOGFRQVLGHUWKHSRVVLELOLW\RIPDUNLQJ XSWKRVHGRFXPHQWVZLWK;0/8VLQJHLWKHUDGDWDEDVHRU;0/JHQHUDOO\DGGVDIHZOD\HUVRI WHFKQRORJ\WRPRUHEDVLFZHEVLWHHOHPHQWVDGGLWLRQDOVRIWZDUHWRHQFRGHRUVWRUHPDWHULDOVDZD\WR GHSRVLWLQIRUPDWLRQLQWRDGDWDEDVHRUPDUNXSWH[WVZLWK;0/DQGDZD\WRH[WUDFWLQIRUPDWLRQIURP WKHGDWDEDVHRU;0/DUFKLYHWREHGLVSOD\HGRQDZHESDJH KWWSFKQPJPXHGXGLJLWDOKLVWRU\DSSHQGL[LQGH[SKS 1 'LJLWDO+LVWRU\_$SSHQGL[ Digital History: A Guide to Gathering, Preserving, and Presenting the Past on the Web Appendix: Database Software, Scripting Languages, and XML Databases 0RVWKLVWRULDQVHQFRXQWHUVLPSOHGDWDEDVHVZKHQWKH\XVHFRPPRQVRIWZDUHDSSOLFDWLRQVVXFKDV$FFHVV RU)LOHPDNHU:HEGDWDEDVHVGLIIHUIURPWKHVH³FOLHQW´RUGHVNWRSSURJUDPV7KH\UXQVLOHQWO\LQWKH ³EDFNJURXQG´RIDZHEVHUYHUDQGUHVSRQGWRVSHFLDOL]HGUHTXHVWVWKURXJKVPDOOSLHFHVRISURJUDPPLQJ FRGHUDWKHUWKDQWKURXJKWKHSRLQWDQGFOLFNDFWLRQVWKDWRFFXURQDSHUVRQDOFRPSXWHUVFUHHQ7KHVH LQYLVLEOHGDWDEDVHRSHUDWRUVSHUPLWTXLFNDQGFRPSOLFDWHG³TXHULHV´RULQVWUXFWLRQVIURPDZHESDJH <RXUEXGJHWDQGWKHRWKHUWHFKQRORJLHV\RXSODQWRXVHRQ\RXUVLWHZLOOKHOS\RXFKRRVHDQDSSURSULDWH GDWDEDVHSURJUDP,I\RXDQWLFLSDWHKDYLQJPRUHWKDQHQWULHVLQWKHGDWDEDVHDQGUHTXLUHQR FRUUXSWLRQRUORVVRILQIRUPDWLRQDQGDVHUYLFHRULHQWHGFRPSDQ\WRJRWRZLWKSUREOHPV LQRWKHUZRUGV LI\RXDUHLQFKDUJHRIDODUJHSURMHFWOLNH(OOLV,VODQG¶VZHEVLWHZKLFKVWRUHVPLOOLRQVRIQDPHVDVZHOO DVDVVRFLDWHGGRFXPHQWV \RXPD\ZDQWWRXVHVRIWZDUHIURP2UDFOHWKHKLJKHQGPDUNHWOHDGHURU VLPLODUSURGXFWVOLNH'%IURP,%07KHVHH[SHQVLYHGDWDEDVHSURGXFWVDUHRIWHQVROGZLWKWHFKQLFDO VXSSRUWDQGFRVWWKRXVDQGVRIGROODUVSHU\HDU RUPRUH WREX\DQGUXQ(YHQWKHQPDQ\ODUJH KLVWRULFDOVLWHVZLWKVRPHLQKRXVHWHFKQLFDOFDSDELOLWLHVPD\EHDEOHWRXVHDIUHHKLJKHQGDOWHUQDWLYH FDOOHG3RVWJUH64/ZKLFKKDVPRVWRIWKHVDPHIHDWXUHVDVWKHFRPPHUFLDOVRIWZDUHZLWKQRQHRIWKH H\HSRSSLQJFRVW)RUH[DPSOHWKH(DVWHUQ,OOLQRLV8QLYHUVLW\VWXGHQWVDQGSURIHVVRUVEHKLQGWKH&ROHV &RXQW\/HJDO+LVWRU\3URMHFWZKLFKLVFDWDORJXLQJDQGPDNLQJZHEVHDUFKDEOHOHJDOGRFXPHQWVIURP WKHHUDRI$EUDKDP/LQFROQ(VTGHFLGHGWRPRYHIURP$FFHVVWR3RVWJUH64/DVWKHLUFROOHFWLRQDQG ZHEVLWHJUHZUDSLGO\RYHUWKH\HDUV3RVWJUH64/OLNH2UDFOH¶VSURGXFWVLV³$&,'´FRPSOLDQWDQ DFURQ\PIRUDGDWDEDVHFKHFNOLVWWKDWHQVXUHVGDWDLQWHJULW\GXULQJIDVWSDFHGKLJKYROXPHXVDJH )RUDOOEXWWKHPRVWH[WHQVLYHKLVWRULFDODUFKLYHVKRZHYHU3RVWJUH64/2UDFOH'%DQGRWKHUUREXVW GDWDEDVHVDUHRYHUNLOODQGPDQ\JRRGDOWHUQDWLYHVIRUVPDOOWRPHGLXPVL]HGKLVWRULFDOZHEVLWHVH[LVW 0LFURVRIW64/6HUYHUVRPHWLPHVFRPHVEXQGOHGZLWK,QWHUQHW,QIRUPDWLRQ6HUYLFHV ,,6 0LFURVRIW¶V ZHEVHUYHUVRIWZDUH EHJLQQLQJDWDURXQG DQGLQFHUWDLQ DQGXS YHUVLRQVLWFDQKDQGOH DVPXFKLQIRUPDWLRQDVDQ\GDWDEDVH HGXFDWLRQDOYHUVLRQVRI64/6HUYHUFRVWFRQVLGHUDEO\OHVV ,Q DGGLWLRQ64/6HUYHULQFOXGHVDGPLQLVWUDWLYHVRIWZDUHWKDWPDLQWDLQVWKHORRNDQGIHHORI:LQGRZVDQG WKXVPD\IHHOPRUHFRPIRUWDEOHWKDQRWKHUGDWDEDVHSDFNDJHV WKRXJK\RXPD\QRWVHHWKLV DGPLQLVWUDWLYHVRIWZDUHLI\RXGRQRWRZQRUUXQWKHVHUYHULWLVRQ 0LFURVRIW¶VORZHQGSHUVRQDOGDWDEDVH$FFHVV DORQHDQGDOVRDYDLODEOHDVSDUWRIWKH2IILFHVXLWH RISURJUDPV PHDQWWRUXQPRUHRQFOLHQWFRPSXWHUVWKDQZHEVHUYHUVLVLQH[SHQVLYHDQGFDQEHSUHVVHG LQWRVHUYLFHDVDZHEGDWDEDVHEXWQRWZLWKRXWVRPHVRIWZDUHOLQNDJHVWKDWZLOOUHTXLUHVRPHWHFKQLFDO NQRZOHGJH7KH8QLYHUVLW\RI0LQQHVRWD¶V,PPLJUDWLRQ+LVWRU\5HVHDUFK&HQWHUXVHV$FFHVVWRVWRUH LQIRUPDWLRQDERXWLWVWKRXVDQGVRIGRFXPHQWVDQGLPDJHVDOWKRXJKWKH\FRQYHUWWKH$FFHVVGDWDLQWR DQRWKHUIRUPDWWRPDNHLWVHDUFKDEOHYLDWKHZHE 0RUHUHFHQWO\ZLWKWKHZLGHVSUHDGDGRSWLRQRIRSHQVRXUFHVRIWZDUHDJRRGDOWHUQDWLYHWRDOORIWKH KWWSFKQPJPXHGXGLJLWDOKLVWRU\DSSHQGL[SKS 2 'LJLWDO+LVWRU\_$SSHQGL[ SUHFHGLQJRSWLRQVKDVHPHUJHG0\64/WKHOHDGLQJIUHHGDWDEDVH0\64/UXQVRQYLUWXDOO\DQ\W\SH RIVHUYHUDQGDEO\KDQGOHVWHQRUHYHQKXQGUHGVRIWKRXVDQGVRIGRFXPHQWVDVLWGRHVIRURXU6HSWHPEHU 'LJLWDO$UFKLYH$OWKRXJKSHUKDSVQRWDVUREXVWDV3RVWJUH64/RU2UDFOH0\64/LVH[WUHPHO\ FDSDEOHIRUPRVWRIWKHWDVNVKLVWRULDQVZLOODVNRILW HJILQGLQJDVSHFLILFGRFXPHQWTXLFNO\ DQGLV VORZO\JDLQLQJPDQ\RIWKHKLJKHQGIHDWXUHVDQGVWDELOLW\RILWVULYDOV0\64/ZLOOOLNHO\FRQWLQXHWR SUROLIHUDWHJLYHQLWVXQGHQLDEO\DWWUDFWLYHSULFHDQGODUJHEDVHRIXVHUVUHDG\WRKHOSRXWRWKHUV0RVW FRPPHUFLDOZHEKRVWV VHHEHORZ SURYLGH0\64/IRUFXVWRPHUVZKRZDQWWRDWWDFKDGDWDEDVHWRWKHLU VLWH %XWKRZGR\RXDFFHVVWKHGDWDEDVHVRIWZDUHOXUNLQJRQWKHVHUYHUHLWKHUWRSXWPDWHULDOVLQRUWRJHW WKHPRXWWRGLVSOD\RQ\RXUZHEVLWH",QJHQHUDOSXWWLQJWKLQJVLQLVHDVLHUEHFDXVHLWFDQEHGRQHWKURXJK YDULRXVLQWHUIDFHVZLWKRXWSURJUDPPLQJ0DQ\GDWDEDVHSURJUDPVFRPHZLWKRUDOORZIRUZHEEDVHG LQWHUIDFHVWRHQWHUGDWD²IRULQVWDQFHWKHSRSXODUSKS0\$GPLQIRU0\64/²WKRXJK\RXPD\ILQGVXFK LQWHUIDFHVODFNLQJPDQ\RIWKHIHDWXUHV\RXDUHXVHGWRZLWKSURJUDPVUXQQLQJRQ\RXUSHUVRQDOFRPSXWHU OLNH$FFHVV([FHODQG)LOH0DNHU %XWVXFKZHEEDVHGLQWHUIDFHVDOORZHQWU\IURPDQ\FRPSXWHUZLWK DQ,QWHUQHWFRQQHFWLRQDQGDEURZVHUDQGKHQFHIDFLOLWDWHWKHGLVWULEXWLRQRIGDWDHQWU\$QRWKHU SRVVLELOLW\LVXVLQJVSHFLDOOLQNLQJVRIWZDUHWRRSHQDZHEVHUYHUGDWDEDVHRQ\RXUSHUVRQDOFRPSXWHU ZLWKLQ$FFHVV([FHORU)LOH0DNHU7KH2SHQ'DWDEDVH&RQQHFWLYLW\SURWRFRO 2'%& HQDEOHVGLIIHUHQW FOLHQWDQGVHUYHUGDWDEDVHVRIWZDUHWRIXQFWLRQVHDPOHVVO\WRJHWKHULQWKLVZD\,I\RXDUHSODQQLQJWR HQWHU\RXUGDWDRQO\RQFHLWPD\EHHDVLHUKRZHYHUMXVWWRUHFRUGLWDV\RXZRXOGLQRQHRIWKHHDV\WR XVHFOLHQWSURJUDPV OLNH$FFHVV DQGWKHQKDQGRIIDWDEGHOLPLWHGILOH DWH[WILOHZLWKWDEVVHSDUDWLQJ HDFKSLHFHRILQIRUPDWLRQZKLFKPRVWGDWDEDVHVOLNH$FFHVVFDQHDVLO\FUHDWH WR\RXUZHEVHUYHU DGPLQLVWUDWRUIRULQJHVWLQWRDZHEGDWDEDVH 7KH6WDWXHRI/LEHUW\²(OOLV,VODQG)RXQGDWLRQAmerican Family Immigration History CenterմOLQN $ PostgreSQLմOLQN$ /RFDOLWpV/RFDOLWLHVColes County Legal History ProjectմOLQN$ 8QLYHUVLW\RI0LQQHVRWDImmigration History Research CenterմOLQN$ MySQLմOLQN$ &HQWHUIRU+LVWRU\DQG1HZ0HGLDDQG$PHULFDQ6RFLDO+LVWRU\3URMHFWThe September 11 Digital ArchiveմOLQN$ KWWSFKQPJPXHGXGLJLWDOKLVWRU\DSSHQGL[SKS 'LJLWDO+LVWRU\_$SSHQGL[ Digital History: A Guide to Gathering, Preserving, and Presenting the Past on the Web Appendix: Database Software, Scripting Languages, and XML Scripting Languages 8QIRUWXQDWHO\JHWWLQJLQIRUPDWLRQLQWRWKHGDWDEDVHLVRQO\KDOIWKHEDWWOHWRXVLQJDGDWDEDVHRQD KLVWRULFDOZHEVLWH<RXQRZQHHGWREHDEOHWRH[WUDFWELWVRIWKLVLQIRUPDWLRQIRUPDWWKHPDQGLQVHUW WKHPLQWRZHESDJHVDVYLVLWRUVWR\RXUVLWHPDNHUHTXHVWV7KHGDWDEDVHVRIWZDUHLVPHUHO\LQWHUHVWHGLQ VWRULQJDQGVHUYLQJWKLVGDWDDQGFDQQRWGRWKLVWDVNIRU\RX1HLWKHUFDQ+70/ZKLFKLVDIDLUO\ ³GXPE´VHWRIWH[WWDJV,QVWHDG\RXPXVWUHO\RQRQHRIVHYHUDO³VFULSWLQJ´ODQJXDJHVWKDWNQRZKRZWR FRPPXQLFDWHZLWKWKHGDWDEDVHVRIWZDUH³6FULSWV´RUOLWWOHSURJUDPVWKDW\RXFDQSODFHHLWKHULQVLGHWKH +70/SDJHV\RXFRQVWUXFWRULQVHSDUDWHILOHVOLQNHGWRZHESDJHVDUHSURFHVVHGRQWKHIO\E\WKHZHE VHUYHUDQGFDQILOODSDJHZLWKLQIRUPDWLRQIURPDGDWDEDVH7KHUHDUHDVPDQ\VFULSWLQJODQJXDJHVDV GDWDEDVHVWKRXJK\RXRIWHQVHHFHUWDLQODQJXDJHVLQFRPELQDWLRQZLWKFHUWDLQGDWDEDVHV)RULQVWDQFH RQHRI0LFURVRIW¶VVFULSWLQJODQJXDJHV$FWLYH6HUYHU3DJHV $63 LVJHQHUDOO\XVHGZLWKRWKHU 0LFURVRIWSURGXFWVLQFOXGLQJ64/6HUYHU3+3 DVHOIUHIHUHQWLDODFURQ\PIRU3+3+\SHUWH[W 3UHSURFHVVRU WKHRSHQVRXUFHFRPPXQLW\¶VDQVZHUWR$63LVPRVWRIWHQXVHGZLWKWKHRSHQVRXUFH 0\64/DQG3RVWJUH64/GDWDEDVHV,QFRQWUDVW&ROG)XVLRQDSRSXODUVFULSWLQJV\VWHPIURP 0DFURPHGLDFDQEHIRXQGDWWDFKHGWRDZLGHYDULHW\RIGDWDEDVHV 7KHZRUGV³VFULSWV´DQG³VFULSWLQJ´VRXQGYHU\KXPDQLWLHVOLNHEXWWKHVHODQJXDJHVDUHIRUDOOLQWHQWV DQGSXUSRVHVSURJUDPPLQJODQJXDJHVPHDQLQJWKDWWKH\DUHPRUHGLIILFXOWWRSLFNXSWKDQ+70/DQG IDUOHVVIRUJLYLQJWRKXPDQHUURU,I\RXQHHGVFULSWVWRDFFHVVDGDWDEDVH\RXVKRXOGFRQVLGHUKLULQJD SURJUDPPHUZKRNQRZVRQHRIWKHVHODQJXDJHVZHOO*RDERXWGHVLJQLQJDQGEXLOGLQJ\RXUVLWHZLWKRXW WKHPDWHULDOVIURPWKHGDWDEDVH²OHDYLQJURRPLQ\RXUGHVLJQ³WHPSODWHV´IRUWKRVHLWHPV²DQGWKHQ EULQJLQDSURJUDPPHUIRUDGD\RUWZRWRZULWHSLHFHVRIWHFKQLFDOFRGHWKDWZLOODGGWKHGDWDEDVH HOHPHQWV$SURJUDPPHUZKRNQRZVKRZWRVWUXFWXUHDGDWDEDVHSURSHUO\IRU\RXUFROOHFWLRQRI KLVWRULFDOLWHPVDQGKRZWRZULWHWKHVFULSWVWRSODFHWKRVHLWHPVLQWR\RXUGHVLJQWHPSODWHVVKRXOGFRVW DURXQGSHUKRXU JHQHUDOO\DPLQLPXPRIIRUDEDVLFVHWXSFRPSOH[ZHEVLWHVOLNH (OOLV,VODQGRUJUHTXLUHZHHNVLIQRWPRQWKVRIGDWDEDVHDQGSURJUDPPLQJZRUN 5HJDUGOHVVRIZKRGRHVWKHWHFKQLFDOZRUN\RXVKRXOGVWDUWE\RXWOLQLQJWKHVSHFLILF³WDEOHV´IRUWKH LQIRUPDWLRQ\RXZDQWWRVWRUH(DFKWDEOHVLPLODUWRDVSUHDGVKHHWLQ([FHOKROGVDSDUWLFXODUNLQGRI LQIRUPDWLRQ²IRULQVWDQFHDOLVWRIDKLVWRULFDORUJDQL]DWLRQ¶VPHPEHUVRUWKHSLHFHVRIGDWDDERXWOHWWHUV LQDQDUFKLYH(YHQZLWKRXWIXOO\XQGHUVWDQGLQJGDWDEDVHVRIWZDUH\RXFDQSUREDEO\GUDIWWKHILHOGVRI HDFKWDEOHODVWQDPHILUVWQDPHPHPEHUVKLSUHQHZDOGDWHDQGVRRQIRUDPHPEHUVKLSUROODXWKRU GDWHZULWWHQWRZKRPWKHOHWWHUZDVVHQWERG\RIWKHWH[WDQGVRRQIRUDOHWWHU2QFHLQWKHGDWDEDVH HDFKRIWKHVHILHOGVZLOOEHVHDUFKDEOHLQGLYLGXDOO\DVZHOODVLQWDQGHPZLWKRWKHUILHOGV)URPWKLVOLVW RIILHOGV RU³FROXPQV´ \RXRU\RXUSURJUDPPHUFDQSURFHHGWRVHWXSWKHIUDPHZRUNRIWKHGDWDEDVH LQWRZKLFKVSHFLILFUHFRUGV DOVRFDOOHG³URZV´ ZLOOJR5HPHPEHU\RX RU\RXUVWDII ZLOOVSHQGPRVWRI \RXUWLPHILOOLQJWKHGDWDEDVHUDWKHUWKDQFUHDWLQJLWLQWKHILUVWSODFHEXW\RXVKRXOGVWDUWE\WKLQNLQJ DERXWZKLFKILHOGVWRVHSDUDWHRXW\RXZLOOKDYHWURXEOHLI\RXGHFLGHODWHUWKDWPHPEHUV¶ODVWQDPHV VKRXOGEHLQDVHSDUDWHILHOGIURPWKHLUILUVWQDPHV KWWSFKQPJPXHGXGLJLWDOKLVWRU\DSSHQGL[SKS 4 'LJLWDO+LVWRU\_$SSHQGL[ 7REHPRUHVSHFLILFDKLVWRULFDOVRFLHW\¶VPHPEHUVKLSUROOLQDGDWDEDVHPLJKWORRNDVIROORZV ILUVWBQDPH ODVWBQDPH PHPEHUBVLQFH GXHV &KDUOHV %HDUG )UHGHULFN 7XUQHU