A Morphological Analyser for Crimean Tatar
Total Page:16
File Type:pdf, Size:1020Kb
A Morphological Analyser for Crimean Tatar .HPDO $OWLQWDV ,O\DV &LFHNOL NHPDO#FVELONHQWHGXWU LO\DV#FVELONHQWHGXWU %LONHQW 8QLYHUVLW\ 'HSDUWPHQW RI &RPSXWHU (QJLQHHULQJ %LONHQW $QNDUD 7XUNH\ $EVWUDFW 7KLV SDSHU GHVFULEHV WKH GHWDLOV RI D PRUSKRORJLFDO DQDO\VHU GHVLJQHG IRU &ULPHDQ 7DWDU ODQJXDJH 7KH V\VWHP LV EDVHG RQ WZROHYHO PRUSKRORJ\ DQG LPSOHPHQWHG XVLQJ ;(52; ILQLWH VWDWH WRROV 7KH SKRQRORJLFDO UXOHV WKDW JRYHUQ WKH GLIIHUHQWLDWLRQ RI VRXQGV DUH H[SODLQHG LQ GHWDLOHG 7KHQ WKH PRUSKRWDFWLF UXOHV WKDW RUJDQLVH WKH &ULPHDQ 7DWDU PRUSKHPH RUGHUV DUH JLYHQ $ EULHI FRPSDULVRQ RI 7XUNLVK DQG &ULPHDQ 7DWDU LV IROORZHG E\ VRPH H[DPSOHV RI WKH SURJUDP RXWSXWV , ,QWURGXFWLRQ 7KH ODQJXDJH VSRNHQ E\ &ULPHDQ 7DWDUV LV DFWXDOO\ D SDVVDJH EHWZHHQ 2JKX] RULHQWHG $QDWROLDQ 7XUNLVK DQG .LSFKDN RULHQWHG ODQJXDJHV VXFK DV .D]DQ 7DWDU DQG .D]DNK.LUJL] +DYLQJ FORVH KLVWRULFDO UHODWLRQV ZLWK 2WWRPDQ (PSLUH &ULPHDQ 7DWDU SHRSOH VSHDN D ODQJXDJH WKDW LV LQWHOOLJLEOH WR $QDWROLDQ 7XUNV +RZHYHU WKH .LSFKDN JUDPPDU UXOHV DQG ZRUGV DUH QRW QHJOLJLEOH >@ 7KHUH DUH WKUHH PDLQ GLDOHFWV RI &ULPHDQ 7DWDU 1RUWKHUQ GLDOHFW ZKLFK LV FDOOHG ³o|O úLYHVL´ VWHSSH GLDOHFW LQ &ULPHDQ 7DWDU VKRZV PXFK PRUH .LSFKDN SURSHUWLHV DQG LV FORVH WR .D]DNK DQG .LUJL] 7KH FHQWUDO GLDOHFW LV FDOOHG ³%DKoHVDUD\ úLYHVL´ UHIHUHQFLQJ %DKoHVDUD\ WKH FDSLWDO FLW\ RI &ULPHDQ .KDQDWH DQG LV WKH EDVLF OLWHUDU\ GLDOHFW 7KH VRXWKHUQ GLDOHFW LV ³<DOÕER\X úLYHVL´ FRDVWDO GLDOHFW DQG LV YHU\ FORVH WR $QDWROLDQ 7XUNLVK >@ ,Q WKLV SURMHFW ZH LPSOHPHQWHG WKH V\VWHP FRPSDWLEOH ZLWK %DKoHVDUD\ GLDOHFW VLQFH LW LV WKH OLWHUDU\ ODQJXDJH 7KURXJKRXW WKH SDSHU WKH WHUP &ULPHDQ 7DWDU PHDQV ³%DKoHVDUD\ GLDOHFW RI &ULPHDQ 7DWDU ODQJXDJH´ DQG WKH WHUP 7XUNLVK PHDQV ³OLWHUDU\ 7XUNLVK ODQJXDJH VSRNHQ LQ 7XUNH\´ 0RVW RI WKH URRW ZRUGV LQ &ULPHDQ 7DWDU DUH FRPPRQ ZLWK 7XUNLVK > @ +RZHYHU WRGD\ WKH GLIIHUHQFHV ERWK LQ URRWV DQG LQ JUDPPDWLFDO UXOHV DUH QRW QHJOLJLEOH 0DQ\ ZRUGV HVSHFLDOO\ LQ 1RUWKHUQ GLDOHFW DUH FRPSOHWHO\ GLIIHUHQW IURP $QDWROLDQ 7XUNLVK $]EDU DYOX \DUG .|NUHN J|÷V FKHVW <HQJLO KDILI OLJKW 0DQ\ ZRUGV DUH SUHVHQW LQ ERWK ODQJXDJHV KRZHYHU WKH\ PHDQ GLIIHUHQW ³7DúODPDT´ LQ &ULPHDQ 7DWDU PHDQV WR OHDYH VRPHWKLQJ DW VRPHZKHUH KRZHYHU LQ 7XUNLVK ³WDúODPDN´ LV WR VWRQH ³6DOPDT´ LQ &ULPHDQ 7DWDU LV WR SXW RU DGG DQG ³VDOPDN´ LQ 7XUNLVK LV WR OHW VRPHWKLQJ JR 7KHUH DUH PDQ\ YDULDQFHV EHWZHHQ WKH JUDPPDUV RI 7XUNLVK DQG &ULPHDQ 7DWDU )RU H[DPSOH WKH VHFRQG WHQVH RI D YHUE LV ZULWWHQ DV D VHSDUDWH ZRUG LQ &ULPHDQ 7DWDU ZKLOH LW LV MRLQHG WR WKH URRW LQ 7XUNLVK $OVR WKH QDUUDWLYH VXIIL[ LQ &ULPHDQ 7DWDU LV ±JHQ RU LWV HTXLYDOHQWV DFFRUGLQJ WR KDUPRQ\ UXOHV ZKLOH QDUUDWLRQ LV H[SUHVVHG ZLWK ±PLú RU ZLWK LWV HTXLYDOHQFH FODVV LQ 7XUNLVK )RU H[DPSOH ³NHOJHQ HGL´ LV ZULWWHQ DV ³JHOPLúWL´ KH KDG FRPH LQ 7XUNLVK /LYLQJ XQGHU 5XVVLDQ UXOH IRU PRUH WKDQ WZR FHQWXULHV WKH HIIHFWV RI 5XVVLDQ LV KHDYLO\ IHOW RYHU &ULPHDQ 7DWDUV 1RW RQO\ WKHUH DUH PDQ\ ZRUGV GHULYHG IURP 5XVVLDQ VRPHWLPHV HYHQ 5XVVLDQ JUDPPDWLFDO UXOHV DUH DSSOLHG WR &ULPHDQ 7DWDU ZRUGV +RZHYHU VLQFH WKHVH DUH QRW YDOLG VWUXFWXUHV IRU &ULPHDQ 7DWDU WKH\ KDYH QRW EHHQ FRQVLGHUHG IRU WKH V\VWHP ZH GHYHORSHG :RUGV HVSHFLDOO\ UHODWHG WR WHFKQRORJ\ DQG XVXDOO\ WKH FRXQWHUSDUWV RI 7XUNLVK ZRUGV WKDW FRPH IURP ZHVWHUQ ODQJXDJHV DUH PRVWO\ GHULYHG IURP 5XVVLDQ 6RPH H[DPSOHV DUH 7HOHYL]RU WHOHYL]\RQ WHOHYLVLRQ $YWREXV RWREV EXV 3HoTD SHoND VRED VWRYH 7KH UHVW RI WKH SDSHU LV RUJDQL]HG DV IROORZV WKH QH[W VHFWLRQ JLYHV D EULHI H[SODQDWLRQ RI WZROHYHO PRUSKRORJ\ 7KH IROORZLQJ VHFWLRQ JLYHV WKH &ULPHDQ 7DWDU DOSKDEHW DQG WKH IRXUWK VHFWLRQ OLVWV WKH YRZHO DQG FRQVRQDQW KDUPRQ\ UXOHV 7KH ILIWK VHFWLRQ H[SODLQV WKH PRUSKRWDFWLFV IRU &ULPHDQ 7DWDU DQG WKH VL[WK VHFWLRQ FRPSDUHV 7XUNLVK DQG &ULPHDQ 7DWDU JUDPPDUV 7KH VHYHQWK VHFWLRQ VXPPDULVHV WKH LPSOHPHQWDWLRQ RI WKH SURJUDP ZLWK VHYHUDO H[DPSOH UXQV DQG WKH SDSHU HQGV ZLWK D FRQFOXVLRQ VHFWLRQ ,, 2YHUYLHZ RI 7ZR/HYHO 0RUSKRORJ\ 7ZROHYHO PRUSKRORJ\ LV D ZD\ RI KDQGOLQJ PRUSKRORJLFDO VWUXFWXUHV E\ H[HFXWLQJ SVHXGRSDUDOOHO UXOHV>@ 7KHUH DUH WZR OHYHOV RI WKH V\VWHP VXUIDFH OHYHO DQG OH[LFDO OHYHO 6XUIDFH OHYHO UHSUHVHQWDWLRQ LV WKH GLUHFW UHSUHVHQWDWLRQ RI DQ LQSXW DV LW LV UHSUHVHQWHG LQ WKH RULJLQDO ODQJXDJH /H[LFDO OHYHO LV WKH GHFRPSRVHG IRUP RI WKH LQSXW DQG LV WKH RXWSXW RI WKH V\VWHP ZKHQ WKH VXUIDFH UHSUHVHQWDWLRQ LV JLYHQ DV DQ LQSXW ,Q D ILQLWH VWDWH WUDQVGXFHU QRUPDOO\ WKH VXUIDFH DQG OH[LFDO OHYHOV DUH UHSUHVHQWHG DV WZR H[SUHVVLRQV VHSDUDWHG E\ D FRORQ )RU H[DPSOH DQ H[SUHVVLRQ OLNH DE LV XVXDOO\ H[SHFWHG WR PHDQ ³OH[LFDO IRUP D LV GHULYHG IURP WKH VXUIDFH IRUP E´ 5XOHV WKDW GHQRWH WKH PRUSKRORJLFDO PRGLILFDWLRQV DQG YDULDWLRQV DUH DOO H[HFXWHG LQ SDUDOOHO DQG DOO WKH UXOHV ZRUN RQ WKH VDPH LQSXW ,I DOO RI WKH UXOHV DFFHSW WKH LQSXW WKHQ WKH PDFKLQH DFFHSWV WKH LQSXW +RZHYHU LI WKH LQSXW LV UHMHFWHG E\ DQ\ RI WKH UXOHV WKHQ WKH PDFKLQH UHMHFWV WKH LQSXW GLUHFWO\ 7KHUH DUH IRXU GLIIHUHQW UXOH W\SHV LQ VXFK D V\VWHP DE ! /& B 5& /H[LFDO D LV PDSSHG WR VXUIDFH E LI LW DSSHDUV LQ WKHVH OHIW DQG ULJKW FRQWH[WV +RZHYHU LWV DSSHDULQJ LQ WKLV FRQWH[W GRHV QRW UHTXLUH VXFK D PDSSLQJ ,Q RWKHU ZRUGV LI D LV PDSSHG WR E WKHQ LW PXVW EH LQ WKLV FRQWH[W DQG FDQQRW KDSSHQ LQ DQRWKHU FRQWH[W DE /& B 5& OH[LFDO IRUP D LV PDSSHG WR VXUIDFH IRUP E LI LW DSSHDUV LQ /& DQG 5& +RZHYHU LW LV DOVR SRVVLEOH WR PDS D WR E LQ DQRWKHU FRQWH[W DE !/&B5&DOH[LFDO D LV DOZD\V PDSSHG WR D VXUIDFH E LQ WKLV FRQWH[W DQG WKLV LV SRVVLEOH RQO\ LQ WKLV FRQWH[W DE /& B 5& D OH[LFDO D LV QHYHU PDSSHG WR D VXUIDFH E LQ WKH JLYHQ FRQWH[W 7KH PRUSKRWDFWLF UXOHV DUH FRPSLOHG WR D ILQLWH VWDWH WUDQVGXFHU DQG DUH MRLQHG ZLWK WKHVH UXOHV 7KH V\VWHP DV D ZKROH WULHV WR ORFDWH WKH URRWV DQG SRVVLEOH IROORZLQJ VXIIL[HV IRU D JLYHQ VXUIDFH IRUP LQSXW ,I WKH V\VWHP DW DQ\ VWDJH FDQQRW ORFDWH D YDOLG VXIIL[ RU LW GLVFRYHUV D VLWXDWLRQ YLRODWLQJ WKH PRUSKRORJLFDO PRGLILFDWLRQ UXOHV LW UHWXUQV ZLWK QR DQVZHU )RU D GHWDLOHG H[SODQDWLRQ RI WZROHYHO PRUSKRORJ\ VHH >@ ,,, 7KH $OSKDEHW $V LW LV WKH FDVH IRU DOO 7XUNLF ODQJXDJHV &ULPHDQ 7DWDU ZDV DOVR ZULWWHQ XVLQJ WKH $UDELF 6FULSW LQ WKH EHJLQQLQJ RI WZHQWLHWK FHQWXU\ $IWHU WKH IRUPDWLRQ RI 6RYLHW UXOH WKH &\ULOOLF DOSKDEHW RI 5XVVLDQ ODQJXDJH ZDV VWDUWHG WR EH XVHG 1RZ D /DWLQ EDVHG DOSKDEHW ZKLFK LV WKH VDPH DV 7XUNLVK DOSKDEHW ZLWK IHZ DGGLWLRQV ZDV DFFHSWHG E\ WKH &ULPHDQ 7DWDU 1DWLRQDO $VVHPEO\ DQG LV EHLQJ XVHG 7KH /DWLQ EDVHG &ULPHDQ 7DWDU DOSKDEHW LV $D Æk %E &F do 'G (H )I *J ö÷ +K ,Õ øL -M .N /O 0P 1Q fx 2Rg| 3S 4T 5U 6V ùú 7W 8X h 9Y <\ =] ,Q WKH SURJUDP WKH OHWWHUV WKDW DUH SUHVHQW LQ WKH $6&,, FKDUDFWHUV DUH XVHG DV LV LQ ORZHUFDVH %RWK LQ VXUIDFH IRUP DQG OH[LFDO IRUP ZH UHSUHVHQWHG WKH OHWWHUV ZKLFK DUH DEVHQW LQ $6&,, ZLWK WKH FDSLWDO IRUP RI WKH FORVHVW V\PERO 7KH FRUUHVSRQGHQFHV DUH DV IROORZV o±&÷±* Õ±, |±2 ú±6 ±8 x±1 $W WKH OH[LFDO OHYHO KRZHYHU ZH QHHG WRXVH VRPH H[WUD FKDUDFWHUV WRUHSUHVHQW RQHWRPDQ\ PDSSLQJV DQG H[FHSWLRQV )RU WKLV SXUSRVH ZH XVH WKH IROORZLQJ FDSLWDO OHWWHUV ZKLFK DUH XVHG RQO\ LQ WKH SURJUDP DQG DUH LQYLVLEOH WRWKH XVHU - ± o WKDW GRHV QRW FKDQJH WR F N8-8 N8&8 3 ± S WKDW GRHV QRW FKDQJH WR E VD3, VDS, 4 ± T WKDW GRHV QRW FKDQJH WR ÷ ED4D EDTD 7 ± W WKDW GRHV QRW FKDQJH WR G EH7 L EHWL : ± N WKDW GRHV QRW FKDQJH WR J WH:L WHNL + ± FRUUHVSRQGV WR V\PEROV , L X 8 DFFRUGLQJ WR YRZHO KDUPRQ\ $ ± FRUUHVSRQGV WR D RU H DFFRUGLQJ WR YRZHO KDUPRQ\ UXOHV < ± FRUUHVSRQGV WR X RU 8 DFFRUGLQJ WR YRZHO KDUPRQ\ UXOHV . ± FRUUHVSRQGV WR J N * T DFFRUGLQJ WR FRQVRQDQW KDUPRQ\ UXOHV ' ± FRUUHVSRQGV WR D G RU W DFFRUGLQJ WR FRQVRQDQW KDUPRQ\ UXOHV = ± V WKDW GRHV QRW GURS DV D MRLQLQJ VRXQG DOLP =Lx DOLPVLQ :H DOVR XVH WKH IROORZLQJ JURXSLQJV LQ WKH WZR OHYHO PRUSKRORJ\ UXOHV 7KH YRZHOV DUH 92:(/ DH,LR2X8$+0<k 7KH FRQVRQDQWV DUH &216 EF&GIJ*KMNOPQ1STUV6WY\].=%34-: 7KH RWKHU JURXSLQJV DUH DV IROORZV %DFN 9RZHO %$&.9 D,XRk )URQW 9RZHO )52179 HL28 )URQW 8QURXQGHG 9RZHO )581529 L H )URQW 5RXQGHG 9RZHO )5529 2 8 %DFN 5RXQGHG 9RZHO %.529 X R %DFN 8QURXQGHG 9RZHO %.81529 D,k 6RIW &RQVRQDQWV 6('$/, EFGJ*MY]OPQ1U\K% +DUG &RQVRQDQWV 6('$6,= S&WNT6IV=34-: -RLQLQJ &RQVRQDQWV ; V \ ,9 9RZHO DQG &RQVRQDQW +DUPRQ\ 5XOHV $ UHDOL]HG DV D $D ! >%$&.9@ >&216@ >&216 _ &216 _ @ B $IWHU D EDFN YRZHO WKH IROORZLQJ $ PXVW EH UHSUHVHQWHG DV DQ D EDOD O$U ! EDODODU oRFXNODU ± NLGV TR\ O$U ! TR\ODU NR\XQODU VKHHS $ UHDOL]HG DV H $H ! >)52179@ >&216@ >&216 _ &216 _ @ B 6LPLODU WR WKH IROORZLQJ UXOH WKLV IROORZV WKH JUDPPDU UXOH VWDWLQJ WKDW IURQW YRZHOV DUH WR IROORZ IURQW YRZHOV N2\ O$U ! N2\O0U N|\OHU ± YLOODJHV J8O '$Q ! J8OG0Q JOGHQ ± IURP WKH URVH $ UHDOL]HG DV \ $\ ! >92:(/@ B ,Q &ULPHDQ 7DWDU SUHVHQW SURJUHVVLYH WHQVH VXIIL[ LV ±\ DQG IXWXUH VXIIL[ LV \F$. LI WKH URRW HQGV LQ D YRZHO VRUD $ !VRUD \ VRUX\RU ± VKH LV DVNLQJ TRU&DOD $F$. !TRU&DOD \FDT NRUX\DFDN ± VKH ZLOO SURWHFW + UHDOL]HG DV X +X ! >&216@ >%.529@ >&216@ >&216 _ &216 _ @ B ,I WKHUH LV RQO\ RQH V\OODEOH LQ WKH URRW ZKLFK PHDQV WKHUH LV RQO\ RQH YRZHO EHIRUH + DQG LI LW FRPHV DIWHU D EDFN URXQGHG YRZHO R X LW LV UHVROYHG WR X VR1+QF+ ! VR1:QF, VRQXQFX ± WKH ODVW + UHDOL]HG DV 8 +8 ! >&216@ >)5529@ >&216@ >&216 _ &216 _ @ B ,Q RWKHU FDVHV QDPHO\ + FRPLQJ LQ WKH VHFRQG V\OODEOH DQG IROORZLQJ D IURQW URXQGHG YRZHO 8 2 LW LV UHVROYHG WR 8 N2\ =+]! N2\V &] N|\V]± ZLWKRXW D YLOODJH 8& +QF+ ! 8&&QFL oQF ± WKH WKLUG + UHDOL]HG DV L +L ! >92:(/@ >&216@ >&216 _ &216 _ @ >)52179@ >&216@ >&216 _ &216 _ @ B >&216@ >)52179@ >&216@ >&216 _ &216 _ @ B ,Q &ULPHDQ 7DWDU ODQJXDJH WKH X DQG LQ VXIIL[HV FDQ DSSHDU RQO\ LQ WKH VHFRQG V\OODEOH DQG IRU WKH VDPH VXIIL[ LW LV ZULWWHQ DV Õ RU L LQ WKH WKLUG DQG WKH ODWHU V\OODEOHV )HZ H[FHSWLRQDO PRUSKHPHV VXFK DV SDVW PRUSKHPH ±GL DQG DFFXVDWLYH PRUSKHPH ±QL DUH PRVW RI WKH WLPH ZULWWHQ ZLWK ÕL HYHQ LI WKH\ DSSHDU LQ WKH VHFRQG V\OODEOH +HUH DUH WZR UXOHV RSHUDWLRQJ LQ SDUDOOHO 7KH ILUVW UXOH FKHFNV ZKHWKHU WKHUH DUH DW OHDVW WZR V\OODEOHV ,I WKHUH DUH WKHQ + LV UHVROYHG WR L DIWHU DOO IURQW YRZHOV QDPHO\ H L 2 8 ,I WKHUH LV RQH V\OODEOH WKHQ WKH VHFRQG UXOH UXQV DQG PDSV + WR L DIWHU RQO\ IURQW XQURXQGHG YRZHOV N2U '+ ! N2UGL J|UG ± VKH VDZ V8W V+] O+.