Tour de CLARIN CLARIN Common Language Resources and Technology Infrastructure

Written by Barbora Hladka, Darja Fišer and Jakob Lenardič, and edited by Darja Fišer and Jakob Lenardič Foreword

Tour de CLARIN highlights prominent user involvement activities of CLARIN national consortia with the aim to increase the visibility of CLARIN consortia, reveal the richness of the CLARIN landscape, and display the full range of activities throughout the CLARIN network that can inform and inspire other consortia as well as show what CLARIN has to offer to researchers, teachers, students, professionals and the general public interested in using and processing language data in various forms.

This brochure presents Czech Republic and is organized in five sections:

• Section One presents the members of the consortium and their work • Section Two demonstrates an outstanding tool • Section Three highlights a prominent resource • Section Four reports on a successful event for researchers and students • Section Five includes an interview with a renowned researcher from the digital humanities or social sciences who has successfully used the consortium’s infrastructure in their research

FOREWORD 3 Prague, Czech Republic | photo by Rodrigo Ardilha | Unsplash Czech Republic

LINDAT Team | Back row: Pavel Straňák, Jaroslava Hlaváčová, Pavel Pecina, David Mareček, Ondřej Bojar, Jan Hajič, Milan Written by Darja Fišer and Jakob Lenardič Fučík. Front row: Barbora Hladká, Anna Nedoluzhko, Vendula Kettnerová, Eva Hajičová (national coordinator), Anna Vernerová, Veronika Kolářová, Magda Ševčíková, Marie Křížková. The Czech consortium LINDAT1 is a founding member of CLARIN ERIC. It is a B-certified LINDAT actively works on centre that involves four Czech research introducing its state-of-the- institutions – the Department of Cybernetics art language technologies at the University of West Bohemia, the to researchers both within Institute of Formal and Applied Linguistics computational fields like at Charles University, the Czech Language NLP and within the digital Institute at the Czech Academy of Science, humanities and social and the NLP Centre at Masaryk University. sciences. To this end, The consortium is led by Professor Eva LINDAT organised a user Hajičová. involvement workshop on 24 April 2018 in Prague, The consortium offers a pioneering repository for language resources, whose architecture serves as which aimed to showcase the backbone of several other CLARIN repositories. The repository rigorously follows best practices how technological on metadata presentation, so it is ensured that all language data are safely stored with clear infrastructures are also documentation as well as outfitted with guidelines on proper citation. Many of the monolingual, relevant beyond the parallel and speech corpora within the repository can be accessed through the concordancer KonText, computational framework. which is a flexible search environment that allows users to perform queries of various complexities – You can read more about from simple searches by lemma or word form to using CQL – as well as save search results for future the workshop on page 10. research.

LINDAT also offers an integrated environment for storing, building, searching and visualising treebanks, which are databases of syntactically annotated sentences. As a pivotal tool for treebanks, LINDAT offers PLM Tree Query, through which researchers can browse a great variety of treebanks in 61 languages. For the novice researcher, the Tree Query is accompanied by a step-by-step tutorial that shows how to execute searches in the query language. Together with the Norwegian INESS, LINDAT is a CLARIN Knowledge Centre that specialises in the creation and maintenance of treebanks.

1 https://lindat.mff.cuni.cz/en

4

Prague, Czech Republic | photo by Studio Reasons | Unsplash 6 Czech Republic Written by Barbora Hladka and Jakob Lenardič, Lenardič, Jakob UDPipe and Hladka Barbora by Written UDPipe 2 as more complex set ofgrammatical features, suchascase, person, gender, andtense (Figure 2). 1), orintable form, where each individualword isaccompanied by its Part-of-Speech labelaswell either bevisualisedintheform ofatree structure, whichshows thesyntactic dependencies(Figure models andinputthetext (orupload wishto wholefiles)they have annotated. Theresults can the sensethat researchers needonlyselect oneofthemanylanguages inoneofthethree training The UDPipeWebApplication isprovided through theLINDAT architecture. easy to Itisvery usein are describedin detail intheUDPipeUser’s Manual: own computers must alsodownload oneoftheUniversal Dependencieslanguage models,which to-use web application. Researchers whowishto runUDPipeasastandalone program ontheir inprogrammingOS X,asalibrary languages suchasC++,Python,Perl, R,Java, C#,andasaneasy- UDPipe isavailable both asadownloadable program that iscompatible Windows and withLinux, Applied Linguistics at CharlesUniversity, andcan befreely usedfor non-commercial purposes. Arabic, Irish,IndonesianandTamil. at developed Itwas theInstitute (andisbeing) ofFormal and annotate andparse texts from over 50languages, manyofwhichare non-Indo-European, suchas by LINDAT (seepage 8for apresentation oftheUniversal Dependencies).UDPipecan beusedto network andistrained onlanguage modelsfrom theUniversal treebanks Dependency provided parsing, allto ahighdegree ofprecision. Thearchitecture of UDPipeemploys adeepneural tokenisation, Part-of-Speech tagging, lemmatisation, sentence segmentation anddependency CZECH REPUBLIC | constituents. sentential structure, thetree structure alsoshows theparts ofspeechandsyntactic features ofthe Figure 1:Thetree structure ofacomplex English raising construction. Apart from visualisingthe http://lindat.mff.cuni.cz/services/udpipe/ • • • 2 isastate-of-the-art tool pipelinewhichperforms several complex annotation tasks: Universal Dependencies2.0models. the CoNLL17Shared Task BaselineUD2.0models,whichcontain adifferent version ofthe contain annotation modelsfor over 50languages; and the Universal Dependencies2.0models,whichare an updated version oftheformer and treebank annotation modelsfor 33languages; the Universal Dependencies1.2models,whichcontain cross-linguistically consistent TOOL edited by by edited Darja Fišer Darja Straka, M.,Hajič,J., andStraková, J. (2016).UDPipe:Trainable Pipelinefor Processing CoNLL-U Straka, M.andStraková, J. (2017).Tokenizing, POSTagging, Lemmatizing andParsing UD2.0 For more details onUDPipeseeStraka andStraková (2017)andStraka et al.(2016): baseline system. and parse languages. new TheCoNLL2018isafollow-up ofCoNLL2017andUDPipeisusedasa highprecision, whichshows thatmodels withvery UDPipecan alsobeeasily adapted to annotate tasks, UDPipewas usedto process raw text in40+languages based ontheUniversal Dependency of crucialimportance for andresearch thedevelopment parsing. ofdependency Intheshared The powerful flexibility ofUDPipewas demonstrated intheCoNLL2017shared task, whichwas infinitive inthesubordinate clause. in table form. Note that itcan detect complex very features, suchastheperfect (i.e. past tense) useofthe Figure 2:UDPipeshows thegrammatical features ofthesentence "John happy to have isvery met Mary" udpipe.pdf (LREC 2016),Portorož, , May2016. http://ufal.mff.cuni.cz/~straka/papers/2016-lrec_ Proceedings oftheTenth International Conference onLanguage Resources andEvaluation Files Performing Tokenization, Morphological Analysis,POSTagging and Parsing. In papers/2017-conll_udpipe.pdf to Universal Dependencies,Vancouver, Canada,August 2017. http://ufal.mff.cuni.cz/~straka/ with Udpipe.InProceedings oftheCoNLL2017Shared Task: MultilingualParsing from Raw Text CZECH REPUBLIC | TOOL 7 8 Czech Republic CZECH REPUBLIC | Universal Dependencies(UD) 3 formal grammar, suchascase assignment/checking. nominal modifiers, whichoften also take into account complex grammatical interdependencies from numerous languages. Thefollowing figure illustrates thecomplex criteria UDusesto recognise UD isalsoaccompanied by detailed outtheannotation, guidelinesfor carrying withexamples from and punct (punctuation) –occur inthetree. (punctuation) –andfour syntactic relations –root (predicate), nsubj(nominalsubject), obj(object), loves John”. Three part-of-speech categories –PROPN(proper name),VERB(verb), andPUNCT the grammatical features. Thefollowing picture shows aUDtree structure for thesentence “Mary cross-linguistic annotation, aswell asseveral existing treebanks that are richlyannotated with UD provides auniversal ofpart-of-speech inventory categories andsyntactic relations for consistent project hasbeenupandrunning since thespringof2014. possible. UDisadministered by aninternational team ofJoakim Nivre. TheUD undersupervision Lenardič auniversaldevelop approach to grammatical annotation, applicable to asmanylanguages as Jakob and Fišer Processing (NLP).Its motivation comes from multi-andcross-lingual research, andits goal isto Darja by Universal Dependencies(UD) edited Hladka, Barbora by Written http://universaldependencies.org/ RESOURCE Figure 3:Asyntactic loves tree John". for "Mary 3 is anopencollaboration project inthefieldofNatural Language in UD. nominal modifier definition ofa Figure 4:The used asmodelsfor ofadvanced thedevelopment parsers. dependency inMay2017,andtheCoNLL2017 and2018Shared Tasks, inwhichtheUDtreebanks were successfully was atutorial onUDat theEACL 2017conference inValencia in Spain, thefirst workshop onUDinGothenburg in conducting parsing experiments withUDtreebanks, aswell asdiscussions ofUD-related topics. Amongthese After aperiodof rapid growth in2014–2017, LINDAT organisedevents aseriesof dedicated to training and are downloadable from theLINDAT/CLARIN repository. release in2014,whichshows language how theinclusionofnew data isgrowing exponentially. Alltheversions 60. Thisversion offers a ten timesgreater numberoftreebanks for sixtimesmore first languages thanthe very 2017 andconsists ofanimpressive numberoftreebanks, 102,for anequallyimpressive numberoflanguages, versionA new oftheUDtreebanks sixmonths. Thelatest isreleased every version (2.1)came outat theendof Figure 5:Using theeditor TrEd to parse aCzech sentence. used to annotate thousandsofsentences inthePrague Treebanks. Dependency The editor, whichoffers an extension for UDannotation illustrated inthe following picture, hasbeensuccessfully programmable editor oftree andviewer structures at developed theInstitute ofFormal andAppliedLinguistics. interfaces for manualUDannotation are alsoavailable. OneofthemisTrEd, whichisafullycustomisable and the treebanks, soitoffers an easy access point to theUniversal Dependencies.Anumberofgraphical user (presented onpage 6),whichisanautomatic UDannotation pipelinethat usesmodelstrained for nearly all To search the UDtreebanks, researchers can usetheonlinePML-TQ (PMLTree andUDPipe service Query) CZECH REPUBLIC | RESOURCE 9 10 Czech Republic Written by Barbora Hladka, edited by Darja Fišer and Jakob Lenardič Jakob and Fišer Darja by edited Hladka, Barbora by Written 2018 DARIAH-CZ WorkshoponDigital Humanities 4 collaboration. researchopening new avenues for further and other national andinternational institutions, the Czech consortium, CLARIN its related partners it strengthened thetiesamongmembers of in thecontext ofdigital humanities.Inaddition, the proposed DARIAH-CZ andits related projects The workshop successfully raised awareness of application ofcomputational methods withinthehumanitiesandsocialsciences: In conclusion oftheworkshop, thefollowing projects were presented to showcase thesuccessful digital tools. to thepresentation andinterpretation ofHolocaust-related archival documents onthebasis of project. Theafternoon session was concluded withalecture onEHRI,whichisaportal dedicated the recently established Czech for Association Digital Humanities, whichwillbeapartner inthe a comprehensive presentation oftheLINDAT/CLARIN andSilvieCinková repository introduced to beintegrated inDARIAH-CZ were presented. Perhaps most prominently, Pavel Straňák gave Austrian Centre for Digital Humanities).Intheafternoon, theCzech projects that are planned the DARIAH-CZ project both structurally (DARIAH, DARIAH-PL, DESIR)andthematically (EADH, The workshop began withtheintroduction oftheEuropean projects and,institutes related to institutions whilesomealsocame from Slovakia, , , andGermany. attended. There were around 70participants, most ofwhomwere researchers from various Czech researchers working at leading Czech andEuropean research institutions. Theworkshop was well the workshop, sixteen lectures were given by prominent computational anddigital humanities within humanitiesandsocialsciences, both intheCzech Republic andinternationally. During Czech Republic in order to introduce theproject andgenerally promote computational approaches on Digital Humanities2018 humanities. Inlightoftheproposal, international aone-day workshop titledDARIAH-CZ Workshop establish DARIAH-CZ, aCzech nodeoftheDARIAH European researcher infrastructure for arts and The members andpartners oftheCzech consortium CLARIN recently submitted aproposal to CZECH REPUBLIC | https://www.lib.cas.cz/en/dariah-cz-workshop-2018/ • • • • correspondence from theearly 17thto themid-19thcenturies. Electronic Enlightenment, whichisawide-ranging onlinecollection ofedited historical text collections; and the READproject andits mainsystem, Transkribus, for transcribing andsearching integrate digital resources onCzech archaeology; the Archaeological Information System oftheCzech Republic, whichisatool usedto computational methods to thehistoriography ofancientGraeco-Roman religions; the GEHIRproject, research whichisaninterdisciplinary initiative that applies EVENT 4 was heldinPrague on24April2018at theAcademy ofSciences ofthe Infrastructures. Digital HumanitieswithResearch Figure 6:Boosting research in across historical language variations based onourresources. while ontheother beableto they’ll expand theapplicability oftheirtools to domainsand new willgiveCLARIN usaninvaluable platform for thecuration andsustainability ofourresources, thatI believe suchacollaboration isofgreat importance for both sides.Ontheonehand,Czech aims to contribute its historical andphilosophical corpora andtexts collections to Czech CLARIN. philosophy).I’llbeinvolved20th century asarepresentative oftheInstitute ofPhilosophy, which to conduct anextensive corpus-based analysisofmodernCzech texts from various domains(e.g., under theCzech DARIAH nodelast year withCzech astheprincipal CLARIN investigator. Its goal is active inthisassociation, like Eva Hajičová andSilvieCinková. We’ve alsosubmitted a project astheChair.Humanities, for whichIcurrently serve Several peoplefrom Czech are CLARIN very for concreteAs collaborations, we’ve recently established theCzech ofDigital Association technical issues. their experts like Pavel Straňák, withwhomIdiscussmywork andwhohasoften helpedmewith then, I’ve beenusingtools andresources that Czech provides CLARIN andamincontact with approaches to myown research, rooted whichisotherwise andmediastudies. insociology Since inspired bywas theirwork andsoonstarted very learning how to code andapplycomputational together proponents ofdigital humanities,includingmeandthecolleagues from Czech I CLARIN. and socialsciences. Sadly, theproject lefttheplanning never stages, brought butitnevertheless libraries, universities, andvarious institutes for linguistics many Czech institutes relevant for digital humanities,suchas ambitious, since we wanted to strike upacollaboration between by oftheCzech theLibrary Academy ofSciences. Theproposal was one ofthecoordinators inafairly large digital humanitiesproject Two years ago, asadelegate oftheInstitute ofPhilosophy, Iwas Could you describeyour collaboration withtheconsortium? 2. How didyou get involved withCzech CLARIN consortium? topics. computational methodologies withsocialscience research improve mycoding skillsandbeinspired abouthow to combine computer scientists, sothisisawonderful opportunity for meto Academy ofSciences. Manyofmycolleagues inJapan are sending organisation, theInstitute ofPhilosophytheCzech Institute ofInformatics inJapan, where Iamrepresenting my Prague. Currently, I’m aJSPS post-doctoral fellow at theNational I received at theFaculty myPhDinsociology ofSocialSciences in 2018 May 16 on Skype Lenardič, of via current position(s). Jakob place by Institute took Academy at 1. Please describeyour academic background andyour National transcribed interview the and at Philosophy and of following conducted The Prague in Institute was the Japan. and at in Republic Czech researcher Informatics the of postdoctoral Sciences a of is Hladík Radim Radim Hladík CZECH REPUBLIC | edited by by edited Darja Fišer. Darja INTERVIEW 11 12 Czech Republic CZECH REPUBLIC | 5 sociological corpus through theCzech once repository CLARIN it’s completed. with fiction. Both observations turned outto bestatistically significant. Iplan to release this by female authors, andoften tend to becited lessthanthose texts whichhave little in common not onlydiffer inlanguage use.What I found outisthat such texts are alsomore likely to bewritten providing quotes ofthepeoplewhoare thesubjects ofthestudy inquestion. Buttheclusters do anexample, clusteringAs showed that suchsociological texts often give voice to theirdata, by corpus to seewhichspecificsociological texts have themost incommon withtheliterary texts. verbs that are shared between thecorpora. Ithenappliedclustering methods to thecombined a vector space modelofthedocuments consisting low-level features ofvery –themost frequent downloaded from ofCzech therepository Ibrought CLARIN. thetwo corpora together by creating I’ve obtained someinteresting results by combining mycorpus withacorpus ofliterary texts that I 5. Have there beenanysignificant results yet? hopefully grow withtime. Currently, mycorpus isfairly small–after theclean-up it consists ofaround 500articles,butwill this topic, andIbegan working oncreating acorpus ofCzech sociological articlesfrom scratch. Consequently, Isoonstarted wondering what aproper digital approach would reveal about papers. claims aboutwholedecades ofscientificwritinginaparticular domainbased ona few dozen on ahandfulofsampledtexts. Ifindsuchanapproach limited, since you can’t really make general claims. However, most sociological research onthistopic hasbeenpurely qualitative orconducted scientific writing,where I’m mostly interested inhow scientists establish thevalidity oftheir truthful representations. Currently, I’ve beentackling similarquestions inconnection with mediated communication, andwhyonlycertain statements about thepast are regarded as In mypostgraduate work Ihave beeninterested inhow historical events are represented through your research inconnection withthistopic? the study of scientificwritinginsocialsciences. Couldyou briefly describehow you conduct 4. Your research scope isvery broad; amongothers, you applyadigital humanist approach to welcomes non-finalversions, whichare thenautomatically linked to ones. newer makingmemorework onit, confident inreleasing adataset sooner, since also therepository know that Ican always version publishanewer ofaspecificdataset incase Idosomeadditional resource you upload. thistakes Ibelieve alot ofpressure offthewholepublishingprocess, since I What Ialsoappreciate isthat theCzech keeps repository CLARIN track ofalltheversions ofa complicated installation processes, whichdissuadesmefrom usingthem. additional components installed andtheirdependencies.Ioften come across tools that require a whichyouservice easily integrate inyour own code. Thisway, Idon’t abouthaving needto worry don’t needto install itasastand-alone program onyour computer, butyou can useitasanAPI morphological analysis.What Iespeciallyappreciate aboutMorphoDiTa isits flexibility, inthat you I’d like to pointout MorphoDiTa, the tools that Czech provides CLARIN are essential for mycurrent work. and morphosyntactic annotation oftexts for isneededeven thesimplest analyses.Inthissense, If you work withtexts inalanguage that isasmorphologically complex asCzech, lemmatisation Could you discusshow you usetheminyour own work? 3. Whichare thetools andresources provided by Czech CLARIN that you useinyour research? http://ufal.mff.cuni.cz/morphodita INTERVIEW 5 whichisatool for tokenisation, lemmatisation and 6 tool intimidating. can bevery resources, whichcould bemademore user-friendly andcontain more examples ofusebecause learning anew the state-of-the-art. Ifthere’s onethingthat I’d like to seeimproved, it’s the documentation ofthetools and confident that Czech willcontinue CLARIN to keep upandmake sure that theirtools are always intouch with it was obvious to methat language technologies are rapidly becoming more andmore advanced worldwide. I’m compete withstate-of-the-art language technologies for developed larger languages, like English.At LREC2018, What Ireally appreciate aboutCzech isthat CLARIN have managed they to tools develop for Czech that can easily 8. What isyour visionfor thefuture of Czech CLARIN? courses tailored to topics that are directly relevant to humanitiesresearch interests. the digital humanitieswould probably require arevamping ofthecurriculumwithagreater numberofdigital course, often sothey invite external teachers from theindustry to teach a course ortwo. However, fullyembracing is that thefaculty at suchdepartments doesn’t usuallyhave therequired skills to teach adigital humanities quantitative approaches thanthemanagement ofhumanitiesdepartments mightrealise. Theproblem, ofcourse, questions withintheirown domains.Consequently, Ithinkthere are more students whoare interested insuch enthusiastic aboutlearningvery how to programme and potentially applyingprogramming skillsto research Czech Manystudents CLARIN. whoalsoattended thiscourse were from various were humanitiesdisciplines.They department. For instance, Ionce attended acourse onprogramming inRthat was given by SilvieCinková from many researchers seeitasastep forward inscientificresearch. At universities, itdependsalot ontheparticular At theInstitute ofPhilosophy, there isquite alot ofenthusiasmfor digital humanities,since themanagement and humanities ingeneral represented intheCzech academic environment? 7. How doyour students andfellow researchers embrace thedigital humanist approach? How are digital basic skills,just enoughto findcommon ground for conversations withthespecialists. yourself; you often onlyneed to get intuitively acquainted withthe computational methodologies andlearn the getting involved indigital humanitiesdoesnot necessarily mean that you needbecome anexpert programmer social scientists orhumanitiesresearchers team upwithcomputer science experts. Dueto suchcollaborations, Additionally, suchevents are often the starting pointscollaborations ofmanyfruitfulcross-disciplinary inwhich concrete examples. is definitely muchmore lecture convincing ondigital thanadry humanitiesthat doesnot provide anykindof disciplines, butalsoopenupmanyapproaches to doingresearch. that Anevent directly involves its participants experts can show how theirtools work donot andhow they onlyanswer specificresearch questions from various of Newspapers”, events. After mypersonal experience ofauditingtheCLARIN-PLUS“Working withDigital workshop: Collections quantitative research that andIbelieve Czech can CLARIN helpalot inthisregard through its userinvolvement and make sure to usetherighttools for theirpurposes.Inother words, there are manymisconceptions about that suchoppositionoften isn’t really justified, although researchers must beaware ofpotential limitations share to anextent. Butnow that Ihave someexperience withusinglanguage tools andresources myself, Ifind in what perceive they to bequalitative research questions. Iunderstand theirpointofview, whichIusedto I’ve met quite afew researchers from non-technical disciplineswhoopposetheuseofquantitative methods community? 6. Whyisaninfrastructure like Czech CLARIN (orCLARIN ERICingeneral) important for thegeneral research https://www.clarin.eu/event/2016/clarin-plus-workshop-working-digital-collections-newspapers 6 Ithinkthat theworkshops are especiallyimportant because they’re aplatform where CLARIN CZECH REPUBLIC | INTERVIEW 13 COLOPHON

This brochure is part of the 'Tour de CLARIN' volume I (publication number: CLARIN-CE-2018-1341, November 2018).

Coordinated by Darja Fišer, Jakob Lenardič and Karolina Badzmierowska

Written by Barbora Hladka, Darja Fišer and Jakob Lenardič

Edited by Darja Fišer and Jakob Lenardič

Proofread by Paul Steed

Designed by Karolina Badzmierowska

Online version www.clarin.eu/Tour-de-CLARIN/Publication

Publication number CLARIN-CE-2018-1341 November 2018

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International Licence.

Contact CLARIN ERIC c/o Utrecht University Drift 10, 3512 BS Utrecht The www.clarin.eu

CLARIN Common Language Resources and Technology Infrastructure CLARIN 2018