Published on EU Science Hub (https://ec.europa.eu/jrc)

Home > Language Technology Resources > JRC Eurovoc Indexer

JRC Eurovoc Indexer - JEX

Introduction The EuroVoc Thesaurus JEX usage conditions Download JEX More information on JEX Acknowledgements

Introduction

Multilingual Eurovoc thesaurus descriptors are used by a large number of European Parliaments and Documentation Centres to manually index their large document collections. The assigned descriptors are then used to search and retrieve documents in the collection and to summarise the document contents for the users.

view details

As Eurovoc descriptors exist in one-to-one translations in almost thirty languages, they can be displayed in a language other than the text language and give users cross-lingual access to the information contained in each document. At the same time, EuroVoc is an ideal means to search in the user's language and to retrieve documents in other languages.

The European Commission's (EC) Joint Research Centre (JRC) has developed - and makes available - software that automatically assigns EuroVoc descriptors to documents in currently 22 languages. The system uses statistical Machine Learning methods that learn the multi-label categorisation rules from previously manually indexed documents. The method used can be described as profile- based category ranking. This software, called JRC EuroVoc Indexer, or short JEX, has been trained for 22 languages and is available for download from this site. The software allows users to re-train the software on their own data, even using their own, alternative classification systems. The EuroVoc Thesaurus

The EuroVoc thesaurus was developed by the European Parliament (EP), in collaboration with the EU Publications Office (OP) and several national organisations for the indexing (cataloguing / classification / categorisation) of document collections in several languages.

view details

EuroVoc currently exists not only in 22 official EU languages (Bulgarian, Czech, Danish, Dutch, English, Estonian, Finnish, French, German, Greek, Hungarian, Italian, Latvian, Lithuanian, Maltese, Polish, Portuguese, Romanian, Slovak, Slovenian, Spanish and Swedish), but also in Basque, Catalan, Croatian, Russian and Serbian. Further non-official translations exist.

The number of Eurovoc users and language versions is steadily increasing. The thesaurus covers the major interests of the involved institutions. It is hierarchically organised into 21 fields and - at the next level - into 127 micro-thesauri, with altogether about 6,700 descriptor terms (classes). The maximum depth of the hierarchy is 8 levels. To browse the thesaurus, see the EuroVoc web site.

JEX usage conditions

The JEX software can in principle be downloaded and used free of charge, but the detailed usage conditions in the EU Licence Agreement (EULA) [1] need to be adhered to. Scientific work using JEX, or scientific publications making reference to JEX, should make reference to at least one of the publications mentioned below (see the Section More information on JEX, below).

Download JEX

JEX has been trained for twenty-two languages. Each language version can be downloaded separately.

view details

For each language version, there are furthermore two versions of JEX: (1) one basic version for the typical end user who wants to either test the software or who wants to use the software in a production environment; (2) an advanced version of the JEX software for technically trained IT specialists; This advanced version additionally allows to re-train the software with a new document collection and to run scientific experiments. It also includes the data on which the software has been trained, meaning that the download packages are much larger. We suggest that you first download the basic version and that you only download the advanced version once you have confirmed that you really want to use it.

JEX is implemented in Java. It can be run on the Windows operating system, on un*x-like operating systems, as well as on Apple Mac. The software should run on most modern computers, but it requires a minimum memory of 2GB.

When downloading, you agree to the JEX usage conditions [1], as formulated in the EU Licence Agreement (EULA) [1]. Indexing and Training Language Version Indexing (basic) (advanced)

bg 1.0 download (18 MB) [2] download (89 MB) [3]

cs 1.0 download (20 MB) [4] download (75 MB) [5]

da 1.0 download (29 MB) [6] download (116 MB) [7]

de 1.0 download (32 MB) [8] download (131 MB) [9]

el 1.0 download (27 MB) [10] download (156 MB) [11]

en 1.0 download (15 MB) [12] download (99 MB) [13]

es 1.0 download (17 MB) [14] download (110 MB) [15]

et 1.0 download (21 MB) [16] download (72 MB) [17]

fi 1.0 download (35 MB) [18] download (121 MB) [19]

fr 1.0 download (24 MB) [20] download (117 MB) [21]

hu 1.0 download (14 MB) [22] download (72 MB) [23]

it 1.0 download (25 MB) [24] download (117 MB) [25]

lt 1.0 download (18 MB) [26] download (117 MB) [27]

lv 1.0 download (19 MB) [28] download (72 MB) [29]

mt 1.0 download (16 MB) [30] download (68 MB) [31]

nl 1.0 download (25 MB) [32] download (117 MB) [33]

pl 1.0 download (18 MB) [34] download (76 MB) [35]

pt 1.0 download (24 MB) [36] download (116 MB) [37]

ro 1.0 download (22 MB) [38] download (119 MB) [39]

sk 1.0 download (18 MB) [40] download (75 MB) [41]

sl 1.0 download (18 MB) [42] download (70 MB) [43]

sv 1.0 download (28 MB) [44] download (115 MB) [45]

More information on JEX

The user manual gives an easy-to-understand overview of the software and explains how to use it, step by step:

Ebrahim Mohamed, Ralf Steinberger & Marco Turchi. JEX Manual [46]. view details

The following document, published in 2012, explains JEX, its history and possible uses. It describes the documents JEX was trained on, gives an overview of the indexing methodology and presents automatic evaluation results for all 22 languages. It also explains how to use JEX: Steinberger Ralf, Mohamed Ebrahim & Marco Turchi (2012). JRC EuroVoc Indexer JEX - A freely available multi-label categorisation tool [47] . Proceedings of the 8th international conference on Language Resources and Evaluation (LREC'2012), pp. 798-805, Istanbul, 21-27 May 2012.

This third document shows experimental JEX classification results for languages belonging to four different language families: Slavic, Finno-Ugric, Germanic and Romance. It furthermore explores the usefulness of linguistic pre-processing (lemmatisation, part-of-speech tagging):

Ebrahim Mohamed, Maud Ehrmann, Marco Turchi & Ralf Steinberger (2012). Multi-label Eurovoc classification for Eastern and Southern EU languages [48]. In: Cristina Vertan & Walther v. Hahn (eds): Multilingual processing in Eastern and Southern EU languages - Low resources technologies and translation, pp. 370-394. Cambridge Scholars Publishing, Cambridge, UK.

This last document, mostly targeted at the scientific community, explains the categorisation algorithm in more depth and also describes the results of a manual evaluation of the automatic classification, performed by specialised human EuroVoc indexers, for English and Spanish documents.

Pouliquen Bruno, Steinberger Ralf, Camelia Ignat (2003). Automatic annotation of multilingual text collections with a conceptual thesaurus [49] . In: Proceedings of the Workshop Ontologies and Information Extraction at the Summer School The Semantic Web and Language Technology - Its Potential and Practicalities (EUROLAN'2003). Bucharest, Romania, 28 July - 8 August 2003.

Acknowledgements

We would like to thank Bruno Pouliquen, who has developed a major part of the main assignment method, and Mladen Kolar, who has implemented an initial Java version of the tool. We would like to mention the support of Victoria Fernandez-Mera from the Spanish Congress of Deputies and Elisabet Lindkvist from the Swedish Riksdagen, who gave us a lot of advice on practices relating to manual EuroVoc indexing and who helped us to thoroughly evaluate the software. Finally, we are grateful to the Publications Office of the European Commission for having provided their collection of manually EuroVoc-indexed documents. The initial work on JEX was funded as a JRC Exploratory Research Project. The preparation of the first public release of JEX, in May 2012, was partially funded under the JRC’s Innovative Project Competition scheme.

Source URL: https://ec.europa.eu/jrc/en/language-technologies/jrc-eurovoc-indexer

Links [1] https://wt-public.emm4u.eu/Resources/Eurovoc/2011_EULA_JEX_Usage-conditions.pdf [2] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing/bg-eurovoc-1.0.zip [3] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing_training/bg-full-eurovoc-1.0.zip [4] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing/cs-eurovoc-1.0.zip [5] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing_training/cs-full-eurovoc-1.0.zip [6] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing/da-eurovoc-1.0.zip [7] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing_training/da-full-eurovoc-1.0.zip [8] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing/de-eurovoc-1.0.zip [9] http://langtech.jrc.ec.europa.eu/Resources/Eurovoc/indexing_training/de-full-eurovoc-1.0.zip [10] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing/el-eurovoc-1.0.zip [11] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing_training/el-full-eurovoc-1.0.zip [12] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing/en-eurovoc-1.0.zip [13] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing_training/en-full-eurovoc-1.0.zip [14] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing/es-eurovoc-1.0.zip [15] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing_training/es-full-eurovoc-1.0.zip [16] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing/et-eurovoc-1.0.zip [17] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing_training/et-full-eurovoc-1.0.zip [18] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing/fi-eurovoc-1.0.zip [19] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing_training/fi-full-eurovoc-1.0.zip [20] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing/fr-eurovoc-1.0.zip [21] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing_training/fr-full-eurovoc-1.0.zip [22] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing/hu-eurovoc-1.0.zip [23] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing_training/hu-full-eurovoc-1.0.zip [24] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing/it-eurovoc-1.0.zip [25] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing_training/it-full-eurovoc-1.0.zip [26] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing/lt-eurovoc-1.0.zip [27] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing_training/lt-full-eurovoc-1.0.zip [28] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing/lv-eurovoc-1.0.zip [29] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing_training/lv-full-eurovoc-1.0.zip [30] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing/mt-eurovoc-1.0.zip [31] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing_training/mt-full-eurovoc-1.0.zip [32] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing/nl-eurovoc-1.0.zip [33] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing_training/nl-full-eurovoc-1.0.zip [34] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing/pl-eurovoc-1.0.zip [35] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing_training/pl-full-eurovoc-1.0.zip [36] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing/pt-eurovoc-1.0.zip [37] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing_training/pt-full-eurovoc-1.0.zip [38] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing/ro-eurovoc-1.0.zip [39] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing_training/ro-full-eurovoc-1.0.zip [40] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing/sk-eurovoc-1.0.zip [41] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing_training/sk-full-eurovoc-1.0.zip [42] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing/sl-eurovoc-1.0.zip [43] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing_training/sl-full-eurovoc-1.0.zip [44] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing/sv-eurovoc-1.0.zip [45] https://wt-public.emm4u.eu/Resources/Eurovoc/indexing_training/sv-full-eurovoc-1.0.zip [46] https://wt-public.emm4u.eu/Resources/Eurovoc/JEX-Manual.pdf [47] https://ec.europa.eu/jrc/sites/jrcsh/files/2012_LREC-JEX_Steinberger-et-al.pdf [48] https://books.google.it/books?id=HKQwBwAAQBAJ&pg=PA370&dq=%22Multi-label+Eurovoc+classification+ for+Eastern+and+Southern+EU+languages%22&hl=en&sa=X&ved=0ahUKEwjBoMme3o_eAhXEWiwK HSYqB8oQ6AEIKTAA#v=onepage&q=%22Multi- label%20Eurovoc%20classification%20for%20Eastern%20and%20Southern%20EU%20languages%22&f=false [49] https://ec.europa.eu/jrc/sites/jrcsh/files/EuroLan-03_Pouliquen-Steinberger-et-al_Eurovoc.pdf