DOCSLIB.ORG

Open Data Goldbook for Data Managers and Data Holders

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Open Data Goldbook for Data Managers and Data Holders Open Data Goldbook for Data Managers and Data Holders Open Data Goldbook for Data Managers and Data Holders Practical guidebook for organisations wanting to publish Open Data Last update: January 2018 www http://www.europeandataportal.eu @ [email protected] Licence: CC-BY 2 Open Data Goldbook for Data Managers and Data Holders Capgemini Consulting prepared this Goldbook as part of the European Data Portal project. The European Data Portal is developed by the European Commission with the support of a consortium led by Capgemini Consulting, including INTRASOFT International, Fraunhofer Fokus, con.terra, Sogeti, the Open Data Institute, Time.Lex and the University of Southampton. For more information about this Goldbook, please contact: European Commission Directorate General for Communications Networks, Content and Technology Unit G.1: Data Policy & Innovation Daniele Rizzi – Policy Officer Email: [email protected] Project team Dinand Tinholt – Vice President, EU Lead, Capgemini Consulting Executive lead European Data Portal Email: [email protected] Wendy Carrara – Principal Consultant, Capgemini Consulting Project Manager European Data Portal Email: [email protected] Written and reviewed by Wendy Carrara, Sem Enzerink, Fréderique Oudkerk, Cosmina Radu, Eva van Steenbergen (Capgemini Consulting) DISCLAIMER By the European Commission, Directorate-General of Communications Networks, Content & Technology. The information and views set out in this publication are those of the author(s) and do not necessarily reflect the official opinion of the Commission. The Commission does not guarantee the accuracy of the data included in this Goldbook. Neither the Commission nor any person acting on the Commission’s behalf may be held responsible for the use, which may be made of the information contained therein. © European Union, 2018. All rights reserved. Certain parts are licensed under conditions to the EU. Reproduction is authorised provided the source is acknowledged. 3 Open Data Goldbook for Data Managers and Data Holders Table of Contents Reading guide .......................................................................................................................................... 6 Glossary ................................................................................................................................................. 10 1. Open Data in a Nutshell ................................................................................................................ 12 1.1. General definition of Open Data ........................................................................................... 12 1.2. Public Sector Information and Open Government Data ....................................................... 13 1.2.1. Is PSI Different from Open (Government) Data? .......................................................... 14 1.3. The benefits of Open Data .................................................................................................... 14 2. How to build an Open Data Strategy ............................................................................................. 19 2.1. Setting the ambition .............................................................................................................. 19 2.1.1. Defining the As-Is Situation ........................................................................................... 19 2.1.2. Define the To-Be situation and define measurable goals ............................................. 21 2.2. Creating your strategy ........................................................................................................... 22 2.2.1. Publishing data: ‘Open by default’ or ‘Closed unless’? ................................................. 23 2.3. Drafting an Open Data Policy ................................................................................................ 23 2.3.1. The Open Data Policy: an overview ............................................................................... 24 2.3.2. The content of your policy ............................................................................................ 24 2.4. Overcoming barriers in publishing Open Data ...................................................................... 27 2.4.1. Ensuring organisational alignment as a Key Success Factor ......................................... 27 2.5. Critical success factors ........................................................................................................... 28 2.5.1. Critical success factors for publishing ........................................................................... 29 2.5.2. Critical success factors for re-use .................................................................................. 29 3. Technical preparation and implementation .................................................................................. 30 3.1. Data management ................................................................................................................. 30 3.1.1. Data management per instance .................................................................................... 30 3.1.2. Federated Data Management with a Centre of Expertise (CoE) ................................... 31 3.1.3. Fully Centralised Master Data Management ................................................................ 32 3.1.4. Implementing Master Data Management ..................................................................... 32 3.2. Extract, transform, and publish ............................................................................................. 32 3.3. Channels ................................................................................................................................ 33 3.3.1. Web download .............................................................................................................. 34 3.3.2. Data portal ..................................................................................................................... 34 3.3.3. API.................................................................................................................................. 34 3.4. Search .................................................................................................................................... 34 4 Open Data Goldbook for Data Managers and Data Holders 3.4.1. Basic search ................................................................................................................... 34 3.4.2. SPARQL .......................................................................................................................... 35 3.5. Pre-requisites, choices and accountability ............................................................................ 35 4. Putting in place an Open Data lifecycle ......................................................................................... 37 4.1. Collecting data ....................................................................................................................... 37 4.1.1. General collection process ............................................................................................ 37 4.1.2. Data quality ................................................................................................................... 41 4.1.3. Preparing the data: technical openness ........................................................................ 42 4.1.3.1. Linked Data ................................................................................................................ 42 4.1.3.2. Metadata ................................................................................................................... 46 4.1.3.3. The 5-Star Open Data model ..................................................................................... 50 4.1.4. Preparation: legal openness .......................................................................................... 52 4.1.5. The Final Check .............................................................................................................. 53 4.2. Publishing data ...................................................................................................................... 54 4.2.1. Publishing as files on a website ..................................................................................... 54 4.2.2. Upload to a portal ......................................................................................................... 54 4.2.3. Publish through an API .................................................................................................. 55 4.3. Maintaining data ................................................................................................................... 56 4.3.1. Maintaining data and metadata regularly ..................................................................... 56 4.3.2. Checking URIs & URLs .................................................................................................... 56 4.3.3. Checking user feedback and continuous improvement ................................................ 56 5. Ensuring and monitoring success .................................................................................................. 57 5.1. Engaging re-users .................................................................................................................. 57 5.2. Monitoring your Open Data initiative ..................................................................................
Load more

Recommended publications
  • Drinking Water Directive: Water Quality and Access to It Improved in Bulgaria, Hungary and Romania, but Investment Needs Remain Substantial’
    23.12.2020 EN Offi cial Jour nal of the European Union L 435/1 I (Legislative acts) DIRECTIVES DIRECTIVE (EU) 2020/2184 OF THE EUROPEAN PARLIAMENT AND OF THE COUNCIL of 16 December 2020 on the quality of water intended for human consumption (recast) (Text with EEA relevance) THE EUROPEAN PARLIAMENT AND THE COUNCIL OF THE EUROPEAN UNION, Having regard to the Treaty on the Functioning of the European Union, and in particular Article 192(1) thereof, Having regard to the proposal from the European Commission, After transmission of the draft legislative act to the national parliaments, Having regard to the opinion of the European Economic and Social Committee (1), Having regard to the opinion of the Committee of the Regions (2), Acting in accordance with the ordinary legislative procedure (3), Whereas: (1) Council Directive 98/83/EC (4) has been substantially amended several times (5). Since further amendments are to be made, that Directive should be recast in the interests of clarity. (2) Directive 98/83/EC set the legal framework to protect human health from the adverse effects of any contamination of water intended for human consumption by ensuring that it is wholesome and clean. This Directive should pursue the same objective and should improve access to such water for all in the Union. To that end, it is necessary to lay down at Union level the minimum requirements with which water intended for that purpose should comply. Member States should take the necessary measures to ensure that water intended for human consumption is free from any micro-organisms and parasites and from any substances which, in numbers or concentrations, in certain cases, constitute a potential danger to human health, and that it meets those minimum requirements.
    [Show full text]
  • Communication on Readiness at the End of the Transition Period Between the European Union and the United Kingdom
    EUROPEAN COMMISSION Brussels, 9.7.2020 COM(2020) 324 final COMMUNICATION FROM THE COMMISSION TO THE EUROPEAN PARLIAMENT, THE COUNCIL, THE EUROPEAN ECONOMIC AND SOCIAL COMMITTEE AND THE COMMITTEE OF THE REGIONS Getting ready for changes Communication on readiness at the end of the transition period between the European Union and the United Kingdom EN EN Getting ready for changes Communication on readiness at the end of the transition period between the European Union and the United Kingdom I. INTRODUCTION ............................................................................................................................................................................. 3 II. CHANGES HAPPENING IN ANY SCENARIO ...................................................................................................................... 5 A. Trade in goods ...................................................................................................................................... 6 A.1. Customs formalities, checks and controls ........................................................................................................... 6 A.2. Customs and taxation rules for import and export of goods (tariffs, VAT, excise) ...................... 7 A.3. Certificates and authorisations of products, establishment requirements, labelling and marking ............................................................................................................................................................................................. 9 Examples
    [Show full text]
  • Communication on Readiness at the End of the Transition Period Between the European Union and the United Kingdom
    EUROPEAN COMMISSION Brussels, 9.7.2020 COM(2020) 324 final COMMUNICATION FROM THE COMMISSION TO THE EUROPEAN PARLIAMENT, THE COUNCIL, THE EUROPEAN ECONOMIC AND SOCIAL COMMITTEE AND THE COMMITTEE OF THE REGIONS Getting ready for changes Communication on readiness at the end of the transition period between the European Union and the United Kingdom EN EN Getting ready for changes Communication on readiness at the end of the transition period between the European Union and the United Kingdom I. INTRODUCTION ............................................................................................................................................................................. 3 II. CHANGES HAPPENING IN ANY SCENARIO ...................................................................................................................... 5 A. Trade in goods ...................................................................................................................................... 6 A.1. Customs formalities, checks and controls ........................................................................................................... 6 A.2. Customs and taxation rules for import and export of goods (tariffs, VAT, excise) ...................... 7 A.3. Certificates and authorisations of products, establishment requirements, labelling and marking ............................................................................................................................................................................................. 9 Examples
    [Show full text]
  • What Is a CELEX Number?
    The CELEX number in EUR-Lex What is it? How does it help me? Most documents in EUR-Lex – It helps you search faster. You can quickly irrespective of language – have a identify the document type without opening it. unique CELEX number. This is handy when you’re checking a document’s metadata, either in the search results or in the “Document information” tab. Here we have: The CELEX number What are its constituent parts? of the EU Water Framework It has 4 components: Directive Directive 2000/60/EC of the European Parliament and of the Council of 23 October 2000 establishing a framework 32000L0060 for Community action in Sector Year Doc type Document number the field of water policy 1 digit or 4 digits 1 or 2 4 digits* 1 letter letters EUR-Lex falls into 12 sectors: Examples of Doc types (descriptors) by sector: See how changing the sector changes the 1: Treaties Sector 3: Legislation document type 2: International agreements L Directives R Regulations Some documents, such 3: Legislation D Decisions as treaties, national 32000L0060 transposition measures > original directive 4: Complementary legislation Sector 5: or national case law, have 5: Preparatory acts and working Preparatory acts and working documents a slightly different CELEX documents PC Commission legislative proposals (COM structure. documents), etc. 6: Case-law * Most document numbers 72000L0060 DC other COM documents (green & white have 4 digits (may be 7: National transposition measures > national transposition papers, communications, reports, etc.) based on the official measures (incorporating 8: References to national case-law SC SWD documents (staff working number, internal number, date of publication, etc.).
    [Show full text]
  • European Union Research BOSTON COLLEGE LAW LIBRARY
    LEGAL RESEARCH GUIDE #9 European Union Research BOSTON COLLEGE LAW LIBRARY INTRODUCTION Post-World War II Europe The European Union has its origins in the period following the end of World War II in 1945. Faced with political and economic uncertainty, many nations in western Europe began to consider the possibilities of increased cooperation as a means of improving economic performance and providing increased security. The Organization for European Economic Cooperation was created in 1948 as a multinational agency to assist in the administration of the Marshall Plan for the reconstruction of western Europe. Further multinational cooperation was fostered by the Council of Europe, a consultative organization established in 1949 to promote common action in economic, social, cultural, scientific, legal and administrative matters. Beginnings of a Common Market The evolution of the European Union itself began in 1951 with the Treaty Establishing the European Coal and Steel Community (“ECSC”), 261 UNTS 140 (1951). This treaty provided a “common market” for the coal and steel industries of France, Germany, Italy, Belgium, the Netherlands, and Luxembourg, with regulations for pricing, transportation, competition, employment, and the abolition of subsidies. When the ECSC proved successful, attention focused on the creation of a “common market” for other sectors of the economy and for further economic integration. Ministers of the six ECSC countries negotiated and concluded two treaties, signed at Rome in March, 1957. The Treaty of Rome, 298 UNTS 11 (1957), established the European Economic Community and the EURATOM Treaty, 298 UNTS 167 (1957), created the European Atomic Energy Community. Both of these organizations officially came into existence on January 1, 1958.
    [Show full text]
  • The European Parliament As a Driving Force of Constitutionalisation
    DIRECTORATE GENERAL FOR INTERNAL POLICIES POLICY DEPARTMENT C: CITIZENS' RIGHTS AND CONSTITUTIONAL AFFAIRS CONSTITUTIONAL AFFAIRS THE EUROPEAN PARLIAMENT AS A DRIVING FORCE OF CONSTITUTIONALISATION STUDY Abstract This report analyses the increasing role played by the European Parliament (EP) in the EU decision-making process. In the first part (Sections 2, 3, 4 and 5), it describes how the EP acquired more power in legislation, comitology, in the appointment of the European Commission and in the budgetary field. In the second part (Sections 6 and 7), the report illustrates the EP’s role in two relevant policy fields: economic governance and external trade agreements. The report demonstrates that EP’s formal and informal powers in legislation, comitology, Commission investiture, the budgetary process, economic governance and international agreements have increased strikingly since the Treaty of Rome. This empowerment is partially explained by the concern for democratic legitimacy on the part of some member states’ (and the Commission). To another important part the empowerment may be explained by the fact that treaties frequently contain ambiguous provisions and thus allow room for informal rules to emerge through bargaining specifying the details of treaty provisions. PE 536.467 EN This study was commissioned by the policy department for Citizen's Rights and Constitutional Affairs at the request of the AFCO Committee. AUTHOR(S) Adrienne Héritier (Project leader), Catherine Moury, Magnus G. Schoeller Katharina L. Meissner, Isabel Mota. RESPONSIBLE ADMINISTRATOR Mr Petr Novak Policy Department Citizens' Rights and Constitutional Affairs European Parliament B-1047 Brussels E-mail: [email protected] LINGUISTIC VERSIONS Original: EN ABOUT THE EDITOR To contact the Policy Department or to subscribe to its monthly newsletter please write to: poldep- [email protected] Manuscript completed in October 2015.
    [Show full text]
  • European Union
    e-RG Electronic Resource Guide European Union Marylin J. Raisch* This page was last updated March 1, 2014. his electronic resource guide, often called the ERG, has been published online by the American Society of International Law (ASIL) since 1997. T Since then it has been systematically updated and continuously expanded. The chapter format of the ERG is designed to be used by students, teachers, practitioners and researchers as a self-guided tour of relevant, quality, up-to-date online resources covering important areas of international law. The ERG also serves as a ready-made teaching tool at graduate and undergraduate levels. The narrative format of the ERG is complemented and augmented by EISIL (Electronic Information System for International Law), a free online database that organizes and provides links to, and useful information on, web resources from the full spectrum of international law. EISIL's subject-organized format and expert-provided content also enhances its potential as teaching tool. 2 This page was last updated March 1, 2014. I. Introduction II. Treaties Establishing the European Union III. Community Acts and Sources of Law IV. Institutions and Powers V. European Court of Justice and Case Law VI. Selected Topical Areas of Research VII. Commentary and Databases VIII. Concluding Review of Updating and Citation Tools I. Introduction This chapter of the ASIL Electronic Resource Guide for International Law (ERG) presents electronic resources for research in the law of the European Union (EU) and its evolving institutional
    [Show full text]
  • (2010) 748 Final
    EN EN EN EUROPEAN COMMISSION Brussels, 14.12.2010 COM(2010) 748 final 2010/0383 (COD) Proposal for a REGULATION OF THE EUROPEAN PARLIAMENT AND OF THE COUNCIL on jurisdiction and the recognition and enforcement of judgments in civil and commercial matters (Recast) {SEC(2010) 1547 final} {SEC(2010) 1548 final} EN EN EXPLANATORY MEMORANDUM 1. CONTEXT OF THE PROPOSAL 1.1. General context This proposal is a recasting of Council Regulation (EC) No 44/2001 of 22 December 2001 on jurisdiction and the recognition and enforcement of judgments in civil and commercial matters (hereafter "Brussels I"). Regulation Brussels I is the matrix of civil judicial cooperation in the European Union. It applies in a broad range of matters, covering not only contractual but also delictual and proprietary claims. It identifies the most appropriate jurisdiction for solving a cross-border dispute and ensures the smooth recognition and enforcement of judgments issued in another Member State. The Regulation replaced the 1968 Brussels Convention which had been concluded between the then Member States and been successively amended to reflect the Union's successive enlargements. It applies in all Member States, including, by way of a separate international agreement, to Denmark which has a special regime for judicial cooperation under the Treaty on the Functioning of the European Union. The Regulation entered into force in March 2002. Eight years afterwards, the Commission has reviewed its operation in practice and considered necessary amendments to the instrument. 1.2. Grounds for and objectives of the proposal While the Regulation is overall considered to work successfully, the consultation of stakeholders and a number of legal and empirical studies commissioned by the Commission revealed a number of deficiencies in the current operation of the Regulation which should be remedied.
    [Show full text]
  • The European Council and the Future of EU Democracy. Prospects of an Enhanced Multi-Level Parliamentarism
    The European Council and the Future of EU Democracy. Prospects of an Enhanced Multi-level Parliamentarism Work in progress EUSA Conference 2017, Miami Johannes Müller Gómez, M.A. Research Associate Centre for Turkey and European Union Studies (CETEUS) | University of Cologne [email protected] 1. Introduction The European Union’s management of the financial and economic crisis has been dominated by intergovernmental decisions (Wessels 2016, pp. 187-219; Fabbrini 2015) and the furthering of technocratic structures (Schimmelfennig 2015). This has been accompanied by a demotion of parliaments both at the EU and national levels: On the one hand, with decisions on and implementation of stronger budgetary regulations, national parliaments were limited in their budgetary rights. On the other hand, the European Parliament (EP) was partly circumvented by the member states when taking the respective decisions. Not only due to the current crises, the European Union (EU) is currently facing a legitimacy crisis of major relevance. Citizens’ trust in the EU remains on a significantly low level: Currently, only 36 % of the EU citizens trust the European Union (European Commission 2016, p. 14), and 54 % do not think that their voices count in the EU (European Commission 2016, p. 18). This tendency coincides with an increased share of votes for EU-sceptic parties. For a long time, the EU was able to draw its legitimacy from the positive output it produced– not from democratic mechanisms translating the citizens’ will into political decisions at the EU level. This basis of legitimacy currently seems to be more questioned than ever.
    [Show full text]
  • The Citizen's Voice in the EU
    THE EUROPEAN PARLIAMENT: THE CITIZEN’S VOICE IN THE EU A SHORT GUIDE TO THE EUROPEAN PARLIAMENT Europe Direct is a service to help you find answers to your questions about the European Union. Freephone number (*): 00 800 6 7 8 9 10 11 (*) The information given is free, as are most calls (though some operators, phone boxes or hotels may charge you). More information on the European Union is available on the internet (http://europa.eu). Luxembourg: Publications Office of the European Union, 2016 Print: ISBN 978-92-823-8731-3 doi:10.2861/40244 QA-02-16-122-EN-C PDF: ISBN 978-92-823-8719-1 doi:10.2861/5185 QA-02-16-122-EN-N Manuscript completed in October 2015. Illustrations: Jing Zhang/© European Union © European Union, 2016 Reproduction is authorised provided the source is acknowledged. Printed in Belgium PRINTED ON ELEMENTAL CHLORINE-FREE BLEACHED PAPER (ECF) PREFACE BY THE PRESIDENT The European Parliament is made up by including jobs and growth, security, you — the citizens of Europe — from all migration and climate change. the 28 corners of this Union. This is so, because you have elected 751 Members The Europeanf Union has been of the European Parliament. It is thanks a formidable tool to bring about to your vote that these Members can prosperity and stability. If we look back change European laws through the at our grandparents, we see how a amendments which they submit, with united Europe realised their dream you in mind. of ending war in Europe. They have seen their children and grandchildren I have been entrusted by your elected born and raised in a time of peace and MEPs to chair and represent the respect for fundamental rights.
    [Show full text]
  • Handbook of the Presidency of the Council of the European Union
    Conseil de l'Union européenne C Secrétariat général Rue de la Loi/Wetstraat 175 1048 Bruxelles/Brussel BELGIQUE/BELGIË Tél. +32 (0)2 281 61 11 www.consilium.europa.eu HANDBOOK OF THE PRESIDENCY OF THE COUNCIL OF THE EUROPEAN UNION RS 012/2018 HANDBOOK OF THE PRESIDENCY OF THE COUNCIL OF THE EUROPEAN UNION Notice This publication is produced by the General Secretariat of the Council and is intended for information purposes only. It does not involve the responsibility of the EU institutions or the member states. Notice For further information on the European Council and the Council, see the website: HOW TO OBTAIN EU PUBLICATIONS This publication is produced by the General Secretariat of the Council and is intended www.consilium.europa.eu for information purposes only. It does not involve the responsibility of the EU institu- Free publications: or contact the Public Information Service of thetion sGeneral or the mem berSecretariat states. of the • one copy: via EU Bookshop (http://bookshop.europa.eu); Council: For further information on the European Council and the Council, see the website: www.consilium.europa.eu • more than one copy or posters/maps: Rue de la Loi/Wetstraat 175 or contact the Public Information Service of the General Secretariat of the Council: from the European Union’s representations (http://ec.europa.eu/represent_en.htm); from the delegations in non-EU countries (http://eeas.europa.eu/delegations/index_en.htm); Rue de la Loi/Wetstraat 175 1048 Bruxelles/Brussel by contacting the Europe Direct service (http://europa.eu/europedirect/index_en.htm) or 1048 Bruxelles/Brussel calling 00 800 6 7 8 9 10 11 (freephone number from anywhere in the EU) (*).
    [Show full text]
  • The EU in the World 2018 Edition
    The EU in the world 2018 edition STATISTICAL BOOKS The EU in the world 2018 edition Printed by Imprimerie Centrale in Luxembourg Manuscript completed in April 2018 Neither the European Commission nor any person acting on behalf of the Commission is responsible for the use that might be made of the following information. Luxembourg: Publications Office of the European Union, 2018 © European Union, 2018 Theme: General and regional statistics Collection: Statistical books Reuse is authorised provided the source is acknowledged. The reuse policy of European Commission documents is regulated by Decision 2011/833/EU (OJ L 330, 14.12.2011, p. 39). Copyright for photographs: cover photo: © Eleanor Hennessy/Shutterstock.com; introduction: @ Javier Rosano/Shutterstock.com; part A: © Monkey Business Images/Shutterstock.com; part B: © Gabor Kovacs Photography/Shutterstock.com; part C: © onemu/Shutterstock.com. For any use or reproduction of photos or other material that is not under the EU copyright, permission must be sought directly from the copyright holders. For more information, please consult: http://ec.europa.eu/eurostat/about/policies/copyright Print: ISBN 978-92-79-86484-1 PDF: ISBN 978-92-79-86485-8 doi:10.2785/64273 doi:10.2785/990579 Cat. No: KS-EX-18-001-EN-C Cat. No: KS-EX-18-001-EN-N Foreword Foreword The first Eurostat publication to carry the title The EU in the world was a special edition, produced in 2010 for World Statistics Day. The EU in the world 2018 is the fifth edition of this publication in its current format. The content and structure have been revised each year to include several new indicators.
    [Show full text]