DOCSLIB.ORG

Judgments As Data Report

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Judgments As Data Report JUDGMENTS AS DATA AUTOMATED OPEN!ACCESS ANALYTICS FOR DECISIONS OF COURTS AND TRIBUNALS IN NEW ZEALAND December 2020 Tom Barraclough | Curtis Barnes | Warren Forster Produced with funding from the New Zealand Law Foundation Information Law and Policy Project. December 2020, Auckland, New Zealand Cover image credit: Malte Baumann, Unsplash. 1 PREAMBLE ............................................................................................................................................. 5 ACKNOWLEDGEMENTS .......................................................................................................................... 5 EXECUTIVE SUMMARY........................................................................................................................... 6 A NOTE ON “STRUCTURED DATA” ......................................................................................................... 8 OVERVIEW OPEN ACCESS TO DIGITAL CASE LAW IN NEW ZEALAND ...................................................................... 10 PREVIOUS ACCESS TO JUSTICE RESEARCH (2015) ........................................................................................... 10 PARTNERSHIP WITH OPENLAW NZ (2019) ................................................................................................. 11 ACCESS TO DIGITAL CASE LAW IN NEW ZEALAND ........................................................................................... 13 SUMMARY OF OUR FINDINGS ................................................................................................................... 14 PART ONE ACCESSING JUDGMENTS AT SCALE ...................................................................................................... 16 WHY WE SHOULD ENHANCE THE AVAILABILITY OF JUDGMENTS ......................................................... 17 JUDGMENTS STATE THE LAW .................................................................................................................... 17 CONSTITUTIONAL FACTORS, OPEN JUSTICE AND FREEDOM OF EXPRESSION .......................................................... 18 ACKNOWLEDGED LIMITATIONS ON PUBLIC ACCESS TO JUDGMENTS AT SCALE ................................... 20 PRIVACY AND SENSITIVE CASES.................................................................................................................. 20 MAINTAINING JUDICIAL DISCRETION AND CONTROL (INCLUDING SUPPRESSION) ..................................................... 20 WOULD ANOTHER SYSTEM BETTER PROTECT THESE PRINCIPLES? ........................................................................ 21 HOW IS CASE LAW CURRENTLY ACCESSED OUTSIDE OF COMMERCIAL PUBLISHERS? .......................... 22 PDF AND “ACCESS” AS MACHINE READABILITY ................................................................................... 26 DISTRIBUTION OF CASE LAW AS PDF BY EMAIL .............................................................................................. 28 THE NEW ZEALAND COUNCIL OF LAW REPORTING......................................................................................... 29 CONCLUSION TO PART ONE ................................................................................................................. 31 PART TWO BALANCING BENEFITS AND TRADE-OFFS ............................................................................................. 32 THE BENEFITS AND APPLICATIONS OF AOAA AND JUDGMENTS AS DATA............................................ 32 EFFECTIVE PUBLIC DATABASES OF CASE LAW ................................................................................................. 32 LINKED LEGAL MATERIALS ........................................................................................................................ 33 CITATORS ............................................................................................................................................ 33 TRACKING SUPPRESSION AND IDENTIFYING INFORMATION SUBJECT TO SUPPRESSION .............................................. 34 RESEARCH PLATFORMS FOR EMPIRICAL WORK ............................................................................................... 34 LEGAL EDUCATION OPPORTUNITIES ............................................................................................................ 35 INNOVATION IN LEGAL TECHNOLOGY ENTERPRISES ......................................................................................... 35 PREDICTIVE ANALYTICS AND MACHINE LEARNING ON CASE LAW ....................................................... 35 PREDICTIVE ANALYTICS ON CASE LAW ......................................................................................................... 36 ANALYSING THE BEHAVIOUR OF PARTICIPANTS IN JUSTICE SYSTEM ...................................................................... 37 WHY THESE POTENTIAL USES SHOULD NOT PREVENT DEVELOPMENT OF THE SYSTEM ............................................... 38 2 WE SHOULD INVESTIGATE A BETTER SYSTEM ................................................................................................. 40 A NOTE ON ISSUES OF RESOURCING............................................................................................................ 40 CONCLUSION TO PART TWO ................................................................................................................ 41 PART THREE CREATING AND PUBLISHING MACHINE-READABLE JUDGMENTS AS STRUCTURED DATA..................... 42 SUMMARY OF PART 3 ............................................................................................................................ 42 OVERVIEW OF HOW SUGGESTED SYSTEM WOULD WORK .................................................................................. 43 AN EXAMPLE OF AN EXISTING SYSTEM: AKOMA NTOSO ................................................................................... 45 SUGGESTED SYSTEM CAN OVERCOME CONTEMPORARY ISSUES WITH LEGAL PUBLISHING ........................................... 47 BETTER ACCESS TO BETTER PDFS ALONE IS INSUFFICIENT ................................................................................. 51 OTHER POLICY FACTORS TO CONSIDER ............................................................................................... 52 RECOMMENDATIONS IN THE UNITED KINGDOM ............................................................................................ 52 DEVELOPMENTS IN CANADA .................................................................................................................... 53 ALGORITHMIC TRANSPARENCY AND RELIABILITY ............................................................................................ 54 DATA ETHICS........................................................................................................................................ 54 DIGITAL INCLUSION................................................................................................................................ 55 COPYRIGHT ......................................................................................................................................... 55 CONCLUSION TO PART THREE.............................................................................................................. 56 PART FOUR CONCLUSIONS ..................................................................................................................................... 57 RECOMMENDATIONS .......................................................................................................................... 58 IMPLEMENTATION MECHANISMS ....................................................................................................... 60 APPENDICES BIBLIOGRAPHY .................................................................................................................................... 63 ABOUT THE AUTHORS ......................................................................................................................... 70 ABOUT OPENLAW NZ .......................................................................................................................... 71 APPENDIX ONE: SUMMARY OF SUGGESTED FUTURE SYSTEM ............................................................ 72 APPENDIX TWO: EXPLANATION OF OPENLAW NZ PROTOTYPE AND PROOF OF CONCEPT ................. 75 OVERVIEW .......................................................................................................................................... 75 HOW WE WORKED WITH OPENLAW NZ TO DEVELOP THE PROTOTYPE................................................................. 75 EXPLAINING THE TOOL AND THE VARIABLES .................................................................................................. 82 KEY POINTS IN SUMMARY ........................................................................................................................ 88 LIMITATIONS OF TEXTUAL ANALYSIS OF JUDGMENTS AS A METHOD ..................................................................... 89 LIMITATIONS OF OUR SUBJECT MATTER AND RESEARCH QUESTIONS .................................................................... 91 APPENDIX THREE: NOTABLE FEATURES OF AKOMA NTOSO ................................................................ 92 EXAMPLE OF AN EXISTING STANDARD: AKOMA NTOSO ................................................................................... 92 PRACTICAL IMPLEMENTATION OF AKN ......................................................................................................
Load more

Recommended publications
  • AI4J – Artificial Intelligence for Justice
    AI4J { Artificial Intelligence for Justice August 30, 2016 The Hague, The Netherlands Workshop at the 22nd European Conference on Artificial Intelligence (ECAI 2016) Workshop chairs Floris Bex Department of Information and Computing Sciences, Utrecht University Tom van Engers Leibniz Center for Law, Faculty of Law, University of Amsterdam Henry Prakken Faculty of Law, University of Groningen; Department of Information and Computing Sciences, Utrecht University Bart Verheij Institute of Artificial Intelligence and Cognitive Engineering, University of Groningen Artificial intelligence is currently in the centre of attention of legal professionals. An abundance of startup companies explore the application of AI techniques in the domain of law, and there is even talk of artificially intelligent legal assistants disrupting the legal market space. Factors driving the increased attention for legal AI include: Technological breakthroughs in machine learning, natural language process- ing, ubiquitous computing, data science, and argumentation technology; The changing attitude towards technology in the legal domain; The much increased availability of legal data on the internet; The recent success of AI applications in the private and public domain; The success of technology supporting access to law, legal empowerment, and transparency; The increased need for norms embedded in technology (autonomous driving and warfare, big data analysis for crime fighting and counterterrorism). The aim of this workshop is to investigate opportunities and challenges
    [Show full text]
  • Measuring, Monitoring, and Managing Legal Complexity
    A5_RUHL&KATZ.DOCX (DO NOT DELETE) 10/16/2015 8:55 AM Measuring, Monitoring, and Managing Legal Complexity J.B. Ruhl & Daniel Martin Katz ABSTRACT: The American legal system is often accused of being “too complex.” For example, most Americans believe the Tax Code is too complex. But what does that mean, and how would one prove the Tax Code is too complex? Both the descriptive claim that an element of law is complex and the normative claim that it is too complex should be empirically testable hypotheses. Yet, in fact, very little is known about how to measure legal complexity, much less how to monitor and manage it. Legal scholars have begun to employ the science of complex adaptive systems, also known as complexity science, to probe these kinds of descriptive and normative questions about the legal system. This body of work has focused primarily on developing theories of legal complexity and positing reasons for, and ways of, managing it. Legal scholars thus have skipped the hard part— developing quantitative metrics and methods for measuring and monitoring law’s complexity. But the theory of legal complexity will remain stuck in theory until it moves to the empirical phase of study. Thinking about ways of managing legal complexity is pointless if there is no yardstick for deciding how complex the law should be. In short, the theory of legal complexity cannot be put to work without more robust empirical tools for identifying and tracking complexity in legal systems. This Article explores legal complexity at a depth not previously undertaken in legal scholarship.
    [Show full text]
  • A Philosophy of Technology for Computational Law
    © Mireille Hildebrandt, draft chapter for OUP’s The Philosophical Foundations of Information Technology Law, eds. David Mangan, Catherine Easton, Daithí Mac Síthigh A philosophy of technology for computational law Abstract: This chapter confronts the foundational challenges posed to legal theory and legal philosophy by the surge of computational law. Two types of computational law are at stake. On the one hand we have artificial intelligence in the legal realm that will be addressed as data-driven law, and on the other hand we have the coding of self-executing contracts and regulation in the blockchain, as well as other types of automated decision making (ADM), addressed as code-driven law. Data-driven law raises problems due to its autonomic operations and the ensuing opacity of its reasoning. Code-driven law presents us with a conflation of regulation, execution and adjudication. Though such implications are very different, both types of computational law share assumptions based on the calculability and computability of legal practice and legal research. Facing the assumptions and implications of data- and code-driven law the chapter will first investigate the affordances of current, text-driven law, and relate some of the core tenets of the Rule of Law to those affordances. This will lead to an enquiry into what computational law affords in terms of legal protection, assuming that one of the core functions of the law and the Rule of Law is to protect what is not computable. Keywords: positive law, rule of law, legal certainty, justice,
    [Show full text]
  • Text and Data Mining in Intellectual Property Law: Towards an Autonomous Classification of Computational Legal Methods 1
    TEXTAND TEXT AND DATA DATAMINIMINING IN INTELLECTUAL NGININTELPROPERTY LAW TOWARDS AN AUTONOMOUS CLASSIFICATION OF LECTUALPCOMPUTATIONAL LEGAL METHODS ROPERTYLCREATe Working Paper 2020/1 AWTOWATHOMAS MARGONI RDSANAU T Text and Data Mining in Intellectual Property Law: Towards an Autonomous Classification of Computational Legal Methods 1 Thomas Margoni2 I. Introduction Text and Data Mining (TDM) can generally be defined as the “process of deriving high-quality information from text and data,”3 and as a “tool for harnessing the power of structured and unstructured content and data, by analysing them at multiple levels and in several dimensions in order to discover hidden and new knowledge.”4 In other words, TDM refers to a set of automated analytical tools and methods that have the goal of extracting new, often hidden, knowledge from existing information, such as textual information (text mining) or structured and unstructured data (data mining), and on this basis annotate, index, classify and visualise such knowledge. All this, which is made possible by the fast advancements in computational power, internet speed, and data availability has the potential to constitute, if not a revolution in the scientific field, certainly a major advancement in the speed of scientific development as well as in its direction. In particular, the impact that TDM may have in the direction of scientific enquiry is invaluable. This is because by identifying the correlations and patterns that are often concealed to the eye of a human observer due to the amount, complexity, or variety of data surveyed, TDM allows for the discovery of concepts or the formulation of correlations that would have otherwise remained concealed or undiscovered.
    [Show full text]
  • Bottleneck Or Crossroad? Problems of Legal Sources Annotation and Some Theoretical Thoughts
    Article Bottleneck or Crossroad? Problems of Legal Sources Annotation and Some Theoretical Thoughts Amedeo Santosuosso * and Giulia Pinotti Research Center ECLT, University of Pavia, 27100 Pavia PV, Italy; [email protected] * Correspondence: [email protected] Received: 30 July 2020; Accepted: 6 September 2020; Published: 9 September 2020 Abstract: So far, in the application of legal analytics to legal sources, the substantive legal knowledge employed by computational models has had to be extracted manually from legal sources. This is the bottleneck, described in the literature. The paper is an exploration of this obstacle, with a focus on quantitative legal prediction. The authors review the most important studies about quantitative legal prediction published in recent years and systematize the issue by dividing them in text-based approaches, metadata-based approaches, and mixed approaches to prediction. Then, they focus on the main theoretical issues, such as the relationship between legal prediction and certainty of law, isomorphism, the interaction between textual sources, information, representation, and models. The metaphor of a crossroad shows a descriptive utility both for the aspects inside the bottleneck and, surprisingly, for the wider scenario. In order to have an impact on the legal profession, the test bench for legal quantitative prediction is the analysis of case law from the lower courts. Finally, the authors outline a possible development in the Artificial Intelligence (henceforth AI) applied to ordinary judicial activity, in general and especially in Italy, stressing the opportunity the huge amount of data accumulated before lower courts in the online trials offers. Keywords: legal sources; prediction; legal analytics 1.
    [Show full text]
  • Science and Technology Law Review
    The Columbia SCIENCE AND TECHNOLOGY LAW REVIEW www.stlr.org THE VARIABLE DETERMINACY THESIS Harry Surden1 This Article proposes a novel technique for characterizing the relative determinacy of legal decision-making. I begin with the observation that the determinacy of legal outcomes varies from context to context within the law. To augment this intuition, I develop a theoretical model of determinate legal decision-making. This model aims to capture the essential features that are typically associated with the concept of legal determinacy. I then argue that we can use such an idealized model as a standard for expressing the relative determinacy or indeterminacy of decision-making in actual, observed legal contexts. From a legal theory standpoint, this approach – separating determinacy and indeterminacy into their constituent conceptual elements – helps us to more rigorously define these theoretical ideas. Ultimately, from a practical standpoint, I assert that this framework assists in understanding why legal outcomes in certain contexts are determinate enough to be amenable to resolution by computers. 1 Associate Professor, University of Colorado Law School. B.A. Cornell University; J.D. Stanford University. Many thanks to Stanford Law School for supporting this work through my fellowship with the Stanford Center for Computers and Law, as well as to the generous support of the University of Colorado Law School. I am grateful for the ideas and challenges of Michael Genesereth from the Stanford Computer Science Department whose tireless efforts inspired this work. Many thanks to Paul Ohm, Phil Weiser, Pierre Schlag, Andrew Schwartz, Alexia Brunet, Vic Fleischer, and the rest of my excellent colleagues at the University of Colorado Law School for their input.
    [Show full text]
  • Legislation As Code for New Zealand: Opportunities, Risks, and Recommendations
    LEGISLATION AS CODE FOR NEW ZEALAND: OPPORTUNITIES, RISKS, AND RECOMMENDATIONS March 2021 Tom Barraclough | Hamish Fraser | Curtis Barnes ACKNOWLEDGEMENTS This report was generously funded by Te Manatū a Ture o Aotearoa, the New Zealand Law Foundation. Our thanks to the Law Foundation Board and to NZLF Executive Director Lynda Hagen. We also extend our thanks to the NZLF Information Law and PoliCy ProjeCt Advisory Review Committee and the project manager of ILAPP, RiChman Wee. Thank you to the University of Otago FaCulty of Law and the New Zealand Law Foundation Centre for Law and Emerging Technologies for providing access to library resources during this research. Thank you to the various people who have engaged with us or provided support in the course of producing this report. They have not seen the final report and any errors are attributable only to the authors. Our thanks to Nadia Webster, RiChard WallaCe, Pim Willemstein, NiCk Vaughan, Mariette Lokin, Meng Wong, Matthew Waddington, LaurenCe Diver, Dave Parry, Roopak Sinha, Joanna Pidgeon and Tim Jones for discussions during the course of this research. Thank you also to Paul MiChel, NiCk Nisbet, Jason Morris and Siobhan McCarthy for their responses to a case study shared during the research. ProduCed with funding from the New Zealand Law Foundation Information Law and PoliCy ProjeCt. MarCh 2021, AuCkland, New Zealand EXECUTIVE SUMMARY OVERVIEW AND PURPOSE This report aims to provide a basis for senior deCision-makers in New Zealand to CritiCally assess and aCt upon the potential of law-as-code initiatives. It was stimulated by the growing attention to the “Better Rules” programme, a “better rules approaCh”, and international “rules as code” efforts.
    [Show full text]
  • Judgments As Data Automated Open!Access Analytics for Decisions of Courts and Tribunals in New Zealand
    JUDGMENTS AS DATA AUTOMATED OPEN!ACCESS ANALYTICS FOR DECISIONS OF COURTS AND TRIBUNALS IN NEW ZEALAND December 2020 Tom Barraclough | Curtis Barnes | Warren Forster Produced with funding from the New Zealand Law Foundation Information Law and Policy Project. December 2020, Auckland, New Zealand Cover image credit: Malte Baumann, Unsplash. 1 PREAMBLE ............................................................................................................................................. 5 ACKNOWLEDGEMENTS .......................................................................................................................... 5 EXECUTIVE SUMMARY........................................................................................................................... 6 A NOTE ON “STRUCTURED DATA” ......................................................................................................... 8 OVERVIEW OPEN ACCESS TO DIGITAL CASE LAW IN NEW ZEALAND ...................................................................... 10 PREVIOUS ACCESS TO JUSTICE RESEARCH (2015) ........................................................................................... 10 PARTNERSHIP WITH OPENLAW NZ (2019) ................................................................................................. 11 ACCESS TO DIGITAL CASE LAW IN NEW ZEALAND ........................................................................................... 13 SUMMARY OF OUR FINDINGS ..................................................................................................................
    [Show full text]
  • AI4J – Artificial Intelligence for Justice August 30, 2016 the Hague, the Netherlands Workshop at the 22Nd European Conference on Artificial Intelligence (ECAI 2016)
    AI4J { Artificial Intelligence for Justice August 30, 2016 The Hague, The Netherlands Workshop at the 22nd European Conference on Artificial Intelligence (ECAI 2016) Workshop chairs Floris Bex Department of Information and Computing Sciences, Utrecht University Tom van Engers Leibniz Center for Law, Faculty of Law, University of Amsterdam Henry Prakken Faculty of Law, University of Groningen; Department of Information and Computing Sciences, Utrecht University Bart Verheij Institute of Artificial Intelligence and Cognitive Engineering, University of Groningen Artificial intelligence is currently in the centre of attention of legal professionals. An abundance of startup companies explore the application of AI techniques in the domain of law, and there is even talk of artificially intelligent legal assistants disrupting the legal market space. Factors driving the increased attention for legal AI include: Technological breakthroughs in machine learning, natural language process- ing, ubiquitous computing, data science, and argumentation technology; The changing attitude towards technology in the legal domain; The much increased availability of legal data on the internet; The recent success of AI applications in the private and public domain; The success of technology supporting access to law, legal empowerment, and transparency; The increased need for norms embedded in technology (autonomous driving and warfare, big data analysis for crime fighting and counterterrorism). The aim of this workshop is to investigate opportunities and challenges
    [Show full text]
  • Kevin D. Ashley. January, 2018 1 CURRICULUM VITA
    Kevin D. Ashley. January, 2018 1 CURRICULUM VITA Kevin Dean Ashley University Addresses: School of Law Learning Research and Development Center University of Pittsburgh University of Pittsburgh 3900 Forbes Avenue 3939 O'Hara Street Pittsburgh, Pennsylvania 15260 Pittsburgh, Pennsylvania 15260 (412) 648-1495 (412) 624-7496 Research Interests: My research interests in learning, law, and computer science are to: (1) Develop computational models of case-based reasoning (CBR) and argumentation in domains like law and practical ethics to better understand decision-making and as a basis for intelligent systems to educate students; (2) Develop techniques for linking computational models of legal reasoning with legal texts in order to facilitate acquiring knowledge in Artificial Intelligence (AI) programs and to assist legal practitioners; (3) Identify and analyze special legal problems posed by computer technology in such areas as intellectual property, commercial law, product liability, technology licensing, and privacy. Summary of Qualifications: Professor of Law and Intelligent Systems, University of Pittsburgh Senior Scientist, Learning Research and Development Center Adjunct Professor of Computer Science Fellow, American Association of Artificial Intelligence National Science Foundation Presidential Young Investigator M.A., Ph.D., Computer Science, University of Massachusetts J.D., Harvard Law School B.A., Philosophy, Princeton University Associate Attorney, White & Case, 14 Wall Street, New York City Visiting Scientist, IBM Thomas J. Watson Research Center Professional Academic and Research Experience: UNIVERSITY OF PITTSBURGH, Pittsburgh, Pennsylvania. Dates: September, 1989 through present. Current Joint Appointments: Professor of Law (with tenure), School of Law, September, 1998 Professor of Intelligent Systems, Graduate Program in Intelligent Systems, September, 1998 Senior Scientist, Learning Research and Development Center, October, 1998 Adjunct Professor of Computer Science, September, 1998.
    [Show full text]
  • Ex Machina: Analytical Platforms, Law and the Challenges of Computational Legal Science
    Article Ex Machina: Analytical platforms, Law and the Challenges of Computational Legal Science Nicola Lettieri 1,*, Antonio Altamura 2, Rosalba Giugno 3, Alfonso Guarino 2, Delfina Malandrino 2, Alfredo Pulvirenti 4, Francesco Vicidomini 2 and Rocco Zaccagnino 2 1 National Institute for Public Policy Analysis (INAPP), 00198 Rome, Italy 2 Department of Computer Science, University of Salerno, 84084 Fisciano, Italy; [email protected] (A.A.); [email protected] (A.G.); [email protected] (D.M.); [email protected] (F.V.); [email protected] (R.Z.) 3 Department of Computer Science, University of Verona, 37134 Verona, Italy; [email protected] 4 Department of Clinical and Experimental Medicine, University of Catania, 95123 Catania, Italy; [email protected] * Correspondence: [email protected] Received: 16 March 2018; Accepted: 23 April 2018; Published: 26 April 2018 Abstract: Over the years, computation has become a fundamental part of the scientific practice in several research fields that goes far beyond the boundaries of natural sciences. Data mining, machine learning, simulations and other computational methods lie today at the hearth of the scientific endeavour in a growing number of social research areas from anthropology to economics. In this scenario, an increasingly important role is played by analytical platforms: integrated environments allowing researchers to experiment cutting-edge data-driven and computation-intensive analyses. The paper discusses the appearance of such tools in the emerging field of computational legal science. After a general introduction to the impact of computational methods on both natural and social sciences, we describe the concept and the features of an analytical platform exploring innovative cross-methodological approaches to the academic and investigative study of crime.
    [Show full text]