Arxiv:1709.02779V1 [Quant-Ph] 8 Sep 2017 I
Total Page:16
File Type:pdf, Size:1020Kb
Machine learning & artificial intelligence in the quantum domain Vedran Dunjko Institute for Theoretical Physics, University of Innsbruck, Innsbruck 6020, Austria Max Planck Institute of Quantum Optics, Garching 85748, Germany Email: [email protected] Hans J. Briegel Institute for Theoretical Physics, University of Innsbruck Innsbruck 6020, Austria Department of Philosophy, University of Konstanz, Konstanz 78457, Germany Email: [email protected] Abstract. Quantum information technologies, on the one side, and intelligent learning systems, on the other, are both emergent technologies that will likely have a transforming impact on our society in the future. The respective underlying fields of basic research { quantum information (QI) versus machine learning and artificial intelligence (AI) { have their own specific questions and challenges, which have hitherto been investigated largely independently. However, in a growing body of recent work, researchers have been prob- ing the question to what extent these fields can indeed learn and benefit from each other. QML explores the interaction between quantum computing and machine learning, inves- tigating how results and techniques from one field can be used to solve the problems of the other. In recent time, we have witnessed significant breakthroughs in both directions of influence. For instance, quantum computing is finding a vital application in providing speed-ups for machine learning problems, critical in our \big data" world. Conversely, machine learning already permeates many cutting-edge technologies, and may become instrumental in advanced quantum technologies. Aside from quantum speed-up in data analysis, or classical machine learning optimization used in quantum experiments, quan- tum enhancements have also been (theoretically) demonstrated for interactive learning tasks, highlighting the potential of quantum-enhanced learning agents. Finally, works exploring the use of artificial intelligence for the very design of quantum experiments, and for performing parts of genuine research autonomously, have reported their first successes. Beyond the topics of mutual enhancement { exploring what ML/AI can do for quantum physics, and vice versa { researchers have also broached the fundamental issue of quantum generalizations of learning and AI concepts. This deals with questions of the very meaning of learning and intelligence in a world that is fully described by quantum mechanics. In this review, we describe the main ideas, recent developments, and progress in a broad spectrum of research investigating machine learning and artificial intelligence in the quantum domain. CONTENTS arXiv:1709.02779v1 [quant-ph] 8 Sep 2017 I. Introduction 3 A. Quantum mechanics, computation and information processing4 B. Artificial intelligence and machine learning7 1. Learning from data: machine learning9 2. Learning from interaction: reinforcement learning 11 3. Intermediary learning settings 12 4. Putting it all together: the agent-environment paradigm 12 C. Miscellanea 15 2 II. Classical background 15 A. Methods of machine learning 16 1. Artificial neural networks and deep learning 17 2. Support Vector Machines 19 3. Other models 22 B. Mathematical theories of supervised and inductive learning 24 1. Computational learning theory 25 2. VC theory 27 C. Basic methods and theory of reinforcement learning 30 III. Quantum mechanics, learning, and AI 34 IV. Machine learning applied to (quantum) physics 35 A. Hamiltonian estimation and metrology 37 1. Hamiltonian estimation 37 2. Phase estimation settings 38 3. Generalized Hamiltonian estimation settings 39 B. Design of target evolutions 40 1. Off-line design 41 2. On-line design 41 C. Controlling quantum experiments, and machine-assisted research 42 1. Controlling complex processes 43 2. Learning how to experiment 44 D. Machine learning in condensed-matter and many-body physics 45 V. Quantum generalizations of machine learning concepts 47 A. Quantum generalizations: machine learning of quantum data 47 1. State discrimination, state classification, and machine learning of quantum data 48 2. Computational learning perspectives: quantum states as concepts 52 B. (Quantum) learning and quantum processes 53 VI. Quantum enhancements for machine learning 55 A. Learning efficiency improvements: sample complexity 56 1. Quantum PAC learning 57 2. Learning from membership queries 58 B. Improvements in learning capacity 60 1. Capacity from amplitude encoding 60 2. Capacity via quantized Hopfield networks 61 C. Run-time improvements: computational complexity 63 1. Speed-up via adiabatic optimization 64 2. Speed-ups in circuit architectures 68 VII. Quantum learning agents, and elements of quantum AI 76 A. Quantum learning via interaction 77 B. Quantum agent-environment paradigm for reinforcement learning 83 1. AE-based classification of quantum ML 86 C. Towards quantum artificial intelligence 87 VIII. Outlook 88 Acknowledgements 91 References 91 3 I. INTRODUCTION Quantum theory has influenced most branches of physical sciences. This influence ranges from minor corrections, to profound overhauls, particularly in fields dealing with sufficiently small scales. In the second half of the last century, it became apparent that genuine quantum effects can also be exploited in engineering-type tasks, where such effects enable features which are superior to those achievable using purely classical systems. The first wave of such engineering gave us, for example, the laser, transistors, and nuclear magnetic resonance devices. The second wave, which gained momentum in the '80s, constitutes a broad-scale, albeit not fully systematic, investigation of the potential of utilizing quantum effects for various types of tasks which, at the base of it, deal with the processing of information. This includes the research areas of cryptography, computing, sensing and metrology, all of which now share the common language of quantum information science. Often, the research into such interdisciplinary programs was exceptionally fruitful. For instance, quantum computation, communication, cryptography and metrology are now mature, well-established and impactful research fields which have, arguably, revolutionized the way we think about information and its processing. In recent years, it has become apparent that the exchange of ideas between quantum information processing and the fields of artificial intelligence and machine learning has its own genuine questions and promises. Although such lines of research are only now receiving a broader recognition, the very first ideas were present already at the early days of QC, and we have made an effort to fairly acknowledge such visionary works. In this review we aim to capture research at the interplay between machine learning, artificial intelligence and quantum mechanics in its broad scope, with a reader with a physics background in mind. To this end, we dedicate comparatively large amount of space to classical machine learning and artificial intelligence topics, which are often sacrificed in physics-oriented literature, while keeping the quantum information aspects concise. The structure of the paper is as follows. In the remainder of this introductory sectionI, we give quick overviews of the relevant basic concepts of the fields quantum information processing, and of machine learning and artificial intelligence. We finish off the introduction with a glossary of useful terms, list of abbreviations, and comments on notation. Subsequently, in sectionII we delve deeper into chosen methods, technical details, and the theoretical background of the classical theories. The selection of topics here is not necessarily balanced, from a classical perspective. We place emphasis on elements which either appear in subsequent quantum proposals, which can sometimes be somewhat exotic, or on aspects which can help put the relevance of the quantum results into proper context. Section III briefly summarizes the topics covered in the quantum part of the review. SectionsIV- VII cover the four main topics we survey, and constitute the central body of the paper. We finish with a an outlook section VIII. Remark: The overall objective of this survey is to give a broad, \birds-eye" account of the topics which contribute to the development of various aspects of the interplay between quantum information sciences, and machine learning and artificial intelligence. Consequently, this survey does not necessarily present all the developments in a fully balanced fashion. Certain topics, which are in their very early stages of investigation, yet important for the nascent research area, were given perhaps a disproportional level of attention, compared to more developed themes. This is, for instance, particularly evident in section VII, which aims to address the topics of quantum artificial intelligence, beyond mainstream data analysis applications of machine learning. This topic is relevant for a broad perspective on the emerging field, however it has only been broached by very few authors, works, including the authors of this review and collaborators. The more extensively explored topics 4 of, e.g., quantum algorithms for machine learning and data mining, quantum computational learning theory, or quantum neural networks, have been addressed in more focused recent reviews (Wittek, 2014a; Schuld et al., 2014a; Biamonte et al., 2016; Arunachalam and de Wolf, 2017; Ciliberto et al., 2017). A. Quantum mechanics, computation and information processing Executive summary: Quantum theory leads to many counterintuitive and