5 AI in Action

Total Page:16

File Type:pdf, Size:1020Kb

5 AI in Action THE EXECUTIVE GUIDE TO ARTIFICIAL INTELLIGENCE How to identify and implement applications for AI in your organization ANDREW BURGESS 每日免费获取金融报告 1.每日微信群内分享5+重磅金融研究报告; 2.金融,互联网,制造业,服务业,数据模型,研究方法…超过10 万份,每周分享 重点事件; 4.每月200+资料汇总,累计上万份金融报告,给专属用户; 截图 扫一扫二维码 或搜索公众号【seed思得】 点击菜单栏“研究报告”->"资料共享" 加入seed思得共享微信群(1-100群) The Executive Guide to Artificial Intelligence Andrew Burgess The Executive Guide to Artificial Intelligence How to identify and implement applications for AI in your organization Andrew Burgess AJBurgess Ltd London, United Kingdom ISBN 978-3-319-63819-5 ISBN 978-3-319-63820-1 (eBook) https://doi.org/10.1007/978-3-319-63820-1 Library of Congress Control Number: 2017955043 © The Editor(s) (if applicable) and The Author(s) 2018 This work is subject to copyright. All rights are solely and exclusively licensed by the Publisher, whether the whole or part of the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation, broadcasting, reproduction on microfilms or in any other physical way, and transmission or informa- tion storage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology now known or hereafter developed. The use of general descriptive names, registered names, trademarks, service marks, etc. in this publication does not imply, even in the absence of a specific statement, that such names are exempt from the relevant protective laws and regulations and therefore free for general use. The publisher, the authors and the editors are safe to assume that the advice and information in this book are believed to be true and accurate at the date of publication. Neither the publisher nor the authors or the editors give a warranty, express or implied, with respect to the material contained herein or for any errors or omissions that may have been made. The publisher remains neutral with regard to jurisdictional claims in published maps and institutional affiliations. Cover illustration: Ukususha/iStock/Getty Images Plus Printed on acid-free paper This Palgrave Macmillan imprint is published by Springer Nature The registered company is Springer International Publishing AG The registered company address is: Gewerbestrasse 11, 6330 Cham, Switzerland This book is dedicated to my wonderful wife, Meg, and our two amazing children, James and Charlie. Foreword I remember well the AI work I did whilst at college studying computer science, how different and fascinating it was and still is. We were set a very open challenge to write an AI programme on any subject. I decided to write mine so that it could tell you if the building in a photo was a house, a flat or a bungalow. Somewhat impractical, but a great learning experi- ence for me, particularly in understanding how AI is different from tradi- tional software. Although my college days were a number of years ago, since that time the concept of computers learning has always intrigued me and I have since won- dered how long it will take for AI to have a truly widespread impact. In recent years, we’ve seen massive improvements in processing power, big data collec- tion via sensors and the Internet of Things, cloud services, storage, ubiquitous connectivity and much more. These technological leaps mean that this is the right time for AI to become part of the ‘here and now’ and I strongly believe we will see a dramatic increase in the use of AI over the next few years. The AI in use today is known as narrow AI because it can excel at thousands of relatively narrow tasks (e.g. doing internet searches, playing Go or looking for fraudulent transactions). Things will certainly get even more exciting when ‘general AI’ can outperform humans at nearly every task we do, but we simply don’t know when this might be, or what the world will then look like. Until then, what excites me most is how we can apply AI now to solve our day-to- day problems at home and work. So why is AI important and how can we use it? Firstly, if you are impatient (like I am), doing small manual, repetitive tasks on computers simply takes too much time. I want the computer to do a better job of anticipating my needs and to just get on with it. If I could, I would prefer to talk to Alexa or vii viii Foreword Google Assistant and just tell the computer what to do. For example, I would love to be able to ask Alexa to buy the most convenient train ticket and take the money out of my account. Compare this to buying a train ticket on any website, where after something like 50 key strokes you might have bought a ticket. I don’t think future generations, who are becoming increasingly impa- tient, will put up with doing these simple and time-consuming tasks. I see my children and future generations having more ‘thinking time’ and focusing on things that are outside the normal tasks. AI may in fact free up so much of my children’s time that they can finally clean up their bedrooms. In the workplace, how many of the emails, phone calls and letters in a call centre could be handled by AI? At Virgin Trains, we used AI to reduce the time spent dealing with customer emails by 85% and this enabled our people to focus on the personable customer service we’re famous for. Further improvements will no doubt be possible in the future as we get better at developing conversational interfaces, deep learning and process automation. One can imagine similar developments revolutionising every part of the business, from how we hire peo- ple to how we measure the effectiveness of marketing campaigns. So, what about the challenges of AI? One that springs to mind at Virgin is how to get the ‘tone of voice’ right. Our people are bold, funny and empa- thetic, and our customers expect this from us in every channel. Conversational interfaces driven by AI should be no different. Today it may be a nuisance if your laptop crashes, but it becomes all the more important that an AI system does what you want it to do if it controls your car, your airplane or your pacemaker. With software systems that can learn and adapt, we need to understand where the responsibility lies when they go wrong. This is both a technical and an ethical challenge. Beyond this, there are questions about data privacy, autonomous weapons, the ‘echo cham- ber’ problem of personalised news, the impact on society as increasing num- bers of jobs can be automated and so on. Despite these challenges, I am incredibly excited about the future of tech- nology, and AI is right at the heart of the ‘revolution’. I think over the next five to ten years AI will make us more productive at work, make us more healthy and happy at home, and generally change the world for the better. To exploit these opportunities to the full, businesses need people who understand these emerging technologies and can navigate around the chal- lenges. This book is essential reading if you want to understand this transfor- mational technology and how it will impact your business. John Sullivan, CIO and Innovation at Virgin Trains Acknowledgements I would like to thank the following people for providing valuable input, con- tent and inspiration for this book: Andrew Anderson, Celaton Richard Benjamins, Axa Matt Buskell, Rainbird Ed Challis, Re:infer Karl Chapman, Riverview Law Tara Chittenden, The Law Society Sarah Clayton, Kisaco Research Dana Cuffe, Aldermore Rob Divall, Aldermore Gerard Frith, Matter Chris Gayner, Genfour Katie Gibbs, Aigen Daniel Hulme, Satalia Prof. Mary Lacity, University of Missouri-St Louis Prof. Ilan Oshri, Loughborough University Stephen Partridge, Palgrave Mike Peters, Samara Chris Popple, Lloyds Bank John Sullivan, Virgin Trains Cathy Tornbaum, Gartner ix x Acknowledgements Vasilis Tsolis, Congnitiv+ Will Venters, LSE Kim Vigilia, Conde Naste Prof. Leslie Willcocks, LSE Everyone at Symphony Ventures Contents 1 Don’t Believe the Hype 1 2 Why Now? 11 3 AI Capabilities Framework 29 4 Associated Technologies 55 5 AI in Action 73 6 S tarting an AI Journey 91 7 AI Prototyping 117 8 What Could Possibly Go Wrong? 129 9 Industrialising AI 147 10 Wher e Next for AI? 165 Index 177 xi List of Figures Fig. 2.1 Basic neural network 21 Fig. 2.2 Training a neural network 21 Fig. 2.3 A trained neural network 22 Fig. 3.1 AI objectives 30 Fig. 3.2 Knowledge map 43 Fig. 3.3 The AI framework 51 Fig. 4.1 Human in the loop 68 Fig. 4.2 Training through a human in the loop 69 Fig. 4.3 Crowd-sourced data training 69 Fig. 6.1 Aligning with the business strategy 93 Fig. 6.2 AI maturity matrix 100 Fig. 6.3 AI heat map first pass 102 Fig. 6.4 AI heat map 104 Fig. 9.1 AI Eco-System 148 xiii 1 Don’t Believe the Hype Introduction Read any current affairs newspaper, magazine or journal, and you are likely to find an article on artificial intelligence (AI), usually decrying the way the ‘robots are taking over’ and how this mysterious technology is the biggest risk to humanity since the nuclear bomb was invented. Meanwhile the companies actually creating AI applications make grand claims for their technology, explaining how it will change peoples’ lives whilst obfuscating any real value in a mist of marketing hyperbole. And then there is the actual technology itself—a chimera of mathematics, data and computers—that appears to be a black art to anyone outside of the developer world.
Recommended publications
  • 5Efa37f24b66fa5fa397c116 Bec
    © Prolego, Inc., 2018. All rights reserved. ISBN 978-0-692-19233-7 This book or parts thereof may not be reproduced in any form, stored in any retrieval system, or transmitted in any form by any means—electronic, mechanical, photocopy, recording, or otherwise—without prior written permission of Prolego, except as provided by United States of America copyright law. For permission requests contact Prolego. Prolego, Inc. 400 West Peachtree Street NW Suite #4 - 868 Atlanta, GA 30308 prolego.io [email protected] Contents - 07 Introduction - 23 PART 1: AI Fundamentals - 45 PART 2: Discovering AI Opportunities - 75 PART 3: Building a Winning AI Strategy - 97 PART 4: Launching Your First AI Product - 117 Epilogue - 121 Appendices 6 – INTRODUCTION 6 – INTRODUCTION Even if there were a trustworthy way to send money over the Internet– which there isn’t–the network is missing a most essential ingredient of capitalism: salespeople. — Clifford Stoll “The Internet? Bah!” Newsweek 1995 BECOME AN AI COMPANY IN 90 DAYS – 7 Introduction THE ERA OF INTELLIGENT COMPUTING Congratulations. You’re living through a once-in-a-generation technology shift—the era of artificial intelligence, or AI. Like previous fundamental shifts such as electricity, the computer, or the Internet, AI will change everything. Skeptical about such big claims? I don’t blame you. Over the past few decades we’ve been bombarded by an endless parade of new technologies promising to “disrupt” everything and solve all our problems. BECOME AN AI COMPANY IN 90 DAYS 8 – INTRODUCTION Most of these technologies never yield more than incremental benefits: > Object-oriented programming made software only slightly more reusable.
    [Show full text]
  • EG Analysistofairhousing Cover Draftmay2009.Ai
    Analysis of Impediments to Fair Housing & Fair Housing Plan - May , C ITY OF ELK G ROVE A NALYSIS OF I MPEDIMENTS TO F AIR H OUSING C HOICE FAIR HOUSING PLAN 2008-09 Prepared by: CITY OF ELK GROVE 8401 LAGUNA PALMS WAY ELK GROVE, CA 95758 MAY 15, 2009 TABLE OF CONTENTS TABLE OF CONTENTS Executive Summary .................................................................................................................................. ES-1 1 Introduction ........................................................................................................................................ 1-1 2 Review of Previous Analysis of Impediments ................................................................................. 2-1 3 Community Setting ............................................................................................................................ 3-1 4 Housing Market Conditions .............................................................................................................. 4-1 5 Mortgage Lending (HMDA Data) ................................................................................................... 5-1 6 Government Barriers to Fair Housing Choice ................................................................................ 6-1 7 Fair Housing Enforcement and Education ..................................................................................... 7-1 8 Summary Analysis .............................................................................................................................
    [Show full text]
  • Analysis of Impediments to Fair Housing Choice in New Hampshire
    Analysis of Impediments to Fair Housing Choice in New Hampshire 2020 UPDATE May 2021 Prepared for New Hampshire Housing Finance Authority and New Hampshire Community Development Finance Authority by New Hampshire Legal Assistance Analysis of Impediments to Fair Housing Choice in New Hampshire 2020 Update May 2021 Prepared for New Hampshire Housing Finance Authority and New Hampshire Community Development Finance Authority by New Hampshire Legal Assistance The publication of the 2020 Update to the Analysis of Impediments to Fair Housing Choice in New Hampshire (2020 AI) marks the fifth Analysis conducted since 1996 when the Office of State Planning issued the original Analysis of Impediments (AI). By 2004, New Hampshire Housing Finance Authority (NHHFA) had taken responsibility for evaluating barriers to housing opportunity and published an update to the AI. In 2010, New Hampshire Community Development Finance Authority (CDFA) also began supporting publication of the AI. The most recent update was published in 2015. New Hampshire Legal Assistance (NHLA), under contract with NHHFA and CDFA, has produced all four of the updates. Scope of Investigation In preparing the 2020 AI Report, the following activities were undertaken: 1. Thirty-year review of affirmatively furthering fair housing in the state 2. Demographic analyses; 3. Evaluation of areas of high poverty and racial/ethnic concentrations; 4. A focus group and a set of one-on-one interviews with community members; 5. A survey of the state’s Public Housing Authorities (PHAs); 6. Analysis of the housing barriers facing residents with serious mental illness; 7. Research into legal developments at the federal and state level; 8.
    [Show full text]
  • 2Wsm1sbirsdt WBEUVEII the Lieu
    ; To! ~~. Rider life-saving team drowns in Maurer pool (8ee p. 27) .2wsM1SbiRsdT WBEUVEII THE lIEU. If. IS 'APIIIL I, 1912· 'Rider deals with moose on loose clean up the path of damaae By JIMMY OLSEN toro d~ by their c:ompet!.­ sure save OD au," er tumiD. the e&mpas iDto . : To add to the seasonal tioo, but we know better. and litter the l.rae berbi­ zoo. problem of Canada geese It', those damn meese." vores bave left 00 campus, He said he w.. astiDg for 00 campus, a herd said co-fouoder Sbarkey volUDteen to dress up .. roostia, The large animals ' have " Actually, that'd be re­ of moose hal settled 00 Wook. moose and " live with the also ambled. into classrooms dundant," said ,;ock Rhino, camp~ , said Godzi1Ia Belcb, jlerd, leani their ~ . " assistant director of Public and begwi to bellow. Roger Brooke Taney, assoc­ usociate director of the Phy­ If' that faU., said Taney, InformatioD. " It already is a iate dean of studeots, said .leaI Plant. the CoHe,. may also COIlIld· ZOO , " li lt's - very atlDoyiD.," said the College w.. colUidering sophomore Grinch McChurll­ biring reIlOWD~ bUDter Joe Belch said t be aDlmal. bobiDstilly. 'They ...ake you have diJrupted tnffic, intra­ . "BuO" W1Dtle to emrmiDate up," the beasts. m~ J&;mel a.a.d campaips Students arrested for Student GoYemmeJlt Au­ McChurliboo.i:llly. a ociation ~_. " On . the other band, we By WALD'- DAIIIIII!rr echoed ac:rosa campus, said· 6.aance major, said be aDd a mi,bt try to d.omesticate ApproJdrDately 100 ·studeD.
    [Show full text]
  • AI Watch Historical Evolution of Artificial Intelligence
    JRC TECHNICAL REPORTS AI Watch Historical Evolution of Artificial Intelligence Analysis of the three main paradigm shifts in AI EUR 30221 EN This publication is a Technical report by the Joint Research Centre (JRC), the European Commission’s science and knowledge service. It aims to provide evidence-based scientific support to the European policymaking process. The scientific output expressed does not imply a policy position of the European Commission. Neither the European Commission nor any person acting on behalf of the Commission is responsible for the use that might be made of this publication. Contact information Blagoj DELIPETREV European Commission, Joint Research Centre, TP262, Via Fermi, 21027 Ispra (VA), ITALY [email protected] Tel.: + 39 0332 786 352 AI-Watch functional mailbox [email protected] EU Science Hub https://ec.europa.eu/jrc JRC120469 EUR 30221 EN PDF ISBN 978-92-76-18940-4 ISSN 1831-9424 doi:10.2760/801580 Luxembourg: Publications Office of the European Union, 2020 © European Union, 2020 The reuse policy of the European Commission is implemented by the Commission Decision 2011/833/EU of 12 December 2011 on the reuse of Commission documents (OJ L 330, 14.12.2011, p. 39). Except otherwise noted, the reuse of this document is authorised under the Creative Commons Attribution 4.0 International (CC BY 4.0) licence (https://creativecommons.org/licenses/by/4.0/). This means that reuse is allowed provided appropriate credit is given and any changes are indicated. For any use or reproduction of photos or other material that is not owned by the EU, permission must be sought directly from the copyright holders.
    [Show full text]
  • Aistrom – a Roadmap for Developing a Successful AI Strategy Arxiv
    aiSTROM { A roadmap for developing a successful AI strategy Dorien Herremans1 1Singapore University of Technology and Design June 2021 A total of 34% of AI research and development projects fails or are abandoned, accord- ing to a recent survey by Rackspace Technology of 1,870 companies (Rackspace Technol- ogy, 2021). We propose a new strategic framework, aiSTROM, that empowers managers to create a successful AI strategy based on a thorough literature review. This provides a unique and integrated approach that guides managers and lead developers through the var- ious challenges in the implementation process. In the aiSTROM framework, we start by identifying the top n potential projects (typically 3-5). For each of those, seven areas of focus are thoroughly analysed. These areas include creating a data strategy that takes into account unique cross-departmental machine learning data requirements, security, and legal requirements. aiSTROM then guides managers to think about how to put together an inter- disciplinary artificial intelligence (AI) implementation team given the scarcity of AI talent. Once an AI team strategy has been established, it needs to be positioned within the organi- zation, either cross-departmental or as a separate division. Other considerations include AI as a service (AIaas), or outsourcing development. Looking at new technologies, we have to consider challenges such as bias, legality of black-box-models, and keeping humans in the loop. Next, like any project, we need value-based key performance indicators (KPIs) to track and validate the progress. Depending on the company’s risk-strategy, a SWOT analysis (strengths, weaknesses, opportunities, and threats) can help further classify the shortlisted projects.
    [Show full text]
  • Alfakabi's Theory of State
    ALFAKABI'S THEORY OF STATE ISSIRTATION SUBMITTED FOR THE DEQREB OF MASTER OF PHILOSOPHY IN Political Science BY Saiyid Ali Sajjad Under the Supervision of Mr. Abdul Shafiq Beg READER DEPARTMENT OF POLITICAL SCIENCE ALIGARH MUSLIM UNIVERSITY ALIGARH 1980 1^ umiEn'o\'^''' DS260 •JX& CHECSED- PRBFACE So tax, there h^ive iaeon no d«tadLXed theniatic studLLea o£ trie ix>Utlcal philosophy o£ ALTAaAQI^ *rh« sacond Toach«r*' (al CHialllm al than!) oi. the Arab worlds Aristotle beinj tlie Firat. Whatever little viock is dofie« is in the field o£ his metaphysical* logiical and philosof^iical* or at most psychological conoapts only, in this study X have attsmptod to fonnulate a systematic theory o£ state wi the basis o£ Alfarabi*a own writings in Arabic, in doing so X h^ivm had to travel into the reijicms of metaip^ysicB, philoso{^y« religion* ethics as well as that of psychology as they are all mixed up and intricately woven into his political thoi^ht, AS a matter of fact these are the various baswsi of his tli^ory of state* t^iich cme oarmot ignore in a detailed and ccs^n^iMMiisive study of his ccmcept of the State and political authority. The present researdi project has h^en udertaken to supplicate for the M.phil, degree from Aligarh Muslim University, wliich 1 interU to further elaborate* and compare Alfarabl^s political thou;jht %iith that of X&n sina in the light of are«^ as well as Islamic theories of state in my thesis for the degree of Ph.D.
    [Show full text]
  • Comparison of National Strategies to Promote Artificial Intelligence
    Comparison of National Strategies to Promote Artificial Intelligence Part 2 www.kas.de Imprint Editor: Konrad-Adenauer-Stiftung e. V. 2019, Berlin Authors: Dr. Olaf J. Groth, CEO & Managing Partner Dr. Mark Nitzberg, Principal & Chief Scientist Dan Zehr, Editor-in-Chief Tobias Straube, Project Manager and Senior-Analyst Toni Kaatz-Dubberke, Senior-Analyst Franziska Frische, Analyst Maximilien Meilleur, Analyst Suhail Shersad, Analyst Cambrian LLC, 2381 Eunice Street, Berkeley CA 94708-1644, United States https://cambrian.ai, Twitter: @AICambrian Editorial team and contact at the Konrad-Adenauer-Stiftung e. V. Sebastian Weise Consultant for Global Innovation Policy Post: 10907 Berlin Office: Klingelhöferstraße 23 T +49 30 / 269 96-3516 10785 Berlin F +49 30 / 269 96-3551 [Note: This English-language version was translated from the original publication in German.] Cover image: © sarah5/Mlenny (istockphoto by Getty Images) Images: © p. 11: Matthew Henry, p.16: Manuel Cosentino, p. 23: Dan Gold, p. 30: David Rodrigo, p. 42: Victor Garcia (unsplash); p. 36: byheaven (istockphoto by Getty Images) Design and typesetting: yellow too Pasiek Horntrich GbR The print edition was produced in a carbon-neutral way at Druckerei Kern GmbH, Bexbach, and printed on FSC-certified paper. Printed in Germany. Printed with the financial support of the Federal Republic of Germany. This publication is licenced under the terms of “Creative Commons Attribution-Share Alike 4.0 International”, CC BY-SA 4.0 (available at: https://creativecommons.org/licenses/ by-sa/4.0/) legalcode.de). ISBN 978-3-95721-553-6 Comparison of National Strategies to Promote Artificial Intelligence Part 2 Dr. Olaf J.
    [Show full text]
  • Deep Reinforcement Learning
    DEEP REINFORCEMENT LEARNING Yuxi Li ([email protected]) ABSTRACT We discuss deep reinforcement learning in an overview style. We draw a big pic- ture, filled with details. We discuss six core elements, six important mechanisms, and twelve applications, focusing on contemporary work, and in historical con- texts. We start with background of artificial intelligence, machine learning, deep learning, and reinforcement learning (RL), with resources. Next we discuss RL core elements, including value function, policy, reward, model, exploration vs. exploitation, and representation. Then we discuss important mechanisms for RL, including attention and memory, unsupervised learning, hierarchical RL, multi- agent RL, relational RL, and learning to learn. After that, we discuss RL appli- cations, including games, robotics, natural language processing (NLP), computer vision, finance, business management, healthcare, education, energy, transporta- tion, computer systems, and, science, engineering, and art. Finally we summarize briefly, discuss challenges and opportunities, and close with an epilogue. 1 Keywords: deep reinforcement learning, deep RL, algorithm, architecture, ap- plication, artificial intelligence, machine learning, deep learning, reinforcement learning, value function, policy, reward, model, exploration vs. exploitation, representation, attention, memory, unsupervised learning, hierarchical RL, multi- agent RL, relational RL, learning to learn, games, robotics, computer vision, nat- ural language processing, finance, business management, healthcare, education, energy, transportation, computer systems, science, engineering, art arXiv:1810.06339v1 [cs.LG] 15 Oct 2018 1Work in progress. Under review for Morgan & Claypool: Synthesis Lectures in Artificial Intelligence and Machine Learning. This manuscript is based on our previous deep RL overview (Li, 2017). It benefits from discussions with and comments from many people. Acknowledgements will appear in a later version.
    [Show full text]
  • Can Artificial Intelligence Help Predict a Learner's Needs? Lessons From
    LONDON REVIEW OF EDUCATION e-ISSN: 1474-8479 Journal homepage: https://www.uclpress.co.uk/pages/london-review-of- education Can artificial intelligence help predict a learner’s needs? Lessons from predicting student satisfaction Dimitris Parapadakis How to cite this article Parapadakis, D. (2020) ‘Can artificial intelligence help predict a learner’s needs? Lessons from predicting student satisfaction’. London Review of Education, 18 (2): 178–195. https://doi.org/10.14324/LRE.18.2.03 Submission date: 30 September 2019 Acceptance date: 20 March 2020 Publication date: 21 July 2020 Peer review This article has been peer-reviewed through the journal’s standard double-blind peer review, where both the reviewers and authors are anonymized during review. Copyright © 2020 Parapadakis. This is an Open Access article distributed under the terms of the Creative Commons Attribution Licence (CC BY) 4.0 https://creativecommons.org/licenses/by/4.0/, which permits unrestricted use, distribution and reproduction in any medium, provided the original author and source are credited. Open access London Review of Education is a peer-reviewed Open Access journal. Parapadakis, D. (2020) ‘Can artificial intelligence help predict a learner’s needs? Lessons from predicting student satisfaction’. London Review of Education, 18 (2): 178–195. DOI https://doi.org/10.14324/LRE.18.2.03 Can artificial intelligence help predict a learner’s needs? Lessons from predicting student satisfaction Dimitris Parapadakis* − University of Westminster, UK Abstract The successes of using artificial intelligence (AI) in analysing large-scale data at a low cost make it an attractive tool for analysing student data to discover models that can inform decision makers in education.
    [Show full text]
  • R'^.'--^^/>^Y^^^,^«»A'*S^-''—^^^^^^^ .^^:•;^::•;A^«Or|L•R•El•Ilt^Ire^,'•'••A; ••.}•..•:J Highest 9F,#In Lotteaiof Pownr.>-U
    .'. •..•.is'.'-im- 'mmmi • .' •.•#^:'•'•r'^.'--^^/>^y^^^,^«»A'*s^-''—^^^^^^^ .^^:•;^::•;A^«or|l•r•el•Ilt^ire^,'•'••A; ••.}•..•:j Highest 9f,#in LotTeaiof Pownr.>-U. S. €ov't Report, Aug. 17,1889^ V'Tbla .luorutitg abiwt.twb o'cioeit; Jobu Wood, tbe well-hnowu plumber ThHr8<l>r» October 18,18$l, \ wbo resides on Main Street, was' awakened by hearing gloss break. Ou IVIieMfleld. " getting out of bed be received ft blow '^\ I Nloo weather for torn hunkliw-AlBledon on tbe bead. He immediately grap* I iHoUool Ulhtrlot. No. S. ara buliaiDK ». now pled with the burglar,: aud after a I brJokBPhool Uouie-CharlMBeemanlibuHd 'Ingoniiddltlon tohUawelllng.-Mrj.Tarrrt,; terrible atruggie succeeded In balding ,of Uratlot county, made her djughtor^JIM. B, hlin until Ills wife obtained help. On I V Kent a vlaltloat week -Mr Oeo Haddle, being searobed at tlie statiou, Mr. IUotKuUiii eouuty, waa. th« guoat of;frjonda lu Wood's watch and wallet were found MASON; MIGH.;™^ thiH vicinity, ferinorlyhla old: home.-Mra. AT CLARK HOUSE, MASON. !: inobortStuadman la atlll very.^lowi chanoea on Ills person. He gave tbe name of ' aro nnulnHt hor rooovery.T-TheJnaeoia are get; Bmder Bobert Terry, Tbe broken glass r tlngiu their, lUnny work at the espenaO:of proved to be a bottle of Sulphur Bitters tlioarly sown wheat.. IfEWS NOTEB. I L. T, Hemaiis is cleaning house nt wblob had almost cured Mrs. Wood of his office. ' "The Aniericdu House Is now vacant, VniTB AHD VINITUBM- rbeutnatisin.—Evohange, 09 See Mr. 'riiorburii's notice of "Man , iillit! AfiSOiJUtEiar PURE Cold ralus the fliat^f the week.
    [Show full text]
  • Deep Reinforcement Learning: an Overview
    DEEP REINFORCEMENT LEARNING:AN OVERVIEW Yuxi Li ([email protected]) ABSTRACT We give an overview of recent exciting achievements of deep reinforcement learn- ing (RL). We discuss six core elements, six important mechanisms, and twelve applications. We start with background of machine learning, deep learning and reinforcement learning. Next we discuss core RL elements, including value func- tion, in particular, Deep Q-Network (DQN), policy, reward, model and planning, exploration, and knowledge. After that, we discuss important mechanisms for RL, including attention and memory, unsupervised learning, transfer learning, multi- agent RL, hierarchical RL, and learning to learn. Then we discuss various appli- cations of RL, including games, in particular, AlphaGo, robotics, natural language processing, including dialogue systems, machine translation, and text generation, computer vision, business management, finance, healthcare, education, Industry 4.0, smart grid, intelligent transportation systems, and computer systems. We mention topics not reviewed yet, and list a collection of RL resources. After pre- senting a brief summary, we close with discussions. This is the first overview about deep reinforcement learning publicly available on- line. It is comprehensive. Comments and criticisms are welcome. (This particular version is incomplete.) Please see Deep Reinforcement Learning, https://arxiv.org/abs/ 1810.06339, for a significant update to this manuscript. arXiv:1701.07274v6 [cs.LG] 26 Nov 2018 1 CONTENTS 1 Introduction5 2 Background7 2.1 Machine Learning . .7 2.2 Deep Learning . .8 2.3 Reinforcement Learning . .9 2.3.1 Problem Setup . .9 2.3.2 Exploration vs Exploitation . .9 2.3.3 Value Function . .9 2.3.4 Dynamic Programming .
    [Show full text]