Mapping U.S. Multinationals' Global AI R&D Activity
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Apple Joins Group Devoted to Keeping AI Nice 27 January 2017
Apple joins group devoted to keeping AI nice 27 January 2017 control and end up being detrimental to society. The companies "will conduct research, recommend best practices, and publish research under an open license in areas such as ethics, fairness, and inclusivity; transparency, privacy, and interoperability; collaboration between people and AI systems; and the trustworthiness, reliability, and robustness of the technology," according to a statement. Internet giants have been investing heavily in creating software to help machines think more like people, ideally acting as virtual assistants who get to know users and perhaps even anticipate needs. Apple is the latest tech giant to join the non-profit "Partnership on AI," which will have its inaugural board SpaceX founder and Tesla chief executive Elon meeting in San Francisco on February 3 Musk in 2015 took part in creating nonprofit research company OpenAI devoted to developing artificial intelligence that will help people and not hurt them. A technology industry alliance devoted to making sure smart machines don't turn against humanity Musk found himself in the middle of a technology said Friday that Apple has signed on and will have world controversy by holding firm that AI could turn a seat on the board. on humanity and be its ruin instead of a salvation. Microsoft, Amazon, Google, Facebook, IBM, and A concern expressed by Musk was that highly Google-owned British AI firm DeepMind last year advanced artificial intelligence would be left to its established the non-profit organization, called own devices, or in the hands of a few people, to the "Partnership on AI," which will have its inaugural detriment of civilization as a whole. -
Naiad: a Timely Dataflow System
Naiad: A Timely Dataflow System Derek G. Murray Frank McSherry Rebecca Isaacs Michael Isard Paul Barham Mart´ın Abadi Microsoft Research Silicon Valley {derekmur,mcsherry,risaacs,misard,pbar,abadi}@microsoft.com Abstract User queries Low-latency query are received responses are delivered Naiad is a distributed system for executing data parallel, cyclic dataflow programs. It offers the high throughput Queries are of batch processors, the low latency of stream proces- joined with sors, and the ability to perform iterative and incremental processed data computations. Although existing systems offer some of Complex processing these features, applications that require all three have re- incrementally re- lied on multiple platforms, at the expense of efficiency, Updates to executes to reflect maintainability, and simplicity. Naiad resolves the com- data arrive changed data plexities of combining these features in one framework. A new computational model, timely dataflow, under- Figure 1: A Naiad application that supports real- lies Naiad and captures opportunities for parallelism time queries on continually updated data. The across a wide class of algorithms. This model enriches dashed rectangle represents iterative processing that dataflow computation with timestamps that represent incrementally updates as new data arrive. logical points in the computation and provide the basis for an efficient, lightweight coordination mechanism. requirements: the application performs iterative process- We show that many powerful high-level programming ing on a real-time data stream, and supports interac- models can be built on Naiad’s low-level primitives, en- tive queries on a fresh, consistent view of the results. abling such diverse tasks as streaming data analysis, it- However, no existing system satisfies all three require- erative machine learning, and interactive graph mining. -
ML Cheatsheet Documentation
ML Cheatsheet Documentation Team Sep 02, 2021 Basics 1 Linear Regression 3 2 Gradient Descent 21 3 Logistic Regression 25 4 Glossary 39 5 Calculus 45 6 Linear Algebra 57 7 Probability 67 8 Statistics 69 9 Notation 71 10 Concepts 75 11 Forwardpropagation 81 12 Backpropagation 91 13 Activation Functions 97 14 Layers 105 15 Loss Functions 117 16 Optimizers 121 17 Regularization 127 18 Architectures 137 19 Classification Algorithms 151 20 Clustering Algorithms 157 i 21 Regression Algorithms 159 22 Reinforcement Learning 161 23 Datasets 165 24 Libraries 181 25 Papers 211 26 Other Content 217 27 Contribute 223 ii ML Cheatsheet Documentation Brief visual explanations of machine learning concepts with diagrams, code examples and links to resources for learning more. Warning: This document is under early stage development. If you find errors, please raise an issue or contribute a better definition! Basics 1 ML Cheatsheet Documentation 2 Basics CHAPTER 1 Linear Regression • Introduction • Simple regression – Making predictions – Cost function – Gradient descent – Training – Model evaluation – Summary • Multivariable regression – Growing complexity – Normalization – Making predictions – Initialize weights – Cost function – Gradient descent – Simplifying with matrices – Bias term – Model evaluation 3 ML Cheatsheet Documentation 1.1 Introduction Linear Regression is a supervised machine learning algorithm where the predicted output is continuous and has a constant slope. It’s used to predict values within a continuous range, (e.g. sales, price) rather than trying to classify them into categories (e.g. cat, dog). There are two main types: Simple regression Simple linear regression uses traditional slope-intercept form, where m and b are the variables our algorithm will try to “learn” to produce the most accurate predictions. -
Redesigning AI for Shared Prosperity: an Agenda Executive Summary
Redesigning AI for Shared Prosperity: an Agenda Executive Summary Artificial intelligence is expected to contribute trillions of dollars to the global GDP over the coming decade,1 but these gains may not occur equitably or be shared widely. Today, many communities around the world face persistent underemployment, driven in part by technological advances that have divided workers into cohorts of haves and have nots. If advances in workplace AI continue on their current trajectory, they could accelerate this economic exclusion. Alternatively, as this Agenda outlines, advances in AI could expand access to good jobs for all workers, regardless of their formal education, geographic location, race, ethnicity, gender, or ability. To put AI on this alternate path, Redesigning AI for Shared Prosperity: An Agenda proposes the creation of shared prosperity targets: verifiable criteria the AI industry must meet to support the future of workers. Crucial to the success of these targets will be thoughtful design and proper alignment with the needs of key stakeholders. In service of that, this Agenda compiles critical questions that must be answered for these targets to be implementable and effective. This living document is not a final set of questions, nor a comprehensive literature review of the issue areas covered. Instead, it is an open invitation to contribute answers as well as new questions that will help make AI advancement more likely to support inclusive economic progress and respect human rights. The primary way that people around the world support themselves is through waged work. Consequently, the creation of AI systems that lower labor demand will have a seismic effect, reducing employment and/ or wages while weakening the worker bargaining power that contributes to job quality and security. -
Overview of Artificial Intelligence
Updated October 24, 2017 Overview of Artificial Intelligence The use of artificial intelligence (AI) is growing across a Currently, AI technologies are highly tailored to particular wide range of sectors. Stakeholders and policymakers have applications or tasks, known as narrow (or weak) AI. In called for careful consideration of strategies to influence its contrast, general (or strong) AI refers to intelligent behavior growth, reap predicted benefits, and mitigate potential risks. across a range of cognitive tasks, a capability which is This document provides an overview of AI technologies unlikely to occur for decades, according to most analysts. and applications, recent private and public sector activities, Some researchers also use the term “augmented and selected issues of interest to Congress. intelligence” to capture AI’s various applications in physical and connected systems, such as robotics and the AI Technologies and Applications Internet of Things, and to focus on using AI technologies to Though definitions vary, AI can generally be thought of as enhance human activities rather than to replace them. computerized systems that work and react in ways commonly thought to require intelligence, such as solving In describing the course of AI development, the Defense complex problems in real-world situations. According to Advanced Research Projects Agency (DARPA) has the Association for the Advancement of Artificial identified three “waves.” The first wave focused on Intelligence (AAAI), researchers broadly seek to handcrafted knowledge that allowed for system-enabled understand “the mechanisms underlying thought and reasoning in limited situations, though lacking the ability to intelligent behavior and their embodiment in machines.” learn or address uncertainty, as with many rule-based systems from the 1980s. -
1.2 Le Zhang, Microsoft
Objective • “Taking recommendation technology to the masses” • Helping researchers and developers to quickly select, prototype, demonstrate, and productionize a recommender system • Accelerating enterprise-grade development and deployment of a recommender system into production • Key takeaways of the talk • Systematic overview of the recommendation technology from a pragmatic perspective • Best practices (with example codes) in developing recommender systems • State-of-the-art academic research in recommendation algorithms Outline • Recommendation system in modern business (10min) • Recommendation algorithms and implementations (20min) • End to end example of building a scalable recommender (10min) • Q & A (5min) Recommendation system in modern business “35% of what consumers purchase on Amazon and 75% of what they watch on Netflix come from recommendations algorithms” McKinsey & Co Challenges Limited resource Fragmented solutions Fast-growing area New algorithms sprout There is limited reference every day – not many Packages/tools/modules off- and guidance to build a people have such the-shelf are very recommender system on expertise to implement fragmented, not scalable, scale to support and deploy a and not well compatible with enterprise-grade recommender by using each other scenarios the state-of-the-arts algorithms Microsoft/Recommenders • Microsoft/Recommenders • Collaborative development efforts of Microsoft Cloud & AI data scientists, Microsoft Research researchers, academia researchers, etc. • Github url: https://github.com/Microsoft/Recommenders • Contents • Utilities: modular functions for model creation, data manipulation, evaluation, etc. • Algorithms: SVD, SAR, ALS, NCF, Wide&Deep, xDeepFM, DKN, etc. • Notebooks: HOW-TO examples for end to end recommender building. • Highlights • 3700+ stars on GitHub • Featured in YC Hacker News, O’Reily Data Newsletter, GitHub weekly trending list, etc. -
Alibaba Amazon
Online Virtual Sponsor Expo Sunday December 6th Amazon | Science Alibaba Neural Magic Facebook Scale AI IBM Sony Apple Quantum Black Benevolent AI Zalando Kuaishou Cruise Ant Group | Alipay Microsoft Wild Me Deep Genomics Netflix Research Google Research CausaLens Hudson River Trading 1 TALKS & PANELS Scikit-learn and Fairness, Tools and Challenges 5 AM PST (1 PM UTC) Speaker: Adrin Jalali Fairness, accountability, and transparency in machine learning have become a major part of the ML discourse. Since these issues have attracted attention from the public, and certain legislations are being put in place regulating the usage of machine learning in certain domains, the industry has been catching up with the topic and a few groups have been developing toolboxes to allow practitioners incorporate fairness constraints into their pipelines and make their models more transparent and accountable. AIF360 and fairlearn are just two examples available in Python. On the machine learning side, scikit-learn has been one of the most commonly used libraries which has been extended by third party libraries such as XGBoost and imbalanced-learn. However, when it comes to incorporating fairness constraints in a usual scikit- learn pipeline, there are challenges and limitations related to the API, which has made developing a scikit-learn compatible fairness focused package challenging and hampering the adoption of these tools in the industry. In this talk, we start with a common classification pipeline, then we assess fairness/bias of the data/outputs using disparate impact ratio as an example metric, and finally mitigate the unfair outputs and search for hyperparameters which give the best accuracy while satisfying fairness constraints. -
Microsoft Recommenders Tools to Accelerate Developing Recommender Systems Scott Graham, Jun Ki Min, Tao Wu {Scott.Graham, Jun.Min, Tao.Wu} @ Microsoft.Com
Microsoft Recommenders Tools to Accelerate Developing Recommender Systems Scott Graham, Jun Ki Min, Tao Wu {Scott.Graham, Jun.Min, Tao.Wu} @ microsoft.com Microsoft Recommenders repository is an open source collection of python utilities and Jupyter notebooks to help accelerate the process of designing, evaluating, and deploying recommender systems. The repository is actively maintained and constantly being improved and extended. It is publicly available on GitHub and licensed through a permissive MIT License to promote widespread use of the tools. Core components reco_utils • Dataset helpers and splitters • Ranking & rating metrics • Hyperparameter tuning helpers • Operationalization utilities notebooks • Spark ALS • Inhouse: SAR, Vowpal Wabbit, LightGBM, RLRMC, xDeepFM • Deep learning: NCF, Wide-Deep • Open source frameworks: Surprise, FastAI tests • Unit tests • Smoke & Integration tests Workflow Train set Recommender train Environment Data Data split setup load Validation set Hyperparameter tune Operationalize Test set Evaluate • Rating metrics • Content based models • Clone & conda-install on a local / • Chronological split • Ranking metrics • Collaborative-filtering models virtual machine (Windows / Linux / • Stratified split • Classification metrics • Deep-learning models Mac) or Databricks • Non-overlap split • Docker • Azure Machine Learning service (AzureML) • Random split • Tuning libraries (NNI, HyperOpt) • pip install • Azure Kubernetes Service (AKS) • Tuning services (AzureML) • Azure Databricks Example: Movie Recommendation -
Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claims
Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claims∗ Miles Brundage1†, Shahar Avin3,2†, Jasmine Wang4,29†‡, Haydn Belfield3,2†, Gretchen Krueger1†, Gillian Hadfield1,5,30, Heidy Khlaaf6, Jingying Yang7, Helen Toner8, Ruth Fong9, Tegan Maharaj4,28, Pang Wei Koh10, Sara Hooker11, Jade Leung12, Andrew Trask9, Emma Bluemke9, Jonathan Lebensold4,29, Cullen O’Keefe1, Mark Koren13, Théo Ryffel14, JB Rubinovitz15, Tamay Besiroglu16, Federica Carugati17, Jack Clark1, Peter Eckersley7, Sarah de Haas18, Maritza Johnson18, Ben Laurie18, Alex Ingerman18, Igor Krawczuk19, Amanda Askell1, Rosario Cammarota20, Andrew Lohn21, David Krueger4,27, Charlotte Stix22, Peter Henderson10, Logan Graham9, Carina Prunkl12, Bianca Martin1, Elizabeth Seger16, Noa Zilberman9, Seán Ó hÉigeartaigh2,3, Frens Kroeger23, Girish Sastry1, Rebecca Kagan8, Adrian Weller16,24, Brian Tse12,7, Elizabeth Barnes1, Allan Dafoe12,9, Paul Scharre25, Ariel Herbert-Voss1, Martijn Rasser25, Shagun Sodhani4,27, Carrick Flynn8, Thomas Krendl Gilbert26, Lisa Dyer7, Saif Khan8, Yoshua Bengio4,27, Markus Anderljung12 1OpenAI, 2Leverhulme Centre for the Future of Intelligence, 3Centre for the Study of Existential Risk, 4Mila, 5University of Toronto, 6Adelard, 7Partnership on AI, 8Center for Security and Emerging Technology, 9University of Oxford, 10Stanford University, 11Google Brain, 12Future of Humanity Institute, 13Stanford Centre for AI Safety, 14École Normale Supérieure (Paris), 15Remedy.AI, 16University of Cambridge, 17Center for Advanced Study in the Behavioral Sciences,18Google Research, 19École Polytechnique Fédérale de Lausanne, 20Intel, 21RAND Corporation, 22Eindhoven University of Technology, 23Coventry University, 24Alan Turing Institute, 25Center for a New American Security, 26University of California, Berkeley, 27University of Montreal, 28Montreal Polytechnic, 29McGill University, 30Schwartz Reisman Institute for Technology and Society arXiv:2004.07213v2 [cs.CY] 20 Apr 2020 April 2020 ∗Listed authors are those who contributed substantive ideas and/or work to this report. -
Artificial Intelligence the Next Digital Frontier?
ARTIFICIAL INTELLIGENCE THE NEXT DIGITAL FRONTIER? DISCUSSION PAPER JUNE 2017 Jacques Bughin | Brussels Eric Hazan | Paris Sree Ramaswamy | Washington, DC Michael Chui | San Francisco Tera Allas | London Peter Dahlström | London Nicolaus Henke | London Monica Trench | London Since its founding in 1990, the McKinsey Global Institute (MGI) has sought to develop a deeper understanding of the evolving global economy. As the business and economics research arm of McKinsey & Company, MGI aims to provide leaders in the commercial, public, and social sectors with the facts and insights on which to base management and policy decisions. The Lauder Institute at the University of Pennsylvania ranked MGI the world’s number-one private-sector think tank in its 2016 Global Think Tank Index for the second consecutive year. MGI research combines the disciplines of economics and management, employing the analytical tools of economics with the insights of business leaders. Our “micro-to-macro” methodology examines microeconomic industry trends to better understand the broad macroeconomic forces affecting business strategy and public policy. MGI’s in-depth reports have covered more than 20 countries and 30 industries. Current research focuses on six themes: productivity and growth, natural resources, labor markets, the evolution of global financial markets, the economic impact of technology and innovation, and urbanization. Recent reports have assessed the economic benefits of tackling gender inequality, a new era of global competition, Chinese innovation, and digital globalization. MGI is led by four McKinsey and Company senior partners: Jacques Bughin, James Manyika, Jonathan Woetzel, and Frank Mattern, MGI’s chairman. Michael Chui, Susan Lund, Anu Madgavkar, Sree Ramaswamy, and Jaana Remes serve as MGI partners. -
The Design and Implementation of Low-Latency Prediction Serving Systems
The Design and Implementation of Low-Latency Prediction Serving Systems Daniel Crankshaw Electrical Engineering and Computer Sciences University of California at Berkeley Technical Report No. UCB/EECS-2019-171 http://www2.eecs.berkeley.edu/Pubs/TechRpts/2019/EECS-2019-171.html December 16, 2019 Copyright © 2019, by the author(s). All rights reserved. Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. To copy otherwise, to republish, to post on servers or to redistribute to lists, requires prior specific permission. Acknowledgement To my parents The Design and Implementation of Low-Latency Prediction Serving Systems by Daniel Crankshaw A dissertation submitted in partial satisfaction of the requirements for the degree of Doctor of Philosophy in Computer Science in the Graduate Division of the University of California, Berkeley Committee in charge: Professor Joseph Gonzalez, Chair Professor Ion Stoica Professor Fernando Perez Fall 2019 The Design and Implementation of Low-Latency Prediction Serving Systems Copyright 2019 by Daniel Crankshaw 1 Abstract The Design and Implementation of Low-Latency Prediction Serving Systems by Daniel Crankshaw Doctor of Philosophy in Computer Science University of California, Berkeley Professor Joseph Gonzalez, Chair Machine learning is being deployed in a growing number of applications which demand real- time, accurate, and cost-efficient predictions under heavy query load. These applications employ a variety of machine learning frameworks and models, often composing several models within the same application. -
Partnership on Artificial Intelligence” Formed by Google, Facebook, Amazon, Ibm, Microsoft and Apple
УДК 004.8 Zelinska Dariia “PARTNERSHIP ON ARTIFICIAL INTELLIGENCE” FORMED BY GOOGLE, FACEBOOK, AMAZON, IBM, MICROSOFT AND APPLE Vinnitsa National Technical University Анотація У статті розповідається про співробітництво найбільших ІТ-компаній та створення особливого партнерства – Партнерства Штучного Інтелекту. Дослідження показує різні цілі та місії, висвітлені технологічними гігантами, і декотрі проблеми, що пояснюють майбутню діяльність даної організації. Ключові слова: партнерство, Штучний Інтелект, Рада Довіри, технології, Силіконова Долина. Abstract The article tells about the cooperation between the greatest IT-companies and the creation of the special partnership – the Partnership on Artificial Intelligence.The research shows different goals and missions highlighted by technology giants and some problems explaining future activities of this organization. Keywords: partnership, Artificial Intelligence, The Board of Trustees, technology, Silicon Valley. It is a well-known fact that the greatest IT-companies have been mostly competitors and cooperated a little not so far ago. But such a situation has changed lately and the best example is joining forces of some tech giants to create a new AI partnership. It is dedicated to advancing public understanding of the sector, as well as coming up with standards for future researchers to abide by. Five tech giants announced inSeptember, 2016 that they are launching a nonprofit to “advance public understanding” of artificial intelligence and to formulate “best practices on the challenges and opportunities within the field.” The Partnership on Artificial Intelligence to Benefit People and Society is being formed by Amazon, Facebook, Google, IBM, and Microsoft, each of which will have a representative on the group's 10- member board.After conspicuously being absent when the group came together in September 2016, Apple has joined the Partnership on AI inJanuary, 2017.