Distinguished.Seminar-Dr Harryshum V3

Total Page：16

File Type：pdf, Size：1020Kb

Date: 17 November, 2020 (Tuesday) SCAN HERE Online registration: Time: 11:30am – 12:30pm https://www.cityu.edu.hk/sdsc_web/zoom/ Abstract In this talk I will discuss a couple of research directions for robust AI beyond deep neural networks. The first is the need to understand what we are learning, by shifting the focus from targeting effects to understanding causes. The second is the need for a hybrid neural/symbolic approach that leverages both commonsense knowledge and massive amount of data. Specifically, as an example, I will present some latest work at Microsoft Research on building a pre-trained grounded text generator for task-oriented dialog. It is a hybrid architecture that employs a large-scale Transformer-based deep learning model, and symbol manipulation modules such as business databases, knowledge graphs and commonsense rules. Unlike GPT or similar language models learnt from data, it is a multi-turn decision making system which takes user input, updates the belief state, retrieved from the database via symbolic reasoning, and decides how to complete the task with grounded response. Biography Dr Harry Shum is an Adjunct Professor at Tsinghua University. He was Executive Vice President of Microsoft’s Artificial Intelligence (AI) and Research Group until March 1, 2020. Dr Shum is an IEEE Fellow and an ACM Fellow for his contributions to computer vision and computer graphics. He received his Ph.D. in robotics from the School of Computer Science at Carnegie Mellon University. In 2017, he was elected to the National Academy of Engineering of the United States. Enquiries: [email protected] All are welcome cityu.edu.hk/sdsc.

Copy Link

Recommended publications

The Future Computed Artificial Intelligence and Its Role in Society
The Future Computed Artificial Intelligence and its role in society By Microsoft With a foreword by Brad Smith and Harry Shum Published by Microsoft Corporation Redmond, Washington. U.S.A. 2018 First published 2018 by Microsoft Corporation One Microsoft Way Redmond, Washington 98052 © 2018 Microsoft. All rights reserved ISBN 978-0-9997508-1-0 Table of contents Foreword The Future Computed 1 Chapter 1 The Future of Artificial Intelligence 22 Microsoft’s Approach to AI 33 The Potential of Modern AI - 43 Addressing Societal Challenges The Challenges AI Presents 48 Chapter 2 Principles, Policies and Laws for the 50 Responsible Use of AI Ethical and Societal Implications 56 Developing Policy and Law for 73 Artificial Intelligence Fostering Dialogue and the Sharing of 82 Best Practices iii Chapter 3 AI and the Future of Jobs and Work 84 The Impact of Technology on Jobs and Work 91 The Changing Nature of Work, the Workplace 101 and Jobs Preparing Everyone for the Future of Work 107 Changing Norms of Changing Worker Needs 122 Working Together 133 Conclusion AI Amplifying Human Ingenuity 134 Endnotes 138 iv Foreword The Future Computed By Brad Smith and Harry Shum 6 Twenty years ago, we both worked at Microsoft, but on The Future Computed opposite sides of the globe. In 1998, one of us was living and working in China as a founding member of the Microsoft Research Asia lab in Beijing. Five thousand miles away, the other was based at the company’s headquarters, just outside of Seattle, leading the international legal and corporate affairs team.
[Show full text]
Few Tips for Gatto Murder Investigation Even After $50,000
Los Feliz Ledger Read by 100,000+ Residents and Business Owners in Los Feliz, Silver Lake, Vol 9. No. 10 April 2014 Atwater Village, Echo Park & Hollywood Hills Commissioners Few Tips for to Decide On Gatto Murder Park Baseball Investigation & Performance Even After Stage $50,000 Reward By Hayley Fox LOS ANGELES —The city’s Ledger Senior Contributing Recreation and Park’s Com- Writer missioners will decide on con- struction of two youth base- More than four months ball fields at Griffith Park’s after the Silver Lake murder of Crystal Springs, April 2nd as Joseph Gatto, police still have well as a permanent stage at little new to report even after the Old Zoo for Symphony in a $50,000 reward was offered the Glen and the Independent for information leading to the Shakespeare Co. arrest and conviction of Gat- The hearing was moved to’s killer. from March 5th to provide According to the Los An- more time for public comment. geles Police Dept. (LAPD) At the commissioner’s, Robbery-Homicide Det. Chris March 19th, Los Feliz Ledger Gable fewer than 25 tips have publisher Allison B. Cohen been received since the reward and Los Feliz Neighborhood was offered in January. Council Recreation Represen- EMERSON IN L.A.—Los Angeles Mayor Eric Garcetti Los Angeles City Councilmember Mitch O’Farrell were This may be, Gable said, tative Mark F. Mauceri spoke on hand March 8th to celebrate the grand opening of the Emerson Los Angeles College. Located on Sunset because law enforcement had in favor of the Crystal Springs Boulevard near the Hollywood Palladium, the 10-story building, designed by award winning Los Angeles architect Thom Payne was designed “to expand the interactive, social aspect of education.” The building already spoken to many—such ballfields; Barbara Ferris and exterior features a sun shading system that adapts to changing weather to maintain indoor temperature as Gatto’s neighbors—imme- Arthur Rubenstein—both of and natural light levels among other sustainable, and beautiful, features.
[Show full text]
Yahoo Search Executive Moves to Microsoft
866-536-8614 | Contact Us www.peakpositions.com Yahoo Search Executive Moves To Microsoft. Rumors are swirling that is move is one of the first steps in setting the stage for Microsoft's take over of Yahoo Search in the coming months. Microsoft (MSFT) released a formal statement last week confirming the hiring of Sean Suchter, an important tech leader at Yahoo (YHOO), from Satya Nadella, SVP for MSN Search, Portal and Advertising: "We are very pleased to confirm that Sean Suchter will be joining Microsoft as the GM of our Silicon Valley Search Technology Center, working on MSN Live Search. Sean will report into Harry Shum when he starts work on December 22. We look forward to welcoming Sean Suchter to Microsoft at that time." Microsoft's talent grab from Yahoo is an interesting one, given that Microsoft has also tried to to buy Yahoo's search and search ad business many times, to little success. Microsoft CEO Steve Ballmer recently discounted the possibility that Microsoft would rebid for all of Yahoo after it abandoned a takeover attempt earlier this year. Ballmer's most recent statements sent Yahoo's stock further into the basement. Losing important execs like Suchter, who was the VP of Search Technology at Yahoo, will also not help the company's prospects. Suchter was deeply involved in Yahoo's efforts to open up its search platform, initiatives the company has touted aggressively as a bright spot in its not so lustrous landscape. Suchter, who came to Yahoo almost six years ago after it acquired Inktomi (the company that got Yahoo into the search business) in early 2003, has been talking with Microsoft for a while and his leaving was not linked or related to the resignation by Jerry Yang to step down as Yahoo's day to day CEO.
[Show full text]
Trustworthy Online Controlled Experiments by R Kohavi, D Tang, and Y Xu Copyright (C)2020
From Trustworthy Online Controlled Experiments by R Kohavi, D Tang, and Y Xu copyright (c)2020 https://experimentguide.com Trustworthy Online Controlled Experiments A Practical Guide to A/B Testing Getting numbers is easy; getting numbers you can trust is hard. This practical guide by experimentation leaders at Google, LinkedIn, and Microsoft will teach you how to accelerate innovation using trustworthy online controlled experiments, or A/B tests. Based on practical experiences at companies that each runs more than 20,000 controlled experiments a year, the authors share examples, pitfalls, and advice for students and industry professionals getting started with experiments, plus deeper dives into advanced topics for experienced practitioners who want to improve the way they and their organizations make data-driven decisions. Learn how to: ● Use the scientiﬁc method to evaluate hypotheses using controlled experiments ● Deﬁne key metrics and ideally an Overall Evaluation Criterion ● Test for trustworthiness of the results and alert experimenters to violated assumptions ● Interpret and iterate quickly based on the results ● Implement guardrails to protect key business goals ● Build a scalable platform that lowers the marginal cost of experiments close to zero ● Avoid pitfalls such as carryover effects, Twyman’s law, Simpson’s paradox, and network interactions ● Understand how statistical issues play out in practice, including common violations of assumptions ron kohavi is a vice president and technical fellow at Airbnb. This book was written while he was a technical fellow and corporate vice president at Microsoft. He was previously director of data mining and personalization at Amazon. He received his PhD in Computer Science from Stanford University.
[Show full text]
Microsoft Corporation
A Progressive Digital Media business COMPANY PROFILE Microsoft Corporation REFERENCE CODE: 8ABE78BB-0732-4ACA-A41D-3012EBB1334D PUBLICATION DATE: 25 Jul 2017 www.marketline.com COPYRIGHT MARKETLINE. THIS CONTENT IS A LICENSED PRODUCT AND IS NOT TO BE PHOTOCOPIED OR DISTRIBUTED Microsoft Corporation TABLE OF CONTENTS TABLE OF CONTENTS Company Overview ........................................................................................................3 Key Facts.........................................................................................................................3 Business Description .....................................................................................................4 History .............................................................................................................................5 Key Employees .............................................................................................................26 Key Employee Biographies .........................................................................................28 Major Products & Services ..........................................................................................35 SWOT Analysis .............................................................................................................36 Top Competitors ...........................................................................................................44 Company View ..............................................................................................................45
[Show full text]
Title of Proseedings for 12Th ICNCT in Kagawa, Japan
Next “Generation” Photo and Video Technology Xiaoou Tang Microsoft Research Asia Beijing, P. R. China It is fundamentally important to develop long-term high-impact technology that aims at future applications. It is also important to develop technology that can make immediate impact on our daily life. In general, it is not difficult to build a research demo in computer vision research. However, it is difficult to build a vision system that works in real life. As a result, the impact of computer vision on our daily life is relatively limited compared to other research areas, such as computer graphics, multimedia communication, and networking. In this talk, I will discuss some practical vision topics that we are working on at Microsoft Research Asia. In particular, I would like to demonstrate some technologies that are simple to use, and perhaps more importantly are fun to use. Most of the works focus on processing of children’s photo. We hope these technologies are useful for processing of photos and videos of our children (the next generation of us) now instead of after another generation. Figure 1. Clustering based photo annotation. Assisted by face detection, recognition, and clustering technology, similar faces are put together into clusters, based on which efficient annotation can be carried out in a file explorer like interface by easy interactions such as drag and drop [1][2]. Figure 2. By making use of the tagged faces and analyzing underlying distribution of untagged faces, we can re-rank the spatial configuration of clusters and faces inside each cluster in our user interface to better facilitate annotation [1][3].
[Show full text]
ACM Multimedia 2014
22nd ACM International Conference on Multimedia ACM Multimedia 2014 November 3-7 Orlando, Florida Conference Organization General Chairs Ning Jiang, Institute for Systems Biology, USA Kien Hua, University of Central Florida, USA Ming Li, California State University, USA Yong Rui, Microsoft Research, China Sponsorship Chairs Ralf Steinmetz, Technische Universitat Darmstadt, Germany Dr. Hassan Foroosh, University of Central Florida, USA Technical Program Committee Chairs Mark Liao Academia Sincia, Taipei, Taiwan Alan Hanjalic Delft University of Technology, Netherlands Travel Grant Chairs Apostol (Paul) Natsev, Google, USA Danzhou Liu, NetApp, USA Wenwu Zhu, Tsinghua University, China JungHwan Oh, University of North Texas, USA High-Risk High-Reward Papers Chairs Proceedings Chairs Abdulmotaleb El Saddik, University of Ottawa, Canada Ying Cai, Iowa State University, USA Rainer Lienhart, Augsburg University, Germany Wallapak Tavanapong, Iowa State University, USA Balakrishnan Prabhakaran, University of Texas at Dallas, History Preservation Chair USA Duc Tran, University of Massachusetts in Boston, U.S.A Multimedia Grand Challenge Chairs Roy Villafane, Andrews University, USA Changsheng Xu, Chinese Academy of Sciences, China Publicity and Social Media Chairs Cha Zhang, Microsoft Research, USA Grace Ngai, Hong Kong Polytechnic University, Technical Demo Chairs S.A.R. China Shu-Ching Chen, Florida International University, USA Author's Advocate Stefan Göbel, Technische Universität Darmstadt, Germany Pablo Cesar, CWI, Netherlands Carsten Griwodz,
[Show full text]
Mining Query Subtopics from Search Log Data
Mining Query Subtopics from Search Log Data Yunhua Hu Yanan Qian Hang Li Microsoft Research Asia SPKLSTN Lab, Xi’an Jiaotong Microsoft Research Asia Beijing, China University, Xi’an, China Beijing, China [email protected] [email protected] [email protected] Daxin Jiang Jian Pei Qinghua Zheng Microsoft Research Asia Simon Fraser University SPKLSTN Lab, Xi’an Jiaotong Beijing, China Burnaby, BC, Canada University, Xi’an, China [email protected] [email protected] [email protected] ABSTRACT General Terms Most queries in web search are ambiguous and multifaceted. Algorithms, Experimentation Identifying the major senses and facets of queries from search log data, referred to as query subtopic mining in this paper, Keywords is a very important issue in web search. Through search log analysis, we show that there are two interesting phe- Search Log Mining, User Behavior, Query Subtopics, Clus- nomena of user behavior that can be leveraged to identify tering, Search Result Clustering query subtopics, referred to as òne subtopic per search' and `subtopic clarification by keyword'. One subtopic per search 1. INTRODUCTION means that if a user clicks multiple URLs in one query, then Understanding the search intent of users is essential for the clicked URLs tend to represent the same sense or facet. satisfying a user's search needs. How to best represent query Subtopic clarification by keyword means that users often add intent is still an ongoing research problem. One consensus an additional keyword or keywords to expand the query in among the researchers is that the intents of queries can be order to clarify their search intent.
[Show full text]
05102017 Build Harry Shum
Build 2017 Harry Shum, Executive Vice President, Microsoft AI and Research Group May 10, 2017 HARRY SHUM: Good morning. It's great to be here. Thank you for listening to Satya, Scott and now me. Let me begin my talk by taking you back to the start of the day. Satya talked about this new app pattern, this new world view of the intelligent edge and the intelligent cloud. Central to this is artificial intelligence. And this is what I'm going to talk to you about now. I have been in the field of AI for a long time. It's amazing to see AI now becoming more a reality. I hope many of you by now know Microsoft Cognitive Services, but I'm not sure if any of you were in that small breakout room two years ago when we launched Cognitive Services with only four APIs. Maybe some of you were in that big breakout room last year when we launched it with 22 APIs. And this year apparently I have been promoted by Satya to the main stage. Seriously, the time for AI is now. At Microsoft, we believe AI is about amplifying human ingenuity. This is our vision for AI at Microsoft. You may ask why now? Well, there are three big forces converging that are making AI possible. The first, big compute, especially how you can take advantage of huge computing power in the cloud. Second, powerful algorithms with amazing progress in deep learning and deep reinforcement learning. Number three, massive amount of data that infuse powerful AI applications.
[Show full text]
Microsoft Corporation One Microsoft Way Redmond, Washington 98052, U.S.A
Microsoft Corporation One Microsoft Way Redmond, Washington 98052, U.S.A. PLAN D’ACHAT D’ACTIONS 2003 RESERVE AUX SALARIES DE MICROSOFT CORPORATION, ER TEL QU’AMENDE, EN VIGUEUR AU 1 JANVIER 2013 (LE « PLAN D’ACHAT D’ACTIONS ») Prospectus destiné aux salariés de certaines filiales de l’Espace Economique Européen (l’« EEE ») de Microsoft Corporation sous réserve de la législation nationale en vigueur dans chaque Etat RESUME DU PROSPECTUS TRADUCTION EN FRANCAIS DU RESUME DU PROSPECTUS VISE PAR L’AUTORITE DES MARCHES FINANCIERS LE 24 JUIN 2015 SOUS LE N° 15-305 En application des articles L. 412-1 et L. 621-8 du Code monétaire et financier et de son Règlement général, notamment des articles 211-1 à 216-1, l’Autorité des marchés financiers (l’« AMF ») a apposé le visa n° 15-305 en date du 24 juin 2015 sur le présent prospectus. Ce prospectus a été établi par l’émetteur et engage la responsabilité de ses signataires. Le visa, conformément aux dispositions de l’article L. 621-8-1 I du Code monétaire et financier, a été attribué après que l’AMF ait vérifié si le document était complet et compréhensible, et si les informations qu’il contenait étaient cohérentes. Il n’implique ni approbation de l’opportunité de l’opération ni authentification des éléments comptables et financiers présentés. Ce prospectus sera mis à la disposition des salariés des filiales de Microsoft Corporation, sous forme imprimée, aux sièges sociaux respectifs des filiales, dans les Etats de l'EEE dans lesquels les offres dans le cadre du plan mentionné ci-dessus sont considérées comme étant des offres au public, sous réserve de la législation en vigueur dans chaque Etat.
[Show full text]
Introduction to Azure AI Solutions and Technologies What to Use When
AI for All Chris Testa-O’Neill Applied Data Scientist Microsoft The Azure AI Landscape Use AI Applications Artificial Intelligence in Applications Include AI Artificial Intelligence from Pre-built Services, Apps, and Knowledge Mining Create AI Artificial Intelligence with Platforms, Infrastructure and Tools Find AI AI Solutions Gallery Artificial Intelligence Solutions in a Portal Use AI - Applications Office 365 Skype Dynamics 365 Teams SwiftKey Calendar.help Pix Customer Service and Support Resource: PowerPoint Translator http://tinyurl.com/ycdt7rzn Resource: Demo Flash-Fill https://tinyurl.com/ybpwysyy Include AI - Services Cognitive Services Bot Framework Knowledge Mining Knowledge Mining Bot Framework - Engage with your users A natural language interface across all conversation channels Insights Operationalization Provide information Perform tasks Make recommendations Capture information Examples of real-world applications Vision Speech Language Knowledge Search Intent: PlayCall Infrastructure and Tools Data Science Process Pretrained Models Azure Databricks Services and Frameworks Infrastructure Data Business • Define Objectives Science Understanding • Identify Data Sources Process Data Acquisition and • Ingest Data • Explore Data Understanding • Update Data • Feature Selection Modeling • Create and Train Model Deployment • Operationalize Customer • Testing and Validation • Handoff aka.ms/tdsp Acceptance • Re-train and re-score Machine Learning on Azure Sophisticated pretrained models … To accelerate solution development with easy
[Show full text]
Mining Query Subtopics from Search Log Data • Summary
What to Mine from Big Data? Hang Li Noah’s Ark Lab Huawei Technologies Big Data Value Two Main Issues in Big Data Mining Agenda • Four Principles for “What to Mine” • Stories regarding to Principles – Search and Browse Log Mining as Example • Our Work on Big Data Mining – Mining Query Subtopics from Search Log Data • Summary Four Principles for “What to Mine” 1. Identifying scenarios of mining as much as possible 2. Logging as much data as possible 3. Integrating as much data as possible 4. ‘Understanding’ data as much as possible Identifying scenarios of mining as much as possible Immanuel Kant The world as we know it is our interpretation of the observable facts in the light of theories that we ourselves invent Example of Bad Design of Toolbar • A toolbar developed at a search engine • It recorded user’s search behavior data • However, • It did not record the time at which the user closed browser • No indication of end of session Logging as much data as possible Examples of Useful Log Information • User moves mouse on screen (user may unconsciously put mouse on focused area) – may infer users’ interest on the page • User uses mouse to scroll up and down – may infer whether user is serious about page content (more scrolling suggests more seriousness) • User clicks on next page – may infer user’s current focus • User closes browser window/tab – may infer user’s current focus Integrating as much data as possible Model of User Search Behavior • Data needs to be collected from different sources (toolbar, search engine log) • E.g., toolbar usually does not record search results • Often challenging to integrate data Understanding Data as Much as Possible AOL Search Data Leak (2006) • AOL search data release (20M queries, 650K users, 3 months) • New York Times article “A Face Is Exposed for AOL Searcher No.
[Show full text]