An Interview with Yolanda Gil
Total Page:16
File Type:pdf, Size:1020Kb
Successful Research in AI Reflections on Successful Research in Artificial Intelligence: An Interview with Yolanda Gil Yolanda Gil, Biplav Srivastava, Ching-Hua Chen, Oshani Seneviratne This article contains the observations ditorial Team: What are your observations on how has of Yolanda Gil, director of knowledge the nature of AI research changed and evolved over technologies and research professor at the years? the Information Sciences Institute of E Gil: I worked on my thesis in the 1980s, when AI research the University of Southern California, methodology was very different than it is today. Back then, USA, and president of Association for AI research was very broad and cross-disciplinary. The Advancement of Artificial Intelligence who was recently interviewed about machine learning conferences I attended would include the factors that could influence suc- cognitive psychologists developing new capabilities for edu- cessful AI research. The editorial team cation and learning, human computer interaction researchers interviewers included members of the doing work on knowledge acquisition, and mathematicians special track editorial team from IBM focused on the statistics of machine learning and formal Research (Biplav Srivastava, Ching-Hua aspects of learning. Because of this, AI researchers like Chen) and Rensselaer Polytechnic Insti- myself would naturally mingle with researchers from other tute (Oshani Seneviratne). disciplines. In contrast, today we see research that is more narrow and focused. This could be a sign of a maturing field, because sometimes when a field grows people tend to spe- cialize into very focused areas. But having a narrow view of AI is not necessarily a good thing in my opinion. 6 AI MAGAZINE Copyright © 2019, Association for the Advancement of Artificial Intelligence. All rights reserved. ISSN 0738-4602 Successful Research in AI Editorial Team: How does one evaluate AI research? sustain basic research. The Internet came out of gov- Gil: For me, the evaluation of research in AI de- ernment investment, and so did technologies like chat pends on the disciplinary angle that is taken. There bots and search engines, all of which are pervasive in are significant differences in evaluation and in meth- our society today. So, we are reaping the benefits of odology for AI research that focus on human com- investments in basic research that were made by the puter interaction, or cognitive science, or physics, government decades ago. Sometimes government or social networking, or philosophy. For example, a funding agencies, perhaps influenced by the inter- cognitive psychology methodology may place a lot ests of the commercial sector in funding the next of emphasis on theoretical models of the mind and start-up, seem very focused on projects that have im- implementing AI systems that approximate them mediate applications. I think it’s really important for well based on particular measurements from user the government to retain a focus on long-term prob- studies. In contrast, a more mathematical method- lems and to consider sustained decadal-scale funding ology may evaluate accuracy based on some statis- programs for the most challenging AI topics. tical metric and may be more focused on algorith- Editorial Team: What skills are essential for young mic improvement. So different evaluation methods AI researchers to have? are appropriate for different kinds of AI research. Gil: I teach my students to be very mindful of long- Editorial Team: Is it difficult to learn how to under- term, deep ideas. Students will often focus on the next stand and appreciate different disciplinary angles? paper, or on the things they can do today to extend Gil: You have to learn enough about the other dis- some code they are working on. However, one of the cipline, which can be a challenge. I’ll let you in on a most important skills for any scientist to have is to little secret: Long plane rides are a great opportunity think deeply about a very challenging problem. To do to learn something new and different. Whenever I that, you need to invest the time. You need to make am on one, I really cherish the opportunity to read a commitment to spend time defining and thinking without interruption. Before the trip, I will prepare about that problem. It is much harder to think about a big folder of materials and books to teach myself what will be important in 10 years than it is to think about a topic that I am less familiar with. Reading about the next paper or the next line of code. It is very them makes the trip feel very short and I can learn hard to devote yourself to thinking rather than cod- something about a new discipline or topic that I have ing, but it is very important if we want fundamental been curious about! advances in AI. For students, this is especially hard, Editorial Team: What factors do you see inhibiting and as professors, we need to teach it. the rate of success in AI research? This is also why it is important for students to go to Gil: We need to emphasize more the importance a broad conference like Association for the Advance- of reproducibility, which is a fundamental aspect of ment of Artificial Intelligence (AAAI), to get a good the scientific method. One key component of repro- view of different research topics in AI, which can ducibility is sharing and publishing (with DOIs) all promote deeper thinking about problems. For exam- of your data and your code together with execution ple, at the AAAI conference, you will find sessions on details (such as parameters and key intermediate re- machine learning and natural language processing, sults). This is important because it helps document the others on robotics and human computer interaction, specific work that was done. It helps other researchers and others on reasoning and planning. And many of understand the context of the claims you are making. the papers will combine research on several areas of It also helps others build on what you did and vice AI. You will find both interesting applications and versa. This is something I have been promoting and fundamental research. I also attend specialized con- pushing in the scientific-paper-of-the future initiative.1 ferences, but I find the AAAI conference most inspir- This initiative promotes a future in which all relevant ing for formulating long-term research problems. details of a computational experiment are exposed Finally, a problem I find that it is when I am I think- properly and in a structured way. ing about long-term topics that I am most excited, A positive trend that we are seeing now is that more work the hardest, and get the most satisfaction at a and more people want to share their results in the open personal level. as soon as possible. The cycle of waiting for six months Editorial Team: Because deeper ideas take time to to see your paper come out is too long. People are pub- develop, and publications may not come about so lishing their work on ArXiv so that their results can be quickly, what are some methods you use to know out and then they move on to the next idea. There that you are making progress against deeper ideas? is an incredible eagerness by young researchers to dis- Gil: This is how I measure progress: I start a folder seminate their work through public sites. We need to on a far-fetched topic and watch how it grows over encourage this and do it for data and software as well, time. Initially the folder is very thin, but I keep adding for every research product in addition to papers. to it as I think more about the topic. Six months Editorial Team: Many countries have come up with a later it has expanded with details, and in yet an- national AI policy. What are your thoughts on govern- other 6 months it will have expanded further, and ment involvement in AI research and development? so on. At some point, I will have enough of an idea Gil: The government can play an incredibly im- to work with a student, and eventually, I’ll under- portant role. Through its funding programs it can stand the problem enough to formulate a 5-year WINTER 2019 7 Successful Research in AI plan. This is a many-month process, and on day 1 area where I think we should do more: Our AI systems you don’t see how you could possibly measure im- have no notion of their own limitations. They don’t provements, but eventually something clicks, and know what their capabilities are or what exists beyond you can really see the path forward. their capability. In the human world, if you walk into Editorial Team: Many companies are now inter- a pharmacy and ask someone for a flu shot, if that ested in commercializing AI and creating their own person is a cashier or a receptionist, they will tell you narratives around AI. What are your thoughts about why they can’t give you one and they will direct you what you see? on who to go to instead. Our AI systems are rarely Gil: I have been doing AI research for more than 30 designed to do this. When asked a question, our AI years, and I have always seen companies presenting systems will give you an answer, but they don’t know AI in a way that promotes their commercial interests. the context, and they often don’t know the risks in- This is natural and is nothing new. In the 1980s, all volved. I wrote a paper recently about thoughtful AI2 the banks wanted investors and customers to know that talks about how an AI system could have more that they were using expert systems and they had awareness of how it fits into the world so that it could AI capabilities in-house.