Future Directions in Compressed Sensing and the Integration of Sensing and Processing What Can and Should We Know by 2030? Robert Calderbank, Duke University Guillermo Sapiro, Duke University Workshop funded by the Basic Research Office, Office of the Assistant Prepared by Brian Hider and Jeremy Zeigler Secretary of Defense for Research & Engineering. This report does not Virginia Tech Applied Research Corporation necessarily reflect the policies or positions of the US Department of Defense Preface OVER THE PAST CENTURY, SCIENCE AND TECHNOLOGY HAS BROUGHT REMARKABLE NEW CAPABILITIES TO ALL SECTORS of the economy; from telecommunications, energy, and electronics to medicine, transportation and defense. Technologies that were fantasy decades ago, such as the internet and mobile devices, now inform the way we live, work, and interact with our environment. Key to this technological progress is the capacity of the global basic research community to create new knowledge and to develop new insights in science, technology, and engineering. Understanding the trajectories of this fundamental research, within the context of global challenges, empowers stakeholders to identify and seize potential opportunities. The Future Directions Workshop series, sponsored by the Basic Research Office of the Office of the Assistant Secretary of Defense for Research and Engineering, seeks to examine emerging research and engineering areas that are most likely to transform future technology capabilities. These workshops gather distinguished academic and industry researchers from the world’s top research institutions to engage in an interactive dialogue about the promises and challenges of these emerging basic research areas and how they could impact future capabilities. Chaired by leaders in the field, these workshops encourage unfettered considerations of the prospects of fundamental science areas from the most talented minds in the research community. Reports from the Future Direction Workshop series capture these discussions and therefore play a vital role in the discussion of basic research priorities. In each Innovation is the key report, participants are challenged to address the following important questions: • How might the research impact science and technology capabilities of the future? • What is the possible trajectory of scientific achievement over the next 10–15 years? to the future, but basic • What are the most fundamental challenges to progress? This report is the product of a workshop held January 11–12, 2016 at research is the key to Duke University in Raleigh-Durham, North Carolina on Compressed Sensing and the Integration of Sensing and Processing. It is intended as a resource to the S&T community including the broader federal funding future innovation. community, federal laboratories, domestic industrial base, and academia. – Jerome Isaac Friedman, Nobel Prize Recipient (1990) Page 2 VT-ARC.org Executive Summary AS IT BECOMES POSSIBLE TO ACCESS EVER LARGER AMOUNTS • Data models for both large and small datasets 15 year goals OF DATA, it becomes increasingly important to develop • Algorithms optimized for efficiency and that • Robust data fusion methods of smart sensing that are able to support integrate human-machine interactions • Non-convex optimization information-based decisions. A trend common to • Performance analytics • New methods of predicting performance, all disciplines and areas is the integration of sensing • New architecture principles with a particular emphasis on deep learning and (task-oriented) processing as one unit. At a • Architectural principles for networked workshop, held at Duke University on January 11–12, In addition to discussing important research data processing systems 2016, thirty distinguished researchers from academia challenges, the participants discussed the value of and industry gathered to discuss the opportunities targeted investment in infrastructure, including the Continuing goals and challenges of Compressed Sensing research to development of open-source tools and International • Model-based simulated data intelligently address the ever increasing data produced Centers of Excellence. The participants were generally • Common test frameworks, from by modern technology. This report captures those optimistic about the trajectory of Compressed Sensing data sets to competitions discussions and presents the consensus opinion about research and expect continued research will meet the • Interdisciplinary research programs that the state of the field, the challenges to progress and the challenges over the next 10 and 15 years. The specific encourage theorists and domain scientists trajectory of research for the next 10 and 15 years. milestones and time frame for reaching the goals is: to collaborate on building systems The workshop participants organized the current and 10 year goals These research goals draw from the disciplines of future research that are fundamental to progress in • Sensing+X or Task Oriented Sensing electrical and computer engineering, statistics, sensing and data processing, into four areas: signal • Model driven signal acquisition computer science and mathematics. Therefore, an acquisition, data models, algorithms and architecture. • New models, with a particular emphasis on the integrated intellectual and capital investment in global geometry of data, to support development these disciplines, from the theory to the domain They framed important challenges for these of non-convex/nonlinear optimization application, is critical for the advancement of research areas within the context of: • Adaptive learning, with a particular emphasis knowledge and leadership in data science. on systems with a human in the loop • Integration of sensing and data processing • New methods of data dependent regularization It has never been more important to understand first, • Integration of distributed and multimodal sensing • New interfaces between modeling what information is necessary to operate and compete; • Improved analog-to-digital conversion and computation and second, how this information is sensed and applied. Investment in basic science is essential to staying ahead of the volume at which data is becoming accessible. “It has never been more important to understand first, what information is necessary to operate and compete; and second, how this information is sensed and applied.” Page 3 VT-ARC.org We are living in the middle of a data revolution. Introduction The Large Synoptic Survey Telescope, in construction on the Cerro Pachon Mountain in Chile will generate HIGH ENERGY PHYSICS DEPENDS MORE AND MORE ON 30 terabytes of data a night, every night, for ten years. MASSIVE DATA SOURCES such as the Large Hadron Collider and Large Synoptic Survey Telescope. The latter is about to transform our understanding of the dynamic universe. Personalized medical care depends on detailed individually collected data, very often including epigenetic data merged with demographic and environmental Billion data. Environmental research depends on ever more 4 Connected People sophisticated observational data coupled with large model-generated datasets. Internet communication can be defined as a graph with billions of nodes. Tracking and predicting the evolution of these kinds of graphs is one of the grand challenges of modern computer Trillion Revenue Opportunity science. In fact, the central issue across a broad spectrum 4 of science is specifying what information is needed to predict the evolution of large complex systems, and answering how this information is obtained and applied. + Billion US leadership of the global services economy 25 Embedded and Intelligent System depends on the ability to analyze data at massive scale, to distill information quickly, and to act on it rapidly with greater insight than an adversary. Moreover, all of this must be done with consistency. + Million 25 Apps Advances in data science can dramatically alter how data is sensed, stored, interpreted and acted As massive as the Internet has become, it will be dwarfed upon, and these developments will in turn have by the Internet of Things that is starting to take shape, fundamental implications for national security Trillion where all devices are equipped with diverse sensors and and US scientific and economic leadership. 50 GBs of Data communicate. (image courtesy of wordstream.com) Page 4 VT-ARC.org Scale and the Data Dilemma research program is to study how genes affect health. SCALE CHANGES THE FACE OF SOCIETY. The introduction of To do this, MVP will build one of the world’s largest Google alone processes on the assembly line enabled Henry Ford to cut car prices medical databases by safely collecting blood samples and create a mass market. The US mastered scale and and health information from one million Veteran average over 40 thousand became the preeminent manufacturing economy. In volunteers. Data collected from MVP will be stored similar fashion, success and failure in the modern era anonymously for research on diseases like diabetes, search queries per second. is a function of excellence in information at scale. The cancer, and post-traumatic stress disorder. Google, along key to future success is to be able to access data, to distill with Stanford and Duke University are also collecting information from such data fast, and to act on it fast large amounts of health data in MVP’s Baseline program. with greater insight than the competition. Perhaps most Meanwhile, Apple’s Open Source Research Kit is driving importantly,