DARPA and Data: a Portfolio Overview

Home , DARPA, Snap (web framework), Storm (software)

DARPA and Data: A Portfolio Overview

William C. Regli Special Assistant to the Director Defense Advanced Research Projects Agency

Brian Pierce Director Information Innovation Office Defense Advanced Research Projects Agency Fall 2017

Distribution Statement “A” (Approved for Public Release, Distribution Unlimited) 1 DARPA Dreams of Data

• Investments over the past decade span multiple DARPA Offices and PMs • Information Innovation (I2O): Software Systems, AI, Data Analytics • Defense Sciences (DSO): Domain-driven problems (chemistry, social science, materials science, engineering design) • Microsystems Technology (MTO): New hardware to support these processes (neuromorphic processor, graph processor, learning systems) • Products include DARPA Program testbeds, data and software • The DARPA Open Catalog • Testbeds include those in big data, cyber-defense, engineering design, synthetic bio, machine reading, among others • Multiple layers and qualities of data are important • Important for reproducibility; important as fuel for future DARPA programs • Beyond public data to include “raw” data, process/workflow data • Data does not need to be organized to be useful or valuable • Software tools are getting better exponentially, ”raw” data can be processed • Changing the economics (Forensic Data Curation) • Its about optimizing allocation of attention in human-machine teams

Distribution Statement “A” (Approved for Public Release, Distribution Unlimited) 2 Working toward Wisdom

Wisdom: sound judgment - governance Abstraction Wisdom (also Understanding: explanation – why “value”) Understanding Knowledge: correlation and composition – how

Knowledge Information: facts - what, who, where, when data: representing signals or stimuli Information

data Sapience (or processing/cognitive ‘load’)

Example of the Data-Wisdom process for model evolution and application:

data Information Knowledge Understanding Wisdom

IRAQ COUNTER-INSURGENCY DYNAMICS

IRAQ COUNTER-INSURGENCY DYNAMICS COALITION Coalition Instit’l COIN Recent COIN Fear of Under- Related Mistake standing & Experience Coalition GOVERNMENTGovt Capability Qual/Avail Perceived Support Govt COIN of COIN COALITION Coalition Instit’l COIN Recent COIN Conflict for Conflict Appropriate COINTrai ni n g COIN Fear of Under- Related Appr Indigenous Forces Mistake Experience Costs Public Actions Specialist Insurge nt standing & Skills Coalition GOVERNMENTGovt Capability Qual/Avail Support Adequacy Ability to Support of COIN Media Emp hasis for Conflict Elapsed Govt COIN COIN Appr Perceived Govt COIN Tool s Instit’l Provoke Conflict for Conflict Appropriate COINTrai ni n g COIN on Negativ e & Ti me of Under- MILITARY – Inform al Excessive Appr Public COIN COIN Costs Public Actions Specialist Insurge nt Sensational UnderstaCOALITION nding Conflict standing & Military to Learni ng COIN Response Support Adequacy Skills Ability to Expect- Govt Comms Learni ng Media Emp hasis for Conflict Elapsed Govt COIN COIN Appr MEDIA and Expectati ons STR / OP & Adjust Unit Duratio n Tool s Instit’l Provoke Media ations Quality Bureaucr acy & & Adjust Military on Negativ e & Ti me of Under- MILITARY – Inform al Excessive Susceptibility Media PUBLIC Manpow er Organizati onal in Area Sensational Public COIN standing & Military to COIN COIN Sensation- Depth & Quality Fundi n g ApprUse Media Coverage UnderstaCOALITION nding Conflict Learni ng Response & RIP/TOA to Insur gent Delays and Expectati ons Expect- Govt Comms STR / OP & Adjust Learni ng alism Bias of Media Equip Dev Fundi ng of Forc e Media MEDIA Bureaucr acy & Unit Duratio n Message Quality Media PUBLIC ations Manpow er Quality & Adjust in Area Military Quality & Availability Coverag e Adequacy Manpow er Adequacy Proactive COIN Local Susceptibility Sensation- Depth & Quality Fundi n g Organizati onal ApprUse per to Insur gent Delays & RIP/TOA of COIN Messa ge Logistics Ops & Timeliness ApprMen tality Knowledge alism Bias of Media Equip Dev Fundi ng Quality of Forc e Perceived Inform ation Population Coalition Population Message Quality & Availability Coverag e Adequacy Manpow er Adequacy Proactive COIN Local Qual/Avail of Effectiveness & Focus Ops of COIN Messa ge per Knowledge Military Adequacy Inform ation Logistics Ops & Timeliness ApprMen tality Use of Fo rce Insurge nt Iraqi Cent ral Effectiveness Data Perceived Qual/Avail of Population Effectiveness & Focus Perceived Intel Military Ops Adequacy Message Govern ment Expected Insurge nt Effectiveness Political Satisfaction Analysis Situational Use of Fo rce Iraqi Cent ral Perceived Intel Effectiveness Benefits COIN Effective MILITARY - Stress Message Govern ment Political Expected Situational Fairness with Infrastr uctur e & Ops Satisfaction Analysis and Cre dibility to Daily Life Econ Dev Ops Resource Effectiveness Fairness Benefits with Infrastr uctur e & COIN Effective MILITARY - Ops Stress Daily Life Effective- and Cre dibility to Daily Life Resource Effectiveness Allocation Daily Life Econ Dev Ops Effective- Perceived Hope for ness Hope for Effectiveness Allocation ness Relative Self & Ops Focus TACTICAL Relative Perceived & Ops Focus Effectiveness Religious & Avg COIN Insurgent Sympathizers Religious & Self TACTICAL Governe d Effectiveness Avg COIN Ideological Appropriate Quality & Governe d Appropriate of Insur gent IRAQI Futur e Emphasis Capability of Insur gent IRAQI Ideological Capability Quality & Compatibility Inter- Volume of Compatibility Futur e Emphasis Inter- Volume of Message on per S oldie r Message on on Civilian per S oldie r on Civilian person al Actionable CiviliansGOVERNMENT LOCAL person al Actionable CiviliansGOVERNMENTLocal Govt/ LOCAL Interacti on Perceptions Civilian Local Govt/ Interacti on Perceptions Behavior Intel Civilian Behavior Intel Police/Military Relative Opport unity/ & Relationships Police/Military Relative Opport unity/ & Relationships Participation Consistency Military to Participation Military to in Central Dev Ops Attractive- Civilian in Central Dev Ops Attractive- Consistency Civilian Govt Events EffectivenessCIVILIANS ness of Qual/Avail Trust Govt Events EffectivenessCIVILIANS ness of Trust Qual/Avail Empower- Ability to Vet Visible Benefits Insurge nt of Local I nfo Ability to Vet of Local I nfo Relig/Trib/ Path Collected Empower- Visible Benefits Insurge nt ment of to Daily Life Civilian Positive Local Relig/Trib/ Path Collected Progressive Polit/Milit Civilian Presence Targ eted ment of to Daily Life Civilian Positive Local Leade rs Willingness Insurge nt Civilian Military Polit/Milit Civilian Targ eted (signals) Local Le aders Ops Offensive Ops Progressive Presence to Inter act Interacti ons Civilian Leade rs Willingness Insurge nt Civilian Military Symp- Fractio n Effectiveness Ability to Effectiveness Offensive Ops athizer Contacts Local Le aders to Inter act Interacti ons Ops Civilian Local Govt Survive Symp- Effectiveness Ability to Effectiveness Fractio n Insurge nt Civilian Fractio n Contacts Coalition Forces Developme nt Prox- athizer Survive Attack & Local Govt Fractio n Civilian Credibility & Consistency Ability to ID imity Insurge nt Effectiveness Effective Use Perception of Military Retaliate Developme nt Prox- Indigenous Government of Existing ISF IP of Coalition Insurge nts & Attack & Credibility & Consistency Govt/Police/ Manpow er Security & Intentions & Activity/ Military Prevent Effective Use Ability to ID imity Personality Attacks Effectiveness Perception of Military Retaliate Milit Capab Effectiveness Perceived Commitment Guardin g Exposure to of Existing ISF IP of Coalition Insurge nts & Stability Coalition Activity/ & Credibility Insurge nt Ability Ops Insurge nt Casualties Govt/Police/ Manpow er Security & Intentions & Military Prevent to Oper ate Attack Personality Insurge nt Effective- Milit Capab Effectiveness Perceived Commitment Exposure to Attacks Infrastr uctur e in Area ness Guardin g Coalition Economy IRAQI POLICE/ Recruiting & Credibility Stability Insurge nt Ability Insurge nt & Retention Civilian Ops Casualties Tri bal & Employment to Oper ate Attack Religious MILITARY Hard Core Insurge nt Insurge nt Casualties Insurge nt Effective- & Damages Infrastr uctur e in Area Tension Contracto r Insurge nt Insurge nts Learni ng Material Insurge nt IRAQI POLICE/ Recruiting ness Adequacy Fear of Manpow er & Support Attacks Economy in Area Employment & Retention Civilian Insurge nt Leade rship on Military Tri bal & Casualties Repercussio n Religious MILITARY Hard Core Insurge nt Insurge nt from Insurge nt & Damages Insurge nt Contracto r Insurge nt Insurge nts Learni ng Material Insurge nt Targ eted Capability Tension Adequacy Thre ats & Fear of Manpow er & in Area Support Attacks Local Civilians Insurge nt on Military Attacks on Leade rship Repercussio n Iraqis INSURGENTS Insurge nt Insurge nt Insurge nt Casualties Targ eted Capability and Capt ures Thre ats & Attacks on Iraqis INSURGENTS Insurgent Forces Infrastructure Insurge nt WORKING HYPOTHESIS Casualties and Capt ures multiple © PA Knowledge Limite d 200 6. All rights reserv ed. – 10/1 8/200 6 WORKING HYPOTHESIS sources International Diplomacy © PA Knowledge Limite d 200 6. All rights reserv ed. – 10/1 8/200 6 Descriptive model Correlative/predictive model Explanatory model Judgement, value, (symbols, syntax) (rules, processes, (abstractions, insight, instinct, semantics) theories, etc) principles, etc

Distribution Statement “A” (Approved for Public Release, Distribution Unlimited) 3 Examples of Data-to-Wisdom

Information Knowledge Understanding Wisdom Task Determine facts Correlate and compose Explain Apply sound judgement (what, who, where and when) (networks and systems) (causal mechanisms) (governance)

IRAQ COUNTER-INSURGENCY DYNAMICS

IRAQ COUNTER-INSURGENCY DYNAMICS COALITION Coalition Instit’l COIN Recent COIN Fear of Under- Related Mistake standing & Experience Coalition GOVERNMENTGovt Capability Qual/Avail Perceived Support Govt COIN of COIN COALITION Coalition Instit’l COIN Recent COIN Conflict for Conflict Appropriate COINTrai ni n g COIN Fear of Under- Related Appr Indigenous Forces Mistake Experience Costs Public Actions Specialist Insurge nt standing & Skills Coalition GOVERNMENTGovt Capability Qual/Avail Support Adequacy Ability to Support of COIN Media Emp hasis for Conflict Elapsed Govt COIN COIN Appr Perceived Govt COIN Tool s Instit’l Provoke Conflict for Conflict Appropriate COINTrai ni n g COIN on Negativ e & Ti me of Under- MILITARY – Inform al Excessive Appr Public COIN COIN Costs Public Actions Specialist Insurge nt Sensational UnderstaCOALITION nding Conflict standing & Military to Learni ng COIN Response Support Adequacy Skills Ability to Expect- Govt Comms Learni ng Media Emp hasis for Conflict Elapsed Govt COIN COIN Appr MEDIA and Expectati ons STR / OP & Adjust Unit Duratio n Tool s Instit’l Provoke Media ations Quality Bureaucr acy & & Adjust Military on Negativ e & Ti me of Under- MILITARY – Inform al Excessive Susceptibility Media PUBLIC Manpow er Organizati onal in Area Sensational Public COIN standing & Military to COIN COIN Sensation- Depth & Quality Fundi n g ApprUse Media Coverage UnderstaCOALITION nding Conflict Learni ng Response & RIP/TOA to Insur gent Delays Hybrid and Expectati ons Expect- Govt Comms STR / OP & Adjust Learni ng alism Bias of Media Equip Dev Fundi ng of Forc e Media MEDIA Bureaucr acy & Unit Duratio n Message Quality Media PUBLIC ations Manpow er Quality & Adjust in Area Military Quality & Availability Coverag e Adequacy Manpow er Adequacy Proactive COIN Local Susceptibility Sensation- Depth & Quality Fundi n g Organizati onal ApprUse per to Insur gent Delays & RIP/TOA of COIN Messa ge Logistics Ops & Timeliness ApprMen tality Knowledge alism Bias of Media Equip Dev Fundi ng Quality of Forc e Perceived Inform ation Population Coalition Population Message Quality & Availability Coverag e Adequacy Manpow er Adequacy Proactive COIN Local Qual/Avail of Effectiveness & Focus Ops of COIN Messa ge per Knowledge Military Adequacy Inform ation Logistics Ops & Timeliness ApprMen tality Use of Fo rce Insurge nt Iraqi Cent ral Effectiveness Perceived Population Effectiveness & Focus Perceived Intel Military Qual/Avail of Ops Adequacy Message Govern ment Expected Insurge nt Effectiveness Political Satisfaction Analysis Situational Use of Fo rce Iraqi Cent ral Perceived Intel Effectiveness Benefits COIN Effective MILITARY - Stress Message Govern ment Political Expected Situational Fairness with Infrastr uctur e & Ops Satisfaction Analysis and Cre dibility to Daily Life Econ Dev Ops Resource Effectiveness Fairness Benefits with Infrastr uctur e & COIN Effective MILITARY - Ops Stress Daily Life Effective- and Cre dibility to Daily Life Resource Effectiveness Allocation Daily Life Econ Dev Ops Effective- Perceived Hope for ness Hope for Effectiveness Allocation ness Relative Self & Ops Focus TACTICAL Relative Perceived & Ops Focus Effectiveness Religious & Avg COIN Insurgent Sympathizers Religious & Self TACTICAL Governe d Appropriate Effectiveness Governe d Avg COIN of Insur gent IRAQI Ideological Capability Quality & IRAQI Ideological Appropriate Quality & Futur e Emphasis Inter- of Insur gent Futur e Emphasis Inter- Capability Message on Compatibility per S oldie r Volume of Message on Compatibility per S oldie r Volume of on Civilian person al Actionable operations Civilians on Civilian person al Actionable CiviliansGOVERNMENT LOCAL GOVERNMENT LOCAL Local Govt/ Interacti on Perceptions Civilian Local Govt/ Interacti on Perceptions Behavior Intel Civilian Behavior Intel Police/Military Relative Opport unity/ & Relationships Police/Military Relative Opport unity/ & Relationships Participation Consistency Military to Participation Military to in Central Dev Ops Attractive- Civilian in Central Dev Ops Attractive- Consistency Civilian Govt Events EffectivenessCIVILIANS ness of Qual/Avail Trust Govt Events EffectivenessCIVILIANS ness of Trust Qual/Avail Empower- Ability to Vet Visible Benefits Insurge nt of Local I nfo Ability to Vet of Local I nfo Relig/Trib/ Path Collected Empower- Visible Benefits Insurge nt ment of to Daily Life Civilian Positive Local Relig/Trib/ Path Collected Progressive Polit/Milit Civilian Presence Targ eted ment of to Daily Life Civilian Positive Local Leade rs Willingness Insurge nt Civilian Military Offensive Ops Progressive Polit/Milit Civilian Presence Targ eted Local Le aders to Inter act Interacti ons Ops Civilian Leade rs Willingness Insurge nt Civilian Military Symp- Fractio n Effectiveness Ability to Effectiveness Offensive Ops athizer Contacts Local Le aders to Inter act Interacti ons Ops Civilian Local Govt Survive Symp- Effectiveness Ability to Effectiveness Fractio n Insurge nt Civilian Fractio n Contacts Coalition Forces Developme nt Prox- athizer Survive Attack & Local Govt Fractio n Civilian Credibility & Consistency Ability to ID imity Insurge nt Effectiveness Effective Use Perception of Military Retaliate Developme nt Prox- Indigenous Government of Existing ISF IP of Coalition Insurge nts & Attack & Credibility & Consistency Govt/Police/ Manpow er Security & Intentions & Activity/ Military Prevent Effective Use Ability to ID imity Personality Attacks Effectiveness Perception of Military Retaliate Milit Capab Effectiveness Perceived Commitment Guardin g Exposure to of Existing ISF IP of Coalition Insurge nts & Stability Coalition Activity/ & Credibility Insurge nt Ability Ops Insurge nt Casualties Govt/Police/ Manpow er Security & Intentions & Military Prevent to Oper ate Attack Personality Insurge nt Effective- Milit Capab Effectiveness Perceived Commitment Exposure to Attacks Infrastr uctur e in Area ness Guardin g Coalition Economy IRAQI POLICE/ Recruiting & Credibility Stability Insurge nt Ability Insurge nt & Retention Civilian Ops Casualties Tri bal & Employment to Oper ate Attack Religious MILITARY Hard Core Insurge nt Insurge nt Casualties Insurge nt Effective- & Damages Infrastr uctur e in Area Tension Contracto r Insurge nt Insurge nts Learni ng Material Insurge nt IRAQI POLICE/ Recruiting ness Adequacy Fear of Manpow er & Support Attacks Economy in Area Employment & Retention Civilian Insurge nt Leade rship on Military Tri bal & Casualties Repercussio n Religious MILITARY Hard Core Insurge nt Insurge nt Insurge nt Insurge nt Contracto r Insurge nt Insurge nts Learni ng Material Insurge nt & Damages Targ eted Capability Tension Adequacy Thre ats & Fear of Manpow er & in Area Support Attacks Local Civilians Insurge nt on Military Attacks on Leade rship Repercussio n Iraqis INSURGENTS Insurge nt Insurge nt Insurge nt Casualties Targ eted Capability and Capt ures Thre ats & Attacks on Iraqis INSURGENTS Insurgent Forces Infrastructure Insurge nt WORKING HYPOTHESIS Casualties and Capt ures © PA Knowledge Limite d 200 6. All rights reserv ed. – 10/1 8/200 6 WORKING HYPOTHESIS International Diplomacy © PA Knowledge Limite d 200 6. All rights reserv ed. – 10/1 8/200 6 Descriptive model Correlative/predictive model Explanatory model Select and execute interventions

Tactical operations

Detect and identify Recognize relationships and Find endo– and exogenous causal Assess viability of objects/entities activities of objects/entities factors driving objects/entities Blue approach

Information operations

Message translation Message meaning Message impact Evolve message strategy

Security operations Students at a Students walking Students walking university walking because of a change because of a change between buildings in classes in classes is not anomalous behavior

Image object identification Scene knowledge Scene understanding Decide and manage (relationships between objects) responses Distribution Statement “A” (Approved for Public Release, Distribution Unlimited) 4 DARPA Investments in the Data Ecosystem

Information Knowledge Understanding Determine facts Correlate and compose Explain (what, who, where and when) (networks and systems) (causal mechanisms)

LORELEI (I2O) CASCADE – Integ data/tools for robust SoS AIDA (I2O) MoDyl – Dynamics from data sets (DSO) (DSO) Big Mechanism (I2O) RATS (I2O) CRAFT – Workflow/CAD tools (MTO) Biochronicity – Tools gene regulatory nets Visual Media Reasoning (I2O) Data Driven Discovery of Models (I2O) (DSO) Global Autonomous Language Deep Extraction from Text (I2O) Causal Exploration (I2O) Exploitation* Insight (I2O) MATRIX– Multi-scale matls data/models Make-It – Synthetic chemistry (DSO) (DSO) MENTOR2 – CAD data/tools (DSO) Mine Better, Fund Faster – Surprise ID (DSO) Algorithms & Analytics & Algorithms Algorithms & Analytics & Algorithms Modelling Adversarial Activity (I2O) SocialSim (I2O) Network Defense (I2O) Synergistic Discovery and Design (I2O) Next Gen Soc Sci – Data/tools (DSO) QCR (I2O) Brandeis – Data privacy (I2O) Sigma – System for CBRNE detection (DSO) EQUIPS – Uncertainty analysis tools TRADES - Eng design env (DSO) BRASS (I2O) (DSO) Personalized Assistant that Learns* Explainable AI (I2O) Memex – Web data/info search (I2O) FunLOL – Framework for AI/ML (DSO) SAFER (I2O) Cortical Processor (MTO) MSEE – Tools for machine understanding Simplex - Unified math frameworks (DSO) EdgeCT (I2O) (DSO) XDATA (I2O) GRAPHS – Graph analysis tools (DSO) PPAML (I2O)

PROCEED* HIVE – Graph problem HW/MW (MTO) Middleware & Services Services & Middleware & Services Signal processing programs* Media Forensics (I2O) MUSE (I2O) SafeWare (I2O) Deep Learning*

Distribution Statement “A” (Approved for Public Release, Distribution Unlimited) *completed program DARPA Investments in the Data Ecosystem

Information Knowledge Understanding Determine facts Correlate and compose Explain (what, who, where and when) (networks and systems) (causal mechanisms)

PROCEED* HIVE – Graph problem HW/MW (MTO) Middleware & Services Services & Middleware & Services Signal processing programs* Media Forensics (I2O) MUSE (I2O) SafeWare (I2O) Deep Learning*

Distribution Statement “A” (Approved for Public Release, Distribution Unlimited) *completed program X-Data: Common Data Cyber-Infrastructure

DARPA XDATA Disk / RAM / GPU Disk / RAM / GPU RAM / Cache / GPU

Sources Transforms Platform Abstractions Analytics Visualization Interaction Queries Batch (size) HDFS / Hadoop Map / Reduce Stream (rate) “Find me Giraph Purdue HTML5 everything on this Oozie USC Stepi+1 d3.js number”

Radar Tracklets Hama Sotera Draper) Vega ( Geo/Time‐ RHIPE MITLL “Find me a Hive Data Like pattern of Java

Speech to GoFS clicking Tactics Graph / Matrix behavior on this Speech text USC Oculus / Kitware Intersect

ETL IBM Skylark(RNLA) Stanford / Kitware entity”

HiveQL / Accumulo Sotera Louvain mouse BlinkDB UCB USC BSP Optimization CherryPy “Where will this Other Python , Video Content Storm and GA Tech NNMF person be

O) Tangelo

Anaconda extraction Spark Streaming JHU VNOM tomorrow” Integrate

Blaze

Mesos /

Stanford O SNAP logging (MDA/JPL) (MDA/JPL)

Numba SQL‐Like Entity Tachyon “What groups

Extraction (Stanford Spark Continuum Time Series Kitware does this group

UCB Export Text Topic Shark Oculus / Kitware

Sotera ARIMA / interact with”

Bagel keystroke Modelling Workflow Aperture Workflow GA Tech Time Series Oculus

Clojure via SSCI/MIT/UL BayesDB API

Zoom API OWF /

Wings Wings OptiWrangler ‐ Neon ‐

Spreadsheets API , Machine Learning Next Century SNAP

MPI SSCI/MIT/UL BayesDB Tracking Pivot

Stanford

API Bokeh

Delite OODT OODT Retrieval /

Elemental MITLL/BBN NLP Graph‐Like GA Tech Analytics OptiCVX (Sotera) Querying

Metadata Logging BLAS Boeing/Upitt SMILE Continuum

IBM Action Hoc

OptiGraph ‐ (UCB),

MITLL TopicID Ingest

OpenMPI Brush Data

Continuum Oculus / Kitware OptiML ‐ DT/UMD/MSR Ad

Zephyr 3d

PCAP Pcap HiveQL API,

Stanford O Link Classification Shark

Data

Virtual Interface

unpacking Single Machine UCB BlinkDB Interactive g++ API. Environments R JHU

Immersive ICT User Geocoding Stanford

IP Networks / Impala, Labs

Matlab Distance Measures Interactive (MDA/JPL) Stata Phronesis TBD e.g, Cosine Sim, CMU Coding

Riposte Page rank New School Summarize

Lincoln Bio Purdue Mongo, Defaults and design Tracking (Wakari, SNAP Stanford O Workflow GA Tech / Stanford B / recommendations

Eye Julia)

/ Continuum MITLL / Continuum Etc… Other basic HPC Convex Optimization Boeing / U Pitt Wings Subselect /

‐ CUDA transforms

Sotera Genie / TBD Bigdata DB Tracking

Correlation Approximation Continuum Stencil Physical Query DSL /

GPU Devices

Tikka,OODT Royal

gpuGraph Caliper Attention (Multi‐touch) UC Davis ICT SYSTAP Search

Quality of Service Workflow Management / System Architecture Resource Management/Planning Latency from click MDA/JPL, UCB, Sotera, Draper, Data‐Tactics Dependencies; Scheduler RAID and redundancy; #GPUs, RAM, SSD, CPU Performance and load estimates 1 Adjustable tradeoffs: Volume, Time, Accuracy / Uncertainty User Interface with workflow planning Distribution Statement “A” (Approved for Public Release, Distribution Unlimited) 7 Examples: Human-Machine Symbiosis

DARPA’s Transformative Design (TRADES)

Program Objective Transform design by exploring new math/algorithms to enable new and innovative designs which account for next generation materials and processes Expected Outcomes • Leverage computation and data at unprecedented scales • Deal with significantly more complex and coupled design problems • Lower the time and expertise required to create complex engineered products

Distribution Statement “A” (Approved for Public Release, Distribution Unlimited) 37 Distribution Statement “A” (Approved for Public Release, Distribution Unlimited) 8 Summary

Today Future

Wisdom Wisdom Abstraction Abstraction Understanding Understanding

Knowledge Knowledge

Information Information

data data Sapience Sapience Unbound Computation & Data Exploit computation and larger scales; leverage machine learning and AI; Produce and harvest data in more disruptive ways! ß requires culture change Advancing the software toolbox An ecosystem of interoperable building blocks/tools for machine-augmented problem solving; make them easier to use ß a limiting issue Problem-Process-People Co-design Simultaneous redesign of problem and human-machine dynamic: Thinking faster, better and functioning at higher levels ß culture change

Distribution Statement “A” (Approved for Public Release, Distribution Unlimited) 9 www.darpa.mil

Distribution Statement “A” (Approved for Public Release, Distribution Unlimited) 10 Credit: Detroit Institute of Arts A DARPA Goal: Transform cognitive problems using machines-as-partners

Distribution Statement “A” (Approved for Public Release, Distribution Unlimited) 11 Big Mechanism

Goal: Machines that help humans to model and analyze very complicated systems by reading fragmented literatures and assembling and reasoning with models.

Courtesy: Rzhetsky Lab

Distribution Statement “A” (Approved for Public Release, Distribution Unlimited) 12 Big Mechanism Architecture

Goal: Machines that help humans to model and analyze very complicated systems by reading fragmented literatures and assembling and reasoning with models.

reading journal suggested model text shallow and with models articles revisions

Gene Ontology entities, relations, Reactome events, processes models assembly Pathway Commons etc ...

reasoning model manager revised models predict, explain, test, curate, etc.

Outline of today’s talk: Reading; Some Results; Varieties of Big Mechanism Systems; Why it Works; Will it Work Elsewhere?

Distribution Statement “A” (Approved for Public Release, Distribution Unlimited) 13 Cross-cutting Opportunities for DARPA

• Altered Senses • New sensing systems; new human-machine interaction as well • Neurotech being coupled with higher-order cognitive processes • Unbound Computation & Data • Exploit computation and larger scales; Produce data and harvest our own in more disruptive ways! • Advancing the software toolbox • An ecosystem of building blocks/tools for machine-augmented problem solving; make them easier to use ß a limiting issue • Problem-Process-People Co-design • Simultaneous redesign of problem and human-machine dynamic

Distribution Statement “A” (Approved for Public Release, Distribution Unlimited) System Concept

Knowledge Needs/Gaps, Request/ Integrated ICM Response Causal Exploration Model

Intuitive Operational, Interaction Government- Model Assembly/ provided, and Knowledge Human Model Population/ Open Source Organization Interaction User Entities, Configuration/ Documents Causal Adaptation and Relationships, Databases Domain- User Input and tailored Feedback to Ontology Causal Model Assembly Model Assembly

Common Standards Shared Repository Scalable Processing and Interfaces

Shared Services

Distribution Statement A – Approved for Public Release, Distribution Unlimited 15