Engineering, Operations & Technology Information Technology Visualization:Acquiring Information using Past Visual, Analytics Present, and Future at Boeing Dave Kasik Senior Technical Fellow The Boeing Company Dave Kasik and [email protected] Senesac The Boeing Company June, 2011 BOEING is a trademark of Boeing Management Company. Copyright © 2011 Boeing. All rights reserved. A Bit About Us Engineering, Operations & Technology | Information Technology . Dave: . Involved in comppgputer graphics since 1969 . Boeing Senior Technical Fellow . ACM Distinguished Scientist . Stand-in on starship bridges . Known around Boeing as – A curmudgeon about virtual reality in the immersive, stereo sense – An a dvoca te for augmen te d rea lity – Leading proponent and expert for broad use of visualization for geometric and non-geometric data . Chr is: . Involved in computer graphics since 1990 . Boeing Senior Architect . Specialty - being able to apply technology to real world problems . Passion is to simplify complex problems Copyright © 2012 Boeing. All rights reserved. 2 Why Are We Here? Engineering, Operations & Technology | Information Technology . Boeing builds astounding aerospace products . We require hugely varied technology, ranging from . Basic physics to . Networking (on-board & conventional) to . Computing (real-time systems & traditional) to . Material science to . Natural language analysis to . Basically, you name it, we have it . Boeing generates terror -by tes of data . Has worked with advanced visual analysis techniques to gain more insight from our data Copyright © 2012 Boeing. All rights reserved. 3 Outline Engineering, Operations & Technology | Information Technology . Motivation . Past: Give a quick Boeing history of projects that changed computer graphics . Present: Stress current 3D use cases in Boeing . FtFuture: How is compu ter grap hics evol living t o address industrial needs? Copyright © 2012 Boeing. All rights reserved. 4 Data Growth: Terabytes Zetabytes Engineering, Operations & Technology | Information Technology .Moore’s Law: Transistor capacity doubl es every 24 months Growth of technology .The human brain’s volume doubles only every 3 x 107 months 1974 Present .The amount of data stored digitally was estimated at 180 exabytes in 2006. Growth of human .By 2011 there will be at capability least 1800 exabytes (1.8 zetabytes) A long time ago Present Copyright © 2012 Boeing. All rights reserved. 5 Why Visualization? Engineering, Operations & Technology | Information Technology . Broadest communication channel to the human brain . Acquires 80+% of all data communicated to a human . BiBrain mus t process dttdata to gai iin insi ihtght . What can a user do with interactive visualization alone? Copyright © 2012 Boeing. All rights reserved. 6 Visual Task Analysis Engineering, Operations & Technology | Information Technology . Find an object in a complex scene . FthfdbjttbttdtdfFocus on the found object to better understand surface characteristics (e.g., smoothness, roughness) . Once the object is found, look at objects in the immediately surrounding vol ume . Visually scan the scene . Observe dynamics in the entire scene (conventionally by animation) . Work with multiple versions of the same set of objects to compare the two sets . Find anomalies and patterns . More detail in DJ Kasik, “Strategies for Consistent Image Ptitii”IEEEMltidiJPartitioning”, IEEE Multimedia, Jan-Mar, 2004, pp. 32-41 Copyright © 2012 Boeing. All rights reserved. 7 The Past: Boeing and Computer Graphics Engineering, Operations & Technology | Information Technology . Computer graphics . Human model . B-spline surface rendering . Fractals . User interface management systems . Industrial-strength NURBS Algorithms . IGES . Augmented reality . FlyThru/IVT . Voxmap PointShell (collision detection) . Visual analytics . Massive model visualization Copyright © 2012 Boeing. All rights reserved. 8 Computer Graphics Engineering, Operations & Technology | Information Technology . According to Wikipedia, computer graphics has made computers easier to interact with, and better for understanding and itinterpre ting many t ypes of fdt data. D eve lopment s i n comput er graphics have had a profound impact on many types of media... The term came from Boeing-Wichita’s Verne Hudson in 1960. Bill Fetter popularized it . Animation by photography 3D-2D ppglotting Contour plots Copyright © 2012 Boeing. All rights reserved. 9 Human Model Engineering, Operations & Technology | Information Technology . Fetter developed BOEMAN, the first computer model of a human body in 1964 . Used a pen plotter to do reach studies for an aircraft carrier Copyright © 2012 Boeing. All rights reserved. 10 Fractal Animation Engineering, Operations & Technology | Information Technology . Loren Carpenter . Produced, directed film called Vol Libre . Resulted in standing ovation at SIGGRAPH’80 Courtesy: L. Carpenter Copyright © 2012 Boeing. All rights reserved. 11 Augmented Reality Engineering, Operations & Technology | Information Technology . Term coined by Boeing’s Tom Caudell in 1990 . Applications evaluated (Caudell, David Mizell)in) in Boeing proved impractical . Boeing continues to invest in Augmented Reality Copyright © 2012 Boeing. All rights reserved. 12 Massive Model Visualization Engineering, Operations & Technology | Information Technology . Dave Kasik started investigating ways to visualize entire aerospace products in 2004 in collaboration with organizations around the world . Monograph ‘Real-Time Massive Model Rendering’ (Yoon, e t a l. ) 2008 Copyright © 2012 Boeing. All rights reserved. 13 Observations Engineering, Operations & Technology | Information Technology . Boeing has a long tradition in computer graphics and interactive techniques . Visualization has specific value for . Highly complex products . PihProcessing huge amoun tfdtts of data . Widest path into brain . Complex system integration . Complex non-geometric data exploration and analysis tasks . Boeing pushed the state-of-the-art to understand state-of- the-art products . It takes a long time for state-of-the-art in aerospace and computing technology to become widespread Copyright © 2012 Boeing. All rights reserved. 14 The Present: Computer Graphics Use Cases Engineering, Operations & Technology | Information Technology . Dozens of use cases, including . Visual anal yti cs for non-geometitric da ta . 3D geometry visualization Copyright © 2012 Boeing. All rights reserved. 15 What Makes Any Visualization Session Interactive? Engineering, Operations & Technology | Information Technology . Model load time: instantaneous . For groups, “instantaneous” translates to less than one minute . For an individual, five minutes just seems like an eternity unless the person can effectively time share tasks . Reality: the faster the better . “Flying” time: New transformation matrices that respond to mouse action . Ideally, 16 Hz (the human flicker fusion threshold for video) or faster . Practically, 10 Hz or faster . Graphical selection . Feedback appears in < . 25 sec Copyright © 2012 Boeing. All rights reserved. 16 Non-Geometric Data: Analytics Overview Engineering, Operations & Technology | Information Technology . Analysis vs. Analytics . When d eali ng with di git al d at a, anal ysi s i s th e d et ail ed examination of any size and number of data collections . Analytics is the science behind analysis . In practice, analytics requires understanding the . Cognitive processes . Data acquisition . Tools . Techniques & methods . Resu lts commun ica tion pa tterns that let people obtain an optimal or reasonable decision based on existing data. Copyright © 2012 Boeing. All rights reserved. 17 Gain Insight through Data Analysis Engineering, Operations & Technology | Information Technology . Situation awareness . Command and control . Tracking and visibility . Determine status Well suited for . Causal chain analysis advanced visual . Determine why something happened analytics tools that allow interactive . Hypothesis testing exploration and . Explore possible explanations assessment of . DiDetecting anoma lidlies and correl liations complex data . Prevent event occurrences . Prediction/Forecasting . ItitiddImprove quantities ordered . What-if studies . Explore alternatives . SiiSummarizing . Communicate results Copyright © 2012 Boeing. All rights reserved. 18 Tools and Techniques Engineering, Operations & Technology | Information Technology . Numerous tools and techniques . Statistical analysis . Text and data mining . Control rooms . Operations centers . Dashboards . Alerting . Fish-bone charts . Matrix analysis . Neural nets . Competing hypotheses . Modeling & simulation . Pareto analysis . … . Visual analytics is an emerging class of analysis tool Copyright © 2012 Boeing. All rights reserved. 19 Mapping Types ofAnalysistoTools Mapping Copyright © 2012 Boeing. All rights reserved. rights All Boeing. 2012 © Copyright Engineering, Operations & Technology | Technology Information Engineering, Operations&Technology Analysis Causal Chain Summarizing TfT Anomalies Correlations Prediction & Forecasting Hypothesis Hypothesis Awareness Tracking & ype o Detecting Situation Visibility Analysis Studies Testing What-If Tools f & IN-SPIRE Starlight Excel TAC Saffron Jigsaw Geotime Tableau Spotfire SAS SPSS SAS Analytics COGNOS Star Analytics Analyst Notebook TRUST/ P-MATCH 20 Visual Analytics Engineering, Operations & Technology | Information Technology Formal definition: “The science of analytical reasoning facilitated by