APPROVED FOR PUBLIC RELEASE

VOLUME 11 | ISSUE 3 | JUNE 2021 SYSTEMS HOW GOOD IS ENGINEERING YOUR MODEL? By JULIE S. FANT, KAREN E. MCSHANE, RONALD NUSSBAUM, FORUM ROBERT G. PETTIT, VINEET VELMURUGAN, AND TOM M. BOTTEGAL The Aerospace Corporation By AL HOHEB Model-based breath, and quality of the model, The Aerospace Corporation (MBSE) in on the rise across as well as risks associated with the Digital Engineering (DE) agile development and open systems form industry and the government. model. MALs are based on a scale the basis for of the government’s digital acquisition approach to meet Models are essential to achieving from one to three, with three being emerging threats. The Aerospace Systems Engineering Forum (SEF) the DOD Digital Engineering (DE) the highest to reflect increasing provides an opportunity for community members to share their DE and vision, enabling them to be digitally value and risk reduction of the Model-Based Systems Engineering expertise, share their successes, linked to each other to inform model, as conceptually depicted note areas of improvement, and plan a way forward. Since 2016, technical decisions and linked to in Figure 1. Within each MAL level four physical SEF working interchange multi-day events have been acquisition and program data to there are also sublevels to show make acquisition and program incremental growth. Each level conducted and proceedings were archived as Aerospace technical decisions. The possible wide-range also has a set of associated risks, reports. For 2021 the SEF has gone virtual with six public events that of MBSE-based activities requires which help aid in the selection of the provide best practices to address key digital engineering needs. The focus to ensure that the models are MAL level. As Figure 1 depicts, a registration site is available for the remaining 2021 events and contain built for purpose. Currently there are lower MAL level equates to a model an archive of presentations and associated reports https://aerospace. no standard means to express the that has less depth and breadth, org/events/sef. The videos of presentations can be viewed on the value, depth, breadth, and quality reducing risk in the program. As Aerospace YouTube channel. of a MBSE model. Thus, it can be a MAL level increases, the risk is difficult for those without detailed further reduced. When applying Delivery of virtual sessions is now serving the community in ways that knowledge of MBSE to understand MALs, not every program needs face-to-face meetings couldn’t. The SEF has attracted a very large pool numerous acquisition questions to achieve the highest MAL level. of interested organizations and individuals that benefit from the live about a model, such as Instead, a MAL goal should be information and the archive information. The archive pdfs and online • Are the models adding enough selected based on the amount of YouTube videos provide immediate information access. value and risk reduction to risk a program is willing to accept. The following topics are offered in the 2021 SEF: the program? A quantitative and repeatable February 24, 2021 Using UAF: UAF Overview, • Are they of high quality so I can assessment approach was be confident in the information EA Guide for UAF, and EA Process for UAF developed to consistently determine they are providing? a MAL level regardless of who is March 16, 2021 Overview of the Model Assurance Levels (MALs) for • Are the models progressing as performing the assessment. We are Systems and Models needed to meet their intended continued on page 3 purpose and risk reduction? May 11, 2021 Model Portfolio Management (MPM) Guide • Are the models mature June 15, 2021 InDEPTH Overview enough for the acquisition or development phase? July 20, 2021 Designing for Principles (DfP) • How much technical depth is in MAL 3 September 14, 2021 Model Based Mission Assurance and Flight my model? Worthiness (MBMA & FW) To address these concerns, we MAL 2 A complete description and registration is available on our developed a rating scale for models, Systems Engineering Forum website. called Model Assurance Levels MAL 1 (MALs). A MAL level is used to For more information contact Al Hoheb, SEF Chair, [email protected]. concisely express the value, depth, Figure 1. Conceptual MAL Scoring PAGE 2 GETTING IT RIGHT VOLUME 11 | ISSUE 3 | JUNE 2021 MODEL-BASED MISSION UNIFIED ARCHITECTURE ASSURANCE AND FLIGHT FRAMEWORK (UAF) WORTHINESS By JAMES N MARTIN The Aerospace Corporation By HETAV PATEL The Daytime Atmospheric and The Aerospace Corporation Ionospheric Limb Imager (DAILI) is The Unified Architecture Framework (UAF) published by the -Based Systems Engineering based on a 6U CubeSat that has Management Group (OMG) defines a complete set of stakeholder domains (MBSE) has been successfully a two-year build time. Its primary as the basis for creating the variety of necessary architecture views of mission is to measure the daytime breaking ground in systems an enterprise, as well as the systems that make up the enterprise. These thermospheric oxygen densities engineering for all aspects of an domains allow for a logical and systematic flow of architecting activities: and ionospheric densities at high ever-increasing complex space brightness conditions. This new enterprise lifecycle. Mission mission required significant changes a) Concerns and objectives drive a assurance for space systems to the standard AeroCube architecture Summary and Overview strategic plan that increases value and flight worthiness for airborne and operating systems, including to enterprise stakeholders systems are no exception. Model AeroCube mission assurance. Strategic b) The strategic plan deploys Based Mission Assurance/Flight capabilities in phases to help The MBMA team went to work Worthiness (MBMA/FW) paves address gaps and shortfalls updating the AeroCube MBSE Operational the way for the conduct of rigorous c) Capabilities are actualized by models and implemented key operational roles, activities, mission assurance in a digital mission assurance processes in the and performers engineering (DE) environment. The Services environment: d) Operational concepts are concept of MBMA/FW is to leverage implemented through services, descriptive models to conduct MA/ • Requirements verification and Resources resources, and personnel verification activity allocations e) Resources comply with standards FW tasks that are large in number, throughout the design, build, Standards require acute specificity, and and test phases of the f) Risk and threats are mitigated through necessary security and may be automated. CubeSat project Personnel protection controls continued on page 4 g) Requirements, constraints, and concerns are understood and Security communicated to projects h) Plans deliver the resources Projects according to project activities and milestones Actual Resources i) Resources are characterized and verified

UAF is a successor to the DOD Architecture Framework (DODAF) and will automatically create DODAF-compliant architecture views as well as a few dozen other useful views. The UAF specification consists of three main components. The Domain Metamodel (DMM) establishes the underlying foundational modeling constructs to be used in modeling an enterprise, as well as major entities within the enterprise. View specifications provide direction to the tool vendors and to those who are creating the architecture views regarding which DMM elements are pertinent to those views. The UAF Profile (UAFP) is an implementation of the DMM that specifies how the UAF views can be modeled using SysML notation. The UAF grid (Figure 2) has rows that represent typical stakeholder domains (or perspectives) that can be used when modeling an enterprise architecture. The grid has columns that represent the architecture aspects (in UAF these are called model kinds) that correspond to “part of an entity’s character or nature (e.g. structural and behavioral aspects)”. [42010 2021]. This grid is provided in the UAF standard as a structuring formalism for organizing the Illustration of Demonstrated Software Framework and Model Architecture 71 view specifications defined within the UAF. on AeroCube. continued on page 4 VOLUME 11 | ISSUE 3 | JUNE 2021 GETTING IT RIGHT PAGE 3 DEFEAT ENTROPY: A GUIDE TO MANAGING YOUR MODEL PORTFOLIO By MISAK ZETILYAN best practices and standards are model management is adequately bodies, model repositories, or The Aerospace Corporation consistent across the portfolio. addressed. Suppliers can organize MPM reports, as a few examples. The MPM guide is for all and communicate their management Regardless of the implementation, organizational sizes; the driving plans to assure their customers the guide serves to provide criteria for use is whether an that their model efforts are well- organizations a starting point to organization has a collection of managed, trusted, and designed to develop a plan of action from a models and modeling resources meet acquisition objectives. compiled list of considerations. The to manage. The guide can help Implementation of this guide can goal is to streamline and organize acquirers manage their model take many forms. It may start the management of models across libraries, encourage reuse, and with writing and conducting a portfolio so that models are provide suppliers a reference tasks according to a written accessible, relevant, and the full for further model development. organizational MPM plan. Adopting breadth of models is known. Acquirers may use the guide as a organizations may also establish Where to get the guide? Contact reference document for requests MPM management tools such as Misak Zetilyan at 310.336.6914; Models enable the DOD Digital for proposals to ensure that stakeholder agreements, governing [email protected]. Engineering (DE) strategy to support engineering activities throughout the lifecycle. Some organizations have responded by defining a DE implementation plan that addresses their own DE strategy. However, the lack of a standard or guidance that directly addresses managing a collection models has created an “ad-hoc” approach. This lack of references, guidance, or standards inhibit model integration and model reuse. The Model Portfolio Management (MPM) guide identifies goals and tasks necessary to manage an organization’s portfolio of models. It defines the actions and products to ensure that the collection of models meets organizational needs, has a planned evolution, and meets integration targets. It ensures that risks, quality objectives, and modeling

HOW GOOD IS YOUR can be used to set goals and to determine if the model is suitable 015100a069/1bzYDotzwgE expectations for a model early in for use. The risks associated with a MODEL? SEF Forum 2021 Charts continued from page 1 a program. Second, MALs can be MAL level can be identified and and Presentation: in the process of automating the used to monitor the progress of a a strategy for mitigating risks can be developed. assessment process to improve the customer’s MBE effort. The MAL https://www.dropboxcom/sh/ lnlgtixlyqo3wjh/AAd1tt8PbQg2wdPh- practical application of MALs. score can be determined multiple Published information includes: times throughout the development or 6QLjxrja?dl=0 MALs can be used on a program Conference Proceedings acquisition lifecycle to determine if https://www.youtube.comv=bfslhsehn- several different ways. First, the model development is https://dl.acm.org/doi/abs/10.5220/ JM&list=PLFEXcXJhNDQ5hx9VWtkE- they can be used to set goals to on-track. Finally, MALs can be used 0007697505420549 SCWINhxKIR9gM&index=2 determine the potential model to understand and manage risks https://www.computer.org/csdl/ For more information contact Julie Fant at investment. The MAL scale resulting from the model— proceedings-articleisor/2019/ [email protected]. PAGE 4 GETTING IT RIGHT VOLUME 11 | ISSUE 3 | JUNE 2021

to iteratively produce a definition UNIFIED ARCHITECTURE Revisiting the Class Agnostic FRAMEWORK (UAF) of the problem space along with a RECENT GUIDANCE definition of the solution space (i.e., Mission Assurance Process at continued from page 2 AND RELATED MEDIA Aerospace by P.S. Chang, implementation and instantiation). To help facilitate use of the UAF, TOR-2019-02173; PR Trade-offs are identified along the Supply Chain an Enterprise Architecture Guide way and architectural decisions are for the USG Space Enterprise 2019 Satellite Lifetime Study by for UAF is being developed that captured in the architecture views as by D.C. Meshel; TOR-2020-01003; K.L. Ferrone; TOR-2019-02620; PR provides a generalized workflow they are fleshed out. USGC to implement these architecting A National Spaceport Strategy by R.L. Schoonmaker; TOR-2020- activities. Each step in the workflow For more information contact James Martin Mass Properties Control for Space conveys the architecture information 00912; USGC at [email protected]. Systems: Space Vehicles GAP Analysis by Y. Tam; TOR-2020- Supply Chain Risk Management 02648; USG for the USG Space Enterprise by D.C. Meshel; TOR-2020-01003; USGC Learning the Right Lessons from the Space Community’s Model Portfolio Management Resourcing Past by R.R. Rumbaugh; Guide by A.C. Hoheb; TOR-2020- TOR-2021-00492; USGC 01577; PR

Risk Assessment for Decision PR = Approved for public release Support and Resilience in Space USG = Distribution authorized to U.S. government agencies only Systems by S.B. Guarro; ATR-2020- USGC = Approved for release to 00733; USGC U.S. government agencies and their contractors A Framework for Trusted Artificial For reprints of these documents, Intelligence by P.C. Slingerland; except as noted, please contact Figure 2. Unified Architecture Framework grid showing domains for enterprise ATR-2020-00876; PR [email protected]. and system architecture models.

MODEL-BASED MISSION MBMA proved to be beneficial The teams conducted a pathfinder ASSURANCE AND in identifying risks and gaps in to determine scalable solutions for FLIGHT WORTHINESS requirement verification using every launch verification continued from page 2 enhanced descriptive models. activity. These solutions involve • Instantiation of a software These models can be utilized a combination of MBSE, and model architecture for and tailored for any future , and GETTING MBMA using Cameo Systems AeroCube iteration. engineering informatics. Modeler™, Syndeia and JIRA® (also a precursor to an enterprise In coordination with launch and The MBMA work showcased here IT RIGHT mission assurance digital the systems engineering teams, engineering framework) provides a roadmap for agile digital COLLABORATING FOR the MBMA team explored what it mission assurance aimed for MISSION SUCCESS • Modular implementation of model takes to update current enterprise stereotypes for tailored risk mission success. mission assurance processes to assessment and management, Getting It Right is published every as well as mitigation plan accommodate a faster production For more information contact Hetav Patel at three months by the Corporate Chief identification and responsibilities. cadence in a DE environment. [email protected]. Engineer’s Office within the Office of the Executive Vice President of The Aero- 2021 EVENTS August 17 Systems Engineering September 19 2021 Systems space Corporation. Direct questions and Forum Virtual Series: Model Based Engineering Forum Virtual Series: comments to [email protected]. June 9–10 NDIA Manufacturing Mission Assurance and Flight Model Based Mission Assurance and Division, Virtual Meeting Click here to subscribe. Worthiness (MBMA & FW) Flight Worthiness (MBMA & FW) June 15 2021 Systems August 18–20 All trademarks, service marks, and trade Space Warfighting October 12–13 Mission Assurance Engineering Forum Virtual Series: Industry Forum (SWIF): Partnerships Summit, virtual meeting, by names are the property of their InDEPTH Overview for the Future invitation only respective owners. June 21-23 Spacecraft & Launch August 22–26 Space Symposium 36 October 4–7 32nd Aerospace Testing Cleared for public release. Vehicle Dynamic Environments September 14-17 Advanced Maui Seminar (ATS), Virtual Meeting OTR 2021CC0645 Workshop (SCLV) Optical and Space Surveillance October 5–7 Satellite Innovation July 20 2021 Systems Engineering Technologies (AMOS) Conference, ©2021 The Aerospace Corporation Forum Virtual Series: DfP Maui, HI 2021, Mountain View, CA

R5