Arxiv:2107.07042V1 [Cs.LG] 8 Jul 2021 in This Work, We Represent a Structured Taxonomy-Based Design It Applies to a Design

Proceedings of the 2021 ASME International Design Engineering Technical Conferences & Computers and Information in Engineering Conference IDETC/CIE 2021 August 17-20, 2021, Virtual, Online DETC2021-70840 CLASSIFYING COMPONENT FUNCTION IN PRODUCT ASSEMBLIES WITH GRAPH NEURAL NETWORKS Vincenzo Ferrero, Bryony DuPont Kaveh Hassani, Daniele Grandi Design Engineering Laboratory Autodesk, Inc. Oregon State University Autodesk Research Corvallis, Oregon, 97331 San Rafael, CA 94903 Email: [email protected] Email: [email protected] Email: [email protected] Email: [email protected] ABSTRACT 1 INTRODUCTION Function is defined as the ensemble of tasks that enable the Function-based design is a foundational tenet in product de- product to complete the designed purpose. Functional tools, sign [1]. Function is defined as the application of the product such as functional modeling, offer decision guidance in the early purpose toward solving a design problem [2, 3]. Components phase of product design, where explicit design decisions are yet within the product complete sub-functions necessary to materi- to be made. Function-based design data is often sparse and alize the overarching product function. In product design, func- grounded in individual interpretation. As such, function-based tional modeling is used to support and guide designers during design tools can benefit from automatic function classification to early conceptual design phases [4, 5]. Here, a designer deter- increase data fidelity and provide function representation models mines the sub-functions needed to complete the primary prod- that enable function-based intelligent design agents. Function- uct function and purpose [1]. These sub-functions are connected based design data is commonly stored in manually generated through flows that capture their interactions. In practice, these design repositories. These design repositories are a collection flows represent material, energy, and signal transfer [6]. of expert knowledge and interpretations of function in product Currently, function-based design suffers from subjectivity design bounded by function-flow and component taxonomies. caused by the designer’s interpretation of function and flow as arXiv:2107.07042v1 [cs.LG] 8 Jul 2021 In this work, we represent a structured taxonomy-based design it applies to a design. Efforts have been made to standardize repository as assembly-flow graphs, then leverage a graph neu- function and flow into taxonomies to limit subjectivity, while ral network (GNN) model to perform automatic function classi- increasing shared domain understanding [6]. The standardiza- fication. We support automated function classification by learn- tion of function-based design principles has led to meaningful ing from repository data to establish the ground truth of com- curation of taxonomy-based design repositories [7, 8, 9]. While ponent function assignment. Experimental results show that our these design repositories have been widely accepted into liter- GNN model achieves a micro-average F1-score of 0.832 for tier 1 ature, there remain challenges in function interpretation defined (broad), 0.756 for tier 2, and 0.783 for tier 3 (specific) functions. by designer expertise in function-based design. The human inter- Given the imbalance of data features, the results are encourag- pretation and assignment of function have generated repositories ing. Our efforts in this paper can be a starting point for more that are often unorganized, sparse, and unbalanced. sophisticated applications in knowledge-based CAD systems and Low data quality and scarcity of design repositories have Design-for-X consideration in function-based design. led to an under-utilization of deep learning methods in the data- 1 Copyright © 2021 by ASME driven product design field [10,11], as they require large amounts In the context of our work, functional modeling supports of data [12, 13]. Prior work addressed the issue of scarce the use of automated reasoning systems, as well as facilitat- structured design knowledge datasets by automatically extract- ing communication and understanding between designers and ing function knowledge from a corpus of mechanical engineer- co-creative agents, both of which could benefit from a better- ing text to construct a design knowledge base [14]. For modali- shared understanding of the problem when working on a creative ties of data other than text, researchers relied on synthetic design task [26, 27, 15]. We see function as an important theoretical el- data [15], small amounts of curated knowledge [16], or scraped ement to allow an intelligent design agent to better understand public online design repositories and manually labeled design the designer’s intent when co-creating with the designer. Pre- knowledge [17, 18]. Yet, it remains challenging to apply data- dicting low-level functions of a design is an initial step towards driven methods in the field of mechanical design [19, 20]. How- this vision. The work we present here contributes the following: ever, recent progress in graph representation learning and graph neural networks (GNNs), show promise in knowledge discovery 1. A novel approach to automatically predict the function of a in sparse datasets [21,22]. Rapid advancements in deep learning part in an assembly using graph neural networks. for sparse datasets present an opportunity to apply such meth- 2. A publicly available relational assembly graph model to rep- ods on design repository data to forward the state-of-the-art in resent design repository data. data-driven design, specifically in the context of function-based 3. Experimental results of part function classification from a design shared understanding, standardization, and computer rep- graph representation of the assembly. resentation. In this body of work, we use the Oregon State Design Repository In this paper, we use GNNs and sparse data from a design (OSDR) as our structured taxonomy-based data source [28, 29]. repository to classify component function based on assembly We provide a publicly available subset of the OSDR dataset used and flow relationships. We represent data from a hierarchical in our work, the assembly graphs representing the OSDR data, taxonomy-based design repository through graphs. The focus of and the GNN implementation for the research community to these graphs is to capture function-flow-assembly relationships leverage in future work 1. Furthermore, graph representation of within products housed in the design repository. We then intro- the OSDR can be leveraged in data searching tasks and other duce a hierarchical GNN framework that capitalizes on the three- GNN tasks beyond function classification. GNN and OSDR tier hierarchical nature of the repository data. Using the hierar- graph representations can be used to ascertain design knowledge chical GNN, we classify component function in three tiers rang- on material choice, assembly order, failure modes, Design for the ing from broad primary functions to detailed tertiary functions as Human Element, Design for the Environment and component- introduced in previous literature [6]. We exhaustively evaluate system classification tasks. our GNN framework using four types of GNN layers and compare its results against other feed-forward networks to determine the fidelity of our proposed GNN architecture. We also compare 2 BACKGROUND our hierarchical GNN architecture against independently trained In this section, we introduce fundamental concepts and re- GNNs for each component function tier. The performance of our search supporting the extraction of functional knowledge using GNN framework is presented and subsequently explored through GNNs. Here, we introduce literature in function-based product confusion matrices and feature importance analysis. design in the context of design support and deep learning. Next, design repositories are discussed as a source of semantic prod- 1.1 Specific Contributions uct data that can be used in modern deep learning techniques. The research presented here contributes to the area of Finally, literature and background are established for graph rep- function-based data-driven product design by leveraging recent resentation and GNNs. developments in graph representation learning to enable a more descriptive shared understanding between humans and comput- 2.1 Function-based Product Design ers about the function of parts in an assembly. Our interest in Function-based design has been used as a bridge to bring function classification stems from recent work that applies data- Design-for-X (DfX) objectives, such as Design for the Environ- driven approaches to various engineering design tasks [10], such ment, from post-design analysis to the earlier design phases of as searching a design space [23], model-based systems engineer- product development. To this end, function-based design has ing [24], or selecting appropriate manufacturing methods [17]. been used with life-cycle assessment data to provide function- Such work points towards intelligent design agents enabled by based sustainable design knowledge to designers [30, 31, 32]. In knowledge-based design systems, which have been explored by human-centered product design, function has been related to hu- the design research community over many years [25, 10]. man error and interaction points to determine which functions need special consideration for ergonomics [33,34]. These recent 1 https://github.com/VincenzoFerrero/OSDR-GNN 2 Copyright © 2021 by ASME developments in function-based

Load more