2020 International Conference on Computational Science and Computational Intelligence (CSCI) Explanation Generation in a Kabuki Dance Stage Performing Structure Simulation System Miku Kawai Jumpei Ono Takashi Ogata Faculty of Software and Information Science Faculty of Software and Information Technology Faculty of Software and Information Science Iwate Prefectural University Aomori University Iwate Prefectural University Takizawa, Iwate, Japan Edogawa City, Tokyo, Japan Takizawa, Iwate, Japan [email protected] [email protected] [email protected] Abstract—We are developing a stage performing structure The information collected was divided into two types: general simulation system. This paper introduces the generation of information and unique information on Kyōganoko Musume explanations into the system. First, we classified the explanations Dōjōji. For example, the term “Dōjōji” requires a general we collected. Thereafter, we prototyped a mechanism wherein the explanation of the building called Dōjōji, as well as an system automatically determines the content and method of an explanation of “Dōjōji” in the story. We obtained a general explanation based on arbitrary parameters. Through this trial, we explanation from Wikipedia and created a unique explanation will examine effective explanation methods for story generation. using [9]. Keywords— Dōjōji, Explanation, Stage Performing Structure, We used three types of explanations: general explanations, unique explanations, and unchiku explanations. The system has I. INTRODUCTION interest information, frequency information, and knowledge In an existing paper [1], the explanation of technical terms amount information. Interest information indicates how has been discussed. Another study has explained the problem- interested a user is in an item. Frequency information indicates solving process of AI systems [2]. This paper deals with the how much the description of the item was described at a given explanation of a story generation system. The explanations used point in time in the story. Knowledge amount information in this story support the understanding of users based on the indicates how much knowledge a user has about an item. For interests and knowledge of the users. interest information and knowledge amount information, 0 is the minimum value, and 10 is the maximum value. The insertion of This paper extends the method of expression of an an explanation is divided into two stages. The explanation explanation generation mechanism that we have developed. generation mechanism determines (A) the content of the Thus far, an explanation generation and an animation system explanation and (B) the method of explanation. have been developed. Both systems are based on the theme of kabuki (Kyōganoko Musume Dōjōji [3]). Kyōganoko Musume (A) Determining the content of the explanation is a process Dōjōji is a famous kabuki-dance work. Based on the Legend of for determining what to explain in a given situation. The system Anchin and Kiyohime, it has undergone many transformations, evaluates the candidate’s explanations based on frequency such as narratives and Noh, leading to the current kabuki-dance. information and interest information and determines what to Therefore, we have analyzed the stage performance structure of explain. Equation (1) is an evaluation equation for the Kyōganoko Musume Dōjōji in detail and developed an explanatory candidates. animation system that can depict the stage [4] [5]. The system 퐼 퐸 = (1) does not reproduce the details of the movements and swings of 퐹 the performer. Based on the story, the system generates code that describes character animation, background switching, and music E is the evaluation result, I is the interest information, and F playback timing. We consider explanations to be one of the is the frequency information (however, one is added to prevent rhetorical techniques of narration [6] [7]. The narrative division by zero). The system appreciates items that are of great generation system that we have developed includes an interest and underestimates items that have been explained many explanation generation mechanism. We have also implemented times. The system selects items for which the value of E is over-explained unchiku generation as one method for achieving higher than the threshold value (0.7). a rhetorical explanation. The aim of this paper is to propose an (B) Determination of the explanation method is a process for experimental explanation mechanism based on the interest and determining the procedure for explaining a specific explanation knowledge of users to consider the future impact of the item. The system determines the type of information to be explanation in the story generation system. explained (general, unique, or unchiku) based on the information of interest. The system determines that items with high interest II. DETAILED LOOK AT THE PROPOSED SYSTEM information should be explained more deeply, hence, it explains This paper examines how explanations can be inserted into unique information more extensively. However, the system animations. In the process of analyzing Kyōganoko Musume explains the storage information for items regarding which the Dōjōji, we collected information on the Legend of Dōjōji [8]. user has a large amount of knowledge (items whose knowledge 978-1-7281-7624-6/20/$31.00 ©2020 IEEE 690 DOI 10.1109/CSCI51800.2020.00126 amount information is 9 or 10). In addition, the system determines the amount to be described based on the frequency information. The system omits the items that have already been explained and the items that the user has knowledge of (items with knowledge amount information of 8 or more). Frequency information and interest information are updated each time a description is generated. Frequency information increases the frequency value of the described item by 1. Interest information decrements the value of the described item by 0.1 and increases the value of the non-explained item by 0.1. III. BACKGROUND SYSTEMS Two systems (a simulation system for Kyōganoko Musume Dōjōji [7,8] and the expansion content generation mechanism [10]) are introduced; these form the basis for the proposed system. A. Simulation System for Kyōganoko Musume Dōjōji Fig. 2. Example of an animation generation In this section, we explain the system that generates an explainable elements in the current scene based on the animation, which is the insertion target of the explanation. Fig.1 explanation target. Thereafter, information on the element to be presents the architecture of a simulation system for Kyōganoko explained is obtained from the knowledge base, based on the Musume Dōjōji. The system receives a command file and explanation type. The mechanism transforms the obtained generates an animation with music. The command file is a file information to generate the case structure of the explanation. Fig. that describes the images to be used, the arrangement and 3 shows an example of knowledge for explanation. animation of those images, the music to be used, and the timing for playing the music. The images are stored in the picture TABLE I. ANALYSES DATA OF “CHŪKEI NO MAI” database for each character and background. The music database stores music generated from the score [11] and existing music. Item Content Continuing from Ranbyōshi, perform a dance at the center Actual stages Fig.2 shows an example of an animation generation. This of the stage, in tune with Noh. animation was generated based on the command file that we Music Creating a music from a score (Nagauta) Kane ni Urami ha kazukazugozaru … (omission) … Lyrics created using the analysis results for Kyōganoko Musume Dōjōji. shinnyo no Tsuki wo nagameakasan Table 1 presents a part of the analysis results [7, 8]. >Characters: Shirabyōshi Hanako (Have Chūkei), Syoke (12 people) >Katarite Images >Musicians: Shamisen (Japanese guitar), Taiko [Drum], Dōjōji Kodutumi [Small Drum], Fue [Flute] Command Display >Place on stage: Main stage, Hanamichi File Animation >Stage equipment: Dōjōji, Kane, Cherry blossoms System IV. EXPLANATION GENERATION This section presents examples of the generation using two Speaker user models. User model 1 (UM1) is a model that has a strong interest in specific items and has a large amount of knowledge. Music Picture User model 2 (UM2) is a model that has a strong interest in many items and a small amount of knowledge. The generation result Database Database for UM1 is presented in Table 2, along with the interest information (Interest) and knowledge amount information Fig. 1. Architecture of the simulation system (Knowledge) for each user model. Fig. 4 shows the classification of the collected data on B. Explanation Content Generation Mechanism Kyōganoko Musume Dōjōji. The value of the node is the value We introduce a mechanism for generating the content of the of interest information and knowledge amount information. We explanation and the data used by the explanation generation have inserted explanations in 14 scenes. Table 3 presents three mechanism. scenes that include an explanation. Fig. 5 presents an example of the explanation of “Shirabyōshi Hanako” in “Chūkei no Mai”. The amount of explanation and the type of explanation are The content of the explanation is as follows: Shirabyōshi determined by the mechanism described in Section 2. The Hanako wanted a memorial service for the bell. The day the bell explanation content generation mechanism receives the was memorialized at Dōjōji, he was the person who came to explanation targets, explanation types, and current scene from perform the dance. The real character of Shirabyōshi Hanako is the explanation control mechanism described in Section 2. The Kiyohime. mechanism selects the element to be explained from the 691 Story: A story written later of the Legend of Anchin and Kiyohime. Next, we present the results for UM2 generation. UM2 is a Shirabyōshi Hanako performs a dance to create a memorial service for the model in which the average value of interest information is bell, but at the end, she reveals her true nature, jumps into the bell, and bigger and the average value of knowledge amount is smaller becomes a snake.