Streamlined Workflow for 3D Modeling with Animated Characters
Total Page:16
File Type:pdf, Size:1020Kb
Journal of Software Streamlined Workflow for 3D Modeling with Animated Characters Wei-Chieh Chang, Wei-Min Jeng* Department of Computer Science and Information Management, Soochow University, Taipei, Taiwan. * Corresponding author. Tel.: 886-2-2311-1531 ext. 3811; email: [email protected] Manuscript submitted December 14, 2014; accepted June 17, 2015. doi: 10.17706/jsw.10.7.912-918 Abstract: With the proliferation of computer graphics and multimedia technology, there are abundant choices of three-dimensional (3D) modeling and character animation professional software in the market. However, authoring using different software products collectively still remains a difficult task considering the distinct features of proprietary software artifacts. The main purpose of this paper is to propose a streamlined workflow aiming at performing the 3D modeling construction with animated characters. As the concept of Wikinomics emerges, open source based software and products are utilized to provide the maximum collective throughput potential. The proposed SketchUp and MikumikuDance workflow (SUMD) introduces the novel method for plentiful of potential applications in light of the augmented capabilities of the integrated process. The goal is to assist professional users associated with different domains and sustain their high enthusiasm levels during the modeling process. Rather than manipulating more than one software products with incompatible properties, the workflow users will be guided through the challenging process to complete their 3D construction with animated characters in the proposed SUMD workflow to create potentials for more future application use. Key words: Augmented reality, SketchUp, animation, workflow, MikuMikuDance. 1. Introduction Augmented reality is a live direct or indirect view of a physical, real-world environment whose elements are augmented or supplemented by computer-generated sensory input such as sound, video, or graphics [1], [2]. With the advanced augmented reality technology like computer vision and object recognition, the emerging computer-based tools can help users interact and digitally manipulate with various aspects of the real world surrounding. The idea of augmented reality has been applied in many fields since its introduction in the 90’s. Many of the created virtual objects can be overlaid with the real world scenes in various settings to exhibit special effects by using augmented reality technology. For 3D modeling, the designer would appreciate the idea if the automated tool can assist in the process by offering the capability of both the 3D scene together with the animated characters to attain the best possible effects. Take relatively popular 3D Modeling computer software SketchUp for examples, SketchUp is always used in 3D visualization by erecting buildings with CAD programs or integrating construction locations with Google Earth. Conversely, MikuMikuDance (MMD) is mainly applied in 3D character animation. It is often used by animating static characters with Microsoft Kinect sensor to create special effects forlater display. In order to design the workflow efficiently while keeping both benefits from the originally different software, the key challenge is to streamline all the operations for typical users in maximizing their productivity. The proposed 912 Volume 10, Number 7, July 2015 Journal of Software SUMD consists of two parts, namely SketchUp and MMD operation, to seamlessly integrate the two operations without challenging user intervention. An integrated 3D modeling with animated characters has many appealing elements, such as beautiful backgrounds and rhythmical dancing. The majority of professionals like to share their finished models for their clients or even for public download. Our proposed SUMD workflow offers the capability for the professionals or even the novices a streamlined process to enrich the 3D scene object with blended user-defined animated characters. The SUMD workflow successfully demonstrates better manipulation capability in immersing of motion characters into static scene smoothly to enable more potential applications than current methods such as commonly used 3DMax software one. 2. 3D Modeling and Character Animation 3D Modeling tool plays a key role in many professional applications such as computer-aided interior design. The representative 3D modeling software, Google SketchUp [3], aims to conduct 3D scene construction from scratch with its rich functionalities. In spite of the fact that most of prior uses of SketchUp have been focused on 3D visualization only, it becomes more popular for AutoCAD users to design construction precisely under AutoCAD’s 2D setting and later render the results in 3D scene [4]. This method provides 3D visualization of real scenes easily from 2D drafting. Integrating Google Earth with SketchUp is another way to create photorealistic 3D construction by utilizing Google Earth photos. Streamlined structuring operation with geometry is what SketchUp emphasizes. It is another feature of SketchUp to make modeling operation easily for novices to learn. SketchUp defines digital lines to generate various surfaces which are combined with sharp, forms and objects. Fig. 1 exhibits the finished photorealistic 3D SketchUp model of an interior design layout. In spite of the rich 2D/3D architectural layout design features, SketchUp is not specially made for character animation purpose like other software such as 3DMax. As a matter of fact, the 3D modeling software is still difficult for average users to master the entire 3D scene construction process in which it is required to accommodate animated characters with the sole layout-based software packages in short amount of time. Fig. 1. 3D model construction (source: 3D Warehouse SketchUp website). MMD has been the free 3D animation software publicly available since 2010 [5]. Traditional way for rigging characters is to conduct skeleton bones and then rig the skeleton with character construction. Due to different models of characters, the skeleton only fits to its original models and it cannot reuse in other ones. Users may gather pose data together to develop motion data for animation. Users have to conduct the tedious process repeatedly until rigged character is completed. Fortunately, MMD improves the rigging 913 Volume 10, Number 7, July 2015 Journal of Software process effectively and increases augmented capability of character models by using PMDEditor. Another way for animating rigged characters is to utilize an external camera device such as Microsoft Kinectto convert real movements into motion data [6]. MMD can animate rigged characters easily by using Kinect plugin that supports motion data. The environment variation can be detected by using Kinect programs which can capture contrasting picture difference to develop motion data and integrate it into MMD for use. The rigged character named Miku Hatsune is an internal character that has been rigged MMD skeletons completely. Real people movements can be detected by using Kinect plugin and shown on upper right screen with a human icon. The rigged character can be animated automatically like the human icon does the same motion when the real person actives. It is instinctive for users to pose and check motions directly to develop MMD motion data. Most MMD uses have been focused on interactive animation by exploiting pedagogical practices for strong bodily-kinesthetic intelligence [7]. PMDEditor is the external software for MMD to rig skeletons with static characters and check construction information in detail. In order to provide an augmented reality look and feel for aesthetic appreciation, demand from professional users for a streamlined workflow is high with the explosive growth of user-generated content [8]. Since involving programs of any workflow more likely are provided by different software vendors that are intrinsically hard-to-integrate in terms of format interchangeability accompanied by the building block components, the most critical factor to the success of resulting product of workflow depends highly on the seamless integration between the heterogeneous programs. 3. The SUMD Workflow Fig. 2. SUMD workflow. According to the technology acceptance model (TAM) [9], perceived usefulness and perceived ease-of-use are the two united reasons for users to accept new technology. Perceived usefulness is defined as the degree to which a person believes that using a particular system would enhance his or her job performance. In this study, usefulness can be thought as the degree to which users believe that using the particular 3D modeling software would enhance the quality of performances and increase enjoyment levels. Likewise, perceived ease-of-use is defined as the degree to which a person believes that using a custom made system would result in less efforts. The professionals who are good at modifying function or modeling amazing artifacts can share their performances without infringing intellectual property rights. The finished models are very popular among users because novices almost lack experiences in actual drill. To make beginners learn more easily, the workflow could simplify process operation by exploiting finished models. Thus, the goal of our 914 Volume 10, Number 7, July 2015 Journal of Software proposed SUMD is to integrate SketchUp 3D construction with MMD animated characters in a streamlined fashion to perform productive operations for professionals. Although finished models are convenient for users, integrating different