APPLICATION OF ZOO AR PHOTO SERVICE WITH ANIMALS BASED ON AUGMENTED REALITY AND LEAP MOTION TECHNOLOGY Agil Julio1, Angga Setiyadi2 1,2 Teknik Informatika - Universitas Komputer Indonesia Jl. Dipatiukur 112-114 Bandung E-mail : [email protected], [email protected] ABSTRACT as Head of Health and Research in Bandung Zoo, that the Bandung Zoo has not provided many photo The purpose of this research is to describe the services with animals due to several factors. Different use of augmented reality and leap motion technology with Taman Safari II, which is located in Pasuruan, as a media to help and make it easy for visitors in East Java, which has many photo session services taking photos and interacting with animals in with animals and has been well organized. The reason Bandung zoo. The data that used in this research are that the Bandung Zoo does not provide many photo the data which was taken in Bandung zoo by giving services is one of the factors of the animal itself. questionnaries to visitors, doing interview with a zoo There are wild animals that cannot be approached by officer, observation, and literature studies to support children and group photos. These wild animals are the theory that can solve the problem. The problem dangerous if children try to interact directly. that arises in Bandung zoo is the difficulty of visitors Another thing that has made the unavailability for taking a picture with animals because there are of many photo services in Bandung Zoo is the wild animals and sick animals. Based on the problem, condition of sick animals. Diseased animals can make there is one of the solution to help and make it easy children unable to interact directly and take photos for visitors in taking photos and interacting with together. Diseased animals can endanger children animals in Bandung zoo is by apply Augmented because the exposure they cause may interfere with Reality and Leap Motion technology using the marker children's health problems as well. based on tracking method. Based on the results of the Based on the results of the questionnaire given questionnaire to visitors and interview with an to 30 respondents who were in Bandung Zoo, that officer, it can be concluded that the applications 73% of tourists knew of animals and 27% of tourists which had been built are in accordance with user did not know animals. As many as 67% of tourists needs such as this application can help an officer and like animals but cannot take pictures together because make it easy for visitors to take a picture and interact there are not many photo services together in with animals in Bandung Zoo. Bandung Zoo. The difficulty of tourists to be able to take pictures together with animals make tourists Keywords: Augmented Reality, Leap Motion, unable to get closer to the animals. And as much as Marker, Bandung Zoo, Photo Service 33% of tourists don't like animals because they are afraid and make these tourists increasingly unable to get to know animals more closely. 1. INTRODUCTION Based on the background that has been described, 1.1. Research Background the proposed application of photo services with Bandung Zoo is one of the flora and fauna animals in Bandung Zoo as an alternative for tourists, attractions that is located at zoo road number 6, Lebak especially children to get to know animals more Siliwangi, Coblong, Bandung and is located right closely. The proposed application is a photo-shaped beside the Bandung Institute of Technology Campus. application that uses augmented reality technology to Founded in 1930 by Bandung Zoological Park, display animals in real-time in three-dimensional Bandung zoo stands on a wavy topography with a forms [9]. Meanwhile, leap motion technology is used land area of nearly 14 ha. for interacting with animals [10]. This application is In Bandung Zoo, there are around 800 species made on a desktop basis. Therefore, it is proposed the of animals in total, consisting of classes of mammals, zoo AR photo service with animals based on aves, reptiles, and fish. This is what makes Bandung augmented reality and using leap motion technology. Zoo as an educational tour for tourists, especially for children to get to know the types of animals that exist 1.2. Purpose and Objectives and take photos as memorable moment. Photo The purpose of this research is to build an activity is an activity that is mostly carried out by application zoo AR photo service with animals based tourists, especially children. on augmented reality and leap motion technology. Based on observations and interviews While the objectives to be achieved from this research conducted in Bandung Zoo on October 15, 2018 are as follows: together with Mr. drh. Dedi Trisasongko who served 1. Providing photo services with animals in form of JSON messages. A Javascript client Bandung Zoo. library is provided to retrieve JSON messages and 2. Make it easy for tourists to interact and take present tracking data as ordinary Javascript photos with wild animals and sick animals in objects. Bandung Zoo. 3. Make it easy for tourists to get to know more 2.5. Discussion closely with animals in Bandung Zoo. Problem analysis is a step carried out to temporarily examine the causes of problems that 2. RESEARCH CONTENT occur in a research. The problem analysis in this 2.1. Augmented Reality research as follows: Augmented Reality (AR) is an environment 1. Bandung Zoo which has less than 800 species of that input 2D or 3D virtual objects into a real animals still does not provide many photo services environment. AR allows users to interact in real-time with animals. with the system. The use of AR today has expanded 2. It is difficult for tourists, especially children to to various aspects of our lives and projected to take pictures with animals because there are wild experience very significant developments. This is animals that cannot be approached directly and because the use of AR is very interesting and easy to cannot interact because there are sick animals that use for doing things, for example in marketing cannot be approached in Bandung Zoo. strategies and product introduction to consumers [16]. 3. The difficulty of tourists to carry out activities with several animals make tourists unable to get 2.2. Kind of Augmented Reality to know animals more closely in Bandung Zoo. Based on the marker, augmented reality is divided into two types, namely: 2.6. Architecture System 1. Marker-based Augmented Reality is a sign or identifier that will be identified or identified by the augmented reality device through the camera. This introduction and identification is used to add virtual objects to the real environment. 2. Markerless Augmented Reality is different from marker-based augmented reality, this markerless method does not require a sign or identifier to display virtual objects. Some types of markerless Figure 1. System Architecture augmented reality examples are face tracking, 3D This is a description of the system architecture that object tracking, motion tracking, and GPS based will be built: tracking. 1. Visitors determine what animal markers they want to display. There are 4 markers that can be 2.3. Leap Motion used, there are tigers, bears, eagles and elephants. Leap Motion (Hand Motion Tracking) is a 2. Markers are directed at the camera to display term for recording hand movements used as digital animals on a laptop or PC screen. models and it is an additional device that can be 3. The camera reads the marker and the animal will connected to a computer and can be used to replace appear on the screen. both mouse and keyboard functions. The function of 4. Visitors put hands on leap motion to interact with the tool called leap motion, can help users control or animals. replace the mouse and keyboard tasks on the 5. The officer presses the photo button for visitors to computer only with hand and finger movements [10]. take photos with animals. 6. The photo button will trigger capture and visitors 2.4. Inteface App Program of Leap Motion can see the results of the photo with the animal. Leap motion has an application program interface which is divided into two, namely: 2.7. Analysis of Augmented Reality 1. Native Application Interfaces are provided 2.7.1. Marker Based Tracking Method through dynamically loaded libraries. This library Making an augmented reality uses several provides a link between leap motion and provides methods, one of them is marker based tracking. By tracking data for the application that has created. default, markers do use a black frame with a pattern Libraries using C++ and Objective-C in the center of the frame, but in its development, the applications, or through one language binding are marker does not have to be black and white. The zoo provided for Java, C#, and Python. AR photo service with animals uses markers with 2. The WebSocket interface as a leap motion service colored concepts to bring up 3D objects. The that is run through WebSocket can be accessed computer will know the position of the marker and using domain localhost through port 6437. The make it into a virtual 3D form at the point (0, 0, 0) WebSocket interface provides tracking data in the and 3 axes namely X, Y, and Z. The marker will be recorded through the camera in realtime. Then the 2.9. Analysis of Leap Motion marker is used to recognize the object to be added. 2.9.1. Leap Motion Controller The added object will be processed using a computer This device has a large interaction space with and webcam which are displayed on the screen eight cubic feet, which takes an inverted pyramid through the introduction of a marker.