An Assessment of the Ergonomic Quality of a Mobile Cinema App with Novice and Expert Users
Total Page:16
File Type:pdf, Size:1020Kb
International Journal of Advanced Science and Technology Vol. 29, No. 8, (2020), pp. 172-179 An Assessment of the Ergonomic Quality of a Mobile Cinema App with Novice and Expert Users Azham Hussain1*, Emmanuel O.C. Mkpojiogu1,2, Yuneswari Muniandy1, Nur Fairuza Syahira Roslan1, Marrium Aslam1 1School of Computing, Universiti Utara Malaysia, 06010 UUM, Sintok, Malaysia 2Department of Computer and Information Technology, Veritas University, Abuja, Nigeria 1*[email protected] Abstract Golden Screen Cinemas Sdn Bhd formerly known as GSC or GSC Cinemas is one of the major cinema chains in Malaysia. It provides an online ticketing system where customers are able to purchase movie tickets through mobile app. This study was geared towards testing the ergonomics of the GSC Cinemas app. Twenty respondents were chosen to participate in the evaluation. The results show poor ergonomic quality of the app. The app was inefficient and users were not satisfied with the layout of information presented. Furthermore, users found some difficulty when using the app for the first time. The participants were also not satisfied with some of the features and suggested numerous improvements. Recommendations were made in order to improve on the ergonomics of the GSC Cinemas app. The findings reveal several findings and feedbacks that require improvements on the design of the app. Keywords: Ergonomic evaluation, mobile cinema app, users’ perception 1. Introduction Golden Screen Cinemas Sdn Bhd formerly known as GSC or GSC Cinemas is the largest cinema holdings in Malaysia. The biggest cinema is located at Mid Valley Megamall. It houses 21 screen cinemas and has 2763 seats which is the largest in Malaysia. GSC was the first cinema operator in Malaysia to feature ground-breaking audio surround technology, Dolby Atmos, which provides movie buffs a great sound and movie experience. The first ever Dolby Atmos hall was launched in 2013 and is currently available in more than 20 GSC locations. GSC launched the country’s first D-BOX motion seats, offering perfectly synchronized motions with movie scenes at GSC 1 Utama in 2014. The feature has since been extended to over 12 cinemas nationwide. In 2017, GSC also introduced the world’s leading 4D cinematic technology, 4DX in GSC Paradigm JB. Developed by South Korea’s CJ 4DPLEX, 4DX brings the movies to life with over 20 signature effects delivered through vibration and motion-activated seats, as well as environmental effects like wind, fog, rain, lightning, and scents, all of which work together cohesively to deliver a multi-sensory experience. Today, 4DX is available in GSC 1 Utama Shopping Centre and GSC IOI City Mall, Putrajaya, and will soon be available in GSC Southkey, Johor Bahru. Recently, GSC launched GSC Mobile App on two main platforms. That is on Android and iOS. The GSC Mobile App is also now available on the App Store and Google Play Store. The purpose of the Apps is to provide convenience at user’s fingertips as it brings the GSC movie listings with real-time show-times and the option to select seats and purchase movie tickets through the user’s mobile phone. UUM students were used to conduct an onsite evaluation using smartphones on either of the 2 platforms with the latest version of GSC App. The evaluation procedures include the following: introducing the group members and their background, explaining the system and what it is used for, giving the users the smartphone to execute the list of tasks with emphasis on the fact that the testing is on the application and not on the user, giving the users the questionnaire to complete and then collect back. While the evaluation lasts, the study was able to capture each participant’s navigational choices, task completion rates, comments, overall ISSN: 2005-4238 IJAST 172 Copyright ⓒ 2020 SERSC International Journal of Advanced Science and Technology Vol. 29, No. 8, (2020), pp. 172-179 satisfaction ratings, questions and feedback. Ergonomics defines the comfort with which users of a product interact with the product in such a way that such interaction is without pain [19][22]. 2. Methodology Twenty participants were recruited for the study. All participants were students from the Universiti Utara Malaysia (UUM) Sintok Campus. The participants were engaged at the Versity Mall, UUM Campus, to interact with the app following a set of tasks. After interacting with the app, they were given a questionnaire to fill. The questionnaire assesses their perception about the ergonomics of the mobile app’s design. The evaluation was done between the 22nd to the 28th of July, 2019. Of the 20 participants, 80% were female while the remaining 20% were male. Their age ranges are as follows: 75% were aged 28 and below, 20% were aged 29 to 35 while 5% were aged 36 and above. Ten (10) novice and 10 expert users were used for the evaluation. Six tasks were given to participants to carry out. The participants were advised to choose without registration (as a guest) and select desired cinema location as Alor Setar– Aman Central. The tasks are as follows: i. select cinema, ii. select date, movie, time and payment, iii. Set profile, iv. select ticket and e-combo, v. select seat, and vi. make payment. Task 1: Select cinema: Participants were required to choose from a list the cinema location for the movie they want. The steps include: start application> click the toggle left > Cinemas> choose the cinema> click to buy. Task 2: Select date, movie, time, and payment: Participants were required to select the date and time payment method for their desired movie. Task 3: Set profile: Participants were required to fill out their name, email, mobile numbers and I/C or passport numbers for profile setting. There are three available ways to setup profile. It could be as Login for participants with existing login credential, or by creating a new account or by setup as a guest. Step begins after clicking ‘Next’ in task 2. Task 4: Select ticket and e-combo: Participants were required to select ticket based on the class of the customer: adult, children, OKU, senior citizen, student, and twin and also select e-combo (for snacks). Step begins after clicking ‘Next’ in task 3. Task 5: Select seat: Participants were required to choose their desired seat location for the movie. Step begins after clicking ‘Next’ in task 4. Task 6: Make payment: Participants were required to make payment for the chosen movies according to seat and e-combo selection [1][4][5][8][11][12][17][18][21]. 3. Results Task Completion Success Rate: all participants successfully completed task 1 (select cinema), task 2 (select date, movie, time, and payment) and task 4 (select ticket and e-combo). Besides, task 3 (profile setting) was successfully achieved by 65% of participants. In task 5 (select seat) 83% of participants were successful. However, in task 6 (make payment) only 25% of participants achieved success. The overall GSC Cinemas app’s effectiveness was 50%. This shows that from the users’ perspective, the application enables them to achieve their goals successfully (by 50% rate on the average). In task 3, both novice and experts where faced with some difficulties in editing email addresses in the profile setting and this issue had impact on task 5 and task 6. Some participants proceeded without profile setting. Not all participants completed task 5 (select seat) due to the issues they had with task 3 (profile setting). However, some participants managed to complete and proceed to task 6. Task 6 had the lowest achievement rate because the inconsistency in the app made feel insecure and uncomfortable making payment [2][3][6][7][15][16] [24]. Time on Task: Some tasks were more complicated than others, thus causing delay in carrying out tasks. This reflected on the average time on task. In task 1, participants were to select date, movie, time, and payment. The mean time on task was 153 seconds. Overall, completion times ranged from 60 (approximately 1 minute) to 300 seconds (approximately 5 minutes). Task 2 required participants to select cinema. The average time on task was 336 seconds. Overall, completion times ranged from 60 ISSN: 2005-4238 IJAST 173 Copyright ⓒ 2020 SERSC International Journal of Advanced Science and Technology Vol. 29, No. 8, (2020), pp. 172-179 (approximately 1 minute) to 780 seconds (approximately 13 minutes). Task 3 required participants to set profile and the average time on task was 225 seconds. Overall, completion times ranged from 120 (approximately 2 minutes) to 360 seconds (approximately 6 minutes). In task 4 it is compulsory for participants to select ticket and e-combo. The average time on task was 144 seconds. Overall, the completion times ranged from 60 (approximately 1 minutes) to 300 seconds (approximately 5 minutes). Task 5 was also compulsory for participants as each must select seat. The mean time on this task was 207 seconds. Overall, the completion times ranged from 120 (approximately 2 minutes) to 420 seconds (more than 5 minutes). Task 6 required participants to make payment. The average time on this task was 402 seconds. Overall, the completion times ranged from 180 (approximately 3 minutes) to 1140 seconds (more than 15 minutes) [9][10][13][14][23]. Table 1 shows the time on tasks. Task (Seconds) Participants Experience 1 2 3 4 5 6 User 1 Novice 120 540 300 180 120 420 User 2 Expert 60 180 120 120 240 180 User 3 Expert 60 300 180 120 120 300 User 4 Expert 120 120 180 60 240 180 User 5 Novice 180 60 300 180 60 480 User 6 Novice 120 660 180 240 300 300 User 7 Expert 120 540 120 120 120 360 User 8 Novice 240 480 180 60 120 540 User 9 Novice 180 780 360 300 420 1140 User 10 Expert 60 300 120 60 300 180 User 11 Expert 180 120 120 60 180 180 User 12 Novice 240 60 360 120 240 420 User 13 Novice 300 240 360 60 300 360 User 14 Novice 180 540 360 240 180 480 User 15 Expert 180 300 120 60 120 360 User 16 Novice 120 300 300 180 300 540 User 17 Expert 180 480 300 180 300 540 User 18 Expert 180 540 120 120 180 420 User 19 Expert 120 120 120 240 180 360 User 20 Novice 120 60 300 180 120 300 TABLE 1.