Imdb.Com Usability Test Kit HCDE 417 Fall 2016
Total Page:16
File Type:pdf, Size:1020Kb
IMDb.com Usability Test Kit HCDE 417 Fall 2016 Group 4 Andy Truong Karin Vaughan Lydia Davison Monica Lee November 8th, 2016 Introduction Our group plans on investigating IMDb, short for Internet Movie Database. IMDb is an online database that provides a myriad of information for entertainment such as movies, TV shows, and celebrities. IMDb provides information on ratings, plot summaries, and reviews. IMDb can be accessed online or through their mobile app. Purpose IMDb can help users find a movie they may be interested in watching. Our objective is to study and improve the usability of navigation and make the information architecture and categorization clear and consistent to create a logical and efficient flow through the website. For the purposes of this study, we will be testing the usability of the website through the desktop version of IMDb. Table of Contents Pre-Screening Background Questionnaire 2 Consent Form 6 Introductory Script 7 Study Script 8 Pre-Test Questionnaire 10 Task Scenarios 12 Post-Task Questionnaires 14 Post-Test Questionnaire 15 Data-Logging Forms 17 1 Pre-Screening Background Questionnaire [Note: The survey will be executed using Google Forms and Facebook.] Title for Facebook post: Enter for a chance to win a $20 Amazon gift card! We need your help understanding movie watching habits. We are a team of students at the University of Washington seeking participants for a usability study on movie watching habits. If you are interested in helping us, please fill out this short screening survey below. Respondents will be contacted based on their compatibility with the study’s intended user group. Please note that this study is for educational purposes only, and participation is voluntary. You must be over 18 years old. The study will take place at the University of Washington Seattle campus and will require a commitment of approximately one hour. Refreshments will be provided and you will be entered into a drawing to win a $20 Amazon gift card. Video and audio will be recorded during the test session. All personal information will remain confidential. 1. Please provide us with your name and contact information. We will contact you by email if you are selected to participate in our study. Name: Email: Phone (optional): 2. Preferred gender: ___ Female ___ Male ___ Prefer not to answer 3. Age: ___ 18-24 ___ 25-34 ___ 35-44 ___ 45-54 ___ 55-64 ___ 65-74 ___ 75+ 2 4. Have you ever gone online to look up information about movies, TV shows, or actors? ___ Yes ___ No a. If Yes: i. How often do you use a laptop or desktop computer? ___ Daily ___ Once a week (a few times a month) ___ Once a month ___ A few times a year ___ Never or N/A ii. How often do you use the following sites? Please rate each site from 0-4. (0 is never and 4 is very frequently). ___ Wikipedia ___ Fandango ___ IMDb ___ Online Newspaper ___ Rotten Tomatoes ___ Other (please specify): ___________________ iii. Do you contribute content about movies, TV shows, actors, or entertainment to the following sites? ___ Wikipedia ___ Fandango ___ IMDb ___ Online Newspaper ___ Rotten Tomatoes ___ Other (please specify): ___________________ b. If No: i. Are there information sources, other than online, that you use to look up information about movies, TV shows, or actors? ___ Yes ___ No 1. If yes, please explain below: 3 a. How often do you use these sources? ___ Daily ___ Once a week (a few times a month) ___ Once a month ___ A few times a year ___ Never or N/A b. How often do you use a laptop or desktop computer? ___ Daily ___ Once a week (a few times a month) ___ Once a month ___ A few times a year ___ Never or N/A 5. Please indicate which days and times you’re available (drop down calendar) ___ Tuesday 11/15/16, 9:00am ___ Tuesday 11/15/16, 10:00am ___ Tuesday 11/15/16, 11:00am ___ Tuesday 11/15/16, 12:00pm ___ Tuesday 11/15/16, 1:00pm ___ Tuesday 11/15/16, 2:00pm ___ Tuesday 11/15/16, 4:00pm ___ Tuesday 11/15/16, 5:00pm ___ Tuesday 11/15/16, 6:00pm ___ Wednesday 11/16/16, 5:00pm ___ Wednesday 11/16/16, 6:00pm ___ Thursday 11/17/16, 9:00am ___ Thursday 11/17/16, 10:00am ___ Thursday 11/17/16, 11:00am ___ Thursday 11/17/16, 12:00pm ___ Thursday 11/17/16, 1:00pm ___ Friday 11/18/16, 12:00pm ___ Friday 11/18/16, 1:00pm ___ Friday 11/18/16, 2:00pm ___ Friday 11/18/16, 3:00pm ___ Saturday 11/19/16, 9:00am ___ Saturday 11/19/16, 10:00am ___ Saturday 11/19/16, 11:00am ___ Saturday 11/19/16, 12:00pm ___ Saturday 11/19/16, 1:00pm ___ Saturday 11/19/16, 2:00pm ___ Saturday 11/19/16, 3:00pm ___ Saturday 11/19/16, 4:00pm 4 ___ Saturday 11/19/16, 5:00pm Termination Script: Thank you for taking the time to complete our survey. We appreciate your willingness to participate in our usability sessions. If you meet our participant criteria, we will contact you within the next 72 hours to confirm the time for your usability session. Best UW Students 5 Consent Form I agree to participate in the study conducted by the IMDb.com Usability Test Group at the University of Washington, Human Centered Design and Engineering Department. During this study: ● I will be asked to perform certain tasks on a computer ● I will be interviewed regarding the tasks I’ve performed ● I will be recorded through audio and video during the session I understand and consent to the use and release of the recording by IMDb.com Usability Test Group at the University of Washington, Human Centered Design and Engineering Department. I understand that the information and recording is for research purposes only and that my name and image will not be used for any other purpose. I relinquish any rights to the recording used by IMDb.com Usability Test Group at the University of Washington, Human Centered Design and Engineering Department without further permission. Participation in this usability study is voluntary. All information and recordings will remain strictly confidential. The descriptions and findings may be used to help improve the IMDb.com website design. At no time will my name or any other identification be used. I have the ability to withdraw consent to the experiment and stop participation at any time. Below is my signature indicating that I have read and understood the information on this form and that any questions I might have about the session have been answered. Date: _________ Participant’s printed name: _________________________________________________ Participant’s signature : ____________________________________________________ Thank you! We appreciate your participation. 6 Introductory Script [Before reading Introductory Script] ❏ Welcome participant to testing area ❏ Have IMDb.com opened in a Google Chrome window on the laptop ❏ Clear browsing data Start time: ___________ “Thank you for taking time to participate in this study, we really appreciate it. I’m <name> and this is <name>. We are students in the Human Centered Design and Engineering (HCDE) major at the University of Washington. <name> will be just be taking notes today and I will be facilitating the study. We are studying the usability of the IMDb website. IMDb is a popular online movie database to find more information about movies and TV. During this study, we will ask you to complete 3 tasks on the website. You may take a break at any time. Please remember that we are testing the site, not you. Any difficulties you may have are because it wasn’t designed in a way that makes sense to you. During the tasks, I can clarify what you are asked to do, but otherwise will remain silent. Try to complete the tasks as if you were at home. You can spend as little or as much time you want on each of them. Again, we are not testing you, we are testing the site. Also, as we go along the tasks, I'm going to ask you to think out loud as much as possible. By that, we mean that we’d like you to speak your thoughts as often as you can so that we know what’s going through your mind. If it’s okay with you, we will be taking screen, audio, and video recordings for a better understanding of behavior on the website. Please take a look at this consent form and sign if you agree with the conditions.” ❏ Give participant the consent/video form to sign ❏ Once signed, start up Lookback and Skype on the laptop ❏ Connect with the note-taker’s laptop and set up Skype’s screen-sharing Before we begin, do you have any questions? 7 Study Script [Before reading Task Scenarios] ❏ Read Introductory Script ❏ Read Think Aloud Warmup Script Okay, now we can get you started on this laptop here. On the laptop screen, you will see the homepage of the IMDb website. ❏ See table below for each participant’s task order Participant Task Order P1 - new user 1, 2, 3, 4 P2 - new user 2, 1, 3, 4 P3 - infrequent user 1, 2, 3, 4 P4 - infrequent user 2, 1, 3, 4 P5 - somewhat infrequent user 1, 2, 3, 4 P6 - somewhat infrequent user 2, 1, 3, 4 Now, take a few moments to observe the IMDb homepage.