Linux Usability Report Group #2-Lexi Shriner, Ben Witmer, Andy Boehme, Vince Osborne May 6, 2016
Total Page：16
File Type：pdf, Size：1020Kb
Linux Usability Report Group #2-Lexi Shriner, Ben Witmer, Andy Boehme, Vince Osborne May 6, 2016 Executive Summary Our group decided to test Linux in order to decide if Windows and Mac users could easily transition to Linux or if their preferences fit with Linux. We decided to test this by looking mostly at mental models in Windows and Mac implemented in Linux. We also briefly looked at what people use computers for and how they valued Linux, in order to see if they would prefer Linux, but are simply misinformed about the operating system. We looked at the fundamental differences between Linux vs. Mac/Windows to select our tasks for testing. This included a few things such as location of the taskbar, interface, and the process of downloading files. We wanted to test things that became mental models to Mac and Windows users. During testing, we saw that many users either couldn’t complete a task, struggled with a task, or completed the task inaccurately. Because of this, we knew that there were going to be mental models that Linux hadn’t implemented. After analyzing our data, we noticed different reactions and data from Windows vs. Mac users. Windows users liked the system more and had faster data, while Mac users disliked the system more and had slower data. Because of this, we could easily calculate that between both the quantitative data and qualitative data, Windows users could transition more easily to Linux. Introduction Our intent of testing Linux platform Ubuntu was to test whether or not Linux has implemented enough mental Models from Windows and Mac for a user to easily transition to Linux. We also tested to see if our users would have a preference for Linux platforms over their current Windows or Mac platforms. Testing We chose these particular tasks based off the main differences between Linux and Windows/Mac. Some of the main differences that we used to base our choices off of were the location of the task bar, open sources, and default softwares. Test Plan Test Goals: Has Linux implemented the mental models of Windows or Mac, so that Windows/Mac users could easily switch to Linux? Identified Issues: The Linux VirtualBox could crash and the user can still enter Windows and can navigate in Windows Target audience: Students who use Mac or Windows. Subgroup: College students not majoring in technology Data collection: Timer, the amount of clicks they take, where they did not make any progress, task completion pass/failure, use of shortcuts Location and equipment: Usability testing lab, two laptops (one recording and one for the test subject), Linux VirtualBox, Morae recording soft ware Tasks: 1. Open up the file explorer, then make a new Folder, and finally, make a file inside the folder. 2. Open an internet browser and download a font. 3. Open up the software center and find GIMP Pre-Test Questions and Purpose 1. Are you a mac or windows user? - Seeing which mental models the users have 2. How many hours do you use a computer per day? - How familiar the user is with a system 3. Do you use shortcuts? How often do you use them? - How advanced the user is 4. Have you heard of linux? If so, have you used Linux before? - Seeing if the user has any knowledge or mental models of Linux 5. What do you typically use a computer for on a day to day basis? - User’s typical uses for a computer 6. What is your preferred system? - The user’s preferred mental models 7. Do you own your own computer/laptop? - Find out more about user preference Post-Test Questions (Rated on a scale of 1-5) 1. I believe the tasks I did went well. - How comfortable the user felt 2. I think I have a good grasp of the system. - How well mental models were used 3. I was able to navigate easily. - Discoverability and mental models 4. I used previous knowledge to help me understand this system. - Use of mental models 5. With more time, I think I could adapt easily to this system(Y/N?) - Similarities between Linux and the user’s preferred system 6. Something I liked about this system was: - Which aspects are similar or improved in Linux 7. Something I didn't like about this system was: - Aspects that were not implemented well into Linux 8. I think I would prefer this system over the one I use now, if I tried it more(Y/N?) - Did Linux afford the user to perform tasks efficiently 9. How much do you think Windows systems cost? Linux? - How the user sees the worth of each system Mental Models implemented: 1. Process of creating files 2. Location of task bar 3. Process of downloading a file properly 4. Capability of Linux to download software from Ubuntu software center 5. Open source aspect of Linux and keyboard shortcuts 6. Ability to change interface of Linux Findings The results are based on four Windows users, two Mac users, and two participants that use both. Full chart shown in Appendix A. Task 3 Times [Appendix A] This section of our findings displays the finishing times for all subjects on task #3. 75% of the subjects in this instance were outliers. Anything outside +/- 35% of the average time was considered an outlier. This shows that quantitative data for some aspects of our findings proved irrelevant. Task 3 Clicks [Appendix A] This section of our findings displays the number of total clicks for the tasks #2 & #3 for every subject. 87.5% of subjects were outliers for task #3. Outliers were found the same way as above, along with all tasks. This supports the fact that quantitative data in this instance was irrelevant. Subject #7 Performance [Appendix A] Test subject #7 seemed to perform the best, with having only 1 outlier. This outlier was very much below the average, meaning this subject finished the task in a minimal number of clicks. This particular subject prefers and uses Windows. This could support the fact that Linux implements Windows mental models. Quantitative Results For this test, both the number of clicks used to perform each task and the amount of time taken to execute the task were recorded. The results were then grouped based on whether the users use Windows, Mac, or both. Averages were then taken based on the results for each group, as seen in Tables 1.1 and 1.2. Table 1.1 Table 1.2 Table 1.1 demonstrates that both Mac and Windows users performed each task, on average, with about the same number of steps for all tasks except Task 3. For Task 3, Mac users struggled more with completing the task, taking more steps in execution. Table 1.2 demonstrates that, again, both Mac and Windows users performed each task, on average, in the same amount of time, until Task 3. Mac users not only clicked more, but also had a longer finishing time for Task 3. This supports the fact that Linux implements Windows mental models, but not Mac. Table 2.1 Table 2.2 Table 2.3 Tables 2.1 - 2.3 display the number of clicks for each task and demonstrate that there wasn’t much correlation between the data. Because of this, most of our results stem from qualitative data and not our quantitative data. Qualitative Results Reactions from User “Is it a software?” -Test subject #4 (Finding GIMP) The subject asked this when they were stuck on what to do on task #3. The subject wasn’t sure what they were looking for when we said Ubuntu software center, because Mac doesn’t have a “software center.” “I don’t really know where the file explorer is.”- Test subject #8 (Make a file and a new document) User attempted to use mental model to finish task, but couldn’t connect mental model to Linux Multiple windows to GIMP The test subject was trying to find GIMP and at a certain point decided to have two windows to possibly help him out. The reaction of finding something about GIMP The test subject believe their is a possibility that GIMP could be found in system settings. Thus the reaction he gave in the picture Trying to find a font and downloading it The test subject was trying to find a font through the preference and had the serach opened in firefox. ● Mostly windows users had higher ratings of Linux in terms of navigation and adaptability ● Many noted they did not like the aesthetics of Linux, but the interface is easily changed ● Windows users tended to have higher ratings on the post-test questions. ● Mac users had less consistent answers and typically rated Linux lower. ● Those that spend more time on computers performed better. ● 2 of 4 Mac users said it was hard to navigate, but those two only spend half as much time using a computer Test subject #4 is a Linux user and prefers Windows. This subject had a fast completion time, and said they used their mental models to complete tasks. However, they noted differences in the cost of Windows and Linux, demonstrating that they noted a difference in quality of the two. Test subject #2 has used Linux, but typically uses Windows. This subject also had a fast completion time, and said they used mental Models to complete tasks. This subject believes that Linux is easily adaptable, demonstrating that this subject believes Linux implements Windows/Mac mental models. Test subject #1 has used Linux before, but is a Windows user.