Linux Usability Report Group #2-Lexi Shriner, Ben Witmer, Andy Boehme, Vince Osborne May 6, 2016

Executive Summary

Our group decided to test Linux in order to decide if Windows and Mac users could easily transition to Linux or if their preferences fit with Linux. We decided to test this by looking mostly at mental models in Windows and Mac implemented in Linux. We also briefly looked at what people use computers for and how they valued Linux, in order to see if they would prefer Linux, but are simply misinformed about the operating system.

We looked at the fundamental differences between Linux vs. Mac/Windows to select our tasks for testing. This included a few things such as location of the taskbar, interface, and the process of downloading files. We wanted to test things that became mental models to Mac and Windows users.

During testing, we saw that many users either couldn’t complete a task, struggled with a task, or completed the task inaccurately. Because of this, we knew that there were going to be mental models that Linux hadn’t implemented.

After analyzing our data, we noticed different reactions and data from Windows vs. Mac users. Windows users liked the system more and had faster data, while Mac users disliked the system more and had slower data. Because of this, we could easily calculate that between both the quantitative data and qualitative data, Windows users could transition more easily to Linux.

Introduction

Our intent of testing Linux platform was to test whether or not Linux has implemented enough mental Models from Windows and Mac for a user to easily transition to Linux. We also tested to see if our users would have a preference for Linux platforms over their current Windows or Mac platforms.

Testing

We chose these particular tasks based off the main differences between Linux and Windows/Mac. Some of the main differences that we used to base our choices off of were the location of the task bar, open sources, and default .

Test Plan Test Goals: Has Linux implemented the mental models of Windows or Mac, so that ​ Windows/Mac users could easily switch to Linux? Identified Issues: The Linux VirtualBox could crash and the user can still enter ​ Windows and can navigate in Windows Target audience: Students who use Mac or Windows. ​ Subgroup: College students not majoring in technology ​ Data collection: Timer, the amount of clicks they take, where they did not make any ​ progress, task completion pass/failure, use of shortcuts Location and equipment: Usability testing lab, two laptops (one recording and one for ​ the test subject), Linux VirtualBox, Morae recording soft ​ware

Tasks: 1. Open up the file explorer, then make a new Folder, and finally, make a file inside the folder. 2. Open an internet browser and download a font. 3. Open up the center and find GIMP

Pre-Test Questions and Purpose 1. Are you a mac or windows user? - Seeing which mental models the users have 2. How many hours do you use a computer per day? - How familiar the user is with a system 3. Do you use shortcuts? How often do you use them? - How advanced the user is 4. Have you heard of linux? If so, have you used Linux before? - Seeing if the user has any knowledge or mental models of Linux 5. What do you typically use a computer for on a day to day basis? - User’s typical uses for a computer 6. What is your preferred system? - The user’s preferred mental models 7. Do you own your own computer/laptop? - Find out more about user preference

Post-Test Questions (Rated on a scale of 1-5) 1. I believe the tasks I did went well. - How comfortable the user felt 2. I think I have a good grasp of the system. - How well mental models were used 3. I was able to navigate easily. - Discoverability and mental models 4. I used previous knowledge to help me understand this system. - Use of mental models 5. With more time, I think I could adapt easily to this system(Y/N?) - Similarities between Linux and the user’s preferred system 6. Something I liked about this system was: - Which aspects are similar or improved in Linux 7. Something I didn't like about this system was: - Aspects that were not implemented well into Linux 8. I think I would prefer this system over the one I use now, if I tried it more(Y/N?) - Did Linux afford the user to perform tasks efficiently 9. How much do you think Windows systems cost? Linux? - How the user sees the worth of each system

Mental Models implemented:

1. Process of creating files 2. Location of task bar 3. Process of downloading a file properly 4. Capability of Linux to download software from 5. Open source aspect of Linux and keyboard shortcuts 6. Ability to change interface of Linux

Findings

The results are based on four Windows users, two Mac users, and two participants that use both.

Full chart shown in Appendix A.

Task 3 Times [Appendix A] ​ This section of our findings displays the finishing times for all subjects on task #3. 75% of the subjects in this instance were outliers. Anything outside +/- 35% of the average time was considered an outlier. This shows that quantitative data for some aspects of our findings proved irrelevant.

Task 3 Clicks [Appendix A] ​ This section of our findings displays the number of total clicks for the tasks #2 & #3 for every subject. 87.5% of subjects were outliers for task #3. Outliers were found the same way as above, along with all tasks. This supports the fact that quantitative data in this instance was irrelevant.

Subject #7 Performance [Appendix A] ​ Test subject #7 seemed to perform the best, with having only 1 outlier. This outlier was very much below the average, meaning this subject finished the task in a minimal number of clicks. This particular subject prefers and uses Windows. This could support the fact that Linux implements Windows mental models.

Quantitative Results

For this test, both the number of clicks used to perform each task and the amount of time taken to execute the task were recorded. The results were then grouped based on whether the users use Windows, Mac, or both. Averages were then taken based on the results for each group, as seen in Tables 1.1 and 1.2.

Table 1.1 Table 1.2

Table 1.1 demonstrates that both Mac and Windows users performed each task, on average, with about the same number of steps for all tasks except Task 3. For Task 3, Mac users struggled more with completing the task, taking more steps in execution. Table 1.2 demonstrates that, again, both Mac and Windows users performed each task, on average, in the same amount of time, until Task 3. Mac users not only clicked more, but also had a longer finishing time for Task 3. This supports the fact that Linux implements Windows mental models, but not Mac.

Table 2.1 Table 2.2 Table 2.3

Tables 2.1 - 2.3 display the number of clicks for each task and demonstrate that there wasn’t much correlation between the data. Because of this, most of our results stem from qualitative data and not our quantitative data.

Qualitative Results

Reactions from User

“Is it a software?” -Test subject #4 (Finding GIMP)

The subject asked this when they were stuck on what to do on task #3. The subject wasn’t sure what they were looking for when we said Ubuntu software center, because Mac doesn’t have a “software center.”

“I don’t really know where the file explorer is.”- Test subject #8 (Make a file and a new document)

User attempted to use mental model to finish task, but couldn’t connect mental model to Linux

Multiple windows to GIMP

The test subject was trying to find GIMP and at a certain point decided to have two windows to possibly help him out.

The reaction of finding something about GIMP

The test subject believe their is a possibility that GIMP could be found in system settings. Thus the reaction he gave in the picture

Trying to find a font and downloading it

The test subject was trying to find a font through the preference and had the serach opened in firefox.

● Mostly windows users had higher ratings of Linux in terms of navigation and adaptability ● Many noted they did not like the aesthetics of Linux, but the interface is easily changed ● Windows users tended to have higher ratings on the post-test questions. ● Mac users had less consistent answers and typically rated Linux lower. ● Those that spend more time on computers performed better. ● 2 of 4 Mac users said it was hard to navigate, but those two only spend half as much time using a computer

Test subject #4 is a Linux user and prefers Windows. This subject had a fast completion time, and said they used their mental models to complete tasks. However, they noted differences in the cost of Windows and Linux, demonstrating that they noted a difference in quality of the two.

Test subject #2 has used Linux, but typically uses Windows. This subject also had a fast completion time, and said they used mental Models to complete tasks. This subject believes that Linux is easily adaptable, demonstrating that this subject believes Linux implements Windows/Mac mental models.

Test subject #1 has used Linux before, but is a Windows user. This subject failed to complete all tasks, but thinks Linux is easily adaptable. The subject noted a difference in the cost of Windows and Linux, demonstrating that they also note a difference in quality of the two.

User Errors

Some subjects were so used to their own operating systems that their mental models prevented accurate completion of some tasks. For example, Test Subject #6 downloaded GIMP through the Internet and not the Ubuntu Software Center, as you should in Linux. This was due to the fact that this is how Windows and Mac have a user download files and packages.

Test subject #1 spent a large amount time looking through administrative files trying to find the font he was trying to download. This is because in Windows, you must open the file, extract/save, and relocate the file. In Linux, all you have to do is extract when the pop-up opens.

Test subject #8 stated that he didn’t know where to look for the file explorer and began wandering around the taskbar. When prompted by the moderator as to what he would normally click in his preferred Windows system, he understood more what he was looking for.

Audience, Subgroups, and Personas

List of participants

This is a list of all of our subjects, along with their ages, genders, major, and preferred operating system. The characteristics that proved most relevant were major and prefered operating system.

Audience

The audience our group focused on were people who were Mac and Windows users looking at Linux to see it was a option for them. The audience would want to make sure there is not a huge learning curve with Linux. The main purpose of the test was to make sure the mental model of Windows and Mac were similar to Linux.

Subgroups

The four subgroups we discussed were 18-21 year olds, 22-27 year olds, 28-32 year olds, and 33-36 year olds. The sub group we tested was the 18 to 21 year olds.

Persona

We created a subject persona based on the characteristics our typical subject would have. We approached college students who used Mac or Windows to test for us. We preferred subjects who weren’t majoring in technology, so that they didn’t have as much in depth experience with Linux. We already know computer users value efficiency and easy navigation, which was part of what we needed to test.

Recommendations

Based off of our testing, there are a few changes Linux could make in order to create an easier transition to Linux from Windows or Mac. First, many users struggled with locating software. Linux could change this by moving the default location of the task bar to the bottom of the screen, like Windows does. Many Windows users have formed mental models of task bars at the bottom. Linux’s interface is already interchangeable, so the task bar could easily be moved back for those who already use Linux. Many Mac and Windows users tried to download through Internet Explorer, regardless of the fact that the task said to open the software center. Linux icons can be moved around on the taskbar easily already. Linux should make the default location of the software center towards the top, instead of close to the bottom, as it was during testing. The software center icon could also be redesigned and renamed so that users are more likely to know what it does beforehand. Many users moved the cursor over the icon but still did not click on it to download software. Perhaps renaming the software something along the lines of Linux as opposed to the Ubuntu Software Center, can increase easy identification, because Apple and Windows have the App store and The . Mac and Windows users have mental models of the software center names using the words app or store. Many games, etc., have walkthrough introductions for first time users. Perhaps Linux could implement something along these lines after logging in to Linux after download for the first time, considering Linux usually has to be downloaded and installed while MacOS and Windows are much more common.

Based on our data and analyzing, we have come to the conclusion that a transition to a Linux operating system would be easiest for a Windows user. Linux seems to use more mental models based off of Windows systems, considering that Windows users not only gave more praise to the system in post-test questioning, but also performed better. Windows users typically were within data range and performed more quickly, with fewer clicks. Meanwhile, Mac users tended to have higher completion times, along with more clicks for each task. Mac users typically had more critiquing comments towards Linux in post-test questioning.

Appendix A

Testing Results

This box shows our findings from our testing. The graph displays for each testing subject their clicks and task times, which were our units of measurement. Red boxes show outliers. Outliers were found by locating data outside the range of +/- 35% of the average. The number of outliers demonstrates little quantitative data. Because of this, the majority of our recommendations were based off our qualitative data.