Menu designs for note-taking applications on tablet devices 著者（英） Atsushi Kitani year 2019 その他のタイトル タブレット端末で用いられるノートアプリケーショ ンのためのメニューデザイン 学位授与大学 筑波大学 (University of Tsukuba) 学位授与年度 2018 報告番号 12102甲第8918号 URL http://doi.org/10.15068/00156249 Menu designs for note-taking applications on tablet devices Atsushi Kitani 2018 筑 波 大 学 審 査 学 位 論 文（ 博 士 ） Doctoral Program in Systems Management and Business Law (Systems ManagementCourse) Graduate School of Business Sciences University of Tsukuba, Tokyo, ABSTRACT This research is a study on menu and palm rejection algorithm for note-taking applica- tions. The purpose of this research is to expand the choices of menus that can be used with note-taking applications and to propose practical palm rejection algorithm. This research proposes three approaches to achieve the purpose and to make closer to smooth note taking. The first approach is reconsideration of menu design. From the view point of note- taking, general linear menus on note-taking applications have drawbacks, one of which is the difficulty of rapid manipulation without occupying the writing space. To solve this issue, we developed an arc-shaped menu and compared the menu to general linear menus that were located on the left of the screen edge. As a result, the manipulation speed of our menu was faster than that of one of the linear menus that popped up on the left of the screen edge. In the second approach, we propose a palm rejection algorithm. Some existing palm rejection algorithms accidentally remove correct ink strokes. To reduce the frequency of removing correct ink strokes, we developed a palm rejection algorithm and, conducted an experiment that found that our algorithm had fewer occurrences of removing correctly drawn strokes than other applications. The last approach is, developing a menu invocation method. After conducting an experiment with regard to menu design, we noticed that menu invocation methods and invocation positions also have influence on smooth note-taking. In order to propose a novel menu invocation method, we applied our palm rejection algorithm to invoke context menus. Our invocation method invokes a context menu when the user lifts the writing hand from the screen. Then, we compared our invocation method with other invocation methods used in past research and existing applications, and evaluated which menu invocation methods are manipulated rapidly and where menus should appear. The results showed that when the menu position was set at the left edge of the screen, our menu invocation method was significantly faster than the bezel swipe and long press. CONTENTS Chapter.1 Introduction 1 1.1 Our viewpoint .................................. 1 1.1.1 Menu criteria for note-taking applications .............. 2 1.1.2 Menu design for note-taking applications .............. 2 1.1.3 Reducing the occurrence of removing correct ink strokes ...... 3 1.1.4 Approaches for menu invocation and invocation position ...... 4 1.2 Research questions ............................... 5 1.3 Purpose of this research ............................ 5 1.4 Structure of this research ........................... 6 Chapter.2 Related work 7 2.1 Introduction ................................... 7 2.2 Menu criteria for note-taking applications .................. 8 2.2.1 Purpose of handwriting ........................ 8 2.2.2 Difference in the screen size ...................... 9 2.2.3 Problems and drawbacks ....................... 10 2.3 Touch interactions ............................... 11 2.3.1 The transitions of user interfaces ................... 11 2.3.2 Active stylus and passive stylus .................... 11 2.3.3 Classification of touch interactions .................. 12 2.3.4 Variation of CTIs ............................ 12 2.3.5 Intended touches and unintended touches .............. 14 2.4 Menu invocation ................................ 15 2.4.1 STIs for menu invocation ....................... 15 2.4.2 CTIs for menu invocation ....................... 17 2.5 Menu selection ................................. 20 2.5.1 STIs for menu selection ........................ 20 i 2.5.2 CTIs for menu selection ........................ 25 2.6 Evaluation .................................... 26 2.7 Conclusion ................................... 28 Chapter.3 Arc menus for note-taking applications 29 3.1 Introduction ................................... 29 3.2 Related work .................................. 30 3.3 Arc menu .................................... 31 3.3.1 Prototype of the arc menu ....................... 31 3.3.2 Basic design of the arc menu ..................... 34 3.4 Experiment for the menu manipulation speed of different menu designs .. 35 3.4.1 Application and device for the experiment .............. 35 3.4.2 Menus for the experiment ....................... 36 3.4.3 Experimental design .......................... 36 3.4.4 Experimental procedure and method ................. 39 3.5 Result ...................................... 40 3.6 Discussion .................................... 41 3.6.1 Discussion of the results of the experiment .............. 41 3.6.2 Reflection on the experimental design ................ 41 3.7 Conclusion ................................... 43 Chapter.4 Toward the reduction of incorrect drawn ink retrieval 45 4.1 Introduction ................................... 45 4.2 Related work .................................. 47 4.2.1 Active stylus interaction ........................ 48 4.2.2 Multi-touch interaction ........................ 48 4.3 Algorithm .................................... 50 4.3.1 Touch distinction using the SVM model ............... 50 4.3.2 Touch protection using the dynamic occlusion area ......... 51 4.3.3 Collecting the dataset for the SVM .................. 51 4.3.4 Developing the SVM model ...................... 53 4.3.5 Implementation of occlusion area protection ............. 53 4.4 Evaluation .................................... 55 ii 4.4.1 Developing a note-taking application ................. 55 4.4.2 Experiment ............................... 55 4.4.3 Result .................................. 59 4.5 Discussion .................................... 61 4.5.1 Discussion on the number of occurrences of IDIR .......... 61 4.5.2 Discussion on the number of occurrences of FP ........... 61 4.5.3 Threats to validity ........................... 61 4.6 Conclusion ................................... 62 Chapter.5 Evaluation of menu manipulation using palm lift manipulation 63 5.1 Introduction ................................... 63 5.2 Related work .................................. 64 5.2.1 Menu invocation methods ....................... 64 5.2.2 Menu invocation position ....................... 65 5.2.3 Palm rejection ............................. 66 5.3 Palm lift manipulation ............................. 67 5.3.1 Menu invocation using PLM ..................... 67 5.3.2 Position of menu invocation using PLM ............... 69 5.3.3 Design of the PLM menu ....................... 70 5.4 Research approach ............................... 71 5.4.1 Device for the experiment ....................... 71 5.4.2 Experimental design .......................... 72 5.4.3 Application development ....................... 76 5.4.4 Classification of erroneous manipulation ............... 78 5.4.5 Preliminary experiment ........................ 79 5.4.6 Comparison of menu invocation methods and menu display positions 82 5.5 Result ...................................... 83 5.5.1 Menu invocation methods at the left edge of the screen ...... 83 5.5.2 Menu invocation method at the stylus nib .............. 84 5.5.3 Menu display position using PLI ................... 85 5.6 Discussion .................................... 85 5.6.1 Discussion of the menu invocation method at left edge of the screen 86 5.6.2 Discussion of menu invocation method at the stylus nib ...... 88 iii 5.6.3 Discussion of the menu display position using PLI ......... 89 5.6.4 Internal validity of the experiment .................. 89 5.6.5 External validity of the experiment .................. 90 5.7 Conclusion ................................... 91 Chapter.6 Conclusion and future work 93 6.1 Arc menu for note-taking applications .................... 93 6.2 Toward the reduction of incorrectly drawn ink retrieval ........... 93 6.3 Evaluation of menu manipulation using palm lift manipulation ...... 94 6.4 Contribution of this research ......................... 94 iv LIST of FIGURE 1.1 Image of the research coverage and corresponding chapters ........ 5 2.1 Context menu of Bamboo Paper [1] ...................... 16 2.2 The image of STIs with the corresponding basic writing actions and con- flicting part in characters ........................... 17 2.3 The image of STIs with the corresponding basic manipulations ...... 18 2.4 Multi-touch marking menu [2] ......................... 19 2.5 Making a selection with HandMark-Finger [3] ................ 19 2.6 Pie menu [4] ................................... 21 2.7 Occlusion-aware menu[5] ............................ 22 2.8 Tracking menu [6] ............................... 23 2.9 Marking menu [7] ................................ 23 2.10 Flower menu [8] ................................. 24 2.11 Uni-manual multi-finger pie menu [9] ..................... 25 3.1 Image for the subjects to draw ........................ 32 3.2 Prototype of the arc menu ........................... 33 3.3 The two-column linear menu ......................... 33 3.4 Image of the arc menu ............................. 35 3.5 Image of the PopupLM and