FMCode: A 3D In-the-Air Finger Motion Based User Login Framework for Gesture Interface Duo Lu Dijiang Huang Arizona State University Arizona State University
[email protected] [email protected] Abstract—Applications using gesture-based human-computer (e.g., Oculus Rift and Vive) and wearable devices rely on interface require a new user login method with gestures because the connected desktop computer or smartphone to complete it does not have traditional input method to type a password. the login procedure using either passwords or biometrics, However, due to various challenges, existing gesture based au- thentication systems are generally considered too weak to be which is inconvenient. A few standalone VR headsets (e.g., useful in practice. In this paper, we propose a unified user Microsoft Hololens [4]) present a virtual keyboard in the air login framework using 3D in-air-handwriting, called FMCode. and ask the user to type a password. However, it is slow We define new types of features critical to distinguish legitimate and user unfriendly due to the lack of key stroke feedback users from attackers and utilize Support Vector Machine (SVM) and a limited recognition accuracy of the key type action for user authentication. The features and data-driven models are specially designed to accommodate minor behavior variations in-the-air. Moreover, passwords have their own drawbacks that existing gesture authentication methods neglect. In addition, due to the trade-off between the memory difficulty and the we use deep neural network approaches to efficiently identify password strength requirement. Biometrics employ the infor- the user based on his or her in-air-handwriting, which avoids mation strongly linked to the person, which cannot be revoked expansive account database search methods employed by existing upon leakage and may raise privacy concerns in online login.