Sensorsnaps: Integrating Wireless Sensor Nodes Into Fabric Snap Fasteners for Textile Interfaces. Proc of UIST'19
Total Page:16
File Type:pdf, Size:1020Kb
SensorSnaps: Integrating Wireless Sensor Nodes into Fabric Snap Fasteners for Textile Interfaces Artem Dementyev Tomás Vega Gálvez Alex Olwal MIT Media Lab MIT Media Lab Google Inc. Cambridge, MA Cambridge, MA Mountain View, CA [email protected] [email protected] [email protected] ABSTRACT Adding electronics to textiles can be time-consuming and A B requires technical expertise. We introduce SensorSnaps, low- power wireless sensor nodes that seamlessly integrate into caps of fabric snap fasteners. SensorSnaps provide a new technique to quickly and intuitively augment any location on the clothing with sensing capabilities. SensorSnaps securely attach and detach from ubiquitous commercial snap fasteners. Using inertial measurement units, the SensorSnaps detect tap and rotation gestures, as well as track body motion. We optimized the power consumption for SensorSnaps to work continuously for 45 minutes and up to 4 hours in capacitive touch standby mode. We present applications in which the SensorSnaps are used as gestural interfaces for a music player controller, cursor control, and motion tracking suit. The user study showed that SensorSnap could be attached in around 71 seconds, similar C D to attaching off-the-shelf snaps, and participants found the gestures easy to learn and perform. SensorSnaps could allow anyone to effortlessly add sophisticated sensing capacities to ubiquitous snap fasteners. Author Keywords Wireless sensor nodes, wearables, textile interfaces, ubiquitous computing, low-power CCS Concepts Human-centered computing -> Interaction devices; Interac- • tion techniques; User interface design Figure 1. SensorSnaps embed miniaturized electronics into generic snap fasteners, making it possible to augment garments with wireless elec- INTRODUCTION tronics that enable on-device gesture recognition, wireless connectivity, motion tracking with sensor fusion, and touch sensing. A) SensorSnaps Recent advances in materials and electronics have inspired replace buttons on a shirt. B) SensorSnaps are used as cufflinks. C) The a surge in the development of more seamless and ubiquitous exploded CAD model of a SensorSnap. The electronics and the battery wearable devices. In particular, the potential for integrating are contained inside the case. D) Integration with off-the-shelf plastic electronics and wearable interfaces into clothing has been snap fasteners (in yellow). shown to be particularly promising. It is, however, challeng- ing to augment clothing with electronics, given that we need to consider the whole lifetime of a garment, which includes manufacturing constraints, end-user customization, and main- Recent projects [29, 31] have contributed yarn-level innova- tenance. tions for integration at the manufacturing stage that are com- patible with existing textile processes. These projects have Permission to make digital or hard copies of all or part of this work for personal or the potential to enable interactive textiles with predefined ca- classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation pabilities in the garments at scale. The academic and maker on the first page. Copyrights for components of this work owned by others than ACM communities complemented these efforts by leveraging tra- must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a ditional craft techniques for customization and modifications fee. Request permissions from [email protected]. of existing textiles [37, 2, 28, 29]. These projects tend to UIST’19, October 20–23, 2019, New Orleans, LA, USA integrate electronics through sewn connections, where adding © 2019 ACM. ISBN 978-1-4503-6816-2/19/10. $15.00 and removing functionality may require time and specialized DOI: http://dx.doi.org/10.1145/3332165.3347913 skills. Unfortunately, most electronic textiles also result in Qualitative user evaluation that assesses the potential of stiff areas due to the need to accommodate rigid components. • our prototypes and interactions. We observe that many garments consistently employ small, Low-power firmware that uses IMU data to detect gestures, rigid parts for both functional and decorative purposes, such as • such as tapping and rotation. The SensorSnaps have a con- buttons or fasteners in places where the fabric should support tinuous battery life of 45 minutes or 4 hours in capacitive reconfigurability, for opening, closing, folding, or changing its touch standby mode. length. SensorSnaps leverage advances in miniaturized elec- tronics to augment such buttons with interactive capabilities without manufacturing dependencies. We specifically focus on RELATED WORK one button category, snap fasteners, as they are widely avail- In this section, we review related work relevant to SensorSnaps. able and allow integration into clothing with limited knowl- We are not familiar with any work that directly integrates edge and tools. They also provide minimal constraints for electronics into snap fasteners. Most of the research looks into attachment and removal, which is beneficial for flexibility in integrating electronics into the fabrics. Metal snap fasteners customization and maintenance. have, however, been used in smart fabrics as connectors from conductive fabric to circuit boards [5, 48] or as antennas [8], We imagine that future SensorSnaps could be inexpensive and given great electrical conductivity when closed and support widely available interactive clothing fasteners for purchase for soldering to the material. from textile suppliers or in fabric stores. This could allow indi- viduals, as well as manufacturers, to easily augment garments with wireless electronics and sensors. Thus, in addition to stan- Digital Jewelry, Wearables, and Accessories dalone operation, our approach can seamlessly co-exist with In recent decades, there has been an increasing interest in electronics for yarn-level integration, as well as craft-based combining electronic capabilities into objects that are worn, techniques. while respecting the aesthetics, style, and function of users and their garments. Researchers at IBM were particularly SensorSnaps enable many applications that could leverage interested in exploring new wearable pervasive devices with touch and motion sensing, as well as ubiquitous sensor net- an approach "that is based in jewelry design, not in technol- works, since they can be added anywhere on clothing or tex- ogy" [26]. Versteeg et al.’s design exploration emphasizes the tiles. For example, activity tracking or motion sensing during aesthetic importance of interactive jewelry [46] and Silina et sports activities could be implicitly captured by SensorSnaps al. [41] analyze 187 jewelry-like devices, particularly high- on the clothing, as an alternative to wearing smartwatches or lighting the opportunities with interchangeable modules that Velcro-strapped sensor nodes. Instead of using separate re- could be used in different locations and enclosures. These mote controls or external sensors, SensorSnaps could be used reviews identify a broad interest in consumer devices for com- to add gestural control on clothing, for example, on shirt cuffs munication, notification, and fitness, which are disguised as to control heads-up displays, an in-car navigation system, or a discrete neutral objects (Ditto [12], Smartstones [10]), jewelry slide presentation. Figure 1 shows SensorSnaps replacing the (Misfit Shine [27], Ringly [34]) or clothing (Burton Mix Mas- original buttons on a shirt. ter Glove [7]), in form factors that are designed to blend into established fashion and social norms. In this paper, we demonstrate how the generic snap fastener can be augmented with miniaturized electronics that perform Inspired by this work, we created SensorSnaps, miniaturized on-device gesture recognition, wireless connectivity, motion modules that can be used in various form factors. In this tracking with sensor fusion, and touch sensing, with the po- paper, we focus on the novel capabilities enabled through our tential for all-day battery life under episodic use. We discuss snap fastener integration, which opens up new possibilities how to design such devices in order to meet stringent power for seamless integration with the most common clothing and and size requirements, and conduct a technical evaluation to accessories. characterize our novel hardware. We develop multiple appli- cations to show potential capabilities and discuss the results Motion-based interactions from a qualitative user study to evaluate the interactions and Early work by Rekimoto [32, 33] and Hinckley at al. [20] applications enabled by SensorSnaps. showed various opportunities to leverage touch and accelerom- The contributions of this paper are as follows: eters for expressiveness and context-detection for mobile in- teraction while being integrated inside devices or under gar- Miniaturized wireless sensor node implementation that inte- • ments. Whack Gestures, for example, proposes casual eyes- grates into snap button caps. free accelerometer-based interaction with a phone in the user’s pocket [21]. With more popularized head-worn displays, many Technical evaluation and characterization of power, cost such techniques have been implemented for wearable comput- • and IMU performance. ing platforms, such as smart eyewear [22]. Most approaches emphasize self-contained sensing