Vinteraction: Vibration-Based Information Transfer for Smart Devices

2012/10/22

Vinteraction: Vibration-based Information Transfer for Smart Devices

Takuro Yonezawa, Keio University

Background • Spread of smart devices such as smartphones and tablets – Not only in home – But also in public space !

Tokyo Sports Café@Roppongi

1 2012/10/22

Imagine when you… • When you want to send small information such as URL from a smart device to other smart device – In both private space and public space

• Do you want to connect Bluetooth ? WiFi ? – What is SSID ? device name ? • Do you want to use e-mail ? short message service ?

Motivation • Limitation of the method to information transfer between smart devices in private/public space – Using networks (WiFi, Bluetooth) requires many steps • (1) specifying network, (2) specifying target device, (3) ﬁnally sending • Burden task (what is the SSID of this café ?) • Of course, we already have many solutions in HCI area – But Still not suﬃcient – There is no best way for every situation I just want to send How to? a few byte of information..

2 2012/10/22

Related Works • For intuitive device paring in the same network – Using infrared sensor [1] – Using synchronous action - SyncTap[2] / Synchronous Gestures[3] – Using location and synchronous action – Bump (smartphone application) – Using proximity information (WiFi signal strength) [4] • For physically direct and intuitive communication – Infrared communication, NFC tag/reader

[1] Colin Swindells, Kori M. Inkpen, John C. Dill, and Melanie Tory. That one there! pointing to establish device identity. In Symposium on User Interface Software and Technology (UIST’02, pp. 151–160. ACM Press, 2002. [2] Jun Rekimoto, Yuji Ayatsuka, and Michimune Kohno. Synctap: An interaction technique for mobile networking. In In Proc. of Mobile HCI 2003, pp. 104–115. Springer, 2003. [3] Ken Hinckley. Synchronous gestures for multiple persons and computers. In Proceedings of the 16th annual ACM symposium on User interface software and technology, UIST ’03, pp. 149–158, New York, NY, USA, 2003. ACM. [4] Jun Rekimoto, Takashi Miyaki, and Michimune Kohno. Proxnet: Secure dynamic wireless connection by proximity sensing. In Alois Ferscha and Friedemann Mattern, ed- itors, Pervasive, Vol. 3001 of Lecture Notes in Computer Science, pp. 213–218. Springer, 2004.

Purpose and Approach • Purpose: NFC in current products without NFC tags/ readers • Related works: leveraging sound/microphone[5], vibration/ photo reflector[6] • Our Approach: Leveraging combination of vibrator (as sender) and accelerometer (as receiver) [5] Will Archer Arentz and Udana Bandara. Near ultrasonic directional data – When putting vibrating device on transfer for modern smartphones. In Pro- ceedings of the 13th international conference on Ubiqui- tous computing, UbiComp ’11, pp. 481–482, New York, tablet, its vibration affects NY, USA, 2011. ACM. accelerometer of the tablet [6] TAKEMURA Tomoki and KAMIOKA Eiji. Vibration- based near field data communications. IEICE technical report, Vol. 108, No. 398, pp. 7–12, 2009-01-15.

3 2012/10/22

Contribution • Proposing Vinteraction: leveraging accelerometer and vibrator for information transfer between smart devices • Creating actual applications based on Vinteraction - vURLTransfer and vKeyTransfer • Evaluating performance of Vinteraction with actual products of smartphones and tablets

Basic step String a

ASCII code 01100001

Vibration

Time Window Transferring Speed = 1000/w bps w (milliseconds)

value Accelerometer

4 2012/10/22

Approach: How to decode vibration pattern correctly Straightforward Approach: Using simple threshold but.. • How do we manage differences of devices ? • Effect to accelerometer depends on the combination of devices Example of detected acceleration from different smartphones to tablet (Sony Tablet S) (Accel X+Y+Z) 000100010100000010010000110010101101100011011000110111100010100000 Galaxy Nexus HTC Desire 2000 HTC Sensation

1500

1000

500

0 0 1000 2000 3000 4000 5000 6000 7000 (msec)

Our Method Basic [start] a [end] Idea 00000010 01100001 00000011 Analyzing vibration pattern by accelerometer

Threshold 00000000 00000000 00000000 00000010 01000000 00000000 t Sliding Time Window + Sliding Threshold00000010 01100000 00000010 Decode00000010 01100001 00000011 0000001011001111 01100001 1111111100000011 11011111 11111111 11111111a 11111111

5 2012/10/22

Implementation and Applications • Vinteraction library for Android platform • 2 applications with the library – vURLTransfer – vKeyTransfer

6 2012/10/22

Evaluation • Purpose: – Is Vinteraction can be useful for various devices ? – Checking speed and accuracy of Vinteraction • How to evaluate: – Sending “Hello,world!”(96bits) information from 3 kinds of smartphone SmartPhones: Galaxy Nexus to 3 kinds of smart tablets HTC Sensation – By changing transferring speeds HTC Desire Tablets: Sony Tablet S – 5 tests for each combination ICONIA TAB A500 REGZA Tablet AT1S0

Result with..

7 2012/10/22

Result with..

8 2012/10/22

Average

(%)

Discussion • Accuracy vs Speed – Effected by read cycle of accelerometer – 1 read per 10~15 milliseconds • Lower accuracy with ICONIA TAB A500 than other tablets – Effect from vibrator is much less to be detected the tablet • Strong frame, Big size (260*177*13.3 mm) • Lower accuracy with HTC Desire than other smartphones in 20bit/sec speeds – Effect from vibrator from the smartphone is much less • Physical contact area is very small

9 2012/10/22

Future Possibilities • Further interaction/application style: (ex. 1-to-Many interaction)

)) ))

• Adapt implementation for ubicomp education – Vinteraction implementation is very simple but requires many kinds of basic knowledge • Using sensor, encode/decode way, threshold-based analysis, error detection etc.

Conclusion • Vinteraction: Vibration-based Information Transfer for Smart Devices • Conﬁrmed that Vinteraction can be worked reasonably with actual products – Nearly 100% in 10bit/sec • Future work – Enhancement of accuracy and speeds – Implementation of error detect/correct function

10 2012/10/22

Thank you very much ! • Question ? J

Vinteraction: Vibration-based Information Transfer for Smart Devices

• Takuro Yonezawa, Keio University • [email protected] / [email protected]