Signal Processing for Pen and Touch Sensors
Total Page:16
File Type:pdf, Size:1020Kb
Signal Processing for Pen and Touch Sensors May 31, 2021 Masayuki Miyamoto Wacom Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. Outline 1. Pen and Touch User Interface 2. EMR (Electro-Magnetic Resonance) Sensing Technology 3. Capacitive Sensing Technology - Principle - SNR Enhancement - Noise Immunity - Sensor Requirement - Passive Pen - Active Pen 4. Latest Technical Challenges Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. Pen and Touch User Interface Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. Professional Creation Support Games Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. Pen Tablet Products for Creative Users Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. 6 Digital Signature System Lalaport, Mitsui Fudosan Retail Management, Japan Citibank, Korea Wacom Clipboard Signature Tablets Wacom Ink Layer Language Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. Pen and Ink Solutions for Smartphones , Tablet, PC, Digital Stationery, etc. Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. 9 Electro-Magnetic Resonance Sensing Technology Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. EMR: Sensing Principle - No Battery in the pen https://tablet.wacom.co.jp/what/news-img/W8002basis.pdf Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. EMR: Sensing Signals https://tablet.wacom.co.jp/what/news-img/W8002basis.pdf Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. EMR: Pen Position Sensing https://tablet.wacom.co.jp/what/news-img/W8002basis.pdf Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. EMR: Pen Pressure, Side Switch, Eraser [An Example] https://tablet.wacom.co.jp/what/news-img/W8002basis.pdf Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. EMR: Sensor Stack-up https://tablet.wacom.co.jp/what/news-img/W8002basis.pdf Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. Capacitive Sensing Technology - Principle - SNR Enhancement - Noise Immunity - Sensor Requirement - Passive Pen - Active Pen Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. Mutual Capacitance Sensing Substrate https://www.bareconductive.com/blogs/blog/how-do-the- touch-boards-capacitive-sensors-work Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. Mutual Capacitance Sensor Pattern 【Diamond】 【Stripe】 Sensing Control Circuit Sensing Control Circuit Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. How to estimate the capacitance 1. Charge Integration (Charge to Voltage Conversion) Vout = - Cm/Cint(Vdrive – Vref) Cm Vdrive 2. Frequency Response Rtx Cm Rrx vi vo = G(jω)vi Ctx Crx Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. Sequential Drive and SNR 4 C 11 C 21 C31 CM1 3 C 12 C 22 C 32 C M2 C C 1j C 2j C 3j Mj 2 C 1N C 2N C 3N C MN Relative SNR Relative 1 0 10 100 Sequential Drive Number of Drive Channels Time M SNR decreases as the number of channel increases Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. A Smart Solution: Parallel Drive Parallel Drive By driving all the channels in parallel, SNR increases. C11 C21 C31 CM1 M C12 C22 C32 CM2 퐒퐣 = Sj1, ⋯ , SjL = Cij퐕퐢 i=1 C1j C2j C3j CMj Signal Reconstruction C1N C2N C3N CMN M 퐒퐣, 퐕퐥 = σi=1 Cij퐕퐢, 퐕퐥 M = σi=1 Cij 퐕퐢, 퐕퐥 M = σi=1 Cij Lδil = C L Parallel Drive lj 퐕ퟏ 퐕풊 퐕푴 Time L if 퐕퐢, 퐕퐥 = σk=1 VikVlk = Lδil M Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. SNR Comparison: Sequential vs. Parallel 4 Parallel Drive 3 2 Relative SNR Relative 1 Sequential Drive 0 10 100 Number of Drive Channels (Assumption) Sensor’s channel resistance is 0. Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. Measured Results: Sequential vs Parallel Sequential Drive Parallel Drive C(fF) C(fF) S32 S32 S28 S28 S24 S24 S20 S20 S16 S16 S12 S12 D0 D0 D2 D4 S8 D2 D4 S8 D6 D8 D6 D8 D10 D12 D10 D12 D14 D16 S4 D14 D16 S4 D18 D20 D18 D20 D22 D24 D22 D24 D26 S0 D26 S0 D28 D30 D28 D30 D32 D34 D32 D34 #(Drive & Sense Cycle) = 348 = 87 x 4 #(Drive & Sense Cycle) = 254 = 127 x 2 #(Drive Channel) = 87 Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. Parallel drive: Hadamard Hadamard Matrix: Mutually Orthogonal DC saturation of the AFE vs Gain Periodicity vs Noise Immunity https://en.wikipedia.org/wiki/Hadamard_matrix Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. Parallel drive: M-Sequence Shifted MLS (Maximum Length Sequence)s: Pseudo Orthogonal -1 1 -1 -1 -1 1 -1 -1 -1 -1 -1 -1 M-Sequence (L = 31 = 26-1) 1 -1 -1 -1 1 -1 35 MLS has Pseudo Randomness -1 -1 1 1 -1 -1 30 - Less DC component -1 1 -1 1 -1 1 ・・・ 25 -> No DC offset issue 1 1 -1 -1 1 1 -> Higher Gain -1 -1 1 20 L 1 -1 -1 퐕퐢, 퐕퐥 = VikVlk -> Higher SNR 1 1 -1 15 1 1 1 k=1 1 1 1 = L if i = k, - Pseudo Randomness 1 1 1 10 = −1 otherwise. -1 1 1 -> Spread spectrum -1 -1 1 Correlation Auto 5 -1 -1 -1 -> Better Noise Immunity 1 -1 -1 0 1 1 -1 -1 1 1 1 -1 1 -5 1 1 -1 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 1 1 1 -1 1 1 1 -1 1 [Example Sequence] 0000100101100111110001101110101 -1 1 -1 1 -1 1 generated from x 5 + x 2 + 1 (primitive polynomial) Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. Display Noise Touch Sensor # of Channel: 88×50 Channel pitch: 5.0mm CH1:200mV/div k-th sense channel Air Gap: 1.5mm LCD: 19.5” FHD Horizontal:20us/div Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. Noise Cancellation by Differential Sensing CH1:200mV/div CH2:200mV/div CH1-CH2:20mV/div Horizontal:20us/div Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. Advantage of Differential Sensing - Common Mode Noise Cancellation - Higher SNR thanks to Higher Gain IEEE J. Solid-State Circuits, vol. 50, no. 1, pp. 335–343, Jan. 2015. Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. Two Phase Rx Circuit Operation phase-1 phase-2 sense channel2i Inn sense channel2i+1 CVC i CVC: Charge to Voltage Converter sense channel2i+2 Inp i=0, …, [N/2]-1. IEEE J. Solid-State Circuits, vol. 50, no. 1, pp. 335–343, Jan. 2015. Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. Power Supply Noise 68kHz(Fundamental) 136kHz(2nd) 204kHz(3rd) 272kHz(4th) AC Adaptor Battery 200kHz Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. Environmental Noise: Fluorescent Light 48kHz(Fundamental) 96kHz(2nd) 192kHz(4th) 144kHz(3rd) Light: ON Light: OFF 200kHz Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. Sensor Material Requirement - RC Time constant: ITO’s time constant is too large to realize large format sensors over 30-inch - Light Transmittance - Visibility: Color, Moire, etc. - Bezel Area Time Constant Comparison A Random Mesh Pattern Sheet Time Constant Metal Width Resistance (Normalized) Copper Metal Mesh 0.003Ω/sq. 7um 1 (Thickness : 7um) Silver Paste 0.2Ω/sq. 6um 78 (Thickness : 9um) ITO on Glass 20Ω/sq. - 260 on Film 150Ω/sq. - 1950 Sensor pitch = 5mm 200μm 200μm Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. Mesh Sensor Design Example Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. Capacitance Changes with a Finger Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. Small Capacitance Change of a Deformed Tip Tip Deformation Conductive fabrics Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. Active Pen with Capacitive Touch Sensor Active Pen sends out electrical signal to touch sensor. The signal can be modulated with pen’s information: the button, pressure, color, ID, etc. Touch controller calculates stylus (x, y) coordinates from the received signal and demodulates pen’s information. Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. One Way Active Pen System TC synchronizes to the pen Not easy to realize Simultaneous Multiple Pens Operation. y-coordinate x-coordinate TC Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. Two Way Active Pen System Each pen synchronizes to TC through Uplink Beacon from TC. Easy to realize Simultaneous Multiple Pens operation. 1. Uplink: for Synchronization Beacon TC 2. Downlink: Multiple Stylus Detection TC Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. Comparison of Capacitive Pen Technology Passive One Way Active Two Way Active Button No Yes Yes Hover NG OK OK Multiple Styluses / w OK / No No / No OK / OK Different Properties Dead Region* Yes No No In-cell Panel Yes No Yes [Dead Region] It is impossible to detect passive pen signal placed very close to a “palm”, since the passive pen signal is small and buried in the palm signal due to its fringing capacitance. Proc. IEEE Asian Solid-State Circuits Conf. (A-SSCC), 2014, pp. 217–220 Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. Example of Two-Way Active Pen Protocol US9977519B2 Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. Universality / Interoperability of Active Pen Protocol 1 Protocol 2 Protocol 3 Architecture PROS CONS Approach 1 Pen enables all the protocol Free competition Complex Implementation Approach 2 Use a unified protocol Conceptually Simple Restricted Competition Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd. An Implementation 240Hz Multiple Active/Passive Pens with 41dB/32dB SNR for 0.5mm Diameter, 85nm CMOS(1P6M) IEEE Int. Solid-State Circuits Conf. (ISSCC) Dig. Tech. Papers, pp. 120–122, Feb. 2015. Confidential. All Rights Reserved. Copyright © 2021 Wacom Co., Ltd.