USOO8949722B2
(12) United States Patent (10) Patent No.: US 8,949,722 B2 Sirpal et al. (45) Date of Patent: Feb. 3, 2015
(54) CALENDARAPPLICATION VIEWS IN H05K5/04 (2013.01); H05K 7/1452 (2013.01); PORTRAIT DUAL MODE B29D 1 1/00673 (2013.01); G02B 6/0001 (2013.01); G06F 3/01 (2013.01); G06F 3/048 (71) Applicant: Z124, Georgetown (KY) (2013.01); G06F 3/04897 (2013.01); G06F (72) Inventors: Sanjiv Sirpal, Oakville (CA); 3/0412 (2013.01); G06T3/00 (2013.01); G06F Mohammed Selim, Oakville (CA); I/I616 (2013.01); G06F 9/4443 (2013.01); Lucilla Madamba, Toronto (CA); G06F 3/0481 (2013.01); G06F 3/0483 Jennifer L. Fraser, Ottawa (CA); (2013.01); G06F 3/048.83 (2013.01); G06F Alexander de Paz, Burlington (CA) 3/1423 (2013.01); G06F 9/44 (2013.01); (Continued) (73) Assignee: Z124, George Town (KY) (58) Field of Classification Search (*) Notice: Subject to any disclaimer, the term of this CPC ... G06F 1/1616; G06F 1/1641; G06F 1/1649 patent is extended or adjusted under 35 USPC ...... 71.5/744 U.S.C. 154(b) by 156 days. See application file for complete search history. (21) Appl. No.: 13/629,349 (56) References Cited U.S. PATENT DOCUMENTS (22) Filed: Sep. 27, 2012 7,453,418 B2 * 1 1/2008 Palmquist ...... 345/1.1 (65) Prior Publication Data 2005/0093868 A1* 5/2005 Hinckley ...... 34.5/5O2 US 2013/OO86480 A1 Apr. 4, 2013 (Continued) Related U.S. Application Data OTHER PUBLICATIONS (60) Provisional application No. 61/539,884, filed on Sep. Toshiba Corporation, Toshiba User's Manual Libretto W100, 27, 2011. Toshiba Corporation, First Edition, 2010, pp. 1-119.* (Continued) (51) Int. C. G06F 3/00 (2006.01) Primary Examiner — Tadeese Hailu H047 72/06 (2009.01) Assistant Examiner — Andrew Chung (Continued) (74) Attorney, Agent, or Firm — Sheridan Ross P.C. (52) U.S. C. CPC ...... H04W 72/06 (2013.01); G09G 5/34 (57) ABSTRACT (2013.01); H04M I/0266 (2013.01); G09G5/00 A communication device comprising a microprocessor read (2013.01); G06F 3/041 (2013.01); G09G I/00 able computer readable medium is provided that includes (2013.01); H05K 5/0226 (2013.01); H05K microprocessor executable instructions to provide graphical 5/0017 (2013.01); H05K 13/00 (2013.01); output, in a first mode, simultaneously on multiple screens H04N 5/44591 (2013.01); G06F 1/1637 and, in a second mode, simultaneously as multiple displays (2013.01); H05K 7/02 (2013.01); E05D3/12 Ola COO. SCC. (2013.01); G06F 1/1641 (2013.01); G06F I/I601 (2013.01); H05K 13/046 (2013.01); 20 Claims, 93 Drawing Sheets
o sf4 ses A so sfs s2
Max MoDE (PortRAIT ses
100 sos 5702 F12
ss s US 8,949,722 B2 Page 2
(51) Int. Cl. Google Image Result for Fujitsu Dual Screen Phone, published date G09G 5/34 (2006.01) unknown, retrieved Apr. 18, 2011), 1 page. Retrieved from: www. H04M I/02 (2006.01) google.com/imgres?imgurl=http://www.gsmdome.com/wp-con G09G 5/00 (2006.01) tent/uploads/2010/10/fujitsu-dual-screen-phone w2cP7 54.jpg. G06F 3/04 (2006.01) Google Image Result for Kyocera Echo, published date unknown, G09G I/00 (2006.01) retrieved Apr. 18, 2011, 1 page. Retrieved from: www.google.com/ H05K 5/02 (2006.01) imgres?imgurl=http://www.hardwaresphere.com/wp-content/up H05K 5/00 (2006.01) loads/2011/02/kyocera-echo-dual-screen-android-phone-for-sprint H05K I3/00 (2006.01) network.jpg. H04N 5/445 (2011.01) Google Image Result for HTC Triple Viper, published date unknown, G06F L/I6 (2006.01) retrieved Apr. 18, 2011, 1 page. Retrieved from: www.google.com/ H05K 7/02 (2006.01) imgres?imgurl=http://www.santafemods.com/Forum/ E05D3/12 (2006.01) AndroidForums/htcTripleViper.png. Google Image Result for Dual-Screen Phone, retrieved Apr. 18. H05K I3/04 (2006.01) 2011, 1 page. Retrieved from: www.google.com/ H05K 5/04 (2006.01) imgres?imgurl=http://www.netshet.org/wp-content/uploads/2011/ H05K 7/4 (2006.01) 02/Dual-Scree . . . . B29D II/00 (2006.01) Website entitled, “Kyocera Echo.” Kyocera Communications, Inc., F2/8/00 (2006.01) 2011, retrieved on Aug. 27, 2012), 6 pages. Retrieved from: www. G06F 3/0 (2006.01) echobykyocera.com/. G06F 3/048 (2013.01) Website entitled “LapdockTM for Motorola Atrix.” Motorola Mobil G06F 3/0489 (2013.01) ity, Inc., 2011, retrieved on Apr. 18, 2011), 1 page. Retrieved from: G06T3/00 (2006.01) www.motorola.com/Consumers/US-EN/Consumer-Product-and Services. Mobile--Ph. . . . G06F 9/44 (2006.01) Website entitled “Motorola Atrix 4G Laptop Dock Review.” G06F 3/048. I (2013.01) phoneArena.com, posted Mar. 2, 2011, retrieved on Apr. 18, 2011). G06F 3/0483 (2013.01) 6 pages. Retrieved from: www.phonearena.com/reviews/Motorola G06F 3/0488 (2013.01) ATRIX-4G-Laptop-Dock-Review id2667. G06F 3/4 (2006.01) Website entitled, “Sony Tablet.” Sony Corporation, 2012, retrieved G09G 5/14 (2006.01) on Aug. 27, 2012, 3 pages. Retrieved from: www.store.Sony.com/ H04788/06 (2009.01) webapp/wcs/stores/servlet/CategoryDisplay?catalogId=10551 HO4W 48/18 (2009.01) &storeId=10151&langId=-1&categoryId=8198552921644795521. Burns, C., “Motorola Atrix 4G Laptop Dock Review.” Android Com (52) U.S. Cl. munity, Feb. 20, 2011, retrieved on Apr. 18, 2011), 5 pages. CPC ...... G09G 5/14 (2013.01); H04W 88/06 Retrieved from: www.androidcommunity.com/motorola-atrix-4g (2013.01); G06F 3/1438 (2013.01); G06F laptop-dock-review-20110220/. 3/1446 (2013.01); H04W 48/18 (2013.01) Catacchio, “This Smartphone has two huge screens . . . that rotate.” USPC ...... 71.5/744 The Next Web, Inc., Oct. 7, 2010, retrieved on Jul. 21, 2011, 2 pages. Retrieved from: www.thenextweb.com/asia/2010/10/07/this (56) References Cited Smartphone-has-two-huge-screens-that-rotate?. Posted by Harman03, “Kyocera Echo Dual-screen Android Phone.” U.S. PATENT DOCUMENTS posted 4 weeks from Apr. 18, 2011, retrieved on Apr. 18, 2011). 3 pages. Retrieved from: www.unp.meff106/kyocera-echo-dual 2008. O165152 A1 7/2008 Forstall et al. screen-android-phone-143800?. 2008/0216125 A1* 9/2008 Li et al...... 725,62 2009,0278806 A1 11/2009 Duarte et al. Stein, S., “How does the Motorola Atrix 4G Lapdock compare with a 2010 OO64536 A1 3/2010 Caskey et al. laptop?” Crave CNET, Feb. 9, 2011 retrieved on Apr. 18, 2011), 7 2010, 0079355 A1* 4/2010 Kilpatricket al...... 345/1.3 pages. Retrieved from: www.news.cnet.com/8301-17938 105 2011/0231783 A1* 9/2011 Nomura ...... 715,761 20031251-1.html. 2013,0021262 A1 1/2013 Chen “iPad User Guide for iOS 4.2 Software.” Apple Corp., 2010, 181 2013/0113835 A1 5/2013 Sirpal et al. pageS. “Toshiba Unveils libretto W 100 Dual-touch-screen Windows 7 Mini OTHER PUBLICATIONS notebook PC, Digital Tech News, Jun. 21, 2010, 3 pages, retrieved from www.digitalnews.com/news/2010/06/oshiab-unveils-libetto Google Image Result for Fujitsu Dual Screen Phone, published date w100-dualtouchscreen-windows-7-mininotebook.pc.html. unknown, retrieved Apr. 18, 2011), 1 page. Retrieved from: www. Geller, “Dual-Screen Sprint Kyocera Echo Innovative, but Bulky.” google.com/imgres?imgurl=http://www.computerriver.com/im Apr. 13, 2011, 9 pages, retrieved from www.foxbusiness.com/tech ages/dual-screen-phone.jpg. nology/2011/04/13/dual-screen-sprint-kyocera-echo-poered-an Google Image Result for LG Dual Touch Screen Concept Phone by droid-reviewed. Eugene Kim, published date unknown, retrieved Apr. 18, 2011, 1 Official Action for U.S. Appl. No. 13/629.325, mailed Aug. 14, 2014, page. Retrieved from: www.google.com/imgres?imgurl=http:// 24 pages. fgadgets.com/wp-content/uplaods/2010/08/1g-dual-touch-screen phone-Eugene-Kim-01.jpg. * cited by examiner U.S. Patent Feb. 3, 2015 Sheet 1 of 93 US 8,949,722 B2
5 100 U.S. Patent Feb. 3, 2015 Sheet 2 of 93 US 8,949,722 B2
100 156 100. FIG. 1F 5 to
144 132 148 152 136
140
FIG. 1E S 172a 164 FIG. 1D
FIG. 1C
5 100 s 2.
FIG. 1G U.S. Patent Feb. 3, 2015 Sheet 3 Of 93 US 8,949,722 B2
to
U.S. Patent Feb. 3, 2015 Sheet 4 of 93 US 8,949,722 B2
100
SCreen 1 SCreen 2
Touch Sensitive Touch Sensitive Display
Configurable Area Configurable Area
216a 208 212 2O4 Display Data Display COntroller Memory Storage PrOCessor COntroller
224 228 Cellular POWer Source and Telephony POWe Control Module MOdule
Other Wireless POrt Integrated 236 GPS Communication Interface Audio I/O Module
HardwareButtons SEensor(s) Accelerometer(s)||Ti9,Capture '''Interface
158 172 176 240 244 248
FIG. 2 U.S. Patent Feb. 3, 2015 Sheet 5 Of 93 US 8,949,722 B2
s 1OO
336
O 316 Outbound MOdified Easel Call
100
344
348 FIG. 3A
U.S. Patent Feb. 3, 2015 Sheet 7 Of 93 US 8,949,722 B2
432a 428a Tap -- S420 FIG. 4A 432b 428b Long Press --S424
FIG. 4B 432 428b 4 36 Drag -- S400
FIG. 4C 432 428b 5 436 Flick --S 404
FIG. 4D 432a 432b 428a 436a 436b
Pinch --S408 428b FIG. 4E ge) 432a 432b436b Spread -- S410 428a 428b U.S. Patent Feb. 3, 2015 Sheet 8 Of 93 US 8,949,722 B2
“ 428b 432b - 400 428a S 2-D- --S 412 436
FIG. 4G
432a 432b 420, 428b - 400 416 428a 436 -S U.S. Patent Feb. 3, 2015 Sheet 9 Of 93 US 8,949,722 B2
U.S. Patent Feb. 3, 2015 Sheet 10 Of 93 US 8,949,722 B2
524
Multi-Display Management Module 568 N Display Configuration Module
572 N Preferences Module
574 Device State Module
Gesture Module
58O Requirements Module
584 Event Module
588 N Binding Module
F.G. E. U.S. Patent Feb. 3, 2015 Sheet 11 of 93 US 8,949,722 B2
:
2 U.S. Patent Feb. 3, 2015 Sheet 12 Of 93 US 8,949,722 B2
CO O CO
3
s U.S. Patent Feb. 3, 2015 Sheet 13 Of 93 US 8,949,722 B2
U.S. Patent Feb. 3, 2015 Sheet 14 of 93 US 8,949,722 B2
& S. 3
CN wn CO U.S. Patent Feb. 3, 2015 Sheet 15 Of 93 US 8,949,722 B2
U.S. Patent Feb. 3, 2015 Sheet 16 of 93 US 8,949,722 B2
s S. O re U.S. Patent Feb. 3, 2015 Sheet 17 Of 93 US 8,949,722 B2
OO s O w
S. U.S. Patent US 8,949,722 B2
09/
U.S. Patent US 8,949,722 B2
()09/
U.S. Patent US 8,949,722 B2
()009 U.S. Patent Feb. 3, 2015 Sheet 23 Of 93 US 8,949,722 B2
900 S.
904
908 Receive activation of a window
912 Determine associated display
916 Determine position in stack
920 Generate logic structure
924
FIG. 9 U.S. Patent Feb. 3, 2015 Sheet 24 of 93 US 8,949,722 B2
1004 to
102O
1012a 1012b S 1012c FIG 10 U.S. Patent Feb. 3, 2015 Sheet 25 of 93 US 8,949,722 B2
FIG 11 U.S. Patent Feb. 3, 2015 Sheet 26 of 93 US 8,949,722 B2
U.S. Patent Feb. 3, 2015 Sheet 27 Of 93 US 8,949,722 B2
1 OO
B Landscape
1010
FIG. 13B
1OO
C Portrait
Landscape -- 1010 | 4 U.S. Patent Feb. 3, 2015 Sheet 28 Of 93 US 8,949,722 B2
1OOO 1016 1010 1004 9.
1012a 1012b 1012C FIG. 14 U.S. Patent Feb. 3, 2015 Sheet 29 Of 93 US 8,949,722 B2
FIG. 15 U.S. Patent Feb. 3, 2015 Sheet 30 of 93 US 8,949,722 B2
Dual Screen Application - on Max Mode Portrait U.S. Patent Feb. 3, 2015 Sheet 31 of 93 US 8,949,722 B2
Dual Screen Application – Max Mode Landscape
Window 1 Window 2
FIG. 17 U.S. Patent Feb. 3, 2015 Sheet 32 Of 93 US 8,949,722 B2
1010 1004 5 1000
1808
Application Area
1 2 3 4. 5 6 7 8 9 O > 1804
O || W E R T Y U O P
A S D F G H J K L
SHIFT Z X C W B N M { DEL
2123 (C) Enter -(- O S
FIG. 18 U.S. Patent Feb. 3, 2015 Sheet 33 Of 93 US 8,949,722 B2
1004 9. 1OOO
1908
Application Area
Max Mode
2 3 4 5 6 8 9 0 1804 aw E R t Yu o P a s D F G H k l z x c v B N M < DEL GD Enter - C - O
FIG. 19 U.S. Patent Feb. 3, 2015 Sheet 34 of 93 US 8,949,722 B2
Type to Compose 1 2 3 4 5 6 7 8 9 0. a w E E R T Y U o P A s D F G H J K L shir z x c v B N M -C DEL 123 Ener
FIG. 20 U.S. Patent Feb. 3, 2015 Sheet 35 of 93 US 8,949,722 B2
Application Area Application Area 1. 2
1804
FIG 21 U.S. Patent Feb. 3, 2015 Sheet 36 of 93 US 8,949,722 B2
U.S. Patent Feb. 3, 2015 Sheet 37 Of 93 US 8,949,722 B2
1OOO 1010 1004 9.
FIG. 24 U.S. Patent Feb. 3, 2015 Sheet 38 of 93 US 8,949,722 B2
1000
------1010... ------: s? g/ Lil' O
FIG. 25 U.S. Patent Feb. 3, 2015 Sheet 39 Of 93 US 8,949,722 B2
1010 too 2618
1020
2604
2608
2616
2612
FIG. 26 U.S. Patent Feb. 3, 2015 Sheet 40 of 93 US 8,949,722 B2
FIG. 27 U.S. Patent Feb. 3, 2015 Sheet 41 of 93 US 8,949,722 B2
to 2618
1010
FIG. 28 U.S. Patent Feb. 3, 2015 Sheet 42 of 93 US 8,949,722 B2
1004 5 1000 2618
2908
2912
Desktop 2916
FIG. 29 U.S. Patent Feb. 3, 2015 Sheet 43 of 93 US 8,949,722 B2
1000
2618
30O8
Application Area
6 7 8 9
a we II Yu to 3004 As D. civilF. G. H. J.it K. L. ?
FIG. 30 U.S. Patent Feb. 3, 2015 Sheet 44 of 93 US 8,949,722 B2
3116
FIG. 31A
1000 & 1010 FIG. 31B
3116
3.108 U.S. Patent Feb. 3, 2015 Sheet 45 of 93 US 8,949,722 B2
D1 D2 D5
6 3220 3224
FIG.32B
U.S. Patent Feb. 3, 2015 Sheet 46 of 93 US 8,949,722 B2
3304 33 12-3316
GBT Toggle WiFi Scm Lck sng Dual Pwr Mode D Carrier Notifications John Smith D-( Draft File status? Pat Cooly D-3 Please schedule meeting
Y. 1000 FIG. 33 U.S. Patent Feb. 3, 2015 Sheet 47 of 93 US 8,949,722 B2
Application launcher 1000
1010 FIG. 34A
31.16 1000 FIG. 34B
Application Launcher
1010 U.S. Patent Feb. 3, 2015 Sheet 48 of 93 US 8,949,722 B2
3520 3524
FIG. 35A
FIG. 35B
3504 3520 >- 3524
D U.S. Patent Feb. 3, 2015 Sheet 49 Of 93 US 8,949,722 B2
3604
Application C
3612
3608
3444 Application D
3416 U.S. Patent Feb. 3, 2015 Sheet 50 of 93 US 8,949,722 B2
III, III owna s D F G H toK 3704 start 2 x c v B N M - DFL a to
FIG. 37 U.S. Patent Feb. 3, 2015 Sheet 51. Of 93 US 8,949,722 B2
S3802 START
S3804 Detect insertion of Device into SP
S3806 Begin Power Management
Turn Off S3808 Displays of Device
S3810 Establish Communication / Connectivity with SP
S3812 Enable Display and other Input/Output Functions on SP
Device Software Settings are S3814 Mapped to SP Hardware Settings
S3816 Automatically Align Screen Orientation of Device to SP
S3818 Last Application in Focus Remains in FOCUS
S3820 END FIG 38 U.S. Patent Feb. 3, 2015 Sheet 52 Of 93 US 8,949,722 B2
Detect SP Orientation
S3904 Detect Application(s) Orientation(s) on Device
Reorient Application(s) As S3906 needed Based on Orientation of SP
FIG. 39 U.S. Patent Feb. 3, 2015 Sheet 53 Of 93 US 8,949,722 B2
S4000 START
S4004 Landscape Orientation?
S4O1 O Display Keyboard in Landscape Mode
Display
S4012 Keyboard in Orientation Portrait MOde Change?
NO Orientation Change?
S4O16 FIG. 40 U.S. Patent Feb. 3, 2015 Sheet 54 Of 93 US 8,949,722 B2
S4100
Detect Gesture Direction
Call Next Application Window into View, Scrolling Currently Viewed Application Window into Stack
Gesture Detected?
S4110
FIG. 41 U.S. Patent Feb. 3, 2015 Sheet 55 Of 93 US 8,949,722 B2
Enable Multiple Application Mode
Detect Selection of Applications to be Displayed Split Screen- 1 Portion for First Application and 2" Portion for Second Application
Detect Application in FOCUS
Highlight In-FOCUS Application U.S. Patent Feb. 3, 2015 Sheet 56 of 93 US 8,949,722 B2
S4300 START
Determine if Application can be Maximized
Maximizable?
S4306 Expand Application to Dual SCreen Mode or Max Mode
S4308
FIG. 43 U.S. Patent Feb. 3, 2015 Sheet 57 Of 93 US 8,949,722 B2
S4400 START
S44.02 Detect Last Application in Application Window Stack
Detect Gesture Requesting S44.04 Next-Window at End of the Stack
Display Desktop S44.08
FIG. 44 U.S. Patent Feb. 3, 2015 Sheet 58 Of 93 US 8,949,722 B2
S45OO START
Display S45O2 Desktop on SP
Logically Divide S4504 Desktop on SmartPad Display 1 Screen of Desktop in S4506 One Logical Portion of SP Display
Display 2nd Screen of Desktop S4508 in Second Logical Portion of SP Display
Allow Carousel S4510 Movement of "Panels' S4512 FIG. 45 U.S. Patent Feb. 3, 2015 Sheet 59 of 93 US 8,949,722 B2
Display Desktop on SP
Logically Divide Desktop on SmartPad
Display 1 Screen of Desktop in S4608 One Logical Portion of SP Display
Display 2nd Screen of Desktop S4610 Bridging First and Second Logical Portion of SP Display
Display 3rd Screen of Desktop S4612 in Second Logical Portion of SP Display
Allow Carousel Movement of "Panels' FIG. 46 U.S. Patent Feb. 3, 2015 Sheet 60 of 93 US 8,949,722 B2
S4700 START
S4702 Detect ACCess Desktop Request
S4704 Display At least One Desktop Panel on Display
Partially Display At least S47O6 One Other Desktop Panel On Display
Upon Gesture-Based Request, Completely S4708 Display Partially Displayed Desktop Panel On Displa play FIG. 47 S4710 U.S. Patent Feb. 3, 2015 Sheet 61 of 93 US 8,949,722 B2
S4800 START
Enter Multiple Application Mode
Arrange Stack with One Or More S4804 Applications Being Partially Visible Behind a First Application
Optionally Arrange Stack with One Or S4806 More Applications Being Partially Visible Behind a Second Application
Upon Receipt of Gesture, Allow Carousel-Like Scrolling S4808 Through Stack Until End of Stack, or Allow Continuous "Circular" Scrolling through the Stack in an Alternative Embodiment
FIG. 48 U.S. Patent US 8,949,722 B2
006f;
U.S. Patent US 8,949,722 B2
U.S. Patent US 8,949,722 B2
U.S. Patent Feb. 3, 2015 Sheet 67 of 93 US 8,949,722 B2
39P-99) 7
77
e9,99 77
U.S. Patent Feb. 3, 2015 Sheet 69 Of 93 US 8,949,722 B2 809€.17099; q-V99ºsôIH
00997 9099; Z099 U.S. Patent Feb. 3, 2015 Sheet 70 of 93 US 8,949,722 B2
\ is, U.S. Patent Feb. 3, 2015 Sheet 71 of 93 US 8,949,722 B2
g SS SS
is is,
NC O t g I
8 N SN N U.S. Patent Feb. 3, 2015 Sheet 72 Of 93 US 8,949,722 B2
0001,
8899; × 969€.
0001, Z699;
0001. 02979; U.S. Patent Feb. 3, 2015 Sheet 73 of 93 US 8,949,722 B2
90/19 91,ALG†70/19 (LiwuLeiod)=IqoWXVIN A.--ZO 90 90/19ZOALS
80/19
0001, 000), ||| U.S. Patent Feb. 3, 2015 Sheet 74. Of 93 US 8,949,722 B2
ooggZ08
909/*0001, (Edwosc.INWT)EqOWXVW
U.S. Patent Feb. 3, 2015 Sheet 76 of 93 US 8,949,722 B2
§§§§§§§§
$399.*****
§§§ $33 U.S. Patent US 8,949,722 B2
$*$#3$"$3:3 U.S. Patent Feb. 3, 2015 Sheet 78 of 93 US 8,949,722 B2
09:29 U.S. Patent US 8,949,722 B2
?!!179
00199 U.S. Patent Feb. 3, 2015 Sheet 80 Of 93 US 8,949,722 B2
80979 U.S. Patent Feb. 3, 2015 Sheet 81. Of 93 US 8,949,722 B2
«er
meaevoaenëe
17099 N ZLZ9 U.S. Patent Feb. 3, 2015 Sheet 82 of 93 US 8,949,722 B2
:::3: 8:::::priants
7 57 U.S. Patent Feb. 3, 2015 Sheet 83 of 93 US 8,949,722 B2
E 1232 PM
Budget Q4 Review . . . . rtari seeting corn
O Corference Cali - Flextrols 1:1: p.m.-2:30pm Sati's fir A quick review of Q3 results and proposed guidance for QA reports, ifiersting,
- o Weekly Standup {m 21C in U.S. Patent Feb. 3, 2015 Sheet 84 of 93 US 8,949,722 B2
8069 U.S. Patent Feb. 3, 2015 Sheet 85 of 93 US 8,949,722 B2
7000
U.S. Patent Feb. 3, 2015 Sheet 86 of 93 US 8,949,722 B2
is: stian swari riters
sia
W is 7104 is starctii-innie ia
6212
ATG 71 U.S. Patent Feb. 3, 2015 Sheet 87 Of 93 US 8,949,722 B2
7200 72O4. 7224
7216
7228
feateria Bob Collins (5) hack it, that and we saw sist right. is 5588.98 ey is Mark, is ward is attached. 7232 f 1: June Robinson (31) Great sale at lordstron's, especially shoes Y:
liza Salazar (57) heard theasais a great sale atrister's
AIG 72 U.S. Patent Feb. 3, 2015 Sheet 88 Of 93 US 8,949,722 B2
N E is 2:32 Pri
7312
7322
N z x c w bin m 4
A76, 73 U.S. Patent US 8,949,722 B2
U.S. Patent Feb. 3, 2015 Sheet 91. Of 93 US 8,949,722 B2
ae: U.S. Patent Feb. 3, 2015 Sheet 92 Of 93 US 8,949,722 B2
0299) U.S. Patent Feb. 3, 2015 Sheet 93 Of 93 US 8,949,722 B2
DETECT STMULUS
DETERMINE STATE OF DEVICE INCLUDING NUMBER OF SCREENS, APPLICATION MODE, EXECUTING APPLICATION TYPES, MAX MODE ENABLED, AND DEVICE ORIENTATION
SELECT DISPLAY CONFIGURATION
A/G 73 US 8,949,722 B2 1. 2 CALENDARAPPLICATION VIEWS IN memories is operable in a first mode to behave as a multi PORTRAIT DUAL MODE screen application on the first communication device and in a second mode as a multi-display application on the second CROSS REFERENCE TO RELATED communication device. APPLICATION In one configuration, the first communication device includes multiple screens, and the second communication The present application claims the benefits of and priority, device only one screen. under 35 U.S.C. S 119(e), to U.S. Provisional Application Ser. In one configuration, in the first mode the software appli No. 61/539,884, filed Sep. 27, 2011, entitled “MOBILE cation does not simultaneously display output as multiple DEVICE.” which is incorporated herein by this reference in 10 displays on a selected Screen and, in the second mode, the its entirety for all that it teaches and for all purposes. Software application does not simultaneously display output This application is also related to U.S. application Ser. No. to multiple screens. 13/629,325, filed on Sep. 27, 2012, entitled “CALENDAR In one configuration, the first and second communication APPLICATION VIEWS IN LANDSCAPE DUAL MODE. devices are docked with one another. which is incorporated herein by this reference in its entirety 15 In one configuration, the Software application is in one or for all that its teaches and for all purposes. both of the first and second memories, the software applica tion is executing and providing output simultaneously to the BACKGROUND first and second communication devices, and, on the first communication device, the output is displayed simulta A substantial number of handheld computing devices, such neously on multiple screens and, on the second communica as cellular phones, tablets, and E-Readers, make use of a tion device, the output is displayed simultaneously on mul touchscreen display not only to deliver display information to tiple displays on a common screen. the user but also to receive inputs from user interface com In one configuration, in the first mode the first screen is a mands. While touch screen displays may increase the config multi-screen composite display and, in the second mode, the urability of the handheld device and provide a wide variety of 25 second screen is a single-screen composite display. user interface options, this flexibility typically comes at a In one configuration, the first communication device is a price. The dual use of the touchscreen to provide content and cellular phone, and the second communication device a tablet receive user commands, while flexible for the user, may computer, such as a Smart pad, or laptop. obfuscate the display and cause visual clutter, thereby leading In one configuration, the second screen is configured to to user frustration and loss of productivity. 30 operate in at least the following modes: The small form factor of handheld computing devices a portrait single display mode, in which the second screen requires a careful balancing between the displayed graphics is in a portrait orientation and only one display is currently and the area provided for receiving inputs. On the one hand, providing a maximized view, in portrait, for the displayed the Small display constrains the display space, which may output of the Software application; increase the difficulty of interpreting actions or results. On the 35 a portrait multi-application mode, in which the second other, a virtual keypad or other user interface scheme is Super screen is in a portrait orientation and the software application imposed on or positioned adjacent to an executing applica and a different Software application are simultaneously pro tion, requiring the application to be squeezed into an even viding a maximized view, in landscape, for the display; Smaller portion of the display. a landscape single application mode, in which the second This balancing act is particularly difficult for single display 40 screen is in a landscape orientation and only the Software touch screen devices. Single display touch screen devices are application is providing a maximized view, in landscape, for crippled by their limited screen space. When users are enter the display; and ing information into the device, through the single display, the a landscape multi-application mode, in which the second ability to interpret information in the display can be severely screen is in a portrait orientation and the software application hampered, particularly when a complex interaction between 45 and a different Software application are simultaneously pro display and interface is required. viding a maximized view, in portrait, for the display. The present disclosure can provide a number of advantages SUMMARY depending on the particular aspect, embodiment, and/or con figuration. There is a need for a dual multi-display handheld comput 50 For example, the communication device and Smartpad, ing device that provides for enhanced power and/or versatility though having differing numbers of screens, can provide a compared to conventional single display handheld computing substantially uniform and intuitive series of views to the user. devices. These and other needs are addressed by the various This can be done by configuring the output of a Software aspects, embodiments, and/or configurations of the present application to be that of a multi-screen application or multi disclosure. Also, while the disclosure is presented in terms of 55 display application to match the capabilities of the graphical exemplary embodiments, it should be appreciated that indi user interface of the device. vidual aspects of the disclosure can be separately claimed. Additionally, the smartpad could provide additional dis In one embodiment, a system is provided that includes: a play area to assista user with viewing content on the device. first communication device including a first microprocessor, Additionally, power sharing and management functions a first memory operable to store software, and a first screen to 60 are available due to, for example, the larger size of the Smart display output; and pad that could be used for power storage. a second communication device including a second micro Furthermore, the Smartpad allows functions of a commu processor, a second memory operable to store software, and a nications device to be extended to a tablet-like platform and/ second screen to display output. or form factor. The first and second communication devices are in signal 65 Even further, the disclosure provides techniques directed communication (e.g., wired or wireless) with one another and toward translating or otherwise converting content for a a software application in one or both of the first and second multi-display device into content for a single screen device. US 8,949,722 B2 3 4 Moreover, the Smartpad provides additional input areas equivalents and Successor media, in which the Software adapted to receive input beyond that of the touchscreen. implementations of the present disclosure are stored. Additional advantages are directed toward managing the The term “desktop' refers to a metaphor used to portray display of one or more windows associated with one or more systems. A desktop is generally considered a “surface' that applications on a multi-display device on a single display typically includes pictures, called icons, widgets, folders, etc. device. that can activate show applications, windows, cabinets, files, Further advantages are directed toward emulation of multi folders, documents, and other graphical items. The icons are display content on a single screen device. generally selectable to initiate a task through user interface These and other advantages will be apparent from the interaction to allow a user to execute applications or conduct 10 other operations. disclosure. The terms “determine”, “calculate” and “compute.” and The phrases “at least one”, “one or more', and “and/or are variations thereof, as used herein, are used interchangeably open-ended expressions that are both conjunctive and dis and include any type of methodology, process, mathematical junctive in operation. For example, each of the expressions operation or technique. “at least one of A, B and C', 'at least one of A, B, or C, “one 15 The term “display” refers to one or more portions of one or or more of A, B, and C. “one or more of A, B, or C and “A, more screens used to display the output of a computer to a B, and/or C' means A alone, B alone, C alone, A and B user. A display may refer to all or part of a screen. In one together, A and C together, B and C together, or A, B and C configuration, the display is a single-display Screen or a together. multi-display screen. A single physical Screen can include The term “a” or “an entity refers to one or more of that multiple displays that are managed as separate logical dis entity. As such, the terms “a” (or “an”), “one or more' and “at plays. Thus, different content can be displayed on the separate least one' can be used interchangeably herein. It is also to be displays although part of the same physical Screen. In another noted that the terms “comprising”, “including, and “having configuration, the display occupies a single screen or spans can be used interchangeably. multiple screens, referred to as a composite display. A com The term “automatic' and variations thereof, as used 25 posite display can encompass the touch sensitive displays of herein, refers to any process or operation done without mate Ole O. O. SCCCS. rial human input when the process or operation is performed. The term "displayed image” refers to an image produced However, a process or operation can be automatic, even on the display. A typical displayed image is a window or though performance of the process or operation uses material desktop. The displayed image may occupy all or a portion of or immaterial human input, if the input is received before 30 the display. performance of the process or operation. Human input is The term “display orientation” refers to the way in which a deemed to be material if such input influences how the pro rectangular display is oriented by a user for viewing. The two cess or operation will be performed. Human input that con most common types of display orientation are portrait and sents to the performance of the process or operation is not landscape. In landscape mode, the display is oriented Such deemed to be “material'. 35 that the width of the display is greater than the height of the The term “composite display” refers to a logical structure display (Such as a 4:3 ratio, which is 4 units wide and 3 units that defines a display that can encompass one or more screens. tall, or a 16:9 ratio, which is 16 units wide and 9 units tall). A "multi-screen composite display is a display that encom Stated differently, the longer dimension of the display is passes multiple screens. A 'single-screen composite display” oriented substantially horizontal in landscape mode while the has different displays on a common screen. The composite 40 shorter dimension of the display is oriented substantially display can have different display characteristics based on the Vertical. In the portrait mode, by contrast, the display is ori various orientations of the device. ented such that the width of the display is less than the height The term “computer-readable medium' as used herein of the display. Stated differently, the shorter dimension of the refers to any tangible storage and/or transmission medium display is oriented substantially horizontal in the portrait that participate in providing instructions to a processor for 45 mode while the longer dimension of the display is oriented execution. Such a medium may take many forms, including substantially vertical. but not limited to, non-volatile media, Volatile media, and The term “gesture” refers to a user action that expresses an transmission media. Non-volatile media includes, for intended idea, action, meaning, result, and/or outcome. The example, NVRAM, or magnetic or optical disks. Volatile user action can include manipulating a device (e.g., opening media includes dynamic memory, Such as main memory. 50 or closing a device, changing a device orientation, moving a Common forms of computer-readable media include, for trackball or wheel, etc.), movement of a body part in relation example, a floppy disk, a flexible disk, hard disk, magnetic to the device, movement of an implement or tool in relation to tape, or any other magnetic medium, magneto-optical the device, audio inputs, etc. A gesture may be made on a medium, a CD-ROM, any other optical medium, punch cards, device (such as on the screen) or with the device to interact paper tape, any other physical medium with patterns of holes, 55 with the device. a RAM, a PROM, and EPROM, a FLASH-EPROM, a solid The term “gesture capture” refers to a sense or otherwise a state medium like a memory card, any other memory chip or detection of an instance and/or type of user gesture. The cartridge, a carrier wave as described hereinafter, or any other gesture capture can occur in one or more areas of the screen, medium from which a computer can read. A digital file attach A gesture region can be on the display, where it may be ment to e-mail or other self-contained information archive or 60 referred to as a touch sensitive display or off the display where set of archives is considered a distribution medium equivalent it may be referred to as a gesture capture area. to a tangible storage medium. When the computer-readable The term “means' shall be given its broadest possible media is configured as a database, it is to be understood that interpretation in accordance with 35U.S.C., Section 112, the database may be any type of database. Such as relational, Paragraph 6. Accordingly, a claim incorporating the term hierarchical, object-oriented, and/or the like. Accordingly, 65 “means' shall coverall structures, materials, or acts set forth the disclosure is considered to include a tangible storage herein, and all of the equivalents thereof. Further, the struc medium or distribution medium and prior art-recognized tures, materials or acts and the equivalents thereof shall US 8,949,722 B2 5 6 include all those described in the summary of the disclosure, capable of different modes or different display dimensions. A brief description of the drawings, detailed description, single-screen application may not be capable of the several abstract, and claims themselves. modes discussed with the multi-screen application. The term “module” as used herein refers to any known or A 'single-display application” refers to an application that later developed hardware, software, firmware, artificial intel is capable of single display mode. Thus, the single-display ligence, fuzzy logic, or combination of hardware and soft application can produce only one window and may not be ware that is capable of performing the functionality associ capable of different modes or different display dimensions. A ated with that element. single-display application may not be capable of the several A "multi-screen application” refers to an application that is modes discussed with the multi-display application. capable of multiple modes. The multi-screen application 10 The term "screen,” “touchscreen,” or “touchscreen” refers mode can include, but is not limited to, a single screen mode to a physical structure that includes one or more hardware (where the application is displayed on a single screen) or a components that provide the device with the ability to render composite display mode (where the application is displayed a user interface and/or receive user input. A screen can on two or more screens). A multi-screen application can have encompass any combination of gesture capture region, a different layouts optimized for the mode. Thus, the multi 15 touch sensitive display, and/or a configurable area. The device screen application can have different layouts for a single can have one or more physical screens embedded in the hard screen or for a composite display that can encompass two or ware. However a screen may also include an external periph more screens. The different layouts may have different eral device that may be attached and detached from the screen/display dimensions and/or configurations on which device. In embodiments, multiple external devices may be the user interfaces of the multi-screen applications can be attached to the device. Thus, in embodiments, the screen can rendered. The different layouts allow the application to opti enable the user to interact with the device by touching areas mize the applications user interface for the type of display, on the screen and provides information to a user through a e.g., single screen or multiple screens. In single screen mode, display. The touch screen may sense user contact in a number the multi-screen application may present one window pane of of different ways, such as by a change in an electrical param information. In a composite display mode, the multi-screen 25 eter (e.g., resistance or capacitance), acoustic wave varia application may present multiple window panes of informa tions, infrared radiation proximity detection, light variation tion or may provide a larger and a richer presentation because detection, and the like. In a resistive touch screen, for there is more space for the display contents. The multi-screen example, normally separated conductive and resistive metal applications may be designed to adapt dynamically to lic layers in the screen pass an electrical current. When a user changes in the device and the mode depending on which 30 touches the screen, the two layers make contact in the con display (single or composite) the system assigns to the multi tacted location, whereby a change in electrical field is noted screen application. In alternative embodiments, the user can and the coordinates of the contacted location calculated. In a use agesture to request the application transition to a different capacitive touch screen, a capacitive layer stores electrical mode, and, ifa display is available for the requested mode, the charge, which is discharged to the user upon contact with the device can allow the application to move to that display and 35 touch screen, causing a decrease in the charge of the capaci transition modes. tive layer. The decrease is measured, and the contacted loca A "multi-display application” refers to an application that tion coordinates determined. In a Surface acoustic wave touch is capable of multiple modes. The multi-display application screen, an acoustic wave is transmitted through the screen, mode can include, but is not limited to, a single display mode and the acoustic wave is disturbed by user contact. A receiv (where the application is displayed on a single display) or a 40 ing transducer detects the user contact instance and deter composite display mode (where the application is displayed mines the contacted location coordinates. on two or more displays). A multi-display application can The term “window' refers to a, typically rectangular, dis have different layouts optimized for the mode. Thus, the played image on at least part of a display that contains or multi-display application can have different layouts for a provides content different from the rest of the screen. The single display or for a composite display that can encompass 45 window may obscure the desktop. two or more displays. The different layouts may have differ The preceding is a simplified Summary of the disclosure to ent screen/display dimensions and/or configurations on provide an understanding of Some aspects of the disclosure. which the user interfaces of the multi-display applications This Summary is neither an extensive nor exhaustive over can be rendered. The different layouts allow the application to view of the disclosure and its various aspects, embodiments, optimize the applications user interface for the type of dis 50 and/or configurations. It is intended neither to identify key or play, e.g., single screen or multiple screens. In single display critical elements of the disclosure nor to delineate the scope of mode, the multi-display application may present one window the disclosure but to present selected concepts of the disclo pane of information. In a composite display mode, the multi Sure in a simplified form as an introduction to the more display application may present multiple window panes of detailed description presented below. As will be appreciated, information or may provide a larger and a richer presentation 55 other aspects, embodiments, and/or configurations of the dis because there is more space for the display contents. The closure are possible utilizing, alone or in combination, one or multi-display applications may be designed to adapt dynami more of the features set forth above or described in detail cally to changes in the device and the mode depending on below. which display (single or composite) the system assigns to the multi-display application. In alternative embodiments, the 60 BRIEF DESCRIPTION OF THE DRAWINGS user can use a gesture to request the application transition to a different mode, and, if a display is available for the FIG. 1A includes a first view of an embodiment of a multi requested mode, the device can allow the application to move screen user device; to that display and transition modes. FIG. 1B includes a second view of an embodiment of a A 'single-screen application” refers to an application that 65 multi-screen user device; is capable of single Screen mode. Thus, the single-screen FIG. 1C includes a third view of an embodiment of a application can produce only one window and may not be multi-screen user device; US 8,949,722 B2 7 8 FIG. 1D includes a fourth view of an embodiment of a FIG. 7D is another representation of an embodiment of a multi-screen user device; logical window stack; FIG.1E includes a fifth view of an embodiment of a multi FIG. 7E is another representation of an embodiment of a screen user device; logical window stack; FIG. 1F includes a sixth view of an embodiment of a FIG. 8 is block diagram of an embodiment of a logical data multi-screen user device; structure for a window Stack; FIG. 1G includes a seventh view of an embodiment of a FIG. 9 is a flow chart of an embodiment of a method for multi-screen user device; creating a window stack; FIG. 1H includes a eighth view of an embodiment of a FIG. 10 illustrates an exemplary smartpad (SP). multi-screen user device; 10 FIG. 11 illustrates an exemplary method of associating the FIG.1I includes a ninth view of an embodiment of a multi smartpad with the device. screen user device; FIG. 12 illustrates a docked device with the smartpad. FIG.1J includes a tenth view of an embodiment of a multi FIGS. 13 A-13B illustrate an exemplary method for screen screen user device; orientation. FIG. 2 is a block diagram of an embodiment of the hard 15 FIG. 14 illustrates a method for displaying an application ware of the device; when the SP is in a landscape mode. FIG. 3A is a block diagram of an embodiment of the state FIG. 15 illustrates a method for displaying an application model for the device based on the device's orientation and/or when the SP is in a portrait mode. configuration; FIG. 16 illustrates an example of a dual screen application FIG. 3B is a table of an embodiment of the state model for in portrait max mode. the device based on the device's orientation and/or configu FIG. 17 illustrates an example of a dual screen application ration; in max mode landscape. FIG. 4A is a first representation of an embodiment of user FIG. 18 illustrates an example of keyboard management on gesture received at a device; the SP. FIG. 4B is a second representation of an embodiment of 25 FIG. 19 illustrates an example of keyboard management on user gesture received at a device; the SP with an application area in max mode. FIG. 4C is a third representation of an embodiment of user FIG. 20 illustrates another example of keyboard manage gesture received at a device; ment for the SP in landscape mode. FIG. 4D is a fourth representation of an embodiment of FIG. 21 illustrates an example of a dual screen application user gesture received at a device; 30 running in a dual screen emulation mode on the SP with a FIG. 4E is a fifth representation of an embodiment of user virtual keyboard. gesture received at a device: FIG.22 illustrates an example of application window stack FIG. 4F is a sixth representation of an embodiment of user management on the SP. gesture received at a device; FIG. 23 illustrates another example of application window FIG. 4G is a seventh representation of an embodiment of 35 stack management on the SP. user gesture received at a device; FIG.24 illustrates an example of multi application mode of FIG. 4H is a eighth representation of an embodiment of the SP, wherein in the multi application mode the SP emulates user gesture received at a device; the device in its mini-tablet form. FIG. 5A is a block diagram of an embodiment of the device FIG. 25 illustrates another example of multi application software and/or firmware; 40 mode of the SP. FIG.5B is a second block diagram of an embodiment of the FIG. 26 illustrates another example of multi application device software and/or firmware; mode of the SP. FIG. 6A is a first representation of an embodiment of a FIG. 27 illustrates another example of multi application device configuration generated in response to the device state; mode of the SP. FIG. 6B is a second representation of an embodiment of a 45 FIG. 28 illustrates a method for managing screen display. device configuration generated in response to the device state; FIG. 29 illustrates an exemplary method for managing FIG. 6C is a third representation of an embodiment of a screen display with the desktop. device configuration generated in response to the device state; FIG. 30 illustrates an exemplary method of managing FIG. 6D is a fourth representation of an embodiment of a screen display with a keyboard. device configuration generated in response to the device state; 50 FIGS. 31A and 31B illustrate desktop management on the FIG. 6E is a fifth representation of an embodiment of a SP device configuration generated in response to the device state; FIGS. 32A and 32 B illustrate exemplary methods for FIG. 6F is a sixth representation of an embodiment of a desktop panel management. device configuration generated in response to the device state; FIG.33 illustrates exemplary notification management on FIG. 6G is a seventh representation of an embodiment of a 55 the SP. device configuration generated in response to the device state; FIGS. 34A and 34B illustrate exemplary techniques for FIG. 6H is a eighth representation of an embodiment of a application management. device configuration generated in response to the device state; FIGS. 35A and 35B illustrate an exemplary method for FIG. 6I is a ninth representation of an embodiment of a providing desktop previews or hints. device configuration generated in response to the device state; 60 FIG. 36 illustrates an exemplary carousel application win FIG. 6J is a tenth representation of an embodiment of a dow stack. device configuration generated in response to the device state; FIG.37 illustrates an exemplary carousel application win FIG. 7A is representation of a logical window stack; dow stack with a virtual keyboard. FIG. 7B is another representation of an embodiment of a FIG.38 illustrates an exemplary method for associating the logical window stack; 65 device and the SP. FIG. 7C is another representation of an embodiment of a FIG. 39 illustrates an exemplary method for application logical window stack; reorientation based on SP orientation. US 8,949,722 B2 10 FIG. 40 illustrates an exemplary method for managing the the similar components having the same first reference label keyboard on the SP. irrespective of the second reference label. FIG. 41 illustrates an exemplary method for window manipulation based on one or more gestures. DETAILED DESCRIPTION FIG. 42 illustrates an exemplary method for application highlighting when an application is in focus in multi applica Presented herein are embodiments of a device. The device tion mode. can be a communications device. Such as a cellular telephone, FIG. 43 illustrates an exemplary method for application or other Smart device. The device can include two screens that maximization. are oriented to provide several unique display configurations. 10 Further, the device can receive user input in unique ways. The FIG. 44 illustrates an exemplary method for transitioning overall design and functionality of the device provides for an from an application window to the desktop. enhanced user experience making the device more useful and FIG. 45 illustrates an exemplary method for managing the more efficient. display of the desktop and/or one or more panels on the SP. Mechanical Features: FIG. 46 illustrates an exemplary method for merging pan 15 FIGS. 1A-1J illustrate a device 100 in accordance with els for display on the SP. embodiments of the present disclosure. As described in FIG. 47 illustrates an exemplary method for previewing greater detail below, device 100 can be positioned in a number one or more panels on the SP. of different ways each of which provides different function FIG. 48 illustrates an exemplary method for stack manage ality to a user. The device 100 is a multi-screen device that ment in multi application mode. includes a primary screen 104 and a secondary screen 108, FIG. 49 depicts a hierarchical relationship according to both of which are touch sensitive. In embodiments, the entire embodiment. front surface of screens 104 and 108 may be touch sensitive FIG.50 illustrates a display according to an embodiment. and capable of receiving input by a user touching the front FIG. 51 illustrates a display according to an embodiment. surface of the screens 104 and 108. Primary screen 104 FIG. 52 illustrates a display according to an embodiment. 25 includes touch sensitive display 110, which, in addition to FIG. 53 illustrates a display according to an embodiment. being touch sensitive, also displays information to a user. FIG. 54 illustrates a display according to an embodiment. Secondary screen 108 includes touch sensitive display 114, FIGS. 55A-F depict various displays according to an which also displays information to a user. In other embodi embodiment. ments, screens 104 and 108 may include more than one dis according to an 30 play area. FIGS. 56A-T depict various displays Primary screen 104 also includes a configurable area 112 embodiment. that has been configured for specific inputs when the user FIGS. 57A-E depict various displays according to an touches portions of the configurable area 112. Secondary embodiment. screen 108 also includes a configurable area 116 that has been FIGS. 58A-C depict various displays according to an 35 configured for specific inputs. Areas 112a and 116a have been embodiment. configured to receive a “back’ input indicating that a user FIGS. 59A-F depict various displays according to an would like to view information previously displayed. Areas embodiment. 112b and 116b have been configured to receive a “menu FIGS. 60A-D depict various displays according to an input indicating that the user would like to view options from embodiment. 40 a menu. Areas 112c and 116c have been configured to receive FIGS. 61A-D depict various displays according to an a “home’ input indicating that the user would like to view embodiment. information associated with a “home' view. In other embodi FIG. 62 illustrates a display according to an embodiment. ments, areas 112a-c and 116a-c may be configured, in addi FIG. 63 illustrates a display according to an embodiment. tion to the configurations described above, for other types of FIG. 64 illustrates a display according to an embodiment. 45 specific inputs including controlling features of device 100, FIG. 65 illustrates a display according to an embodiment. Some non-limiting examples including adjusting overall sys FIG. 66 illustrates a display according to an embodiment. tem power, adjusting the Volume, adjusting the brightness, FIG. 67 illustrates a display according to an embodiment. adjusting the vibration, selecting of displayed items (on either FIG. 68 illustrates a display according to an embodiment. of screen 104 or 108), operating a camera, operating a micro FIG. 69 illustrates a display according to an embodiment. 50 phone, and initiating/terminating of telephone calls. Also, in Some embodiments, areas 112a-C and 116a-C may be con FIG. 70 illustrates a display according to an embodiment. figured for specific inputs depending upon the application FIG. 71 illustrates a display according to an embodiment. running on device 100 and/or information displayed on touch FIG.72 illustrates a display according to an embodiment. sensitive displays 110 and/or 114. FIG. 73 illustrates a display according to an embodiment. 55 In addition to touch sensing, primary Screen 104 and sec FIG. 74 illustrates a display according to an embodiment. ondary screen 108 may also include areas that receive input FIG. 75 illustrates a display according to an embodiment. from a user without requiring the user to touch the display FIG. 76 illustrates a display according to an embodiment. area of the screen. For example, primary screen 104 includes FIG. 77 illustrates a display according to an embodiment. gesture capture area 120, and secondary screen 108 includes FIG. 78 illustrates an exemplary method for selecting a 60 gesture capture area 124. These areas are able to receive input display configuration. by recognizing gestures made by a user without the need for In the appended figures, similar components and/or fea the user to actually touch the surface of the display area. In tures may have the same reference label. Further, various comparison to touch sensitive displays 110 and 114, the ges components of the same type may be distinguished by fol ture capture areas 120 and 124 are commonly not capable of lowing the reference label by a letter that distinguishes among 65 rendering a displayed image. the similar components. If only the first reference label is used The two screens 104 and 108 are connected together with in the specification, the description is applicable to any one of a hinge 128, shown clearly in FIG. 1C (illustrating a back