TOMMUNOMUS009772751B2 U KUTIMULON NATION ( 12 ) United States Patent ( 10) Patent No. : US 9 ,772 , 751 B2 Anzures et al. ( 45 ) Date of Patent : Sep . 26 , 2017 ( 54 ) USING GESTURES TO SLIDE BETWEEN ( 56 ) References Cited USER INTERFACES U . S . PATENT DOCUMENTS (75 ) Inventors : Freddy Allen Anzures, San Francisco , CA (US ) ; Marcel Van Os, San 5 , 051, 736 A 9 / 1991 Bennett et al . Francisco , CA (US ) ; Imran Chaudhri, 5 , 146 ,556 A 9/ 1992 Hullot et al...... 395 / 159 San Francisco , CA (US ) ; Michael ( Continued ) Matas, San Francisco , CA (US ) ; Stephen O . Lemay , San Francisco , CA FOREIGN PATENT DOCUMENTS (US ) ; Scott Herz , San Jose, CA (US ) AU 2006338183 AL 8 /2007 AU 2012202140 A1 5 /2012 ( 73 ) Assignee : APPLE INC ., Cupertino , CA ( US ) (Continued ) ( * ) Notice : Subject to any disclaimer , the term of this patent is extended or adjusted under 35 OTHER PUBLICATIONS U . S . C . 154 ( b ) by 494 days . “ Transition Effects ,” RealNetworks Inc ., 2001, http :/ /web .archive . (21 ) Appl. No. : 12 /217 ,029 org /web / 20011214191845/ http :/ / service .real . com /help / library / guides / realone /ProductionGuide / HTML /htmfiles / transit . htm .* ( 22 ) Filed : Jun . 30 , 2008 (Continued ) (65 ) Prior Publication Data Primary Examiner - Eric Wiener US 2009 /0007017 A1 Jan . 1, 2009 ( 74 ) Attorney, Agent, or Firm — Morrison & Foerster Related U . S . Application Data LLP (60 ) Provisional application No . 61 /019 ,841 , filed on Jan . (57 ) ABSTRACT 8 , 2008 , provisional application No . 61/ 010 , 208, filed A first user interface is displayed without concurrently ( Continued ) displaying a second user interface that is distinct from the (51 ) Int. CI. first user interface . A gesture to select the second user GOOF 3 /0483 ( 2013 . 01 ) interface is detected on the touch screen display. In response G06F 3 / 0482 to detecting the gesture , an animation is displayed of a ( 2013 . 01 ) transition from display of the first user interface to display (Continued ) of the second user interface . The animation comprises (52 ) U .S . CI. sliding a first element of the second user interface onto the CPC ...... G06F 3 /0483 (2013 .01 ); G06F 3 /0482 display from a first side of the display while simultaneously (2013 .01 ) ; G06F 3 / 04883 ( 2013. 01 ) ; sliding a second element of the second user interface that ( Continued ) contacts the first element horizontally across the top of the (58 ) Field of Classification Search first element. The first element of the second user interface CPC .. .. GOOF 3 / 0487 ; GO6F 3 /0482 ; G06F 3 /0483 ; is distinct from the second element of the second user HO4N 21 / 4438 ; G06T 13 / 00 ; G06T interface . 2213 /00 ; G05B 2219 /23129 ( Continued ) 27 Claims, 113 Drawing Sheets
Portable Multifunction Device 206 100 Speaker 111 Optical Proximity 150059 Sensor 164 Sensor 166 208 2081 Enter Passcode Wallpaper image 314
Come1502 . 3 1502 - 2 15021
1504 1 DEF 6 GHI MNO PQRS TUV WXYZ Microphore ! Home 113 204 US 9 ,772 ,751 B2 Page 2
Related U . S . Application Data 6 ,297 ,795 B1 10 /2001 Kato et al. 6 , 313 , 853 B1 11 / 2001 Lamontagne et al. on Jan . 6 , 2008 , provisional application No . 60 / 937 , 6 ,313 ,855 B1 11 /2001 Shuping et al. 993 , filed on Jun . 29 , 2007 . 6 , 317 , 140 B1 11 / 2001 Livingston et al. 6 , 323 , 846 B1 11 / 2001 Westerman et al...... 345 /173 6 , 326 , 970 B1 12 / 2001 Mott et al. (51 ) Int . Cl. 6 , 349 .410 B1 2 / 2002 Lortz G06F 3 /0488 ( 2013 . 01 ) 6 , 353 ,451 B1 * 3 /2002 Teibel et al ...... 715 / 803 H04M 1/ 725 ( 2006 .01 ) 6 , 359 ,615 B1 3 / 2002 Singh HO4N 21/ 443 ( 2011 .01 ) 6 ,377 , 698 B1 . 4 /2002 Cumoli et al. G06T 13 /00 6 , 396 ,520 B1 * 5 / 2002 Ording . 715 / 798 ( 2011 .01 ) 6 ,407 , 757 B1 * 6 / 2002 Ho ...... GO6F 3 /03547 H04M 1 /2745 ( 2006 . 01 ) 715 /702 (52 ) U . S . CI. 6 ,411 , 283 B1 6 / 2002 Murphy CPC .. . H04M 1/ 72522 ( 2013 .01 ) ; H04M 1/ 72583 6 , 433, 801 B1 . 8 / 2002 Moon et al...... 345 / 840 6 ,466 ,198 B1 10 / 2002 Feinstein ( 2013 .01 ) ; G06T 13 /00 ( 2013 . 01 ) ; H04M 6 , 466 , 203 B2 10 / 2002 Van Ee 1 / 274525 ( 2013 . 01 ) ; H04M 1 /72544 ( 2013 . 01 ) ; 6, 486 ,895 B1 11/ 2002 Robertson et al. H04M 1 / 72552 ( 2013 .01 ); H04M 1/ 72561 6, 489 , 975 B1 12 / 2002 Patil et al. ( 2013 .01 ) ; H04M 2250 / 12 ( 2013 .01 ); H04M 6 , 496 , 182 B1 12 / 2002 Wong et al . 2250 / 22 ( 2013 .01 ) ; H04N 21 /4438 (2013 .01 ) 6 ,545 ,669 B14 / 2003 Kinawi et al...... 345 / 173 6 , 570 ,557 B1 5 / 2003 Westerman et al...... 345 / 173 (58 ) Field of Classification Search 6 , 570 , 583 B1 5 / 2003 Kung et al . USPC ...... 715 /726 , 767 , 778 , 802 , 810 , 835 , 837, 6 ,590 ,568 B1 7 / 2003 Astala et al...... 345 / 173 715 /838 , 840 , 863 6 ,597 , 391 B2 * 7 / 2003 Hudson ...... GO8B 13 / 19641 See application file for complete search history . 340 / 3 . 1 6 , 613 , 100 B2 9 / 2003 Miller 6 , 621, 768 B1 . 9 / 2003 Keller et al. (56 ) References Cited 6 , 628, 309 B1 9 / 2003 Dodson et al . 6 ,629 ,793 B1 10 / 2003 Miller U .S . PATENT DOCUMENTS 6 ,639 ,584 B110 / 2003 Li 5 , 196 , 838 A 3 / 1993 Meier et al. 6 ,677 , 932 B11 / 2004 Westerman 345 / 173 5 ,491 , 778 A * 2 / 1996 Gordon et al...... 345 /640 6 ,683 ,628 B1 * 1 / 2004 Nakagawa ...... G06F 3 /0485 5 ,598 ,524 A 1/ 1997 Johnston , Jr . et al. 345 /672 5 ,610 ,653 A 3 / 1997 Abecassis 6 , 700 , 612 B1 3 /2004 Anderson et al . 5 ,612 ,719 A 3 / 1997 Beernink et al. 6 , 710 ,788 B1 3 /2004 Freach et al . 5 ,642 ,490 A 6 / 1997 Morgan et al...... 395 / 342 6 , 714 , 222 B1 3 / 2004 Bjorn et al. 5 ,644 , 739 A 7 / 1997 Moursundd 395 / 354 6 , 727 , 916 B1 4 / 2004 Ballard 5 ,657 ,049 A 8 / 1997 Ludolph et al. 6 , 763 , 388 B1 7 /2004 Tsimelzon ...... 709 /228 5 , 726 ,687 A 3 / 1998 Belfiore et al. 345 / 341 6 , 771 , 250 B1 8 / 2004 Oh 5 , 745 , 096 A 4 / 1998 Ludolph et al. 6 ,781 , 575 B1 8 / 2004 Hawkins et al...... 345 / 173 5 ,745 , 116 A 4 / 1998 Pisutha - Arnond 6 , 820, 111 B1 11 /2004 Rubin et al. 5 , 745 , 910 A * 4 / 1998 Piersol et al ...... 715 / 210 6 , 915 , 294 B1 7 / 2005 Singh et al . 5 ,754 , 179 A *. 5 / 1998 Hocker et al ...... 715 /835 6, 915 , 490 B1 7 / 2005 Ewing et al. 5 , 757 , 371 A 5 / 1998 Oran et al. 345 / 348 6 , 928 , 461 B2 8 / 2005 Tuli 5 ,760 , 773 A 6 / 1998 Berman et al ...... 345 / 347 6 , 931, 601 B2 8 / 2005 Vronay et al...... 715 /767 5 , 774 ,119 A 6 / 1998 Alimpich et al. 6 , 934 , 911 B28 / 2005 Salmimaa et al . 5 ,796 ,401 A * 8 / 1998 Winer ...... 345 /619 6 , 950 , 949 B1 * 9 /2005 Gilchrist ...... GO6F 21/ 36 5 ,812 , 862 A * 9 / 1998 Smith et al...... 715 / 209 726 / 19 5 , 825 , 349 A 10 / 1998 Meier et al . 6 , 956 , 564 B1 10 / 2005 Williams 5 ,825 , 357 A 10 / 1998 Malamud et al...... 345 / 340 6 , 970 ,749 B1 * 11/ 2005 Chinn et al...... 700 / 12 5 , 870 ,683 A * 2 / 1999 Wells et al...... 455 / 566 6 ,976 , 210 B1 * 12 / 2005 Silva et al ...... 715 / 205 5 , 877 , 765 A 3 / 1999 Dickman et al...... 345 / 349 6 , 978 , 127 B1 12 / 2005 Bulthuis et al ...... 455 /412 . 1 5 ,914 ,716 A * 6 / 1999 Rubin et al...... 715 /779 6 , 987 , 991 B2 1 /2006 Nelson 5 ,914 , 717 A * 6 / 1999 Kleewein et al. 715 /843 6 , 990, 452 B1 1 / 2006 Ostermann et al. 5 , 923 , 327 A * 7 / 1999 Smith et al...... 715 /784 7 , 007 , 239 B1 2 / 2006 Hawkins et al . 5 , 934 , 707 A 8 / 1999 Johnson 7 , 017, 118 B1 3 / 2006 Carroll et al. 5 , 995 , 106 A 11/ 1999 Naughton et al...... 345 /357 7 , 030, 861 B1 4 / 2006 Westerman et al . 6 ,025 , 842 A 2 / 2000 Filetto et al . 7 ,054 , 965 B2 5 / 2006 Bell et al . 6 , 043 ,818 A * 3 / 2000 Nakano et al...... 715 / 851 7, 071 ,943 B2 * 7 / 2006 Adler 345 /473 6 , 049, 336 A * 4 / 2000 Liu et al...... 715 / 830 7 , 075 , 512 B1 7 / 2006 Fabre et al. 6 , 069 ,626 A 5 / 2000 Cline et al. 7 , 085 , 590 B28 / 2006 Kennedy et al. 6 ,072 ,486 A 6 / 2000 Sheldon et al ...... 345 /339 7 ,093 , 201 B2 8 / 2006 Duarte 6 ,073 ,036 A 6 / 2000 Heikkinen et al. 7 , 134 ,095 B1 11/ 2006 Smith et al...... 715 / 860 6 , 111 , 573 A * 8 / 2000 McComb et al ...... 715 / 763 7 , 149 ,549 B1 12 / 2006 Ortiz et al. 6 , 133 , 914 A * 10 / 2000 Rogers et al ...... 345 /661 7 , 166 ,791 B2 1 / 2007 Robbin et al. 6 , 144 ,863 A 11/ 2000 Charron . .. . 455 / 566 7 , 167 , 731 B2 1 / 2007 Nelson 6 , 145 ,083 A 11 / 2000 Shaffer et al. 7 , 171 , 625 B1 1/ 2007 Sacchi 6 , 177 , 936 B1 1 / 2001 Cragun 7 , 221 , 933 B2 5 /2007 Sauer et al. 6 , 195 ,094 B1 * 2 / 2001 Celebiler ...... 715 / 764 7 , 231 ,229 B1 6 /2007 Hawkins et al...... 455 / 564 6 , 199 ,082 B1 3 / 2001 Ferrel et al. 7 ,283 , 845 B2 10 / 2007 De Bast ...... 455 /566 6 , 229 , 542 B1 * 5 / 2001 Miller 715 / 782 7 , 310, 636 B2 12 / 2007 Bodin et al . 6 , 243 ,080 B1 6 / 2001 Molne 7 ,346 , 855 B2 3 /2008 Hellyar et al. 6 , 256, 008 B1 7 / 2001 Sparks et al. 7 ,355 , 593 B2 4 / 2008 Hill et al...... 345 / 173 6 , 262 , 732 B1 7 / 2001 Coleman et al. 7 , 360 , 166 B1 4 /2008 Krzanowski 6 , 262, 735 B1 . 7 / 2001 Eteläperä 7 , 362, 331 B2 * 4 / 2008 Ording .. . .. 345 / 473 6 ,271 , 841 B1 8 / 2001 Tsujimoto 7 ,432 ,928 B2 * 10 /2008 Shaw et al...... 345 / 473 6 , 275, 935 B1 . 8 / 2001 DallowBarlow et al...... 713 / 182 NNNNNNNN7 ,434 , 177 B1 * 10 /2008 Ording et al...... 715 /862 6 , 278 ,454 B1 . 8 / 2001 Krishnan ...... 345 / 349 7, 437 ,005 B2 10 / 2008 Drucker et al. US 9 ,772 ,751 B2 Page 3
(56 ) References Cited 2002 /0104096 AL 8 /2002 Cramer et al. 2002 / 0152283 A1 10 / 2002 Dutta et al . U . S . PATENT DOCUMENTS 2002 / 0188948 A1 12 / 2002 Florence 2002 /0191029 A1 12 / 2002 Gillespie et al ...... 345 /810 7 , 461, 353 B2 12 /2008 Rohrabaugh et al. 2003 / 0007012 A1 1/ 2003 Bate 7 ,480 , 870 B2 1 / 2009 Anzures et al. 2003 /0013483 Al 1 / 2003 Ausems et al. 7 ,487 , 467 B1 * 2 / 2009 Kawahara et al. 715 /810 2003/ 0014415 A1 1 / 2003 Weiss et al. 7 .490 ,295 B2 * 2 / 2009 Chaudhri et al...... 715 / 764 2003 /0016241 A1 1 / 2003 Burke ...... 345 / 753 7 , 493 , 573 B2 * 2 /2009 Wagner ...... 715 /864 2003 / 0025676 A1 2 / 2003 Cappendijk 7 , 506 , 268 B2 * 3 / 2009 Jennings et al...... 715 / 786 2003/ 0030664 A1 2 /2003 Parry 7 , 509 , 588 B2 3 / 2009 van Os et al...... 715 /835 2003/ 0033331 A1 2 /2003 Sena et al. 7 ,512 ,898 B2 * 3 / 2009 Jennings et al. 715 / 822 2003 / 0048295 A1 * 3 / 2003 Lilleness et al...... 345 / 738 7 ,526 , 738 B2 * 4 / 2009 Ording et al ...... 715 / 862 2003 /0063125 AI 4 / 2003 Miyajima et al . 7 , 546 , 548 B2 * 6 / 2009 Chew et al...... 715 /810 2003 / 0081135 A 5 / 2003 Boll 7 , 546 , 554 B2 * 6 / 2009 Chiu et al...... 715 / 864 2003 / 0090572 A1 * 5 /2003 Belz et al...... 348/ 207. 1 7 , 561, 874 B2 * 7 / 2009 Wang et al ...... 455 /418 2003 /0095135 A1 5 / 2003 Kaasila et al . 7 , 587 , 671 B2 9 / 2009 Saft et al. 2003/ 0095155 A1 5 / 2003 Johnson 7 , 587 , 683 B2 . 9 / 2009 Ito et al . 2003/ 0117427 A1 6 /2003 Haughawout et al . 7 ,603 , 105 B2 10 / 2009 Bocking et al. 2003 / 0117440 AL 6 /2003 Hellyar et al . 7 ,614 , 008 B2 11/ 2009 Ording 2003/ 0132938 Al * 7 / 2003 Shibao ...... G06T 13 /00 7 ,624 , 357 B2 11/ 2009 De Bast .. . . 715 /828 345 /473 7 ,633 ,076 B2 12/ 2009 Huppi et al . 2003 /0164861 AL 9 /2003 Barbanson et al . 7 ,642 , 934 B2 * 1 / 2010 Scott 341/ 23 2003 /0169298 A1 * 9 / 2003 Ording ...... 345 /810 7 , 650 , 137 B2 1/ 2010 Jobs et al. 2003 /0174172 A1 9 / 2003 Conrad et al. 7 , 653 , 883 B2 1 / 2010 Hotelling et al . 2003 /0184552 A1 * 10 / 2003 Chadha . . 345 /581 7 ,657 ,252 B2 2 / 2010 Futami 2003 / 0184587 Al 10 / 2003 Ording et al ...... 345 / 769 7 , 657 , 849 B2 2 / 2010 Chaudhri et al. 2003 / 0193524 A1 10 / 2003 Bates et al . 7 ,663 , 607 B2 . 2 /2010 Hotelling et al. 2003 /0200289 A 10 / 2003 Kemp et al. 709 /221 7 , 669, 135 B2 2 / 2010 Cunningham et al. 2003 / 0206195 AL 11/ 2003 Matsa et al...... 345 /744 7 , 683 , 889 B2 3/ 2010 Rimas Ribikauskas et al. 2003 /0206197 A1 * 11 / 2003 McInerney ...... 345 / 764 7 , 694 , 231 B2 4 /2010 Kocienda et al . 2003 / 02 10280 A1 11/ 2003 Baker et al . 7 ,719 ,542 B1 * 5 /2010 Gough et al. .. . . 345 /581 2003 /0225811 A1 * 12 / 2003 Ali GO6F 8 / 10 7 ,720 ,893 B2 5 / 2010 Boudreau et al . 718 / 101 7 , 730 ,401 B2 6 / 2010 Gillespie et al. 2004 /0021643 AL 2 /2004 Hoshino et al. 7 , 735 , 021 B2 6 /2010 Padawer et al . 2004 / 0041849 Al 3 /2004 Mock et al . 7 , 739 , 271 B2 6 / 2010 Cook et al . 2004 / 0056839 A1 3 / 2004 Yoshihara 7, 739 , 604 B1 . 6 / 2010 Lyons et al . 2004 / 0093582 Al 5 / 2004 Segura 7 , 747, 289 B2 * 6 / 2010 Wang et al. 455 /566 2004 /0103156 AL 5 / 2004 Quillen et al ...... 709 / 206 7 ,783 ,583 B2 . 8 / 2010 Sendhoff et al. 2004 / 0103371 Al 5 / 2004 Chen et al . 7 ,783 , 990 B2 * 8 / 2010 Amadio et al...... 715 /809 2004 / 0109025 A1 6 / 2004 Hullot et al. NNNN7 , 788, 583 B1 . 8 / 2010 Amzallag et al. 2004 /0121823 A1 * 6 /2004 Noesgaard et al...... 455 /575 .1 7 , 805 ,684 B2 * 9 / 2010 Arvilommi ...... 715 / 829 2004 /0138569 Al 7 / 2004 Grunwald et al . 7 , 810 . 038 B2 10 / 2010 Matsa et al ...... 715 / 765 2004 /0141011 A1 7 / 2004 Smethers et al. 7 , 831, 926 B2 11/ 2010 Rohrabaugh et al. 2004 /0143796 A1 7 / 2004 Lerner et al. 7 , 835 , 729 B2 11/ 2010 Hyon 2004 / 0155909 A1 * 8 / 2004 Wagner...... 345/ 854 7 , 840 , 901 B2 11/ 2010 Lacey et al. 2004 / 0169674 A1 9 / 2004 Linjama 7 ,844 ,889 B2 11 / 2010 Rohrabaugh et al . 2004 /0177148 AL 9 /2004 Tsimelzon , Jr . .. . 709 /227 7 , 844 , 914 B2 11/ 2010 Andre et al. 2004 /0201595 AL 10 /2004 Manchester 7 , 853 ,972 B2 * 12 / 2010 Brodersen et al...... 725/ 40 2004 /0205492 Al 10 /2004 Newsome 7 , 856 ,602 B2 * 12 / 2010 Armstrong ...... 715 / 830 2004 / 0205496 Al 10 / 2004 Dutta et al . 7 , 917, 846 B2 3 / 2011 Decker et al . 2004 / 0215719 A1 * 10 / 2004 Altshuler 709 / 204 7 , 934 ,152 B2 4 /2011 Krishnamurthy et al. 2004 /0221006 A1 11 / 2004 Gopalan et al. 7 , 940 , 250 B2 5 / 2011 Forstall 2004 / 0222975 A1 * 11/ 2004 Nakano et al. 345 /173 7 , 957 , 762 B2 6 / 2011 Herz et al . 2004 /0268400 A112 / 2004 Barde et al . 7 ,958 ,457 B1 6 / 2011 Brandenberg et al. 2005 / 0005246 AL 1 / 2005 Card et al ...... 715 /776 7 , 996, 789 B2 8 / 2011 Louch et al . 2005 / 0005248 Al 1 / 2005 Rockey et al. 8 ,006 , 002 B2 8 /2011 Kalayjian et al . 2005 /0020317 A1 1 /2005 Koyama 8 , 239 , 784 B2 8 / 2012 Hotelling et al. 2005/ 0024341 A1 2 /2005 Gillespie et al. 8 ,279 , 180 B2 10 / 2012 Hotelling et al . 2005 / 0026644 A1 2 / 2005 Lien 455 /550 . 1 8 , 365 , 084 B1 1 /2013 Lin et al . 2005 / 0039134 A1 2 / 2005 Wiggeshoff et al . 8 , 381 , 135 B2 2 / 2013 Hotelling et al . 2005 / 0044509 Al 2 / 2005 Hunleth et al. 8 , 446, 371 B2 5 / 2013 Fyke et al . 2005 /0057524 A1 3 / 2005 Hill et al...... 345 / 173 8 ,479 , 122 B2 7 / 2013 Hotelling et al . 2005 / 0057548 A1 * 3 / 2005 Kim ...... 345 / 204 8 , 519 , 964 B2 8 / 2013 Platzer et al . 2005 /0060653 A1 3 /2005 Fukase et al. 8 , 519, 972 B2 8 /2013 Forstall et al. 2005/ 0060664 A1 * 3 / 2005 Rogers .. . 715 / 810 8 , 558 , 808 B2 10 / 2013 Forstall et al . 2005 / 0060665 A1 3 / 2005 Rekimoto ...... 715 /810 8 ,601 , 370 B2 12 / 2013 Chiang et al. 2005 /0066286 A1 3 / 2005 Makela 8 ,619 , 038 B2 12 / 2013 Chaudhri et al . 2005 /0071364 Al 3 / 2005 Xie et al. 8 , 788, 954 B2 7 / 2014 Lemay et al. 2005 /0071736 Al 3 / 2005 Schneider et al . 2001/ 0024195 A1 9 / 2001 Hayakawa ...... 345 / 173 2005/ 0071778 A1 3 / 2005 Tokkonen 2001 /0024212 A1 9 / 2001 Ohnishi ...... 345 / 769 2005 / 0078804 Al 4 / 2005 Yomoda 2002 /0015024 AL 2 / 2002 Westerman et al ...... 345 / 173 2005 / 0079896 Al 4 / 2005 Kokko et al. 2002 / 0015042 A1 2 / 2002 Robotham et al...... 345 / 581 2005 /0091609 Al 4 / 2005 Matthews et al...... 715 /804 2002 /0015064 AL 2 / 2002 Robotham et al . 2005 /0093826 A1 5 / 2005 Huh 2002 / 0024540 A1 * 2 / 2002 McCarthy ...... 345 /844 2005 / 0097089 Al * 5 / 2005 Nielsen et al ...... 707 / 3 2002 / 0038299 Al 3 / 2002 Zernik et al . 2005 /0108657 A1 * 5 /2005 Han ...... GO6F 3 /04817 2002 /0054090 A1 5 /2002 Silva et al. 345 / 747 715 / 827 2002 /0085037 Al 7 /2002 Leavitt et al...... 345 / 765 2005 / 0114788 AL 5 /2005 Fabritius 2002 / 0093531 A1 7 / 2002 Barile 2005 /0120142 A16 /2005 Hall US 9, 772 ,751 B2 Page 4
References Cited 2006 /0242607 A1 * 10 /2006 Hudson ...... 715 / 863 ( 56 ) 2006 / 0265643 A1 11/ 2006 Saft et al. U . S . PATENT DOCUMENTS 2006 / 0271864 A1 11/ 2006 Satterfield et al . 2006 / 0271867 AL 11/ 2006 Wang et al. 2005 /0134578 A1 6 / 2005 Chambers et al ...... 345 / 184 2006 / 0271874 Al 11/ 2006 Raiz et al. 715 / 767 2005 /0154798 Al 7 / 2005 Nurmi 2006 / 0277460 Al 12 / 2006 Forstall et al. . 715 /513 2005 /0156873 A1 7 / 2005 Walter et al . 2006 / 0277588 A1 12 / 2006 Harrington et al. 2005 /0166232 Al 7/ 2005 Lamkin et al . 2006 /0278692 A1 12 / 2006 Matsumoto et al...... 235 / 375 2005 /0169527 Al 8 / 2005 Longe et al. 2006 / 0282786 A1 * 12 / 2006 Shaw et al . .. . 715 /762 2005 /0177783 A1 8 / 2005 Agrawala et al . 2006 /0282790 A1 12 / 2006 Matthews et al. 2005/ 0183017 A1 8 / 2005 Cain 2006 /0284852 Al 12 / 2006 Hofmeister et al...... 345 / 173 2005 /0190059 AL 9 /2005 Wehrenberg 2006 /0290661 A1 * 12 / 2006 Innanen et al...... 345 / 156 2005 /0192924 A1 9 / 2005 Drucker et al . 2007 / 0004451 A11 / 2007 Anderson 2005/ 0204385 A1 9 / 2005 Sull et al. 2007 / 0013665 AL 1 / 2007 Vetelainen et al...... 345 / 169 2005 / 0210018 AL 9 / 2005 Singh et al . 2007 / 0022386 A11 / 2007 Boss et al . 2005 /02 10369 Al * 9 / 2005 Damm , Jr ...... G06F 17 / 246 2007 / 0024646 A1 2 / 2007 Saarinen et al. 715 /213 2007 /0028269 A1 * 2 /2007 Nezu et al...... 725 / 52 2005 /0210403 A1 * 9 /2005 Satanek ...... GO6F 3 /04855 2007 /0030362 A1 * 2 /2007 Ota et al...... 348 / 239 715 /786 2007 / 0038612 AL 2 / 2007 Sull et al. 2005 / 0229102 Al 10 /2005 Watson et al...... 715 / 739 2007 /0055947 A1 * 3 /2007 Ostojic et al...... 715 /800 2005 / 0229118 A1 10 / 2005 Chiu et al. 2007 / 0067272 A1 * 3 / 2007 Flynt et al...... 707 /3 2005 / 0250438 A1 11 /2005 Makipaa et al ...... 455 / 3 .06 2007 /0067738 A1 3 / 2007 Flynt et al. 2005 /0251755 A1 11/ 2005 Mullins, II et al...... 715 / 779 2007 /0083827 Al 4 / 2007 Scott et al. 2005 /0253817 A1 * 11/ 2005 Rytivaara ...... GO6F 3 /04883 2007 / 0083911 A1 * 4 /2007 Madden et al ...... 725 / 135 345 / 173 2007 /0101292 AL 5 /2007 Kupka 2005 /0262448 A1 11/ 2005 Vronay et al...... 715 / 767 2007/ 0101297 A1 * 5 /2007 Forstall et al...... 715 /841 2005 /0267869 Al 12 / 2005 Horvitz et al. 2007 / 0106952 A1 5 /2007 Matas et al. 2005 /0275636 Al 12 / 2005 Dehlin et al...... 345 /173 2007 /0124677 A1 5 /2007 de los Reyes et al ...... 715 / 705 2005 / 0285880 AL 12 / 2005 Lai et al . 2007 /0132789 A1 6 / 2007 Ording et al. 2005 /0289458 A1 12 / 2005 Kylmanen 715 /513 2007 /0150810 A1 6 /2007 Katz et al. 2005 / 0289476 A1 12 / 2005 Tokkonen 2007/ 0150830 A1 6 /2007 Ording et al. 2006 / 0005207 AL 1 / 2006 Louch et al. 2007 /0152980 A1 7 /2007 Kocienda et al . 2006 / 0007182 AL 1 / 2006 Sato et al. 2007 /0152984 Al 7 /2007 Ording et al. 2006 /0017692 A11 /2006 Wehrenberg et al. 2007 /0155434 Al 7 /2007 Jobs et al . 2006 /0025110 A1 * 2 / 2006 Liu 455 /411 2007 /0156697 A1 7 / 2007 Tsarkova .. .. . 707 / 9 2006 /0026170 A1 2 / 2006 Kreitler et al . 2007 /0157089 A1 * 7 /2007 Van Os et al ...... 715 /702 2006 /0026521 A1 2 /2006 Hotelling et al. 2007 /0157228 A1 7 /2007 Bayer et al . 2006 / 0026536 A1 * 2 / 2006 Hotelling et al . 715 / 863 2007 /0177803 AL 8 / 2007 Elias et al. 382 / 188 2006 /0033724 Al 2 / 2006 Chaudhri et al. 2007 /0177804 AL 8 / 2007 Elias et al . 2006 /0033751 A1 2 /2006 Keely et al. 2007/ 0180395 A1 * 8 / 2007 Yamashita et al...... 715 / 778 2006 /0033761 A1 2 / 2006 Suen et al. 2007 /0189737 A1 * 8 / 2007 Chaudhri et al ...... 386 / 125 2006 /0036944 AL 2 / 2006 Wilson 2007 /0192741 A1 * 8 / 2007 Yoritate et al...... 715 / 828 2006 /0051073 A1 * 3 / 2006 Jung et al ...... 386 / 125 2007 /0200713 AL 8 / 2007 Weber et al. 2006 /0053386 A1 3 / 2006 Kuhl et al. 2007/ 0204218 AL 8 / 2007 Weber et al . 2006 /0053387 AL 3 /2006 Ording 2007 /0233695 Al 10 /2007 Boudreau et al. 2006 /0055662 AL 3 / 2006 Rimas -Ribikauskas et al. 2007 /0240079 A1 * 10 / 2007 Flynt et al...... 715 /810 2006 / 0055700 A1 3 / 2006 Niles et al. 2007/ 0243862 A1 * 10 / 2007 Coskun et al . 455 /418 2006 /0064647 Al 3 /2006 Tapuska et al . 2007 /0245250 A1 * 10 / 2007 Schechter et al...... 715 /760 2006 / 0075355 Al 4 / 2006 Shiono et al . 715 / 778 2007/ 0250768 A 10 /2007 Funakami et al. 2006 / 0080616 A1 4 / 2006 Vogel et al. . . . 715 / 769 2007 / 0254722 Al * 11/ 2007 Kim ...... GO6F 3 /0485 2006 /0085743 A1 4 / 2006 Baudisch et al. 455 / 566 2006 / 0085763 Al 4 / 2006 Leavitt et al. 2007 / 0260999 A1 11/ 2007 Amadio et al . 2006 /0097991 A1 5 / 2006 Hotelling et al. 2007 /0263176 AL 11/ 2007 Nozaki et al. 2006 / 0101354 Al 5 / 2006 Hashimoto et al. 2007 /0266011 AL 11/ 2007 Rohrs et al . 2006 / 0105814 Al 5 / 2006 Monden et al . 2007 /0266342 AL 11/ 2007 Chang et al. 2006 /0112335 Al 5 / 2006 Hofmeister et al ...... 715 /701 2007 /0288860 A1 12 / 2007 Ording et al ...... 715 / 779 2006 /0116578 A1 6 / 2006 Grunwald et al . 2007 /0288862 A1 * 12 / 2007 Ording ...... 715 / 788 2006 /0117197 A1 6 / 2006 Nurmi 2007 /0288868 A1 12 / 2007 Rhee et al. 2006 /0123360 A1 * 6 / 2006 Anwar et al. 715 / 810 2007 /0300160 A112 / 2007 Ferrel et al . 2006 /0125799 A1 6 / 2006 Hillis et al. 2008 / 0001924 A1 * 1 / 2008 de los Reyes et al ...... 345 / 173 2006 /0129647 Al 6 / 2006 Kaghazian 2008 / 0005703 A1 * 1 / 2008 Radivojevic et al...... 715 / 863 2006 / 0143574 AL 6 / 2006 Ito et al. 2008 / 0034309 A1 * 2 / 2008 Louch et al...... 715 / 766 2006 /0146016 A1 7 / 2006 Chan et al . 2008 / 0042984 A1 2 / 2008 Lim et al . 2006 / 0146038 Al 7 / 2006 Park et al. 2008/ 0059906 A1 3 / 2008 Toki 2006 / 0148526 Al 7 / 2006 Kamiya et al. 2008 / 0062137 AL 3 /2008 Brodersen et al. 2006 /0153531 Al 7 / 2006 Kanegae et al . 2008/ 0082930 A1 4 /2008 Omernick et al. 2006 /0161871 Al 7 /2006 Hotelling et al. 2008 /0104515 Al 5 / 2008 Dumitru et al . 2006 /0168510 A1 7 /2006 Bryar et al. 2008 /0122796 A1 5 /2008 Jobs et al...... 345 / 173 2006 /0174211 A1 8 / 2006 Hoellerer et al. 2008/ 0125180 A1 * 5 / 2008 Hoffman et al...... 455 / 566 2006 /0179415 Al 8 / 2006 Cadiz et al . 2008/ 0132252 A16 / 2008 Altman et al. 2006 /0190833 Al 8 / 2006 Sangiovanni et al. 2008 / 0139176 AL 6 /2008 Kim 2006 /0197753 AL 9 / 2006 Hotelling . . .. 345 / 173 2008 /0161045 A1 * 7 / 2008 Vuorenmaa ...... 455/ 556 . 1 2006 /0209035 AL 9 / 2006 Jenkins et al. 2008 /0168075 A1 7 / 2008 Kamiyabu 2006 /0224997 Al 10 / 2006 Wong et al. 2008 /0168367 A1 7 /2008 Chaudhri et al...... 715 / 764 2006 /0236266 A1 * 10 / 2006 Majava ...... 715 / 810 2008/ 0168401 A1 * 7 / 2008 Boule et al ...... 715 /863 2006 /0238625 Al 10 / 2006 Sasaki et al. 2008/ 0168478 AL 7 / 2008 Platzer et al. 2006 /0242145 A1 10 /2006 Krishnamurthy et al. 2008/ 0171555 A17 / 2008 Oh et al. 2006 / 0242596 A1 * 10 / 2006 Armstrong 715 /786 2008/ 0174562 Al * 7 / 2008 Kim . GO6F 3 /04886 2006 /0242604 Al 10 /2006 Wong et al. 345 / 173 US 9 ,772 ,751 B2 Page 5
References Cited = 9 - 138745 A 5 / 1997 ( 56 ) 9 - 258971 A 10 / 1997 U . S . PATENT DOCUMENTS 10 - 96648 A 4 / 1998 11 - 143604 A 5 / 1999 2008/ 0182598 AL 7 / 2008 Bowman 11 - 242539 A 9 / 1999 2008 /0182628 A1 * 7 / 2008 Lee et al...... 455 / 566 11 - 327433 A 11 / 1999 2008 /0184052 AL 7 / 2008 Itoh et al. = 2000 - 10702 A 1 /2000 2008 /0184112 A1 * 7 / 2008 Chiang et al...... 715/ 700 2000 - 105772 A 4 / 2000 2008 /0189108 A1 8 / 2008 Atar 2000 163031 6 / 2000 2008 /0201452 AL 8 / 2008 Athas et al. 2000 163193 6 / 2000 2008 /0216017 A1 * 9 /2008 Kurtenbach et al...... 715 /823 2000 - 163444 A 6 / 2000 2008 /0231610 AL 9 /2008 Hotelling et al . 2000 - 181436 A 6 / 2000 2008/ 0259045 A1 * 10 / 2008 Kim et al...... 345 / 173 2000 - 242390 A 9 / 2000 2008 /0268882 Al 10 / 2008 Moloney 2001 - 142604 A 5 / 2001 2008 /0300055 Al 12 / 2008 Lutnick et al. 2001 - 175386 A 6 / 2001 2008/ 0300572 Al 12 / 2008 Rankers et al. 2001 - 265481 A 9 / 2001 2008 / 0310602 A112 / 2008 Bhupati 2001 -312347 A 11 / 2001 2009 /0002324 A1 * 1 / 2009 Harbeson ...... G06F 3 /0485 2002 -41206 A 2 / 2002 345 / 173 2002 062966 2 /2002 2009 /0006991 A1 * 1 /2009 Lindberg ...... GO6F 3 /04817 2002062966 A * 2 / 2002 715 /763 2002 - 099370 A 4 / 2002 2009 /0007017 A1 1 / 2009 Anzures et al...... 715 / 835 2002 - 149312 A 5 /2002 2009 /0058821 Al 3 / 2009 Chaudhri et al. 2002 149616 A 5 /2002 2009/ 0064055 Al 3/ 2009 Chaudhri et al...... 715 /863 2002 - 189567 A 7 / 2002 2009 /0128581 A1 5 / 2009 Brid et al. 2002 - 244635 A 8 / 2002 2009 / 0138827 A1 5 / 2009 Van Os et al . 2002 - 525705 A 8 / 2002 2009 /0163193 AL 6 / 2009 Fyke et al . 2002 - 323850 A 11 /2002 2009 /0178008 AL 7 / 2009 Herz et al . 2003 - 066941 A 3 / 2003 = 2003 - 139546 A 5 / 2003 2009 / 0199128 A1 * 8 / 2009 Matthews et al...... 715 / 799 2003 - 162356 A 6 / 2003 2009 /0222765 AL 9 /2009 Ekstrand 2003 - 248538 A 9 / 2003 2009 /0249252 Al 10 / 2009 Lundy et al. 2003 - 256142 A 9 / 2003 2009/ 0254799 Al 10 / 2009 Unger 2003 - 271310 A 9 / 2003 2009 /0288032 AL 11/ 2009 Chang et al. 2004 - 38310 A 2 / 2004 2009 /0295753 Al 12 /2009 King et al. 2004 - 062645 A 2 / 2004 2010 /0095238 A1 * 4 / 2010 Baudet ...... 715 / 784 2004 070492 A 3 /2004 2010 /0105454 A1 * 4 / 2010 Weber et al...... 463 / 1 2004 - 118478 A 4 / 2004 2010 /0169357 A1 7 / 2010 Ingrassia et al . 2004 - 132741 A 4 / 2004 2010 / 0179991 A1 7 / 2010 Lorch et al . 2004 164242 A 6 / 2004 2010 / 0283743 A111 / 2010 Coddington 2004 - 206230 A 7 / 2004 2010 /0318709 Al 12 / 2010 Bell et al . 2004 - 227393 A 8 / 2004 2011/ 0007009 AL 1 / 2011 Ishihara et al . 2004 - 288208 A 10 / 2004 2011/ 0252373 Al 10 / 2011 Chaudhri 2004 - 318505 A 11 / 2004 2014 / 0068483 A13 / 2014 Platzer et al . 2004 341886 12 / 2004 2014 / 0237360 AL 8 / 2014 Chaudhri et al. 2004 - 343662 A 12 / 2004 2015/ 0012853 AL 1 / 2015 Chaudhri et al . 2005 - 004396 A 1 / 2005 2005 - 018229 A 1 /2005 = 2005 115896 4 /2005 FOREIGN PATENT DOCUMENTS 2005 - 515530 A 5 / 2005 2005 - 228088 A 8 / 2005 ?? 2349649 A1 1 / 2002 2005 -234291 A 9 / 2005 CN 1257247 A 6 / 2000 2005 - 242669 A 9 / 2005 CN 1818843 A 8 / 2006 2005 - 267049 A 9 /2005 CN 1940833 A 4 / 2007 2005309933 A * 11/ 2005 G06F 3 /00 EP 0 322 332 A2 6 / 1989 ...... G06F 3 /023 2005 352924 A 12 /2005 EP 0476972 A2 3 / 1992 2005 352943 12 / 2005 EP 0 626 635 A2 11 / 1994 G06F 3 / 00 = 2006 - 18645 A 1 / 2006 EP 0651544 A2 5 / 1995 2006 - 099733 A 4 / 2006 EP 0 689 134 Al 12 / 1995 G06F 9 /44 2007 - 132676 A 5 /2007 EP 0701220 A1 3 / 1996 2008 - 123553 A 5 /2008 EP 0 844 553 Al 5 / 1998 GO6F 3 /023 2008 -518330 A 5 / 2008 EP 0880090 A2 11/ 1998 2009 - 51921 A 3 /2009 EP 1049305 Al 11 / 2000 2009 - 522666 A 6 / 2009 EP 1 143 334 A2 10 /2001 G06F 9 /44 2009 - 151821 A 7 / 2009 EP 1 231 763 A1 8 / 2002 . . HO4M 1 / 725 2010 - 538394 A 12 / 2010 EP 1 517 228 A2 3 / 2005 ...... G06F 3 /033 2013 - 211055 A 10 / 2013 EP 1632874 A2 3 / 2006 KR 2002 - 0010863 2 / 2002 EP 1 744 242 A2 1 / 2007 KR 10 - 2006 -0085850 A 7 / 2006 EP 1752880 A1 2 / 2007 WO WO 99 / 28815 A1 6 / 1999 EP 1964022 B1 3 / 2010 WO WO 99 / 38149 AL 7 / 1999 G09G 500 FR 2 819 675 A1 7 / 2002 ...... H04Q 7 /32 GB 2301217 A 11 / 1996 wo 99 / 54807 Al 10 / 1999 2 329 813 A 3 / 1999 G06F 3 /033 wo WO 00 / 08757 A 2 / 2000 ...... H03J 1 /00 5 - 225302 A 9 / 1993 WO WO 01 / 16690 A2 3 / 2001 .. . . GO6F 3 /033 6 - 51930 A 2 / 1994 Wo WO 01/ 57716 A2 8 / 2001 ...... GO6F 17 / 00 7 - 225829 A 8 / 1995 WO WO 02 /08881 A2 1 / 2002 8 - 221203 A 8 / 1996 wo WO 02/ 13176 A2 2 / 2002 Geeeeeee 09 073381 3 / 1997 WO 02 /46903 A1 6 / 2002 9 - 97162 A 4 / 1997 WO 02 /082418 A2 10 / 2002 9 - 101874 A 4 / 1997 WO 02 /093542 AL 11 /2002 US 9 ,772 ,751 B2 Page 6
References Cited Microsoft, “ Right- Clicking with a Pen ,” microsoft. com , Nov . 7 , ( 56 ) 2002 , 3 pages, http :/ /www .microsoft . com /windowsxp / using FOREIGN PATENT DOCUMENTS tabletpc/ learnmore/ rightclick .mspx . MountFocus Information Systems, “ An Onscreen Virtual Key WO 03 /052626 AL 6 /2003 board : touchscreen , kiosk and Windows compatible, " printed Dec . WO 03 /060622 A2 7 / 2003 WO WO 03 / 107168 A1 12 / 2003 G06F 3 /023 19 , 2007 , 3 pages , http :/ /www .virtual - keyboard . com . WO 2004 /021166 A1 3 / 2004 Sadun , E ., “ Erica ' s Documentation : Applications and Utilities for WO 2004 /040481 A1 5 /2004 the iPhone and iPod Touch ,” Copyright 2007, http :/ / ericasadun . WO WO 2004 /063862 A2 7 / 2004 com / ftp /Deprecated /Documentation Manual -0 .04 .pdf . WO 2005 /036416 A2 4 / 2005 Vrba, J ., “ iPhone Customizations and Applications, ” Ezine Articles, WO 2005 / 041020 5 /2005 G06F 3 /033 http : // ezinearticles. com ? iPhone- Customizations- and - Applications WO 2005 /074268 A1 8 / 2005 WO 2005 / 106684 A1 11 / 2005 & id = 815807 & opt = print. WO 2006 / 003591 A2 1 /2006 Wildarya, " iDesksoft Desktop Icon Toy v2. 9 ," Oct. 16 , 2007 , 4 WO WO 2006 /019639 2 / 2006 pages , http :/ / www .dl4all . com /2007 / 10 / 16 / idesksoft_ desktop _ WO WO 2006 /020304 A2 2 /2006 icon _ toy _ v2 . 9 . html. WO WO 2006 / 020305 A2 2 / 2006 International Search Report and Written Opinion dated Feb . 25 , WO WO 2006 / 036069 A1 4 / 2006 2010 , received in International Application No. PCT/ US2009 / WO WO 2006 /037545 A2 4 / 2006 030225 , which corresponds to U . S . Appl. No. 12 /242 ,851 . wo WO 2007 /031816 A1 3 / 2007 WO WO 2007 /032972 A1 3 /2007 Office Action dated Sep . 14 , 2009 , received in Australian Patent WO WO 2007/ 069835 A1 6 / 2007 G06F 3 /041 Application 2009100812 , which corresponds to U . S . Appl . No . WO 2007 / 080559 A2 7 / 2007 11 /459 ,602 . WO WO 2007/ 094894 A2 8 / 2007 Office Action dated Sep . 14 , 2009 , received in Australian Patent WO 2008 /030874 Al 3 / 2008 Application No . 2009100813 , which corresponds to U . S . Appl. No . WO 2008 /030976 A2 3 / 2008 11 /459 ,602 . WO 2008 /086303 A1 7 / 2008 Office Action dated Dec . 10 , 2009 , received in Canadian Applica WO 2009 /089222 A2 7 / 2009 tion No. 2 ,633 ,759 , which corresponds to U . S . Appl. No . 11/ 459 ,602 . Office Action dated Oct . 27 , 2009 , received in German Patent OTHER PUBLICATIONS Application No . 11 2006 003 600 . 9 , which corresponds to U . S . Appl. No. 11 /459 ,602 . Anonymous, “ Asus Eee PC Easy Mode Internet Tab Options, ” Office Action dated Oct. 13 , 2008 , received in European Application asuseeehacks. blogspot . com , Nov . 10 , 2007 , 33 pages , http : // No. 06 846 840 . 4 , which corresponds to U . S . Appl. No . 11 /459 ,602 . asuseeehacks . blogspot .com / 2007 / 11/ asus -eee - pc- user - interface Thomas et al. , “ Applying Cartoon Animation Techniques to Graphi tour. html . cal User Interfaces, " ACM Transactions on Computer -Human Inter Invitation to Pay Additional Fees dated Nov. 16 , 2009 , received in action , vol. 8 , No . 3 , Sep . 2001 , pp . 198 - 222. International Patent Application No . PCT/ US2009 /030225 , which tuaw . com , " Springboard Scrolling , " new page dot feature , Oct. 9 , corresponds to U . S . Appl. No . 12 / 242, 851 . 2007 , http :/ /www .tuaw .com /gallery / springboard -scrolling /4313471 . Agarawala et al . “ Database Compendex / EI, ” Engineering Informa tuaw .com , “ Springboard Scrolling, ” mid - scroll , Oct. 9, 2007 , http :/ / tion , Inc . , Apr. 27 , 2006 , 1 page . www .tuaw .com /photos / springboard - scrolling /731348 / . Agarawala et al ., “ Keepin ' it Real: Pushing the Desktop Metaphor tuaw . com . “ Springboard Scrolling, " mostly unpopulated page, Oct . with Physics, Piles and the Pen ,” CHI Proceedings 2006 , Apr. 9 , 2007 . http :/ / www .tuaw .com /photos / springboard -scrolling 22 - 27 , 2006 , Montréal, Québec , Canada , pp . 1283 - 1292 . 4313491. Anonymous, “ Desktop Icon Toy — History ,” Oct. 8 , 2009 , 2 pages , tuaw . com , “ TUAW Hack : Mess with Your iPhone Settings, ” Dec . http : / /www . idesksoft .com / history .html . 18 , 2007 , http :/ / www / tuaw . com / tag/ SpringBoard /. Berka , J ., " iFuntastic 3 Opens Up New iPhone Functionality, ” ars tuaw .com , “ 1 . 1. 1 iPhone Multipage Springboard Hack, " posted Oct . technica , Aug . 30 , 2007 , http : // arstechnica . com / journals/ apple .ars / 9 , 2007, http :/ /www .tuaw .com /2007 / 10 /09 / 1 - 1- 1 - iphone -multipage 2007 / 08 / 30 / ifuntastic - 3 -opens - up -new - iphone - functionality . springboard -hack / . Chartier, D . , “ iPhone 1 . 1 . 3 Video Brings the Proof, " ars technica , International Preliminary Report on Patentability dated Jul. 15 , Dec . 30 , 2007 , http :/ /arstechnica .com /journals /apple . are/ 2007 / 12 / 2010 , received in International Application No . PCT /US2009 / 30 / iphone - 1 - 1 - 3 - video -brings - the -proof . 030225 , which corresponds to U . S . Appl. No . 12 /242 ,851 . Domshlak , C ., et al . “ Preference -Based Configuration of Web Page International Preliminary Report on Patentability dated Mar. 18 , Content, ” Proceedings of the 17th Int' l Joint Conf. on Artificial 2010 , received in International Application No . PCT/ US2008 / Intelligence ( IJCAI) , pp . 1451- 1456 , Seattle , WA . 074625 , which corresponds to U . S . Appl. No. 11/ 849 ,938 , 7 pages . Edwards, A ., “ iPhone 1 . 1 . 3 Firmware Feature Gallery , " Gear Live , Office Action dated Mar . 30 , 2010 , received in Chinese Application Dec . 28 , 2007 , http :/ /www . gearlive .com /news / article /q407 - iphone for Invention No . 200680053441. 1 , which corresponds to U . S . 113 - firmware- feature- gallery /. Appl. No. 11 /459 , 602 , 5 pages . iPhone Dev Wiki, “ IPhone Customization , ” http :/ / iphone . fiveforty . Examiner ' s Report dated Apr. 20 , 2010 , received in Australian net /wiki / index . php / Iphone _ Customization . Patent Application No. 2009204252 , which corresponds to U . S . iPhone Hacks , “ iPhone Firmware 1 . 1 . 1 : Multi - Page SpringBoard Appl. No . 12/ 242, 851. Hack ,” Oct . 10 , 2007, 4 pages , http : // www .iphonehacks . com /2007 / Final Office Action dated May 5 , 2010 , received in U . S . Appl. No . 10 / springboardhack . html. 12 / 364 ,470 . iPhone Hacks , " SummerBoard for iPhone OS v1. 1 . 1 : iPhone Hack Office Action dated Aug. 11 , 2010 , received in U . S . Appl. No . Enables Scrolling of iPhone ' s Home Screen ,” http :/ / www . 11 / 850 ,011 . iphonehacks. com /2007 / 10 / summerboard -v3 .html . Andrew ' s Widgets , “ Developing Dashboard Widgets — What the iPhone Info , “ Modifying the iPhone SpringBoard ,” http :/ / Heck is a Widget, ” http :/ / andrew .hedges .name / widgets / dev / , printed iphoneinfo . ca /modifying - the - iphone - springboard . Jan . 25 , 2008 , 9 pages. Jazzmutant, “ Jazzmutant Lemur, " printed Nov . 16 , 2005 , 3 pages , Designing Interfaces .com , " Animated Transition ," http :/ / http : // 64 .233 . 167. 104 / search ? q = cache : 3g4wFSaZiXIJ :www . designinginterfaces .com / Animated _ Transition , printed Oct . 16 , nuloop . c . 2006 , 2 pages. Jazzmutant , “ The Lemur : Multitouch Control Surface ” , printed Apple . com , “ Tiger Developer Overview Series — Developing Dash Nov . 16 , 2005 , 3 pages http : // 64233 . 167 . 104 / search ? q = cache :jO _ board Widgets , " http : // developer. apple .com /macosx /dashboard . nEDNVzOcJ: www .cycling7 . html, printed Jun . 23, 2006 , 9 pages. US 9 ,772 ,751 B2 Page 7
( 56 ) References Cited Examiner ' s Report dated May 18, 2011 , received in Australian Patent Application No . 2009204252 , which corresponds to U . S . OTHER PUBLICATIONS Appl. No. 12 / 242 , 851. Office Action dated Nov. 26 , 2010 , received in European Patent Apple Computer, Inc. , “ Dashboard Tutorial, ” Apple Computer , Inc . Application No . 09 700 333. 9 , which corresponds to U . S . Appl. No . © 2004 , 2006 , 24 pages . 12 /242 , 851. Hesseldahl, A . , “ An App the Mac can Brag About, ” Forbes. com , Office Action dated Nov. 13 , 2009 received in U .S . Appl. No. http : // www . forbes. com /2003 / 12 /15 /cx _ ah _ 1215tentech _ print. 12 /364 ,470 . html, Dec . 15 , 2003 , 2 pages . Office Action dated Mar . 4 , 2011, received in U . S . Appl. No . Mello , Jr. , J ., “ Tiger ' s Dashboard Brings Widgets to New Dimen 12 /364 ,470 . sion ," http : // www .nacnewsworld .com / story / 42630 . html, Mac New Final Office Action dated May 27 , 2011 , received in U . S . Appl. No . World , printed Jun . 23 , 2006 , 3 pages. 11/ 849 ,938 . International Search Report and Written Opinion for International Office Action dated Oct . 29 , 2010 , received in Australian Patent Application No . PCT/ US2007 / 077643 , dated May 8 , 2008 . Application No . 2008296445, which corresponds to U .S . Appl. No . 11 / 849 ,938 . International Search Report and Written Opinion for International Chang et al. , “ Animation : From Cartoons to the User Interface ," Application No. PCT/ US2008 /050431 , dated Jun . 17 , 2008 . UIST '93 Conference Proceedings , Atlanta , GA , Nov. 1993 , 12 CNET, “ Video : Create custom widgets with Web Clip ,” CNET pages. News, Aug. 8 , 2006 , 3 pages , http : // news . cnet . com / 1606 - 2 Apple, “ Welcome to Tiger, ” copyright © 2005 Apple Computer, 6103525 .html . Inc ., 32 pages, http :/ / manuals . info .apple . com / en /Welcome _ to _ FondantFancies, “ Dash Clipping : Don ' t wait for Mac OS X 10 . 5 Mac _ OS _ X _ v10 . 4 _ Tiger .pdf . Leopard ,” fondantfancies . com , Aug . 8 , 2006 , 9 pages, http : // www . Delltech , “ Working with Graphics, ” Windows XP : The Complete fondantfancies. com /blog /30012391 . Reference , Chapter 18 , Apr. 5 , 2005 , 4 pages. Macworld , “ Whip up a widget, " Macworld . com ., Sep . 23 , 2005 , 5 Dodge et al. , “ Microsoft Office Excel 2003 Office Manual, ” pages, http : // www .macworld .com / artiele /46622 / 2005 /09 / Microsoft Press , Jul. 12 , 2004 , vol. 1, p . 66 -68 , Unable to Locate Octgeekfactor. html . English Translation . Macworld , “ First Look : Leopard first looks : Dashboard ,” Aug. 9 , Widgipedia , " I Need a Bog and a Forum Please ? ” 2 pages , printed 2006 , 3 pages , http : // www .macworld .com /article / 52297 /2005 / 08 / Oct . 19 , 2006 , http : / /www .widgipedia . com /widgets / details / adni 18 / leodash .html . hyalo -weather _ 27 . html. Opera Software, “ Welcome to Widgetize, ” Copyright © 2006 Opera International Search Report and Written Opinion dated Jul. 8 , 2008 Software ASA , 1 page, http :/ /widgets .opera . com /widgetize . for International Application No . PCT/ US2007 / 077639 , which cor Examiner ' s Report dated Apr. 2 , 2009 , received in the Canadian responds to U . S . Appl. No. 11 / 850 ,010 , 11 pages (Omernick ). International Search Report and Written Opinion dated Nov . 27 , patent application which corresponds to U . S . Appl. No. 11/ 459 ,602 . 2009 , received in International Application No . PCT/ US2008 / Office Action dated Aug . 12 , 2010 , received in Canadian Applica 074341, which corresponds to U . S . Appl. No . 11/ 850 ,005 , 25 pages tion No. 2633759 , which corresponds to U . S . Appl. No . 11/ 459 ,602 . ( Chaudhri) . Office Action dated Sep . 2, 2010 , received in U .S . Appl. No . Office Action dated May 2 , 2011 , received in U . S . Appl. No. 12 / 364 ,470 . 11 / 850 , 010 , 12 pages (Omernick ). Office Action dated Oct. 12 , 2010 , received in U . S . Appl. No. Final Office Action dated Oct. 17 , 2011, received in U . S . Appl. No . 11 / 849, 938 . 11 /850 ,010 , 11 pages (Omernick ) . Office Action dated Oct . 15 , 2010 , received in European Application Office Action dated May 16 , 2012, received in U . S . Appl. No . No. 08 829 660 . 3 , which corresponds to U . S . Appl. No. 11 /849 ,938 . 11/ 850 ,010 , 12 pages (Omenick ) . Final Office Action dated Oct. 19 , 2011, received in U .S . Appl. No . Office Action dated Jan . 18 , 2012 , received in Chinese Patent 12 / 364 ,470 ( van Os ) . Application No . 200780041309. 3, which corresponds to U . S . Appl . Final Office Action dated Jul. 14 , 2011, received in U . S . Appl. No . No . 11/ 850 ,011 , 15 pages ( Forstall) . 11 / 969 , 809 . Summons to attend oral proceedings dated Dec . 1 , 2011 , received in Office Action dated Jun . 10 , 2011 , received in European Patent European Patent Application No . 07814689 . 1 , which corresponds to Application No . 09 700 333 .9 , which corresponds to U . S . Appl. No . U . S . Appl. No . 11/ 850 ,011 , 6 pages ( Forstall ) . 12 / 242 , 851. Final Office Action dated Oct . 31 , 2011 , received in U . S . Appl. No. Office Action dated Aug . 24 , 2011 , received in Chinese Patent 11/ 969 ,912 , 14 pages ( Lemay ) . Application No. 200880112570 . 2 , which corresponds to U . S . Appl . Final Office Action dated Dec . 12 , 2011 , received in U . S . Appl . No. No . 11/ 849, 938 . 12 / 242 , 851 , 17 pages (Herz ) . Office Action dated Aug . 8 , 2011, received in Korean Patent Notification of Acceptance dated Oct. 17 , 2011 , received in Aus Application No. 10 -2010 -7007258 , which corresponds to U . S . tralian Patent Application No. 2009204252 , which corresponds to Appl. No. 11 /849 , 938 . U . S . Appl. No . 12 / 242 ,851 , 3 pages (Herz ) . Invitation to Pay Additional Fees dated Jun . 27 , 2008 , received in Office Action dated Oct . 21, 2011, received in Australian Patent International Application No . PCT/ US2008 /050430 , which corre Application No . 2011101194 , which corresponds to U .S . Appl. No. sponds to U . S . Appl. No . 11/ 969 ,809 . 12 / 242 , 851 , 2 pages (Herz ) . International Search Report and Written Opinion dated Sep . 1, 2008 , Certification of Australian Innovation Patent No . 2011101194 dated received in International Application No. PCT/ US2008 /050430 , Mar. 2 , 2012 , which corresponds to U . S . Appl. No . 12 /242 ,851 , 4 which corresponds to U . S . Appl. No . 11/ 969 ,809 . pages (Herz ). Final Office Action dated Dec . 1 , 2010 , received in U . S . Appl. No . Office Action dated Nov . 30 , 2011, received in Chinese Patent 11 /850 , 011 . Application No . 200980000229 . 2 , which corresponds to U . S . Appl . Notice of Allowance dated Feb . 18 , 2011, received in U . S . Appl. No . No. 12/ 242 , 851 , 24 pages (Herz ) . 11/ 850 , 011 . Office Action dated Dec . 14 , 2011, received in U . S . Appl . No . Office Action dated Mar. 4, 2011, received in European Application 11 /849 , 938 , 30 pages (Chaudhri ) . No. 07 814 689 . 1 , which corresponds to U . S . Appl. No. 11 /850 ,638 . Notice of Acceptance dated Dec . 14 , 2011, received in Australian Office Action dated Mar. 14 , 2011 , received in U . S . Appl. No. Patent Application No . 2008296445 , which corresponds to U . S . 11/ 969 , 809 . Appl. No . 11/ 849 , 938 , 3 pages ( Chaudhri) . Office Action dated Apr. 13 , 2011 , received in U . S . Appl. No . Office Action dated Feb . 13 , 2012 , received in Japanese Patent 11 / 969, 912 . Application No . 2010 -524102 , which corresponds to U . S . Appl. No. Office Action dated Apr. 15 , 2011, received in U . S . Appl. No . 11 /849 , 938 , 2 pages ( Chaudhri) . 12 / 242 , 851. Apple , iPhone User' s Guide, Jun . 2007 , Apple Inc ., 137 pages . US 9, 772 ,751 B2 Page 8
( 56 ) References Cited Office Action dated Jan . 17 , 2013 , received in Korean Patent Application No. 10 2011 7014104 , which corresponds to U . S . Appl. OTHER PUBLICATIONS No . 12 / 274 , 346 , 4 pages (Moore ) . Notice of Allowance dated Aug. 29 , 2013 , received in Korean Patent Cerulean Studios, “ Trillian Online User Manual ,” 2006 , http :/ / Application No . 10 2011 7014104 , which corresponds to U .S . Appl. www .ceruleanstudios . com / support /manual . php ?hchap = 4 & hsub = 1 No. 12 / 274 , 346 , 2 pages (Moore ) . & hsect = 5 . Office Action dated Aug. 31, 2011, received in U .S . Appl. No . CNET, “ bounding box ,” cnet .com , downloaded Dec . 29 , 2008 , 1 12 / 365, 887 (Moore ) . page , http :/ / www .cnet .com /Resources / Info /Glossary / Terms/ Final Office Action dated Feb . 29 , 2012 , received in U . S . Appl. No. boundingbox .html . 12 /365 , 887 (Moore ) . Dearman et al ., “ Rendezvousing with Location - Aware Devices: Notice of Allowance dated May 23 , 2012, received in U . S . Appl. Enhancing Social Coordination ,” Interacting with Computers, vol. No. 12 / 365, 887, 5 pages (Moore ). 17, Issue 5 , Sep . 2005 , http :/ / www .dgp . toronto . edu /~ dearman /pub Office Action dated Nov. 10 , 2011 , received in U . S . Appl . No . lications/ dearman _ IWC05 .pdf , pp . 542 -566 . 12 / 365 ,888 (Moore ) . Emesene forum , “ Autocomplete plugin ,” Jun . 20 , 2008 , http : // Notice of Allowance dated Oct . 10 , 2013 , received in U . S . Appl. No . emeseme. org /smf / index .php ? topic = 1276 . 0 , 5 pages. 11/ 849 , 938 , 35 pages ( Chaudhri) . Foxit, “ Foxit Reader v . 1 . 3 Feature Description ," Foxit Software Notice of Allowance dated Nov . 20 , 2013 , received in Korean Patent Company, 2008 , http : / /www . foxitsoftware .com /pdf / reader _ 2 / Application No . 2010 7007258 , which corresponds to U .S . Appl. verhistory .htm , 4 pages. No. 11 /849 , 938 , 2 pages ( Chaudhri ) . InfoWorld , “ Two Geeks and an iPhone : Part 3 , ” InfoWorld Video , Office Action dated Oct . 25 , 2013 , received in Korean Patent Dec . 18 , 2007 , http : / /web .archive . org /web / 20080124065641/ http :/ Application No . 2010 7007258 , which corresponds to U .S . Appl. www .infoworld . com / video / Interviews/Mobile - Tech - Apple - iPhone / No. 11/ 849 , 938 , 4 pages (Chaudhri ). Two -Geeks - and -an - iPhone - Part - 3 / video _ 1966 .html , 2 pages. Office Action dated Oct . 24 , 2013 , received in U . S . Appl. No. PocketGear .com , " Software Keyboards : Effy -Japanese ( Eng / Jp ) 11 / 850 ,005 , 12 pages ( Chaudhri ) . 4 . 0 , " updated Sep . 23 , 2008 , http :/ /classic .pocketgear . com /soft Office Action received for Australian Patent Application No. ware _ detail . asp ? id = 9115 . 2012200475 , dated Jun . 29 , 2015 , 3 pages . Potter , " Graffiti Smilies ,” PalmInfocenter Forums, Feb . 9 , 2003 , 6 Non - Final Office Action received for U . S . Appl . No . 14 / 261 , 112 , pages , 2005 , http : / /www .palminfocenter .com / forum / viewtopic . dated Jul. 8 , 2015 , 29 pages . php ?t = 11307 . Non - Final Office Action received for U . S . Appl. No . 12 / 242 , 851 , Sadun , E ., “ Found Footage : Scrolling iPhone dock smashes through dated Jun . 26 , 2015 , 33 pages . 16 - icon home screen limit, " TUAW , Aug . 30 , 2007 , http : / /www . ImageShack — Hosting , available at
( 56 ) References Cited Supplemental Notice of Allowance received for U . S . Appl. No. 11/ 850 ,011 , dated Feb . 24 , 2011 , 6 pages. OTHER PUBLICATIONS Non - Final Office Action received for U .S . Appl. No. 11/ 850 ,013 , dated Jun . 11, 2010 , 32 pages . Office Action received for European Patent Application No. Notice of Allowance received for U . S . Appl. No . 11 / 850 ,013 , dated 09171787. 6 , dated Jul. 12 , 2011, 5 pages. Oct. 20 , 2010 , 20 pages . Office Action received for Taiwan Patent Application No . Final Office Action received for U . S. Appl. No . 11/ 850 ,638 , dated 097100075 , dated Dec . 29 , 2011 , 5 pages (English Translation May 15, 2012 , 16 pages . only ) . Final Office Action received for U . S . Appl. No . 11/ 850 ,638 , dated Notice of Allowance received for Korean Patent Application No . Feb . 8 , 2011 , 14 pages. 10 -2009 -7007064 , dated Sep . 30 , 2011 , 2 pages (Official Copy Non - Final Office Action received for U . S . Appl. No. 11 / 850 ,638 , only ) . ( See Communication under 37 CFR § 1 . 98 ( a ) ( 3 ) ) . dated Oct. 26 , 2010 , 17 pages. Notice of Allowance received for Korean Patent Application No. Non -Final Office Action received for U . S . Appl. No. 11/ 850 ,638 , 10 - 2009 -7007067 , dated Dec . 1 , 2011, 2 pages (Official Copy only ) . dated Jan . 17 , 2012 , 15 pages . ( See Communication under 37 § 1 . 98 ( a ) ( 3 ) ) . Final Office Action received for U .S . Appl. No . 11/ 961, 773 , dated Office Action received for Korean Patent Application No . 10 - 2009 Nov. 2 , 2011, 12 pages . 7007067 , dated Aug . 30 , 2011 , 2 pages (English Translation only ) . Final Office Action received for U . S . Appl. No . 11/ 961 , 773 , dated Office Action received for Korean Patent Application No. 10 - 2009 Nov. 29 , 2012 , 15 pages . 7007067 , dated Nov . 12 , 2010 , 3 pages ( English Translation only ) . Non - Final Office Action received for U .S . Appl. No . 11/ 961, 773 , Notice of Allowance received for Korean Patent Application No. dated Apr. 15 , 2011, 21 pages . 10 - 2011 - 7019633 , dated May 18 , 2012 , 2 pages (Official Copy Non - Final Office Action received for U . S . Appl. No . 11/ 961, 773 , only ). (See Communication under 37 CFR § 1. 98 ( a ) ( 3 )) . dated May 10 , 2012 , 14 pages . Notice of Allowance received for Korean Patent Application No . Notice of Allowance received for U . S . Appl. No . 11 / 969 , 912 , dated 10 - 2011 - 7026583 , dated Apr. 29 , 2015 , 2 pages (Official Copy only ). (See Communication under 37 CFR § 1 .98 (a ) (3 )) . Jun . 11, 2014 , 4 pages . Office Action received for Korean Patent Application No. 10 - 2011 Notice of Allowance received for U . S . Appl. No . 11/ 969, 912 , dated 7026583, dated Aug. 14 , 2014 , 6 pages ( 2 pages of English Mar . 6 , 2014 , 12 pages . Translation and 4 pages of Official Copy ) . Office Action received from German Patent Application No. Notice of Allowance received for Korean Patent Application No . 112006003600 . 9 , dated Aug . 9 , 2011, 4 pages ( English Translation 10 - 20147011273 , dated Apr. 28 , 2015 , 2 pages (Official Copy only ). only ) . (See Communication under 37 CFR § 1 . 98 ( a ) (3 ) ). Office Action received for German Patent Application No. Office Action received for Korean Patent Application No. 10 - 2014 112007002107 . 1 , dated Jun . 7 , 2010 , 3 pages (English Translation 7011273 , dated Aug . 14 , 2014 , 5 pages ( 2 pages of English only ) . Translation and 3 pages of Official Copy) . Advisory Action received for U . S . Appl. No. 12/ 242, 851, dated Final Office Action received for U .S . Appl. No . 11/ 620 ,647 , dated Nov. 15 , 2013 , 4 pages. Dec . 23 , 2010 , 21 pages . Non - Final Office Action received for U . S . Appl. No. 12 / 242 ,851 , Non - Final Office Action received for U . S . Appl. No . 11/ 620 ,647 dated Oct . 6 , 2014 , 27 pages . dated Jun . 24 , 2010 , 19 pages . Non - Final Office Action received for U . S . Appl. No . 12 / 981 ,433 , Non -Final Office Action received for U . S . Appl. No . 11 /620 ,647 dated Oct. 11 , 2012 , 29 pages . dated Nov. 17 , 2009 , 20 pages . Extended European Search Report ( includes Partial European Non - Final Office Action received for U . S . Appl. No. 11/ 620 ,647 , Search Report and European Search Opinion ) received for Euro dated Oct. 13 , 2011 , 23 pages. pean Patent Application No. 12169786 .6 , dated Jul. 11 , 2012 , 10 Notice of Allowance received for U . S . Appl. No. 11/ 620 ,647 dated pages. Mar. 2 , 2012 , 8 pages. Office Action received for European Patent Application No. Notice of Allowance received for U . S . Appl. No . 11/ 849 , 938 , dated 12194312 . 0 , dated Jan . 13 , 2014 , 4 pages . Nov . 27 , 2013 , 2 pages. Office Action received for European Patent Application No . Final Office Action received for U . S . Appl . No. 11 /850 , 005 , dated 12194315 . 3 , dated Jan . 13 , 2014 , 4 pages. Jul. 8 , 2011 , 9 pages . Non - Final Office Action received for U . S . Appl. No . 13/ 155, 304 , Final Office Action received for U . S . Appl. No. 11 /850 , 005 , dated dated Sep . 5 , 2012 , 11 pages . May 22 , 2014 , 13 pages . Extended European Search Report ( includes Partial European Non Final Office Action received for U . S . Appl. No . 11/ 850 ,005 , Search Report and European Search Opinion ) received for Euro dated May 29 , 2015 , 12 pages. pean Patent Application No. 13174706 . 5 , dated Jan . 8 , 2015 , 8 Non -Final Office Action received for U . S . Appl. No . 11/ 850 ,005 , pages . dated Mar. 18 , 2011 , 10 pages . Non Final Office Action received for U . S . Appl. No . 14 / 142 ,640 , Non -Final Office Action received for U .S . Appl. No. 11/ 850 ,005 , dated Jun . 5 , 2015 , 29 pages. dated Nov . 10 , 2011 , 11 pages . Final Office Action received for U . S . Appl . No. 14 /261 , 112 , dated Final Office Action received for U . S . Appl. No . 11/ 850 ,008 , dated Oct . 9 , 2014 , 29 pages . Dec . 29 , 2010 , 14 pages . Non -Final Office Action received for U .S . Appl. No. 14 / 261, 112 , Non - Final Office Action received for U . S . Appl. No . 11 /850 ,008 , dated Jun . 18 , 2014 , 25 pages. dated Aug . 2 , 2010 , 14 pages . Office Action received for Canadian Patent Application No, Notice of Allowance received for U . S . Appl. No , 11/ 850 , 008 , dated 2 ,633 ,759 , dated Aug . 12 , 2010 , 8 pages. Mar. 11 , 2011 , 7 pages . Notice of Allowance received for Canadian Patent Application No. Final Office Action received for U . S . Appl . No. 11 / 850 , 010 , dated 2 ,633 , 759 , dated Sep . 9 , 2013 , 1 page . Feb . 15 , 2013 , 12 pages . Office Action received from Canadian Patent Application 0 . Final Office Action received for U .S . Appl. No. 11/ 850 ,010 , dated 2 ,633 ,759 , dated Apr. 18 , 2013 , 2 pages . May 8 , 2014 , 11 pages . Notice of Allowance received for Canadian Patent Application No. Non Final Office Action received for U . S . Appl. No . 11 /850 ,010 , 2, 845 ,297 , dated Nov . 10 , 2014 , 1 page . dated Dec. 17 , 2014 , 10 pages . Office Action received for Canadian Patent Application No. Non - Final Office Action received for U .S . Appl. No. 11/ 850 ,010 , 2 ,845 , 297, dated Apr . 23 , 2014 , 2 pages. dated Jun . 25 , 2015 , 10 pages . Office Action received for Chinese Patent Application No . Notice of Allowance received for U . S . Appl. No. 11 / 850 ,011 , dated 200680053441. 1 , dated Nov . 12 , 2010 , 4 pages (English Translation Feb . 11 , 2011 , 5 pages. only ) . US 9 , 772 , 751 B2 Page 10
( 56 ) References Cited Response to Notice of Opposition filed for Australian Patent Appli cation No. 2009204252 , dated Apr. 28 , 2014 , 4 pages . OTHER PUBLICATIONS Office Action received for Japanese Patent Application No. 2009 527541 , dated May 21 , 2012 , 3 pages (English Translation only ) . Grant for Invention Patent Received in Chinese Patent Application Office Action received for Japanese Patent Application No . 2009 No . 200680053441. 1, dated Jan . 28 , 2011 , 1 page (Official Copy 527541, dated Sep . 26 , 2011 , 3 pages (English Translation only ). only ) . ( See Communication under 37 CFR § 1 . 98 ( a ) ( 3 ) ) . Office Action received for Japanese Patent Application No . 2009 Office Action received for Australian Patent Application No . 527566 , dated Aug . 15 , 2011 , 3 pages ( English Translation only ) . 2007289019, dated Jul. 2 . 2009 , 3 pages. Office Action received for Japanese Patent Application No. 2009 Office Action received for Australian Patent Application No . 527566 , dated Sep . 21 , 2012 , 3 pages ( English Translation only ) . 2007289019 , dated Oct. 7 , 2009 , 2 pages. Notice of Allowance received for Chinese Patent Application No . Notice of Acceptance received for Australian Patent Application 200980000229 .2 , dated Oct . 24 , 2014 , 2 pages (Official Copy only ). No . 2007292383 , dated Jan . 4, 2012 , 3 pages. (See Communication under 37 CFR § 1. 98 (a ) ( 3 )) . Office Action received for Australian Patent Application No . Office Action received for Chinese Patent Application No. 2007292383 , dated Dec . 22 , 2011 , 2 pages. 200980000229. 2 , dated Jan . 6 , 2014 , 6 pages ( 3 pages of English Office Action received for Australian Patent Application No . Translation and 3 pages of Official Copy ). 2007292383 , dated Mar. 24 , 2010 , 2 pages. Office Action received for Chinese Patent Application No . Office Action received for Australian Patent Application No . 200980000229. 2 , dated Jun . 27 , 2014 , 7 pages (4 pages of English 2007292383 , dated May 12 , 2011 , 2 pages. Translation and 3 pages of Official copy ) . Decision to Grant received for Chinese Patent Application No. Notice of Acceptance received for Australian Patent Application 200780001140. 9 , dated Feb . 3 , 2012 , 4 pages ( 2 pages of English No . 2010200763 , dated Aug . 21, 2012 , 1 page . Translation and 2 pages of Official copy ) . Office Action received for Australian Patent Application No. Office Action received for Chinese Patent Application No . 2010200763, dated Jul. 28 , 2011 , 2 pages. 200780001140 . 9 , dated Jan . 15 , 2010 , 5 page ( English Translation Certificate of Examination received for Australian Patent Applica only ) . tion No. 2011101190 , dated Nov . 23 , 2011 , 1 page . Office Action received for Chinese Patent Application No. Office Action received for Chinese Patent Application No. 200780001140 . 9 , dated Jun . 10 , 2011, 7 pages ( English Translation 201210399033 .9 , dated Nov . 27 , 2014 , 7 pages (Official Copy only ). only ). ( See Communication under 37 CFR § 1 . 98 ( a ) ( 3 ) ) . Office Action received for Chinese Patent Application No . Notice of Acceptance received for Australian Patent Application 200780041222 .6 , dated Feb . 29 , 2012 , 6 pages ( 3 pages of English No . 2012202140 , dated May 28 , 2014 , 2 pages . Translation and 3 pages of Official copy ). Notice of Acceptance received for Australia Patent Application No. Office Action received for Chinese Patent Application No . 2012261534 , dated Jan . 6 , 2015 , 2 pages . 200780041222 .6 , dated Jul. 25 , 2012, 3 pages (English Translation Office Action received for Australian Patent Application No . only ) . 2012261534 , dated Dec . 3 , 2013 , 3 pages. Office Action received for Chinese Patent Application No . Office Action received for Japanese Patent Application No . 2013 200780041222. 6 , dated Oct . 13 . 2010 , 10 pages (English Transla 011209 , dated Feb . 7 , 2014 , 3 pages (Official copy only ). (See tion only ) . Communication under 37 CFR § 1 .98 (a ) ( 3 )) . Office Action received for Chinese Patent Application No. Office Action received for Japanese Patent Application No. 2013 200780052019 . 9 , dated Feb . 29 , 2012 , 6 pages ( 3 pages of English 011209 , dated Oct . 27 , 2014 , 3 pages (Official Copy only ) . (See Translation and 3 pages of Official Copy ) . Communication under 37 CFR § 1. 98 (a ) ( 3 )) . Office Action received from Japanese Patent Application No . 2008 Office Action received for Japanese Patent Application No . 2013 548858 dated May 30 , 2011, 3 pages ( English Translation only ) . 127963 , dated Aug . 15 , 2014 , 8 pages ( 6 pages of English Trans Office Action received from Japanese Patent Application No. 2008 lation and 2 pages of Official Copy ) . 548858 , dated Jan . 20 , 2012 , 5 pages ( English Translation only ). Office Action received for Japanese Patent Application No . 2013 Office Action received for Chinese Patent Application No . 127963 , dated Mar . 10 , 2014 , 7 pages ( 4 pages of English translation 200880110709 . X , dated Nov . 24 , 2011 , 10 pages ( 6 pages of English and 3 pages of Official copy ). Translation and 4 pages of Official Copy ). Office Action received for Japanese Patent Application No . 2013 Office Action received from Japanese Patent Application No. 2009 252338 , dated Jan . 30 , 2015 , 4 pages (Official Copy only ) . (See 51921 dated Jan . 20 , 2012 , 5 pages (English Translation only ) . Communication under 37 CFR § 1 . 98 ( a ) ( 3 ) ) . Office Action received for Japanese Patent Application No. 2009 Patent Grant received for Japanese Patent Application No . 2008 051921, dated May 31 , 2013 , 7 pages ( 3 pages of English Trans 548858 , dated Sep . 24 , 2012 , 3 pages (Official Copy only ). (See lation and 4 pages of Official Copy ) . Communication under 37 CFR § 1 . 98 ( a ) ( 3 ) ) . Office Action received from Japanese Patent Application No. 2009 Notice of Allowance received for Japanese Patent Application No . 051921, dated Jun . 27, 2011, 6 pages ( English Translation only ). 2009 - 051921 , dated Jan . 20 , 2014 , 2 pages (Official Copy only ) . Office Action received from Japanese Patent Application No . 2009 (See Communication under 37 CFR § 1 .98 ( a ) ( 3 )) . 051921 , dated Sep . 24 , 2012 , 3 pages (English Translation only ) . International Preliminary Report on Patentability received for PCT Office Action received for Australian Patent Application No . Patent Application No. PCT/ US2006 / 062685 , dated Jul. 1 , 2008 , 6 2009100760 , dated Sep . 28 , 2009 , 2 pages . pages . Intention to Grant received for Chinese Patent Application No . International Search Report and Written Opinion received for PCT 200910173272. 0 , dated Oct . 23 , 2012 , 1 page ( English Translation Patent Application No . PCT/ US2007 /077838 , dated Feb . 19 , 2008 , Only ) . 9 pages . Office Action received from Chinese Patent Application No . International Preliminary Report on Patentability received for PCT 200910173272 .0 , dated Nov . 30 , 2011, 8 pages (5 pages of English Patent Application No . PCT/ US2007 / 077839 , dated Mar . 10 , 2009 , Translation and 3 pages of Official Copy ) . 6 pages . Office Action received for Chinese Patent Application No . International Preliminary Report on Patentability received for PCT 200910175852 . 3 , dated Apr. 24 , 2012 , 10 pages ( 6 pages of English Patent Application No. PCT/ US2007 /077843 , dated Mar. 10 , 2009 , Translation and 4 pages of Official Copy ) . 7 pages . Office Action received for Chinese Patent Application No . International Search Report and Written Opinion received for PCT 200910175852 . 3 , dated Jun . 2 , 2011, Jun . 2 , 2011, 6 pages ( English Patent Application No . PCT /US2007 / 077844 , dated May 30 , 2008 , Translation only ) . 18 pages. Office Action received for Australian Patent Application No . Invitation to pay additional fees received for PCT Patent Applica 2009204252 , dated Sep . 16 , 2014 , 6 pages . tion No . PCT/ US2007 /077644 , dated Jan . 23 , 2008 , 10 pages. US 9 , 772 , 751 B2 Page 11
(56 ) References Cited Chen et al. , “ Detecting Web Pages Structure for Adaptive Viewing on Small Form Factor Devices” , Proceedings of the 12th interna OTHER PUBLICATIONS tional conference on World Wide Web , 2003, 9 pages . Chen et al ., “ DRESS : A Slicing Tree Based Web Page Represen International Search Report and Written Opinion received for PCT tation for Various Display Sizes ” , Microsoft Research , Technical Patent Application No . PCT /US2007 / 077773 , dated Jan . 15 , 2008 , Report , Nov . 16 , 2002 , 9 pages . 8 pages . CNET, “ Fujitsu LifeBook B6110D ” , Reviews, Nov . 24 , 2005 , 2 International Search Report and Written Opinion received for PCT pages . Patent Application No. PCT/US2007 /088879 , dated Jun . 30 , 2008 , Cooper, Alan , “ The Inmates Are Running the Asylum ” , Sams 8 pages. Publishing, Mar. 23 , 1999 , pp . 138 - 147 . International Search Report and Written Opinion received for PCT Delltech , “ Working with Graphics” , Windows XP: The Complete Patent Application No . PCT/ US2007 / 088893 , dated Jul. 11, 2008 , Reference , Chapter 18 , Apr . 5 , 2005, 4 pages. 10 pages. Elo , “ Touchscreen User Manual, Elo Projected Capacitance Driver International Preliminary Report on Patentability received for PCT Software Version 1 . 00 (Serial ) ” , Elo TouchSystems, Inc. , Dec. 30 , Patent Application No. PCT /US2008 /050430 , dated Jul. 7 , 2009 , 10 2005 , 37 pages. pages . Expansystv , “ HTC Touch Dual Demonstration by eXpansys” , 5 : 26 International Preliminary Report on Patentability received for PCT minutes video , available at http : // www . youtube .com / Patent Application No. PCT/ US2008 /050431 , dated Jul. 7 , 2009 , 8 watch ? v = Tupk8MYLhMk > , uploaded on Oct. 1 , 2007 , 2 pages. pages. Eyemodule Springboard Compatible , “ Turn Your HandspringTM International Preliminary Report on Patentability received for PCT VisorTM Handheld into a Digital Camera ” , User ' s Manual, 2000 , 9 Patent Application No. PCT/ US2008 /074341 , dated Mar . 9 , 2010 , 8 pages . pages . Farber, Dan , “ Jobs: Today Apple is Going to Reinvent The Phone ” , International Search Report and Written Opinion received for PCT ZDNet, available at < http :/ / www .zdnet .com /blog /btl / jobs -today Patent Application No . PCT/ US2008 /074625 , dated Jan . 8 , 2009 , 8 apple - is- going -to - reinvent- the -phone /4249 > , Jan . 9 , 2007, 3 pages. pages. Fingerworks Forums, “ Is the Multitouch Lemur ? ” , Available at Agarwal, Amit, " iTunesInline Video " , Digital Inspiration The < http : / /64233 . 167 . 104 / search ? q = cache : sjVdtyFBVRMJ: forums. fin Tech Guide, available online at
( 56 ) References Cited Opera Software , “ Opera for Windows Mobile Smartphone 2003 Tutorial" , Available at < http : / /www .opera .com / support / tutorials / OTHER PUBLICATIONS winmobile > , retrieved on Apr. 5 , 2005 , 4 pages . Opera Software, “ The New Opera Browser for Series 60 Features Karlson et al. , “ AppLens and Launch Tile : Two Designs for One Zoom and Password Manager” , Press Releases Database , Available Handed Thumb Use on Small Devices” , CHI 2005 , Papers : Small at < http :/ / pressreleases .techwhack . com / 1334 / 1411 -opera -browser Devices 1 , Apr. 2 - 7 , 2005 , pp . 201 - 210 . features -zoom - and - password > , Nov . 14 , 2005 , 3 pages. Karlson et al. , “ AppLens and Launch Tile : Two Designs for One Palme et al. , “MIME Encapsulation of Aggregate Documents , such Handed Thumb Use on Small Devices” , Powerpoint Presentation , CHI 2005 , 17 pages . as HTML" , Network Working Group , 1999 , 24 pages . Khella et al. , “ Pocket Photo Mesa : A Zoomable Image Browser for Palmone , “ Your Mobile Manager ” , Chapter 2 , LifeDriveTM User ' s PDAs ” , Proceedings of the 3rd International Conference on Mobile Guide , available at < http : / /www . palm .com /us / support /handbooks / and Ubiquitous Multimedia , available at < http :/ / delivery . acm .org / lifedrive/ en /lifedrive _ handbook . pdf> , 2005, 23 pages . 10 . 1145 / 1060000 / 1052384 /p19 -khella . pdf? keyl = 1052384 Park , Will, “ Apple iPhone v1. 1. 1 SpringBoard Hacked to Display & key2 = 2419987911 & co11 =GUIDE & dl =GUIDE Multiple Pages ” , available at < http :/ /www .intomobile .com / 2007 / & CFID = 47073625 & CFTOKEN =65767142 > , Oct. 29 , 2004 , pp . 10 /09 / apple - iphone - v111 -springboard -hacked - to - display -multiple 19 - 24 . pages/ > , Oct . 9 , 2007 , 5 pages . Kinoma, “ Kinoma Player 4 EX Documentation " , Available at Park , Will, “ Neonode N2 Unboxing Pics ! " , available at < http : / / < http :/ / replay . waybackmachine .org /20061101175306 /http :/ / www . www . intomobile . com / 2007 /07 / 18 /neonode -n2 -unboxing - pics/ > , kinoma. com / index / pd - player - 4 > , archived on Nov . 1 , 2006 , Nov. 1 , Jul. 18 , 2007 , 7 pages . 2006 , 28 pages. PCFAN , “ Boot Camp Introduction /Data Transition /Operability / Laakko et al. , “ Adapting Web Content to Mobile User Agents ” , Ability Truth Derived from Gap Mac & Win Dual Boot Hard Veri IEEE Internet Computing, vol . 9 , No. 2 , Mar ./ Apr. 2005 , pp . 46 -53 . fication ” , Daily Communications , vol. 13 , No . 14 , Jun . 15 , 2006 , p . Landragin , Frederic , “ The Role of Gesture in Multimodal Referring 57 ( Japanese Language only ). Actions” , Proceedings of the 4th IEEE International Conference on Raman et al ., “ Application - Specific Workload Shaping in Multime Multimodal Interfaces, available at < http : // ieeexplore. iee. org / ie15 / dia - Enabled Personal Mobile Devices ” , CODES + ISSS , Oct . 22 - 25 , 8346 / 26309 /01166988pdf ? arnumber= 1166988 > , 2002 , 6 pages. Lie , Hakon Wium ., “ Cascading Style Sheets ” , University of 2006 , pp . 4 - 9 . Osloensis, MDCCCXI, 2005 , pp . 243 - 247 . Robie , Jonathan , “What is the Document Object Model ?” , Texcel Microsoft Word , “ Example of Scrolling Pages in Word 2003” , 2003 , Research , available at < http :/ /www .w3 . org / TR -DOM / introduction . 3 pages . html> , 2006 , 5 pages . Milic -Frayling et al ., “ Smart View : Enhanced Document Viewer for Rohrer, Tim , “Metaphors We Compute by : Bringing Magic into Mobile Devices ” , Microsoft Technical Report , available at < ftp : / / Interface Design ” , Available online at < http :/ / www .uoregon . edu / ftp . research .microsoft .com / pub / tr / tr - 2002 - 114 .pdf > , retrieved on uophil/ metaphor / gui4web . htm > , retrieved on Jun . 13 , 2006 , 7 Dec . 17 , 2007 , Nov . 15 , 2002, 9 pages . pages . Milic -Frayling et al. , “ SmartView : Flexible Viewing of Web Page Roto et al. , “ Minimap - A Web Page Visualization Method for Contents ” , Proceedings of the Eleventh International World Wide Mobile Phones ” , Proceedings of the SIGCHI Conference on Human Web Conference , available at < http : / /www2002 .org /CDROM Factors in Computing Systems, Apr. 22 - 27 , 2006 , pp . 35 - 44 . poster/ 172 / > , May 11 , 2002 , 4 pages. Salmre , I. , “Characteristics of Mobile Applications” , Chapter 2 , Miller, Matthew , “ HTC Touch and TouchFLO Interface ” , 7 :53 Salmre _ 02 . fm , Dec . 20 , 2004 , pp . 19 - 36 . minutes video , available at http : // www .youtube . com / Schreiner, Tony, “ High DPI in IE : Tip & Mystery Solved ” , Tony watch ? v = 60Up4wOcUc4 > , uploaded on Jun 6 , 2007 , 2 pages. Schreiner ' s Blog , available at < http :/ /blogs .msdn .com / tonyschr /ar Neonode Inc ., “ Welcome to the N1 Guide ” , available at < http : // chive / 2004 /05 /051126305 .aspx > , May 2004 , 2 pages . www .ebookspdf . com / gadget /2818 / neonode -nlm -manual / > , Jul. Stampfli , Tracy, “ Exploring Full - Screen Mode in Flash Player 9 ” , 2004 , pp . 1 -42 . Available online at < http : // www .adobe .com /devnet / flashplayer /ar Neonode. com , “ N1 Chick StartGuide” , Version 0 . 5 , Apr. 5 , 2005 , ticles/ full _ screen _ mode .html > , Nov . 14 , 2006 , 2 pages . pp . 1 - 24 . Stanek et al. , “ Video and Animation Plug - Ins ” , Chapter 9 , Web NTT DOCOMO , “ i -mode Compatible Pictograms” , available at Publishing Professional Reference Edition , available online at
( 56 ) References Cited Be Done With Android ” , Mar. 18, 2009 , pp . 58 -65 (See the communication filed under 37 CFR § 1 . 98 ( a ) ( 3 ) ) . OTHER PUBLICATIONS Decision to refuse a European Patent application received for European Patent Application No . 06846840 .4 , dated Mar. 4, 2010 , Warabino et al. , “ Video Transcoding Proxy for 3Gwireless Mobile 10 pages . Internet Access” , IEEE Communications Magazine, vol. 38 , No . 10 , Summons to Attend Oral proceedings received for European Patent Oct . 2000 , pp . 66 - 71 . Application No. 06846840 . 4 , dated May 18 , 2009, 7 pages . Wave Technologies , International Inc. , “ Certified Internet Webmas Decision to Refuse Patent Application received for European Patent ter Foundations Study Guide” , A Thomson Learning Company, Application No. 07814689 . 1 , dated May 11 , 2012 , 15 pages . CIWF -SGMN - 0101A , copyright 1988 - 2000 , 88 pages . Decision to Refuse Application received for European Patent Appli Weblogs, " An Overview of WebCore ” , Chapter 2 , WebCore Docu cation No. 09170697. 8 , dated Oct . 23 , 2013 , 12 pages. mentation , available at < http : / / lweblogs .mozillazine .org /hyatt / Decision to Grant received for European Patent Application No. WebCore/ chapter2 .html > , 2006 , 3 pages. 09700333 .9 , dated Nov. 7 , 2013 , 2 pages . Weblogs , " Downloading and Building WebCore ” , Chapter 1 , Final Office Action received for U . S . Appl. No. 11/ 850 , 005 , dated WebCore Documentation , available at < http :/ / weblogs . mozillazine . Nov. 16 , 2015 , 13 pages. org /hyatt /WebCore /chapter1 . html > , 2006 , 2 pages . Notice of Allowance received for U . S . Appl. No . 14 /011 , 639 , dated Webmasterworld . com , “ Page Zooming with IE -Hidden Feature ! ” , Sep . 29 , 2015 , 11 pages. Available at < http :/ / www .webmasterworld .com / forum83/ 4179 . Advisory Action received for U . S . Appl. No . 14 / 261, 112 , dated Apr. htm > , Jul. 2004 , 7 pages. 23 , 2015 , 3 pages. Wikipedia , " Comparison of Layout Engines ” , The free encyclope Office Action received for Chinese Patent Application No. dia , available at < http :/ /en .wikipedia .org / wiki/ Comparison _ of _ 201210399033. 9 , dated Oct . 8 , 2015, 8 pages (3 pages of English layout_ engines > , 2006 , 3 pages. Translation and 5 pages of Official Copy ) . Wikipedia , “ History of YouTube” , The Free Encyclopedia , available Notice of Acceptance received for Australian Patent Application at < http :/ / en .wikipedia .org /wiki / History _ of _ YouTube > , retrieved No . 2012200475, dated Aug. 24 , 2015 , 2 pages. on Mar. 15 , 2011, 4 pages . Office Action received for Japanese Patent Application No . 2013 Wikipedia , “ KDE ” , The free encyclopedia , available at < http : // en . 011209 , dated Nov . 2 , 2015, 9 pages ( 2 pages of English Translation wikipedia .org / wiki / KDE > , 2006 , 9 pages . and 7 pages of Official Copy ). Wikipedia , “ KHTML " , The free encyclopedia , available at < http : // Notice of Allowance received for Japanese Patent Application No. en .wikipedia . org /wiki / KHTML > , 2006 , 3 pages. 2013 - 127963 , dated Oct. 9 , 2015, 3 pages ( 1 page of English Wikipedia , “ List of Layout Engines” , The Free Encyclopedia , Translation and 2 pages of Official Copy ). available at < http : // en .wikipedia .org /wiki / List _ of_ layout _ en Office Action received for Japanese Patent Application No. 2013 gines > , 2006 , 1 page . 252338 , dated Dec. 4 , 2015 , 4 pages (2 pages of English Translation Williams, Martyn , “ LG ' s Cell Phone Can Pause Live TV ” , PC and 2 pages of official copy ) . World , Oct. 11, 2005 , 2 pages . Non - Final Office Action received for U . S . Appl. No . 14 / 710 ,125 , Wobbrock et al. , “ WebThumb : Interaction Techniques for Small dated Apr. 12 , 2016 , 12 pages . Screen Browsers " , UIST '02 , Paris France, Oct. 27 -30 , 2002 , pp . Final Office Action received for U . S . Appl. No . 11/ 850 ,010 , dated 205 - 208 . Apr . 18 , 2016 , 16 pages. Xiao et al ., “ Slicing* _ Tree Based Web Page Transformation for Cha , B ., “ HTC Touch (Sprint ), ” CNET Reviews, Nov . 6 , 2007 , Small Displays ” , International Conference on Information and http : / /web .archive .org /web / 20071106065114 / http : // reviews . cnet . Knowledge Management, Oct . 31- Nov . 5 , 2005 , 2 pages . com / smartphones/ htc -touch - sprint/ 4505 -6452 _ 7 -3267123 .html , 10 Xie et al. , “ Efficient Browsing of Web Search Results on Mobile pages . Devices Based on Block Importance Model ” , Microsoft Research Gade . L . , “HTC Touch ( Sprint) - Mobile TechReview , " Smartphone Asia , 2005 , 10 pages . Reviews by Mobile Tech Review , Nov . 2 , 2007 , http : / /www . Yin et al ., “ Using Link Analysis to Improve Layout on Mobile mobiletechreview . com / phones/ HTC - Touch .htm , 7 pages . Devices ” , Proceedings of the 13th international conference on ISO 9241 -10 : 1996 Ergonomic requirements for office work with World Wide Web , available at < http : // www . iw3c2 . org /WWW2004 / visual display terminals (VDTs ) Part 10 : Dialogue principles, docs/ 1p338. pdf > , May 17 - 22, 2004 , pp . 338 - 344 . International Standard - ISO , Zuerich , CH , vol. 9241- 10 , May 1 , YouTube, “ Broadcast Yourself ', Available at
References Cited Office Action dated Aug . 12 , 2013 , received in Australian Patent ( 56 ) Application No. 2012202140 , which corresponds to U . S . Appl. No . OTHER PUBLICATIONS 11 / 849 ,938 , 2 pages (Chaudhri ) . Office Action dated Feb . 20 , 2013 , received in Chinese Patent Final Office Action dated Feb . 15 , 2013 , received in U . S . Appl . No . Application , which corresponds to U . S . Appl . No. 11/ 849 , 938 , 5 pages ( Chaudhri ) . 11/ 850 ,010 , 21 pages (Omernick ). Office Action dated Aug . 2 , 2013 , received in European Patent Office Action dated Nov . 1, 2012 , received in Chinese Patent Application No. 08 829 660 . 3 , which corresponds to U . S . Appl. No . Application No. 200750041309 . 3 , which corresponds to U . S . Appl. 11 / 849 ,938 , 7 pages (Chaudhri ). No . 11/ 850 ,011 , 5 pages (Forstall ) . Office Action dated Oct. 26 , 2012 , received in Japanese Patent Office Action dated Jul. 2 , 2013 , received in Chinese Patent Appli Applieation No . 2010 - 524102 , which corresponds to U . S . Appl . No . cation No . 200780041309. 3 , which corresponds to U .S . Appl . No . 11 / 849 ,938 , 4 pages (Chaudhri ) . 11 /850 .011 , 12 pages ( Forstall ) . Decision to Grant dated May 31, 2013, received in Japanese Patent Notice of Allowance dated Apr. 20 , 2013 , received in U . S . Appl. No . Application No . 2010 - 524102 , which corresponds to U . S . Appl . No . 11 / 969 , 809, 23 pages ( Platzer ) . 11 /849 , 938 , 3 pages ( Chaudhri ) . Office Action dated Jan . 30 , 2013 , received in Koran Patent Appli Office Action dated Sep . 10 , 2013 , received in U .S . Appl . No . cation No . 1020107007258 , which corresponds to U . S . Appl. No . 11/ 964 , 912 , 20 pages (Lemay ) . 11 / 849 , 938 , 4 pages ( Chaudhri ). Office Action dated Sep . 20 , 2012 , received in U .S . Appl. No. Office Action dated Nov. 13 , 2012 , received in U .S . Appl. No. 12 / 242 ,851 , 21 pages (Herz ). 13 / 104 , 903 , 21 pages , ( Forstall ) . Final Office Action dated May 10 , 2013 , received in U . S . Appl . No . Notice of Allowance dated Apr . 29, 2013 , received in U . S . Appl. No. 12/ 242, 851, 33 pages (Herz ). 13 / 104 ,903 , 8 pages ( Forstall ) . Office Action dated Oct. 26 , 2012 , received in Chinese Patent Office Action dated Feb . 20 , 2013 , received in U . S . Appl . No . Application No . 200980000229 .2 , which corresponds to U . S . Appl . 13 / 104 ,911 , 25 pages (Forstall ). No . 12/ 242 , 851, 22 pages (Herz ) . Notice of Allowance dated Jun . 10 , 2013 , received in U . S . Appl. No . Office Action dated Jul. 2 , 2013 , received in Chinese Patent Appli 13/ 104 , 911 , 6 pages ( Forstall ). cation No . 200980000229 . 2 , which corresponds to U . S . Appl. No . Final Office Action dated Sep . 14 , 2012 , received in U . S . Appl. No. 12 /242 , 851 4 pages (Herz ). 11/ 850 ,005 , 22 pages ( Chaudhri ) . Summons to oral proceedings dated Sep . 21, 2012 , received in Decision to Grant dated Aug. 6 , 2012 , received in Chinese Patent European Patent Application No. 09700333 . 9 , which corresponds to Application No. 200880110709. X , which corresponds to U . S . Appl. U . S . Appl. No . 12 / 242 ,851 , 4 pages (Herz ). No. 11 /850 , 005 , 2 pages ( Chaudhri ) . Grant Notice dated Jun . 20 , 2013 , received in European Patent Summons to attend oral arguments dated Aug. 30 , 2013 , received in Application No . 09 700 333. 9 which corresponds to U .S . Appl. No . European Patent Application No. 08798713 . 7 , which corresponds to 12 / 242 ,851 , 7 pages (Herz ) . U .S . Appl. No . 11/ 850 ,005 , 15 pages (Chaudhri ) . Final Office Action dated Jan . 30 , 2013 , received in U .S . Appl. No . 11/ 849 , 938 , 38 pages ( Chaudhri) . * cited by examiner U . S . Patent Sep . 26 , 2017 Sheet 1 of 113 US 9, 772 , 751 B2
Memory Portable Multifunction Device 102 100 Operating System ??? Applications ( continued ) 136 Communication Module Calendar Module 148 Contact/ Motion Module Widget Modules 149 Graphics Module Weather Widget 149- 1 Text Input Module Stocks Widget - 149 - 2 GPS Module Calculator Widget . 149 - 3 Applications Alarm Clock Widget - 1494 Contacts Module Dictionary Widget 149- 5 Telephone Module Video Conference Module User -Created Widget( s ) 149 -6 ???????#???? - 150 E -mail Client Module Widget Creator Module 151 Instant Messaging Module Search Module Blogging Module Camera Module ?????????? Power 1 162 Image Management Module System Video Player Module Music Player Module External Browsing Module Port 118 103 RF Circuitry 103 m 103 108 Speaker 104 med - 111 Controller ????????????????? Audio 122 cm Circuitry ( 103 110 Peripherals 1103 Microphone Interface Proximity 113 103 Sensor 166 120 Processor (s ) Accelerometer( s ) 103 168 I/ O Subsystem 158 106 Display Optical Other Input 160 Controller sensor( s ) Controller ( s ) 156 - Controller 11103 m 103 1103 Optical Touch -Sensitive Other Input mars 116 112 Display System Sensor( s ) Control 164 Devices Figure 1A U . S . Patent Sep . 26 , 2017 Sheet 2 of 113 US 9 ,772 ,751 B2
Memory 102 Portable Multifunction Device 100 Operating System 126 136 Applications (continued ) 148 Communication Module Lr 128 Calendar Module Contact Motion Module Widget Modules 149 Graphics Module Weather Widget (s ) 149- 1 Text InputModule Stocks Widget 149- 2 GPS Module Calculator Widget 149- 3 Applications Alarm Clock Widget 149 - 4 Contacts Module Dictionary Widget 149- 5 Telephone Module 149 - 6 User -Created Widget( s ) Video Conference Module 150 E -mail ClientModule Widget Creator Module 151 Instant Messaging Module Search Module 155 Blogging Module Online Video Module Camera Module Image Management Module - 144 Video and Music PlayerModule IIIIIII 152 Power L 162 System Notes Module Map Module 1 154 External 124 Browsing Module L 147 Port : 118 103 RF Circuitry 103 108 Speaker 104 - 111 Controller 03 Audio 122 . Circuitry 110 ( 103 Peripherals . 103 Microphone Interface Proximity Tone113 Sensor M 166 Processor( s ) Accelerometer( s ) em 103 168 I / O Subsystem 158 Display Optical Other Input 160 Controller sensor ( s ) Controller( s ) 156 Controller 103 103 103 Optical Touch -Sensitive Other Input - 116 Display System Sensor (s ) Control 112 164 Devices Figure 1B U . S . Patent Sep . 26 , 2017 Sheet 3 of 113 US 9, 772 , 751 B2
Portable Multifunction Device 100 I 206 210 212 Optical Proximity Speaker 111 Sensor 164 Sensor 166 208 200
208 210 is SIM card slot 212 is headphone jack
202
Touch Screen 112
Microphone Home Accelerometer( s ) 113 204 168
ExternalPort VOOR 124 VOO Figure 2 U . S . Patent Sep. 26 , 2017 Sheet 4 of 113 US 9, 772 , 751 B2
Portable Multifunction Device 206 100 Speaker 111 Optical Proximity 300 Sensor 164 Sensor 166 302
...... Current Time 308 307 310 m Day and Datem 312 Wallpaper image 314
Slide to unlock
302 306
Touch Screen 112
Microphone Home Microphone113 home204 Figure 3 U . S . Patent Sep. 26 , 2017 Sheet 5 of 113 US 9, 772 ,751 B2
Portable Multifunction Device | 2061 ; 100 ...... Speaker 111 Optical Proximity 400A Sensor 164 Sensor 166 402 . . .. . Current Time 404 . . . . . 406 [2081208 IM
Text Photos Camera Videos 141 144 143 145 Jan 750 15 Weather Stocks Blog Calendar 149 - 1 149 -2 142 148
i User + = X nimicininin Created ABC Widget Calculator Alarm Dictionary . . . . . Widget 149 - 3 149 - 4 149- 5 149- 6
......
coPhone Mail Browser Music 138 140 408HO . 147 146 Touch Screen 112
Microphone Home 113 204
Figure 4A U . S . Patent Sep. 26 , 2017 Sheet 6 of 113 US 9, 772 , 751 B2
Portable Multifunction Device 1 2061 100 Optical Proximity Speaker 111 Sensor 164 Sensor 166 400B 807 A 402 Current Time 404 D 406
User User Usern User 807) Created Created Created Created Widget 1 Widget 2 Widget 3 Widget 4 Widget Widget Widget Widget Hotototototi149 - t6 ottatott- 1 149 - 6 - 2 149 - 6 - 3 UN149 -6 -4 User User Created Created Widget 5 Widget 6 Widget Widget 149 - 6 - 5 149 - 6 -6
Phone Mail Browser Music COE140 147 146 138 Proget h er the 408age Brazete Melhor Touch Screen 112
Microphone Home 113 204
Figure 4B U . S . Patent Sep. 26, 2017 Sheet 7 of 113 US 9, 772 , 751 B2
Portable Multifunction Device 206 ) 100 Speaker 111 Optical Proximity 400C Sensor 164 Sensor 166 |802 402 Current Time 404 O 406 807 User- Created Widgets wwww (User Widget- Created 1 User- Created Widget 1 149- 6 - 1 V Userbakarra - Created Widget 2 User- Created Widget 2 149- 6- 2 User- Created Widget 3 User- Created Widget 3 149 -6 - 3 UserWidget- Created 4 * | User- Created Widget 4 149- 6 -4 B
* User- Created Widget 5 User- Created Widget 5 149- 6 - 5 UserWidget- Created 6 ) User- Created Widget 6 149- 6 -6
.
Phone Mail Browser Music 138 140 147 146 408 ? : : : : : : : : : : ...... Touch Screen 112
Microphone Home Moreogramet.. . 113 .. . ) eros204 Figure 4C U . S . Patent Sep . 26 , 2017 Sheet 8 of 113 US 9, 772 ,751 B2
Portable Multifunction Device 206 100 Speaker 111 Optical Proximity 3900A Sensor 164 Sensor 166 2081 L 402 Current Time 404 406 3902 3906 po208 Welcome 3904 http :/ /www .company .com /start 3908 3910 Web page Block 3 3912 3914 - 3 Block 1 3914 - 1 Block 7 Block 4 3914 - 1 wwwwwwwwwvivivivivivivivivivivivivivir 3914 -4 Block 5 3925 3914- 5 Block 2 13923 Block 8 3914 - 2 3914 - 8 Block 6 3914 - 6 A + DARRERA 3916 3918 3920 3922
Microphone Home Moreninge: 113 n Figure 5A U . S . Patent Sep . 26 , 2017 Sheet 9 of 113 US 9, 772 , 751 B2
Portable Multifunction Device 206 100 Speaker 111 Optical Proximity 3900B Sensor 164 Sensor 166 807 4402 Current Time 404 TO 406 Y * * * * * * * * * * * * - * * * * * * * * * * * ( Cancel Welcome 3904 807) http :/ / www . company. com | 3926
Clear 3928 initi Search Google 3930 Go to URL 3932 QWERTYULD ASDFGHKM 0 2 xCUBNM ? 123 616
Microphone Home 113 204
Figure 5B U . S . Patent Sep . 26 , 2017 Sheet 10 of 113 US 9, 772 ,751 B2
Portable Multifunction Device 206 Speaker 111 Optical Proximity 39000 Sensor 164 Sensor 166 402 Current Time 404 406 2081208 w ilayalamdinin i 3902 Welcome 3904 3906 http :/ /www . company .com /start 3908 3910 3927, Block 4 3914- 4
Block 5 3914- 5 3937 WANNA -37 - 13939 3939 2700m say39431 revr y - r - - r - r - - r - r - -r - - r - - r - - r- - r - - r - - r r - r - -r - - r - - r - - r- - r - - r - - r -- r - - r - - r - - r - - r - - r - - r - - r - - r - r - - r - - r - - r - - r - - r - - r - r - - r - - r - - r - -r - - r - - r - - r - - r - - r - - r -- r - - r - - Block 6 3914 -6 3935 © © + Ç 3916 3918 3920 3922 . Microphone ) Home 113 204
Figure 5C U . S . Patent Sep. 26 , 2017 Sheet 11 of 113 US 9, 772 , 751 B2
Portable Multifunction Device 206 100 Speaker 111 Optical Proximity 3900D Sensor 164 Sensor 166 807 1402 Current Time 404 O 406 807 3916
3918 http:/www.companycomstart3908
3902 3914-53914-5 5Block 39063906 etagero, Welcome3904 3920SD3920+5 wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww 3922 3910
Microphone Home 113 204
Figure 5D U . S . Patent Sep . 26 , 2017 Sheet 12 of 113 US 9, 772 ,751 B2
Portable Multifunction Device 206 100 Optical Proximity Speaker 111 Sensor 164 3900E Sensor 166 807 402 Current Time 404 1 406
802)
w
w
.?123 w L123? Clear3928 wwwwwwwwwwwwwwwwwwwwwwwwwwwwwww http:/www.companycom|3926 Cancel
wwwwwwwwwwwwwwwarnanananananananananananananananananananananananananananananananananananananananawwwwww EI616 wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwtestow 2CUENM@ wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww n Welcome3904 QWERLOOUOD C
* 3932 GotoURL * GEGOOK ' Google3930 Search
Microphone Home 113 204
Figure 5E U . S . Patent Sep . 26 , 2017 Sheet 13 of 113 US 9, 772 , 751 B2
Portable Multifunction Device 2061 100 . * . . Speaker 111 Optical Proximity 3900F Sensor 164 Sensor 166 208 402 Current Time 404 D 406 wwwwwwww tutututututututututututututitutitutitutitutitutitutitutitutitutitutitutitutitutitutit 3902 3906 |208 Welcome 3904 http :/ / www . company . com /start 3908 3910 Block 4 3914 - 4
Block 5 3914 -5
3972 - - + + + + + + + + + + + + + + + + + + + + + Create+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + Web+ + + + + + + + + + + + + + + + + + + + + + + -+ + + + + Clip+ + + + + + + + + + + + + + + + + + + Widget+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + 3978+ + + + + + + + + + +
Add Bookmark 3974 S everneverneverneverneverne E -mail Link To This Page 2975
Cancel 3976
Microphone Home 113 204
OOOOOOOOOOOOFigure 5F U . S . Patent Sep. 26 , 2017 Sheet 14 of 113 US 9, 772 , 751 B2
Portable Multifunction Device 206 100 Speaker 111 Optical Proximity Sensor 164 Sensor 166 208) 3900G 402 Current Time 404 D 406 gigigigit 208 * 3912-1 139497 *
3934-2
3936 NewWindow 3951Swipe 3912-2 3938 Done iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii WebpageWebp 3934-3 139539 3912-3
Microphone Home Merentemente113 co 204m Figure 5Giniiniini niin innin w U . S . Patent Sep. 26 , 2017 Sheet 15 of 113 US 9, 772 ,751 B2
Portable Multifunction Device [ 206 100 Speaker 111 Optical C . Proximity 3900H Sensor 164 Sensor 166 802
402 Current Time 404 WA 406 807 Cancel Welcome 3904 Add Web Clip Widget Cancel Add 3928 13978 Block 5 3914 - 5 Name: Welcome Block 51 200060
...... QWERTYUIO (ASDFGHJKL ) 616 1 2 xCUBNM . ? 123 618
Microphone Home Microphone113 Hote204 Figure 5H U . S . Patent Sep. 26 , 2017 Sheet 16 of 113 US 9, 772 , 751 B2
Portable Multifunction Device 206 ) 100 Speaker 111 Optical Proximity 39001 Sensor 164 Sensor 166 2081208 402 Current Time 404 0406 Add
Folder:Sports com.ESPN:Title(
)>comespn.www:/httpAddress( AddBookmark Cancel ...... ! ! ! ! Microphone Home Microphone113 204
Figure 51 U . S . Patent Sep . 26 , 2017 Sheet 17 of 113 US 9, 772 , 751 B2
Portable Multifunction Device 206 Speaker 111 Optical Proximity 3900J Sensor 164 Sensor 166 208 402 Current Time 404 I 406 3902 Welcome 3904 3906 |208 Welcome 3904 http :/ / www . company .com /start 3908 une 3910 Ytttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttt * Web page Block 3 3912 wwwwwwwwwwwwwwwwwwwwwwwwwwwwww Block 1 3914 - 3 3914 - 1 Block 7 Block 4 3914 - 7 3914 - 4 LE
witwerterent rererererererererererererererereretetett Block 5 3914 - 5 Block 2 Block 8 3914 - 2 3914 - 8 wwwwwwwwwwwwwwwwwwwwww Block 6 ttttttttttttttt 3914 - 6
Toggle Add Widget Cancel IIIIII. 3956 3954 3952
Microphone Home 113 204
Figure 5J U . S . Patent Sep. 26 , 2017 Sheet 18 of 113 US 9, 772 , 751 B2
Portable Multifunction Device 206 100 Speaker 111 Optical Proximity 3900K Sensor 164 Sensor 166 2087 A 402 Current Time 404 D 406 3902 Welcome 3904 3906 http :/ / www .company . com /start 3908 3910 This is what the web clip3950 widget will look like . Move , scale , and /or rotate to adjust.
Block 4 3914 -4
Block 5 3914 -5 39231
Cancel dd Widget 3952 3954 ww waimi 3916 3918 3920 3922 113924 Microphone Home 113 204
Figure 5K U . S . Patent Sep. 26 , 2017 Sheet 19 of 113 US 9, 772 ,751 B2
Portable Multifunction Device 1 2061 100 Speaker 111 Optical Proximity 3900L Sensor 164 Sensor 166 BOZ 402 Current Time 404 406 BOZ 3902 3906
User- Created Widget 1 149 -6 -1 Swipe ! 3962
User- Created Widget 2 149- 6 -2
3916 3918 3920+ 39220 Microphone Home 113 204
Figure 5L U . S . Patent Sep. 26 , 2017 Sheet 20 of 113 US 9, 772 , 751 B2
Portable Multifunction Device 206 100 Optical Proximity Speaker 111 Sensor 164 Sensor 166 3900M 807 402 Current Time 404 0 406 3902 3906 )807 39643
User- Created Swipe ! Widget 2 43965 ) 3962 149 -6 -2 13969
Swipe 3963 he
Edit Widget 3970 39160 h3918 3920+ 3922 Microphone Home 113 : 204
Figure 5M U . S . Patent Sep. 26 , 2017 Sheet 21 of 113 US 9, 772 , 751 B2
Portable Multifunction Device 907 100 Speaker 111 Optical Proximity 39000 Sensor 164 Sensor 166 208 402 Current Time 404 10 406 208 3902 Welcome 3904 3906 http : / /www .company . com /start 3908 3910 Block 4 3914 - 4
wwwwwwwww Block 5 wwwwwwwwwwww 3914 - 5
Block 6 3914 - 6
39160 39180 +3920 3922 Microphone Home Microphone113 home204 Figure 6A U . S . Patent Sep. 26 , 2017 Sheet 22 of 113 US 9, 772 ,751 B2
Portable Multifunction Device [ 206 ] 100 Speaker 111 Optical Proximity 600B Sensor 164 Sensor 166 208 4402 Current Time 404 D 406
User User User -208 Created 604 - 1 Created Created Widget 1 Widget 2 Widget 3 Widget Widget Widget 149 -6 - 1 149- 6 - 2 149 -6 - 3
??? 3?? ? ? ?? ?? ? ???? ? ????? - 98 User User User 604 - 2 Created Created Created Widget 4 Widget 5 Widget 6 Widget Widget Widget 149 - 6 - 4 149 - 6 - 5 149 - 6 - 6
Block 5 3914 - 5
Phone Mail Browser Music OBO138 140 147 146146 Touch Screen 112
Microphone Home 113 204
Figure 6B U . S . Patent Sep. 26 , 2017 Sheet 23 of 113 US 9, 772 , 751 B2
Portable Multifunction Device 206 . 100 w atertown Speaker 111 Optical Proximity 600B Sensor 164 Sensor 166 807 A 402 Current Time 404 I 406
. . . . V = Y4EYS User . Usern User 807 Created 604 - 1 Created Created Widget 1 Widget 2 Widget 3 Widget Widget Widget 149- 6 - 1 149 - 6 - 2 149 -6 - 3 Usert : ) User User 604 - 2 Created Created Created Widget Widget 6 - - = - * * * . . . Widget Widget Widget 149 - 6 - 4 1 149 - 6 - 5 149 -6 -6
Block 5 everything3914 . 5 s02
410
Phone Mail Browser Music 138 140 408 147 146 09www hote l esnemmenommen hatte Touch Screen 112
...... Microphone Home Merenskomst113 204 ...... Figure 6C atent Sep . 26 , 2017 Sheet 24 of 113 US 9, 772 , 751 B2
Portable Multifunction Device [ 2067 100 Speaker 111 Optical Proximity 600B Sensor 164 Sensor 166 208 1402 Current Time 404 D 406 208 User User User Created Block 5 Created Created Widget 1 3914 - 5 Widget 2 Widget 3 Widget Widget Widget Widget 149- 6 - 1 149- 6 - 7 149- 6 - 2 149 -6 - 3 User User User . 604- 2 Created Created Created .LA Widget 4 Widget 5 Widget 6 Widget Widget Widget 149 - 6 - 4 149- 6 - 5 149 - 6 - 6
A V ANTAJANA TAAVAA WATAAAAAAAAAAttitutitutitutitutitutitutitutitutitutitutitutitutitutitute wwvwwwvvwvvvv IIIIIIIIIIIIIIIII Phone Mail Browser Music 138 1401400 147 146 OE408408 147 ? Touch Screen 112
Microphone | Home Microphone113 co 204me Figure 6D U . S . Patent Sep . 26 , 2017 Sheet 25 of 113 US 9, 772 , 751 B2
Portable Multifunction Device 206 100 Optical Proximity Speaker 111 Sensor 164 Sensor 166 600Bop Gender un correo 2081208 mal 402 Current Time 404 LA406 User User User Created I 606 ) Created Created Widget 1 Widget 2 Widget 3 Widget Widget Widget Widget 149- 6 - 1 149- 6 - 7 149 -6 - 2 149- 6 - 3 Users User User 604- 2 Created treated Created NES Widget 4 Widget 5 Widget 6 Widget Widget Widget 149- 6 - 4 149 - 6 - 5 149 -6 - 6
Phone Mail Browser Music 140 408 147 146 Touch Screen 112
Microphone Home 113 204
Figure 6E U . S . Patent Sep . 26 , 2017 Sheet 26 of 113 US 9, 772 , 751 B2
700 ovement canone mensen meteen e wn e were women were rent - - - nowe owem w oniministeerimine - - - - Detect selection of a web page or portion thereof for display on a touch screen ! display of a portable multifunction device 702 - wam o naman sement com a comment on an emergence
Display the web page or portion thereof on the touch screen display 704
Detect an activation of an options icon 706
In response to detecting activation of the options icon , display a plurality of icons including a web - clip widget creation icon 708
Detect an activation of the web -clip widget creation icon 710
In response to detecting activation of the web -clip widget creation icon , create a web - clip widget corresponding to the displayed web page or portion thereof 712 sebe nemen e n roer teen monument comes to create some so come more come see more he was . o . moet het om Request a name for the web -clip widget , receive the name, and store the name . {. 714 www wayan man www www men annan www www . cam mana www www 11 Il Il - - - o com o me - - - - - com o I ??? Create anE icon corresponding to the web - clip widget 716 . mom an mw mo man man was ann am www ww . mom anna ne money ann ann www www mm www .ww www .m anom ww www mm 1pe Displayr te moeten renmen the mwen iconsammen women corresponding arenen annen som samen me t commentto serveresthe mere web -are clip sorprende widget come more serien in er aen menuste superior comeor list ofcontenente icons aumentation ! 718 . - - - - . - - - . ------. - se mere - - - - - recent comments - - - - - More - - - - coment 11 -IIIID Store the web - clip widget as a bookmark in a browser application 720 . rentIII content are many women were more nomen women women are we went there are some me shume met bra m e e IIIII Iloi worden over waren aurrean movie was comme mon maneno manera con nomen women waren waren sorrere ancora non est moment en comment comme Send the web - clip widget to a web server for storage 722 TallI . 1
Figure 7A U . S . Patent Sep . 26 , 2017 Sheet 27 of 113 US 9 ,772 , 751 B2
......
Detect an activation of the icon corresponding to the web - clip widget 724
Display the web - clip widget 726 Figure 7B
Send the web - clip widget to an electronic device external to the portable multifunction device 728
The external electronic device stores the web - clip widget 730
The external electronic device detects an activation of the web -clip widget 732
The external electronic device displays the web -clip widget 734
Figure 70 U . S . Patent Sep . 26 , 2017 Sheet 28 of 113 US 9, 772 , 751 B2
Detect an activation of a widget editing icon 736
Display one or more settings associated with the web - clip widget 738 www www more awarin animent ma i marining animanis among woming moviments entre em content content are the best serveren e contents were content continue Display an animation of flipping the web -clip widget, to reveal the one ! or more settings 240
Receive a change to a setting of the one or more settings 742 werden som en samment centren e me t mensen machent meneem omnes are more comment content are own money on monetan mand more on minus one ano anane Detect one ormore finger gestures to refocus an area in the web page or portion thereof for use by the web -clip widget 744 wanna maana wanne www w s wann waren menin women were weinindian moderne der warning w meninining win winning the street - www
Store the change 246
Cease to display the one or more settings 748
Figure 7D U . S . Patent Sep. 26 , 2017 Sheet 29 of 113 US 9, 772 , 751 B2
Detect an activation of an options icon on a touch screen display of a portable multifunction device 752 Detect a finger gesture ( e . g . , a tap gesture ) on the options icon 753
Detect an activation of a web - clip widget creation icon 754 somente comune come across seves moment more come so no co me ancest scores were more content concerns were measures waren waren seren serem Detect a finger gesture ( e . g ., a tap gesture ) on the web - clip widget creation icon 756
Select an area in a web page or portion thereof displayed on the touch screen display 758 Toggle between frames that are successively overlaid on the displayed web page or portion thereof 760 ------el moment moet ons son mom mom mo m momento . . . . . Detect one ormore finger gestures to select an area in the web page ! or portion thereof for use by the web -clip widget 762 mm mm annen annan www www www www www www www ww www ww www meme wa mwanawe wa mwa winna uwe umewe anawe amed ------Detect one or more finger gestures to scale an area in the web page i or portion thereof for display by the web -clip widget 764 comentario e internet dentaire et reste de aer med en moeten der en en anderen r en der e internet service la merce et de contenentementet r en stor andet e nde t den er det eneste steder er
Detect a finishing gesture 766 anampen om e e n conviene covóvónénk a vevoneni sevöv?vére Revisiones svovovénie civovovom vovveni servovóvóni rownies thrown amontni svovovové kovovóvóné venti on comprison serinin tamirimin e insemination au sein durimine animation Detect a finger gesture ( e . g . , a tap gesture ) on an icon 768 - more on someone we are more monere are cover more comment on to
Create a web - clip widget from the selected area 770
Figure 7E U . S . Patent Sep. 26 , 2017 Sheet 30 of 113 US 9, 772 , 751 B2
. . . . 780
......
Display , on a touch screen display on a portable multifunction device , an icon corresponding to a plurality ofwidgets , including two or more web clip widgets 781
Detect an activation of the icon 782
Display a first portion of the two or more web - clip widgets 783
Detect a gesture on the touch screen display 784
Display a second portion of the two or more web - clip widgets 785
Figure 7F U . S . Patent Sep . 26 , 2017 Sheet 31 of 113 US 9, 772 ,751 B2
790
Display , on a touch screen display on a portable multifunction device , an icon corresponding to a plurality of widgets , including two or more web clip widgets 791
Detect an activation of the icon 792
Display a plurality of icons corresponding to respective widgets in the plurality of widgets 793
ODIO DIVIDIDO ODVODOVODNO DOVODNO OD DONDOO YOU Detect an activation of a respective icon in the plurality of icons, corresponding to a respective web -clip widget 794
Display the respective web -clip widget 795 UUUDetect a gesture on the touch screen display 796 Cease display of the respective web - clip widget and display another web clip widget 797
Figure 7G U . S . Patent Sep . 26 , 2017 Sheet 32 of 113 US 9 ,772 , 751 B2
7000
Display , on a touch screen display on a portable multifunction device , an icon for a web - clip widget. The web - clip widget corresponds to a user specified area of a web page 7002
- wenn man and wenn man anno com www www me on one content contenido este mesmo. maana wanan a Display the icon in a menu or list of icons 7004 com home honored the - we went o n www come com o nomen women women women moremo mom moren sormente serveren en content conte contenendo l aranybenderanimin vendimin mendimin wann wennen nemen met mensen w we a re mannen anne man som manne wanne wamem ------The user- specified area was previously selected by translating and ! com scaling a displayed portion of the web page 7006 i wasio na mm mm muret mm mm mm mmen werden gelen annen mensen met meer mensen we w w w w do - m a m ww www www come and grow and more common comment seren serents servant The user- specified area was previously selected by centering and enlarging a displayed portion of the web page 7008 www ww ww www www more more common sense are wann man amant cannot games and wann man met w we are interesante este con here
Detect an activation of the icon 7010 gonna mannen som er rettet med annen sensation entertaining ww www mwen menm mw www me see www mom mom ww my Detect a finger gesture ( e . g . , a tap gesture ) on the icon 7012 | Led
In response to detecting activation of the icon , display the user- specified area of the web page 7014
Figure 7H U . S . Patent Sep. 26 , 2017 Sheet 33 of 113 US 9, 772 ,751 B2
Portable Multifunction Device 2067 100 Speaker 111 Optical Proximity 800A Sensor 164 Sensor 166 208 _ Currentnt Time 194404 * ) D40I 406 4492 Jan p2087 15 200 Text Calendar Photos Camera 141 148 144 143 om 750 Online Stocks Map Weather Videovete 155 149 - 2 154 149thing . 1 ( 0 ) *oth - *X Clock Calculator Notes Settings 1494 149 - 3 153 412 User Created • Swipe 808 Widget * * * * * * Swipe 810 Widget 804 - 1 804 - 2 1 802 Det149 - 6 er 8060noget * to someoneÓ Om 804 - 3 ? Vivi ? ? Phone Mail Browser Pod 138 140 147 152 408 Touch Screen 112
Microphone Home Accelerometer( s ) 113 204 168
Figure 8A U . S . Patent Sep . 26 , 2017 Sheet 34 of 113 US 9, 772 , 751 B2
Portable Multifunction Device 2061 100 Speaker 111 Optical Proximity 800B Sensor 164 Sensor 166 208 402 Current Time 404 * 406 Users Users User User (2081 Created Created Created Created Widget 1 Widget 2 Widget 3 Widget 4 Widget Widget Widget Widget 149 - 6 - 1 149 -6 - 2 149- 6 - 3 149 - 6 - 4 User User Created Created Widget 5 Widget 6 Widget Widget 149 - 6 - 5 149 - 6 - 6
• Swipe 812 sanannnnnnnnnnimin memnuninniermisinin
804 - 1 804- 2 | 802 www . com www 806enom. ~com .? mm od 0 - 804- 3 0 0 0 Phone Mail Browser iPod 408 138" 140 147 152 Touch Screen 112
Microphone Home Accelerometer ( s ) Marmontantes113 204 Peralamatan168 Figure 8B U . S . Patent Sep . 26 , 2017 Sheet 35 of 113 US 9 ,772 ,751 B2
Portable Multifunction Device [ 206 100 Speaker 111 Optical Proximity 8000 Sensor 164 Sensor 166 802 402 portalen Currentwenn man Time en we 404 x D 406
User User User User 1807 Created Created Created Created Widget 7 Widget 8 Widget 9 Widget 10 Widget Widget Widget Widget 149- 6 - 7 149 -6 - 8 149 -6 - 9 149- 6 - 10 User User User User 1816 Created Created Created Created Widget 11 Widget 13 Widget 14 Widget Widget Widget Widget 149 - 6 - 11 149 - 6 - 12 149 - 6 - 13 149 - 6 - 14
Users Created Widget 15 Widget 149 -6 - 15 804 -1804 -2 } 802 8064 * O Ó . 4804- 3 - - -
Phone Mail Browser iPod 152 408pre ho Browser142 does Touch Screen 112
Microphone Home Accelerometer ( s ) Mersin113 g everything204 Peringatan Figure 8C U . S . Patent Sep . 26 , 2017 Sheet 36 of 113 US 9 ,772 ,751 B2
Portable Multifunction Device | 206 100 Speaker 111 Optical Proximity 800D Sensor 164 Sensor 166 208 - 4402 Current Time 404 * 406merend mannen 208 wenn 3 :45 PM mensenwonen Sunday, November 2 women were ennen m annen 730 einen man wenn Cupertino A annan manierenen DJI 13, 046 + 70 .00 were arethere women AAPL 190. 05 + 10 .00 and 2 Messages from Alice wamenwomen wawe Meeting at 5 :00 PM mense 804 -1 804 -2 annenan was 180 www __ 806 O O O Vyv 804- 3
Phone Mail Browser iPod 138 140 147 152 408e en Browser doe Touch Screen 112
Microphone Home Accelerometer (s ) 113 204 168
Figure 8D U . S . Patent Sep. 26 , 2017 Sheet 37 of 113 US 9, 772 , 751 B2
900 Display a first set of a first plurality of icons in a first area of a touch screen display . The first plurality of icons includes a plurality of sets of icons that are separately displayed in the first area of the touch screen display . 902
Display a second plurality of icons in a second area on the touch screen display , The second area is different from the first area . 904
Detect a first finger gesture on the touch screen display in the first area . 906
In response to detecting the first finger gesture on the touch screen display in the first area , replace display of the first set of the first plurality of icons with display of a second set of the first plurality of icons in the first area on the touch screen display while maintaining the display of the second plurality of icons in the second area on the touch screen display . 908 , www ww nan momen muss man www man www www mannen man was won monosan new www mm s maneno men man www www www www mm mm mm Update the information provided by set- sequence -indicia icons to reflect the replacement of the displayed first set by the second set. 910
|pome . Detect www www ww a wwwsecond mwenen waar fingerhet wie warm gesture en weer on anin amenin icon mand weetin onthe winni second setw of theonnen w firsto plurality of icons . 912 moer women mense water and we wawe na wewe un www www www way wwwm m m mmmwww w mwen om een
...... In response to detecting the second finger gesture , display an application that | corresponds to the icon in the second set upon which the second finger gesture He was detected . 914
iw Detect a third finger gesture on the touch screen display while the second set of gran the first plurality of icons are displayed . 916merem treneren me t een over more ne I
www wwwwwwwwwwwwwww w w. ww www ww ww www ww wwww ww www mm wwwmy In response to detecting the third finger gesture , replace display of the second set of the first plurality of icons with display of a third set of the first plurality of icons in the first area on the touch screen display while maintaining the display of the more second plurality of icons in the second area on the touch screen display : 918 ww w ww moments were more om ww man ay www wat ons were mom ww www mm
Figure 9A U . S . Patent Sep . 26 , 2017 Sheet 38 of 113 US 9, 772 , 751 B2
pre com www com www c o m o nome mend w mom www mw me on women wanne wat aan een mannen som Detect a fourth finger gesture on an icon in the third set of the first plurality of icons .I ! 920 pre noen someone on one wom www am ww ww wom samen met en annen een comes more even more en una mostrar momento n este moment 1 in response to detecting the fourth finger gesture , display an application that 1 corresponds to the icon in the third set upon which the fourth finger gesture was Het* detected . 922 wienieni ar citiem maintenant indien dienen tenderin birin in adinin menasi como una to remove the ri to en image directions within 1 meer d an werwerten en annen som serveren The first finger gesture is a swipe gesture in a first direction . Detect a second finger ! he swipe gesture on the touch screen display in a direction that is opposite (or substantially opposite ) the first direction . 924 menat
por unIn a nararamenteresponse entre totes where the mountament towhen detectinganomenen wannen momen t materna the memohon secondmenaren orairement more and fingerwhether you relaterte artementenswipe warene nt restaurant gesture wateren en weer , replace display of the first set of the first plurality of icons with a display of information , other than a set in the plurality of sets of icons , customized to a user of the device . 926 i Update the information provided by a customized - information indicia icon and ? i il the set- sequence - indicia icons to reflect the replacement of the displayed first , I lm www com ww onnow womesset by the information customized to the user . 928 m . baserer senere w ere some moren moeten worsen -
Figure 9B U . S . Patent Sep . 26 , 2017 Sheet 39 of 113 US 9, 772 , 751 B2
Portable Multifunction Device 2061 Optical Proximity Speaker 111 Sensor 164 Sensor 166 1000A BOZ 402 Current Time 404 * D 406 ( M Jan TEL 802 15 Text Calendar Photos Camera 141 148 144 143 10021
----- 750 Online Stocks Map Weather Video 155 149 - 2 154
X
Clock Calculator Notes Settings 149 - 4 149- 3 153 412 User Created Widget Widget 804 - 1 804- 2 802 149 - 6 804 - 3 C 0 0 Phone Mail Browser iPad 138 Matilde140 Brouwe147 r 152 Touch Screen 112
Microphone Home Accelerometer( s ) Changementer113 204 i Korban168 Figure 10A atent Sep . 26 , 2017 Sheet 40 of 113 US 9, 772 , 751 B2
Portable Multifunction Device 206 100 Speaker 111 Opticaliii Proximity 1000B Sensor 164 Sensor 166 L802 4 402 Current Time 404 406 1.802 M van
Text Calendar Photos Camera 141 148 144 143
75° Online Stocks Map Weather Video 155 149 - 2 154 149 - 11 1004 - 1
+ X
Clock Calculator Notes Settings 1494 149 - 3 153 412 User Created Widget Widget 804- 7 804- 2 149 - 6 do on 804- 3
Touch Screen 112
Microphone Home Accelerometer( s ) Microphone113 (che 204 Accelerometeren168 Figure 10B U .S . Patent Sep. 26 , 2017 Sheet 41 of 113 US 9 ,772 ,751 B2
Portable Multifunction Device 206 100 Speaker 111 Optical Proximity 10000 Sensor 164 Sensor 166 208 402 Current Time 404 D 406 208
Stocks 149 - 2 154 1004- 2
+ - X Calculator Notes : 149 - 3 153
Touch Screen 112
Microphone Home Accelerometer (s ) 113 204 168 Figure 10C U . S . Patent Sep . 26 , 2017 Sheet 42 of 113 US 9, 772 , 751 B2
Portable Multifunction Device 206 100 Speaker 111 Optical Proximity 1000D Sensor 164 Sensor 166 208 402 Current Time 404 x D 406 208 1004 - 3 INDU 11240 . 35 - 2 . 24 AAPL 68. 30 - 1. 29 DIS 29. 90 -. 14 GOOG : 373. 78 - 1 .61 INTC 17 .49 7 . 16 1d tw 1m 3m 6m 1y 2y
Touch Screen 112
Microphone Home Accelerometer( s ) 113 204 168
Figure 10D U . S . Patent Sep. 26 , 2017 Sheet 43 of 113 US 9, 772 , 751 B2
Portable Multifunction Device | 2061 100 Optical Proximity Speaker 111 Sensor 166 1000E Sensor 164 208 402 Current Time 404 406 1004. . |208 INDU 11240 . 35 - 2 .24 AAPLwwwwwww 68. 30 - 1. 29 DIS 29. 90 - 14 GOOG 373. 78 - 1 .61 VIVA INTC 17 .49 * . 16 1d 1w 1m 3m 6m 1y 2y
X1006 Microphone Home Accelerometer( s ) 113 204 168
Figure 10E U . S . Patent Sep . 26 , 2017 Sheet 44 of 113 US 9, 772 , 751 B2
Portable Multifunction Device 2067 100
RADIOHEAD Speaker 111 Optical Proximity 1000F Sensor 164 Sensor 166 208 A 402 Current Time 404 D 406 208 1004- 5 INDU 11240 .35 -2 . 24 AAPL 68 . 30 - 1 .29 DIS 29 . 90 -. 14 rozana GOOG 373. 78 - 1. 61 wit inthe treated INTC 17 . 49 7+. 16 1d 1w 1m 3m 6m 1y 2y
Touch Screen 112
Microphone Home Accelerometer( s ) 113 204 168
Figure 10F U . S . Patent Sep . 26 , 2017 Sheet 45 of 113 US 9, 772 , 751 B2
Portable Multifunction Device 100 206 . . . . . Optical Proximity Speaker 111 Sensor 164 1000G Sensor 166 208 402 Current Time 404 * O 406 208
Stocks Map 149- 2 154 1004 - 6
* x
Calculator Notes 149 - 3 153
Touch Screen 112
Microphone Home Accelerometer( s ) 113 204 168
Figure 10G U . S . Patent Sep. 26, 2017 Sheet 46 of 113 US 9, 772 , 751 B2
Portable Multifunction Device 206 portable sources100 onDevice Optical Proximity? Speaker 111 Sensor 164 1000HU Sensor 166 208 402 Current Time 404 * 406 208
Text Calendar Photos Camera 141 . . . 148 144 143
750 Online Stocks ??? Weather Video 155 149 - 2 154 149 - 1 1004 - 7
111 X
Clock Calculator Notes Settings 149 - 4 149- 3 153 412 111111111111111111111111 User Created Widget Widget 804 - 1 804- 2 149 - 6 TOO 804- 3
Touch Screen 112 OOOOOOOOOOOOOO bububububbbbbbbb b bb b bbbbbbbbbbbb Microphone Home Accelerometer* * * ( s ) 113 204 168
Figure 10H U . S . Patent S ep . 26 , 2017 Sheet 47 of 113 US 9, 772 ,751 B2
Portable Multifunction Device 2067 100 Speaker 111 Optical Proximity 10001 Sensor 164 Sensor 166 208 402 Current Time 404 * D 406 M Jan 208 ( 15 Text Calendar Photos Camera 141 148 144 143
. . . . 75° Online Stocks ??? Weather Video 155 149- 2 154 149 . 1
+ - X - w OF Clock Calculator Notes Settings 149 - 4 153 412 User Created Widget Widget 804 - 1 804 - 2 1802 149 -6 w 804 - 3
Phone Mail Browser iPod 138 140 147 152 408 Touch Screen 112
Microphone Home Accelerometer ( s ) . Warning...... e Reinsalat168 Figure 101 U . S . Patent Sep . 26 , 2017 Sheet 48 of 113 US 9, 772 , 751 B2
Portable Electronic Device - 2061 100 Speaker 111 Optical Proximity 1100A Sensor 164 Sensor 166 2087208 A402 Current Time 404 D 406 Edit - 512 Instant Messages ~ 502 ( +- 6514) Jane Doen 504- 1 51 508- 1 510 -1 Hola , 506 - 1 Today 3 John Smithin 504- 2 506- 2 508- 2 510 -2 Are you going tonight ? January 28 , 2006 > 408- 123 - 4567m 504 - 3 508 - 3 510 - 3 Byen 506- 3 January 27, 2006 Bob Adams - 504 -4 508 -4 510 -4 CU later 506 - 4 January 25 , 2006 > Bill Jones ~ 504- 5 5508508 - 5 510510 -5 Happy New Year! » 506 -54 January 15 , 2006 > Mike Miller 504- 6 wieniu 508 -6 510- 6 Got your package ! sovao December 20th , 2005 > Tom Lee n 504- 7 V 508 -7 510 - 7 Just met Tim . - 506- 7 December 18th , 2005 Jackie Wong 508- 8 : 510 - 8 My flight delayed . December 14th , 2005 Touch Screen 112
Microphone Home Accelerometer( s ) Mesophoma113 ( Home204 Rolegamateria168 Figure 11A U . S . Patent Sep. 26 , 2017 Sheet 49 of 113 US 9, 772 , 751 B2
Portable Electronic Device - 206 100 Speaker 111 Optical Proximity 1100B Sensor 164 Sensor 166 208 2402 Current Time 404 D 406
|208 1102- 4 Instant Messages ~ 502 1104- 1 + loon 504 - 1 508 -1 510 -1 Today 3 nn 504 - 2 506 - 27 500m 5102 bing tonight ? January 28 , 2006 > 604 -1 567 504- 3 508 - 3 510 - 3 ( R U there January 27 , 2006 > 604 - 2 sm 5044 508-- 4 4 510 -4 (Check ou 506 - 4 January 25 , 2006 > www 504 -5 508508- 5 510 - 5 w Year! 506- 5 January 1st, 2006 > wwwwwwwwwwww m 504- 6 $ 16 508 - 6 510 - 6 Jackagelovnoe/56066 December 20th . 2005 504 -7 508- 7 510 -7 im . -- 508 - 7 December 18th , 2005 ng 508 -8 510 -8 elayed . December 14th , 2005 }
Microphone Home Accelerometer( s ) Microphone113 (hormet 204 Perle 168meleren ) Figure 11B U . S . Patent Sep. 26 , 2017 Sheet 50 of 113 US 9, 772 ,751 B2
Portable Electronic Device - T 206 100 Speaker 111 Optical Proximity 11000 Sensor 164 Sensor 166 208 1402 Current Time 404 D 406 504 - 1 Jane D |208 InstantMessages ~ 502 104 . 2 ( Clear veini pigi508 * - 1 * * * * 510- 1 Today > What iii CallCall 506 - 2 508 -2 510 -2 January 28 , 2006 604- 1 January 508- 3 510 -3 R U there ? 20 :35 January 27 , 2006 604- 2 508 -4 510- 4 Check out apple . com January 25 , 2006 3 January ????????????????????????? 8 : 30 508 - 5 510 - 5 January 1st, 2006 516 6508 - 5 10 -6 December 20th , 2005 S 5087 - 510- 7 December 18th , 2005 508 - 8 510 -8 December 14th , 2005 Text box
Microphone Home Accelerometer (s ) 113 204 168
Figure 110 U . S . Patent Sep . 26 , 2017 Sheet 51 of 113 US 9, 772 , 751 B2
Portable Electronic Device - 206 | 100 Speaker 111 Optical Proximity 1100C Sensor 164 Sensor 166 208 402 Current Time 404 O 406 2602602 2087 InstantMessages Jane Doen 504 - 1 ( Clear ) 1102 - 3 21104- 3 510 - 1 y Call Conta 510 - 2 Call 18 , 2006 ? 604- 1 January 29 , 2006 510 - 3 20 : 35 AM IR U there ? 608 - 1 27 , 2006 > 604 - 2 ( IM 510 -4 | Check out apple . com ) January 30 , 2006 5, 2006 8 : 30 AM 510 - 5 st, 2006 § 608 -2 16 5 pt, 2005510 10Šº - 66 th, 2005510 & - 7 510 - 8 th, 2005 { Text box 612
Microphone Home Accelerometer ( s ) 113 204 168
Figure 11D U . S . Patent Sep . 26 , 2017 Sheet 52 of 113 US 9, 772 , 751 B2
Portable Electronic Device - [ 206 ] 100 Speaker 111 Optical Proximity 1100E Sensor 164 Sensor 166 208 2402 Current Time 404 na 406 1 1106602 pe208 Instant Messages Jane Doen 504- 1 ( Clear
Call 1 ContactContact InfoInfo
604 - 1 January 29 , 2006 20 : 35 AM 606 - 1 R U there ? 608608 - 1 A Wowo- 604 -2 (IM is the best. OIHIHIIHIIHIN Check out apple . com 610 606 -2 DIONINOM January 30 , 2006 , 8 : 30 AM (Hola HOHHOHOHOHOHOHOHOHOHOHOHOHOHOHOHOHOHOHOHOHOHOHOHOID 608 - 2 ONIUM
......
...... c Text box _ 612812 Send 310 ) Microphone Home Accelerometer ( s ) .Microphone . . 113 ( home204 ) . . .celerometerle . . . . . 168 ...... Figure 11E U . S . Patent Sep . 26 , 2017 Sheet 53 of 113 US 9, 772 , 751 B2
Portable Electronic Device in 2061 Speaker 111 Optical Proximity 1100F Sensor 164 Sensor 166 2087 402 Current Time 404 D 406 602 208 Instant Messages Jane Doe - 504 - 1( Clear )
510 - 1 ......
Call Conta 510 - 2 Call | 18 , 2006 604- 1 January 29 , 2006 510 - 3 20 : 35 AM (R U there ? 608 - 1 27 , 2006 > 604- 2 (IM w o menranneren 510 - 4 Check out apple .com January 30 , 2006 5, 2006 8 :30 AM 6 510 - 5 608 - 2 st, 2006 ? 6 ...... 510 - 6 ...... beh, 2005 510 - 7 $ th , 2005 3 510 - 8 th , 2005 wwwwwww wwwm Text box 612
Microphone Home Accelerometer ( s ) 113 204 168
Figure 117 U . S . Patent Sep . 26 , 2017 Sheet 54 of 113 US 9, 772 , 751 B2
Portable Electronic Device - [ 206 100 serta tersendiri Speaker 111 Optical Proximity 1100G Sensor 164 Sensor 166 208 402 Current Time 404 406
-208 InstantMessages n 502 Jane Doe 508 -1 510- 1 Today CallCall 506 -2 508 - 2 510 - 2 January 28 , 2006 60,47 January 508- 3 510 - 3 RU there ? 20 : 39 January 27 , 2006 604 -2 508 - 4 5104 (Check out apple . com January January 25 , 2006 > 8 : 30 508 -5 510 - 5 January 1st, 2006 > 516 5085086 -- 6 5 51010 -6 6 December 20th , 2005 508 - 7 510 - 7 December 18th , 2005 508- 8 510 - 8 December 14th , 2005 C Text box
Microphone Home Accelerometer( s ) 113 204 168 Figure 11G U . S . Patent Sep. 26 , 2017 Sheet 55 of 113 US 9, 772 , 751 B2
Portable Electronic Device - 206 100 Speaker 111 Optical Proximity 1100H Sensor 164 Sensor 166 208 402 Current Time 404 D 406 208 InstantMessages ~ 502 In 504 - 1 508508 - 1 1 510510 -1 504 - 1 Today 3 hº 504 - 2 - 506- 2 508- 2 510 - 2 þing tonight ? January 28 , 2006 > 604- 1 567 504- 3 508 -3 510 -3 R U there January 27 , 2006 > 604- 2 S 504 - 4 508- 4 510 - 4 Check ou 506 - 4 January 25 , 2006 > 504 - 5 508 - 5 510 - 5 W Yearln 506 -5 January 1st, 2006 > m 504- 6 5066 $16508 - 6 510 - 6 ackage ! sovdo December 20th , 2005 > tutututututututu t ututututututututututututututututututututututututututututututututututututututututututututututututututututut 504- 7 508- 7 510 -7 im .: 506 -7 December 18th , 2005 } ng 508 -8 510 - 8 elayed . December 14th, 2005 {
Microphone Home Accelerometer( s ) 113 204 168 HD DODO Figure 11H U . S . Patent Sep. 26 , 2017 Sheet 56 of 113 US 9 ,772 ,751 B2
Portable Electronic Device and 1 2067 100 Speaker 111 Optical Proximity 11001 Sensor 164 Sensor 166 208 * * * 402 Current Time 404 D 406 208 Edita 512 Instant Messages ~ 502 + 05141 Jane Doe n 504 - 1 508- 1 510 -1 Hola , 506 - 1 Today 3 508- 2 : 510 - 2 AreJohn you Smith going n 504tonight- 2 ? 506 -January2 28 , 2006 > 408 - 123- 45674 504 -3 508 - 3 510 - 3 Byen 506 -3 January 27 , 2006 > Bob Adams , 504 -4 508 - 4 510 - 4 CU later n 506 - 4 January 25 , 2006 > Bill Jones n 504 -5 508- 5 510 -5 Happy New Yearln 506 -54 January 1st, 2006 > Mike Miller 504- 6 508508 - 6 510 - 6 Got your package !sous - o December 20th , 2005 Tom Lee m 504 - 7 V 508508 - 7 510510 - 7 Just met Tim . - 506 -7 December 18th , 2005 } Jackie Wong 508 - 8 510 - 8 My flight delayed . December 14th , 2005 Touch Screen 112 Microphone Home Accelerometer( s ) Microphone113 Home204 Accelerometer168 (s ) Figure 111 U . S . Patent Sep. 26 , 2017 Sheet 57 of 113 US 9, 772 , 751 B2
Portable Multifunction Device 206 100 Optical Proximity 1200A Speaker 111 Sensor 164 Sensor 166 L802 2402 Current Time 404 D 406 # KILLLILLLLLLLLL L LLLLLLLLLLLILILLLLLLLLLLLLLLLLLLL BOZ Photo Albums 41222
Graphic 1204 - 1 Album Name 1206 - 1 > Awwwwww vvwvvwvvwvwyve
. Graphic 1204 - 2 Album Name 1206 -2 www NA Graphic 1204 - 3 Album Name 1206 -3 : >
Graphic CV 1204 - 4 Album Name 1206- 4
+ + + + + + + + + Graphic 1204 - 5 Album Name 1206- 3 12203 wwwwwwwwwww Autor MITHUAHUAHUAHUA when the momento memenuhi storiteit e n to the other storheten av hotelowwwwww Graphic 1204 - 6 Album Name 1206 -6 >
Microphone | Home Microphone113 (1 204 ome ) MODULO Figure 12A U . S . Patent Sep. 26 , 2017 Sheet 58 of 113 US 9, 772 , 751 B2
Portable Multifunction Device 206 Optical Proximity Speaker 111 Sensor 164 Sensor 166 d 1200B 208 1402 Current Time 404 not 406 2081 Photo Albums
??????????????????????????????????? * * *
Album Name 1206 -1 > Thumbnail 1210 -01 Album Name 1206- 2 > Thumbnail Album Name 1206 -3 > 1210 - 05 Album Name 1206 - 4 > Thumbnail 1210 -09 Album Name 1206 -5 >
Thumbnail Album Name 1206 -6 > 1210 - 13
V ALYVULL
Microphone Home 113 204
Figure 12B U . S . Patent Sep. 26 , 2017 Sheet 59 of 113 US 9, 772 , 751 B2
Portable Multifunction Device 206 100 Optical Proximity Speaker 111 Sensor 164 Sensor 166 208y 1200C 402 Current Time 404 D 406 208 Photo Albums Album Name 1206 - 5
Jame 1206 - 1 > Thumbnail Thumbnail 1210 -01 1210 - 02 lame 1206 -2 > Thumbnail Thumbnail ame 1206 -3 > 1210 - 05 1210 - 06 ame 1206 -4 > Thumbnail Thumbnail 1210 -09 1210 - 10 ame 1206 -5 >
.
1206 - 6 Thumbnail Thumbnail * Jame 1206 - 6 > 1210 - 13 1210 - 14
*
www *
Microphone Home 113 204
Figure 12c U . S . Patent Sep . 26 , 2017 Sheet 60 of 113 US 9, 772 , 751 B2
Portable Multifunction Device 2061 100 Optical Proximity Speaker 111 Sensor 164 Sensor 166 1200D 208 2 402 Current Time 404 406 208 Photo Albums Album Name 1206 -5 m 1202 Artist Art
Thumbnail Thumbnail Thumbnail * * 1210 - 01 1210 - 02 1210 - 03 *
Thumbnail Thumbnail Thumbnail ...... 1210 -05 1210 - 06 1210 - 07 77
1 - - + + + + + + + + + + + + + + + + +
A '
- Thumbnail Thumbnail Thumbnail 1210 - 09 1210 - 10 1210 - 11 Ava A wwwwwww + + + + + + + + + + + +
A Thumbnail Thumbnail Thumbnail 1210 - 13 1210 - 14 1210 - 15
+ + + + + + + + + + + + + ertortortor www Port
: : Microphone Home 113 204 Figure 12D U . S . Patent Sep . 26 , 2017 Sheet 61 of 113 US 9 , 772 ,751 B2
Portable Multifunction Device | 206 100 Speaker 111 Optical Proximity 1200E Sensor 164 Sensor 166 208 A 402 Current Time 404 0406 208 Photo Albums Album Namee 12061206 - 5 for 1202 Loveinirinining formimin Thumbnail Thumbnail Thumbnail Thumbnail 1210 -01 inisi 1210 -02 1210 - 03 1210 -04 nin
Thumbnail Thumbnail Thumbnail Thumbnail 1210 - 05 1210 - 06 1210 -07 1210 -08
Le
Thumbnail Thumbnail Thumbnail Thumbnail 1210 - 09 e 1210 - 10 1210 - 11 1210 - 12 1226
Thumbnail Thumbnail Thumbnail Thumbnail 1210 - 13 1210 - 14 1210 - 15 1210 - 16 A
Microphone Home 113 204
Figure 12E U . S . Patent Sep. 26 , 2017 Sheet 62 of 113 US 9, 772 ,751 B2
Portable Multifunction Device 2061 100 Speaker 111 Optical Proximity 1200F Sensor 164 Sensor 166 208 mini iwimin 402 Current Time 404 [208 Album NÁRE 11 05 87
Swipe 1116 Image 1106
LIC FD Microphone Home When113 ever204 mind Figure 12F U . S . Patent Sep. 26 , 2017 Sheet 63 of 113 US 9, 772 ,751 B2
Portable Multifunction Device . . . more | 206 ...... 100 Speaker 111 Optical Proximity 1300A Sensor 164 Sensor 166 BOZ. 4402 Current Time 404 D 406
...... 807) ( Q Cupertino Starbucks muutaman totoo. . . .
" .. acteu Federal :W. nkintasANTES Ne .
*
* a . ***** h osW. hosD o Starbucks, a
- r* * i
* Open Space * p elusetting VY
ek WW Saratoga agustuhan wwwwwwwwwww 5206 5290 ws Map Satellite List
Microphone ! Home Accelerometerwwww ww ( s ) 113 204 ...... 168 :
Figure 13A U . S . Patent Sep . 26 , 2017 Sheet 64 of 113 US 9, 772 , 751 B2
Portable Multifunction Devica
* * ** * * * ** * * * * * ** * ** * * * * * * w wwwwwwwwwwww * * * * * * * * * * * * *
** * * * * * * ** * * ** * ** * * ** * * * . ww w Speakár 111 Optical Proximity Sansox 104 Sensor 180 BOOB * * * * * * * * www .* * * ** 402 Current Time 404 0 ,00 1302
. . . rtino Starbucks Map *
Loca
Starbucks > hom address
Map Satellite List wwwwwwwwwwv . v
wwwwwwwwwwwwwwwwwwwwwwwwwww wwwwwwwwwwwwwwwwww
* * * Microphone Home Accelerometers ) 204
Figure 138 U . S . Patent Sep. 26 , 2017 Sheet 65 of 113 US 9, 772 , 751 B2
Portable Muldfuncion Device 100
* * * ** * ** * * * ** * * ** * * ** * * * eondo Proximity Speaker 11 Sensor 164 Sensor 168 13000 * * ** * wwwwww wwwwwwwwwwwwwwwwwwwww 402 Current Time 404 3 40 |2001208 Map W13021302 Inn
1999 * * * * * * * * * * ** IT - . LocalMap
Starbucks > 1 phone (40 Sa home page http :/ / Cos San Jose address Starbucks , 39 Sunnyvale , a
Direction *
* Directions *
*
* wwwwwwwwwwwwwwwwwwwwwwwww * Add to B 6290 Create Ne List Add to Exis
wwwwwwwwwwwwwwwwwwwwwwwwwwwwwww *
*
** * ** ** * ** ** * ** * * * * * * * * Wawi* * * ** ** * * * * * ** * * ** * * ** * * * ** ** ** ** ** ** ** ** * * * ** ** ** ** OUN. uoudo o LUOH Accelerometers )
6 wwwwwwwwwwwwwwwwwwwww
22-14 Figure 13C U . S . Patent Sep. 26 , 2017 Sheet 66 of 113 US 9 ,772 ,751 B2
Portable Multifunction Device 206 100 Optical Proximity Speaker 111 Sensor 164 Sensor 166 1300D ...... 208 402 Current Time 404 n . 406 ) [2081 ® Map 1302 Info
** ** Local Map Starbuck com. inne hahaha semChia i s® phone (408 ) 123 -4567
13 home page http : // www .starbuc
,3 . address Starbucks, 332 W El Can Sunnyvale , CA 94087 . . €25 . Liittimiiiiiiii Directions To Here Directions From Here ..
paranemaananananananananananananananawwwww w . 85 statement Add to Bookmark Create New Contact Add to Existing Contact
Microphone Home Accelerometer( s ) 113 204 168 Figure 13D U .S . Patent Sep. 26 , 2017 Sheet 67 of 113 US 9 ,772 ,751 B2
Portable Multifunction Device 206 100 : : : : : : : : : : : : : : : : : : : : : : : : Optical Proximity Speaker 111 Sensor 164 Sensor 166 2081 1300E 402 Current Time 404 406 208 Mar . 1302 Info
Local Map Starbucks phone (408 ) 123 -4567 home page http : // www .starbucks . com / address Starbucks , 332 W El Camino Real, Sunnyvale , CA 94087 Directions To Here Directions From Here Add to Bookmark Create New Contact Add to Existing Contact
Microphone Home Accelerometer( s ) Microphone113 co 204me Paras 168pamat an Figure 13E U . S . Patent Sep . 26 , 2017 Sheet 68 of 113 US 9, 772 , 751 B2
Portable Multifunction Device 206 1 100 Speaker 111 Optical Proximity 1300F Sensor 164 Sensor 166 208 402 Current Time 404 1 406 |2087 Map 1302 Info SK mon LocalMap Starbuch phone (408 ) 123 - 4567 home page http : // www .starbuc address Starbucks , 332 W ElCan Autottttttttt Sunnyvale , CA 94087 A Directions To Here AAAAAAAAA Directions From Here wwW Add to Bookmark we' Create New Contact Add to Existing Contact
Microphone Home Accelerometer( s )
. 113 204 168
.
. . Figure 13F U . S . Patent Sep . 26 , 2017 Sheet 69 of 113 US 9, 772 , 751 B2
Portable Multifunction Device 206 100 wwwhh h hhhhhhhh Speaker 111 Optical Proximity 1300G Sensor 164 Sensor 166 20872087 402 Current Time 404 D 406 ® MapMap M18021302 InfIni
AVSV a lungs anomat > w wi LocalMap .. ' * . , $ maksimum - Starbucks > phone (40 home page http :/ / Declara , San Jose address Starbucks , 33 ...... Sunnyvale , a Directions
ti Directions ** * * * * *
.. Add to B 5290 Create Ne ellite List ...... Add to Exis
Microphone Home Accelerometer ( s ) 113 204 : 168
Figure 13G U . S . Patent Sep . 26 , 2017 Sheet 70 of 113 US 9, 772 , 751 B2
Portable Multifunction Device 206 ) 100 Speaker 111 Optical Proximity . . . . . 1300H...... Sensor 164 Sensor 166 BOZ A 402 Current Time 404 D 406 1302 807) ertino Starbucks Map
......
9:", ? { {F?? HUBSwasasAM Administration :*: Field e is virm *HS * W Starbucks SlaberCHERE . hom OE©L . - Clara San Jose
: MyWor address * V
tigers Besteak Frage Cudestino * * non ? ,
'.,
h
* *U ** **:
Saratoga *** * ,ar . *** * * mountament . *: . . 5206 5290 Map Satellite List
Microphone Home Accelerometer( s ) 113 204 168
Figure 13H U . S . Patent Sep. 26 , 2017 Sheet 71 of 113 US 9, 772 , 751 B2
Portable Multifunction Device 2067 100 Speaker 111 Optical Proximity 13001 Sensor 164 Sensor 166 807 402 Current Time 404 0406 807 ( Q Cupertino Starbucks
mammogatom . ** Moitett Federatson *** * . Starbucks > * . . .
*** * PY *WEAR* ** * * * * * * *
*
*
* * Ejs . cito *
. * * * V
* See 34 5206 5290
Map Satellite I 1306
Microphone Home Accelerometer( s ) Microphone113 ( 204 168 Figure 131 U . S . Patent Sep . 26 , 2017 Sheet 72 of 113 US 9, 772 , 751 B2
Portable Multifunction Device 206 100 Speaker 111 Optical Proximity 13003 Sensor 164 Sensor 166 807) 4402 Current Time 404 D 406
W Y YYYYYYYYYYYYYYYYYYYYYYYYY L8OZ ( Q Cupertino Starbucks wwwwwwwwwww wwiiwiwiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii
01 Map Satellite | List Microphone Home Accelerometer( s ) 113 204 168 Figure 13J U . S . Patent Sep . 26 , 2017 Sheet 73 of 113 US 9, 772 , 751 B2
Portable Mulbtunction Device 100 wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww* * * * * * * * * ** ** * ** ** * ** * * * ' ' ' ' ' ' * * * * ** * * wwwmasons * * * * * ------* * * * * * * * wwwwww * * * * * * * * * * * * * * * * * * ** Speaker 111 Optical Auxoid BOOK Sensor 104 Osues 990 wiwi w w w m * * * * * * * * * * * ** * * ** ** * * * ** * * * * * * 2081208 402 Current Time 404 408
? ? ?? ? ? ? ? ?? ? ? ? ? * * . * * . * * . * * . * + + + + + + + + + + + + + Cupertino Starbucks wi wwwwww Starbucks 20520 Stevens Creek Bld # A Cuper. . . Starbucks 21000 Stevens Creek Blvd Cupertino ...... ------Starbucks 332 W ElCamino Real Sunnyvale CA . . w Starbucks 11111 N Wolfe Rd # C Cupertino CA . . . Starbucks
1685 Hollenbeck Ave Sunnyvale CA . . . See more . . Starbucks . 1291 S Mary Ave Sunnyvale CA 94087 . . . .: wwwwwwwwwwww 6290
w
ap Satellitew List * * * *
w wwwwwwwwwwwwwww w www???? ?????? ????? ??? ?? ???? wwwwwwwwwwwwwwwwwwave Microphone Home dovwwwwwwwwwwwwwwwwwwwwwwwww Sholawoja 113 204
** ** * * * * ** ** * * * * * * * * * * * * * * * * * * * * * * * * * * aunbud XC1 U . S . Patent Sep . 26 , 2017 Sheet 74 of 113 US 9, 772 , 751 B2
Portable Multifunction Device [ 206 100 Speaker 111 Optical Proximity 1300L Sensor 164 Sensor 166 807 A 402 Current Time 404 m 406 807 ( Q Cupertino Starbucks
Map + EEEEEE Satellite List
Microphone Home Accelerometer( s ) 113 204 kehebatan168 Figure 13L U . S . Patent Sep. 26 , 2017 Sheet 75 of 113 US 9, 772 , 751 B2
Portable Mullfunction Device 100 * * * * * * * * * * wwwwwwwww ** * * * * ** * * Speaker 10 Proximity 1300M Sensor 104 Sensor 168 002 402 Current Time 404 400 Q Cupertino Starbucks
* * * * * * * * * * * ** ** ** * * * * * * * * * * * * * * * * * * * * * * * * * * * *
*
*
*
WWWWWWWW*
.: ...... Starbucks
W Ca San Jose
W Wwwvom
wwwwwwwwwwwwwwwwwwwvvwVVVVVVVVV1111111 * ** * * * * ** * * * 5200 W * Map Satellite List
wwwwwwwwww wwwwww * * * * ** * * * * * ** * * * * * * * * * * * * * * * * To Map Satellite La * *** wwwwwwwwwwwwwwwwwwwwwwwwwwww * Microphone Home Accelerometers )
4 * * * * ** * * * * Merophone Hormone204 Pe terometerie 1 Figure 13M U .S . Patent Sep. 26 , 2017 Sheet 76 of 113 US 9 ,772 ,751 B2
Portable Multifunction Device
Speaker 11 Proximity 1300N Sanso 164 Sensor 169 1902 Current Time 404
ino Starbucks List wwwww ......
hs Creek Bld # A Cuper. .5 . Local hs Creek Blvd Cupertino . . .
mino Real Sunnyvale CA . . . home * te Rd # C Cupertino CA . . . address ...... eck Ave Sunnyvale CA . . , wwwwwwwwwwwwwwwwwwwwwwwwwwww Ave Sunnyvale CA 94087. . . ved
5290 5206 e om .com .Xoris Map Satellite List * * * * * * * * * * * * ** *
Microphones mome Accelerometers) 204 168
Figure 13N U .S . Patent Sep. 26 , 2017 Sheet 77 of 113 US 9 ,772 ,751 B2
Portable Multifuncion Device 100
wwwwwwwwwwwwwwwws
* Opbca Proxyly Speaker 111 Sensor 64 Sensor 169 * 13000 402 Current Time 404 List 1316 Ini # A Cuper . . . LocalMap by Cupertino . . . phone (40 *
...... , , , , , , , *om Innyvale CA . .. home page http : // mon wvwwwwwwwww address Starbucks , 33 pertino CA .* > .< Sunnyvale , o ww
nyvale CA . . . . .', Direction wwwwwwwwwwwwale CA 94087. . . Directions Add to B Create Ne ellite List * * * * * * * * * * * ** * ** * * * * * * * * * * * * * * Add to Exis ......
Microphone Home 113204 Accelerometers1618 Figure 130 U . S . Patent Sep . 26 , 2017 Sheet 78 of 113 US 9, 772 , 751 B2
Portable Mulufunction Device 100 * * * ** ** * * ** * * * * * * * * * * * * * * * wwwwwwwwwwwwww WW * * * * ???? ?? ? ??? ??? ???? Optical* * * * * * * * * * * * * ** * * Senawwwwwwwwwproximity Speaker 111 * Sensor 104* * * * * * * * * * * ** * * * * * * * * * 111111 * www 13000 * *
BOZ * * * *
402 Current Time 404 * *
*
*
*
vo ...... * *
. 207 m1316 * List - 1315 Info *
Local Map Starbuck
...... phone (408 ) 123 - 4567 home page http :/ /wwwLILLE . .starbuc
*
address Starbucks , 332 W El Can *
*
Sunnyvale , CA 94087 *
EEEEEEEEEEEEE + + + + + + + + + + EEEEEE + + + + + + + + + + + + + + + + + + + + + + + + + + + + + * *. *...... Directions To here .
wwwwwwwwwwwwwwwwwwwwwwwwwwwww
Directions+ + + + + + From+ + + + + + + + + BB B B B BIIIIHere . .
...... ww Add to Bookmark
w
Lern - - - - - Create New Contact wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww Add to Existing Contact * * ** * * * wwwwwwwwwwwwwwwww Microphone Home Accelerometer ( s ) 113 204
wwwwwwwwwwwwwFigure 13Pw ww U . S . Patent Sep . 26 , 2017 Sheet 79 of 113 US 9 ,772 ,751 B2
Portable Multifunction Device 206 Speaker 111 Optical Proximity 1300Q Sensor 164 Sensor 166 208 4402 Current Time 404 1 406 208[ List 1316 Info
Local Map Starbucks phone (408 ) 123 - 4567 home page http :/ / www . starbucks .com / address Starbucks , 332 W ElCamino Real, Sunnyvale , CA 94087 Directions To Here Directions From Here Add to Bookmark Create New Contact Add to Existing Contact
Microphone Home Accelerometer( s ) 113 204 168 Figure 130 U . S . Patent Sep. 26 , 2017 Sheet 80 of 113 US 9, 772 ,751 B2
Portable Multifunction Device 206 100 Speaker 111 Optical Proximity 1300R Sensor 164 Sensor 166 208 402 Current Time 404 1 406406 [208 ? List 1316 Info toteuttatott * * * * * * * * * * * * ...... LocalMap Starbuch
phone (408 VWWAAAAAAA ) 123 -4567 home page http :/ /www . starbuc address Starbucks , 332 W El Can Sunnyvale , CA 94087 Directions To Here Directions From Here Add to Bookmark Create New Contact
Add to Existing Contact ...... wiiiiiiiiiiii wi
wwwwwwwwwwwwwwwwwwwwwwww
Microphone Home Accelerometer ( s ) 113 204 168
Figure 13R U . S . Patent Sep. 26 , 2017 Sheet 81 of 113 US 9, 772 , 751 B2
Portable Multifunction Device ( 206 100 Speaker 111 Optical Proximity 13005 Sensor 164 Sensor 166 18021803 A 402 Current Time 404 D 406 ListList n 13161316 Inf # A Cuper. . . Local Map bi Cupertino . . . phone (40 Innyvale CA . . . home page http : // address Starbucks, 33 pertino CA . . . Sunnyvale , a nyvale CA. . . Directions Directions hale CA 94087. . . >> Add to B 5290 Create Ne ellite List Add to Exis
Microphone Home Accelerometer ( s ) 113 204 168
Figure 135 U . S . Patent Sep. 26 , 2017 Sheet 82 of 113 US 9, 772 , 751 B2
Portable Multifunction Device 2067 100 Optical Proximity Speaker 111 Sensor 164 Sensor 166 1300T BOZ 402 Current Time 404 DO 406 BOZ ino Starbucks H indi wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww
hs Creek Bld # A Cuper. . . Local hs Creek Blvd Cupertino. . .
mino Real Sunnyvale CA . . ( home fe Rd # C Cupertino CA . . . address eck Ave Sunnyvale CA . . ? Ave Sunnyvale CA 94087 . . . e
5206 5290 Map Satellite List
.
. Microphone Home Accelerometer ( s ) 113 204 168 Figure 13T U . S . Patent Sep. 26 , 2017 Sheet 83 of 113 US 9, 772 , 751 B2
Portable Multifunction Device 206 100 Speaker 111 Optical Proximity 13000 Sensor 164 Sensor 166 208 402 Current Time 404 406
(208 ( Q Cupertino Starbucks
w a nted to wwwwwwwwwwwwwwwwwwww Starbucks 20520 Stevens Creek Bld # A Cuper. . . Starbucks 21000 Stevens Creek Blvd Cupertino . . . Starbucks 332 W El Camino Real Sunnyvale CA . . 1312 vawah Starbucks 11111 N Wolfe Rd # CO 10 CA . . . Starbucks 1685 Hollenbeck Ave Sunnyvale CA . . . Starbucks 1291 S Mary Ave Sunnyvale CA 94087 . . . e esteh en * * * * ** * * wwwwwww
5206 5290 Map 1313 Satellite List
Microphone Home Accelerometer( s ) 113 204 168
Figure 130 U . S . Patent Sep. 26 , 2017 Sheet 84 of 113 US 9, 772 ,751 B2
Portable Muldfuncion Device 208 100 wwwwwwwwwwwwwwwwwwwwww Proximity Speaker 111 Sensor 104 WWW $ 400A Sensor 100 ** * * * * * * ** * ** * * * * * * * * * ** * * * * * * * * * * * * * * ** * * * * * * * * * * 402 Current Time 404 200
* Today List Day Month
?????? ????? ?? ????? ?? ?????????? ?????????????????????????????? ???????? ???? ???? ???? ???? ???? ???? * January , 2007 * Sun Mon Tue Wed Thu Fri Sat 31 1 2 3 4
w 100 w 9 10 11 12
w wwwwwwwwwwwwwwwwwwwwwwwwwwwwww
* 15 16 17 18
*wwwwwwwwwwwwwwwwwwwwwwww 21 22 23 24 25 26 www*
* wwwwwwwwwwwwvevovovovovovov* 29 30 31 Noon Lunch with Eddie (14023 3 PM Pick up Jack 5 PM Pick up Lady wwwwwwwwwwwwwww Touch Screen 112 Microphone Home Accelerometer* * * *( * * s * * ) 113 204 Acceler Figure 14A * * * * * * * * * * * * ** * * U . S . Patent Sep. 26 , 2017 Sheet 85 of 113 US 9, 772 , 751 B2
Portable Muldiuncton Device 100 wwwwwwwwwwwwwwwwwwwwwwwwwwwwwse * * ope is ini sino Speaker 111 Proximity Sensor 16 Sensor 166 14008 wwwwwwwwwwwwwwwwwwwwwwwwwwwww 402 Current Time 404
800002 ? List Day Month ? January , 2007 on Tue Wed Thu Fri Sat Lunch Wednesq From 12 14083 9 10 11 12 13 *
16 17 18 19 20 * wwww 23 24 25 26 27 w LoL FE+EEEEEEEEEEEEE 30 31
* Lunch with Eddie *
* * Pick up Jack
* Pick up Lady wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww www Touch Screen 112 wwwwwwwwwwwwwwwwwwwwwwww Microphone Home AccelerometerleAccelerometerswww . ) Figurewwwwwwwwwwwwwwwwwwwwwwwww 14B U . S . Patent Sep . 26 , 2017 Sheet 86 of 113 US 9, 772 , 751 B2
Portable Muldfunction Device 206 * ** ** * * * * * * * * ** * * * * * * * * * * * * * * * * * * * * * * * ** ** * * * Speaker 11 Optical Proximity 14000 Sensor 104 S ensor 166
? ????? * * * * * * * * * * * * * * * 402 Current Time 404
...... , , , , , , , , , , , Day Month Eve y , 2007 ed Thu Fri Sat Lunch with Eddie Wednesday, Jan 17 , 2007 5 6 From 12 PM to 1 PM 4 14083 11 12 13
w
N 25 26 27 wwwwwwwwwwwwwwwwwwwwwwwwwwwwww
w Iddie wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww * w
Touch Screen 112 * eeeee' e' ' * * * * * * * * * * * * * * * * * * * * * * * * * * * * * ** * * * * * * * eeeeeeeewwwwwww114979 Microphone home Accelerometers ) 204 . Figure 146