USOO8291.332B2
(12) United States Patent (10) Patent No.: US 8,291.332 B2 Chaudhri et al. (45) Date of Patent: *Oct. 16, 2012
(54) LAYER FOR ACCESSING USER INTERFACE 5,289,574 A 2/1994 Sawyer ELEMENTS 5,297.250 A 3/1994 Leroy et al. 5,303,388 A 4, 1994 Kreitman et al. (75) Inventors: Imran A. Chaudhri, San Francisco, CA 5,351,995 A 10/1994 Booker (US); John Louch, San Luis Obispo, CA (Continued) (US); Andrew M. Grignon, Campbell, CA (US); Gregory N. Christie, San FOREIGN PATENT DOCUMENTS Jose, CA (US) CN 1191344. A 8, 1998 (73) Assignee: Apple Inc., Cupertino, CA (US) (Continued) (*) Notice: Subject to any disclaimer, the term of this OTHER PUBLICATIONS patent is extended or adjusted under 35 U.S.C. 154(b) by 790 days. Examiner's First Report on Australian Patent Application No. 2011200603, Mar. 28, 2011, 2 pages. This patent is Subject to a terminal dis claimer. (Continued) (21) Appl. No.: 12/343,140 Primary Examiner — Steven BTheriault (22) Filed: Dec. 23, 2008 (74) Attorney, Agent, or Firm — Fish & Richardson P.C. (65) Prior Publication Data US 2009/0158193 A1 Jun. 18, 2009 (57) ABSTRACT Related U.S. Application Data A user-activatable dashboard (also referred to as a unified interest layer) contains any number of user interface ele (63) Continuation of application No. 10877.968, filed on ments, referred to herein as “widgets, for quick access by a Jun. 25, 2004, now Pat. No. 7,490,295. user. In response to a command from a user, the dashboard is invoked and the widgets are shown on the screen. The user can (51) E.M48 (2006.01) activate the dashboard at any time, causing the dashboard to GO6F 3/OO (200 6. 01) temporarily replace the existing user interface display on the user's screen. Once the dashboard has been activated, the user (52) U.S. Cl...... 715/764; i.6."i.T can interact with any or all of the widgets, and can configure (58) Field of Classification search. 715,767768. h.clashbaby adding dising Ying...configuring 715/802, 808, 810, 866 individual widgets as desired. When the user wishes to return See application file for complete search history. to the normal user interface he or she was working with, the user issues a command causing the dashboard to be dis (56) References Cited missed. Once the dashboard has been dismissed, the previous user interface state is restored, allowing the user to resume U.S. PATENT DOCUMENTS normal interactions with the operating system. 4,752,893 A 6/1988 Guttaget al. 5,007,033. A 4, 1991 Kubota et al. 5,168,441 A 12/1992 Omaheim et al. 56 Claims, 40 Drawing Sheets
2701A 2701A 20A 270A 2013 201A 2701B 69 Peew Fi's edit Yew Go Winw Heis wet: ".29AN
X Address Bock Calculato Caleridar T
2500 e
regisles e E US 8,291.332 B2 Page 2
U.S. PATENT DOCUMENTS 6,144,381 A 11/2000 Lection et al. 6,154,601 A 11/2000 Yaegashi et al. 3359 A 1998: E. al 6,166,748. A 12/2000 Van Hook et al. 5.388,201 A 2, 1995 Sight il 6,167,533 A 12/2000 Potterveld et al. 5.46.850. A 5/1995 Etz et al. 6,188,399 B1 2/2001 Voaset al. 5.481665 A 1, 1996 See al 6, 191,797 B1 2/2001 Politis 5.490246 A 2, 1996 Brotsky et al. s R 358: SE 5,522,022 A 5, 1996 Rao et al. 4. J. J. 5.564,0025.537,630 A 10/1996T. 1996 EyetB al.1 6,232,9576,216,141 B1 4/20015/2001 HinckleyStraub et al. 5,564,022. A 10/1996 Debnath et al. 6,246,418 B1 6/2001 Oka 5,583,833. A 12, 1996 C 1 6,259,432 B1 7/2001 Yamada et al. 5.588,098. A 12/1996 El 6,266,053 B1 7/2001 French et al. 5,602,597 A 2, 1997 Carpenteret al. 6,266.430 B1, 7/2001 Rhoads 5,603,034 A 2, 1997 S 6,272.484 B1 8/2001 Martin et al. 5636,336 A 6, 1997 San 6,272,558 B1 8, 2001 Hui et al. 5,638.50. A 6/1997 Gough et al. 37 E. S. Area 5,644,737 A 7, 1997 Tuniman et al. 4 - 5.644.739 A 7, 1997 M d 6,278.448 B1 8, 2001 Brown et al. 5,651.107 A 7, 1997 El 6,278.450 B1 8/2001 Arcuri et al. 5,657,049 A 8/1997 Ludolphet al. 35; B. 858 Ray 5,659,693. A 8, 1997 Hansen et al. - WW 5,659,694 A 8, 1997 Bib 6,304,684 B1 10/2001 Niczyporuket al. 5671343 A 9, 1997 Rital 6,307.574 B1 10/2001 Ashe et al. 5.675.362 A 10/1997 Clough etal 6,310,621 B1 10/2001 Gagne et al. 5678,015 A 10/1997 Goh 6,313,851 B1 1 1/2001 Matthews, III et al. 5,689,664 A 1/1997 Narayanan et al. 6,321,314 B1 11/2001 Van Dyke 5,708.764 A 1/1998 Borrel et all 6,326,978 B1 12/2001 Robbins 5.72848 A 2, 1998 E. 6,333,753 B1* 12/2001 Hinckley ...... 71.5/768 5724.49. A 3, 1998 Maxws etal 6,344,855 B1 2/2002 Fisher et al. 5.727,135 A 3/1998 Webbet al. 33. R 3383 5,731,819 A 3/1998 Gagne et al. - W - 5,754,174.5.742.285 A 4,5/1998 1998 CarpenterUeda et al. 6,369,8306,396.520 B1 4/20025/2002 OrdingBrunner et al. 5,760,773. A 6, 1998 B 1 6,401,104 B1 6/2002 LaRue et al. 576.4.229 A 6, 1998 Eact al. 6,411,301 B1 6/2002 Parikh et al. 5,764.238 A 6, 1998 As al 6,412,021 B1 6/2002 Nguyen et al. 5.78685 A 7, 1998 Eyet 6.421,058 B2 7/2002 Parikh et al. 5,790,120 A 8, 1998 Lozares et al. 6.424,348 B2 7/2002 Parikh et al. 5,793.368 A 8, 1998 B 6,429,903 B1 8/2002 Young 5,793,376 A 8, 1998 fak tal 6,434.447 B1 * 8/2002 Shteyn ...... TOO.245 5.796.40 A 8, 1998 Eii, 6,434,744 B1 8/2002 Chamberlain et al. 5,80703 A 9/1998 Bowdeneral. 6.452,600 B 9/2002 Parikh et al. 5,809,230 A 9, 1998 Pereira 6,456,290 B2 9/2002 Parikh et al. 5.835,693. A 11/1998 Cragun et al. 6.457,034 B 9/2002 Morein 5.835,693. A 1 1/1998 Lynch et all 6,466,218 B2 10/2002 Parikh et al. 5.838.316 A 1/1998 R et al. 6,466.237 B1 10/2002 Miyao et al. 5,845.25i. A 12/1998 Ea 6,469,714 B2 10/2002 Buxton et al. 5870.734 A 2, 1999 E. 6,483,524 B1 1 1/2002 Petchenkine et al. 5.875,076 A * 2, 1999 Barret al. ... TO4/270.1 6,484.261 B1 1 1/2002 Wiegel 5,877,741 A 3, 1999 Chee etal 6,486,895 B1 1 1/2002 Robertson et al. 5,877,762 A 3, 1999 Y al 6,487,560 B1 1 1/2002 LaRue et al. 5.878.29 A 3, 1999 SES 6,489,963 B2 12/2002 Parikh et al. 5880,733 A 3, 1999 SiCa 6,512.522 B1 1/2003 Miller et al. 5,880,743 A 3, 1999 VEN" 6,515,682 B1 2/2003 Washington et al. 5,883,639 A 3/1999 Waltonet al. 6,519,601 B1 2/2003 Bosch 5.900,876. A 5, 1999 Yagita et all 6,525,736 B1 2/2003 Erikawa et al. 59.03896 A 5, 1999 WE 1 6,526,174 B1 2/2003 Graffagnino 5.914716 A 6, 1999 RE a. 6,535,892 B 1 3/2003 LaRue et al. 5,920,659 A 1999 verson et al. 3. R 23. Sin et al. 3. A 2.92. her et al. 6,542,166 B1 4/2003 Washington et al. - - W 6,544,295 B1 4/2003 Bodnar 3. A 88: E. al 6,567,854 B1* 5/2003 Olshansky et al...... 709,229 5950.002 A 9/1999 Hofordet al. 375 E. 358 kiReal. 5,963,191 A 10, 1999 Jaaskelainen - - 5.974.253 A 10, 1999 Nahaboo et all 6,577.317 B1 6/2003 Duluk, Jr. et al. 5.978.579 A 1/1999 SEal 6,580,430 B1 6/2003 Hollis et al. 5.999,948 A 12/1999 Nelson et al. 39: R 2.38 SR et al. 6,005,568 A 12/1999 Simonoff et al. -- 6,006,231 A 12/1999 Popa 6,601,988 B2 8/2003 Molander 60.562 A 1/2000 Gagne etal 6,609,977 B1 8, 2003 Shimizu et al. 6,03937 A 2, 2000 Griffagnino 6,614.444 B1 9, 2003 Duluk, Jr. et al. 6045.446 A 4/2000 Ohshima 6,618,048 B1 9/2003 Leather 6,061,695 A 5, 2000 Slivka et al. 6,628,310 B1 9/2003 Hiura et al. 6,075,543 A 6/2000 Akeley 6,636.214 B1 10/2003 Leather et al. 6,128,010 A 10/2000 Baxter et al. 6,639,595 B1 10/2003 Drebin et al. 6,133,915. A 10/2000 Arcuri et al. 6,647,370 B1 1 1/2003 Fu et al. 6,141,005 A 10/2000 Hetherington et al. 6,661,426 B1 12/2003 Jetha et al. US 8,291.332 B2 Page 3
6,664,958 B1 12/2003 Leather et al. 7,836,403 B2 * 1 1/2010 Viswanathan et al...... 71.5/745 6,664,962 B1 12/2003 Komsthoeft et al. 7,895,522 B2 2/2011 Wong et al. 6,664,986 B1 12/2003 Kopelman et al. 7,917,858 B2 3/2011 Pereira et al. 6,674,438 B1 1/2004 Yamamoto et al. 8,073,866 B2 12/2011 Eagle et al. 6,675,230 B1 1/2004 Lewallen 2001 OOOO667 A1 5, 2001 Okawa et al. 6,687,745 B1* 2/2004 Franco et al...... TO9,219 2001/0030647 A1 10, 2001 SowiZral et al. 6,697,074 B2 2/2004 Parikh et al. 2001 0035885 A1 11, 2001 Iron et al. 6,707.462 B1 3/2004 Peercy et al. 2002fOO11446 A1 1/2002 Lundquist 6,710,790 B1 3/2004 Fagioli 2002fOO13822 A1 1, 2002 West 6,714,201 B1 3/2004 Grinstein et al. 2002.0054148 A1 5, 2002 Okada 6,714.221 B1 3, 2004 Christie et al. 2002fOO59594 A1 5/2002 Rasmussen et al. 6,715,053 B1 3/2004 Grigor 2002fOO65946 A1 5/2002 Narayan 6,717,599 B1 4/2004 Olano 2002fOO67418 A1 6, 2002 I 6,724.403 B1 4/2004 Santoro et al. 2002fOO78453 A1 6/2002 Kuo 6,734,864 B2 5/2004 Abgrall 2002/0085037 A1 7/2002 Leavitt et al. 6,738,804 B1 5, 2004 LO 2002/008.9526 A1 7/2002 Buxton et al. 6,741,242 B1 5, 2004 Itoh et al. 2002fOO93516 A1 7/2002 Brunner et al. 6,742,042 B1 5, 2004 Holden et al. 2002/0099678 A1* 7/2002 Albright et al...... TO6/45 6,760,046 B2 7/2004 IAnson et al. 2002/0105548 A1 8/2002 Hayton et al. 6,760,748 B1* 7/2004 Hakim ...... TO9.204 2002/0112180 A1 8, 2002 Land et al. 6,765,592 B1 7/2004 Pletcher et al. 2002/01182.17 A1 8/2002 Fujiki 6,788,318 B2 9, 2004 Chen 2002/012O673 A1 8, 2002 Tolson et al. 6,792,616 B1 9/2004 Jerding et al. 2002/0129092 A1 9, 2002 Tolson et al. 6,801.224 B1 10/2004 Lewallen 2002/0130900 A1* 9, 2002 Davis ...... 345,744 6,806,892 B1 10/2004 Plow et al. 2002/0133508 A1 9, 2002 LaRue et al. 6,819,343 B1 1 1/2004 Sobeski et al. 2002fO14074.0 A1 10, 2002 Chen 6,832,263 B2 * 12/2004 Polizzi et al...... TO9,246 2002/0140746 A1 10/2002 Gargi 6,850,808 B2 2/2005 Yuen et al. 2002/0152098 A1* 10, 2002 Evans et al...... 705/4 6,882,979 B1 4/2005 Reay et al. 2002/0152279 A1 * 10/2002 Sollenberger et al...... 709/217 6,892,360 B1 5, 2005 Pabla et al. 2002/0158902 A1 10, 2002 Hooker et al. 6,906,720 B2 6/2005 Emberling et al. 2002/0171682 A1 11/2002 Frank et al. 6,910,000 B1 6, 2005 Yedidia et al. 2002/0174003 A1 11/2002 Redmann et al. 6,911,984 B2 6, 2005 Sabella et al. 2002/0174181 A1 11, 2002 Wei 6,912,532 B2 6/2005 Andersen ...... 1f1 2002fO180798 A1 12/2002 Poor et al. 6,918,091 B2 7/2005 Leavitt et al. 2002/0186257 A1 12/2002 Cadiz et al. 6,931,633 B1 8/2005 Vazquez et al. 2002/0194090 Al 12/2002 Gagnon et al. 6,944,829 B2 9, 2005 Dando 2002/0196.268 A1 12/2002 Wolff et al. 6,993,721 B2 1/2006 Rosin et al. 2003,0008711 A1 1/2003 Corbo 7,007,242 B2 2, 2006 Suomela et al. 2003/OOO9267 A1 1/2003 Dunsky et al. 7,016,011 B2 3, 2006 De Haan 2003, OO11646 A1 1/2003 Levine et al. 7,024,381 B1 4/2006 Hastings et al. 2003, OO18971 A1 1/2003 McKenna, Jr. 7,027,055 B2 4/2006 Anderson et al. 2003/0020671 A1 1/2003 Santoro et al. 7,028,264 B2 4/2006 Santoro et al. 2003, OO32409 A1 2/2003 Hutcheson et al. 7,036,083 B1 4/2006 Zenith 2003/004631.6 A1 3/2003 Gergic et al. 7,050,955 B1 5, 2006 Carmel et al. 2003, OO61482 A1 3/2003 Emmerichs 7,065,718 B2 6, 2006 Lection 2003/0065715 A1 4/2003 Burdick et al. 7,076,730 B1 7/2006 Baker 2003, OO67489 A1 4/2003 Wong et al. 7,085,994 B2 8/2006 Gvily 2003, OO69904 A1 4/2003 HSu et al. 7,107,546 B2 9, 2006 Coulthard 2003/0076369 A1 4/2003 Resner et al...... 345,864 7,127.473 B2 10/2006 Agassi et al. 2003/0080995 A1 5/2003 Tenenbaum et al. 7,127,713 B2 10/2006 Davis et al. 2003/OO97659 A1 5/2003 Goldman 7,146,563 B2 12/2006 Hesmer et al. 2003/0101046 A1 5/2003 Krasnov 7,170,510 B2 1/2007 Kawahara et al. 2003. O112271 A1 6/2003 Batalden et al. 7,174,512 B2 2/2007 Martin et al. 2003/O122787 A1 7/2003 Zimmerman et al. 7,185,290 B2 2/2007 Cadiz et al. 2003/O123739 A1 7/2003 Graffagnino 7,191,399 B2 3/2007 Ohtani et al. 2003/O125962 A1 7/2003 Holliday et al. 7,194,743 B2 3/2007 Hayton et al. 2003. O140044 A1 7/2003 Mok et al. 7,216.305 B1 5/2007 Jaeger 2003/0146934 A1 8/2003 Bailey et al. 7,218,575 B2 5, 2007 Rosevear 2003. O154239 A1 8, 2003 Davis et al. 7,242.406 B2 7/2007 Robotham et al. 2003/O158975 A1 8, 2003 Frank et al. 7,245,310 B2 7/2007 Kawahara et al. 2003. O164862 A1 9, 2003 Cadiz et al. 7,249,327 B2 7/2007 Nelson et al. 2003. O169306 A1 9/2003 Makipaa et al. 7,269,792 B2 9, 2007 Consolatti et al. 2003/0174136 A1 9/2003 Emberling et al. 7.281.202 B2 10/2007 Croney et al. 2003/01741.54 A1 9, 2003 Yukie et al. 7,293,034 B2 11/2007 Paya et al. 2003. O184552 A1 10, 2003 Chadha 7,293,070 B2 11/2007 Moses et al. 2003/0184584 A1 10, 2003 Vachuska et al. 7,305,491 B2 12/2007 Miller et al. 2003/0189597 A1 10, 2003 Anderson et al. 7,315,848 B2 1/2008 Pearse et al. 2003/019 1799 A1 10/2003 Araujo et al. 7,328,435 B2 2, 2008 Trifon 2003/0208685 A1 11/2003. Abdel-Rahman 7,392.483 B2 6/2008 Wong et al. 2004/OOO3402 A1 1/2004 McKenna, Jr. 7,434,177 B1 10/2008 Ording et al. 2004/0012626 A1 1/2004 Brookins ...... 345.738 7,480,873 B2 1/2009 Kawahara 2004.00246.16 A1 2/2004 Spector et al. 7,523,401 B1 * 4/2009 Aldridge ...... 715,760 2004/OO32409 A1 2/2004 Girard 7,536,647 B2 5, 2009 Walker et al. 2004.0036711 A1 2/2004 Anderson 7,543,245 B2 6/2009 Irimajiri 2004/00399.34 A1 2/2004 Land et al. 7,657,837 B2 2/2010 Shappir et al. 2004.0056900 A1 3/2004 Blume 7,665,031 B2 2/2010 Matthews et al. 2004f0070629 A1 4/2004 Seifert 7,681,112 B1 3/2010 Francis 2004/01 19754 A1* 6/2004 Bangalore et al...... 345,809 7,685,515 B2 * 3/2010 Braud et al...... 71.5/255 2004.0125128 A1 7/2004 Chang et al. US 8,291.332 B2 Page 4
2004/O141016 A1 T/2004 Fukatsu et al. 2007/0101146 A1 5/2007 Louch et al. 2004/0179019 A1 9, 2004 Sabella et al. 2007/0101279 A1 5/2007 Chaudhri et al. 2004/O194020 A1 9, 2004 Beda et al. 2007/0101288 A1 5/2007 Forstall et al. 2004/O199541 A1 * 10, 2004 Goldberg et al...... TO7 104.1 2007/0101291 A1 5/2007 Forstall et al. 2004/0199.543 A1 * 10, 2004 Braud et al...... TO7 104.1 2007/0101297 A1 5/2007 Forstall et al. 2004/O1995.74 A1 10, 2004 Franco et al. 2007/0101433 A1 5/2007 Louch et al. 2004/0204963 A1 10, 2004 Klueh et al. 2007, 0118813 A1 5/2007 Forstall et al. 2004/0205504 A1 10, 2004 Phillips 2007. O130541 A1 6/2007 Louch et al. 2004/0212640 A1 10, 2004 Mann et al. 2007/0162850 A1 7/2007 Adler et al. 2004/0215740 A1 10, 2004 Frank et al. 2007/02O3984 A2 8, 2007 AlHusseini et al. 2004/0223.003 A1 11, 2004 Heirich et al. 2007/02090 13 A1 9/2007 Ramsey et al. 2004/0225955 A1 11, 2004 Ly 2007/0233736 A1 10/2007 Xiong et al. 2004/0237082 A1 11, 2004 Alcazar et al. 2007,0266093 A1 11/2007 Forstall et al. 2004/O255.253 A1 12, 2004 Marcjan 2008, OO16468 A1 1/2008 Chambers et al. 2004/0261012 A1 12, 2004 Balsiger 2008/0052382 A1 2/2008 Dinh et al. 2004/0261037 A1 12, 2004 Ording et al. 2008. O155453 A1 6/2008 Othmer 2004/0261038 A1 12, 2004 Ording et al. 2008/0243548 A1 10, 2008 Cafer 2005/OO 10419 A1 1/2005 Pourhamid 2008/0256479 A1 10/2008 Hemmings 2005, OO 10634 A1 1/2005 Henderson et al. 2009/01 19127 A2 5/2009 Rosow et al...... 705/2 2005/0O21756 A1 * 1/2005 Grant ...... TO9,226 2009/0228824 A1 9, 2009 ForStall 2005/002 1935 A1 1/2005 Schillings et al. 2010, OO773.38 A1 3/2010 Matthews et al. 2005/0022139 A1 1/2005 Gettman et al. 2010/02055.30 A1 8, 2010 Butin et al. 2005/OO39144 A1 2, 2005 Wada et al. 2005/OO57497 A1 3, 2005 Kawahara FOREIGN PATENT DOCUMENTS 2005/006O193 A1 3, 2005 Lancaster et al. CN 1335951 A 2, 2002 2005, OO60655 A1 3, 2005 Gray et al. CN 1425151 A 6, 2003 2005, OO60661 A1 3, 2005 Kawahara et al. DE 10242378 3, 2004 2005/0076312 A1 4, 2005 Gardner et al. EP 548586 6, 1993 2005/0O88447 A1 4, 2005 Hanggie et al. EP O694879 1, 1996 2005/0O88452 A1 4, 2005 Hanggie et al. EP O908.835 4f1999 2005/009 1571 A1 4, 2005 Leichtling EP 1237O76 9, 2002 2005/011.4021 A1 5/2005 Krull et al. EP 1383.080 1, 2004 2005/O114778 A1 5/2005 Branson et al. EP O972 273 3, 2004 2005/O144563 A1 6, 2005 Hough et al. EP 1724996 11, 2006 2005/O144595 A1 6, 2005 McLean JP 4214595 A 8, 1992 2005/O1494.58 A1 7/2005 Eglen et al. JP 05-210477 8, 1993 2005. O149852 A1 T 2005 Bleicher et al. WO WO96,06401 2, 1996 2005, 01603.68 A1 7/2005 Liu et al. WO WO 97/O7467 2, 1997 2005/O1684.71 A1 8, 2005 Paquette WO WO98,07112 2, 1998 2005/O1684.76 A1 8, 2005 Levene et al. WO WO 98.45815 10, 1998 2005/0172239 A1 8, 2005 Liu et al. WO WOO1? 46790 6, 2001 2005, 0183026 A1 8, 2005 Amano et al. WO WO O2/O9039 1, 2002 2005/O1933.68 A1 9, 2005 Becker et al. WO WO 2003/023593 A1 3, 2003 2005/O198584 A1 9, 2005 Matthews et al. WO WO 2004/027707 4/2004 2005/0215310 A1 9, 2005 Boyd et al. WO WO 2004/076977 9, 2004 2005/0240857 A1 10, 2005 Benedict et al. WO WO 2006/O12343 2, 2006 2005/0243373 A1 11/2005 Silverbrook et al. WO WO 2006/02O3O4 2, 2006 2005/0256940 A1 11/2005 Henderson et al. WO WO 2006/119269 11, 2006 2005/O2571.67 A1 * 11/2005 Fraleigh et al...... 715/809 WO WO 2009/O12330 1, 2009 2005/0270274 A1 12, 2005 Bachmann 2005/0278651 A1 12, 2005 Coe et al. OTHER PUBLICATIONS 2005/0282612 A1 12, 2005 Mathews 2005/0283734 A1 12, 2005 Santoro et al. Notice of the Reason for Refusal for Japanese Patent Application No. 2006.00052O7 A1 1, 2006 Louch et al. JP 2007-518332, Mar. 1, 2011, 6 Pages. 2006, OOO7875 A1 * 1/2006 Andersen ...... 370,314 Office Action for Canada Patent Application No. CA2,717.237, May 2006, OO 10394 A1 1, 2006 Chaudhri et al. 30, 2011, 4 Pages. 2006, OO15818 A1 1, 2006 Chaudhri et al. Notification of the Third Office Action for Chinese Patent Applica 2006, OO15846 A1 1, 2006 Fraleigh et al. tion No. CN 200580016349.3, May 11, 2011, 9 Pages. 2006, OO31264 A1 2, 2006 Bosworth et al. Willett, E., et al., “Microsoft Office 2003 Bible.” Chapter 1, Oct. 2, 2006.0036941 A1 2, 2006 Neil 2003, pp. 1-14, Can be retrieved at
Wincustomize.com et al. “Currency Widget” 2004 1 page, online Javaboutique. Oct. 8, 2008, 3 pages, online retrieved on Jan. 10, Retrieved on Feb. 15, 2010 Retrieved from the internet 2011 Available at: http://web.archive.org/web/20021208051951/ Authorized officer Athina Nickitas-Etienne, International Prelimi Archive of "Objects, Images and Applets.” W3C Recommendation, nary Report on Patentability and Written Opinion in PCT/US2008/ Feb. 10, 2003, online Archived by http://archive.org: Retrieved on 05.0038 mailed Sep. 24, 2009, 11 pages. Apr. 13, 2006 Retrieved from the Internet-URL:http://web.archive. Authorized officer Athina Nickitas-Etienne, International Prelimi org/web/20030210154019/http://www.w3.o- rg/TR/REC-html 140/ nary Report on Patentability and Written Opinion in PCT/US2008/ struct/objects.html>. 050047 mailed Sep. 24, 2009, 11 pages. Archive of BabelFish.com Inc., Oct. 2003, online Archived by International Search Report, dated Sep. 3, 2009, issued in Interna http://archive.org on Oct. 2, 2003; Retrieved on Dec. 8, 2008 tional Application No. PCT/US2008/050047, 7 pages. Retrieved from the internet URL:http://web.archive.org/web/ Authorized officer Beate Giffo-Schmitt, International Preliminary 20031002115902/www.babellfish.com/en/index.html>. Report on Patentability and Written Opinion in PCT/US2008/ Archive of Movies.com, 2001, Disney Enterprises, Inc., Online 070217 mailed Jan. 28, 2010, 7 pages. Archived by http://archive.org on Jan. 18, 2002; Retrieved on Dec. 8, International Search Report, dated Oct. 16, 2009, issued in Interna 2008 Retrieved from the Internet-URL:http://web.archive.org/web/ tional Application No. PCT/US2008/070217. 5 pages. 200201 18102516/movies.go.com/&-gt;. Office Action for U.S. Appl. No. 12/368,170, Oct. 8, 2010, 12 Pages. Archive of www.gigaplex.com, Lazar Productions, Nov. 1996, Office Action for U.S. Patent Application No. 12/495,686, Sep. 3, online Archived by http://archive.org on Nov. 5, 1996; Retrieved 2010, 12 Pages. on Dec. 8, 2008 Retrieved from the internet URL:http://web.archive. Office Action for U.S. Patent Application No. 12/495,686, Jan. 27. org/web. 1996.1 105081827/www.gigaplex.com/>. 2011, 11 Pages. Baratz, Adam et al. “DesktopX 3.1” Nov. 17, 2005. Third Office Action for Chinese Patent Application No. Cadiz, JJ et al., “Sideshow: Providing Peripheral Awareness of 20091004021 X, Dec. 14, 2010, 6 Pages. Important Information.” Technical Report MSR-TR-2001-83. (Sep. Second Office Action for Chinese Patent Application No. 14, 2001), 9 pages. Microsoft Corporation, Redmond, WA. 20091004021 X, Sep. 13, 2010, 15 Pages. Conner Borookshire D. et al. “Three-Dimensional Widgets' ACM Third Office Action for Chinese Patent Application No. 1992. 20091004022.4, Dec. 14, 2010, 22 Pages. Elliott, Conal “Programming Graphics Processors Functionally.” 11 Second Office Action for Chinese Patent Application No. pageS. 2009 10004022.4, Sep. 13, 2010, 12 Pages. First Office Action of the Patent Office of the People's Republic of Communication of the European Patent Office dated Oct. 1, 2010, for China, Chinese Patent Application No. 200580016349.3, Jul. 25, European Patent Application No. 05766079.7. 5 pages. 2008. Examiner's Report for Canada Patent Application No. 2,562,626, Jul. Fried, Ina, Developer Calls Apple's Tiger a Copycat, CNET News. 20, 2010, 3 pages. com, Jun. 28, 2004 online Retrieved on Jul. 1, 2004 Retrieved Examiner's Report for Canada Patent Application No. 2,717.237, from the Internet-URL:http://Zdnet.com.com/2102-1 104. Sub.--2- Nov.30, 2010, 3 pages. 5250692.html?tag=p-rinthis>. Examiner's Report for Canada Patent Application No. 2,707.754, Fried, Ina, For Apple's Tiger, the Keyword is Search, CNET News. Sep. 30, 2010, 3 pages. com, Jun. 28, 2004 online Retrieved on Jul. 1, 2004 Retrieved Harold R. “Java Network Programming, Second Edition, 2nd edi from the Internet-URL:http://Zdnet.com.com/2102-1 103. Sub. tion' O'Reilly & Associates 2000 pp. 1-731 (Cover page and Table of 2-5250346.html?tag=printthis. Contents enclosed). Guber, John et al. “Dashboard vs. Konfabulator.” Daring Fireball, “Comparison of widget engines' Wikipedia, 2007 online Jun. 2004, online Retrieved on May 11, 2007 Retrieved from the Retrieved on Sep. 28, 2007 Retrieved from the Internet Microsoft Corporation, Microsoft.RTM. Windows.TM. User's Internet 1 OO 102 Computer 115 Output device 113 103 Graphics Processor module 6 114 LOCal input storage device --- | F.G. 1 107 Remote server U.S. Patent Oct. 16, 2012 Sheet 2 of 40 US 8,291.332 B2 2O8 User invokes dashboard User dismisses layer dashboard layer 2O3 Save U State 209 Play animation to dismiss dashboard layer 210 Restore U in saved state 205 Play animation to introduce dashboard layer 2O6 Display dashboard layer including widgets 2O7 User interacts with and/or configures widgets FIG 2 U.S. Patent Oct. 16, 2012 Sheet 3 of 40 US 8,291.332 B2 3OO 3O2 Dashboard client(s) 3O2 Dashboard client(s) 304 Dashboard Configuration 3O2 information Dashboard client(s) 301 Dashboard server 109 Operating System FIG 3 U.S. Patent Oct. 16, 2012 Sheet 4 of 40 US 8,291.332 B2 U.S. Patent Oct. 16, 2012 Sheet 5 of 40 US 8,291.332 B2 C. 3. d 9. O CD St 9 > 5 g il k c d C ul U.S. Patent Oct. 16, 2012 Sheet 6 of 40 US 8,291.332 B2 Z09 U.S. Patent Oct. 16, 2012 Sheet 7 of 40 US 8,291.332 B2 U.S. Patent Oct. 16, 2012 Sheet 8 of 40 US 8,291.332 B2 U.S. Patent Oct. 16, 2012 Sheet 9 of 40 US 8,291.332 B2 U.S. Patent US 8,291.332 B2 33inGS U.S. Patent Oct. 16, 2012 Sheet 13 of 40 US 8,291.332 B2 SAAêNXoogss.3uppy saunL! dieHwopuAA09we?A||p=e|BJepuis? U.S. Patent Oct. 16, 2012 Sheet 14 of 40 US 8,291.332 B2 Ol 5 I 3. C d . 3. O CD 3. O ) 5 U cle u. C 9. - c. YS) U.S. Patent Oct. 16, 2012 Sheet 16 of 40 US 8,291.332 B2 diêHwopuAA09walaup=914??pu).T? U.S. Patent Oct. 16, 2012 Sheet 17 of 40 US 8,291.332 B2 U.S. Patent Oct. 16, 2012 Sheet 18 of 40 US 8,291.332 B2 - C OD C O s SD (S (/) D (5 (/) d O a CS 3. U.S. Patent Oct. 16, 2012 Sheet 19 of 40 US 8,291.332 B2 U.S. Patent US 8,291.332 B2 |07 U.S. Patent Oct. 16, 2012 Sheet 21 of 40 US 8,291.332 B2 |07 U.S. Patent Oct. 16, 2012 Sheet 22 of 40 US 8,291.332 B2 |07 U.S. Patent Oct. 16, 2012 Sheet 24 of 40 US 8,291.332 B2 NASDAQ 3450.054 4.50 NYSE 14535.44. A 3.98 AAPL. 42.05A 7.36 1902 MSFT 18.23 V 1.34 PIXR 92.23A 3.32 AMZN 5.23A O. 12 1d 3m (6m) 1y 2y 3y 28 26 1903 -M 2624 Mar Apr May Jun Jul Aug At N 1901 1904 FIG. 19 U.S. Patent Oct. 16, 2012 Sheet 26 of 40 US 8,291.332 B2 v CO v CN U.S. Patent Oct. 16, 2012 Sheet 27 of 40 US 8,291.332 B2 v sO) & s U.S. Patent US 8,291.332 B2 909Z U.S. Patent Oct. 16, 2012 Sheet 29 of 40 US 8,291.332 B2 Z07Z|077 ?OC]?ue[^ U.S. Patent Oct. 16, 2012 Sheet 30 of 40 US 8,291.332 B2 CO C LD CN U.S. Patent Oct. 16, 2012 Sheet 31 of 40 US 8,291.332 B2 @ 3. A k A A. A. A. K. A. A A. A |09 | U.S. Patent Oct. 16, 2012 Sheet 32 of 40 US 8,291.332 B2 spJegya §3.naeleg A. A. A A. A. A. A. A. A A. A U.S. Patent Oct. 16, 2012 Sheet 33 of 40 US 8,291.332 B2 U.S. Patent Oct. 16, 2012 Sheet 34 of 40 US 8,291.332 B2 UbIwNo.z?m?g?NTRO @ / Z06Z800GZ|| |09 U.S. Patent Oct. 16, 2012 Sheet 35 of 40 US 8,291.332 B2 ×××3×3638 U.S. Patent US 8,291.332 B2 E@ U.S. Patent Oct. 16, 2012 Sheet 37 of 40 US 8,291.332 B2 [2] spugoa Ø CòTÆÐRATRÈ A. A. A U.S. Patent Oct. 16, 2012 Sheet 38 of 40 US 8,291.332 B2 U.S. Patent Oct. 16, 2012 Sheet 39 of 40 US 8,291.332 B2 CD O r cy) v C'Meeu(O)SnunesouLÂueuopo?(I 9079Z079 U.S. Patent Oct. 16 2012 Sheet 40 of 40 US 8 9 291.332 B2 O O r cr) v Z079|079 US 8,291.332 B2 1. 2 LAYER FOR ACCESSING USER INTERFACE Although many users appreciate the ability of Such user ELEMENTS interfaces to pre-sent such a wealth of information on the screen simultaneously, the resulting “information overload” CROSS-REFERENCE TO RELATED can be somewhat overwhelming. Users often find that it is APPLICATIONS difficult to navigate to a particular UI element or window, or to even locate a desired element, among a large number of This application is a continuation of U.S. application Ser. onscreen elements. The problem is further compounded when No. 10/877,968, entitled “Unified Interest Layer for User user interfaces allow users to position the onscreen elements Interface filed Jun. 25, 2004, which is incorporated herein in any desired arrangement, including overlapping, minimiz by reference in its entirety; and the subject matter of the 10 ing, maximizing, and the like. Such flexibility may be useful invention is generally related to the following jointly owed to some users but may result in chaos for other users. Having and co-pending patent applications, each incorporated herein too many items on the screen simultaneously leads to infor by reference in its entirety: mation overload, and can act as an inhibiting factor in the U.S. Provisional patent application Ser. No. 1 1/114,384, effective use of the computer equipment. for “Procedurally Expressing Graphic Objects for Web 15 Some user interfaces dedicate certain areas of the screen Pages.” filed Jun. 25, 2004; for holding certain user interface elements that are commonly U.S. Utility patent application Ser. No. 10/874,829, for used (such as a menu bar, or icons that activate commonly “User Interface for Assisting in the Installation of an used programs or files). However, such areas are generally Asset, filed Jun. 22, 2004; limited in size, so as not to occupy too much valuable screen U.S. Utility patent application Ser. No. 10/877,358, for real estate that could otherwise be devoted to the main work “Display-Wide Visual Effects for a Windowing System space area of the display Screen. Although Small elements, Using a Programmable Graphics Processing Unit, filed Such as a digital clock element or taskbar, may be well Suited Jun. 25, 2004; for display in Such dedicated Screen areas, other types of U.S. Utility patent application Ser. No. 10/826,762, for elements cannot be usably presented in Such a small screen “High-Level Program Interface for Graphics Opera 25 area; thus they must be activated, or enlarged, before they can tions.” filed Apr. 16, 2004; be used or viewed. This causes yet another level of confusion, U.S. Utility patent application Ser. No. 10/866,360, for since the items need to be activated and dismissed. Further “System and Method for Processing Graphics Opera more, the items may overlap or otherwise add to the number tions with Graphics Processing Unit, filed Jun. 11, ofonscreen elements that must be dealt with and organized by 2004; 30 the user. U.S. Utility patent application Ser. No. 10/826,596, for These problems cause many users to fail to use their com “Improved Gaussian Blur” filed Apr. 16, 2004; puters to their full potential, and can further result in frustra U.S. Utility patent application Ser. No. 10/826,744, for tion or confusion, particularly in novice users. “System for Emulating Graphics Operations.” filed Apr. What is needed is a mechanism for providing easy access to 16, 2004; 35 commonly used user interface elements, without introducing U.S. Utility patent application Ser. No. 10/876,298, for additional clutter or confusion. What is further needed is a “User-Interface Design.” filed Jun. 24, 2004; mechanism for providing Such access in a user-configurable U.S. Utility patent application Ser. No. 10/876,039, for manner that allows the user to activate and dismiss the UI “Gaussian Blur Approximation Suitable for GPU. filed elements at will and with a minimum of confusion. What is Jun. 24, 2004; 40 further needed is a mechanism that allows users to easily U.S. Utility patent application Ser. No. 10/825,694, for activate and dismiss certain user interface elements regard “System for Optimizing Graphics Operations, filed less of the number of open windows currently on the user's Apr. 16, 2004; screen, and without requiring the user to search for particular U.S. Utility patent application Ser. No. 10/826,773, for user interface elements among a set of open windows. “System for Reducing the Number of Programs Neces 45 What is further needed is a mechanism for addressing the sary to Render an Image filed Apr. 16, 2004; and above-stated problems in a convenient, easy-to-use manner U.S. Utility patent application Ser. No. 10/875.483, for that is likely to be readily adopted by users, and that fits within “Fast Approximation Functions for Image Processing the framework of existing graphical user interfaces. Filters, filed Jun. 24, 2004. 50 SUMMARY OF THE INVENTION FIELD OF THE INVENTION According to the techniques of the present invention, a The present invention relates generally to graphical user user-activatable dashboard (also referred to as a unified inter interfaces, and more particularly to a user-activatable, con est layer) is provided. The dashboard can contain any number figurable, unified layer containing items of interest to a user. 55 ofuser interface elements, referred to herein as “widgets.” for quick access by a user. In response to a command from a user, BACKGROUND OF THE INVENTION the dashboard is invoked and the widgets are shown on the screen. In one aspect of the invention, the user can activate the A hallmark of modern graphical user interfaces is that they dashboard at any time, causing the dashboard to temporarily allow a large number of items to be displayed on a screen at 60 replace or overlay the existing user interface display on the the same time. The leading computer operating systems. Such user's Screen. as Apple MacOS X and Microsoft Windows XP provide user Once the dashboard has been activated, the user can inter interfaces in which a number of windows can be displayed, act with any or all of the widgets, and can configure the overlapped, resized, moved, configured, and reformatted dashboard by adding, deleting, moving, or configuring indi according to the needs of the user. Taskbars, menus, and other 65 vidual widgets as desired. When the user wishes to return to UI elements provide mechanisms for accessing and activating the normal user interface, the user issues a command causing windows even when they are hidden behind other windows. the dashboard to be dismissed. Once the dashboard has been US 8,291.332 B2 3 4 dismissed, the previous user interface state is restored, allow FIG. 14 is a screen shot depicting a dashboard where the ing the user to resume normal interactions with the operating configuration bar has been closed, according to one embodi system. ment. In one aspect, the dashboard, when activated, temporarily FIG. 15 is a screen shot depicting a dashboard wherein replaces the existing user interface display. In another aspect, widgets have been moved to new positions. the dashboard partially obscures the existing user interface FIGS. 16A through 16Care screen shots depicting a tran display, but allows some part of the existing display to be sition animation for dismissing the dashboard, according to visible so as to remind the user of its presence. In another one embodiment. aspect, the existing user interface display is faded, blurred, FIGS. 17A through 17D are screen shots depicting a tran and/or darkened while the dashboard is active. 10 sition animation for activating the dashboard, according to In one aspect, a transition effect is displayed during acti one embodiment. Vation and/or dismissal of the dashboard, so as to assist the FIG. 18 is an example of a calendar widget according to user in understanding what is happening when the dashboard one embodiment. appears and disappears. FIG. 19 is an example of a stock quote widget according to In one aspect, the user can select from any number of 15 one embodiment. widgets to be placed on the dashboard in any desired arrange FIG.20 is an example of a weather widget according to one ment. Whenever the dashboard is activated, the widgets embodiment. appear in the locations where the user placed them previously. FIG.21 is an example of a traffic webcam widget according Widgets can be of any type. They can communicate with a to one embodiment. remote server to provide information to the user (for example, FIG. 22 is an example of a music player widget according a weather report), or they can provide commonly needed to one embodiment. functionality (for example, a calculator), or they can act as an FIG.23 is an example of a package tracking widget accord information repository (for example, a notepad or calendar). ing to one embodiment. Some widgets can provide a combination of these types of FIG.24 is an example of an address book widget according functions. In one aspect, an application programming inter 25 to one embodiment. face (API) is provided so as to allow third-party developers to FIG. 25 is an example of a clock widget according to one create and distribute additional widgets that provide different embodiment. types of functionality. FIG. 26 is a screen shot depicting a dashboard where the configuration bar has been closed, according to one embodi BRIEF DESCRIPTION OF THE DRAWINGS 30 ment. FIG. 27 is a screen shot depicting a dashboard where the The accompanying drawings illustrate several embodi configuration bar has been opened to show favorite widgets, ments of the invention and, together with the description, according to one embodiment. serve to explain the principles of the invention. FIG. 28 is a screen shot depicting a dashboard where the FIG. 1 is a block diagram depicting an overall architecture 35 configuration bar has been opened to allow access to addi for implementing the present invention according to one tional widgets, according to one embodiment. embodiment. FIG. 29 is a screen shot depicting a dashboard including FIG. 2 is a flowchart depicting a method for activating and rollovericons for closing and configuring a widget, according using a dashboard according to one embodiment of the to one embodiment. present invention. 40 FIG. 30 is a screen shot depicting a dashboard wherein FIG.3 is a block diagram depicting a software architecture Some labels in the configuration bar have changed in appear for implementing the present invention according to one ance, according to one embodiment. embodiment. FIG. 31 is a screen shot depicting a dashboard wherein FIG. 4 is a screen shot depicting a desktop user interface Some labels in the configuration bar have changed in appear prior to activation of a dashboard. 45 ance, and wherein the dashboard includes rollover icons for FIG. 5 is a screen shot depicting an initial state for a closing and configuring a widget according to one embodi dashboard, according to one embodiment. ment. FIG. 6 is a screen shot depicting a configuration bar for a FIG. 32 is a screen shot depicting a dashboard showing dashboard, according to one embodiment. preferences controls for two widgets, according to one FIG. 7 is a screen shot depicting user selection of a widget 50 embodiment. from the configuration bar, according to one embodiment. FIG.33 is an example of a calculator widget according to FIG. 8 is a screen shot depicting a dashboard including a one embodiment. calculator widget, according to one embodiment. FIGS. 34A and 34B depict an example of a dictionary/ FIG. 9 is a screen shot depicting a dashboard including a thesaurus widget according to one embodiment. calculator widget and a music player widget, according to one 55 One skilled in the art will recognize that these Figures are embodiment. merely examples of the operation of the invention according FIG. 10 is a screen shot depicting activation of a music to one embodiment, and that other user interface arrange player application as invoked by a music player widget, ments and modes of operation can be used without departing according to one embodiment. from the essential characteristics of the invention. FIG. 11 is a screen shot depicting a dashboard including a 60 calculator widget, a music player widget, and an address book DETAILED DESCRIPTION OF THE widget, according to one embodiment. EMBODIMENTS FIG. 12 is a screen shot depicting operation of an address book widget, according to one embodiment. The present invention is now described more fully with FIG. 13 is a screen shot depicting a dashboard including a 65 reference to the accompanying Figures, in which several number of widgets including a notes widget, according to one embodiments of the invention are shown. The present inven embodiment. tion may be embodied in many different forms and should not US 8,291.332 B2 5 6 be construed as limited to the embodiments set forth herein. The dashboard (also referred to hereinas a “unified interest Rather these embodiments are provided so that this disclosure layer') includes a number of elements, referred to herein as will be complete and will fully convey the invention to those “widgets'. These widgets generally include Software acces skilled in the art. sories for performing useful, commonly needed functions. Hardware Architecture Examples of widgets include, without limitation, a calendar, In one embodiment, the present invention is implemented a calculator, an address book, a package tracker, a weather as part of an operating system for a personal computer. One module, and the like. In one embodiment, Some widgets may example of an implementation of the pre-sent invention is in interact with remote sources of information, Such as servers, a Macintosh personal computer running the MacOS X oper to provide information; for example, a weather module may 10 retrieve live weather data from a remote server. Widgets may ating system. Referring now to FIG. 1, there is shown an be interactive, so that a user performs common input opera example of an architecture for a system 100 for implementing tions (such as clicking a mouse or typing on a keyboard) to the present invention. Personal computer 102 includes pro utilize the functionality of a widget. cessor 103, memory 105, input devices 114 such as keyboard The user interacts with and/or configures widgets as and mouse, and output device 115 Such as a display screen. A 15 desired 207. In one embodiment, the user can move widgets graphics module 113, Such as a graphics card, may be pro around the screen, and can resize widgets if applicable. Some vided for generating output for output device 115. User 101 widgets may be resizable, and some may be offixed size; the interacts with system 100 by providing input via device 114 widget author may specify whether a widget can be resized. and viewing output via device 115. Computer 102 also Some widgets may automatically resize themselves based on includes local storage 106, Such as a hard drive, and can also the amount or nature of the data being displayed. In one include network connection 108 for accessing remote server embodiment, widgets may overlap one another. In another 107. These components are well-known hardware compo embodiment, widgets do not overlap one another; if the user nents commonly used for running software applications. In attempts to move one widget to the position occupied by one embodiment, software embodying the invention is pro another widget, one of the widgets may automatically move vided on a computer-readable medium such as local storage 25 out of the way to make room. In one embodiment, the posi 106. tion, configuration, and size of widgets are saved when the In another embodiment, the present invention is imple dashboard is dismissed, so that the same state can be restored mented as a plug-in that can be installed and run on personal the next time the dashboard is invoked. computer 102, and that interacts with the operating system of When the user wishes to dismiss 208 the dashboard and personal computer 102 to perform the functions described 30 return to the normal user interface, he or she does so by herein. In yet another embodiment, the present invention is invoking a dismissal command. In various embodiments, the implemented as functionality in a software application run user hits a function key or key combination (which may be the ning on a personal computer. same or different than the key or combination used to activate For illustrative purposes, in the following description the the dashboard), or clicks on a close box or othericon, or clicks invention is described as a feature of an operating system; 35 on negative space within the dashboard (in other words, a however, one skilled in the art will recognize that the tech space between widgets), or moves an onscreen cursor to a niques of the present invention can be implemented in other predefined corner of the screen. In another embodiment, the contexts as well, including those described above. dashboard is automatically dismissed after some pre-deter Method of Operation mined period of time without any user activity, or upon some Referring now to FIG. 2, there is shown a flowchart depict 40 other trigger event. An animation may be played 209 to pro ing a method for activating and using a dashboard according vide a transition as the dashboard is dismissed. to one embodiment of the present invention. In one embodi In one embodiment, when the dashboard is dismissed, the ment, the user can activate the functionality of the present current configuration of the widgets is stored so that it can be invention at any time, for example by hitting a designated retrieved the next time the dashboard is activated. In one function key or key combination, or by clicking on an icon, or 45 embodiment, an animation is played to dismiss the dashboard by selecting a command from an onscreen menu, or by mov and reintroduce the user interface. The user interface is ing an onscreen cursor to a designated corner of the screen. In restored 210 to its previous state, so that the user can resume response to the user performing such an action 202, the cur normal interaction with the Software applications and oper rent state of the user interface is saved 203, the user interface ating system of the computer. is temporarily inactivated (and/or faded 204), an animation is 50 In one embodiment, the dashboard is configurable. The played 205 to introduce the dashboard, and the dashboard of user can select any number of widgets to be displayed, for the present invention is displayed 206. If applicable, a previ example by dragging the widgets from a configuration bar (or ous state of the dashboard is retrieved, so that the dashboard other user interface element) onto a location on the dash can be displayed in the same configuration as the last time the board. In one embodiment, the configuration bar can include user saw it. 55 different types of widgets, and can be categorized and/or In one embodiment, the dashboard is overlaid on the exist hierarchically organized. In one embodiment, in response to ing desktop user interface; the user interface may be dark the user dragging a widget onto the configuration bar, the ened, brightened, blurred, distorted, or otherwise altered so as widget is downloaded from a server and installed (if it is not to emphasize that it is temporarily inactivated. The existing already installed on the user's machine). In one embodiment, desktop may be visible behind the dashboard. In another 60 certain widgets may cost money, so that the user must provide embodiment, the existing desktop is not visible while the a credit card or some other payment means before the widget dashboard is active. In another embodiment, the desktop is is installed on the user's machine. In another embodiment, shrunk to a small portion of the screen while the dashboard is widgets are already installed on the user's machine, but are active, and can be reactivated by clicking on it. In another only made visible when they have been dragged from the embodiment, the desktop is shrunk and presented as a widget 65 configuration bar onto the dashboard. One skilled in the art similar to the widgets described herein; the desktop can be will recognize that the configuration baris merely an example reactivated by clicking on the widget. of one type of user interface element for configuring the US 8,291.332 B2 7 8 dashboard, and that other configuration mechanisms can be cations can be accessed by other means than a button within used without departing from the essential characteristics of the widget. For example, Such functionality can be launched the present invention. via an on-screen icon or menu, or via a keystroke or key As mentioned above, various types of animations can be combination. used to emphasize and clarify transitions in connection with In one embodiment, the fully functional application or the present invention. For example, activation of the dash related website provides context for a launched widget. For board can be signaled by a “fly-in' animation, wherein the example, if the user has highlighted a word in a document widgets move from the edge of the screen inwards to their before activating a dictionary widget, the dictionary widget's respective positions in the dashboard. Simultaneously, the text field is automatically populated with the highlighted user interface can be darkened, blurred, distorted, or other 10 word. In one embodiment, a word search is automatically wise altered to indicate that it is temporarily inactive. Dis activated, and the results automatically displayed, so that missal of the dashboard can be signaled by a “fly-out' ani activating the dictionary widget causes a definition to be mation, wherein the widgets move towards the edge of the displayed without any further user interaction. Similarly, if an screen and then appear to fly off the screen. Simultaneously, email message is open on the user's screen when an address the user interface is restored to its normal state. In one 15 book widget is launched, the address book is automatically embodiment, when the user drags a widget from the configu opened to a page corresponding to the contact information for ration bar onto the desktop, an animation Such as a ripple the sender of the email message. In one embodiment, Such effect can be shown, to emphasize that the widget has been prepopulation or automatic opening is not performed under placed onto the desktop in the selected location. The ripple certain situations, such as for example if the widget is already effect distorts the background temporarily to give the impres open to another page or entry. In one embodiment, the user sion that the widget is being placed into water. In one embodi can configure the operation of the widget, including whether ment, the effect is implemented according to animation and or not such prepopulation or automatic opening occurs and distortion techniques described in detail in the related cross under what circumstances it should occur. One skilled in the referenced patent applications. In one embodiment, such ani art will recognize that there are many other situations where a mations are configurable by the user. 25 widget can use context information from a currently-running In one embodiment, more than one dashboard is available. application or website. For example, the user can configure one dashboard to contain In one embodiment, some or all widgets have rollover widgets related to work, and another for widgets related to elements; these are user interface elements that appear when personal matters. Different trigger events (such as different the onscreen cursor is moved over the widget. The rollover key combinations) can be used for triggering the various 30 elements disappear when the onscreen cursor is moved so that dashboards; alternatively, the user can select from a pop-up it is no longer over the widget. In one embodiment, rollover menu which dashboard he or she wishes to activate. The elements only appear if the cursor is held over the widget for system of the present invention stores state information for at least a predetermined period of time, such as half a second. each of the dashboards. Different dashboards can contain one An example of a rollover element is a Volume ring (not or more of the same widgets; state information for a widget 35 shown) for music player application. can be maintained separately for each dashboard in which the FIGS. 4through 17D and 26 through 32 depict examples of widget appears, or it can be commonly maintained across all dashboard operations in response to various user commands; dashboards in which the widget appears. In addition, different these Figures illustrate various techniques and capabilities of dashboards can be available for different users of computer the present invention. 102, so that each user can only access the dashboard(s) he or 40 FIG. 4 depicts a desktop user interface 400 prior to activa she created. A user can specify a dashboard as being available tion of the dashboard. Desktop user interface 400 (referred to to other users, if desired. A user can also specify, for any or all herein as "desktop') is a conventional user interface as may of the dashboards he or she creates, whether other users are be provided by an operating system such as MacOS X. Desk permitted to make changes to the dashboard(s). top 400 has a background image, menu bar 401, and other In one embodiment, some or all widgets are associated 45 standard features. As is known in the art, desktop 400 may with related, fully functional applications providing also include windows, icons, and other elements (not shown). expanded versions of the functionality of the corresponding The user activates the dashboard by selecting an item from widgets. These widgets include a button, or icon, or other a menu, or by clicking on an icon, or by pressing a function element, for quickly launching the associated application. key or key combination, or by some other means for invoking When the user clicks on the button, the dashboard is dis 50 a command. FIG. 5 depicts an initial state for a dashboard, missed, the normal desktop user interface is reactivated, and according to one embodiment. In the example of FIG. 5, a the associated application is automatically launched. For configuration icon 501 is initially displayed. Alternatively, example, as will be described in more detail below, a music upon activation, the dashboard can include one or more player widget can include a button for launching a fully default widgets. Alternatively, if the dashboard has previ functional music player application containing additional 55 ously been activated and configured, the widgets are dis features beyond what is available in the widget. played as previously configured. As shown in FIG. 5, the In one embodiment, a button can be provided for accessing dashboard itself is not necessarily visible as a distinct layer; a website, web page, or web-based application having func rather its various components (such as widgets, icon 501, and tionality or information related to a widget. When the user other features) are visible. In one embodiment, these compo clicks on the button, the dashboard is dismissed, the normal 60 nents are displayed in a transparent layer that allows desktop desktop user interface is reactivated, a web browser is 400 to be seen through it. In one embodiment desktop 400 and launched, and the web page (or the like) associated with the its components are darkened (or blurred, or otherwise visu widget is automatically launched. For example, a stock quote ally modified) while the dashboard is active, so as to empha widget may include a button for accessing a website that size that desktop 400 is temporarily inactive. The user can includes more detailed information on a portfolio or on a 65 easily reactivate desktop 400 and dismiss the dashboard by particular stock. In another embodiment, related fully func simply clicking on an area of the screen where no dashboard tional applications, websites, web pages, or web-based appli element is being displayed; in one embodiment, clicking on US 8,291.332 B2 9 10 this “negative space' causes the dashboard to be dismissed get 901 is placed by clicking and dragging from iTunes' according to techniques described in more detail below. In label903 in configuration bar 601. Music player widget 901, another embodiment, other commands, key combinations, in this embodiment, provides a subset of the functionality icons, or other user input is used to cause the dashboard to be associated with a fully functional music player application. In dismissed. In another embodiment, desktop 400 is not visible 5 one embodiment, music player widget 901 includes button while the dashboard is active. 902 for activating a fully functional music player application. In one embodiment, the user can move icon 501 to any Thus, the user can easily launch an application that provides location on the screen by dragging it, and the position of icon enhanced functionality with respect to a widget. 501 is persistent from one invocation of the dashboard to the In one embodiment, in response to the user clicking button neXt. 10 902 to activate the full music player application, the dash The user clicks on icon 501 to activate configuration bar board is dismissed, the normal desktop 400 is restored, and 601, as shown in FIG. 6. Configuration bar 601 provides the full music player application is launched. All of these access to various widgets that can be placed on the dashboard. steps take place automatically, without requiring additional In one embodiment, a text label is shown for each available user intervention. FIG. 10 depicts the screen after the user has widget. In another embodiment, an icon is shown for each 15 activated the full music player application 1001 by clicking available widget. If many widgets are available, they may be on button 902 in music player widget 901, according to one arranged hierarchically by type, or alphabetically, or by any embodiment. The dashboard has been dismissed, and the other categorization methodology. For example, a number of various elements of desktop 400, including menu bar 401, are categories may be displayed; clicking on one of the categories once again active. causes a pull-down menu to be displayed, listing a number of In FIG. 11, the user has reactivated the dashboard (thus widgets in that category. In one embodiment, a buy command restoring widgets 801 and 901 in their previous states and 602 is also available, allowing the user to select widgets from locations), and has placed an address book widget 1101 by an online store or website. One skilled in the art will recognize dragging it from label 1102. Again, in one embodiment, a that the particular configuration and appearance of configu ripple animation is displayed when widget 1101 is dropped ration bar 601 in FIG. 6 is merely exemplary, and that many 25 onto its location on the dashboard. other arrangements are possible. The user can dismiss con The user can interact with address book widget 1101 as he figuration bar 601 by clicking on dismissal icon 603. Refer or she would normally interact with an address book appli ring now briefly to FIG. 31, a Done button 3101 can also be cation. For example, as shown in FIG. 12, the user can type in provided for dismissing configuration bar 601. the first few letters of a person's name in field 1201; once In one embodiment, the user can move configuration bar 30 sufficient information has been entered to identify an indi 601 to any location on the screen by dragging it, and the vidual, that individual’s address card is displayed. position of configuration bar 601 is persistent from one invo FIG. 13 depicts the dashboard after a number of widgets cation of the dashboard to the next. Also, in one embodiment have been placed, including notes widget 1301, calculator the state of configuration bar 601 (open or closed) is persistent widget 801, music player widget 901, and address book wid from one invocation of the dashboard to the next. 35 get 1101. In one embodiment, double-clicking in notes wid The user can drag widgets from configuration bar 601 onto get 1301 causes it to enter an edit mode wherein text can be the surface of the dashboard (in other words, anywhere on the entered or edited. When not in edit mode, widget 1301 can be screen), using standard drag-and-drop functionality for mov moved around the dashboard. In other embodiments, other ing objects on a screen. FIG. 7 depicts user selection of a types of user actions (for example pressing modifier keys) can calculator widget from the configuration bar, according to 40 be used to distinguish between text editing operations and one embodiment. Calculator label 701 is highlighted, to indi widget-dragging operations. cate that it has been selected by the user. FIG. 8 depicts the The user can dismiss configuration bar 601 by clicking on dashboard after the calculator widget 801 has been placed on dismissal icon 603. FIG. 14 depicts a dashboard after con the screen. In one embodiment, an animation, such as a ripple figuration bar 601 has been closed, according to one embodi animation, is shown when the user “drops' widget 801 by 45 ment. Configuration icon 501 is displayed, which allows the releasing a mouse button (or equivalent input device) to place user to reactivate configuration bar 601 as desired. widget 801 at the desired location. The user can move widget The user can move widgets around the screen as desired. 801 after it has been placed, to any other desired location, or Widget locations are preserved when the dashboard is dis can remove widget 801 from the screen, for example by missed, so that the widgets reappear at the same location dragging it off the screen, or dragging it back onto configu 50 where they were left, when the dashboard is activated. FIG. ration bar 601, or by invoking a remove command. The posi 15 depicts the dashboard after widgets 801, 901, 1101, 1301 tion, state, and configuration of widget 801 are preserved have been moved to new positions. when the dashboard is dismissed, so that these characteristics As discussed above, in one embodiment a transition ani are restored the next time the dashboard is activated. mation is played when the dashboard is dismissed. FIGS. 16A In one embodiment, multiple instances of some widgets 55 through 16C are screen shots depicting a “fly-out' transition can be activated, by dragging the widget from configuration animation, wherein widgets 801, 901, 1101, 1301 appear to bar 601 onto the dashboard surface two or more times. In fly off the edges of the screen when the dashboard is dis another embodiment, only one instance of each widget can be missed. While they are flying off the edges of the screen, activated. In another embodiment, some widgets can have widgets 801, 901, 1101, 1301 grow in size and fade, so as to multiple instances and others cannot. 60 reinforce the appearance of movement and transition. At the Once calculator widget 801 has been placed on the dash same time, desktop 400 and its features (such as menu bar board, the user can interact with it by entering numbers via a 401) are restored to their normal, non-faded appearance. mouse or other pointing device, or via a keyboard. Conven As discussed above, in one embodiment a transition ani tional operations for calculator applications are available. mation is played when the dashboard is activated. FIGS. 17A FIG.9 depicts the screen after the user has dragged both a 65 through 17D are screen shots depicting a “fly-in' transition calculator widget 801 and a music player widget 901 onto the animation, wherein widgets 801, 901, 1101, 1301 appear to dashboard, according to one embodiment. Music player wid fly in from the edges of the screen when the dashboard is US 8,291.332 B2 11 12 activated. Widgets 801, 901, 1101, 1301 are faded and tion bar 601 has two sections 2802, 2803. Section 2802 enlarged when they first appear at the screen edges; they includes labels 2701 for favorite widgets; this includes the reduce in size and become more solid in appearance while same subset of widgets that is included in the first state of they are flying in, so as to reinforce the appearance of move configuration bar 601, as shown in FIG. 27. Section 2803 ment and transition. At the same time, desktop 400 and its includes labels 2701 for other widgets that are not included in features (such as menu bar 401) gradually fade into the back the set of favorite widgets. Dragging a label 2701 from sec ground. tion 2802 to 2803 causes the corresponding widget to be In one embodiment, the system of the present invention removed from the favorites subset. Dragging a label 2701 includes the capability to alert the user when a widget needs from section 2803 to 2802 causes the corresponding widget to attention or has new information to display to the user, even if 10 be added to the favorites subset. Dragging a label 2701 from the dashboard is not currently active. For example, an icon on eithersection 2802 or 2803 onto the dashboard surface causes a “Dock', or taskbar, or other user interface element com the corresponding widget to be placed at the specified loca monly associated with a desktop user interface, can blink or tion. Dragging a label 2701 from either section 2802 or 2803 bounce or otherwise indicate an alert condition. A distinctive onto trash icon 2801 causes the label 2701 to be removed from Sound can also be played. Alternatively, a dialog box can be 15 configuration bar 601; in one embodiment, this also causes presented, or a text alert can be displayed. Whatever form it the corresponding widget to be removed from the dashboard may take, the alert can be of a generalized type or it may (if it is currently open). In one embodiment, dragging a label indicate the specific widget that issued the alert, and may even 2701 onto trash icon 2801 also causes the corresponding have additional information specifying the nature of the alert. widget to be deleted from the user's machine, or made The user can then activate the dashboard (either by a dash unavailable. In one embodiment, the user is presented with a board activation command as described above, or by clicking dialog box to confirm that he or she wishes to delete the on an icon or button associated with the alert) to see the widget. In one embodiment, the user can also drag widgets widget that issued the alert. Alternatively, the dashboard can onto trash icon 2801 to cause the widgets to be closed, dis automatically be activated in Such a situation, or a dialog box missed, and/or uninstalled. More gadgets label 2602 provides can be presented to allow the user to indicate whether or not 25 access to a website, online store, or other resource for obtain the dashboard should be activated. ing and installing additional widgets; in one embodiment it For example, a package tracking widget may issue an alert offers functionality that is similar to buy command 602 as when a package has been delivered. The alert may be gener described above in connection with FIG. 6. alized, or it may indicate that the package tracking widget is In one embodiment the state of configuration bar 601 is the source of the alert, or it may even provide the delivery 30 persistent from one invocation of the dashboard to the next. information. The user can dismiss the alert, or activate the Referring now to FIG. 30, there is shown an example of a dashboard to see the widget and interact with it to obtain more dashboard wherein some labels 2701A in configuration bar information. As another example, a traffic webcam widget 601 have changed in appearance, while other labels 2701B, can issue an alert when an accident has occurred on the route 2701C are unchanged, according to one embodiment. In one covered by the webcam. 35 embodiment, when a widget is open, its corresponding label In one embodiment, configuration bar 601 has several pos 2701 on configuration bar 601 changes in appearance; for sible states. Referring now to FIG. 26, there is shown an example, it is grayed out or displayed in Some other color. In example of the dashboard where the configuration bar is another embodiment, label 2701 is grayed out (or otherwise closed, so that configuration icon 501 is displayed. Two stick changed) only if the widget is a single-instance widget (as ies widgets 1301 are currently being displayed, along with 40 described above); for multiple-instance widgets, label 2701 two clock widgets 2500A, 2500B. remains unchanged when the widget is opened. Such a tech Clicking on configuration icon 501 causes configuration nique provides an indication to the user as to which labels bar 601 to be displayed in a first state, as shown in FIG. 27. 2701 can be used to activate a widget (either because they are The first state includes labels 2701 for various widgets that not currently open or because they are multiple-instance wid are designated as “favorites'; in one embodiment, these are a 45 gets) and which labels 2701 are currently inactive (because subset of all of the widgets currently installed on the user's they correspond to single-instance widgets that have already machine. Thus, in this state, the user is presented with only been opened). In the example of FIG. 30, address book 1101, those widgets that are commonly needed. As will be seen, the calculator 801, calendar 1801, music player 901, and stock user is able to configure this view so that it includes any quote widget 1901 are open, single-instance widgets; there desired Subset of installed widgets. In one embodiment, con 50 fore their corresponding labels 2701A are grayed-out. Stick figuration bar 601 in this state includes a “More” label or icon. ies 1301 and clock 2500 are open, multiple-instance widgets; The user clicks on this label or icon to cause configuration bar therefore their corresponding labels 2701B are unchanged. 601 to expand to its second state, as shown in FIG. 28. Dis Labels 2701C are also unchanged, since they correspond to missal icon 603 causes configuration bar 601 to be dismissed, widgets that are not currently open. reverting to configuration icon 501 as shown in FIG. 26. In 55 In another embodiment, labels 2701 corresponding to open one embodiment, the on-screen position of icon 603 matches multiple-instance widgets have a different appearance than that of icon 501, so that the user can easily open and close labels 2701 corresponding to widgets that are not currently configuration bar 601 without moving the cursor around. open. The user can drag labels 2701 onto the dashboard surface to In another embodiment, when a widget is opened, its label place widgets onto the dashboard. As described above, in one 60 2701 is removed from configuration bar 601. When the wid embodiment a distinctive animation, such as a ripple effect, is get is closed, its label 2701 is restored in configuration bar shown to reinforce the notion that the widget is being placed 601. In another embodiment, when a single-instance widget at the specified location. is opened, its label 2701 is removed from configuration bar Referring now to FIG. 28, there is shown an example of 601, but when a multiple-instance widget is opened, its label configuration bar 601 in its second, expanded State, providing 65 2701 remains on configuration bar 601. When the single access to additional widgets as well as the favorite widgets instance widget is closed, its label 2701 is restored in con that were presented in the first state. In this state, configura figuration bar 601. Removing and/or restoring labels 2701 US 8,291.332 B2 13 14 can be accompanied by animations to reinforce the transition are grayed-out. Stickies 1301A and 1301B are open, mul from configuration bar 601 onto dashboard surface and vice tiple-instance widgets; therefore their corresponding label Versa. For example, when closing a widget, the widget can 2701B is unchanged. Labels 2701C, including world clock appear to be sucked into configuration bar 601 as the corre label, are also unchanged, since they correspond to widgets sponding label 2701 is restored. that are not currently open. In FIG.31, the cursor (not shown) If a widget is deleted or removed (by dragging it or its label is positioned over stickies widget 1301B, so that close box to trash icon 2801, for example), its label 2701 is removed 2901 and preferences icon 2902 are displayed, as described from configuration bar 601. above in connection with FIG. 29. In one embodiment, the user can close a widget by clicking In the example of FIG. 31, configuration bar 601 includes on a close icon, or by dragging the widget back to configura 10 tion bar 601. Referring now to FIG. 29, there is shown a Done button 3101, which dismisses configuration bar 601 and screen shot depicting a dashboard including close icon 2901 restores configuration icon 501. Thus, Done button 3101 per for closing widget 2500B. In one embodiment, icon 2901 is a forms the same action as dismissal icon 603. rollover icon; it appears when the user has positioned the In one embodiment, flipping a widget over reveals other cursor over widget 2500B, and it disappears when the cursor 15 information, fields, or controls in addition to (or instead of) is no longer positioned over widget 2500B. In one embodi preferences fields and controls. One skilled in the art will ment, rollover icon 2901 only appears if the cursor is held recognize that the reverse side of a widget can include any over widget 2500B for at least a predetermined period of time, type of auxiliary information, fields, or controls, and is not Such as half a second. In one embodiment, when a widget is limited to a mechanism for accessing preferences controls. closed, an animation is played to reinforce the notion that the Widget Installation widget is closing. For example, the widget may be momen In one embodiment, widgets are preinstalled on the user's tarily distorted in Such a way that it appears to be Sucked into computer, so that dragging them onto the dashboard merely close icon 2901, or onto configuration bar 601, before it makes them active. In another embodiment, widgets are not disappears from the screen. Other types of animations or preinstalled, but are installed in response to the user dragging effects may also be used, Such as a fade, or a wipe, or a 25 them onto the dashboard. In another embodiment, dragging a shrinking effect. In one embodiment, the user can configure widget onto the desktop causes code for the widget to be which effect is desired, or if no effect is desired. downloaded from a remote server and installed on the user's Widget 2500B also includes preferences icon 2902 for machine. In another embodiment, installing a widget in this accessing preferences controls for widget 2500B. In one manner also causes a fully functional application containing embodiment, icon 2902 is a rollover icon; it appears when the 30 related functionality to be automatically installed as well user has positioned the cursor over widget 2500B, and it (although the user can be given the option to decline Such an disappears when the cursor is no longer positioned over wid installation); for example, installing a music player widget get 2500B (although it continues to be visible when the cursor can cause a fully functional music player application to be is moved over to icon 2902). In one embodiment, icon 2902 installed as well. Authentication and payment may be prereq only appears if the cursor is held over widget 2500B for at 35 uisites for Such operations in Some embodiments. least a predetermined period of time, Such as half a second. For example, referring briefly to FIG. 28, in one embodi Clicking on icon 2902 causes preferences controls to be dis ment the user clicks on more gadgets label 2602 to access an played. In one embodiment, preferences are entered using a online widget store or website where widgets are available for conventional dialog box (not shown) as is known in the art. In purchase or for free download. The user selects widget(s) for another embodiment, clicking on icon 2902 causes widget 40 installation on his or her machine, and pays via credit card (if 2500B to appear to flip over, revealing its reverse side, which required). The online store or website is dismissed, the contains preferences controls. selected widget(s) are downloaded and installed, the dash Referring now to FIG.32, there is shown an example of the board is automatically reactivated, and the selected widget dashboard where two widgets 2500A and 1301A have been appears in configuration bar 601, ready to be dragged onto the flipped over, revealing preferences controls 3201. In the 45 dashboard Surface. Alternatively the new widget can auto example, preferences controls 3201 include menus for select matically be placed on the dashboard surface. Thus, the ing a location (for clock widget 2500A), and paper color present invention provides an easy, seamless way to install selector and font selector (for stickies widget 1301A). One widgets. skilled in the art will recognize that any type of controls, In one embodiment, an online store or free distribution site menus, fields, or other elements can be included in prefer 50 is provided for making widgets 303 available. Available wid ences controls 3201. The user can dismiss preferences con gets 303 can be viewed, previewed, selected and installed trols 3201 by clicking on Done button 3203 or on close box from a website, or from a configuration option within the 3202. In one embodiment, close box 3202 is a rollover icon, dashboard. In one embodiment, users can pay for widgets 303 so that it is only visible when the cursor is positioned over using a credit card or any other conventional means for online widget 1301A (although it continues to be visible when the 55 purchases. Widgets 303 are transmitted and installed on the cursor is moved over to close box 3202). In one embodiment, user's computer according to conventional means. In one when preferences controls 3201 are dismissed, a flip-over embodiment, widgets 303 are installed according to tech animation is again played, and the normal appearance of the niques describe in related U.S. Utility patent application Ser. widget is restored (reflecting any changes that were made via No. 10/874,829, for “User Interface for Assisting in the preferences controls 3201). 60 Installation of an Asset, filed Jun. 22, 2004, the disclosure of Referring now to FIG. 31, there is shown another example which is incorporated herein by reference. of a dashboard wherein some labels 2701A in configuration In one embodiment, widgets such as 801 are implemented bar 601 have changed in appearance, while other labels using HTML technology with enhancements that are more 2701B, 2701Care unchanged, according to one embodiment. fully described below and in the related cross-referenced Address book 1101, calculator 801, calendar 1801, music 65 applications. One skilled in the art will recognize, however, player 901, and stock quote widget 1901 are open, single that any graphics technology can be used for implementing instance widgets; therefore their corresponding labels 2701A widgets such as 801. US 8,291.332 B2 15 16 In one embodiment, widgets 303 are encrypted into a flat Fast login. In one embodiment, dashboard clients 302 are file that is expandable in memory, either in whole or in parts. launched and then rendered into a window from dashboard Widget 303 contents are indexed so that particular resources server 301. Since this can take some time, dashboard server can be accessed as needed. Widgets 303 may be encrypted 302 provides an initial image to be rendered in the window according to any conventional encryption technology. 5 while client 302 is launched, so as to improve visual feedback In one embodiment, clients 302 have complete control of and to make initial activation animation appear instanta resource loading of the WebView. When a relative resource is neous. As dashboard clients 302 load and render, they take requested, the client 302 converts the protocol to one specific over the window and draw their content. to the process. In one embodiment, the NSURL Protocol in Event management. In one embodiment, server 301 acts as Foundation is used to fetch data from the encrypted source. 10 an event server as well as a window server. Events come from Software Architecture the operating system window server to dashboard server 301 Referring now to FIG. 3, there is shown an example of a and are routed to the appropriate dashboard client 302. This software architecture 300 for implementing the present indirection allows for a variety of features, including: server invention according to one embodiment. In the embodiment, side dragging (even if a dashboard client 302 is hung); filter the present invention operates in connection with an operat 15 ing of events; insertion of server-generated events; and the ing system 109 as described above. like. Dashboard clients 302 communicate with server 301 to In one embodiment, software architecture 300 includes describe control regions, so that server 301 can initiate server dashboard server 301, dashboard client(s) 302, and widget(s) side drags correctly. 303. Dashboard configuration information 304 is used by Loading widgets 303. In one embodiment, server 301 is server 301 and/or clients 302 to specify the configuration responsible for loading widgets 303. It maintains the list of options for displaying widgets 303. All of the dashboard widgets 303 to load when starting up. In one embodiment, the configuration information, including access levels and the dashboard client 302 corresponding to a particular widget like (if applicable), is stored in dashboard configuration infor 303 is not launched until the first time the dashboard is acti mation 304. As described above, such information may vated. include dashboard configuration information for two or more 25 Arbitration of widgets 303. In one embodiment, server 301 dashboards configured by the same user or by different users. is the arbitrator of dashboard clients 302. It controls the In one embodiment, widgets 303 are displayed using process and passes information to and from each widget 303. HTML and related web technology. Dashboard server 301 If a widget 303 crashes, dashboard server 301 re-launches the manages and launches dashboard client 302 processes. Each process automatically. It also prevents crash loops where a dashboard client 302 loads a widget 303, which in one 30 widget 303 crashes repeatedly at startup. In one embodiment, embodiment is an HTML webpage and related resources all communication to a widget 303 goes through dashboard needed to display the page. In one embodiment, a client 302 Server 301 first. is initiated for each widget 303 to be displayed. In one Corelmage integration. In one embodiment, server 301 embodiment, clients 302 display widgets 303 without a con uses Corelmage technology, as described in related U.S. Util ventional window frame, menu bar, or other components 35 ity patent applications cross-referenced above. Filters are typically associated with on-screen windows; this provides a applied to the background window of the server to provide clean, straightforward display of the overall dashboard that spotlight and ripple effects. avoids confusion and clutter. Clients 302 display widgets 303 Widget 303 preference management. In one embodiment, by rendering web pages into a “WebView'; the size of each server 301 stores, in configuration information 304 that is Web View is defined as metadata associated with the corre 40 stored according to a conventional file system, preferences sponding widget 303. Server 301 is a window server that associated with widgets 303, and vends those preferences to provides data for rendering a layer that can be overlaid on the widgets 303. normal desktop of the user interface. Widgets 303 are ren Dashboard Client 302 dered into the separate layer, and then that layer is drawn on In one embodiment, each client 302 is a lightweight pro top of the normal desktop, so as to partially or completely 45 cess that uses, for example, objects defined as part of a devel obscure the desktop while the dashboard is active. opment environment Such as Cocoa Application Framework Dashboard Server 301 (also referred to as the Application Kit, or AppKit), described Dashboard server 301 is a lightweight process that can for example at Mac OS X Panther Release Notes Cocoa stand alone or be imbedded in another process. Server 301 Application Framework, available at “http://developer.apple can be located at computer 102, or at remote server 107. 50 .com/documentation/ReleaseNotes/Cocoa/AppKit.html). Server 301 provides the following functionality: Clients 302 can be implemented as simplified browser Non-widget UI. In one embodiment, server 301 handles screens that omit conventional interface features such as a user interface functionality that is not directly related to wid menu bar, window frame, and the like. In one embodiment, gets. This includes, for example: activation; deactivation; clients 302 provide the following functionality in implement dashboard background; background animations; and the like. 55 ing the present invention: Window management. In one embodiment, server 301 acts Control of the Web View. Client 302 creates a WebView and as a lightweight window server for the dashboard client 302 attaches the HTML of widget 303 to the WebView. Client 302 processes. Windows are created in server 301 process and acts as the delegate for user interface requests made by the then passed to dashboard clients 302. Operations performed Web View. In one embodiment, client 302 overrides much of on windows go through dashboard server 301. Such opera 60 AppKit's default behavior as it regards to communication to tions include, for example: resizing; moving; fetching of server 301 and event handling. WebViews are generic con position and size; and the like. One advantage to having trols for viewing and manipulating HTML and XHTML; they window operations pass through server 301 is that server 301 are described, for example, at WebKit Reference for Objec can then react to widget 303 changes and update the overall tive-C, available at “http://developer.apple.com/documenta environment. For example, server 301 can cause displayed 65 tion/Cocoa/Reference/WebKit/ObjC classic/index.html. widgets 303 to bounce off of each other, stick to sides of the JavaScript extensions. In one embodiment, client 302 screen, Snap to grids, or the like. inserts a custom object in the JavaScript runtime of the Web US 8,291.332 B2 17 18 View. This allows for a variety of extensions for widgets 303, My.html can reference any other local resource as well. In including without limitation: copy/cut/paste; getting/setting one embodiment, the resources are specified relative to the preferences; notifications when preferences have changed; HTML file’s location. opening a linked application (for example, a widget 303 may My.png can have any name, based on the “Defaultimage' include a button or other trigger that causes a corresponding key in the Info.plist. This image is rendered by server 301 if application to be launched); quitting; moving/resizing; and there is no cached representation. the like. The English.lproi and other localizable directories are for Managing Plug-ins. Some widgets 303 use native code as localizable strings. part of their implementations. In one embodiment, client 302 Widget 303 Location includes the capability to interface with such native code 10 In one embodiment, widgets 303 are stored locally in stor and/or with databases and data stores available locally or age device 106 such as a hard drive. Per-machine widgets 303 remotely. In one embodiment, widgets 303 also have the are stored at, for example: ability to create a custom AppKit NSView. A widget devel /Library/Widgets/ oper can use a custom view to enable other types of anima 15 /Applications/Widgets/ tions, such as OpenGL views, plug-ins such as Flash, and the Widgets 303 can also be made available on aper-user basis, like. particularly in situations where more than one user uses the In one embodiment, plug-ins are implemented as follows. same computer 102. Per-user widgets 303 are stored, for An Obj-C bundle is loaded from a resources folder associated example, at: with widget 303. The bundle has two methods on its Principal ~/Widgets Class: ~/Library/Widgets/ -(id) initWithWebView:(WebView)webview: One skilled in the art will recognize that these configura -(void) windowScriptObject Available:(WebScriptOb tions are merely exemplary, and that any other file format or ject)windowScriptObject (this allows the plugin to add directory structure can be used. JavaScript extensions before the web page has loaded). 25 Widget 303 Development initwith WebView is called when the Dashboard Client In one embodiment, widgets 303 can be developed using starts up, and webViewLoaded is called when the page fin WebKit, described, for example, at Web Kit Reference for ishes loading. The developer of a plug-in can use the Web Objective-C, available at “http://developer.apple.com/docu Kit's scripting APIs to extend the JavaScript for a particular mentation/Cocoa/Reference/WebKit/ObjC classic/in widget 303. 30 dex.html. Additional functionality can also be provided, Such as the ability to drag to and from web pages, detect Widget 303 Format control regions, stop plug-ins and timers from firing when the In one embodiment, each widget 303 is implemented as an dashboard is hidden, and the like. In one embodiment, such HTML file. The HTML file can reference other local and additional functionality is provided using an enhanced Can remote resources such as style sheets, other HTML files, 35 was architecture, as described in related U.S. Provisional JavaScript files, images, and the like. Widgets 303 can be patent application 60/583,125, for “Procedurally Expressing implemented using, for example, a flatbundle file format or a Graphic Objects for Web Pages.” filed Jun. 25, 2004, the packaged HTML file format. disclosure of which is incorporated herein by reference. In Flat Bundle. The Flat Bundle format has the following addition, web extensions that are well known in the art can be directory structure: 40 used for providing additional functionality Such as drag-and My widget (directory/Bundle) drop capability, detection of control regions, and the like. Info.plist (file) For widgets that involve additional, more detailed render My.html (file) ing than is available from WebKit/HTML, a In the Claims In Claim 46, column 29, line 20, delete “of is and insert -- is --. Signed and Sealed this Seventeenth Day of June, 2014 74-4-04- 2% 4 Michelle K. Lee Deputy Director of the United States Patent and Trademark Office UNITED STATES PATENT AND TRADEMARK OFFICE CERTIFICATE OF CORRECTION PATENT NO. : 8,291,332 B2 Page 1 of 1 APPLICATIONNO. : 12/343140 DATED : October 16, 2012 INVENTOR(S) : Imran A. Chaudhri et al. It is certified that error appears in the above-identified patent and that said Letters Patent is hereby corrected as shown below: In the Claims In Claim 46, column 28, line 20, delete “of is and insert -- is --. This certificate supersedes the Certificate of Correction issued June 17, 2014. Signed and Sealed this Fifteenth Day of July, 2014 74-4-04- 2% 4 Michelle K. Lee Deputy Director of the United States Patent and Trademark Office