USOO9547468B2 (12) United States Patent (10) Patent No.: US 9,547.468 B2 Yen et al. (45) Date of Patent: Jan. 17, 2017 (54) CLIENT-SIDE PERSONAL VOICE WEB G06F 3/04842; G06F 17/30899; G10L NAVIGATION 15/265 See application file for complete search history. (71) Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC, Redmond, WA (56) References Cited (US) U.S. PATENT DOCUMENTS (72) Inventors: Cheng-Yi Yen, Redmond, WA (US); 5,893,063 A * 4/1999 Loats ...................... G1 OL15, 26 Derek Liddell, Kent, WA (US); 704/27O Kenneth Reneris, Clyde Hill, WA 7,653,544 B2 * 1/2010 Bradley ................. G06Q 50/01 (US); Charles Morris, Seattle, WA TO4,260 (US); Dieter Rindle, Klosterlechfeld (Continued) (DE); Tanvi Surti, Seattle, WA (US); Michael Stephens, Seattle, WA (US); OTHER PUBLICATIONS Eka Tjung, Redmond, WA (US) Viticci, Federico , "Coming Soon: i Phone Voice Control for (73) Assignee: MICROSOFT TECHNOLOGY Everything MacStories'. Published on: Jan. 30, 2011, Available LICENSING, LLC, Redmond, WA at: http://www.macstories.net/iphone/coming-Soon-iphone-voice (US) control-for-everything? (4 pages total). (Continued) (*) Notice: Subject to any disclaimer, the term of this patent is extended or adjusted under 35 Primary Examiner — Maryam Ipakchi U.S.C. 154(b) by 137 days. (74) Attorney, Agent, or Firm — Miia Sula; Judy Yee; Micky Minhas (21) Appl. No.: 14/231,570 (57) ABSTRACT (22) Filed: Mar. 31, 2014 A system running on a mobile device such as a Smartphone is configured to expose a user interface (UI) to enable a user (65) Prior Publication Data to specify web pages that can be pinned to a start screen of US 2015/0277846 A1 Oct. 1, 2015 the device. Once pinned, the user may launch a web page by voice command from any location on the UI or from within (51) Int. Cl. any experience that is currently being Supported on the G06F 3/16 (2006.01) device. Thus, the user can be on a call with a friend talking G06F 3/04 (2006.01) about a new video game and then use a voice command to launch a web browser application on the mobile device that (Continued) navigates to a pinned web page having information about the (52) U.S. Cl. game's release date. Web pages can be readily pinned and CPC ................. G06F 3/16 (2013.01); G06F 3/041 unpinned from the start screen through the UI. When a web (2013.01); G06F 3/04817 (2013.01); page is unpinned from the start Screen, the system disables (Continued) Voice web navigation for it. (58) Field of Classification Search CPC ........ G06F 3/16; G06F 3/041: G06F 3/04817; 15 Claims, 11 Drawing Sheets 5 OO Use invokes we towserto navigate to webpage 505 of interest System exposes a control to enable user to pin current webpage to start screen User invokes pinning control System applies name to token for web page or 520 user provides name 548 525 System pins web page token to start screen 550 System exposes a control to enable user to unpin 555 530 webpage from start screen System unpinstremoves web page token from mode is optionally implemented, 560 535 start screen responsively to user input System disables voice web navigation 54 for umpinned webpage US 9,547.468 B2 Page 2 (51) Int. Cl. 2014/0274211 A1* 9/2014 Sejnoha ............ HO4M 1/72519 G06F 3/048 (2013.01) 455,563 G06F 3/0484 (2013.01) 2014/0278419 A1* 9, 2014 Bishop . G06F 3/16 TO4,249 GIOL I5/26 (2006.01) 2014/0343950 A1* 11/2014 Simpson ................. GO6F 3/167 G06F 7/30 (2006.01) 704/275 (52) U.S. Cl. CPC. G06F 3/04842 (2013.01); G06F 17/30899 OTHER PUBLICATIONS (2013.01); G 10L 15/265 (2013.01) EightForums, "Start Screen Pin or Unpin App, Folder, or Drive in Windows 8”. Published Sep. 15, 2011, Available at http://www. (56) References Cited eightforums.com/tutorials/2352-start-screen-pin-unpin-app-folder drive-windows-8-a.html (10 pages total).* U.S. PATENT DOCUMENTS Staff, Appleinsider, “Websites Activating Safari Push Notifications Ahead of OS X Mavericks Rollout', Published on: Oct. 21, 2013, 8,423,911 B2 * 4/2013 Chaudhri ............ GO6F 3,04817 Retrieved from: http://appleinsider.com/articles/13/10/22/websites 71.5/765 activating-Safari-push-notifications-ahead-of-os-X-mavericks-roll 9,015,584 B2 * 4/2015 Park ...................... G06F 3.0488 out Retrieved Date: May 1, 2014 (2 pages total). 715/702 “International Search Report and Written Opinion Issued in PCT 2004/0054539 A1* 3/2004 Simpson ................. G1 OL15.30 Patent Application No. PCT/US2015/022603, Mailed Date: Jun.9, TO4/270.1 2015, (8 Pages total) (MSH 341424.02). 2005/0143975 A1* 6/2005 Charney ............. G1OL 15.26 Benton, Joshua, “Now Websites can send Push Notifications—Not TO4,201 Just Apps'. Published on: Jun. 2013, Avaiable at: http://www. 2007/0033054 A1* 2/2007 Snitkovskiy ... GO6F 3/167 niemanlab.org/2013/06/now-websites-can-Send-push-notifications 704/275 2009/0106704 A1* 4/2009 De Leon ............... G06F 3,0238 not-just-apps (5 pages total). 715,847 Dilger, Daniel Eran, “Safari 7.0 to Bring Web Notifications to OS 2009/0178006 A1* 7/2009 Lemay ............. GO6F 3,04817 X Mavericks'. Published on Jun. 28, 2013, Available at: http:// 715.835 appleinsider.com/articles/13/06/28/safari-70-to-bring-web-notifica 2010/0105364 A1* 4/2010 Yang ................. GO6F 17,30663 tions-to-os-X-mavericks (5 pages total). 455,414.1 Armstrong, et al., “Efficient and Transparent Dynamic Content 2011 0138287 A1* 6, 2011 Katsuranis .............. G06F 3,011 Updates for Mobile Clients'. In Proceedings of the 4th International 71.5/728 Conference on Mobile Systems, Applications and Services, Jun. 19. 2011/0307794 A1 12/2011 Hiero et al. 2006, (13 pages total). 2011/0307883 A1* 12/2011 Hillerio .................. GO6F 3.0481 Tyrsina, Radu, “Firefox Web Browser will Get a Push Notification 717/176 System”. Published on: Feb. 7, 2012, Available at: http:// 2012/00 16678 A1 1/2012 Gruber ................ GO6F 17,3087 thetechjournal.com/internet/firefox-Web-browser-will-get-a-push 704/275 notification-system.xhtml (4 pages total). 2012/0089392 A1* 4/2012 Larco .................... G1OL 15,063 Lalmalani, Rahul, "Pinned Sites in Windows 8: Getting more TO4,231 visibility of your site'. Published on: Jan. 21, 2013, Available at: 2012/0150546 A1* 6/2012 Cheng ..................... GO6F 3/167 http://www.codeproject.com/Articles/530445/Pinned-Sites-in-Win 704/275 dows-8-Getting-more-visibility (5 pages total). 2012/0209608 A1* 8, 2012 Lee ......................... G1 OL15/22 “Internet Explorer on Windows 8.1: One browser, two Experi 704/246 ences'. Published on: Nov. 13, 2013, Available at: http://msdn. 2013,0031486 A1 1/2013 Schultz et al. microsoft.com/en-us/library/ie/hh771832(v= vs. 85).aspx (8 pages 2013/0219277 A1* 8/2013 Wang ...................... GO6F 3/167 71.5/728 total). 2013/0325484 A1* 12/2013 Chakladar ............... GO6F 3/167 "Second Written Opinion Issued in PCT Application No. PCT/ 704/275 US2015/022603”. Mailed Date: Feb. 26, 2016, (6 Pages total) (MSH 2013/0347094 A1* 12/2013 Bettini ................ HO4L 63,0227 341424.02). T26/11 Agar, Colt, “How to Pin Your Favorite Websites to Your iPhone's 2014/0040746 A1 2/2014 Reich ...................... GO6F 3/167 Home Screen'. Retrieved from <<http://thetechreviewer.com/tech 71.5/728 tipspin-favorite-Websites-iphones-home-screen/?singlepage=1D->. 2014/0040748 A1* 2/2014 Lemay .................... GO6F 3/167 May 24, 2013, (8 Pages total). 71.5/728 “International Preliminary Report on Patentability Issued in PCT 2014/0173521 A1* 6/2014 Mayor .............. HO4M 1/72519 Application No. PCT/US2015/022603”. Mailed Date: Jun. 2, 2016, 715.835 7 Pages. (MSH 341424.02). 2014/0222436 A1* 8, 2014 Binder .................... GO6F 3/167 704/275 * cited by examiner U.S. Patent US 9,547.468 B2 “GOL I{DIH U.S. Patent US 9,547.468 B2 | pueuuLuOO GOZ Z€).I.H. U.S. Patent Jan. 17, 2017 Sheet 3 of 11 US 9,547.468 B2 9|7 09#7 f75)IAI U.S. Patent US 9,547.468 B2 OZ9 U.S. Patent Jan. 17, 2017 Sheet 6 of 11 US 9,547.468 B2 5 3. S. E O X O (K) O 2 s co S. U.S. Patent Jan. 17, 2017 Sheet 8 of 11 US 9,547.468 B2 sæ6esseW f7IOIH (O) 0||7 U.S. Patent Jan. 17, 2017 Sheet 9 of 11 US 9,547.468 B2 U.S. Patent Jan. 17, 2017 Sheet 11 of 11 US 9,547.468 B2 FIG 18 1802 1820 110 Mobile device Non-removable Power supply memory 1882 1822 GPS receiver Removablance ACCelerometer 1884 1824 1886 Input/output ports Processor Physical connector 1880 1810 1890 Input device(s) Output device(s) Wireless modem 1830 1850 1860 Touchscreen Speaker Wi-Fi 1852 1862 MicrophoneE. Display Bluetooth 1854 1864 (G)() Camera 1836 Operating system Physical 1812 keyboard 1814 1838 Application 1. 1 8 O 4 Trackball 1840 Application Proximity Application sensor(s) 1842 US 9,547,468 B2 1. 2 CLIENTSIDE PERSONAL VOICE WEB below in the Detailed Description. This Summary is not NAVIGATION intended to identify key features or essential features of the claimed Subject matter, nor is it intended to be used as an aid BACKGROUND in determining the scope of the claimed Subject matter. Furthermore, the claimed subject matter is not limited to Mobile devices are leveraging new communication ser implementations that solve any or all disadvantages noted in vices on advanced mobile operator (MO) networks that any part of this disclosure. It will be appreciated that the provide voice and data services to Support rich user expe above-described Subject matter may be implemented as a riences such as website browsing over the Internet.