Multi-Tiered Voice Feedback in an Electronic Device
Total Page:16
File Type:pdf, Size:1020Kb
(19) TZZ¥Z __T (11) EP 3 026 541 A1 (12) EUROPEAN PATENT APPLICATION (43) Date of publication: (51) Int Cl.: 01.06.2016 Bulletin 2016/22 G06F 3/0482 (2013.01) (21) Application number: 16150079.8 (22) Date of filing: 01.09.2009 (84) Designated Contracting States: • BOETTCHER, Jesse AT BE BG CH CY CZ DE DK EE ES FI FR GB GR Cupertino, CA California 95014 (US) HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR (74) Representative: Gillard, Matthew Paul Withers & Rogers LLP (30) Priority: 05.09.2008 US 205780 4 More London Riverside London SE1 2AU (GB) (62) Document number(s) of the earlier application(s) in accordance with Art. 76 EPC: Remarks: 09792124.1 / 2 329 348 •Claims filed after the date of filing of the application (Rule 68(4) EPC). (71) Applicant: Apple Inc. •This application was filed on 04-01-2016 as a Cupertino, CA 95014 (US) divisional application to the application mentioned under INID code 62. (72) Inventors: •MASON,James Cupertino, CA California 95014 (US) (54) MULTI-TIERED VOICE FEEDBACK IN AN ELECTRONIC DEVICE (57) Thisinvention is directed toproviding voice feed- back features may be integrated in a Model View Con- back to a user of an electronic device. Because each troller (MVC) design used for displaying content to a user. electronic device display may include several speakable For example, the model and view of the MVC design may elements (i.e., elements for which voice feedback is pro- include additional variables associated with speakable vided), the elements may be ordered. To do so, the elec- properties. The electronic device may receive audio files tronic device may associate a tier with the display of each for each speakable element using any suitable approach, speakable element. The electronic device may then pro- including for example by providing a host device with a vide voice feedback for displayed speakable elements list of speakable elements and directing a text to speech based on the associated tier. To reduce the complexity engine of the host device to generate and provide the in designing the voice feedback system, the voice feed- audio files. EP 3 026 541 A1 Printed by Jouve, 75001 PARIS (FR) 1 EP 3 026 541 A1 2 Description in a predetermined order (e.g., based on tiers associated with each displayed object). Background of the Invention [0006] In some embodiments, a method, electronic de- vice, and computer readable media for providing voice [0001] This invention is directed to providing multi-5 feedback to a user of an electronic device may be pro- tiered voice feedback in an electronic device. vided. The electronic device may display several ele- [0002] Many electronic devices provide a significant ments and identify at least two of the elements for which number of features or operations accessible to a user. to provide voice feedback. The electronic device may The number of available features or operations may often determine a tier associated with the display of each of exceed the number of inputs available using an input10 the identified elements, where the tier defines the relative mechanism of the electronic device. To allow users to importance of each displayed element. The electronic access electronic device operations that are not specif- device may then provide voice feedback for the identified ically tied to particular inputs (e.g., inputs not associated elements in an order of the determined tiers, for example with a key sequence or button press, such as a MENU such that voice feedback is first provided for the most button on an iPod, available from Apple Inc.), the elec- 15 important element, and subsequently provided for the tronic device may provide menus with selectable options, next most important element until voice feedback has where the options are associated with electronic device been provided for each element. operations. For example, an electronic device may dis- [0007] In some embodiments, a method, electronic de- play a menu with selectable options on a display, for ex- vice, and computer readable media for providing audio ample in response to receiving an input associated with 20 feedback for displayed content may be provided. The the menu from an input mechanism (e.g., a MENU but- electronic device may direct a display to display several ton). elements, where speakable properties are associated [0003] Because the menu is typically displayed on an with at least two of the elements. The electronic device electronic device display, a user may be required to look may determine a tier associated with each of the at least at thedisplay to select aparticular option. This may some- 25 two elements and generate a queue that includes the at times not be desirable. For example, if a user desires to least two elements. The determined tiers may set the conserve power (e.g., in a portable electronic device), order of the elements in the generated queue. The elec- requiring the electronic device to display a menu and tronic device may direct an audio output to sequentially move a highlight region navigated by the user to provide speak each queue element in the order of the queue, a selection may use up power. As another example, if a 30 where the audio output includes voice feedback associ- user is in a dark environment and the display does not ated with each of the at least two elements. include back lighting, the user may not be able to distin- [0008] In some embodiments, a method, electronic de- guish displayed options of the menu. As still another ex- vice and computer readable media for speaking the text ample, if a user is blind or visually impaired, the user may of elements displayed by an electronic device may be not be able to view a displayed menu. 35 provided. The electronic device may display several el- [0004] To overcome this issue, some systems may ements with which speakable properties are associated. provide audio feedback in response to detecting an input The speakable properties may identify, for each element, from a user or a change in battery status, as described text to speak. The electronic device may display the sev- in commonly assigned U.S. Patent Publication No. eral elements in several views, where each view is as- 2008/0129520, entitled "ELECTRONIC DEVICE WITH 40 sociatedwith speakable order. The electronic devicemay ENHANCED AUDIO FEEDBACK" (Attorney Docket No. generate a queue that includes the several elements, P4250US1, which is incorporated by reference herein in where the order of the elements in the queue is set from its entirety. In some cases, the electronic device may the speakable order of each view (e.g., such that ele- provide voice feedback describing options that a user ments with a higher speakable order are at the beginning may select or operations that the user may direct the45 of the queue). The electronic device may wait for a first electronic device to perform. If several menus are simul- timeout to lapse and identify audio files associated with taneously displayed, or if a display includes different each of the elements of the queue. During the first time- modules or display areas (e.g., several views), the elec- out, the electronic device may modify audio playback to tronic device may have difficulty determining the objects make speech easier to hear and to prevent the electronic or menu options, or the order of objects or menu options, 50 device from speaking while a transaction is detected. The for which to provide a voice feedback. audio files may include the spoken speakable property text to speak for each element. The electronic device Summary of the Invention may sequentially play back the identified audio files in the order of the queue and pause for a second timeout. [0005] This invention is directed to systems and meth- 55 The second timeout may allow the electronic device to ods for providing multi-tiered voice feedback to a user. return audio playback to the pre-speaking configuration In particular, this invention is directed to providing voice (e.g., music playback). In some embodiments, the elec- feedback for several displayed objects (e.g., menu items) tronic device may receive the audio files from a host de- 2 3 EP 3 026 541 A1 4 vice that generates the audio files using a text to speech FIG. 14 is a flowchart of an illustrative process for engine from the speakable property text to speak for each providing static strings to an electronic device; and element. FIG. 15 is a flowchart of an illustrative process for providing dynamic strings to an electronic device. Brief Description of the Drawings 5 Detailed Description [0009] The above and other features of the present invention, its nature and various advantages will be more [0010] An electronic device operative to provide selec- apparent upon consideration of the following detailed de- tive voice feedback based on tiers associated with dis- scription, taken in conjunction with the accompanying 10 played options is provided. drawings in which: [0011] The electronic device may include a processor and a display. The electronic device may display any FIG. 1 is a schematic view of a electronic device in suitable information to the user. For example, a display accordance with one embodiment of the invention; may include a title bar, a menu with selectable options, FIG. 2 is a schematic view of an illustrative display 15 an information region for displaying information related screen having content for which voice feedback may to one or more options, information identifying media or be available in accordance with one embodiment of files available for selection, or any other suitable infor- the invention; mation.