Processor Position 206' Sensor 208' Sensor
Total Page:16
File Type:pdf, Size:1020Kb
US 20070282564Al (19) United States (12) Patent Application Publication (10) Pub. No.: US 2007/0282564 A1 Sprague et al. (43) Pub. Date: Dec. 6, 2007 (54) SPATIALLY AWARE MOBILE PROJECTION (60) Provisional application No. 60/742,638, ?led on Dec. 6, 2005. (75) Inventors: Randall B. Sprague, Carnation, WA (US); Joshua O. Miller, Woodinville, Publication Classi?cation WA (US); David E. Lashmet, Bainbridge Island, WA (US); Andrew (51) Int. Cl. T. Rosen, LynnWood, WA (US) G01P 13/00 (2006.01) G01C 9/00 (2006.01) Correspondence Address: G01P 15/00 (2006.01) MICROVISION, INC. G01P 15/14 (2006.01) 6222 185TH AVENUE NE (52) U.S. c1. ......................... ..702/141; 702/127; 702/150 REDMOND, WA 98052 (US) (73) Assignee: MICROVISION, INC., Redmond, WA (Us) (57) ABSTRACT (21) Appl. No.: 11/761,908 A spatially aWare apparatus includes a projector. Projected (22) Filed: Jun. 12, 2007 display contents can change based on the position, motion, or orientation of the apparatus. The apparatus may include Related US. Application Data gyroscope(s), accelerometer(s), global positioning system (GPS) receiver(s), radio receiver(s), or any other devices or (63) Continuation-in-part of application No. 11/635,799, interfaces that detect, or provide information relating to, ?led on Dec. 6, 2006. motion, orientation, or position of the apparatus. 104 K PROCESSOR PROJECTOR 102-’ H POSITION 230 206’ SENSOR \ f 200 OTHER OUTPUTS IVIOTION 208’ SENSOR 220 \ OTHER ORIENTATION INPUTS 210" SENSOR Patent Application Publication Dec. 6, 2007 Sheet 1 0f 12 US 2007/0282564 A1 SPATIALLYAWARE H PROJECTOR / IMAGE PROCESSOR \ x \ X 102 104 106 [100 FIG. 1 10\4 PROCESSOR PROJECTOR / 102/ <‘;—:> \ I POSITION 230 206 SENSOR <1: \ [200 OTHER ID OUTPUTS NOT/ON 208’ SENSOR <1: 28 OTHER 1 ORIENTATION <;|I[> INPUTS 210 SENSOR FIG. 2 Patent Application Publication Dec. 6, 2007 Sheet 2 0f 12 US 2007/0282564 A1 102 I 04 \ PROCESSOR :: D PROJECTOR WIRELESS I300 INTERFACE <—_ X 310 FIG. 3 102 104 \ PROCESSOR PROJECTOR WIRED 1-400 INTERFACE T1 \ 410 FIG. 4 Patent Application Publication Dec. 6, 2007 Sheet 3 0f 12 US 2007/0282564 A1 8% Em: / E: NE/ Sn8%8m fr.I1 8Q#555%SE moSmBmmmommmuomm05g. mesammom<zuxoqmammlmwm?mE SE85?‘EH5 dmwmwwmmwmEmEmmawEEmmowzmm f/f gm Emgm8m URNw @353mw<§E5:Egon‘82%:mu?mmcgE /mwé?m?ggmm 382%EEOEmm2:3E 51.50/ 50%: 512‘ XS“ Patent Application Publication Dec. 6, 2007 Sheet 4 0f 12 US 2007/0282564 A1 c: /coC: / FIG.6 Patent Application Publication Dec. 6, 2007 Sheet 5 0f 12 US 2007/0282564 A1 @E UPTNm SN NE f ME Patent Application Publication Dec. 6, 2007 Sheet 6 0f 12 US 2007/0282564 A1 / 808 805%) ./'805 f f 803 FIG. 8 Patent Application Publication Dec. 6, 2007 Sheet 7 0f 12 US 2007/0282564 A1 3 904 g 905 906 907 909 2 S / 910 / / 900\ 908 902 903 903 901 \ r? | ’ | | ’ | FIG. 9 1000 / 10210 / |— w z \ 900 H FIG. 10 Patent Application Publication Dec. 6, 2007 Sheet 8 0f 12 US 2007/0282564 Al f E: f S: f 8: 8: 8: 8: 88: Patent Application Publication Dec. 6, 2007 Sheet 9 0f 12 US 2007/0282564 A1 Q “ESQwzimg- @ @$8 Q\\Q\ <m/R @M0555 >N Tee N\GEN / as ,f asgs r as f as X88 Patent Application Publication Dec. 6, 2007 Sheet 10 0f 12 US 2007/0282564 Al 32 \ :2 \ / MN65% IN: UH : a:as xw 32as22 s2asa:a: a:82e2 r 95 Patent Application Publication Dec. 6, 2007 Sheet 11 0f 12 US 2007/0282564 A1 EIE E25 isoegm %soegm 32538¢ 85885 QEQESx3 $2 5.638A? m9: / a:a: D,\J 30G a:a: 09:Al Av000000 Patent Application Publication Dec. 6, 2007 Sheet 12 0f 12 US 2007/0282564 A1 RECEIVE SPATIAL INFORMATION DESCRIBING POSITION, MOTION, AND/OR 1-1510 ORIENTATION OF A MOBILE PROJECTOR RECEIVE OTHER INPUT DA TA GENERA TE OR MODIFYA PROJECTED IMAGE BASED ATLEAST IN PART ON THE f 1530 SPATIAL INFORMATION PROVIDE OUTPUTIN ADDITION TO THE 1'1540 IMAGE 1500 FIG. 15 US 2007/0282564 A1 Dec. 6, 2007 SPATIALLY AWARE MOBILE PROJECTION structure, or characteristic described herein in connection With one embodiment may be implemented Within other FIELD embodiments Without departing from the spirit and scope of [0001] The present invention relates generally to projec the invention. In addition, it is to be understood that the tion devices, and more speci?cally to mobile projection location or arrangement of individual elements Within each devices. disclosed embodiment may be modi?ed Without departing from the spirit and scope of the invention. The folloWing BACKGROUND detailed description is, therefore, not to be taken in a limiting sense, and the scope of the present invention is de?ned only [0002] Projection systems are commonly in use in busi by the appended claims, appropriately interpreted, along ness environments and in multimedia entertainment sys With the full range of equivalents to Which the claims are tems. For example, desktop projectors are noW popular for entitled. In the draWings, like numerals refer to the same or sales and teaching. Also for example, many public theatres similar functionality throughout the several vieWs. and home theatres include projection devices. As With many other electronic devices, projectors are shrinking in siZe, [0019] FIG. 1 shoWs a spatially aWare mobile projection their poWer requirements are reducing, and they are becom apparatus. Mobile projection apparatus 100 includes projec ing more reliable. tor 104 and processor 102. Projector 104 projects an image 106. Processor 102 has information relating to the spatial BRIEF DESCRIPTION OF THE DRAWINGS position, orientation, and/or motion of apparatus 100, and is referred to as being “spatially aWare.” The term “spatially [0003] FIG. 1 shoWs a spatially aWare mobile projection aWare” describes access to any information relating to system; spatial characteristics of the apparatus. For example, as [0004] FIG. 2 shoWs a spatially aWare mobile projector described above, a spatially aWare processor Within an system With various input systems and output systems; apparatus may have access to information relating to the position, motion, and/or orientation of the apparatus. [0005] FIG. 3 shoWs a spatially aWare mobile projection system With a Wireless interface; [0020] Projector 104 may change the projected image in response to information received from processor 102. For [0006] FIG. 4 shoWs a spatially aWare mobile projection example, processor 102 may cause projector 104 to modify system With a Wired interface; the image in response to the current position of apparatus [0007] FIG. 5 shoWs a spatially aWare mobile projection 100. Further, processor 102 may cause projector 104 to system; modify the image in response to motion of the apparatus. Still further, processor 102 may cause projector 104 to [0008] FIG. 6 shoWs a micro-projector; modify the image in response to a current orientation or [0009] FIG. 7 shoWs a spatially aWare gaming apparatus; change in orientation of the apparatus. In some scenarios, processor 102 may recogniZe the spatial information Without [0010] FIG. 8 shoWs a communications device With a changing the image. For example, processor 102 may spatially aWare mobile projector; change the image in response to spatial information after a [0011] FIG. 9 shoWs a spatially aWare mobile projection delay, or may determine Whether to change the image in system used as a sports teaching tool; response to spatial information as Well as other contextual information. [0012] FIG. 10 shoWs a system that includes both ?xed and mobile projectors; [0021] Processor 102 may obtain spatial information and therefore become spatially aWare in any manner. For [0013] FIG. 11 shoWs a spatially aWare mobile projection example, in some embodiments, apparatus 100 may include system used as a medical information device; sensors to detect position, motion, or orientation. Also for [0014] FIG. 12 shoWs a spatially aWare mobile projection example, the position/motion/orientation data may be pro system used as an aid to navigation; vided to apparatus 100 through a Wired or Wireless link. These and other embodiments are further described beloW [0015] FIG. 13 shoWs a spatially aWare mobile projection With reference to later ?gures. system having an appendage With a projection surface; [0022] In some embodiments, processor 102 provides [0016] FIG. 14 shoWs a vehicular mobile projection sys image data to projector 104, and changes it directly. In other tem; and embodiments, image data is provided by a data source other [0017] FIG. 15 shoWs a ?owchart in accordance With than processor 102, and processor 102 indirectly in?uences various embodiments of the present invention. projector 104 through interactions With the image data source. Various embodiments having various combinations DESCRIPTION OF EMBODIMENTS of image data sources are described further beloW With reference to later ?gures. [0018] In the folloWing detailed description, reference is made to the accompanying draWings that shoW, by Way of [0023] Projector 104 may be any type of projector suitable illustration, speci?c embodiments in Which the invention for inclusion in a mobile apparatus. In some embodiments, may be practiced. These embodiments are described in projector 104 is a small, light, battery-operated projector. su?icient detail to enable those skilled in the art to practice For example, projector 104 may be a micro-electro mechani the invention. It is to be understood that the various embodi cal system (MEMS) based projector that includes an elec ments of the invention, although different, are not necessar tromagnetic driver that surrounds a resonating aluminum ily mutually exclusive. For example, a particular feature, coated silicon chip. The aluminum coated silicon chip US 2007/0282564 A1 Dec. 6, 2007 operates as a small mirror (“MEMS mirror”) that moves on system 200.