USOO61.41034A United States Patent (19) 11 Patent Number: 6,141,034 McCutchen (45) Date of Patent: Oct. 31, 2000 54). IMMERSIVE IMAGING METHOD AND Lake Audio Directional Sound-Brochure 1995. APPARATUS Century Precision Optics Wide Angle Lenses Brochure. 75 Inventor: David McCutchen, Portland, Oreg. Tinsley Precision Optics Overview Brochure (1995). Zorin + Barr; "Correction of Geometric Perceptualp Distor 73) ASSignee: Immersive Media Co., Portland, Oreg. tion in Pictures” Siggraph 95 Proceedings (1995). Veldkampp + McHugh;9. "Binaryy Optics'Up Scien. Amer: May 21 Appl. No.: 08/572,785 1992 p. 92–7. 22 Filed: Dec. 15, 1995 Adaptive Optics Assoc. Lenslet Modules Brochure (1993). 51 Int. Cl." ............................ H04N 700. HoaN 1302. ASSorted Panoramic Cameras-B+H Catalog (1995). HO)4N 15/00 Sony Betacam SP Recorder BVW-50 Brochure (1995). 52 U.S. Cl. ................................................. 348/36; 348/48 Sony Control-L Keypad RM-95 (Xerox). 58) Field "F.S.", 25.15 3.s: Steadicam Jr. Camera Mount-B+H Brochure (1996). 159, 153–155,214; 350/502; 352/70; 354/94; JVC GR-DVI DVC Camcorder Brochure (1996). 395/119, 125; 386/15, 37, 38, 106 (List continued on next page.) 56) References Cited Primary Examiner Dang Ton U.S. PATENT DOCUMENTS ASSistant Examiner David R. Vincent 4,798.448 1/1989 Van Raalte .............................. 350/345 57 ABSTRACT 4.885,878 12/1989 Wulu .............................................. 52/6 4,962,420 10/1990 Judenich ................................... 358/60 Improvements in the production means for dodecahedral E. 6/1991 Mitchen - - - - i.231 imaging are described, to define a simple, flexible and 130,794 7/1992 Ritchey.................................. 358/87 efficient Strategy for the creation of extremely wide images. 5,495,576 2/1996 Ritchey ................................... 395/125 Improvements in production technology include lenses and OTHER PUBLICATIONS optical mounts that enable automatic alignment of film and Video cameras and other imaging devices to cover multiple A coding Scheme for Stereoscopic television Sequences, B. fields of view equal to one, two or three dodecahedral Choquet et al.Image Processing, p188-192, Apr. 7, 1995. pentagons. Three double-pentagon formats, X, P and O, are Y.P. Chen, “Landscape Generation: A Changing Perspec described in detail, the X format producing an even hemi tive” Reprinted From ESD, Feb. 1988. spherical division and a full spherical view, and the Pformat Seos Prodas Spherical Screen Components-Brochure producing simplified coverage of most of a sphere and ease 1995. of use for Stereoscopic effects, and the O based on the Kodak DCS Digital Camera Brochure 1994. combination of the dodecahedron and the octahedron. A Canon RC-570 Still Video Camera-Brochure 1994. triple-pentagon T format based on the use of the tetrahedron Nikkor 15mm Lens Picture-From Brochure 1995. is also described, along with crisscroSS optics and temporal Sagebrush Motorized Gimbals and Mounts-Brochure offset mounts to minimize parallax differences between the 1995. Separate camera ViewS. Standard cropping mattes for Kenko Wide-Angle Adaptor Lens-Brochure 1994. dodecahedral images are given, and compressed Storage Chinon CX-062 Camera Description-Brochure 1994. methods are Suggested for a more efficient distribution of Sony Progressive-Scan IC Announcement-1995. dodecahedral images in a variety of media. Crystal River Audio Description of Directional Sound 1995. 25 Claims, 76 Drawing Sheets 38 138 328 328 6,141,034 Page 2 OTHER PUBLICATIONS Critchley et al. “Picture Quality in Large Screen Projectors Using The Digital Multimirror Devices” S.I.D. 1995 Intl. Kaiser “A New View of The World” (Peters Projection) pp. Symposium Preprint pp. 1-4. 4-11. Hoffner “Digital ATV Arrives-Finally!" TV Technology “Miniature CRT For Virtual Reality” Photonics Spectra Dec. Dec. 1995, p. 43. 1994 p. 50,52. Stephenson “Networked Large Image Archives' Advanced Tektronix SGS60 Stereotek MKII Active Stereoscopic Imaging Jan. 1993 p. 14,16,18. Glasses-Brochure (1992). Sharp XV-P10U Video Projector Brochure (1992). Sony LCX007AK LCD Panel Announcement (1994). Hughes JVC 335s Lightvalve Projector-Brochure (1995). Cermax Xenon Lamps-Brochure (1995). Sound Advance Speaker Systems-Brochure (1994). U.S. Patent Oct. 31, 2000 Sheet 1 of 76 6,141,034 U.S. Patent Oct. 31, 2000 Sheet 2 of 76 6,141,034 Edge Point Ceriter Half of Edge Complete Cross Section Pentagon Dodecahedron Intersphere Radius Base Center U.S. Patent Oct. 31, 2000 Sheet 3 of 76 6,141,034 22 enSN U.S. Patent Oct. 31, 2000 Sheet 4 of 76 6,141,034 U.S. Patent Oct. 31, 2000 Sheet S of 76 6,141,034 U.S. Patent Oct. 31, 2000 Sheet 6 of 76 6,141,034 FiO. 12 !== OCO U.S. Patent Oct. 31, 2000 Sheet 7 of 76 6,141,034 U.S. Patent Oct. 31, 2000 Sheet 8 of 76 6,141,034 -26.5659 U.S. Patent Oct. 31, 2000 Sheet 9 of 76 6,141,034 U.S. Patent Oct. 31, 2000 Sheet 10 of 76 6,141,034 U.S. Patent Oct. 31, 2000 Sheet 11 Of 76 6,141,034 3O2 U.S. Patent Oct. 31, 2000 Sheet 12 of 76 6,141,034 Fig. 21 312-N-f - 316 U.S. Patent Oct. 31, 2000 Sheet 13 of 76 6,141,034 U.S. Patent Oct. 31, 2000 Sheet 14 Of 76 6,141,034 368 U.S. Patent Oct. 31, 2000 Sheet 15 Of 76 6,141,034 U.S. Patent Oct. 31, 2000 Sheet 16 of 76 6,141,034 U.S. Patent Oct. 31, 2000 Sheet 17 of 76 6,141,034 U.S. Patent Oct. 31, 2000 Sheet 18 of 76 6,141,034 U.S. Patent Oct. 31, 2000 Sheet 19 of 76 6,141,034 U.S. Patent Oct. 31, 2000 Sheet 20 Of 76 6,141,034 16 N U.S. Patent Oct. 31, 2000 Sheet 21 of 76 6,141,034 U.S. Patent Oct. 31, 2000 Sheet 22 of 76 6,141,034 Ne 1N Fig44 378 Fig43 as ". U.S. Patent Oct. 31, 2000 Sheet 23 of 76 6,141,034 5OO 506 U.S. Patent Oct. 31, 2000 Sheet 24 of 76 6,141,034 U.S. Patent Oct. 31, 2000 Sheet 25 of 76 6,141,034 U.S. Patent Oct. 31, 2000 Sheet 26 of 76 6,141,034 U.S. Patent Oct. 31, 2000 Sheet 27 Of 76 6,141,034 U.S. Patent 6,141,034 U.S. Patent Oct. 31, 2000 Sheet 29 of 76 6,141,034 Direction of travel Five camera Ten camera U.S. Patent Oct. 31, 2000 Sheet 30 Of 76 6,141,034 U.S. Patent Oct. 31, 2000 Sheet 31 of 76 6,141,034 Fig. 62 PentaramaTM Fig. 63 66 XodoxTM-S U.S. Patent Oct. 31, 2000 Sheet 32 Of 76 6,141,034 U.S. Patent Oct. 31, 2000 Sheet 33 of 76 6,141,034 U.S. Patent Oct. 31, 2000 Sheet 34 of 76 6,141,034 728 734 U.S. Patent Oct. 31, 2000 Sheet 35 of 76 6,141,034 MONITOR 764 760 Fig. 70 SELECT MONITOR 764 MONITOR 774 748 754 U.S. Patent Oct. 31, 2000 Sheet 36 of 76 6,141,034 U.S. Patent Oct. 31, 2000 Sheet 37 of 76 6,141,034 U.S. Patent Oct. 31, 2000 Sheet 38 0f 76 6,141,034 U.S. Patent Oct. 31, 2000 Sheet 39 of 76 6,141,034 840 Central Pentagon Outside Pentagon Area (encoded) 834 Fig. (6 U.S. Patent Oct. 31, 2000 Sheet 40 of 76 6,141,034 U.S. Patent Oct. 31, 2000 Sheet 42 of 76 6,141,034 U.S. Patent Oct. 31, 2000 Sheet 43 of 76 6,141,034 - Fig.65A 946 i. 926 N U.S. Patent Oct. 31, 2000 Sheet 44 Of 76 6,141,034 e 3 926 U.S. Patent Oct. 31, 2000 Sheet 45 of 76 6,141,034 SAIMW2 in Hi Hill. At TINT-24AAA I L IN L, A \ \ \ . | | | | | | NHL 1 \\ 1 \ . TTTI SN-24A A \ \\ 970 if I TSN41.OOaxablessee Hitt A. U.S. Patent Oct. 31, 2000 Sheet 46 of 76 6,141,034 U.S. Patent Oct. 31, 2000 Sheet 47 0f 76 6,141,034 494 504 U.S. Patent Oct. 31, 2000 Sheet 48 of 76 6,141,034 III U.S. Patent Oct. 31, 2000 Sheet 49 of 76 6,141,034 Fig.99 1052 FIVE PENTAGONS IN 4:3 ASPECTRATIO 1050 1056 1064 1060 -6-- SEOUENCE OF TEN SPREAD PENTAGONS Fig OO WITH MOVABLE4:3 WINDOW U.S. Patent Oct. 31, 2000 Sheet 50 of 76 6,141,034 1 O 8O U.S. Patent 6,141,034 U.S. Patent Oct. 31, 2000 Sheet 53 of 76 6,141,034 904 1096 V a w W W. M. he us was an - - - - - - a own an is as a a M -- W 1 N ----- M W M - - - w M U.S. Patent Oct. 31, 2000 Sheet 54 of 76 6,141,034 EYE WEWS M N w N N N w N a y M M. M y M P M M M w M w M w M C W Y A. N A. 1118 ' N N /YM - 1 1. v. M ... ', al M / / Y V V V M w M s V LEFT EYE RIGHT EYE 1116 U.S. Patent Oct. 31, 2000 Sheet 55 0f 76 6,141,034 Fig.110 1122 Figll Fig 12 1154. - - - - 1150 U.S. Patent Oct. 31, 2000 Sheet 56 of 76 6,141,034 Fig. 113A 1172 A - 170 1176N 9 RN it." H 1174. 18O 1182 U.S. Patent Oct. 31, 2000 Sheet 57 Of 76 6,141,034 U.S.