DOCSLIB.ORG

Panoramic Image Mosaics

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Panoramic Image Mosaics Panoramic Image Mosaics Image Stitching Computer Vision CSE 576, Spring 2008 Full screen panoramas (cubic): http://www.panoramas.dk/ Richard Szeliski Mars: http://www.panoramas.dk/fullscreen3/f2_mars97.html Microsoft Research 2003 New Years Eve: http://www.panoramas.dk/fullscreen3/f1.html Richard Szeliski Image Stitching 2 Gigapixel panoramas & images Image Mosaics + + … + = Mapping / Tourism / WWT Medical Imaging Goal: Stitch together several images into a seamless composite Richard Szeliski Image Stitching 3 Richard Szeliski Image Stitching 4 Today’s lecture Readings Image alignment and stitching • Szeliski, CVAA: • motion models • Chapter 3.5: Image warping • Chapter 5.1: Feature-based alignment (in preparation) • image warping • Chapter 8.1: Motion models • point-based alignment • Chapter 8.2: Global alignment • Chapter 8.3: Compositing • complete mosaics (global alignment) • compositing and blending • Recognizing Panoramas, Brown & Lowe, ICCV’2003 • ghost and parallax removal • Szeliski & Shum, SIGGRAPH'97 Richard Szeliski Image Stitching 5 Richard Szeliski Image Stitching 6 Motion models What happens when we take two images with a camera and try to align them? Motion models • translation? • rotation? • scale? • affine? • perspective? … see interactive demo (VideoMosaic) Richard Szeliski Image Stitching 8 Image Warping image filtering: change range of image g(x) = h(f(x)) Image Warping f g h x x image warping: change domain of image g(x) = f(h(x)) f g h x x Richard Szeliski Image Stitching 10 Image Warping Parametric (global) warping image filtering: change range of image Examples of parametric warps: g(x) = h(f(x)) f g h image warping: change domain of image translation rotation aspect g(x) = f(h(x)) f g h perspective affine cylindrical Richard Szeliski Image Stitching 11 Richard Szeliski Image Stitching 12 2D coordinate transformations Image Warping translation: x’ = x + t x = (x,y) Given a coordinate transform x’ = h(x) and a rotation: x’ = R x + t source image f(x), how do we compute a similarity: x’ = s R x + t transformed image g(x’)=f(h(x))? affine: x’ = A x + t perspective: x’ ≅ H x x = (x,y,1) (x is a homogeneous coordinate) These all form a nested group (closed w/ inv.) h(x) xx’f(x) g(x’) Richard Szeliski Image Stitching 13 Richard Szeliski Image Stitching 14 Forward Warping Forward Warping Send each pixel f(x) to its corresponding Send each pixel f(x) to its corresponding location x’ = h(x) in g(x’) location x’ = h(x) in g(x’) • What if pixel lands “between” two pixels? • What if pixel lands “between” two pixels? • Answer: add “contribution” to several pixels, normalize later (splatting) h(x) h(x) xx’f(x) g(x’) xx’f(x) g(x’) Richard Szeliski Image Stitching 15 Richard Szeliski Image Stitching 16 Inverse Warping Inverse Warping Get each pixel g(x’) from its corresponding Get each pixel g(x’) from its corresponding location x’ = h(x) in f(x) location x’ = h(x) in f(x) • What if pixel comes from “between” two pixels? • What if pixel comes from “between” two pixels? •Answer: resample color value from interpolated (prefiltered) source image h(x) xx’f(x) g(x’) xx’f(x) g(x’) Richard Szeliski Image Stitching 17 Richard Szeliski Image Stitching 18 Interpolation Prefiltering Possible interpolation filters: Essential for downsampling (decimation) to • nearest neighbor prevent aliasing • bilinear MIP-mapping [Williams’83]: • bicubic (interpolating) 1. build pyramid (but what decimation filter?): • sinc / FIR – block averaging Needed to prevent “jaggies” – Burt & Adelson (5-tap binomial) and “texture crawl” (see demo) – 7-tap wavelet-based filter (better) 2. trilinear interpolation – bilinear within each 2 adjacent levels – linear blend between levels (determined by pixel size) Richard Szeliski Image Stitching 19 Richard Szeliski Image Stitching 20 Prefiltering Essential for downsampling (decimation) to prevent aliasing Other possibilities: Motion models (reprise) • summed area tables • elliptically weighted Gaussians (EWA) [Heckbert’86] Richard Szeliski Image Stitching 21 Motion models Plane perspective mosaics • 8-parameter generalization of affine motion – works for pure rotation or planar surfaces Translation Affine Perspective 3D rotation • Limitations: – local minima – slow convergence – difficult to control interactively 2 unknowns 6 unknowns 8 unknowns 3 unknowns Richard Szeliski Image Stitching 23 Richard Szeliski Image Stitching 24 Image warping with homographies Rotational mosaics • Directly optimize rotation and focal length • Advantages: – ability to build full-view panoramas – easier to control interactively – more stable and accurate estimates image plane in front image plane below Richard Szeliski Image Stitching 25 Richard Szeliski Image Stitching 26 3D → 2D Perspective Projection Rotational mosaic Projection equations (Xc,Yc,Zc) 1. Project from image to 3D ray f uc (x0,y0,z0) = (u0-uc,v0-vc,f) u 2. Rotate the ray by camera motion (x1,y1,z1) = R01 (x0,y0,z0) 3. Project back into new (source) image (u1,v1)= (fx1/z1+uc,fy1/z1+vc) Richard Szeliski Image Stitching 27 Richard Szeliski Image Stitching 28 Image reprojection Rotations and quaternions How do we represent rotation matrices? 1. Axis / angle (n,θ) 2 R = I + sinθ [n]× + (1- cosθ) [n]× (Rodriguez Formula), with [n]× = cross product matrix (see paper) 2. Unit quaternions [Shoemake SIGG’85] mosaic PP q = (n sinθ/2, cosθ/2) = (w,s) The mosaic has a natural interpretation in 3D quaternion multiplication (division is easy) • The images are reprojected onto a common plane q0 q1 = (s1w0+ s0w1, s0 s1-w0·w1) • The mosaic is formed on this plane Richard Szeliski Image Stitching 29 Richard Szeliski Image Stitching 30 Incremental rotation update Perspective & rotational motion 1. Small angle approximation Solve 8x8 or 3x3 system (see papers for 2 ΔR = I + sinθ [n]× + (1- cosθ) [n]× details), and iterate (non-linear) ≈ θ [n]× = [ω]× Patch-based approximation: linear in ω 1. break up image into patches (say 16x16) 2. Update original R matrix 2. accumulate 2x2 linear system in each R ← R ΔR (local translational assumption) 3. compose larger system from smaller 2x2 results [Shum & Szeliski, ICCV’98] Richard Szeliski Image Stitching 31 Richard Szeliski Image Stitching 32 Image Mosaics (stitching) Blend together several overlapping images into one seamless mosaic (composite) Image Mosaics (Stitching) + + … + = [Szeliski & Shum, SIGGRAPH’97] [Szeliski, FnT CVCG, 2006] Richard Szeliski Image Stitching 34 Mosaics for Video Coding Establishing correspondences Convert masked images into a background sprite 1. Direct method: for content-based coding • Use generalization of affine motion model [Szeliski & Shum ’97] +++ 2. Feature-based method • Extract features, match, find consisten inliers [Lowe ICCV’99; Schmid ICCV’98, = Brown&Lowe ICCV’2003] •Compute R from correspondences (absolute orientation) Richard Szeliski Image Stitching 35 Richard Szeliski Image Stitching 36 Absolute orientation Stitching demo [Arun et al., PAMI 1987] [Horn et al., JOSA A 1988] Procrustes Algorithm [Golub & VanLoan] Given two sets of matching points, compute R pi’= R pi 3D rays T T T T T T A = Σi pi pi’ = Σi pi pi R = U S V = (U S U ) R VT = UT RT R = VUT Richard Szeliski Image Stitching 37 Richard Szeliski Image Stitching 38 Panoramas Cylindrical panoramas What if you want a 360° field of view? Steps mosaic Projection Cylinder • Reproject each image onto a cylinder • Blend • Output the resulting mosaic Richard Szeliski Image Stitching 39 Richard Szeliski Image Stitching 40 Cylindrical Panoramas Determining the focal length Map image to cylindrical or spherical coordinates 1. Initialize from homography H • need known focal length (see text or [SzSh’97]) 2. Use camera’s EXIF tags (approx.) 3. Use a tape measure 4m 1m Image 384x300 f = 180 (pixels) f = 280 f = 380 4. Ask your instructor Richard Szeliski Image Stitching 41 Richard Szeliski Image Stitching 42 3D → 2D Perspective Projection Cylindrical projection • Map 3D point (X,Y,Z) onto cylinder (Xc,Yc,Zc) f uc • Convert to cylindrical coordinates Y Z X u • Convert to cylindrical image coordinates unit cylinder – s defines size of the final image unwrapped cylinder cylindrical image Richard Szeliski Image Stitching 43 Richard Szeliski Image Stitching 44 Cylindrical warping Spherical warping Given focal length f and Given focal length f and image center (xc,yc) image center (xc,yc) φ (X,Y,Z) (x,y,z) cos φ (sinθ,h,cosθ) (sinθcosφ, sinφ, cosθcosφ) Y Y sin φ Z Z X X cos θ cos φ Richard Szeliski Image Stitching 45 Richard Szeliski Image Stitching 46 Radial distortion 3D rotation Correct for “bending” in wide field of view lenses Project Rotate image before to “normalized” placing on unrolled sphere image coordinates (x,y,z) φ cos φ Apply radial distortion (sinθcosφ, sinφ, cosθcosφ) sin φ Z Y X cos θ cos φ p = R p Apply focal length _ _ translate image center _ _ To model lens distortion • Use above projection operation instead of standard projection matrix multiplication Richard Szeliski Image Stitching 47 Richard Szeliski Image Stitching 48 Fisheye lens Image Stitching Extreme “bending” in ultra-wide fields of view 1. Align the images over each other • camera pan ↔ translation on cylinder 2. Blend the images together (demo) Richard Szeliski Image Stitching 49 Richard Szeliski Image Stitching 50 Project 2 – image stitching Matching features 1. Take pictures on a tripod (or handheld) 2. Warp images to spherical coordinates 3. Extract features 4. Align neighboring pairs using RANSAC 5. Write out list of neighboring translations 6. Correct for drift
Load more

Recommended publications
  • A Stitching Algorithm for Automated Surface Inspection of Rotationally Symmetric Components
    A Stitching Algorithm for Automated Surface Inspection of Rotationally Symmetric Components Tobias Schlagenhauf1, Tim Brander1, Jürgen Fleischer1 1Karlsruhe Institute of Technology (KIT) wbk-Institute of Production Science Kaiserstraße 12, 76131 Karlsruhe, Germany Abstract This paper provides a novel approach to stitching surface images of rotationally symmetric parts. It presents a process pipeline that uses a feature-based stitching approach to create a distortion-free and true-to-life image from a video file. The developed process thus enables, for example, condition monitoring without having to view many individual images. For validation purposes, this will be demonstrated in the paper using the concrete example of a worn ball screw drive spindle. The developed algorithm aims at reproducing the functional principle of a line scan camera system, whereby the physical measuring systems are replaced by a feature-based approach. For evaluation of the stitching algorithms, metrics are used, some of which have only been developed in this work or have been supplemented by test procedures already in use. The applicability of the developed algorithm is not only limited to machine tool spindles. Instead, the developed method allows a general approach to the surface inspection of various rotationally symmetric components and can therefore be used in a variety of industrial applications. Deep-learning-based detection Algorithms can easily be implemented to generate a complete pipeline for failure detection and condition monitoring on rotationally symmetric parts. Keywords Image Stitching, Video Stitching, Condition Monitoring, Rotationally Symmetric Components 1. Introduction The remainder of the paper is structured as follows. Section 2 reviews the current state of the art in the field of stitching.
    [Show full text]
  • Fast Vignetting Correction and Color Matching for Panoramic Image Stitching
    FAST VIGNETTING CORRECTION AND COLOR MATCHING FOR PANORAMIC IMAGE STITCHING Colin Doutre and Panos Nasiopoulos Department of Electrical and Computer Engineering The University of British Columbia, Vancouver, Canada ABSTRACT When images are stitched together to form a panorama there is often color mismatch between the source images due to vignetting and differences in exposure and white balance between images. In this paper a low complexity method is proposed to correct vignetting and differences in color Fig. 1. Two images showing severe color mismatch aligned with no between images, producing panoramas that look consistent blending (left) and multi-band blending [1] (right) across all source images. Unlike most previous methods To compensate for brightness/color differences between which require complex non-linear optimization to solve for images in panoramas, several techniques have been correction parameters, our method requires only linear proposed [1],[6]-[9]. The simplest of these is to multiply regressions with a low number of parameters, resulting in a each image by a scaling factor [1]. A simple scaling can fast, computationally efficient method. Experimental results somewhat correct exposure differences, but cannot correct show the proposed method effectively removes vignetting for vignetting, so a number of more sophisticated techniques effects and produces images that are highly visually have been developed. consistent in color and brightness. A common camera model is used in most previous work on vignetting and exposure correction for panoramas [6]-[9]. Index Terms— color correction, vignetting, panorama, A scene radiance value L is mapped to an image pixel value image stitching I, through: 1. INTRODUCTION I = f ()eV ()x L (1) A popular application of image registration techniques is to In equation (1), e is the exposure with which the image stitch together multiple photos into a panorama [1][2].
    [Show full text]
  • Robust L2E Estimation of Transformation for Non-Rigid Registration Jiayi Ma, Weichao Qiu, Ji Zhao, Yong Ma, Alan L
    IEEE TRANSACTIONS ON SIGNAL PROCESSING 1 Robust L2E Estimation of Transformation for Non-Rigid Registration Jiayi Ma, Weichao Qiu, Ji Zhao, Yong Ma, Alan L. Yuille, and Zhuowen Tu Abstract—We introduce a new transformation estimation al- problem of dense correspondence is typically associated with gorithm using the L2E estimator, and apply it to non-rigid reg- image alignment/registration, which aims to overlaying two istration for building robust sparse and dense correspondences. or more images with shared content, either at the pixel level In the sparse point case, our method iteratively recovers the point correspondence and estimates the transformation between (e.g., stereo matching [5] and optical flow [6], [7]) or the two point sets. Feature descriptors such as shape context are object/scene level (e.g., pictorial structure model [8] and SIFT used to establish rough correspondence. We then estimate the flow [4]). It is a crucial step in all image analysis tasks in transformation using our robust algorithm. This enables us to which the final information is gained from the combination deal with the noise and outliers which arise in the correspondence of various data sources, e.g., in image fusion, change detec- step. The transformation is specified in a functional space, more specifically a reproducing kernel Hilbert space. In the dense point tion, multichannel image restoration, as well as object/scene case for non-rigid image registration, our approach consists of recognition. matching both sparsely and densely sampled SIFT features, and The registration problem can also be categorized into rigid it has particular advantages in handling significant scale changes or non-rigid registration depending on the form of the data.
    [Show full text]
  • Video Stitching for Linear Camera Arrays 1
    LAI ET AL.: VIDEO STITCHING FOR LINEAR CAMERA ARRAYS 1 Video Stitching for Linear Camera Arrays Wei-Sheng Lai1;2 1 University of California, Merced [email protected] 2 NVIDIA Orazio Gallo2 [email protected] Jinwei Gu2 [email protected] Deqing Sun2 [email protected] Ming-Hsuan Yang1 [email protected] Jan Kautz2 [email protected] Abstract Despite the long history of image and video stitching research, existing academic and commercial solutions still produce strong artifacts. In this work, we propose a wide- baseline video stitching algorithm for linear camera arrays that is temporally stable and tolerant to strong parallax. Our key insight is that stitching can be cast as a problem of learning a smooth spatial interpolation between the input videos. To solve this prob- lem, inspired by pushbroom cameras, we introduce a fast pushbroom interpolation layer and propose a novel pushbroom stitching network, which learns a dense flow field to smoothly align the multiple input videos for spatial interpolation. Our approach out- performs the state-of-the-art by a significant margin, as we show with a user study, and has immediate applications in many areas such as virtual reality, immersive telepresence, arXiv:1907.13622v1 [cs.CV] 31 Jul 2019 autonomous driving, and video surveillance. c 2019. The copyright of this document resides with its authors. It may be distributed unchanged freely in print or electronic forms. (a) Our stitching result (b) [19] (c) [3] (d) [12] (e) Ours Figure 1: Examples of video stitching. Inspired by pushbroom cameras, we propose a deep pushbroom stitching network to stitch multiple wide-baseline videos of dynamic scenes into a single panoramic video.
    [Show full text]
  • Image Stitching for Panoramas Last Updated: 12-May-2021
    Image Stitching for Panoramas Last Updated: 12-May-2021 Copyright © 2020-2021, Jonathan Sachs All Rights Reserved Contents Introduction ................................................................................................................................... 3 Taking the photographs ................................................................................................................ 4 Equipment ................................................................................................................................. 4 Use a rectilinear lens................................................................................................................. 6 Use the same camera settings for all the images ...................................................................... 6 Image overlap ........................................................................................................................... 7 Camera orientation ................................................................................................................... 7 Composition .............................................................................................................................. 7 Avoid polarizing filters ............................................................................................................... 7 Single- and Multi-row panoramas .............................................................................................. 8 Mark the beginning of each series of images ...........................................................................
    [Show full text]
  • Sift Based Image Stitching
    Journal of Computing Technologies (2278 – 3814) / # 14 / Volume 3 Issue 3 SIFT BASED IMAGE STITCHING Amol Tirlotkar, Swapnil S. Thakur, Gaurav Kamble, Swati Shishupal Department of Information Technology Atharva College of Engineering, University of Mumbai, India. { amoltirlotkar, thakur.swapnil09, gauravkamble293 , shishupal.swati }@gmail.com Abstract - This paper concerns the problem of image Camera. Image stitching is one of the methods that can be stitching which applies to stitch the set of images to form used to create large image by the use of overlapping FOV a large image. The process to generate one large [8]. The drawback is the memory requirement and the panoramic image from a set of small overlapping images amount of computations for image stitching is very high. In is called Image stitching. Stitching algorithm implements this project, this problem is resolved by performing the a seamless stitching or connection between two images image stitching by reducing the amount of required key having its overlapping part to get better resolution or points. First, the stitching key points are determined by viewing angle in image. Stitched images are used in transmitting two reference images which are to be merged various applications such as creating geographic maps or together. in medical fields. Most of the existing methods of image stitching either It uses a method based on invariant features to stitch produce a ‘rough’ stitch or produce a ghosting or blur effect. image which includes image matching and image For region-based image stitching algorithm detect the image merging. Image stitching represents different stages to edge, prepare for the extraction of feature points.
    [Show full text]
  • Shooting Panoramas and Virtual Reality
    4104_ch09_p3.qxd 6/25/03 11:17 PM Page 176 4104_ch09_p3.qxd 6/25/03 11:17 PM Page 177 Shooting Panoramas and Virtual Reality With just a little help from special software, you can extend the capabilities of your digital camera to create stunning panoramas and enticing virtual reality (VR) images. This chapter shows you how to shoot—and create— images that are not only more beautiful, but 177 ■ also have practical applications in the commer- SHOOTING PANORAMAS AND VIRTUAL REALITY cial world as well. Chapter Contents 9 Panoramas and Object Movies Shooting Simple Panoramas Extending Your View Object Movies Shooting Tips for Object Movies Mikkel Aaland Mikkel 4104_ch09_p3.qxd 6/25/03 11:18 PM Page 178 Panoramas and Object Movies Look at Figure 9.1. It’s not what it seems. This panorama is actually comprised of several images “stitched” together using a computer and special software. Because of the limitations of the digital camera’s optical system, it would have been nearly impos- sible to make this in a single shot. Panoramas like this can be printed, or with an extended angle of view and more software help, they can be turned into interactive virtual reality (VR) movies viewable on a computer monitor and distributed via the Web or on a CD. Figure 9.1: This panorama made by Scott Highton using a Nikon Coolpix 990 is comprised of 178 four adjacent images, “stitched” together using Photoshop Elements’ 2 Photomerge plug-in. ■ If you look at Figure 9.2 you’ll see another example where software was used to extend the capabilities of a digital camera.
    [Show full text]
  • Image Stitching
    Panoramic Image Mosaics Image Stitching Computer Vision CSE 576, Spring 2008 Full screen panoramas (cubic): http://www.panoramas.dk/ Richard Szeliski Mars: http://www.panoramas.dk/fullscreen3/f2_mars97.html Microsoft Research 2003 New Years Eve: http://www.panoramas.dk/fullscreen3/f1.html Richard Szeliski Image Stitching 2 Gigapixel panoramas & images Image Mosaics + + … + = Mapping / Tourism / WWT Medical Imaging Goal: Stitch together several images into a seamless composite Richard Szeliski Image Stitching 3 Richard Szeliski Image Stitching 4 Today’s lecture Readings Image alignment and stitching • Szeliski, CVAA: • motion models • Chapter 3.5: Image warping • Chapter 5.1: Feature-based alignment (in preparation) • image warping • Chapter 8.1: Motion models • point-based alignment • Chapter 8.2: Global alignment • Chapter 8.3: Compositing • complete mosaics (global alignment) • compositing and blending • Recognizing Panoramas, Brown & Lowe, ICCV’2003 • ghost and parallax removal • Szeliski & Shum, SIGGRAPH'97 Richard Szeliski Image Stitching 5 Richard Szeliski Image Stitching 6 Motion models What happens when we take two images with a camera and try to align them? Motion models • translation? • rotation? • scale? • affine? • perspective? … see interactive demo (VideoMosaic) Richard Szeliski Image Stitching 8 Image Warping image filtering: change range of image g(x) = h(f(x)) Image Warping f f h x x image warping: change domain of image g(x) = f(h(x)) f f h x x Richard Szeliski Image Stitching 10 Image Warping Parametric (global) warping
    [Show full text]
  • Robust Panoramic Image Stitching CS231A Final Report
    Robust Panoramic Image Stitching CS231A Final Report Harrison Chau Robert Karol Department of Aeronautics and Astronautics Department of Aeronautics and Astronautics Stanford University Stanford University Stanford, CA, USA Stanford, CA, USA [email protected] [email protected] Abstract— Creation of panoramas using computer vision is not a new algorithms combined in a novel way. First, an image database idea, however, most algorithms are focused on creating a panorama is created. This is done manually by taking pictures from a using all of the images in a directory. The method which will be variety of locations around the world. SIFT keypoints are then explained in detail takes this approach one step further by not found for each image. The algorithm then sorts through the requiring the images in each panorama be separated out manually. images to find keypoint matches between the images. A Instead, it clusters a set of pictures into separate panoramas based on clustering algorithm is run which separates the images into scale invariant feature matching. Then uses these separate clusters to separate panoramas, and the individual groups of images are stitch together panoramic images. stitched and mosaicked together to form separate panoramas. Keywords—Panorama; SIFT; RANSAC; Homography; II. RELATED WORK Keypoint; Stitching; Clustering A. Prior Algorithms I. INTRODUCTION Algorithms which have been used to create panoramas You travel often for work or pleasure but you have had a have been developed in the past and implemented many times. passion for photography since childhood. Over the years, you Some of these algorithms have even been optimized to run in take many different photographs at each of your destination.
    [Show full text]
  • A Method of Generating Panoramic Street Strip Image Map with Mobile Mapping System
    The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Volume XLI-B1, 2016 XXIII ISPRS Congress, 12–19 July 2016, Prague, Czech Republic A METHOD OF GENERATING PANORAMIC STREET STRIP IMAGE MAP WITH MOBILE MAPPING SYSTEM Chen Tianen a *, Kohei Yamamoto a, Kikuo Tachibana a a PASCO CORP. R&D CENTER, 2-8-10 Higashiyama Meguro-Ku, Tokyo 153-0043, JAPAN – (tnieah3292, kootho1810, kainka9209)@pasco.co.jp Commission I, ICWG I/VA KEY WORDS: Mobile Mapping System, Omni-Directional Camera, Laser Point Cloud, Street-Side Map, Image Stitching ABSTRACT: This paper explores a method of generating panoramic street strip image map which is called as “Pano-Street” here and contains both sides, ground surface and overhead part of a street with a sequence of 360° panoramic images captured with Point Grey’s Ladybug3 mounted on the top of Mitsubishi MMS-X 220 at 2m intervals along the streets in urban environment. On-board GPS/IMU, speedometer and post sequence image analysis technology such as bundle adjustment provided much more accuracy level position and attitude data for these panoramic images, and laser data. The principle for generating panoramic street strip image map is similar to that of the traditional aero ortho-images. A special 3D DEM(3D-Mesh called here) was firstly generated with laser data, the depth map generated from dense image matching with the sequence of 360° panoramic images, or the existing GIS spatial data along the MMS trajectory, then all 360° panoramic images were projected and stitched on the 3D-Mesh with the position and attitude data.
    [Show full text]
  • Dual-Fisheye Lens Stitching for 360-Degree Imaging
    DUAL-FISHEYE LENS STITCHING FOR 360-DEGREE IMAGING Tuan Ho 1* Madhukar Budagavi 2 1University of Texas – Arlington, Department of Electrical Engineering, Arlington, Texas, U.S.A 2Samsung Research America, Richardson, Texas, U.S.A ABSTRACT Dual-fisheye lens cameras have been increasingly used for 360-degree immersive imaging. However, the limited overlapping field of views and misalignment between the two lenses give rise to visible discontinuities in the stitching boundaries. This paper introduces a novel method for dual- fisheye camera stitching that adaptively minimizes the Fig. 1. (a) Samsung Gear 360 Camera (left). (b) Gear 360 discontinuities in the overlapping regions to generate full dual–fisheye output image (7776 x 3888 pixels) (right). spherical 360-degree images. Results show that this approach Left half: image taken by the front lens. Right half: image can produce good quality stitched images for Samsung Gear taken by the rear lens. 360 – a dual-fisheye camera, even with hard-to-stitch objects in the stitching borders. companies. The number of cameras used in these systems ranges from 8 to 17. These cameras typically deliver Index Terms— Dual-fisheye, Stitching, 360-degree professional quality, high-resolution 360-degree videos. Videos, Virtual Reality, Polydioptric Camera On the downside, these high-end 360-degree cameras are bulky and extremely expensive, even with the decreasing cost 1. INTRODUCTION of image sensors, and are out of reach for most of the regular users. To bring the immersive photography experience to the 360-degree videos and images have become very popular masses, Samsung has presented Gear 360 camera, shown in with the advent of easy-to-use 360-degree viewers such as Fig.
    [Show full text]
  • Panoweaver 9 User Manual (To Start the Online Help, Select Help > Help Topics from the Main Menu Or Press F1)
    Panoweaver User Manual www.easypano.com Table Of Contents Welcome .................................................................................................... 1 Introduction ............................................................................................... 3 What's New........................................................................................... 3 Edition Comparison ................................................................................ 4 Get Help ............................................................................................... 5 Install Panoweaver 9 ................................................................................... 7 System Requirements .......................................................................... 10 System Requirements ..................................................................... 10 For Windows .................................................................................. 10 For Macintosh ................................................................................ 11 Activate Panoweaver 9 ............................................................................... 13 Activate Panoweaver 9 ......................................................................... 13 Purchase ............................................................................................ 13 Product Activation ................................................................................ 13 Transfer License Key ...........................................................................
    [Show full text]