DOCSLIB.ORG

Deep Learning for Image Super-Resolution: a Survey

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Deep Learning for Image Super-Resolution: a Survey 1 Deep Learning for Image Super-resolution: A Survey Zhihao Wang, Jian Chen, Steven C.H. Hoi, Fellow, IEEE Abstract—Image Super-Resolution (SR) is an important class of image processing techniques to enhance the resolution of images and videos in computer vision. Recent years have witnessed remarkable progress of image super-resolution using deep learning techniques. This article aims to provide a comprehensive survey on recent advances of image super-resolution using deep learning approaches. In general, we can roughly group the existing studies of SR techniques into three major categories: supervised SR, unsupervised SR, and domain-specific SR. In addition, we also cover some other important issues, such as publicly available benchmark datasets and performance evaluation metrics. Finally, we conclude this survey by highlighting several future directions and open issues which should be further addressed by the community in the future. Index Terms—Image Super-resolution, Deep Learning, Convolutional Neural Networks (CNN), Generative Adversarial Nets (GAN) F 1 INTRODUCTION MAGE super-resolution (SR), which refers to the process and strategies [8], [31], [32], etc. I of recovering high-resolution (HR) images from low- In this paper, we give a comprehensive overview of re- resolution (LR) images, is an important class of image cent advances in image super-resolution with deep learning. processing techniques in computer vision and image pro- Although there are some existing SR surveys in literature, cessing. It enjoys a wide range of real-world applications, our work differs in that we are focused in deep learning such as medical imaging [1], [2], [3], surveillance and secu- based SR techniques, while most of the earlier works [33], rity [4], [5]), amongst others. Other than improving image [34], [35], [36] aim at surveying traditional SR algorithms or perceptual quality, it also helps to improve other computer some studies mainly concentrate on providing quantitative vision tasks [6], [7], [8], [9]. In general, this problem is very evaluations based on full-reference metrics or human visual challenging and inherently ill-posed since there are always perception [37], [38]. Unlike the existing surveys, this survey multiple HR images corresponding to a single LR image. takes a unique deep learning based perspective to review In literature, a variety of classical SR methods have been the recent advances of SR techniques in a systematic and proposed, including prediction-based methods [10], [11], comprehensive manner. [12], edge-based methods [13], [14], statistical methods [15], The main contributions of this survey are three-fold: [16], patch-based methods [13], [17], [18], [19] and sparse 1) We give a comprehensive review of image super- representation methods [20], [21], etc. resolution techniques based on deep learning, in- With the rapid development of deep learning techniques cluding problem settings, benchmark datasets, per- in recent years, deep learning based SR models have been formance metrics, a family of SR methods with deep actively explored and often achieve the state-of-the-art per- learning, domain-specific SR applications, etc. formance on various benchmarks of SR. A variety of deep 2) We provide a systematic overview of recent ad- learning methods have been applied to tackle SR tasks, rang- vances of deep learning based SR techniques in a ing from the early Convolutional Neural Networks (CNN) arXiv:1902.06068v2 [cs.CV] 8 Feb 2020 hierarchical and structural manner, and summarize based method (e.g., SRCNN [22], [23]) to recent promising the advantages and limitations of each component SR approaches using Generative Adversarial Nets (GAN) for an effective SR solution. [24] (e.g., SRGAN [25]). In general, the family of SR al- 3) We discuss the challenges and open issues, and gorithms using deep learning techniques differ from each identify the new trends and future directions to other in the following major aspects: different types of provide an insightful guidance for the community. network architectures [26], [27], [28], different types of loss functions [8], [29], [30], different types of learning principles In the following sections, we will cover various aspects of recent advances in image super-resolution with deep learning. Fig. 1 shows the taxonomy of image SR to be • Corresponding author: Steven C.H. Hoi is currently with Salesforce Research Asia, and also a faculty member (on leave) of the School covered in this survey in a hierarchically-structured way. of Information Systems, Singapore Management University, Singapore. Section 2 gives the problem definition and reviews the Email: [email protected] or [email protected]. mainstream datasets and evaluation metrics. Section 3 ana- • Z. Wang is with the South China University of Technology, China. E-mail: lyzes main components of supervised SR modularly. Section [email protected]. This work was done when he was a visiting student with Dr Hoi’s group at the School of Information Systems, Singapore 4 gives a brief introduction to unsupervised SR methods. Management University, Singapore. Section 5 introduces some popular domain-specific SR ap- • J. Chen is with the South China University of Technology, China. E-mail: plications, and Section 6 discusses future directions and [email protected]. open issues. 2 Image Super-resolution Supervised Image Super-resolution Model Frameworks Upsampling Methods Network Design Learning Strategies Other Improvements Residual Learning Loss Functions: Pre-upsampling SR Context-wise Network Interpolation-based Methods: Recursive Learning - Pixel Loss Fusion - Nearest Neighbor Multi-path Learning - Content Loss - Bilinear - Texture Loss Post-upsampling SR Dense Connections - Bicubic - Adversarial Loss Data Augmentation - Others Attention Mechanism - Cycle Consistency Loss Advanced Convolution - Total Variation Loss Progressive Upsampling SR Region-recursive Learning - Prior-based Loss Multi-task Learning Learning-based Methods: Pyramid Pooling Batch Normalization - Transposed Convolution Network Interpolation Iterative Up-and-down Wavelet Transformation - Sub-pixel Layer Curriculum Learning Sampling SR xUnit - Meta Upscale Module Self-ensemble Desubpixel Multi-supervision Performance Evaluation Unsupervised Image Super-resolution Domain-specific Applications Benchmark Datasets Depth Map Super-resolution Zero-shot Super-resolution Performance Metric: Face Image Super-resolution - Objective Methods: PSNR, SSIM, etc. Weakly-supervised Super-resolution: - Subjective Methods: MOS Hyperspectral Image Super-resolution - Learned Degradation - Task-based Evaluation Real-world Image Super-resolution - Learning-based Perceptual Quality - Cycle-in-cycle Super-resolution - Other Methods Video Super-resolution Operating Channels Deep Image Prior Other Applications Fig. 1. Hierarchically-structured taxonomy of this survey. 2 PROBLEM SETTING AND TERMINOLOGY downsampling operation is bicubic interpolation with anti- aliasing. However, there are other works [39] modelling the 2.1 Problem Definitions degradation as a combination of several operations: Image super-resolution aims at recovering the correspond- D(I ; δ) = (I ⊗ κ) # +n ; fκ, s; &g ⊂ δ; (4) ing HR images from the LR images. Generally, the LR image y y s & I x is modeled as the output of the following degradation: where Iy ⊗ κ represents the convolution between a blur kernel κ and the HR image I , and n is some additive I = D(I ; δ); y & x y (1) white Gaussian noise with standard deviation &. Compared to the naive definition of Eq. 3, the combinative degradation where D denotes a degradation mapping function, Iy is pattern of Eq. 4 is closer to real-world cases and has been the corresponding HR image and δ is the parameters of shown to be more beneficial for SR [39]. the degradation process (e.g., the scaling factor or noise). Generally, the degradation process (i.e., D and δ) is un- To this end, the objective of SR is as follows: known and only LR images are provided. In this case, also ^ θ = arg min L(I^y;Iy) + λΦ(θ); (5) known as blind SR, researchers are required to recover an θ HR approximation I^y of the ground truth HR image Iy from where L(I^y;Iy) represents the loss function between the the LR image Ix, following: generated HR image I^y and the ground truth image Iy, Φ(θ) λ I^y = F(Ix; θ); (2) is the regularization term and is the tradeoff parameter. Although the most popular loss function for SR is pixel-wise where F is the super-resolution model and θ denotes the mean squared error (i.e., pixel loss), more powerful models parameters of F. tend to use a combination of multiple loss functions, which Although the degradation process is unknown and can will be covered in Sec. 3.4.1. be affected by various factors (e.g., compression artifacts, anisotropic degradations, sensor noise and speckle noise), 2.2 Datasets for Super-resolution researchers are trying to model the degradation mapping. Most works directly model the degradation as a single Today there are a variety of datasets available for image downsampling operation, as follows: super-resolution, which greatly differ in image amounts, quality, resolution, and diversity, etc. Some of them provide D(Iy; δ) = (Iy) #s; fsg ⊂ δ; (3) LR-HR image pairs, while others only provide HR images, in which case the LR images are typically obtained by imre- where #s is a downsampling operation with the scaling size function with default settings in MATLAB (i.e., bicubic factor s. As a matter of fact, most datasets for generic SR are interpolation with anti-aliasing). In Table 1 we list a number built based on this pattern, and the most commonly used of image datasets commonly used by the SR community, 3 TABLE 1 List of public image datasets for super-resolution benchmarks. Dataset Amount Avg. Resolution Avg. Pixels Format Category Keywords BSDS300 [40] 300 (435; 367) 154; 401 JPG animal, building, food, landscape, people, plant, etc. BSDS500 [41] 500 (432; 370) 154; 401 JPG animal, building, food, landscape, people, plant, etc. DIV2K [42] 1000 (1972; 1437) 2; 793; 250 PNG environment, flora, fauna, handmade object, people, scenery, etc.
Load more

Recommended publications
  • A Novel Edge-Preserving Mesh-Based Method for Image Scaling
    A Novel Edge-Preserving Mesh-Based Method for Image Scaling Seyedali Mostafavian and Michael D. Adams Dept. of Electrical and Computer Engineering, University of Victoria, Victoria, BC V8P 5C2, Canada [email protected] and [email protected] Abstract—In this paper, we present a novel image scaling no loss of image quality. One main problem in vector-based method that employs a mesh model that explicitly represents interpolation methods, however, is how to create a vector discontinuities in the image. Our method effectively addresses model which faithfully represents the raster image data and its the problem of preserving the sharpness of edges, which has always been a challenge, during image enlargement. We use important features such as edges. Among the many techniques a constrained Delaunay triangulation to generate the model to generate a vector image from a raster image, triangle and an approximating function that is continuous everywhere mesh models have become quite popular. With a triangle-mesh except across the image edges (i.e., discontinuities). The model model, the image domain is partitioned into a set of non- is then rasterized using a subdivision-based technique. Visual overlapping triangles called a triangulation. Then, the image comparisons and quantitative measures show that our method can greatly reduce the blurring artifacts that can arise during intensity function is approximated over each of the triangles. image enlargement and produce images that look more pleasant A mesh-generation method is required to choose a good subset to human observers, compared to the well-known bilinear and of sample points and to collect any critical data from the input bicubic methods.
    [Show full text]
  • Color Page Effects Chapter 116 Davinci Resolve Control Panels
    PART 9 Color Page Effects Chapter 116 DaVinci Resolve Control Panels The DaVinci Resolve control panels make it easier to make more adjustments in the same amount of time than using a mouse, pen, or trackpad with the on-screen interface. Additionally, using a DaVinci Resolve control panel to control the Color page provides vastly superior ergonomic comfort to clutching a mouse or pen all day, which is important when you’re potentially grading a thousand shots per day. This chapter covers details about the three DaVinci Resolve control panels that are available, and how they work with DaVinci Resolve. Chapter – 116 DaVinci Resolve Control Panels 2258 Contents About The DaVinci Resolve Control Panels 2260 DaVinci Resolve Micro Panel 2261 Trackballs 2261 Control Knobs 2262 Control Buttons 2263 DaVinci Resolve Mini Panel 2265 Palette Selection Buttons 2265 Quick Selection Buttons 2266 DaVinci Resolve Advanced Control Panel 2268 Menus, Soft Keys, and Soft Knob Controls 2268 Trackball Panel 2269 T-bar Panel 2270 Transport Panel 2276 Copying Grades Using the Advanced Control Panel 2280 Copy Forward Keys 2280 Scroll 2280 Rippling Changes Using the Advanced Control Panel 2281 Chapter – 116 DaVinci Resolve Control Panels 2259 About The DaVinci Resolve Control Panels There are three DaVinci Resolve control panel options available and each are designed to meet modern workflow ergonomics and ease of use so colorists can quickly and accurately construct both simple and complex creative grades with minimal fatigue. This chapter provides details of the each of the panel functions and should be read in conjunction with the previous grading chapters to get the best from your panel.
    [Show full text]
  • Apparent Display Resolution Enhancement for Moving Images
    Apparent Display Resolution Enhancement for Moving Images Piotr Didyk1 Elmar Eisemann1;2 Tobias Ritschel1 Karol Myszkowski1 Hans-Peter Seidel1 1 MPI Informatik 2 Telecom ParisTech / CNRS-LTCI / Saarland University Frame 1 Frame 2 Frame 3 Retina Lanczos Frame 1 Frame 2 Frame 3 Retina Lanczos Frame 1 Frame 2 Frame 3 Retina Lanczos Figure 1: Depicting fine details such as hair (left), sparkling car paint (middle) or small text (right) on a typical display is challenging and often fails if the display resolution is insufficient. In this work, we show that smooth and continuous subpixel image motion can be used to increase the perceived resolution. By sequentially displaying varying intermediate images at the display resolution (as depicted in the bottom insets), subpixel details can be resolved at the retina in the region of interest due to fixational eye tracking of this region. Abstract and images are skillfully tone and gamut mapped to adapt them to the display’s capabilities, these limitations persist. In order to Limited spatial resolution of current displays makes the depiction of surmount the physical limitations of display devices, modern algo- very fine spatial details difficult. This work proposes a novel method rithms started to exploit characteristics of the human visual system applied to moving images that takes into account the human visual (HVS) such as apparent image contrast [Purves et al. 1999] based on system and leads to an improved perception of such details. To this the Cornsweet Illusion or apparent brightness [Zavagno and Caputo end, we display images rapidly varying over time along a given tra- 2001] due to glare.
    [Show full text]
  • Rk3026 Brief
    BRIEF RK3026 RK3026 BRIEF Revision 1.1 Public Version August 2013 High Performance and Low-power Processor for Digital Media Application - 1 - BRIEF RK3026 Revision History This document is now Production Data. Date Revision Description 2013-08-28 1.0 Initial Release 2013-10-17 1.1 Update “512MB” to “1GB” High Performance and Low-power Processor for Digital Media Application - 2 - BRIEF RK3026 Content Content................................................................................................................................................................- 3 - chapter 1 Introduction......................................................................................................................- 5 - 1.1 Overview.....................................................................................................................................- 5 - 1.2 Features......................................................................................................................................- 5 - 1.3 Block Diagram..........................................................................................................................- 15 - High Performance and Low-power Processor for Digital Media Application - 3 - BRIEF RK3026 Warranty Disclaimer Rockchip Electronics Co.,Ltd makes no warranty, representation or guarantee (expressed, implied, statutory, or otherwise) by or with respect to anything in this document, and shall not be liable for any implied warranties of non-infringement, merchantability or fitness for a particular
    [Show full text]
  • Sensitive Text Icon Classification for Android Apps
    SENSITIVE TEXT ICON CLASSIFICATION FOR ANDROID APPS by ZHIHAO CAO Submitted in partial fulfillment of the requirements for the degree of Master of Science Thesis Advisor: Dr. Xusheng Xiao Department of Electrical Engineering and Computer Science CASE WESTERN RESERVE UNIVERSITY January, 2018 CASE WESTERN RESERVE UNIVERSITY SCHOOL OF GRADUATE STUDIES We hereby approve the thesis/dissertation of Zhihao Cao candidate for the degree of Master of Science. Committee Chair Xusheng Xiao Committee Member Andy Podgurski Committee Member Ming-Chun Huang Date of Defense Nov. 30 2017 *We also certify that written approval has been obtained for any proprietary material contained therein. Contents List of Tables 3 List of Figures 4 List of Abbreviations 7 Abstract 8 1 Introduction 9 2 Background 16 2.1 Permission System in Android…………………………………………………..16 2.2 Sensitive UI Detection in Android……………………………………………….17 2.3 Pixel and Color Model…………………………………………………………...19 2.4 Optical Character Recognition…………………………………………………...21 3 Design of DroidIcon 23 3.1 Overview…………………………………………………………..……………..23 3.2 Image Mutation…………………………………………………………………..24 3.2.1 Image Scaling………………………………………………………………24 3.2.2 Color Inversion…………………………………………………………….31 1 3.2.3 Opacity Conversion………………………………………………………..33 3.2.4 Grayscale Conversion………..…………………………………………….37 3.2.5 Contrast Adjustment……………………………………………………….42 3.3 Text Icon Classification 48 3.3.1 Text Cleaning……………………...……………………………………….48 3.3.2 Keyword Dataset Construction…………………………………………….49 3.3.3 Classification Algorithm…………………………………………………...50
    [Show full text]
  • RK3066 Datasheet Brief
    RK3066 Datasheet brief RK3066 Datasheet brief Rev1.0 RK3066 Datasheet brief Revision 1.0 Feb. 2012 Rockchips Confidential 1 Date Revision Description Revision History RK3066 Datasheet brief Rev1.0 Revision History Date Revision Description 2011-10-30 0.0 Initial Release 2012-02-15 1.0 Add package information Rockchips Confidential 2 TABLE OF CONTENT RK3066 Datasheet brief Rev1.0 TABLE OF CONTENT Revision History....................................................................................2 TABLE OF CONTENT.............................................................................. 3 Chapter 1 Introduction...............................................................4 1.1 Overview.......................................................................4 1.2 Features........................................................................4 1.3 Block Diagram..............................................................15 Chapter 2 Package information..................................................16 2.1 Dimension................................................................... 16 2.2 Ball Map...................................................................... 18 2.3 Pin Number Order.........................................................21 2.4 RK3066 power/ground IO descriptions.............................26 2.5 RK3066 function IO descriptions..................................... 28 Chapter 3 Electrical Specification............................................... 40 3.1 Absolute Maximum Ratings...........................................
    [Show full text]
  • Mesh Models of Images, Their Generation, and Their Application in Image Scaling
    Mesh Models of Images, Their Generation, and Their Application in Image Scaling by Ali Mostafavian B.Sc., Iran University of Science and Technology, 2007 M.Sc., Sharif University of Technology, 2009 A Dissertation Submitted in Partial Fulfillment of the Requirements for the Degree of DOCTOR OF PHILOSOPHY in the Department of Electrical and Computer Engineering c Ali Mostafavian, 2019 University of Victoria All rights reserved. This dissertation may not be reproduced in whole or in part, by photocopying or other means, without the permission of the author. ii Mesh Models of Images, Their Generation, and Their Application in Image Scaling by Ali Mostafavian B.Sc., Iran University of Science and Technology, 2007 M.Sc., Sharif University of Technology, 2009 Supervisory Committee Dr. Michael D. Adams, Supervisor (Department of Electrical and Computer Engineering) Dr. Pan Agathoklis, Departmental Member (Department of Electrical and Computer Engineering) Dr. Venkatesh Srinivasan, Outside Member (Department of Computer Science) iii ABSTRACT Triangle-mesh modeling, as one of the approaches for representing images based on nonuniform sampling, has become quite popular and beneficial in many applications. In this thesis, image representation using triangle-mesh models and its application in image scaling are studied. Consequently, two new methods, namely, the SEMMG and MIS methods are proposed, where each solves a different problem. In particular, the SEMMG method is proposed to address the problem of image representation by producing effective mesh models that are used for representing grayscale images, by minimizing squared error. The MIS method is proposed to address the image- scaling problem for grayscale images that are approximately piecewise-smooth, using triangle-mesh models.
    [Show full text]
  • Deep Sampling Networks
    Deep Sampling Networks Bolun Cai1?, Xiangmin Xu1??, Kailing Guo1, Kui Jia1, and Dacheng Tao2 1South China University of Technology, China 2UBTECH Sydney AI Centre, FEIT, The University of Sydney, Australia [email protected], fxmxu,kuijia,[email protected], [email protected] Abstract. Deep convolutional neural networks achieve excellent im- age up-sampling performance. However, CNN-based methods tend to restore high-resolution results highly depending on traditional interpo- lations (e.g. bicubic). In this paper, we present a deep sampling network (DSN) for down-sampling and up-sampling without any cheap interpo- lation. First, the down-sampling subnetwork is trained without supervi- sion, thereby preserving more information and producing better visual effects in the low-resolution image. Second, the up-sampling subnetwork learns a sub-pixel residual with dense connections to accelerate conver- gence and improve performance. DSN's down-sampling subnetwork can be used to generate photo-realistic low-resolution images and replace tra- ditional down-sampling method in image processing. With the powerful down-sampling process, the co-training DSN set a new state-of-the-art performance for image super-resolution. Moreover, DSN is compatible with existing image codecs to improve image compression. Keywords: Image sampling, deep convolutional networks, down/up- sampling. arXiv:1712.00926v2 [cs.CV] 26 Mar 2018 1 Introduction The aim of the image sampling is to generate a low-resolution (LR) image from a high-resolution (HR) image or reconstruct the HR image in reverse. Single- image up-sampling is widely used in computer vision applications including HDTV [1], medical imaging [2], satellite imaging [3], and surveillance [4], where high-frequency details are required on demand.
    [Show full text]
  • Extensible Implementation of Reliable Pixel Art Interpolation
    F O U N D A T I O N S O F C O M P U T I N G A N D D E C I S I O N S C I E N C E S Vol. 44 (2019) No. 2 ISSN 0867-6356 DOI: 10.2478/fcds-2019-0011 e-ISSN 2300-3405 Extensible Implementation of Reliable Pixel Art Interpolation Paweł M. Stasik, Julian Balcerek ∗ y Abstract. Pixel art is aesthetics that emulates the graphical style of old computer systems. Graphics created with this style needs to be scaled up for presentation on modern displays. The authors proposed two new modifications of image scaling for this purpose: a proximity-based coefficient correction and a transition area restriction. Moreover a new interpolation kernel has been introduced. The presented approaches are aimed at reliable and flexible bitmap scaling while overcoming limitations of exist- ing methods. The new techniques were introduced in an extensible .NET application that serves as both an executable program and a library. The project is designed for prototyping and testing interpolation operations and can be easily expanded with new functionality by adding it to the code or by using the provided interface. Keywords: image processing, pixel art, image upscaling, bitmap interpolation, proximity measure, proximity-based coefficient correction (PBCC), p-lin interpola- tion, transition area restriction (TAR) 1. Introduction Old computer systems, in comparison to modern systems, were heavily restricted in their graphical capabilities (in the sense of the amount of available colors and the possible resolutions). Pixel art is an artistic form that was aimed at handling these limitations, but them should not prevent it from being presented with graphical possibilities of the modern systems.
    [Show full text]
  • Use Style: Paper Title
    I.J. Image, Graphics and Signal Processing, 2013, 5, 55-62 Published Online April 2013 in MECS (http://www.mecs-press.org/) DOI: 10.5815/ijigsp.2013.05.07 A Comparative Analysis of Image Scaling Algorithms Chetan Suresh Department of Electrical and Electronics Engineering, BITS Pilani Pilani - 333031, Rajasthan, India E-mail: [email protected] Sanjay Singh, Ravi Saini, Anil K Saini Scientist, IC Design Group, CSIR – Central Electronics Engineering Research Institute (CSIR-CEERI) Pilani – 333031, Rajasthan, India Abstract— Image scaling, fundamental task of to the same input image. Some of the common numerous image processing and computer vision interpolation algorithms are the nearest neighbour, applications, is the process of resizing an image by pixel bilinear [7], and bicubic [8]-[9]. Lanczos algorithm interpolation. Image scaling leads to a number of utilizes the 3-lobed Lanczos window function to undesirable image artifacts such as aliasing, blurring and implement interpolation [10]. moiré. However, with an increase in the number of There are many other higher order interpolators which pixels considered for interpolation, the image quality take more surrounding pixels into consideration, and improves. This poses a quality-time trade off in which thus also require more computations. These algorithms high quality output must often be compromised in the include spline [11] and sinc interpolation [12], and retain interest of computation complexity. This paper presents the most of image details after an interpolation. They are a comprehensive study and comparison of different extremely useful when the image requires multiple image scaling algorithms. The performance of the rotations/distortions in separate steps. However, for scaling algorithms has been reviewed on the basis of single-step enlargements or rotations, these higher-order number of computations involved and image quality.
    [Show full text]
  • Image Interpolation Techniques for Image Scaling
    ISSN(Online): 2320-9801 ISSN (Print): 2320-9798 International Journal of Innovative Research in Computer and Communication Engineering (An ISO 3297: 2007 Certified Organization) Vol. 2, Issue 12, December 2014 A Review: Image Interpolation Techniques for Image Scaling Prof. PankajS. Parsania1, Dr. Paresh V.Virparia2 Assistant Professor, College of FPTBE, Anand Agricultural University, Anand, Gujarat, India1 Director, Department of Computer Science, Sardar Patel University, VallabhVidyanagar, Gujarat, India2 ABSTRACT: The growing interest in image scaling is mainly due to the availability of digital imaging devices such as, digital cameras, digital camcorders, 3G mobile handsets, high definition monitors etc. Scaling a digital image is a demanding and very important area of research. Image scaling is an important image processing operation applied in diverse areas in computer graphics. Image scaling can be especially useful when one needs to reduce image file size for email and web documents or increase image size for printing, GIS observation, medical diagnostic etc. With the recent advances in imaging technology, digital images have become an important component of media distribution. In addition, a variety of displays can be used for image viewing, ranging fromhigh-resolution computer monitors to TV screens and low-resolution mobile devices.This paper is focused on different image scaling techniqueswith intent that review to be useful to researchers and practitioners interested in image Scaling. KEYWORDS: Image Scaling, interpolation, Non-adaptive techniques, adaptive techniques, Context aware image resizing, Segmentation-Based, Seam Carving, Warping-Based Methods. I. INTRODUCTION Technology for display devices are growing very fast, an image often needs to be displayed across various size with different aspect ratios.
    [Show full text]
  • Super-Resolution Imaging.Pdf
    SUPER-RESOLUTION IMAGING THE KLUWER INTERNATIONAL SERIES IN ENGINEERING AND COMPUTER SCIENCE SUPER-RESOLUTION IMAGING Edited by SUBHASIS CHAUDHURI Department of Electrical Engineering Indian Institute of Technology - Bombay Mumbai, India 400 076. KLUWER ACADEMIC PUBLISHERS NEW YORK, BOSTON, DORDRECHT, LONDON, MOSCOW !"##$%&'"() *+,*-+47004+7 ./012%&'"() *+792+37471+1 34**4%5678!/%9:;<!=0:%.7>60?@!/? (!8%A#/$B%"#?2#1B%C#/</!:@2B%D#1<#1B%E#?:#8 ./012%%34***%5678!/%9:;<!=0:%F%.6!17=%.7>60?@!/? (!8%A#/$ 966%/0G@2?%/!?!/H!< (#%I;/2%#J%2@0?%!"##$%=;K%>!%/!I/#<7:!<%#/%2/;1?=022!<%01%;1K%J#/=%#/%>K%;1K%=!;1?B%!6!:2/#10:B =!:@;10:;6B%/!:#/<01GB%#/%#2@!/80?!B%802@#72%8/022!1%:#1?!12%J/#=%2@!%.7>60?@!/ L/!;2!<%01%2@!%M102!<%'2;2!?%#J%9=!/0:; N0?02%5678!/%O1601!%;2)%% @22I)FF$678!/#1601!P:#= ;1<%5678!/Q?%!"##$?2#/!%;2) @22I)FF!>##$?P$678!/#1601!P:#= Contents Preface ix Contributing Authors xi 1 Introduction 1 Subhasis Chaudhuri 1.1 The Word Resolution 2 1.2 Illustration of Resolution 3 1.3 Image Zooming 5 1.4 Super-Resolution Restoration 6 1.5 Earlier Work 8 1.6 Organization of the Book 14 2 Image Zooming: Use of Wavelets 21 Narasimha Kaulgud and Uday B. Desai 2.1 Introduction 21 2.2 Background 22 2.3 Some Existing Methods 24 2.4 Proposed Method 28 2.5 Color Images 33 2.6 Results and Discussion 38 2.7 Conclusion 41 3 Generalized Interpolation for Super-Resolution 45 Deepu Rajan and Subhasis Chaudhuri 3.1 Introduction 46 3.2 Theory of Generalized Interpolation 48 3.3 Some applications of Generalized Interpolation 54 3.4 Experimental Results 59 3.5 Conclusions 68 4 High Resolution Image from Low Resolution Images 73 Brian C.
    [Show full text]