DOCSLIB.ORG

Super-Resolution Imaging.Pdf

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Super-Resolution Imaging.Pdf SUPER-RESOLUTION IMAGING THE KLUWER INTERNATIONAL SERIES IN ENGINEERING AND COMPUTER SCIENCE SUPER-RESOLUTION IMAGING Edited by SUBHASIS CHAUDHURI Department of Electrical Engineering Indian Institute of Technology - Bombay Mumbai, India 400 076. KLUWER ACADEMIC PUBLISHERS NEW YORK, BOSTON, DORDRECHT, LONDON, MOSCOW !"##$%&'"() *+,*-+47004+7 ./012%&'"() *+792+37471+1 34**4%5678!/%9:;<!=0:%.7>60?@!/? (!8%A#/$B%"#?2#1B%C#/</!:@2B%D#1<#1B%E#?:#8 ./012%%34***%5678!/%9:;<!=0:%F%.6!17=%.7>60?@!/? (!8%A#/$ 966%/0G@2?%/!?!/H!< (#%I;/2%#J%2@0?%!"##$%=;K%>!%/!I/#<7:!<%#/%2/;1?=022!<%01%;1K%J#/=%#/%>K%;1K%=!;1?B%!6!:2/#10:B =!:@;10:;6B%/!:#/<01GB%#/%#2@!/80?!B%802@#72%8/022!1%:#1?!12%J/#=%2@!%.7>60?@!/ L/!;2!<%01%2@!%M102!<%'2;2!?%#J%9=!/0:; N0?02%5678!/%O1601!%;2)%% @22I)FF$678!/#1601!P:#= ;1<%5678!/Q?%!"##$?2#/!%;2) @22I)FF!>##$?P$678!/#1601!P:#= Contents Preface ix Contributing Authors xi 1 Introduction 1 Subhasis Chaudhuri 1.1 The Word Resolution 2 1.2 Illustration of Resolution 3 1.3 Image Zooming 5 1.4 Super-Resolution Restoration 6 1.5 Earlier Work 8 1.6 Organization of the Book 14 2 Image Zooming: Use of Wavelets 21 Narasimha Kaulgud and Uday B. Desai 2.1 Introduction 21 2.2 Background 22 2.3 Some Existing Methods 24 2.4 Proposed Method 28 2.5 Color Images 33 2.6 Results and Discussion 38 2.7 Conclusion 41 3 Generalized Interpolation for Super-Resolution 45 Deepu Rajan and Subhasis Chaudhuri 3.1 Introduction 46 3.2 Theory of Generalized Interpolation 48 3.3 Some applications of Generalized Interpolation 54 3.4 Experimental Results 59 3.5 Conclusions 68 4 High Resolution Image from Low Resolution Images 73 Brian C. Tom, Nikolas P. Galatsanos and Aggelos K. Katsaggelos 4.1 Introduction 74 4.2 Literature Review 81 vi SUPER-RESOLUTION IMAGING 4.3 Imaging Model 86 4.4 Simultaneous Registration and Restoration, RR-I Approach 88 4.5 Simultaneous Restoration, Registration and Interpolation: RRI Approach 95 4.6 Experimental Results 97 4.7 Conclusions and Future Work 101 5 Super-Resolution Imaging Using Blur as a Cue 107 Deepu Rajan and Subhasis Chaudhuri 5.1 Introduction 108 5.2 Theory of MRF 109 5.3 Modeling the Low Resolution Observations 112 5.4 MAP Estimation of the Super-resolution Image 114 5.5 Experimental Results 119 5.6 Conclusions 127 6 Super-Resolution via Image Warping 131 Terrance E. Boult, Ming-Chao Chiang and Ross J. Micheals 6.1 Background and Introduction 132 6.2 Image Formation, Image Restoration and Super-Resolution 133 6.3 Imaging-Consistency and The Integrating Resampler 135 6.4 Warping-based Super-Resolution 142 6.5 Quantitative Evaluation 148 6.6 Face-Based evaluation 160 6.7 Conclusion 165 7 Resolution Enhancement using Multiple Apertures 171 Takashi Komatsu, Kiyoharu Aizawa and Takahiro Saito 7.1 Introduction 172 7.2 Original Concept 173 7.3 Image Acquisition with Multiple Different-Aperture Cameras 178 7.4 Experimental Simulations 187 7.5 Conclusions 192 8 Super-Resolution from Mutual Motion 195 Assaf Zomet and Shmuel Peleg 8.1 Introduction 196 8.2 Efficient Gradient-based Algorithms 199 8.3 Computational Analysis and Results 205 8.4 Summary 206 9 Super-Resolution from Compressed Video 211 C. Andrew Segall, Aggelos K. Katsaggelos, Rafael Molina and Javier Mateos 9.1 Introduction 211 9.2 Video Compression Basics 213 9.3 Incorporating the Bit-Stream 216 9.4 Compression Artifacts 222 Contents vii 9.5 Super-Resolution 225 9.6 Conclusions 239 10 Super-Resolution: Limits and Beyond 243 Simon Baker and Takeo Kanade 10.1 Introduction 244 10.2 The Reconstruction Constraints 245 10.3 Analysis of the Constraints 248 10.4 Super-Resolution by Hallucination 257 10.5 Summary 271 10.6 Discussion 271 Index 277 !"#$%&'()%#*+)*+#,*'--.%-)/+%0-'*1 Preface The field of image processing is now quite a mature one. Many impor- tant developments have taken place over the last three or four decades. It finds applications in many diverse areas and a plenty of new applica- tions are being suggested on a regular basis. The bottom line of all image processing applications is that the quality of the input images should be good. Further, the area of interest in the digital picture should be repre- sented at a sufficiently high spatial resolution. One way to increase this resolution is to go for a very high resolution CCD camera which is often not a viable option. Thus, a need for generating a super-resolution im- age from a set of low resolution observations was felt by the researchers and this book is an outcome of such an effort. I, as the editor of the book, requested a team of authors to cover a wide range of problems and methods coming under the topic of super- resolution imaging so that the readers get a survey of the present state of the field. I believe that the field super-resolution imaging has reached a first stage of maturity, justifying the timeliness of the book. We primar- ily concentrate on three different issues in this book – summarization of the existing results, exploration of new ideas, and preparation of ground for further investigations. I hope that the book will become a widely used general reference and that it will motivate further research in this topic and stimulate communication between mathematicians, scientists and practicing engineers. If the book serves to demonstrate that there is a basic need for further exploration in this topic, I would consider my goal of editing this book to have been achieved. The book is addressed to a broad audience. The senior undergrad- uate and the graduate students in electrical engineering, computer sci- ence and mathematics disciplines may find it a good reference for their courses and seminars on image processing and computer vision. The academicians and the researchers at the universities and various labo- ratories may find it suitable to supplement their research interest. The practicing engineers will also find the book to be quite useful as the con- x SUPER-RESOLUTION IMAGING tributing authors have discussed the methodologies in sufficient details so that they can be very easily implemented. The book being very focused on a particular topic, it is mostly self contained. One does not require a very strong background in image pro- cessing to appreciate the contents of the book. However, some knowledge on image restoration would definitely help. The contributors of this book would be happy if the readers find the book to be useful. I would very much appreciate if readers send me some constructive suggestions. Acknowledgments I would like to express my sincere thanks to all authors for readily agreeing to my request to participate in this exercise and for their excel- lent contributions. It was wonderful that I did not have to send too many reminders to the contributors for their submissions. Thanks are also due to Jennifer Evans and Anne Murray of Kluwer Academic Publishers for their constant help and encouragement. They allowed me liberal exten- sions of deadlines whenever I needed. I should also thank my student Deepu Rajan for helping me in typesetting the book. Some financial support from the Curriculum Development Programme at IIT Bombay is gratefully acknowledged. My acknowledgments would be incomplete if I do not thank three most important people in my life – Sucharita, Ushasi and Syomantak for their understanding and support during the period of preparation for this book. It is not very common to write a dedication for an edited book. Yet I could not help but to do so. For the last few years I had to helplessly watch my father surrendering to the wrath of Parkinson’s disease. He lost his all forms of communication – the very precious thing he incul- cated in me since my childhood days. He breathed his last just three weeks ago. I dedicate this book to all such sufferers of Parkinson’s dis- ease. SUBHASIS CHAUDHURI Contributing Authors Kiyoharu Aizawa, Department of Electrical Engineering, The Univer- sity of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8656, Japan. [email protected] Simon Baker, Robotics Institute, Carnegie Mellon University, Pitts- burgh, PA 15213, USA. [email protected] Terrance E. Boult, Weisman Chair Professor and Chairman, Com- puter Science and Engineering Department, Lehigh University, Pennsyl- vania, USA. [email protected] Subhasis Chaudhuri Department of Electrical Engineering, Indian Institute of Technology-Bombay, Powai, Mumbai-400 076. India. [email protected] Ming-Chao Chiang, Computer Science and Engineering Department, Lehigh University, Pennsylvania, USA. [email protected] Uday B. Desai, Department of Electrical Engineering, Indian Institute of Technology, Bombay, Mumbai 400 076, India. [email protected] Nikolas P. Galatsanos, Department of Electrical and Computer En- gineering, Illinois Institute of Technology, Chicago, IL 60616, USA. [email protected] xii SUPER-RESOLUTION IMAGING Takeo Kanade, Robotics Institute, Carnegie Mellon University, Pitts- burgh, PA 15213, USA. [email protected] Aggelos Katsaggelos, Department of Electrical and Computer Engi- neering, Northwestern University, Evanston, IL 60208. USA. [email protected] Narasimha Kaulgud, Department of Electronics and Communica- tions, SJ College of Engineering, Mysore 570 006, India. [email protected] Takashi Komatsu, Department of Electrical Engineering, Kanagawa University, 3-27-1 Rokkakubashi,Kanagwa-ku, Yokohama,221-8686,Japan. [email protected] Javier Mateos, Departamento de Ciencias de la Computación, Univer- sidad de Granada, 18071 Granada, Spain. [email protected] Ross J. Micheals, Computer Science and Engineering Department, Lehigh University, Pennsylvania, USA. [email protected] Rafael Molina, Departamento de Ciencias de la Computación, Univer- sidad de Granada, 18071 Granada, Spain.
Load more

Recommended publications
  • A Novel Edge-Preserving Mesh-Based Method for Image Scaling
    A Novel Edge-Preserving Mesh-Based Method for Image Scaling Seyedali Mostafavian and Michael D. Adams Dept. of Electrical and Computer Engineering, University of Victoria, Victoria, BC V8P 5C2, Canada [email protected] and [email protected] Abstract—In this paper, we present a novel image scaling no loss of image quality. One main problem in vector-based method that employs a mesh model that explicitly represents interpolation methods, however, is how to create a vector discontinuities in the image. Our method effectively addresses model which faithfully represents the raster image data and its the problem of preserving the sharpness of edges, which has always been a challenge, during image enlargement. We use important features such as edges. Among the many techniques a constrained Delaunay triangulation to generate the model to generate a vector image from a raster image, triangle and an approximating function that is continuous everywhere mesh models have become quite popular. With a triangle-mesh except across the image edges (i.e., discontinuities). The model model, the image domain is partitioned into a set of non- is then rasterized using a subdivision-based technique. Visual overlapping triangles called a triangulation. Then, the image comparisons and quantitative measures show that our method can greatly reduce the blurring artifacts that can arise during intensity function is approximated over each of the triangles. image enlargement and produce images that look more pleasant A mesh-generation method is required to choose a good subset to human observers, compared to the well-known bilinear and of sample points and to collect any critical data from the input bicubic methods.
    [Show full text]
  • Color Page Effects Chapter 116 Davinci Resolve Control Panels
    PART 9 Color Page Effects Chapter 116 DaVinci Resolve Control Panels The DaVinci Resolve control panels make it easier to make more adjustments in the same amount of time than using a mouse, pen, or trackpad with the on-screen interface. Additionally, using a DaVinci Resolve control panel to control the Color page provides vastly superior ergonomic comfort to clutching a mouse or pen all day, which is important when you’re potentially grading a thousand shots per day. This chapter covers details about the three DaVinci Resolve control panels that are available, and how they work with DaVinci Resolve. Chapter – 116 DaVinci Resolve Control Panels 2258 Contents About The DaVinci Resolve Control Panels 2260 DaVinci Resolve Micro Panel 2261 Trackballs 2261 Control Knobs 2262 Control Buttons 2263 DaVinci Resolve Mini Panel 2265 Palette Selection Buttons 2265 Quick Selection Buttons 2266 DaVinci Resolve Advanced Control Panel 2268 Menus, Soft Keys, and Soft Knob Controls 2268 Trackball Panel 2269 T-bar Panel 2270 Transport Panel 2276 Copying Grades Using the Advanced Control Panel 2280 Copy Forward Keys 2280 Scroll 2280 Rippling Changes Using the Advanced Control Panel 2281 Chapter – 116 DaVinci Resolve Control Panels 2259 About The DaVinci Resolve Control Panels There are three DaVinci Resolve control panel options available and each are designed to meet modern workflow ergonomics and ease of use so colorists can quickly and accurately construct both simple and complex creative grades with minimal fatigue. This chapter provides details of the each of the panel functions and should be read in conjunction with the previous grading chapters to get the best from your panel.
    [Show full text]
  • Apparent Display Resolution Enhancement for Moving Images
    Apparent Display Resolution Enhancement for Moving Images Piotr Didyk1 Elmar Eisemann1;2 Tobias Ritschel1 Karol Myszkowski1 Hans-Peter Seidel1 1 MPI Informatik 2 Telecom ParisTech / CNRS-LTCI / Saarland University Frame 1 Frame 2 Frame 3 Retina Lanczos Frame 1 Frame 2 Frame 3 Retina Lanczos Frame 1 Frame 2 Frame 3 Retina Lanczos Figure 1: Depicting fine details such as hair (left), sparkling car paint (middle) or small text (right) on a typical display is challenging and often fails if the display resolution is insufficient. In this work, we show that smooth and continuous subpixel image motion can be used to increase the perceived resolution. By sequentially displaying varying intermediate images at the display resolution (as depicted in the bottom insets), subpixel details can be resolved at the retina in the region of interest due to fixational eye tracking of this region. Abstract and images are skillfully tone and gamut mapped to adapt them to the display’s capabilities, these limitations persist. In order to Limited spatial resolution of current displays makes the depiction of surmount the physical limitations of display devices, modern algo- very fine spatial details difficult. This work proposes a novel method rithms started to exploit characteristics of the human visual system applied to moving images that takes into account the human visual (HVS) such as apparent image contrast [Purves et al. 1999] based on system and leads to an improved perception of such details. To this the Cornsweet Illusion or apparent brightness [Zavagno and Caputo end, we display images rapidly varying over time along a given tra- 2001] due to glare.
    [Show full text]
  • Rk3026 Brief
    BRIEF RK3026 RK3026 BRIEF Revision 1.1 Public Version August 2013 High Performance and Low-power Processor for Digital Media Application - 1 - BRIEF RK3026 Revision History This document is now Production Data. Date Revision Description 2013-08-28 1.0 Initial Release 2013-10-17 1.1 Update “512MB” to “1GB” High Performance and Low-power Processor for Digital Media Application - 2 - BRIEF RK3026 Content Content................................................................................................................................................................- 3 - chapter 1 Introduction......................................................................................................................- 5 - 1.1 Overview.....................................................................................................................................- 5 - 1.2 Features......................................................................................................................................- 5 - 1.3 Block Diagram..........................................................................................................................- 15 - High Performance and Low-power Processor for Digital Media Application - 3 - BRIEF RK3026 Warranty Disclaimer Rockchip Electronics Co.,Ltd makes no warranty, representation or guarantee (expressed, implied, statutory, or otherwise) by or with respect to anything in this document, and shall not be liable for any implied warranties of non-infringement, merchantability or fitness for a particular
    [Show full text]
  • RK3066 Datasheet Brief
    RK3066 Datasheet brief RK3066 Datasheet brief Rev1.0 RK3066 Datasheet brief Revision 1.0 Feb. 2012 Rockchips Confidential 1 Date Revision Description Revision History RK3066 Datasheet brief Rev1.0 Revision History Date Revision Description 2011-10-30 0.0 Initial Release 2012-02-15 1.0 Add package information Rockchips Confidential 2 TABLE OF CONTENT RK3066 Datasheet brief Rev1.0 TABLE OF CONTENT Revision History....................................................................................2 TABLE OF CONTENT.............................................................................. 3 Chapter 1 Introduction...............................................................4 1.1 Overview.......................................................................4 1.2 Features........................................................................4 1.3 Block Diagram..............................................................15 Chapter 2 Package information..................................................16 2.1 Dimension................................................................... 16 2.2 Ball Map...................................................................... 18 2.3 Pin Number Order.........................................................21 2.4 RK3066 power/ground IO descriptions.............................26 2.5 RK3066 function IO descriptions..................................... 28 Chapter 3 Electrical Specification............................................... 40 3.1 Absolute Maximum Ratings...........................................
    [Show full text]
  • Mesh Models of Images, Their Generation, and Their Application in Image Scaling
    Mesh Models of Images, Their Generation, and Their Application in Image Scaling by Ali Mostafavian B.Sc., Iran University of Science and Technology, 2007 M.Sc., Sharif University of Technology, 2009 A Dissertation Submitted in Partial Fulfillment of the Requirements for the Degree of DOCTOR OF PHILOSOPHY in the Department of Electrical and Computer Engineering c Ali Mostafavian, 2019 University of Victoria All rights reserved. This dissertation may not be reproduced in whole or in part, by photocopying or other means, without the permission of the author. ii Mesh Models of Images, Their Generation, and Their Application in Image Scaling by Ali Mostafavian B.Sc., Iran University of Science and Technology, 2007 M.Sc., Sharif University of Technology, 2009 Supervisory Committee Dr. Michael D. Adams, Supervisor (Department of Electrical and Computer Engineering) Dr. Pan Agathoklis, Departmental Member (Department of Electrical and Computer Engineering) Dr. Venkatesh Srinivasan, Outside Member (Department of Computer Science) iii ABSTRACT Triangle-mesh modeling, as one of the approaches for representing images based on nonuniform sampling, has become quite popular and beneficial in many applications. In this thesis, image representation using triangle-mesh models and its application in image scaling are studied. Consequently, two new methods, namely, the SEMMG and MIS methods are proposed, where each solves a different problem. In particular, the SEMMG method is proposed to address the problem of image representation by producing effective mesh models that are used for representing grayscale images, by minimizing squared error. The MIS method is proposed to address the image- scaling problem for grayscale images that are approximately piecewise-smooth, using triangle-mesh models.
    [Show full text]
  • Extensible Implementation of Reliable Pixel Art Interpolation
    F O U N D A T I O N S O F C O M P U T I N G A N D D E C I S I O N S C I E N C E S Vol. 44 (2019) No. 2 ISSN 0867-6356 DOI: 10.2478/fcds-2019-0011 e-ISSN 2300-3405 Extensible Implementation of Reliable Pixel Art Interpolation Paweł M. Stasik, Julian Balcerek ∗ y Abstract. Pixel art is aesthetics that emulates the graphical style of old computer systems. Graphics created with this style needs to be scaled up for presentation on modern displays. The authors proposed two new modifications of image scaling for this purpose: a proximity-based coefficient correction and a transition area restriction. Moreover a new interpolation kernel has been introduced. The presented approaches are aimed at reliable and flexible bitmap scaling while overcoming limitations of exist- ing methods. The new techniques were introduced in an extensible .NET application that serves as both an executable program and a library. The project is designed for prototyping and testing interpolation operations and can be easily expanded with new functionality by adding it to the code or by using the provided interface. Keywords: image processing, pixel art, image upscaling, bitmap interpolation, proximity measure, proximity-based coefficient correction (PBCC), p-lin interpola- tion, transition area restriction (TAR) 1. Introduction Old computer systems, in comparison to modern systems, were heavily restricted in their graphical capabilities (in the sense of the amount of available colors and the possible resolutions). Pixel art is an artistic form that was aimed at handling these limitations, but them should not prevent it from being presented with graphical possibilities of the modern systems.
    [Show full text]
  • Use Style: Paper Title
    I.J. Image, Graphics and Signal Processing, 2013, 5, 55-62 Published Online April 2013 in MECS (http://www.mecs-press.org/) DOI: 10.5815/ijigsp.2013.05.07 A Comparative Analysis of Image Scaling Algorithms Chetan Suresh Department of Electrical and Electronics Engineering, BITS Pilani Pilani - 333031, Rajasthan, India E-mail: [email protected] Sanjay Singh, Ravi Saini, Anil K Saini Scientist, IC Design Group, CSIR – Central Electronics Engineering Research Institute (CSIR-CEERI) Pilani – 333031, Rajasthan, India Abstract— Image scaling, fundamental task of to the same input image. Some of the common numerous image processing and computer vision interpolation algorithms are the nearest neighbour, applications, is the process of resizing an image by pixel bilinear [7], and bicubic [8]-[9]. Lanczos algorithm interpolation. Image scaling leads to a number of utilizes the 3-lobed Lanczos window function to undesirable image artifacts such as aliasing, blurring and implement interpolation [10]. moiré. However, with an increase in the number of There are many other higher order interpolators which pixels considered for interpolation, the image quality take more surrounding pixels into consideration, and improves. This poses a quality-time trade off in which thus also require more computations. These algorithms high quality output must often be compromised in the include spline [11] and sinc interpolation [12], and retain interest of computation complexity. This paper presents the most of image details after an interpolation. They are a comprehensive study and comparison of different extremely useful when the image requires multiple image scaling algorithms. The performance of the rotations/distortions in separate steps. However, for scaling algorithms has been reviewed on the basis of single-step enlargements or rotations, these higher-order number of computations involved and image quality.
    [Show full text]
  • Image Interpolation Techniques for Image Scaling
    ISSN(Online): 2320-9801 ISSN (Print): 2320-9798 International Journal of Innovative Research in Computer and Communication Engineering (An ISO 3297: 2007 Certified Organization) Vol. 2, Issue 12, December 2014 A Review: Image Interpolation Techniques for Image Scaling Prof. PankajS. Parsania1, Dr. Paresh V.Virparia2 Assistant Professor, College of FPTBE, Anand Agricultural University, Anand, Gujarat, India1 Director, Department of Computer Science, Sardar Patel University, VallabhVidyanagar, Gujarat, India2 ABSTRACT: The growing interest in image scaling is mainly due to the availability of digital imaging devices such as, digital cameras, digital camcorders, 3G mobile handsets, high definition monitors etc. Scaling a digital image is a demanding and very important area of research. Image scaling is an important image processing operation applied in diverse areas in computer graphics. Image scaling can be especially useful when one needs to reduce image file size for email and web documents or increase image size for printing, GIS observation, medical diagnostic etc. With the recent advances in imaging technology, digital images have become an important component of media distribution. In addition, a variety of displays can be used for image viewing, ranging fromhigh-resolution computer monitors to TV screens and low-resolution mobile devices.This paper is focused on different image scaling techniqueswith intent that review to be useful to researchers and practitioners interested in image Scaling. KEYWORDS: Image Scaling, interpolation, Non-adaptive techniques, adaptive techniques, Context aware image resizing, Segmentation-Based, Seam Carving, Warping-Based Methods. I. INTRODUCTION Technology for display devices are growing very fast, an image often needs to be displayed across various size with different aspect ratios.
    [Show full text]
  • An Introduction to Ffmpeg, Davinci Resolve, Timelapse and Fulldome Video Production, Special Effects, Color Grading, Streaming
    An Introduction to FFmpeg, DaVinci Resolve, Timelapse and Fulldome Video Production, Special Effects, Color Grading, Streaming, Audio Processing, Canon 5D-MK4, Panasonic LUMIX GH5S, Kodak PIXPRO SP360 4K, Ricoh Theta V, Synthesizers, Image Processing and Astronomy Software by Michael Koch, [email protected] Version from October 7, 2021 1 Contents 1 Introduction to FFmpeg .............................................................................. 9 2.27 Sharpen or blur images .................................................................. 57 1.1 What can be done with FFmpeg? .................................................... 11 2.28 Extract a time segment from a video ............................................. 58 1.2 If FFmpeg has no graphical user interface, how do we use it? .... 12 2.29 Trim filter ......................................................................................... 59 1.3 The first example .............................................................................. 14 2.30 Tpad filter, add a few seconds black at the beginning or end .... 60 1.4 Using variables ................................................................................. 15 2.31 Extract the last 30 seconds of a video .......................................... 61 2 FFmpeg in detail ....................................................................................... 16 2.32 Fade-in and fade-out ....................................................................... 62 2.1 Convert from one video format to another video
    [Show full text]
  • Deep Learning for Image Super-Resolution: a Survey
    1 Deep Learning for Image Super-resolution: A Survey Zhihao Wang, Jian Chen, Steven C.H. Hoi, Fellow, IEEE Abstract—Image Super-Resolution (SR) is an important class of image processing techniques to enhance the resolution of images and videos in computer vision. Recent years have witnessed remarkable progress of image super-resolution using deep learning techniques. This article aims to provide a comprehensive survey on recent advances of image super-resolution using deep learning approaches. In general, we can roughly group the existing studies of SR techniques into three major categories: supervised SR, unsupervised SR, and domain-specific SR. In addition, we also cover some other important issues, such as publicly available benchmark datasets and performance evaluation metrics. Finally, we conclude this survey by highlighting several future directions and open issues which should be further addressed by the community in the future. Index Terms—Image Super-resolution, Deep Learning, Convolutional Neural Networks (CNN), Generative Adversarial Nets (GAN) F 1 INTRODUCTION MAGE super-resolution (SR), which refers to the process and strategies [8], [31], [32], etc. I of recovering high-resolution (HR) images from low- In this paper, we give a comprehensive overview of re- resolution (LR) images, is an important class of image cent advances in image super-resolution with deep learning. processing techniques in computer vision and image pro- Although there are some existing SR surveys in literature, cessing. It enjoys a wide range of real-world applications, our work differs in that we are focused in deep learning such as medical imaging [1], [2], [3], surveillance and secu- based SR techniques, while most of the earlier works [33], rity [4], [5]), amongst others.
    [Show full text]
  • A Study on Ffmpeg Multimedia Framework H
    International Journal of Trend in Scientific Research and Development (IJTSRD) Volume 5 Issue 4, May-June 2021 Available Online: www.ijtsrd.com e-ISSN: 2456 – 6470 A Study on FFmpeg Multimedia Framework H. Sumesh Singha 1, Dr. Bhuvana J 2 1Master of Computer Science Applications (SCT), 2Associate Professor, 1,2 Jain Deemed-to-be University, Bengaluru, Karnataka, India ABSTRACT How to cite this paper : H. Sumesh Singha With the advancement in internet technology, everyone has access to the | Dr. Bhuvana J "A Study on FFmpeg internet. After google, YouTube is the second largest search engine and Multimedia Framework" Published in approximately 1 billion hours are consumed by people to watch video International Journal contents on YouTube. Editing the video and processing is not very easy. of Trend in Scientific Network also plays an important role. With an unsteady network it can cause Research and video to buffer which can reduce the streaming experience of users. Many Development (ijtsrd), people don’t even have a good computer which can handle the editing of large ISSN: 2456-6470, video files as editing and processing the video utilizes hardware, software and Volume-5 | Issue-4, both. Many video editing software are available on the internet. Either it can June 2021, pp.580- IJTSRD42362 be paid or open-source software. One of the most popular open-source 584, URL: software available on the internet is FFmpeg (Fast Forward Moving Picture www.ijtsrd.com/papers/ijtsrd42362.pdf Expert Group). FFmpeg with other various software together can be used for video forensic to find traces in videos.
    [Show full text]