Inverse Problems in Image Processing: Blind Image Restoration

Total Page:16

File Type:pdf, Size:1020Kb

Inverse Problems in Image Processing: Blind Image Restoration University of Tennessee, Knoxville TRACE: Tennessee Research and Creative Exchange Masters Theses Graduate School 8-2005 Inverse Problems in Image Processing: Blind Image Restoration Ravi Viswanathan University of Tennessee - Knoxville Follow this and additional works at: https://trace.tennessee.edu/utk_gradthes Part of the Engineering Commons Recommended Citation Viswanathan, Ravi, "Inverse Problems in Image Processing: Blind Image Restoration. " Master's Thesis, University of Tennessee, 2005. https://trace.tennessee.edu/utk_gradthes/2546 This Thesis is brought to you for free and open access by the Graduate School at TRACE: Tennessee Research and Creative Exchange. It has been accepted for inclusion in Masters Theses by an authorized administrator of TRACE: Tennessee Research and Creative Exchange. For more information, please contact [email protected]. To the Graduate Council: I am submitting herewith a thesis written by Ravi Viswanathan entitled "Inverse Problems in Image Processing: Blind Image Restoration." I have examined the final electronic copy of this thesis for form and content and recommend that it be accepted in partial fulfillment of the requirements for the degree of Master of Science, with a major in Engineering Science. Mohamed R. Mahfouz, Major Professor We have read this thesis and recommend its acceptance: Anthony E. English, Aly Fathy Accepted for the Council: Carolyn R. Hodges Vice Provost and Dean of the Graduate School (Original signatures are on file with official studentecor r ds.) To the Graduate Council: I am submitting herewith a thesis written by Ravi Viswanathan entitled "Inverse Problems in Image Processing: Blind Image Restoration." I have examined the final electronic copy of this thesis for form and content and recommend that it be accepted in partial fulfillment of the requirements for the degree of Master of Science, with a major in Engineering Science. Mohamed R. Mahfouz__ Major Professor We have read this thesis and recommend its acceptance: Anthony E. English_______________ Aly Fathy ______________________ Accepted for the Council: Anne Mayhew___________ Vice Chancellor and Dean of Graduate Studies (Original signatures are on file with official student records.) INVERSE PROBLEMS IN IMAGE PROCESSING: BLIND IMAGE RESTORATION A Thesis Presented for the Master of Science Degree The University of Tennessee, Knoxville Ravi Viswanathan August 2005 Acknowledgements I am indebted to my energetic advisor Prof. Mohamed R. Mahfouz for constantly encouraging me in my research focus and making my UT experience truly enlightening. I am also grateful to my other thesis committee members Prof. Anthony E. English and Prof. Aly Fathy for stimulating discussions and valuable comments. Thanks also go to UT faculty and students whose creative energy and ideas helped discover the creative self in me. Many thanks to my group of friends who have helped keep my spirits high. Thanks mom, dad and Jai. You guys were my prime source of strength. ii Abstract Blind Image Restoration pertains to the estimation of degradation in an image, without any prior knowledge of the degradation system, and using this estimation to help restore the original image. Original Image, in this case, refers to that version of the image before it experienced degradation. In this thesis, after estimating the degradation system in the form of Gaussian blur and noise, we employ Deconvolution to help restore the original image. In this thesis, we use a Redundant Wavelet based technique to estimate blur in the image using high-frequency information in the image itself. Lipschitz exponent – a measure of local regularity of signals, is computed using the evolution of wavelet coefficients of singularities across scales. It has been shown before that this exponent is related to the blur in the image and we use it in this case to estimate the standard deviation of the Gaussian blur. The properties of wavelets enable us to compute the noise variance in the image. In this thesis, we employ two cases of deconvolution – A strictly Fourier domain Regularized Iterative Wiener filtering approach and A Fourier-Wavelet Cascaded approach with Regularized Iterative Wiener filtering - to compute an estimate of the image to be restored using the blur and noise variance information that was earlier computed. The estimated value of standard deviation of the blur helped obtain robust estimates with deconvolution. It can be observed from the results that Fourier domain Regularized Iterative Wiener filtering provides a more stable output estimate than the Iterative Filtering with Additive Correction methods, especially when the number of iterations employed is more. The Fourier-Wavelet Cascaded deconvolution seems to be iii image dependent with regards to performance although it outperforms the strictly Fourier domain deconvolution approach in some cases, as can be gauged from the visual quality and Mean Squared Error. iv Contents 1 Introduction 1 1.1 Blind Image Restoration………………………………………………………..1 1.2 Image Deconvolution: Biomedical Applications……………………………….3 2 PSF Estimation 4 2.1 Blur – A Mathematical Representation……………………………….………..4 2.2 Principle for Blur Estimation…………………………………………………...5 2.3 The Wavelet Transform………………………………………………………...7 2.3.1 Why Wavelets…………………………………………………………….9 2.3.2 The Discrete Wavelet Transform………………………………………...10 2.3.4 Economy of Wavelet Representations…………………………………...12 2.4 Mallat’s Relationships – The Lipschitz Exponent…...…………………………12 2.4.1 Definition I……………………………………………………………….13 2.4.2 Definition II……………………………………………………………...14 2.4.3 Vanishing Moments……………………………………………………...15 2.5 Singularity Detection…………………………………………………………...15 2.6 Wavelet Transform Modulus Maxima………………………………………….16 2.7 Modulus Maxima and Lipschitz Exponent – The Relationship………..……….16 2.8 Computation of Lipschitz Exponent…………………………………...……….17 2.9 Blur and Lipschitz Exponent – The Relationship…………………………...….20 2.10 Computation of Constants…………………………………………….……….22 2.11 Implementation Summary……………………………………………………..26 v 3 Fourier Domain Deconvolution 29 3.1 Problem Statement…………………………………………………………......29 3.2 Computation of Noise Variance…………………………………………….....30 3.3 Linear Time Invariant Wiener Filtering………………………………………..30 3.4 Regularized Deconvolution………………………………………….………...32 3.4.1 Choice of Shrinkage Term……………………………………………….33 3.5 Fourier Domain Filtering…………………………………………….………...33 3.5.1 Inverse Filtering ………………………………………………………....34 3.5.2 Wiener Filtering ………………………………………………………....34 3.5.3 Regularized Fourier Domain Wiener Filtering……………………….….35 3.5.4 Iterative Wiener Filtering…………………………………………….….37 3.5.5 Iterative Wiener Filtering with Additive Correction…………………….40 4 Fourier Wavelet Cascaded Deconvolution 44 4.1 Deconvolution – A Cascaded Approach…...………………………………....44 4.2 Experiment Outline…………………………………………………………...45 4.3 The Experiment…………………………………………………….………....45 4.3.1 Noise Computation…………………………………………………......46 4.3.2 Initial Experimental Set-up………………………………………….....46 4.3.3 Fourier Domain Shrinkage……………………………………………..48 4.3.4 Need for Wavelet Domain Shrinkage…………………………………..48 4.3.5 Wavelet Domain Set-up………………………………………………...49 4.3.6 Wavelet Domain Deconvolution………………………………………..49 4.3.6.1 Hard Thresholding……………………………………………...50 4.3.6.2 Soft Thresholding………………………………………….…...51 4.3.6.3 Donoho Approach………………………………………….…...51 4.3.6.4 Multi-resolution Wiener Filtering………………………….…...52 4.3.7 Wiener Wavelet Filtering……………………………………………......53 vi 4.3.8 Final Filtering Mechanism………………………………………….….54 4.4 Technical Summary…………………………………………………………..57 5 Results and Conclusion 60 5.1 PSF Estimation…………………………………………………………….60 5.2 Deconvolution Results…………………………………………………….65 5.2.1 Fourier Domain Wiener Filtering…………………………………..65 5.2.2 Fourier Wavelet Cascaded Deconvolution………………………....68 5.3 Deconvolution on the Test Image………………………………………....70 5.4 Conclusion……………………………………………………….………..74 Bibliography 79 Vita 83 vii List of Tables 5.1 Estimated values of standard deviation for training images………………………63 5.2 Standard Deviation values of applied blur and estimated blur for test image…….65 viii List of Figures 2.1 Degradation of an image by LTI system followed by additive noise……………..4 2.2 Evolution of wavelet coefficients across scales…………………………………...6 2.3 Experimental flow………………………………………………………………....7 2.4 Signal analysis in different domains……………………………………………...8 2.5 Discrete Wavelet Transform on an image………………………………………..12 2.6 Fitting at dyadic powers………………………………………………………….18 2.7 Exponential fitting curve…………………………………………………………22 2.8 Double Exponential fitting curve………………………………………………...24 2.9 Image Restoration results for training image with different blur estimates……...25 2.10 Image Restoration results for test image with different blur estimates………....27 3.1 Image degradation process….…………………………………………………....33 3.2 Trivial Wiener filtering results…………………………………………………...36 3.3 Iterative Wiener filtering estimates………………………………………………43 4.1 Fourier-Wavelet Cascaded Deconvolution model………………………………..44 4.2: Corrupting a zero intensity image with Gaussian noise…………………………50 4.3 Fourier and Fourier-Wavelet Cascaded filtering estimates………………………58 5.1 Applied blur vs. estimated blur for training images using exp1 fitting …....….....61 5.2 Applied blur vs. estimated blur for training images using exp2 fitting …..…..….62 5.3 Actual Blur vs. Estimated Blur for the test image………………………………..64 5.4 Fourier Domain Iterative Wiener Filtering for training image …………………..66 5.5 RMSE between original image and
Recommended publications
  • Blind Image Deconvolution of Linear Motion Blur
    Blind image deconvolution of linear motion blur Florian Brusius, Ulrich Schwanecke, and Peter Barth RheinMain University of Applied Sciences, Wiesbaden, Germany Abstract. We present an efficient method to deblur images for informa- tion recognition. The method is successfully applied directly on mobile devices as a preprocessing phase to images of barcodes. Our main con- tribution is the fast identifaction of blur length and blur angle in the fre- quency domain by an adapted radon transform. As a result, the barcode recognition rate of the deblurred images has been increased significantly. Keywords: Blind deconvolution, image restoration, deblurring, motion blur estimation, barcodes, mobile devices, radon transform 1 Introduction Increasingly, mobile smartphone cameras are used as alternative input devices providing context information { most often in the form of barcodes. The pro- cessing power of smartphones has reached a state to allow to recognise all kinds of visually perceptible information, like machine-readable barcode tags and the- oretically even printed text, shapes, and faces. This makes the camera act as an one-click link between the real world and the digital world inside the device [9]. However, to reap the benefits of this method the image has to be correctly recognised under various circumstances. This depends on the quality of the cap- tured image and is therefore highly susceptible to all kinds of distortions and noise. The photographic image might be over- or underexposed, out of focus, perspectively distorted, noisy or blurred by relative motion between the camera and the imaged object. Unfortunately, all of those problems tend to occur even more on very small cameras.
    [Show full text]
  • Blind PSF Estimation and Methods of Deconvolution Optimization
    Blind PSF estimation and methods of deconvolution optimization Yu A Bunyak1, O Yu Sofina2 and R N Kvetnyy2 1InnoVinn Inc. Vinnitsa, Ukraine 2Vinnitsa National Technical University, Vinnitsa, Ukraine E-mail: [email protected] Abstract. We have shown that the left side null space of the autoregression (AR) matrix operator is the lexicographical presentation of the point spread function (PSF) on condition the AR parameters are common for original and blurred images. The method of inverse PSF evaluation with regularization functional as the function of surface area is offered. The inverse PSF was used for primary image estimation. Two methods of original image estimate optimization were designed basing on maximum entropy generalization of sought and blurred images conditional probability density and regularization. The first method uses balanced variations of convolution and deconvolution transforms to obtaining iterative schema of image optimization. The variations balance was defined by dynamic regularization basing on condition of iteration process convergence. The regularization has dynamic character because depends on current and previous image estimate variations. The second method implements the regularization of deconvolution optimization in curved space with metric defined on image estimate surface. It is basing on target functional invariance to fluctuations of optimal argument value. The given iterative schemas have faster convergence in comparison with known ones, so they can be used for reconstruction of high resolution images series in real time. 1. Introduction Many modern applications need real time reconstruction of high resolution images of some millions pixels size, which are corrupted by defocusing, medium penetration, camera jitter and other factors. Usually, the model of corruption is presented as convolution of original image signal and point spread function (PSF) [5, 23, 27].
    [Show full text]
  • Chapter 15 - BLIND SOURCE SEPARATION: Principal & Independent Component Analysis C G.D
    HST-582J/6.555J/16.456J Biomedical Signal and Image Processing Spring 2008 Chapter 15 - BLIND SOURCE SEPARATION: Principal & Independent Component Analysis c G.D. Clifford 2005-2008 Introduction In this chapter we will examine how we can generalize the idea of transforming a time series into an alternative representation, such as the Fourier (frequency) domain, to facil- itate systematic methods of either removing (filtering) or adding (interpolating) data. In particular, we will examine the techniques of Principal Component Analysis (PCA) using Singular Value Decomposition (SVD), and Independent Component Analysis (ICA). Both of these techniques utilize a representation of the data in a statistical domain rather than a time or frequency domain. That is, the data are projected onto a new set of axes that fulfill some statistical criterion, which implies independence, rather than a set of axes that represent discrete frequencies such as with the Fourier transform, where the independence is assumed. Another important difference between these statistical techniques and Fourier-based tech- niques is that the Fourier components onto which a data segment is projected are fixed, whereas PCA- or ICA-based transformations depend on the structure of the data being ana- lyzed. The axes onto which the data are projected are therefore discovered. If the structure of the data (or rather the statistics of the underlying sources) changes over time, then the axes onto which the data are projected will change too1. Any projection onto another set of axes (or into another space) is essentially a method for separating the data out into separate components or sources which will hopefully allow us to see important structure more clearly in a particular projection.
    [Show full text]
  • Revisiting Bayesian Blind Deconvolution
    Journal of Machine Learning Research 15 (2014) 3775-3814 Submitted 5/13; Revised 5/14; Published 11/14 Revisiting Bayesian Blind Deconvolution David Wipf [email protected] Visual Computing Group Microsoft Research Building 2, No. 5 Danling Street Beijing, P.R. China, 100080 Haichao Zhang [email protected] School of Computer Science Northwestern Polytechnical University 127 West Youyi Road Xi'an, P.R. China, 710072 Editor: Lawrence Carin Abstract Blind deconvolution involves the estimation of a sharp signal or image given only a blurry observation. Because this problem is fundamentally ill-posed, strong priors on both the sharp image and blur kernel are required to regularize the solution space. While this naturally leads to a standard MAP estimation framework, performance is compromised by unknown trade-off parameter settings, optimization heuristics, and convergence issues stemming from non-convexity and/or poor prior selections. To mitigate some of these problems, a number of authors have recently proposed substituting a variational Bayesian (VB) strategy that marginalizes over the high-dimensional image space leading to better estimates of the blur kernel. However, the underlying cost function now involves both in- tegrals with no closed-form solution and complex, function-valued arguments, thus losing the transparency of MAP. Beyond standard Bayesian-inspired intuitions, it thus remains unclear by exactly what mechanism these methods are able to operate, rendering un- derstanding, improvements and extensions more difficult. To elucidate these issues, we demonstrate that the VB methodology can be recast as an unconventional MAP problem with a very particular penalty/prior that conjoins the image, blur kernel, and noise level in a principled way.
    [Show full text]
  • Deep Wiener Deconvolution: Wiener Meets Deep Learning for Image Deblurring
    Deep Wiener Deconvolution: Wiener Meets Deep Learning for Image Deblurring Jiangxin Dong Stefan Roth MPI Informatics TU Darmstadt [email protected] [email protected] Bernt Schiele MPI Informatics [email protected] Abstract We present a simple and effective approach for non-blind image deblurring, com- bining classical techniques and deep learning. In contrast to existing methods that deblur the image directly in the standard image space, we propose to perform an explicit deconvolution process in a feature space by integrating a classical Wiener deconvolution framework with learned deep features. A multi-scale feature re- finement module then predicts the deblurred image from the deconvolved deep features, progressively recovering detail and small-scale structures. The proposed model is trained in an end-to-end manner and evaluated on scenarios with both simulated and real-world image blur. Our extensive experimental results show that the proposed deep Wiener deconvolution network facilitates deblurred results with visibly fewer artifacts. Moreover, our approach quantitatively outperforms state-of-the-art non-blind image deblurring methods by a wide margin. 1 Introduction Image deblurring is a classical image restoration problem, which has attracted widespread atten- tion [e.g.,1,3,9, 10, 56]. It is usually formulated as y = x ∗ k + n; (1) where y; x; k, and n denote the blurry input image, the desired clear image, the blur kernel, and image noise, respectively. ∗ is the convolution operator. Traditional methods usually separate this problem arXiv:2103.09962v1 [cs.CV] 18 Mar 2021 into two phases, blur kernel estimation and image restoration (i.e., non-blind image deblurring).
    [Show full text]
  • Blind Deconvolution and Adaptive Algorithms for De-Reverberation
    Master Thesis Electrical Engineering with Emphasis on signal processing BLIND DECONVOLUTION AND ADAPTIVE ALGORITHMS FOR DE-REVERBERATION Suryavamsi Atresya Uppaluru Supervisor: Dr. Nedelko Grbic Examiner: Dr. Benny Sällberg Department of Signal Processing School of Engineering (ING) Blekinge Institute of Technology i This thesis is submitted to the School of Engineering at Blekinge Institute of Technology (BTH) in partial fulfillment of the requirements for the degree of Master of Science in Electrical Engineering with emphasis on Signal Processing. Contact Information: Author: Suryavamsi Atresya Uppaluru E-mail: [email protected] Supervisor: Dr. Nedelko Grbic School of Engineering (ING) E-mail: [email protected] Phone: +46 455 38 57 27 Examiner: Dr. Benny Sällberg School of Engineering (ING) E-mail: [email protected] Phone: +46 455 38 55 87 School of Engineering Blekinge Institute of Technology Internet: www.bth.se/ing 371 79 Karlskrona Phone: +46 455 38 50 00 Sweden. Fax: +46 455 38 50 57 ii ACKNOWLEDGEMENT I would like to express sincere gratitude to our Supervisor Dr.Nedelko Gribic for his sagacious guidance and scholarly advice which enabled us to complete the thesis. I humbly thank the examiner Dr. Benny Sallberg for the encouragement and support. I express my deep gratitude to my parents in particular and my family who always reinforced every effort of mine. I would like to thank God and my friends for giving me constant support in every endeavor of mine. I would like to express my gratitude towards everyone who contributed their precious time and effort to help me, with whom I could complete my thesis successfully.
    [Show full text]
  • Channel Equalization and Blind Deconvolution
    Advanced Digital Signal Processing and Noise Reduction, Second Edition. Saeed V. Vaseghi Copyright © 2000 John Wiley & Sons Ltd ISBNs: 0-471-62692-9 (Hardback): 0-470-84162-1 (Electronic) 15 CHANNEL EQUALIZATION AND BLIND DECONVOLUTION 15.1 Introduction 15.2 Blind-Deconvolution Using Channel Input Power Spectrum 15.3 Equalization Based on Linear Prediction Models 15.4 Bayesian Blind Deconvolution and Equalization 15.5 Blind Equalization for Digital Communication Channels 15.6 Equalization Based on Higher-Order Statistics 15.7 Summary lind deconvolution is the process of unravelling two unknown signals that have been convolved. An important application of blind B deconvolution is in blind equalization for restoration of a signal distorted in transmission through a communication channel. Blind equalization has a wide range of applications, for example in digital telecommunications for removal of intersymbol interference, in speech recognition for removal of the effects of microphones and channels, in deblurring of distorted images, in dereverberation of acoustic recordings, in seismic data analysis, etc. In practice, blind equalization is only feasible if some useful statistics of the channel input, and perhaps also of the channel itself, are available. The success of a blind equalization method depends on how much is known about the statistics of the channel input, and how useful this knowledge is in the channel identification and equalization process. This chapter begins with an introduction to the basic ideas of deconvolution and channel equalization. We study blind equalization based on the channel input power spectrum, equalization through separation of the input signal and channel response models, Bayesian equalization, nonlinear adaptive equalization for digital communication channels, and equalization of maximum-phase channels using higher-order statistics.
    [Show full text]
  • Blind Deconvolution of Backscattered Ultrasound Using Second-Order Statistics
    Blind Deconvolution of Backscattered Ultrasound using Second-Order Statistics Carlos E. Davila and Tao He Electrical Engineering Department, Southern Methodist University Dallas, Texas 75275-0338 E-mail: [email protected] Phone: (214) 768-3197 Fax: (214) 768-3573 Abstract A method for blind deconvolution of ultrasound based on second-order statistics is proposed. This approach relaxes the requirement made by other blind deconvolution methods that the tissue reflectivity be statistically white or broad-band. Two methods are described, the ¯rst is a basic second-order deconvolution method, while the second incorporates an optimally weighted least squares solution. Experimental results using synthetic and actual ultrasound data demonstrate the potential bene¯ts of this method. Submitted to IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, July 23, 2001 1 Background Ultrasound is used extensively in medicine as a relatively inexpensive approach for non- invasively imaging organ structures and measuring blood flow. The basic premise behind ultrasonic imaging is that an ultrasonic pulse transmitted through tissue will be reflected or backscattered, particularly at distinct tissue boundaries. The underlying tissue structures can then be imaged by measuring the reflections of the transmitted pulse at each tissue boundary. While models for ultrasonic backscattering can be quite complex, a simple model that is often used is based on a linear convolution ZZZ µ ¶ e¡2az 2z r(t)= g(x; y; z)s(x; y)p t ¡ dxdydz (1) z c where s(x; y) is the lateral distribution of the transmitted ultrasound wave, c is the speed of sound through the tissue (assumed constant), a is the average attenuation constant of the tissue in the ultrasound propagation path, and g(x; y; z) is the tissue reflectivity.
    [Show full text]
  • Independent Component Analysis and Nongaussianity for Blind Image Deconvolution and Deblurring
    Integrated Computer-Aided Engineering 15 (2008) 219–2 219 IOS Press Independent component analysis and nongaussianity for blind image deconvolution and deblurring Hujun Yin and Israr Hussain School of Electrical and Electronic Engineering, The University of Manchester, Manchester M60 1QD, UK E-mail: [email protected], [email protected] Abstract. Blind deconvolution or deblurring is a challenging problem in many signal processing applications as signals and images often suffer from blurring or point spreading with unknown blurring kernels or point-spread functions as well as noise corruption. Most existing methods require certain knowledge about both the signal and the kernel and their performance depends on the amount of prior information regarding the both. Independent component analysis (ICA) has emerged as a useful method for recovering signals from their mixtures. However, ICA usually requires a number of different input signals to uncover the mixing mechanism. In this paper, a blind deconvolution and deblurring method is proposed based on the nongaussianity measure of ICA as well as a genetic algorithm. The method is simple and does not require prior knowledge regarding either the image or the blurring process, but is able to estimate or approximate the blurring kernel from a single blurred image. Various blurring functions are described and discussed. The proposed method has been tested on images degraded by different blurring kernels and the results are compared to those of existing methods such as Wiener filter, regularization filter, and the Richardson-Lucy method. Experimental results show that the proposed method outperform these methods. 1. Introduction the restoration process may become straightforward or even trivial.
    [Show full text]
  • Research Article PSF Estimation Via Gradient Cepstrum Analysis for Image Deblurring in Hybrid Sensor Network
    Hindawi Publishing Corporation International Journal of Distributed Sensor Networks Volume 2015, Article ID 758034, 11 pages http://dx.doi.org/10.1155/2015/758034 Research Article PSF Estimation via Gradient Cepstrum Analysis for Image Deblurring in Hybrid Sensor Network Mingzhu Shi1 and Shuaiqi Liu2 1 College of Electronic and Communication Engineering, Tianjin Normal University, Tianjin 300387, China 2College of Electronic and Information Engineering, Hebei University, Baoding 071000, China Correspondence should be addressed to Mingzhu Shi; [email protected] Received 4 December 2014; Accepted 13 January 2015 Academic Editor: Qilian Liang Copyright © 2015 M. Shi and S. Liu. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. In hybrid sensor networks, information fusion from heterogeneous sensors is important, but quite often information such as image is blurred. Single image deblurring is a highly ill-posed problem and usually regularized by alternating estimating point spread function (PSF) and recovering blur image, which leads to high complexity and low efficiency. In this paper, we first propose an efficient PSF estimation algorithm based on gradient cepstrum analysis (GCA). Then, to verify the accuracy of the strategy, estimated PSFs are used for image deconvolution step, which exploits a novel total variation model coupling with a gradient fidelity term. We also adopt an alternating direction method (ADM) numerical algorithm with rapid convergence and high robustness to optimize the energy function. Both synthetic and real blur experiments show that our scheme can estimate PSF rapidly and produce comparable results without involving long time consuming.
    [Show full text]
  • Wiener Meets Deep Learning for Image Deblurring
    Deep Wiener Deconvolution: Wiener Meets Deep Learning for Image Deblurring Jiangxin Dong Stefan Roth MPI Informatics TU Darmstadt [email protected] [email protected] Bernt Schiele MPI Informatics [email protected] Abstract We present a simple and effective approach for non-blind image deblurring, com- bining classical techniques and deep learning. In contrast to existing methods that deblur the image directly in the standard image space, we propose to perform an explicit deconvolution process in a feature space by integrating a classical Wiener deconvolution framework with learned deep features. A multi-scale feature re- finement module then predicts the deblurred image from the deconvolved deep features, progressively recovering detail and small-scale structures. The proposed model is trained in an end-to-end manner and evaluated on scenarios with both simulated and real-world image blur. Our extensive experimental results show that the proposed deep Wiener deconvolution network facilitates deblurred results with visibly fewer artifacts. Moreover, our approach quantitatively outperforms state-of-the-art non-blind image deblurring methods by a wide margin. 1 Introduction Image deblurring is a classical image restoration problem, which has attracted widespread atten- tion [e.g.,1,3,9, 10, 56]. It is usually formulated as y = x ∗ k + n; (1) where y; x; k, and n denote the blurry input image, the desired clear image, the blur kernel, and image noise, respectively. ∗ is the convolution operator. Traditional methods usually separate this problem into two phases, blur kernel estimation and image restoration (i.e., non-blind image deblurring).
    [Show full text]
  • Contrasts, Independent Component Analysis, and Blind Deconvolution Pierre Comon
    Contrasts, Independent Component Analysis, and Blind Deconvolution Pierre Comon To cite this version: Pierre Comon. Contrasts, Independent Component Analysis, and Blind Deconvolution. International Journal of Adaptive Control and Signal Processing, Wiley, 2004, 18 (3), pp.225–243. 10.1002/acs.791. hal-00542916 HAL Id: hal-00542916 https://hal.archives-ouvertes.fr/hal-00542916 Submitted on 3 Dec 2010 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. INTERNATIONAL JOURNAL OF ADAPTIVE CONTROL AND SIGNAL PROCESSING Int. J. Adapt. Control Signal Process. 2004; 00:1–16 Prepared using acsauth.cls [Version: 2002/11/11 v1.00] Contrasts, Independent Component Analysis, and Blind Deconvolution P. Comon I3S, CNRS-UNSA, Sophia-Antipolis SUMMARY A general definition of contrast criteria is proposed, which induces the concept of trivial filters. These optimization criteria enjoy identifiability properties, and aim at delivering outputs satisfying specific properties, such as statistical independence or a discrete character. Several ways of building new contrast criteria are described. It is then briefly elaborated on practical numerical algorithms. Copyright c 2004 John Wiley & Sons, Ltd. key words: Independent Component Analysis (ICA), Contrast criteria, Blind Deconvolution and Equalization, MIMO linear systems 1.
    [Show full text]