A Novel Approach for Sharpening Blur Image Using Convolutional Neural Networks

Journal of Critical Reviews

ISSN- 2394-5125 Vol 7, Issue 7, 2020

A NOVEL APPROACH FOR SHARPENING BLUR IMAGE USING CONVOLUTIONAL NEURAL NETWORKS

R. Shiva Shankar1, G Mahesh2, K V S S Murthy3, J Rajanikanth4

1-4 Computer Science and Engineering Department, 1-4 S.R.K.R. Engineering College, Bhimavaram, West Godavari, Andhrapradesh, India [email protected]

Received: 14.02.2020 Revised: 08.03.2020 Accepted: 11.04.2020

Abstract Image sharpening is done by passing blur picture as input and obtaining the sharp one at full resolution as output. The technique of sharpening blur image has more impact on different fields such as medical imaging, forensic science and astronomy. To enhance an image by using LSTM it takes more time complexity. In order to overcome those drawbacks we proposed CNN algorithm to get better performance by using ResBlocks. The proposed model addresses two general issues: the solver and relative arguments in every scale is same and different arguments in each scale cause instability. Another issue is the input image has different resolutions and different scales. In each scale parameter tweaking is allowed and over-fit is raised to the particular image. The proposed model takes sequence of blurry images in different resolutions and down sampled at encoder as-well-as convert the given input to the feature map then generates latent sharp image at every layer and provide the final sharp image at full resolution by converting back into the original format at decoder. Thus, it reduces the time complexity and gives the stable results.

Keywords: LSTM, CNN, Blurry Images, Encoder, Decoder, ResBlocks.

INTRODUCTION unchanged. In actual cases, the plane rotation of the camera or Now-a-days the conversion of blurry image to sharp image is one moving object is blurred. The picture is degraded by a couple of of the main problem because, everyone uses smart phone and blur kernels; it is referred to as asymmetric blur picture. The click pictures everywhere. Sometimes the pictures captured as excellent method is used to enhance an image, which means that blur because of the camera motion or the moment of object etc. it can completely restore a sharp picture at different resolutions The photographer decreases the shutter speed for taking in a pyramid step by step. This is especially true of both pictures under low light, when we decrease the shutter speed, optimization based strategies and more recently neural network most of the times the image get blurred. As-well-as the image get based methods. blurred when the tendency of the photographer hand to shake. Due to this problem, the conversion of blur image to sharp image Motion blur in real world photography is so complicated that the has become frequently used thesis in image processing. To sharp concept of shift instability is not constantly present. It is very this type of blur images most of the tries have done. Mostly these difficult to do away with non-uniform moment blur in picture. solutions are implemented using deep learning algorithms. In The causes of non-uniform motion blur may be divided into two deep learning researches have been going on for converting the categories: camera rotation and target movement [3]. To cope blurry images to sharp images in low cost and efficient manner with the trouble of target movement, non-uniform blur image which allows it to be implemented in a wide range. enhancement techniques have been proposed. Existing methods starts with a completely hard scale of the blurred picture and Picture contains awfully useful information; sometimes this progressively retrieve the picture in high resolution until information is required for forensic labs, courts, etc. Most of the complete resolution is reached. Using this, we propose more news channels and newspapers, information is acquired as an efficient network architecture for multilevel picture deblurring image by conveying the information easily to the people. By the and this approach works effectively. time technology has also developed day by day by employing this technologies, conventional pictures has come in place of high Inspired with the aid of recent success of the encoder-decoder definition pictures. More and more technologies are created to structure for the various computer imaginative and prescient make modern life easier, including photo editing techniques. As tasks, the encoder-decoder blocks [4], we search for an effective ordinary people acquire the ability to remodel, create or convert way to optimize picture enhancement. We display that digital images, the credibility of the images they function immediately applying an existing encoder-decoder structure evidence is becoming an issue [1]. Furthermore, as digital images does no longer produce most advantageous results. Our dominate our daily lives, we would like to grasp whether a given proposed network, by the way of contrast, meets the necessities image is processed, how well the image is processed, should get of diverse CNN architectures and achieves the feasibility of replaced. To enhance the picture most of the techniques (or) training. It also produces better results that are of important for methods are available. By employing this methods most of the large motion enhancement. individuals desires to impulse the pictures. After applying these methods the picture becomes clearer by adjusting the edges, and LITERATURE SURVEY setting the textures as well as some required details. Qi Shan et al., [5] invoked a method for converting blurry image to sharp image by introducing the unified framework which In signal processing, changing the blur picture to a sharp picture removes motion blur caused by camera by reducing the typically reduces the problem of deconvolution and the kernel improper noisy kernel. This method solves non-blind and blind performance of motion blur [2] need to remain the same. deconvolution issues. Y. Li et al., [6] proposed a method for However, the overall performance of the kernel is often increasing the performance as well as interpretability and

Journal of critical reviews 139

A NOVEL APPROACH FOR SHARPENING BLUR IMAGE USING CONVOLUTIONAL NEURAL NETWORKS

achieves better performance by using deep network methods. technique which uses generic priors, exemplers are in number Rob Fergus et al., [7] introduced a multi scale approach for format. sharpening the single image. Initially the data will be extracted the given input into grayscale and remove gamma corrections J. Pan et al., [18] introduce a method for enhancing the human then initialize blur kernel and estimate full resolution blur image faces using exempler dataset. This dataset doesn’t use any of the finally pass the image to non-blind deconvolution method for existing methods, they implement convolutional neural network getting deblurred image. for generating sharp images by taking noisy picture as input. This Mauricio Delbracio and Guilermo Sapiro [8] presented an method demonstrates the better results compared with existing algorithm to remove the blur due to the camera i.e. object methods. R. Shiva Shankar et al., [19] projected an Object- moment, photographer hand shake. The main idea of Oriented Approach for Noise Reduction. In this approach they implementing this algorithm is, most of the images taken by have used fuzzy filters to remove noise without disturbing the camera are blurred differently. They reconstruct the image by actual image. Its main aim is to find the corrupted pixels in an taking weighted average in Fourier domain which is not used in image that contributes to produce noise. most of the deconvolution problems because this is an inverse of T M Nimisha et al., [20] invokes a method for generating sharp deconvolution. Ayan Chakrabarti et al., [9] introduces a method images from single image. This method uses autoencoder and for blind motion deblurring by the use of neural network generative adversarial network (GAN). First they extract features methods for calculating the patches in sharp image which are through encoder and perform regression and passed it to the blurred due to the motion kernel which is unknown. This method decoder for getting desired output. This method id kernel free uses to get the complex forier coefficient of a deconvolution filter. and handles both space variant and invariant blurs. It performs The network is to be applied independently such that all its far better than competing methods. outputs are used to get their average to result the sharp image estimation. Zhang et al., [10] proposed an image restoration Amit Goldstein and RaananFattal [21] introduced a new method method by the use of Generative Adversial Networks. This for recovering the blurred areas in motion blur or Gaussian blur method uses two way connections and it avoids dependence on images based on statistical changes. This method mainly works appriori knowledge of noisy picture as compared to the existing based on phase retrieval algorithm along with convergence and deblurring methods. The proposed approach gives better results. disambiguation functionalities. Compared with many existing works, this method doesn’t calculate max posteriori analysis. It K. V. S. S. Murthy et al., [11] proposed a 2D Image processing generates latent images at every stage so that it provides technique to recognize facial expression based on texture. In this effective running capability. technique, neural network-based decision trees algorithm is used. This algorithm works by splitting an image into two pieces F. A. G. Pena et al., [22] proposed a new incremental aggregation most probably eyes and lips. Bezier curves are used to draw algorithm which takes several multiple blur pictures as input and curves on main parts and recognize the emotion. process it with automatic image selection. They deal with the hassle of deblurring image in two steps: first, they correctly JiaXu et al., [12] introduced a way for accelerating a wide range of research the comparison characteristics to rank pictures, blast image processing operators. It makes use of a fully constant the usage of deep cnn. Second, increasing Fourier coupling with network that is based on input-output pairs. There is no need to reconstructive mechanism is only applied to low resolution use real operator after a trained network is setup. The newly pictures to enhance the quality of the reconstruction and to setup network operates at complete resolution, and in a verify searches in many different synthetic and real datasets. continuous time, they’ve analyzed this approach on numerous advanced image processing operators. Jiansun et al., [23] proposed convolution neural networks based image sharpening approach. They train the model for finding Y. Bai et al., [13] proposed a deblurring approach by interpreting blurry kernels from patches. They used markov random fields the picture patch as a signal on graph with weights as well as it (MRF) for identifying the non-uniform motion blur area. So that, uses some of the properties, robustness in generating the sharp they achieve state-of-art sharpening results. picture and pws filters for better enhancement. This method achieves in both quantitatively and qualitatively. Junyoung Rolf Kohler et al., [24] paper aims at sharpening the blurry image Chung et al., [14] compared different types of recurrent neural even without knowing the details about given input image i.e. networks and concentrate more on the units and implement a camera motion, exposure, etc. They created a benchmark dataset gating technique such as a LSTM unit and GRU. They compared in for realistic blurry images for evaluating the performance polyphonic modeling and speech signal modeling and these accurately and comparing models with non-uniform blurry data. advanced recurrent units are efficient than traditional ones. This algorithm incorporates with uniform and non- uniform models. Qifeng Chen et al., [25] presented a method, for Patrick Wieschollek et al., [15] proposed an efficient method to producing an image with photographic appearance based on the deblur the frames by taking temporary content into account input layout. To produce an image it takes a two dimensional because handheld cameras are available in every smart phone. semantic layout of the scene. It doesn’t depend on adversarial Now-a-days this makes us enable to record videos everywhere at training. any time. If we take a quick short, most of the times the images get blurred. Removing the extra noise from the picture is a big F. Albluwiet al., [26] introduced an approaches which addresses problem if we don’t consider motion blur kernel image. two general issues in existing methods: super resolution and Exploring information between multiple consecutive blurry deblurring. In order to address these issues they introduced a images helps to produce the expected image or video. revised method, which solves issues in conversion of blur image from low resolution to sharp picture at high resolution. X. Tao et Chao Dong et al., [16] introduced a method for getting picture at al., [27] investigated several deep learning strategies and full resolution by using deep learning methods. It uses mapping introduced a scale recurrent network for sharpening the blur for low and high resolution pictures and it takes less resolution image. This network uses lstm for training the model and it takes picture as input and gives the one at high resolution. Existing less number of parameters for making training easier. They approaches deals every component individually but in this evaluate this method on large dataset for generating sharp method it combines all layers and optimize. S. Anwar et al., [17] images both quantitatively and quantitatively. introduced a novel class related method which signiﬁcantly increases the performance of sharpening the picture. They reconstruct the frequency responses suppressed after the blurring process. This method provides prior deconvolution

Journal of critical reviews 140

A NOVEL APPROACH FOR SHARPENING BLUR IMAGE USING CONVOLUTIONAL NEURAL NETWORKS

SYSTEM ARCHITECTURE: 1. Encoder Our system architecture mainly consists of the four phases. The 2. Feature mapping pictorial representation of our architecture is represented in Fig 3. Model 3.1 (a). 4. Decoder

Collect the Data

Split the Data

Training Data Testing Data

Encoder

Training Model

Decoder

Trained Model

Resultant Image

Fig 3.1 (a) Illustration of our architecture

The brief explanation of our architecture is as follows: produces clean features. Then it is fed to the decoder for generating sharp image. Existing works on image deblurring Every image can be represented as grid of pixels. Each pixel value combine the representation of data and deblurring in network ranges from 0 to 255 which indicate its brightness. but it takes time for extracting features from the image to Our proposed model uses auto-encoder that learns from the overcome this we use auto encoder. We use residual blocks sharp images by extracting features. First, we train our model by (shown in Fig 3.1 (b)) in encoder for getting faster convergence passing sharp image manifold to the encoder. After the and also it improves the generated output. completion of training it takes blurred image as an input and The structure of residual block is as follows:

Conv

ReLu

Conv

ResBlock Fig 3.1 (b) Flowchart for Residual Block

Journal of critical reviews 141

A NOVEL APPROACH FOR SHARPENING BLUR IMAGE USING CONVOLUTIONAL NEURAL NETWORKS

First the input images are taken by encoder and convert it to the array of pixel vales. It process the input image of dimensions h*w Pooling and generate an image. In order to save the initial dimensions we it's a sample-based discretization method. Pooling is employed to use padding attribute. It represents the input image in low down-sample AN input image, reducing its spatiality and leaving dimensional space for recovering the blur image. Then it takes all assumptions to be created regarding options contained within the data extracted from encoder after it removes the unwanted the sub-regions binned. There are unremarkably 2 varieties of noises and adjust corrections then fed it to the decoder as input. pooling referred to as goop and min pooling. Group pooling is substitution the complete sample with the most prices from the Then, the decoder takes the corrected data and converts back to chosen region and min pooling is substitution the complete the original image dimensions and produce the required sharp sample with the minimum price from the chosen region. Thus a image. CNN is largely a deep neural network that consists of hidden layers having convolution and pooling performs at the side of IMPLEMENTATION activation function ReLu. Dataset Most of the researches has done on image debluring along with Flattening that some of them created a realistic datasets by clicking This is a straightforward easy step. You straighten the element consecutive frames from videos which are taken by handheld map put away in succession of numbers. This permits data to camera for getting accurate results. We use Gopro dataset which turn into the info layer of a man-made neural system for consists of 3214 blur/sharp image pairs. The dataset will be additional handling. splitted into training and testing data. Training data contains 2103 blur/sharp images at high resolution and testing data Fully Connected Layer contains 1111 blurry images. This layer can be a customary multi-layer perceptron. It utilizes grouping in the yield layer. Characterization is typically a Pre-process the data softmax initiation work completely associated implies that every We pre-process the Blur/sharp images using Keras Image Data neuron in the past layer interfaces with every neuron. Generator. The images in the dataset were downscaled to 128X128 pixel resolution from 256X256 pixel resolution to make Softmax images easier to analyse and learn. The 3214 images in Gopro It gets values between zero and one and adds them to one dataset were split into the validation data set (1111 images) and (100%). SoftMax takes a vector of execution scores into a vector training data set (2103 images). of qualities between zero and one.

Convolutional Neural Networks (CNN): Dropout layer CNN is the algorithmic program employed in this paper. It is one Dropout layer in deep learning is a technique to overcome the among the kinds of neural networks employed in Image process. problem of over fitting. Dropout method takes a float number It has differing types of hidden layers and CNN generally between 0 and 1. This value indicates ignoring certain set of comprise convolutional layers, pooling layers and absolutely neurons while training to avoid over fitting. connected layers. Here in convolution and pooling layers ReLu is Batch-Size employed as activation perform. Let us acumen a convolution It is simply how many training examples were taken for one and pooling layer works to induce a transparent understanding forward and backward pass. They can be 10, 32, 64, 100, etc. But of CNN. the increase in batch size makes the memory full and it takes more time for the process to complete. Convolution It operates on 2 signals (in 1D) or 2 pictures (in 2D) during ReLu which one are taken as sign or image, and also the alternative This is the corrected linear measure that uses activation function. referred to as the kernel are taken as a filter on the input image, It gives zero for any negative pixel value; similarly it gives the manufacturing an output image. It takes 2 pictures as input and same value for any positive pixel value and formulated as : produces a 3rd as output. In common man terms, the sign is 푓(푥) = max⁡(0, 푥) taken and a filter is applied over it. This filter multiplies the sign with the kernel to induce the changed signal. Mathematically, it Here, f(x) - is a function. has two functions of f and g is outlined as, 푚 푚 Epoch (푓 ∗ 푔)(푖) = ∑ 푔(푗). 푓(푖 − 푗 + ) 2 It is the forward and backward pass on all the training data or 푗=1 simply completes an iteration. Based on the batch size and the count of the data we need to give epoch. Here, f * g gives generalized product and * indicates convolutio operation. PROPOSED ALGORITHM: It is nothing however real number of the input performs and a Input: Blur images are given as input. kernel perform. In the case of image process, the kernel slides Output: Sharp images are obtained as output. over entire image so changes the worth of every element of the image.

Steps: 1. Start 2. First load the input blur/sharp images and resize it.

Journal of critical reviews 142

A NOVEL APPROACH FOR SHARPENING BLUR IMAGE USING CONVOLUTIONAL NEURAL NETWORKS

for images in os.listdir("dataset/gopro_large/train/") original_image=cv2.imread(dataset/gopro_large/train/GOPR0374_11_2/sharp/image_id) original_image = cv2.resize(original_image, (128,128)) blurry_image = cv2.imread(dataset/gopro_large/train/GOPR0374_11_2/ blur/ image_id) blurry_image = cv2.resize(blurry_image,(128,128)) original_image = original_image/255.0 blurry_image = blurry_image/255.0 for sub_directory in sub_directories: for image_id in os.listdir("dataset/gopro_large/train/"+sub_directory+'/sharp/'): _image,_blurry_image= load(path,sub_directory,image_id ,original_image _size) original_image.append(_image) blurry_image.append(_blurry_image)

3. Now the loaded images are sent through encoder wherever convolution, pooling at the side of ReLu activation function are applied and down-sampled.

total_layers = [64, 128, 256] no_of_batch= 32 size_of_kernel = 3 dimenssion = 256 input_image = Input(image_shape=(128,128,3)) input = input_image for f in total_layers: input = Conv2D(f=f, size_of_kernel=size_of_kernel, no_of_strides=2, activation ='relu', padding='same')(input) image_shape = K.int_image_shape(input) input = Flatten()(input) l = Dense(dimenssion, name='l_vector')(input) enblock = Model(input_image, l, name='enblock')

4. Now, the original_image can be converted back to the previous size in decoder section.

l_inputs = Input(image_shape=(dimenssion,), name='dblock_in') input = Dense(image_shape[1]*image_shape[2]*image_shape[3])(l_inputs) input = Reshape((image_shape[1], image_shape[2], image_shape[3]))(input) for f in total_layers[::-1]: input = Conv2DTranspose(f=f, size_of_kernel=size_of_kernel, no_of_strides=2, activation='relu', padding='same')(input) outputs = Conv2DTranspose(f=3, size_of_kernel=size_of_kernel, activation='sigmoid', padding='same', name='dblock_out')(input) dblock = Model(l_inputs, outputs, name='dblock') dblock.summary()

5. Initiate the autoencoder model.

a_eblock = Model(input_image, dblock(enblock(input_image)), name='a_eblock') a_eblock.summary()

6. Now the model is generated, compiled and fitted by shaping epochs and reduce learning rate if loss doesn’t improve after 5 epochs.

lr_reducer = ReduceLROnPlateau(ftr=np.sqrt(0.1), cd=0, p=5, vb=1, mlr=0.5e-6) a_eblock.compile(loss='mse', optimizer='adam',metrics=["acc"]) callbacks = [lr_reducer] a_eblock.fit(blurry_image, original_image, validation_data=(blurry_image, original_image), epochs=1000, no_of_batch=no_of_batch, callbacks=callbacks)

7. The model is generated, so as to check blur images we need to load and generate sharp images.

for i in range(3): r = random.randint(0, len(original_image)-1) input, output = blurry_image[r],original_image[r] x_inp=input.reshape(1,128,128,3) sharpen_image = a_eblock.predict(x_inp) sharpen_image = sharpen_image.reshape(128,128,3) picture = plt.figure() picture.subplots_adjust(hspace=0.1, wspace=0.2)

8. Finally, the blur image is converted to sharp image.

Journal of critical reviews 143

A NOVEL APPROACH FOR SHARPENING BLUR IMAGE USING CONVOLUTIONAL NEURAL NETWORKS

final = picture.add_subplot(1, 3, 1) final.imshow(x) final = picture.add_subplot(1, 3, 2) final.imshow(output) final = picture.add_subplot(1, 3, 3) plt.imshow(sharpen_image)

In this algorithm, initially the images are loaded and converted into array of pixels. In third step, the loaded images are sent RESULT ANALYSIS through encoder wherever convolution, pooling at the side of The model is implemented by using Convolutional Neural ReLu activation function are applied and down sample the image. Networks. For training the model we use Gopro dataset contains In fourth step, the original_image can be converted back to the complex camera motion pictures which are more common while previous size in decoder section. Initiate the auto encoder model taking photos. Based on our experiments 1000 epochs are in step five. In step six the model is compiled and fitted by sufficient for convergence but it takes really large time to shaping epochs and reduce learning rate. In step seven the model implement. Our proposed model is fully convolutional so, it takes is built and trained over 3000 images. The flow of the above arbitrary size images as input as long as computer memory steps can be viewed in the Fig 5.1 (a). In final step, the blur allows and generates sequence of corresponding sharp images. images are tested by loading and generating sharp images using trained model.

Input Blur Images: The input Blur images (shown in Fig 5.1 (a)) can be in any of the formats like png, jpeg, jpg etc.

Fig 5.1 (a) Input Blur Image

After one epoch The batch size taken here is 10 and the epoch is 1. The below Fig 5.1 (b) is the result obtained after the implementation.

Fig 5.1 (b) After one epoch

After 10 epochs The batch size taken here is 10 and the epochs are 10. The below Fig 5.1 (c)is the result obtained after the implementation.

Fig 5.1 (c) After 10 epochs

After 25 epochs The batch size taken here is 10 and the epochs are 25. The below Fig 5.1 (d) is the result obtained after the implementation.

Journal of critical reviews 144

A NOVEL APPROACH FOR SHARPENING BLUR IMAGE USING CONVOLUTIONAL NEURAL NETWORKS

Fig 5.1 (d) After 25 epochs

After 50 epochs The batch size taken here is 10 and the epochs are 50. The below Fig 5.1 (e) is the result obtained after the implementation.

Fig 5.1 (e) After 50 epochs

After 75 epochs The batch size taken here is 10 and the epochs are 75. The below Fig 5.1 (f) is the result obtained after the implementation.

Fig 5.1 (f) After 75 epochs

After 100 epochs The batch size taken here is 10 and the epochs are 100. Based on the epoch size it takes really a large time to implement and the memory also becomes full. The below Fig 5.1 (g) is the result obtained after the implementation.

Fig 5.1 (g) After 100 epochs

In training the Perceptual loss classiﬁcation network, the images image (Fig 5.1 (d)), though the patch of noise is also included. taken for training proved sufficient for classifier to converge Once the edges are identified, the model applies learned weights under truncated normal initialization. Accuracy at the end of 100 to the classification problem and generates sharp image (Fig 5.1 iterations shows that the obtained sharp image is accurate. (g)).

This results shows that the input noisy image (Fig 5.1 (a)) is Performance Evaluation taken by the convolution layer in order to extract the features In order to find the performance of this implemented model, we from it (Fig 5.1 (b)). After passing this input image to the use different metrics for measuring the similarity between target different convolution layers surprisingly, the output of image (sharp image) and input blur image. Here we employ two convolution layer shows a very good outline of the edges of the metrics namely psnr (peak signal to noise ratio) and ssim

Journal of critical reviews 145

A NOVEL APPROACH FOR SHARPENING BLUR IMAGE USING CONVOLUTIONAL NEURAL NETWORKS

(structural similarity). Psnr can be calculated by finding reciprocal of mse (mean square error). SSIM helps us to ﬁnd the structural similarity between two images, it can be calculated using, (2휇푥휇 To calculate mse we use below formula, 푦+∁1)(2휎푥푦+∁2) SSIM(x,y)= 2 2 2 3 (휇푥+휇푦+∁1)(휎푥+휎푦+∁2) ∑ 푃, 푄(퐼 − 퐿)2 푀푆퐸 = Where x, y are windows of equal dimension for B,I respectively. 푃, 푄 µx, µy denotes mean of x, y respectively. σx, σy denotes variance Here p and q represents picture dimensions, I represents sharp for x, y respectively, whereas σxy is the covariance between x image and L represents deblurred image. and y. c1 and c2 are constants used to stabilize the division. Peak signal to noise ratio (psnr) can be calculated using, 2 The PSNR and SSIM for different deblurring architecture in PSNR= 푚 푀푆퐸 GoPro dataset is shown in Table 1.

Where m is the maximum possible intensity value, since we are using 8-bit integer to represent a pixel in channel so, m = 255.

Table 1: Result Analysis Kim et al. Sun et al. Nah et al. Gong et al. Measure Our Model [21] [8] [20] [28] PSNR 23.64 24.64 29.08 26.1 30.10

SSIM 0.8239 0.8429 0.9135 0.863 0.9323

TESTED RESULTS IN VARIOUS IMAGES: The image tested on our model is shown in Fig 6.1 (a) to Fig 6.1 Some of the testing is done on the images with our model. By (d) is as follows: passing different blur images as input and obtain sharp image as output.

Testing Image 01:

Fig 6.1 (a) Test Case 01

Testing Image 02:

Fig 6.1 (b) Test Case 02

Journal of critical reviews 146

A NOVEL APPROACH FOR SHARPENING BLUR IMAGE USING CONVOLUTIONAL NEURAL NETWORKS

Testing Image 03:

Fig 6.1 (c) Test Case 03

Testing Image 04:

Fig 6.1 (d) Test Case 04

CONCLUSION 9. [9]. Chen, Q., Xu, J., & Koltun, V. (2017). Fast image The results obtained from the beginning our model is looking processing with fully-convolutional networks. In realistic as compared to the existing works. Thus, the model Proceedings of the IEEE International Conference on constructed using convolutional neural networks is performing Computer Vision (pp. 2497-2506). satisfactorily as well as it increases the efficiency of sharpening 10. [10]. Zhang, X., Lv, Y., Li, Y., Liu, Y., & Luo, P. (2019, July). A the blur image and reduced the training time of the model as Modified Image Processing Method for Deblurring Based on compared to the developed models like lstm, gru, etc. The GAN Networks. In 2019 5th International Conference on Big proposed model takes sequence of blurry images in different Data and Information Analytics (BigDIA) (pp. 29-34). IEEE. resolutions and down sampled at encoder then generates latent 11. [11]. Shankar, R. S., Gupta, V. M., Murthy, K. V. S., & sharp image at each layer and provides the sharp image at full Someswararao, C. (2012, June). Object oriented fuzzy filter resolution by converting back into the original format at decoder. for noise reduction of Pgm images. In 2012 8th Thus, it reduces the time complexity and gives stable results. International Conference on Information Science and Digital Content Technology (ICIDT2012) (Vol. 3, pp. 776-782). REFRENCES IEEE. 1. [1]. Ye, J., Shen, Z., Behrani, P., Ding, F., & Shi, Y. Q. (2018). 12. [12]. Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Detecting USM image sharpening by using CNN. Signal Citro, C. & Ghemawat, S. (2016). Tensorflow: Large-scale Processing: Image Communication, 68, 258-264. machine learning on heterogeneous distributed systems. 2. [2]. Cho, S., & Lee, S. (2009). Fast motion deblurring. In ACM arXiv preprint arXiv:1603.04467. SIGGRAPH Asia 2009 papers (pp. 1-8). 13. [13]. Bai, Y., Cheung, G., Liu, X., & Gao, W. (2018). Graph- 3. [3]. Xu, L., Zheng, S., & Jia, J. (2013). Unnatural l0 sparse based blind image deblurring from a single photograph. representation for natural image deblurring. In Proceedings IEEE Transactions on Image Processing, 28(3), 1404-1418. of the IEEE conference on computer vision and pattern 14. [14]. Wieschollek, P., Hirsch, M., Scholkopf, B., & Lensch, H. recognition (pp. 1107-1114). (2017). Learning blind motion deblurring. In Proceedings of 4. [4]. Tao, X., Gao, H., Shen, X., Wang, J., & Jia, J. (2018). Scale- the IEEE International Conference on Computer Vision (pp. recurrent network for deep image deblurring. In 231-240). Proceedings of the IEEE Conference on Computer Vision 15. [15]. Levin, A. (2007). Blind motion deblurring using image and Pattern Recognition (pp. 8174-8182). statistics. In Advances in Neural Information Processing 5. [5]. Chakrabarti, A. (2016, October). A neural approach to Systems (pp. 841-848). blind motion deblurring. In European conference on 16. [16]. Chen, Q., & Koltun, V. (2017). Photographic image computer vision (pp. 221-235). Springer, Cham. synthesis with cascaded refinement networks. In 6. [6]. Li, Y., Tofighi, M., Monga, V., & Eldar, Y. C. (2019, May). Proceedings of the IEEE international conference on An algorithm unrolling approach to deep image deblurring. computer vision (pp. 1511-1520). In ICASSP 2019-2019 IEEE International Conference on 17. [17]. Anwar, S., Huynh, C. P., & Porikli, F. (2018). Image Acoustics, Speech and Signal Processing (ICASSP) (pp. deblurring with a class-specific prior. IEEE transactions on 7675-7679). IEEE. pattern analysis and machine intelligence, 41(9), 2112- 7. [7]. Dong, C., Loy, C. C., He, K., & Tang, X. (2014, September). 2130. Learning a deep convolutional network for image super- 18. [18]. Pan, J., Ren, W., Hu, Z., & Yang, M. H. (2018). Learning resolution. In European conference on computer vision (pp. to deblur images with exemplars. IEEE transactions on 184-199). Springer, Cham. pattern analysis and machine intelligence, 41(6), 1412- 8. [8]. Sun, J., Cao, W., Xu, Z., & Ponce, J. (2015). Learning a 1425. convolutional neural network for non-uniform motion blur 19. [19]. Babu, D. R., Shankar, R. S., Mahesh, G., & Murthy, K. V. S. removal. In Proceedings of the IEEE Conference on S. (2017, May). Facial expression recognition using bezier Computer Vision and Pattern Recognition (pp. 769-777). curves with hausdorff distance. In 2017 International Conference on IoT and Application (ICIOT) (pp. 1-8). IEEE.

Journal of critical reviews 147

A NOVEL APPROACH FOR SHARPENING BLUR IMAGE USING CONVOLUTIONAL NEURAL NETWORKS

20. [20]. Nah, S., Hyun Kim, T., & Mu Lee, K. (2017). Deep multi- scale convolutional neural network for dynamic scene deblurring. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 3883-3891). 21. [21] .Hyun Kim, T., Mu Lee, K., Scholkopf, B., & Hirsch, M. (2017). Online video deblurring via dynamic temporal blending network. In Proceedings of the IEEE International Conference on Computer Vision (pp. 4038-4047). 22. [22]. Peña, F. A. G., Fernández, P. D. M., Ren, T. I., Leandro, J. D. J. G., & Nishihara, R. M. (2019). Burst Ranking for Blind Multi-Image Deblurring. IEEE Transactions on Image Processing, 29, 947-958. 23. [23]. Nimisha, T. M., Kumar Singh, A., & Rajagopalan, A. N. (2017). Blur-invariant deep learning for blind-deblurring. In Proceedings of the IEEE International Conference on Computer Vision (pp. 4752-4760). 24. [24]. Bahat, Y., Efrat, N., & Irani, M. (2017). Non-uniform blind deblurring by reblurring. In Proceedings of the IEEE International Conference on Computer Vision (pp. 3286- 3294). 25. [25]. Pan, J., Sun, D., Pfister, H., & Yang, M. H. (2016). Blind image deblurring using dark channel prior. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 1628-1636). 26. [26]. Albluwi, F., Krylov, V. A., & Dahyot, R. (2018, September). Image deblurring and super-resolution using deep convolutional neural networks. In 2018 IEEE 28th International Workshop on Machine Learning for Signal Processing (MLSP) (pp. 1-6). IEEE. 27. [27]. Tao, X., Gao, H., Shen, X., Wang, J., & Jia, J. (2018). Scale- recurrent network for deep image deblurring. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 8174-8182). 28. [28]. Gong, D., Yang, J., Liu, L., Zhang, Y., Reid, I., Shen, C. ... & Shi, Q. (2017). From motion blur to motion flow: a deep learning solution for removing heterogeneous motion blur. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 2319-2328).

Journal of critical reviews 148