Lecture 4: Smoothing
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Moving Average Filters
CHAPTER 15 Moving Average Filters The moving average is the most common filter in DSP, mainly because it is the easiest digital filter to understand and use. In spite of its simplicity, the moving average filter is optimal for a common task: reducing random noise while retaining a sharp step response. This makes it the premier filter for time domain encoded signals. However, the moving average is the worst filter for frequency domain encoded signals, with little ability to separate one band of frequencies from another. Relatives of the moving average filter include the Gaussian, Blackman, and multiple- pass moving average. These have slightly better performance in the frequency domain, at the expense of increased computation time. Implementation by Convolution As the name implies, the moving average filter operates by averaging a number of points from the input signal to produce each point in the output signal. In equation form, this is written: EQUATION 15-1 Equation of the moving average filter. In M &1 this equation, x[ ] is the input signal, y[ ] is ' 1 % y[i] j x [i j ] the output signal, and M is the number of M j'0 points used in the moving average. This equation only uses points on one side of the output sample being calculated. Where x[ ] is the input signal, y[ ] is the output signal, and M is the number of points in the average. For example, in a 5 point moving average filter, point 80 in the output signal is given by: x [80] % x [81] % x [82] % x [83] % x [84] y [80] ' 5 277 278 The Scientist and Engineer's Guide to Digital Signal Processing As an alternative, the group of points from the input signal can be chosen symmetrically around the output point: x[78] % x[79] % x[80] % x[81] % x[82] y[80] ' 5 This corresponds to changing the summation in Eq. -
Comparative Analysis of Gaussian Filter with Wavelet Denoising for Various Noises Present in Images
ISSN (Print) : 0974-6846 Indian Journal of Science and Technology, Vol 9(47), DOI: 10.17485/ijst/2016/v9i47/106843, December 2016 ISSN (Online) : 0974-5645 Comparative Analysis of Gaussian Filter with Wavelet Denoising for Various Noises Present in Images Amanjot Singh1,2* and Jagroop Singh3 1I.K.G. P.T.U., Jalandhar – 144603,Punjab, India; 2School of Electronics and Electrical Engineering, Lovely Professional University, Phagwara - 144411, Punjab, India; [email protected] 3Department of Electronics and Communication Engineering, DAVIET, Jalandhar – 144008, Punjab, India; [email protected] Abstract Objectives: This paper is providing a comparative performance analysis of wavelet denoising with Gaussian filter applied variouson images noises contaminated usually present with various in images. noises. Wavelet Gaussian transform filter is ais basic used filter to convert used in the image images processing. to wavelet Its response domain. isBased varying on with its kernel sizes that have also been shown in analysis. Wavelet based de-noisingMethods/Analysis: is also one of the way of removing thresholding operations in wavelet domain noise could be removed from images. In this paper, image quality matrices like PSNR andFindings MSE have been compared for the various types of noises in images for different denoising methods. Moreover, the behavior of different methods for image denoising have been graphically shown in paper with MATLAB based simulations. : In the end wavelet based de-noising methods has been compared with Gaussian basedKeywords: filter. The Denoising, paper provides Gaussian a review Filter, MSE,of filters PSNR, and SNR, their Thresholding, denoising analysis Wavelet under Transform different noise conditions. 1. Introduction is of bell shaped. -
MPA15-16 a Baseband Pulse Shaping Filter for Gaussian Minimum Shift Keying
A BASEBAND PULSE SHAPING FILTER FOR GAUSSIAN MINIMUM SHIFT KEYING 1 2 3 3 N. Krishnapura , S. Pavan , C. Mathiazhagan ,B.Ramamurthi 1 Department of Electrical Engineering, Columbia University, New York, NY 10027, USA 2 Texas Instruments, Edison, NJ 08837, USA 3 Department of Electrical Engineering, Indian Institute of Technology, Chennai, 600036, India Email: [email protected] measurement results. ABSTRACT A quadrature mo dulation scheme to realize the Gaussian pulse shaping is used in digital commu- same function as Fig. 1 can be derived. In this pap er, nication systems like DECT, GSM, WLAN to min- we consider only the scheme shown in Fig. 1. imize the out of band sp ectral energy. The base- band rectangular pulse stream is passed through a 2. GAUSSIAN FREQUENCY SHIFT lter with a Gaussian impulse resp onse b efore fre- KEYING GFSK quency mo dulating the carrier. Traditionally this The output of the system shown in Fig. 1 can b e describ ed is done by storing the values of the pulse shap e by in a ROM and converting it to an analog wave- Z t form with a DAC followed by a smo othing lter. g d 1 y t = cos 2f t +2k c f This pap er explores a fully analog implementation 1 of an integrated Gaussian pulse shap er, which can where f is the unmo dulated carrier frequency, k is the c f result in a reduced power consumption and chip mo dulating index k =0:25 for Gaussian Minimum Shift f area. Keying|GMSK[1] and g denotes the convolution of the rectangular bit stream bt with values in f1; 1g 1. -
Spatial Domain Low-Pass Filters
Low Pass Filtering Why use Low Pass filtering? • Remove random noise • Remove periodic noise • Reveal a background pattern 1 Effects on images • Remove banding effects on images • Smooth out Img-Img mis-registration • Blurring of image Types of Low Pass Filters • Moving average filter • Median filter • Adaptive filter 2 Moving Ave Filter Example • A single (very short) scan line of an image • {1,8,3,7,8} • Moving Ave using interval of 3 (must be odd) • First number (1+8+3)/3 =4 • Second number (8+3+7)/3=6 • Third number (3+7+8)/3=6 • First and last value set to 0 Two Dimensional Moving Ave 3 Moving Average of Scan Line 2D Moving Average Filter • Spatial domain filter • Places average in center • Edges are set to 0 usually to maintain size 4 Spatial Domain Filter Moving Average Filter Effects • Reduces overall variability of image • Lowers contrast • Noise components reduced • Blurs the overall appearance of image 5 Moving Average images Median Filter The median utilizes the median instead of the mean. The median is the middle positional value. 6 Median Example • Another very short scan line • Data set {2,8,4,6,27} interval of 5 • Ranked {2,4,6,8,27} • Median is 6, central value 4 -> 6 Median Filter • Usually better for filtering • - Less sensitive to errors or extremes • - Median is always a value of the set • - Preserves edges • - But requires more computation 7 Moving Ave vs. Median Filtering Adaptive Filters • Based on mean and variance • Good at Speckle suppression • Sigma filter best known • - Computes mean and std dev for window • - Values outside of +-2 std dev excluded • - If too few values, (<k) uses value to left • - Later versions use weighting 8 Adaptive Filters • Improvements to Sigma filtering - Chi-square testing - Weighting - Local order histogram statistics - Edge preserving smoothing Adaptive Filters 9 Final PowerPoint Numerical Slide Value (The End) 10. -
A Simplified Realization for the Gaussian Filter in Surface Metrology
In X. International Colloquium on Surfaces, Chemnitz (Germany), Jan. 31 - Feb. 02, 2000, M. Dietzsch, H. Trumpold, eds. (Shaker Verlag GmbH, Aachen, 2000), p. 133. A Simplified Realization for the Gaussian Filter in Surface Metrology Y. B. Yuan(1), T.V. Vorburger(2), J. F. Song(2), T. B. Renegar(2) 1 Guest Researcher, NIST; Harbin Institute of Technology (HIT), Harbin, China, 150001; 2 National Institute of Standards and Technology (NIST), Gaithersburg, MD 20899 USA. Abstract A simplified realization for the Gaussian filter in surface metrology is presented in this paper. The sampling function sinu u is used for simplifying the Gaussian function. According to the central limit theorem, when n approaches infinity, the function (sinu u)n approaches the form of a Gaussian function. So designed, the Gaussian filter is easily realized with high accuracy, high efficiency and without phase distortion. The relationship between the Gaussian filtered mean line and the mid-point locus (or moving average) mean line is also discussed. Key Words: surface roughness, mean line, sampling function, Gaussian filter 1. Introduction The Gaussian filter has been recommended by ISO 11562-1996 and ASME B46-1995 standards for determining the mean line in surface metrology [1-2]. Its weighting function is given by 1 2 h(t) = e−π(t / αλc ) , (1) αλc where α = 0.4697 , t is the independent variable in the spatial domain, and λc is the cut-off wavelength of the filter (in the units of t). If we use x(t) to stand for the primary unfiltered profile, m(t) for the Gaussian filtered mean line, and r(t) for the roughness profile, then m(t) = x(t)∗ h(t) (2) and r(t) = x(t) − m(t), (3) where the * represents a convolution of two functions. -
Chapter 3 FILTERS
Chapter 3 FILTERS Most images are a®ected to some extent by noise, that is unexplained variation in data: disturbances in image intensity which are either uninterpretable or not of interest. Image analysis is often simpli¯ed if this noise can be ¯ltered out. In an analogous way ¯lters are used in chemistry to free liquids from suspended impurities by passing them through a layer of sand or charcoal. Engineers working in signal processing have extended the meaning of the term ¯lter to include operations which accentuate features of interest in data. Employing this broader de¯nition, image ¯lters may be used to emphasise edges | that is, boundaries between objects or parts of objects in images. Filters provide an aid to visual interpretation of images, and can also be used as a precursor to further digital processing, such as segmentation (chapter 4). Most of the methods considered in chapter 2 operated on each pixel separately. Filters change a pixel's value taking into account the values of neighbouring pixels too. They may either be applied directly to recorded images, such as those in chapter 1, or after transformation of pixel values as discussed in chapter 2. To take a simple example, Figs 3.1(b){(d) show the results of applying three ¯lters to the cashmere ¯bres image, which has been redisplayed in Fig 3.1(a). ² Fig 3.1(b) is a display of the output from a 5 £ 5 moving average ¯lter. Each pixel has been replaced by the average of pixel values in a 5 £ 5 square, or window centred on that pixel. -
Review of Smoothing Methods for Enhancement of Noisy Data from Heavy-Duty LHD Mining Machines
E3S Web of Conferences 29, 00011 (2018) https://doi.org/10.1051/e3sconf/20182900011 XVIIth Conference of PhD Students and Young Scientists Review of smoothing methods for enhancement of noisy data from heavy-duty LHD mining machines Jacek Wodecki1, Anna Michalak2, and Paweł Stefaniak2 1Machinery Systems Division, Wroclaw University of Science and Technology, Wroclaw, Poland 2KGHM Cuprum R&D Ltd., Wroclaw, Poland Abstract. Appropriate analysis of data measured on heavy-duty mining machines is essential for processes monitoring, management and optimization. Some particular classes of machines, for example LHD (load-haul-dump) machines, hauling trucks, drilling/bolting machines etc. are characterized with cyclicity of operations. In those cases, identification of cycles and their segments or in other words – simply data segmen- tation is a key to evaluate their performance, which may be very useful from the man- agement point of view, for example leading to introducing optimization to the process. However, in many cases such raw signals are contaminated with various artifacts, and in general are expected to be very noisy, which makes the segmentation task very difficult or even impossible. To deal with that problem, there is a need for efficient smoothing meth- ods that will allow to retain informative trends in the signals while disregarding noises and other undesired non-deterministic components. In this paper authors present a review of various approaches to diagnostic data smoothing. Described methods can be used in a fast and efficient way, effectively cleaning the signals while preserving informative de- terministic behaviour, that is a crucial to precise segmentation and other approaches to industrial data analysis. -
Electronic Filters Design Tutorial - 3
Electronic filters design tutorial - 3 High pass, low pass and notch passive filters In the first and second part of this tutorial we visited the band pass filters, with lumped and distributed elements. In this third part we will discuss about low-pass, high-pass and notch filters. The approach will be without mathematics, the goal will be to introduce readers to a physical knowledge of filters. People interested in a mathematical analysis will find in the appendix some books on the topic. Fig.2 ∗ The constant K low-pass filter: it was invented in 1922 by George Campbell and the Running the simulation we can see the response meaning of constant K is the expression: of the filter in fig.3 2 ZL* ZC = K = R ZL and ZC are the impedances of inductors and capacitors in the filter, while R is the terminating impedance. A look at fig.1 will be clarifying. Fig.3 It is clear that the sharpness of the response increase as the order of the filter increase. The ripple near the edge of the cutoff moves from Fig 1 monotonic in 3 rd order to ringing of about 1.7 dB for the 9 th order. This due to the mismatch of the The two filter configurations, at T and π are various sections that are connected to a 50 Ω displayed, all the reactance are 50 Ω and the impedance at the edges of the filter and filter cells are all equal. In practice the two series connected to reactive impedances between cells. -
Data Mining Algorithms
Data Management and Exploration © for the original version: Prof. Dr. Thomas Seidl Jiawei Han and Micheline Kamber http://www.cs.sfu.ca/~han/dmbook Data Mining Algorithms Lecture Course with Tutorials Wintersemester 2003/04 Chapter 4: Data Preprocessing Chapter 3: Data Preprocessing Why preprocess the data? Data cleaning Data integration and transformation Data reduction Discretization and concept hierarchy generation Summary WS 2003/04 Data Mining Algorithms 4 – 2 Why Data Preprocessing? Data in the real world is dirty incomplete: lacking attribute values, lacking certain attributes of interest, or containing only aggregate data noisy: containing errors or outliers inconsistent: containing discrepancies in codes or names No quality data, no quality mining results! Quality decisions must be based on quality data Data warehouse needs consistent integration of quality data WS 2003/04 Data Mining Algorithms 4 – 3 Multi-Dimensional Measure of Data Quality A well-accepted multidimensional view: Accuracy (range of tolerance) Completeness (fraction of missing values) Consistency (plausibility, presence of contradictions) Timeliness (data is available in time; data is up-to-date) Believability (user’s trust in the data; reliability) Value added (data brings some benefit) Interpretability (there is some explanation for the data) Accessibility (data is actually available) Broad categories: intrinsic, contextual, representational, and accessibility. WS 2003/04 Data Mining Algorithms 4 – 4 Major Tasks in Data Preprocessing -
Memristor-Based Approximation of Gaussian Filter
Memristor-based Approximation of Gaussian Filter Alex Pappachen James, Aidyn Zhambyl, Anju Nandakumar Electrical and Computer Engineering department Nazarbayev University School of Engineering Astana, Kazakhstan Email: [email protected], [email protected], [email protected] Abstract—Gaussian filter is a filter with impulse response of fourth section some mathematical analysis will be provided to Gaussian function. These filters are useful in image processing obtained results and finally the paper will be concluded by of 2D signals, as it removes unnecessary noise. Also, they could stating the result of the done work. be helpful for data transmission (e.g. GMSK modulation). In practice, the Gaussian filters could be approximately designed II. GAUSSIAN FILTER AND MEMRISTOR by several methods. One of these methods are to construct Gaussian-like filter with the help of memristors and RLC circuits. A. Gaussian Filter Therefore, the objective of this project is to find and design Gaussian filter is such filter which convolves the input signal appropriate model of Gaussian-like filter, by using mentioned devices. Finally, one possible model of Gaussian-like filter based with the impulse response of Gaussian function. In some on memristor designed and analysed in this paper. sources this process is also known as the Weierstrass transform [2]. The Gaussian function is given as in equation 1, where µ Index Terms—Gaussian filters, analog filter, memristor, func- is the time shift and σ is the scale. For input signal of x(t) tion approximation the output is the convolution of x(t) with Gaussian, as shown in equation 2. -
Sampling and Reconstruction
Sampling and reconstruction COMP 575/COMP 770 Spring 2016 • 1 Sampled representations • How to store and compute with continuous functions? • Common scheme for representation: samples write down the function’s values at many points [FvDFH fig.14.14b / Wolberg] [FvDFH fig.14.14b / • 2 Reconstruction • Making samples back into a continuous function for output (need realizable method) for analysis or processing (need mathematical method) amounts to “guessing” what the function did in between [FvDFH fig.14.14b / Wolberg] [FvDFH fig.14.14b / • 3 Filtering • Processing done on a function can be executed in continuous form (e.g. analog circuit) but can also be executed using sampled representation • Simple example: smoothing by averaging • 4 Roots of sampling • Nyquist 1928; Shannon 1949 famous results in information theory • 1940s: first practical uses in telecommunications • 1960s: first digital audio systems • 1970s: commercialization of digital audio • 1982: introduction of the Compact Disc the first high-profile consumer application • This is why all the terminology has a communications or audio “flavor” early applications are 1D; for us 2D (images) is important • 5 Sampling in digital audio • Recording: sound to analog to samples to disc • Playback: disc to samples to analog to sound again how can we be sure we are filling in the gaps correctly? • 6 Undersampling • What if we “missed” things between the samples? • Simple example: undersampling a sine wave unsurprising result: information is lost surprising result: indistinguishable from -
Deconvolution
Pulses and Parameters in the Time and Frequency Domain David A Humphreys National Physical Laboratory ([email protected]) Signal Processing Seminar 30 November 2005 Structure • Introduction • Waveforms and parameters • Instruments • Waveform metrology and correction Waveforms and parameters Parameters for a pulse waveform Signal Time Why use parameters? • Convenient way to compare information • Reduce data complexity • Specification of instruments • IEEE Standard on Transitions, Pulses, and Related Waveforms, IEEE Std 181, 2003 • These documents standardise how to characterise a waveform but do not specify units Measuring and characterising a signal Determine parameters that describe a signal or response I. Instrument capabilities II. Waveform metrology and correction III. Parameter analysis and extraction Assumptions • In practice we want to define a response in terms of single parameters such as width or risetime or bandwidth • Assume oscilloscope response has smooth bell-shaped e.g. Gaussian Simple analytically Can calculate frequency response, convolution simply, reasonably realistic Only 3 parameters – width/risetime; amplitude and position Instruments Instrumentation • Time-domain Frequency Real-time oscilloscope Time High-speed A/D converter Memory subsystem e.g. 32 Msamples X(t) A/D Memory Instrumentation • Time-domain Frequency Real-time oscilloscope Time Sample rates up to 40Gsamples/s Multiple high-speed A/D converters X(t) A/D Memory Fast memory subsystem A/D Memory Memory architecture may limit the length of trace A/D Memory e.g. 1 Msamples A/D Memory Resolution typically 8 bits Instrumentation • Time-domain Frequency Real-time oscilloscope Time Sampling oscilloscope Requires a repetitive waveform Sampling X(t) High-speed >70 GHz Gate Short trace length (e.g.