Splines and Wavelets

Total Page:16

File Type:pdf, Size:1020Kb

Splines and Wavelets 6 Splines and wavelets A fundamental aspect of our formulation is that the whitening operator L is nat- urally tied to some underlying B-spline function, which will play a crucial role in the sequel. The spline connection also provides a strong link with wavelets [UB03]. In this chapter, we review the foundations of spline theory and show how one can construct B-spline basis functions and wavelets that are tied to some specific oper- ator L. The chapter starts with a gentle introduction to wavelets that exploits the analogy with Legos blocks. This naturally leads to the formulation of a multiresolu- tion analysis of L2(R) using piecewise-constant functions and a de visu identification of Haar wavelets. We then proceed in Section 6.2 with a formal definition of our gen- eralized brand of splines—the cardinal L-splines—followed by a detailed discussion of the fundamental notion of Riesz basis. In Section 6.3, we systematically cover the first-order operators with the construction of exponential B-splines and wavelets, which have the convenient property of being orthogonal. We then address the the- ory in its full generality and present two generic methods for constructing B-spline basis functions (Section 6.4) and semi-orthogonal wavelets (Section 6.5). The pleas- ing aspect is that these results apply to the whole class of shift-invariant differential operators L whose null space is finite-dimensional (possibly trivial), which are pre- cisely those that can be safely inverted to specify sparse stochastic processes. 6.1 From Legos to wavelets It is instructive to get back to our introductory example of piecewise-contant splines in Chapter 1 (§1.3) and to show how these are naturally connected to wavelets. The fundamental idea in wavelet theory is to construct a series of fine-to-coarse approx- imations of a function s(r ) and to exploit the structure of the multiresolution approx- imation errors, which are orthogonal across scale. Here, we shall consider a series of approximating signals {si }i Z, where si is a piecewise-constant spline with knots 2 positioned on 2i Z. These multiresolution splines are represented by their B-spline expansion si (r ) ci [k]¡i,k (r ), (6.1) = k Z X2 6.1 From Legos to wavelets 113 where the B-spline basis functions (rectangles) are dilated versions of the cardinal ones by a factor of 2i r 2i k 1, for r 2i k,2i (k 1) ¡ (r ) Ø0 ° 2 + (6.2) i,k = i = 0, otherwise. + µ 2 ∂ ( £ ¢ The variable i is the scale index that specifies the resolution (or knot spacing) a 2i , = while the integer k encodes for the spatial location. The B-spline of degree 0, ¡ 0 = ¡0,0 Ø , is the scaling function of the representation. Interestingly, it is the iden- = + tification of a proper scaling function that constitutes the most fundamental step in the construction of a wavelet basis of L2(R). DEFINITION 6.1 (Scaling function) ¡ L (R) is a valid scaling function if and only 2 2 if it satisfies the following three properties: – Two-scale relation ¡(r /2) h[k]¡(r k), (6.3) = k Z ° X2 where the sequence h ` (Z) is the so-called refinement mask. 2 1 – Partition of unity ¡(r k) 1 (6.4) k Z ° = X2 – The set of functions {¡( k)}k Z forms a Riesz basis. · ° 2 In practice, a given brand of (orthogonal) wavelets (e.g., Daubechies or splines) is often summarized by its refinement filter h since the latter uniquely specifies ¡, subject to the admissibility constraints (6.4) and ¡ L (R). In the case of the B-spline 2 2 of degree 0, we have that h[k] ±[k] ±[k 1], where = + ° 1, for k 0 ±[k] = = ( 0, otherwise is the discrete Kronecker impulse. This translates into what we jokingly refer to as the Lego-Duplo relation 1 Ø0 (r /2) Ø0 (r ) Ø0 (r 1). (6.5) + = + + + ° The fact that Ø0 satisfies the partition of unity is obvious. Likewise, we already ob- + served in Chapter 1 that Ø0 generates an orthogonal system which is a special case + of a Riesz basis. By considering the rescaled version of such a basis, we specify the subspace of splines at scale i as Vi si (r ) ci [k]¡i,k (r ):ci `2(Z) L2(R) = ( = k Z 2 ) Ω X2 1. The Duplos are the larger-scale versions of the Lego building blocks and are more suitable for smal- ler children to play with. The main point of the analogy with wavelets is that Legos and Duplos are com- patible; they can be combined to build more complex shapes. The enabling property is that a Duplo is equivalent to two smaller Legos placed next to each other, as expressed by (6.5) 114 Splines and wavelets Wavelets: Haar transform revisited 4 s0(x) ψ(x) 3 Wavelet: 2 1 0 2 4 6 8 2 1 4 + s1(x) 3 2 4 6 8 -1 2 - -2 1 ri(x)=si−1(x) − si(x) 2 0 2 4 6 8 4 + 1 s2(x) 3 2 4 6 8 2 - -1 1 -2 2 0 2 4 6 8 4 + 1 s3(x) 3 2 4 6 8 2 - -1 1 -2 0 2 4 6 8 Figure 6.1 Multiresolution signal analysis using piecewise-constant splines with a dyadic scale progression. Left: multiresolution pyramid. Right: error signals between two successive levels of the pyramid. which, in our example, contains all the finite-energy functions that are piecewise- constant on the intervals 2i k,2i (k 1) with k Z. The two-scale relation (6.3) im- + 2 plies that the basis functions at scale i 1 are contained in V (the original space £ ¢= 0 of cardinal splines) and, by extension, in V for i 0. This translates into the gen- i ∑ eral inclusion property V V for any i 0 i, which is fundamental to the theory. i 0 Ω i > A subtler point is that the closure of i Z Vi is equal to L2(R), which follows from 2 the fact that any finite-energy function can be approximated arbitrarily well by a S piecewise-constant spline when the sampling step 2i tends to zero (i ). The !°1 necessary and sufficient condition for this asymptotic convergence is the partition of unity (6.4), which ensures that the representation is complete. Having set the notation and specified the underlying hierarchy of function spaces, we now proceed with the multiresolution approximation procedure starting from the fine-scale signal s (x), as illustrated in Figure 6.1. Given the sequence c [ ] of fine- 0 0 · scale coefficients, our task is to construct the best spline approximation at scale 1 which is specified by its B-spline coefficients c [ ] in (6.1) with i 1. It is easy to see 1 · = that the minimum-error solution (orthogonal projection of s0 onto V1) is obtained by taking the mean of two consecutive samples. The procedure is then repeated at the next coarser scale and so forth until one reaches the bottom of the pyramid, as shown on the left-hand side of Figure 6.1. The description of this coarsening algorithm is 1 1 ci [k] ci 1[2k] ci 1[2k 1] ci 1 h˜ [2k]. (6.6) = 2 ° + 2 ° + = ° § ° ¢ 6.1 From Legos to wavelets 115 It is run recursively for i 1,...,i where i denotes the bottom level of the pyr- = max max amid. The outcome is a multiresolution analysis of our input signal s0. In order to uncover the wavelets, it is enlightening to look at the residual signals ri (r ) si 1(r ) si (r ) Vi 1 on the right of Figure 6.1. While these are splines that = ° ° 2 ° live at the same resolution as si 1, they actually have half the apparent degrees of ° freedom. These error signals exhibit a striking sign-alternation pattern due to the fact that two consecutive samples (ci 1[2k],ci 1[2k 1]) are at an equal distance ° ° + from their mean value (ci [k]). This suggests rewriting the residuals more concisely in terms of oscillating basis functions (wavelets) at scale i, like ri (r ) si 1(r ) si (r ) di [k]√i,k (r ), (6.7) = ° ° = k Z X2 where the (non-normalized) Haar wavelets are given by r 2i k √ (r ) √ ° i,k = Haar i µ 2 ∂ with the Haar wavelet being defined by (1.19). The wavelet coefficients d [ ] are given i · by the consecutive half differences 1 1 di [k] ci 1[2k] ci 1[2k 1] ci 1 g˜ [2k]. (6.8) = 2 ° ° 2 ° + = ° § ° ¢ More generally, since the wavelet template at scale i 1, √ V , we can write = 1,0 2 0 √(r /2) g[k]¡(r k) (6.9) = k Z ° X2 which is the wavelet counterpart of the two-scale relation (6.3). In the present ex- ample, we have g[k] ( 1)k h[k], which is a general relation that is characteristic of = ° an orthogonal design. Likewise, in order to gain in generality, we have chosen to ex- press the decomposition algorithms (6.6) and (6.8) in terms of discrete convolution (filtering) and downsampling operations where the corresponding Haar analysis fil- ters are h˜[k] 1 h[ k] and g˜[k] 1 ( 1)k h[ k]. The Hilbert-space interpretation of = 2 ° = 2 ° ° this approximation process is that r W , where W is the orthogonal complement i 2 i i of Vi in Vi 1; that is, Vi 1 Vi Wi with Vi Wi (as a consequence of the orthogonal- ° ° = + ? projection theorem).
Recommended publications
  • A Suite on Wavelet Differentiation Algorithms
    Algorithm 929: A Suite on Wavelet Differentiation Algorithms MANI MEHRA and KAVITA GOYAL, Indian Institute of Technology Delhi A collection of the Matlab routines that compute the values of the scaling and wavelet functions (φ(x)and ψ(x) respectively) and the derivative of an arbitrary function (periodic or non periodic) using wavelet bases is presented. Initially, the case of Daubechies wavelets is taken and the procedure is explained for both collocation and Galerkin approaches. For each case a Matlab routine is provided to compute the differenti- ation matrix and the derivative of the function f (d) = D(d) f . Moreover, the convergence of the derivative is shown graphically as a function of different parameters (the wavelet genus, D and the scale, J) for two test functions. We then consider the use of spline wavelets. Categories and Subject Descriptors: G.1.2 [Numerical Analysis]: Approximation—Wavelets and fractals; G.1.8 [Numerical Analysis]: Partial Differential Equations—Multigrid and multilevel methods General Terms: Algorithms, Theory Additional Key Words and Phrases: Differentiation matrices, wavelets, wavelet methods (Galerkin and collocation), splines. ACM Reference Format: Mehra, M. and Goyal, K. 2013. Algorithm 929: A suite on wavelet differentiation algorithms ACM Trans. Math. Softw. 39, 4, Article 27 (July 2013), 28 pages. DOI: http://dx.doi.org/10.1145/2491491.2491497 1. INTRODUCTION The term differentiation matrix D(d) denotes the transformation between grid point values of a function and its d-th order derivative. In the case of the Galerkin ap- proach [Canuto et al. 1988] this matrix is the product of three matrices, that is, D(d) = C−1 D(d)C.
    [Show full text]
  • On Spline Wavelets
    On Spline Wavelets Dedicated to Professor Charles Chui on the occasion of his 65th birthday Jianzhong Wang Abstract. Spline wavelet is an important aspect of the constructive theory of wavelets. This paper consists of three parts. The ¯rst part surveys the joint work of Charles Chui and me on the construction of spline wavelets based on the duality principle. It also includes a discussion of the computational and algorithmic aspects of spline wavelets. The second part reviews our study of asymptotically time- frequency localization of spline wavelets. The third part introduces the application of Shannon wavelet packet in the sub-band decompo- sition in multiple-channel synchronized transmission of signals. x1. Introduction In this paper, I give a brief survey of my joint work with Charles Chui on spline wavelet. In the theory of wavelet analysis, an important aspect is to construct wavelet bases of a function space, say of the Hilbert space L2(R) ([32], [64], [65]). Recall that a (standard) wavelet basis of L2(R) is the basis generated by the dilations and translates of a \wavelet" function Ã: More precisely, if the set of functions j=2 j fÃj;kgj;k2Z ;Ãj;k = 2 Ã(2 x ¡ k); (1) forms an unconditional basis (also called a Riesz basis) of L2(R); then we call à a wavelet and call the system (1) a wavelet basis. Three of most basic properties of a wavelet are its regularity, its decay speed, and the order of its vanishing moments. Therefore, a wavelets is usually chosen to be compactly supported (or exponentially decay) and to have certain degree of regularity so that they are \local" in both x-domain (time domain) and !-domain (frequency domain).
    [Show full text]
  • Construction of Biorthogonal B-Spline Type Wavelet Sequences with Certain Regularities
    Construction of Biorthogonal B-spline Type Wavelet Sequences with Certain Regularities Tian-Xiao He∗ Department of Mathematics and Computer Science Illinois Wesleyan University, Bloomington, IL 61702-2900, USA [email protected] Abstract In this paper we study a refinement equation of the form φ(x) = P n∈Z hnφ(2x − n), where {hn} is a finitely supported sequence. 1 P n Let the symbol of the sequnce m(z) := 2 n hnz take the form 1+z N k0 Pk j P P j m(z) = ( 2 ) z j=0 ajz where j aj = 1 and j(−1) aj 6= P 2 P 2 0. Under the assumption 0≤odd j≤k |aj| + 0≤even j≤k |aj| 2N−1 < 2 we show that the corresponding φ is in L2. Then the B-spline type wavelet sequences that possess the largest possible regularities and required vanishing moments are characterized. AMS Subject Classification: 39A70, 41A80, 65B10. Key Words and Phrases: symbolic summation operator, power series, generating function, Euler’s series transform. 1 Introduction We start by setting some notations. We define a low-pass filter as ∗The author would like to thank the Illinois Wesleyan University for a sabbatical leave during which the research in this paper was carried out. 1 2 Tian-Xiao He −1 X −inξ m0(ξ) = 2 cne . (1.1) n Here, we assume that only finitely many cn are nonzero. However, some of our results can be extended to infinite sequences that have sufficient decay for |n| → ∞. Next, we define φ by ˆ ∞ −j φ(ξ) = Πj=1m0(2 ξ).
    [Show full text]
  • A BRIEF STUDY on CARDINAL B- SPLINE WAVELETS Rupali Gupta1, Gagan Batra2 1,2Mathematics Department, Khalsa College for Women, Ludhiana, Punjab (India)
    A BRIEF STUDY ON CARDINAL B- SPLINE WAVELETS Rupali Gupta1, Gagan Batra2 1,2Mathematics Department, Khalsa College For Women, Ludhiana, Punjab (India) ABSTRACT This paper focuses on the concepts of Cardinal B-Spline wavelets, their Properties and description of their relations. Spline wavelets are extremely regular and usually symmetric or anti-symmetric. They can be designed to have compact support and to achieve optimal time-frequency localization (B-spline wavelets). The underlying scaling functions are the B-splines, which are the shortest and most regular scaling functions of order L which will be further classified into linear, quadratic or biquadratic spline wavelets. Their graphical representations are enclosed herein. Keywords: Compact Structures, Control points, Interpolation,Orthonormal, Spline wavelets. I. INTRODUCTION In this paper, we try to visualize the basic concepts of B- spline cardinal wavelets and their properties[1]. A spline wavelet is a wavelet constructed using a spline functionwhich is basically orthogonal, but do not have any compact supports. The interpolatory spline wavelets were introduced by C.K. Chui and J.Z. Wang. There is a certain class of wavelets, unique in some sense, having compact supports with some special properties. These special wavelets are called B-spline wavelets or cardinal B-spline wavelets. A Basis spline, often called as B-spline is a spline function that has the minimum support with respect to some given degree, sleekness, and domain partition. All spline functions of a given degree can be expressed as Linear combination[6] of B-splines of that degree. Due to this reason, B-splines of order ‘n’ are basis functions for spline functions of the same order defined over the same knots.
    [Show full text]
  • 4.4 Basic Spline Wavelet Transform
    Basic Spline Wavelet Transform and Pitch Detection of a Speech Signal by Ken Wenchian Lee Submitted to the Department of Electrical Engineering and Computer Science in Partial Fulfillment of the Requirements for the Degrees of Bachelor of Science and Master of Science at the Massachusetts Institute of Technology May 1994 © 1994 Ken Wenchian Lee. All rights reserved. The author hereby grants to MIT permission to reproduce and to distribute publicly paper and electronic copies of this thesis document in whole or in part. // Signature of Author . .... ... .. o d ;... .. .. V1~ 4'.7 o. Department of Electrical Engineering and Computer Science Certified by ...................... r...L. Yr......... .................................- Professor Peter Elias Department of Electrical Engineering and Computer Science Thesis Supervisor (Academic) Certified by .......................................; ..... ......... ... ......................... Dr. Forrest Tzeng o-\ C Supervisor(COMSAT Laboratories) I . Accepted by ............... ·J.......... ............. deric R. Morgenthaler on Graduate Students Basic Spline Wavelet Transform and Pitch Detection of a Speech Signal by Ken Wenchian Lee Submitted to the Department of Electrical Engineering and Computer Science on January 28, 1994, in Partial Fulfillment of the Requirements for the Degrees of Bachelor of Science and Master of Science Abstract In recent years the wavelet transform and its applications have gained tremendous interest and have come under intense investigation. Successful applications of the transform are inherently dependent on the wavelets themselves, whose properties necessary for a specific application are not well known. In this thesis, besides examining wavelet theory, we study the wavelet issues important in the accurate pitch detection of a speech signal in no noise, low noise, and high noise environments. To have control over the properties of the wavelets, we employ a transform based on wavelets built from a sum of shifted B-spline functions.
    [Show full text]
  • Non-Equispaced B-Spline Wavelets Is Concluded by the Short Section 3.5 on the Non-Decimated B-Spline Wavelet Transform
    Non-equispaced B-spline wavelets Version with detailed proofs Maarten Jansen Universit´elibre de Bruxelles Departments of Mathematics and Computer Science October 20, 2016 Abstract This paper has three main contributions. The first is the construction of wavelet transforms from B-spline scaling functions defined on a grid of non- equispaced knots. The new construction extends the equispaced, biorthog- onal, compactly supported Cohen-Daubechies-Feauveau wavelets. The new construction is based on the factorisation of wavelet transforms into lifting steps. The second and third contributions are new insights on how to use these and other wavelets in statistical applications. The second contribution is related to the bias of a wavelet representation. It is investigated how the fine scaling coefficients should be derived from the observations. In the con- text of equispaced data, it is common practice to simply take the observations as fine scale coefficients. It is argued in this paper that this is not acceptable for non-interpolatingwavelets on non-equidistant data. Finally, the third con- tribution is the study of the variance in a non-orthogonal wavelet transform in a new framework, replacing the numerical condition as a measure for non- orthogonality. By controlling the variances of the reconstruction from the wavelet coefficients, the new framework allows us to design wavelet trans- forms on irregular point sets with a focus on their use for smoothing or other applications in statistics. Keywords arXiv:1502.01533v2 [math.ST] 19 Oct 2016 B-spline; wavelet; Cohen-Daubechies-Feauveau; penalised splines; non-equispaced; non-equidistant; lifting AMS classification 42C40; 65T60; 65D07; 41A15; 65D10 1 1 Introduction Ever since the early days of wavelet research, spline wavelets have enjoyed special attention in the community.
    [Show full text]
  • Wavelet Bases
    VII Wavelet Bases One can construct wavelets ψ such that the dilated and translated family 1 t 2jn ψj,n(t)= ψ − j j √2 2 (j,n) Z2 ! " #$ ∈ is an orthonormal basis of L2(R). Behind this simple statement lie very different point of views which open a fruitful exchange between harmonic analysis and discrete signal processing. j j Orthogonal wavelets dilated by 2 carry signal variations at the resolution 2− . The construction of these bases can thus be related to multiresolution signal approximations. Following this link leads us to an unexpected equivalence between wavelet bases and conjugate mirror filters used in discrete multirate filter banks. These filter banks implement a fast orthogonal wavelet transform that requires only O(N) operations for signals of size N. The design of conjugate mirror filters also gives new classes of wavelet orthogonal bases including regular wavelets of compact support. In several dimensions, wavelet bases of L2(Rd) are constructed with separable products of functions of one variable. Wavelet bases are also adapted to bounded domains and surfaces with lifting algorithms. 7.1 Orthogonal Wavelet Bases Our search for orthogonal wavelets begins with multiresolution approximations. For f L2(R), the + ∈ partial sum of wavelet coefficients ∞ f,ψ ψ can indeed be interpreted as the difference n= $ j,n% j,n between two approximations of f at the−∞ resolutions 2 j+1 and 2 j. Multiresolution approximations % − − compute the approximation of signals at various resolutions with orthogonal projections on different spaces Vj j Z. Section 7.1.3 proves that multiresolution approximations are entirely characterized by a particular{ } ∈ discrete filter that governs the loss of information across resolutions.
    [Show full text]
  • Wavelets for Computer Graphics: a Primer Part 2
    Wavelets for Computer Graphics: A Primer Part 2 Eric J. Stollnitz Tony D. DeRose David H. Salesin University of Washington j 1 Introduction It is often convenient to put the different scaling functions § i(x) for a given level j together into a single row matrix, Wavelets are a mathematical tool for hierarchically decomposing ¨ j j ¢¥¢¥¢ j § (x) := [ § (x) (x)], functions. They allow a function to be described in terms of a coarse 0 mj © 1 overall shape, plus details that range from broad to narrow. Regard- less of whether the function of interest is an image, a curve, or a where mj is the dimension of Vj. We can do the same for the surface, wavelets provide an elegant technique for representing the wavelets: levels of detail present. j j ¢¥¢ ¢ j (x) := [ (x) © (x)], In Part 1 of this primer we discussed the simple case of Haar 0 nj 1 wavelets in one and two dimensions, and showed how they can be where nj is the dimension of Wj. Because Wj is the orthogonal com- used for image compression. In Part 2, we present the mathematical plement of Vj in Vj+1, the dimensions of these spaces satisfy mj+1 = theory of multiresolution analysis, then develop bounded-interval mj + nj. spline wavelets and describe their use in multiresolution curve and surface editing. The condition that the subspaces Vj be nested is equivalent to requir- ing that the scaling functions be re®nable. That is, for all j = 1, 2, ¤ there must exist a matrix of constants Pj such that 2 Multiresolution analysis ¨ ¨ j © 1(x) = j(x) Pj.
    [Show full text]
  • Spline Wavelets in Numerical Resolution of Partial Differential
    Spline Wavelets in Numerical Resolution of Partial Differential Equations Jianzhong Wang1 Department of mathematics, Computer Sciences, and Statistics Sam Houston State University Huntsville, Texas, USA Abstract. We give a review of applications of spline wavelets in the resolution of partial differential equations. Two typical methods for numerical solutions of partial dif- ferential equations are Galerkin method and collocation method. Corresponding to these two methods, we present the constructions of semi-orthogonal spline wavelets and semi- interpolation spline wavelets respectively. We also show how to use them in the numerical resolution of various partial differential equations. 1 Introduction In this paper, we show how wavelets, particularly the spline wavelets, can be used in the nu- merical resolution of partial differential equations (PDE’s). To solve a PDE numerically, we first need to find a finite-dimensional approximation space for the solutions, then discretize the PDE to a system of algebraic equations in this space so that the numerical solutions can be obtained. In many cases, the wavelets provide better bases of the approximation spaces than other bases in the following sense. First, the representations of the differen- tial operators are almost diagonal on the wavelet bases, that improves the conditioning of the discrete algebraic equations. Second, the wavelet representations are effective in the adaptive procedures so that the complexity of calculations can be reduced. Furthermore, when the solution has a certain singularity, its wavelet representation can automatically capture the singularity. Hence, the advantage of wavelet methods in numerical resolution of PDE’s is quite significant. However, in general, the wavelets do not have a localization as sharp as finite element method or finite difference method.
    [Show full text]
  • Wavelet Transforms Generated by Splines
    Wavelet transforms generated by splines Amir Z. Averbuch Valery A. Zheludev School of Computer Science Tel Aviv University Tel Aviv 69978, Israel Abstract In this paper we design a new family of biorthogonal wavelet transforms that are based on polynomial and discrete splines. The wavelet transforms are constructed from various types of interpolatory and quasi-interpolatory splines. The transforms use finite and infinite impulse response filters and are implemented in a fast lifting mode. We analyze properties of the generated wavelets. We describe successful applications of the designed transforms to still image compression. 1 Introduction In this paper we describe a new generic technique for the design of biorthogonal wavelet transforms. Some of the results that are presented in this paper have already appeared in [6]–[9]. However, this paper contains a unified theory that combines a full theoretical justifi- cations of the previous results with new facts about the spline-based wavelet transforms. The developed technique enables us to construct a wide family of transforms with various prop- erties. It supports flexible adaptation of the transforms to the problems under consideration. In particular, the newly designed transforms prove to be efficient for distinct computational problems such as image compression, feature extraction for signal identification, to name a few. The performance of the suggested transforms for still image compression is similar to the performance of the transform with 9/7 wavelets ([4]) on most of the benchmark images. Our 1 approach combines custom-design capabilities which are inherent in the lifting schemes [46] with the usage of the well-developed theory of interpolatory, quasi-interpolatory, continuous and discrete splines [34, 43, 55, 56].
    [Show full text]