Understanding Sparsity Properties of Frames Using Decomposition Spaces
Total Page:16
File Type:pdf, Size:1020Kb
Understanding sparsity properties of frames using decomposition spaces Felix Voigtlaender http://voigtlaender.xyz Technische Universität Berlin Applied Functional Analysis Group Seminar “Advanced Topics in PDE and Harmonic Analysis” Bonn, 24. November 2017 F. Voigtlaender Sparsity properties of frames via decomposition spaces PDE and Harmonic Analysis Seminar, Bonn 1 / 20 Outline 1 Different representation systems and their applications (5 slides) 2 Structured systems & Decomposition spaces (2 slides) 3 Sparsity properties characterized by decomposition spaces (7 slides) F. Voigtlaender Sparsity properties of frames via decomposition spaces PDE and Harmonic Analysis Seminar, Bonn 2 / 20 Outline 1 Different representation systems and their applications (5 slides) 2 Structured systems & Decomposition spaces (2 slides) 3 Sparsity properties characterized by decomposition spaces (7 slides) F. Voigtlaender Sparsity properties of frames via decomposition spaces PDE and Harmonic Analysis Seminar, Bonn 3 / 20 The Fourier basis: The mother of all representation systems 2pihn;•i d d d Consider Fourier basis (en) d := e d on the torus = = . n2Z n2Z T R Z Nice properties: 2 d Fourier basis is an orthonormal basis for L (T ). Smooth functions are sparse in the Fourier basis. k d p d 2d For example: If g 2 C , then (g (n)) d 2 ` for p > . T b n2Z Z d+2k Fourier basis diagonalizes translation invariant operators. But: The coefficients gb(n) = hg; eni are non-local. 1 d If g is discontinuous at a single point, then (g (n)) d 2= ` . b n2Z Z d For the Fourier transform on R : 2pihx;•i I The index set of (e ) d is uncountable. x2R 2pihx;•i p d d I We have e 2= L R for x 2 R and p < ¥. 2pihx;•i I The coefficients gb(x) = hg; e i depend non-locally on g. F. Voigtlaender Sparsity properties of frames via decomposition spaces PDE and Harmonic Analysis Seminar, Bonn 4 / 20 A wish list for representation systems Φ = (ji )i2I should be a frame for Hilbert space H, i.e.: 1 f 2 H can be stably recovered from the analysis coefficients (hf ; ji i)i2I . 2 The synthesis map 2 SΦ : ` (I ) ! H; (ci )i2I 7! ∑ ci · ji i2I is bounded and surjective. 2 2 Note: Each of these prop. equivalent to kf kH ∑i2I jhf ;ji ij for all f 2 H. Φ should yield sparse representations for a function class C of interest. 1 p Analysis sparsity means (hf ; ji i)i2I 2 ` (I ). 2 p Synthesis sparsity means f = ∑i2I ci ji with (ci )i2I 2 ` (I ). Φ should be “compatible” with a class of operators of interest (e.g.: operators in the class preserve sparsity w.r.t. Φ). Characterization of function spaces using the coefficients (hf ;ji i)i2I . Φ should be efficiently implementable. Φ should be useful feature extractor (e.g. for edge detection). F. Voigtlaender Sparsity properties of frames via decomposition spaces PDE and Harmonic Analysis Seminar, Bonn 5 / 20 Example 1: Gabor frames 2 d Given a prototype g 2 L R and sampling densities a;b > 0, the associated Gabor system is n [n;k;a;b] 2pihan;•−bki d o G(g;a;b) := g := Lbk [Man g] = e · g (• − bk): n;k 2 Z : Illustration: F. Voigtlaender Sparsity properties of frames via decomposition spaces PDE and Harmonic Analysis Seminar, Bonn 6 / 20 Example 1: Gabor frames 2 d Given a prototype g 2 L R and sampling densities a;b > 0, the associated Gabor system is n [n;k;a;b] 2pihan;•−bki d o G(g;a;b) := g := Lbk [Man g] = e · g (• − bk): n;k 2 Z : Applications: Feature extraction: Gabor transform ≈ score sheet Gabor frames characterize modulation spaces, used to study ΨDOs. [n;k;a;b] Frequency concentration: If suppgb⊂ Q, then supp F g ⊂ Q + an. or F. Voigtlaender Sparsity properties of frames via decomposition spaces PDE and Harmonic Analysis Seminar, Bonn 6 / 20 Example 2: Wavelet frames 2 d 2 d Given low-pass filter j 2 L R , mother wavelet g 2 L R , and sampling density d > 0, the associated wavelet system is n [−1;k;d ] d o W(j;g;d) := g := Ldk j : k 2 Z n [j;k;d] jd=2 j d o [ g := 2 · g (2 • −dk): j 2 N0;k 2 Z : Illustration: F. Voigtlaender Sparsity properties of frames via decomposition spaces PDE and Harmonic Analysis Seminar, Bonn 7 / 20 Example 2: Wavelet frames 2 d 2 d Given low-pass filter j 2 L R , mother wavelet g 2 L R , and sampling density d > 0, the associated wavelet system is n [−1;k;d ] d o W(j;g;d) := g := Ldk j : k 2 Z n [j;k;d] jd=2 j d o [ g := 2 · g (2 • −dk): j 2 N0;k 2 Z : Applications: Feature extraction: Wavelet transform can detect singularities of functions. Sparsity: Piecewise smooth functions have sparse wavelet transform. Wavelet frames characterize Besov spaces and Triebel-Lizorkin spaces, used to study Calderon-Zygmund operators. 23 Frequency concentration: 2 [j;k;d ] j 2 If suppg ⊂ Q, then supp F g ⊂ 2 Q for j 2 N0. b 21 20 20 21 22 23 F. Voigtlaender Sparsity properties of frames via decomposition spaces PDE and Harmonic Analysis Seminar, Bonn 7 / 20 Example 3: Shearlet frames Given low-pass filter j, mother shearlet g, and sampling density d > 0, the associated cone-adapted shearlet system is n [−1;k;d] 2o SH(j;g;d) := g := Ldk j : k 2 Z n [i;k;d ] 1=2 T 2o [ g := jdetTi j · g (Ti • −dk): i 2 I0; k 2 Z j=2 with I0 := (j;`;i) 2 N0 × Z × f0;1g : j`j ≤ 2 and 0 1 2j 0 1 0 T = Ri · P · S with R = ; P = ; S = : j;`;i j ` 1 0 j 0 2j=2 ` ` 1 Illustration (images courtesy of Philipp Petersen) F. Voigtlaender Sparsity properties of frames via decomposition spaces PDE and Harmonic Analysis Seminar, Bonn 8 / 20 Example 3: Shearlet frames Given low-pass filter j, mother shearlet g, and sampling density d > 0, the associated cone-adapted shearlet system is n [−1;k;d] 2o SH(j;g;d) := g := Ldk j : k 2 Z n [i;k;d ] 1=2 T 2o [ g := jdetTi j · g (Ti • −dk): i 2 I0; k 2 Z : Applications: Feature extraction: Decay of shearlet transform characterizes wavefront set. Sparsity: The shearlet coefficients of cartoon-like functions are sparse. What kind of spaces are characterised by shearlets? What kinds of operators can be understood using shearlets? F. Voigtlaender Sparsity properties of frames via decomposition spaces PDE and Harmonic Analysis Seminar, Bonn 8 / 20 Example 3: Shearlet frames Given low-pass filter j, mother shearlet g, and sampling density d > 0, the associated cone-adapted shearlet system is n [−1;k;d] 2o SH(j;g;d) := g := Ldk j : k 2 Z n [i;k;d ] 1=2 T 2o [ g := jdetTi j · g (Ti • −dk): i 2 I0; k 2 Z : Applications: Feature extraction: Decay of shearlet transform characterizes wavefront set. Sparsity: The shearlet coefficients of cartoon-like functions are sparse. What kind of spaces are characterised by shearlets? What kinds of operators can be understood using shearlets? Frequency concentration: Q F. Voigtlaender Sparsity properties of frames via decomposition spaces PDE and Harmonic Analysis Seminar, Bonn 8 / 20 Outline 1 Different representation systems and their applications (5 slides) 2 Structured systems & Decomposition spaces (2 slides) 3 Sparsity properties characterized by decomposition spaces (7 slides) F. Voigtlaender Sparsity properties of frames via decomposition spaces PDE and Harmonic Analysis Seminar, Bonn 9 / 20 Structured systems A structured system is of the form Γ(d ) = g[i;k;d ] with i2I ;k2Zd 1 g[i;k;d] = jdetT j 2 · L M g ◦ T T i d· −T ·k b i Ti i for some prototype g and a family of affine maps ( Ti • + bi )i2I . Note: All of the considered systems are (more of less) of this form! Frequency concentration of structured system: g[i] := g[i;0;d ] satisfies [i] −1=2 −1 F g = jdetTi j · Lbi gb◦ Ti : d [i] If gb is concentrated in Q ⊂ R , then F g is concentrated in Qi := Ti Q + bi . Q = (Qi )i2I is the structured covering associated to the structured system. p q Goal: Find family of Banach spaces D Q;L ;`w , parametrized by p;q;w, so that p q (d ) f 2 D(Q;L ;`w ) () f sparse with respect to Γ : F. Voigtlaender Sparsity properties of frames via decomposition spaces PDE and Harmonic Analysis Seminar, Bonn 10 / 20 Decomposition spaces d Consider structured admissible covering Q = (Qi )i2I of R . This means: d There is a fixed open, bounded base set Q ⊂ R with Qi = Ti Q + bi 8i 2 I ; ∗ ∗ ji j ≤ N for all i 2 I , with i := f` 2 I : Q` \ Qi 6= ?g, additional technical conditions (almost always satisfied in practice). Choose a regular partition of unity Φ = (ji )i2I subordinate to Q. ¥ ji 2 Cc (Qi ), ∑i2I ji ≡ 1 and some other technical condition. Choose a Q-moderate weight w = (wi )i2I , i.e., wi ≤ C · wj if Qi \ Qj 6= ?. For p;q 2 (0;¥], and g 2 R, define the decomposition space (quasi)-norm −1 kgk p q := wi · F (ji · g) p 2 [0;¥]: D(Q;L ;`w ) b L i2I `q The decomposition space determined by Q;p;q;w is p q D(Q;L ;` ) := g 2 R : kgk p q < ¥ : w D(Q;L ;`w ) 0 d Here R is a suitable reservoir of distributions (think: R = S (R )).