Mathematics of Digitalization: Case Study

Total Page:16

File Type:pdf, Size:1020Kb

Mathematics of Digitalization: Case Study Mathematics of Digitalization: Case Study Massimo Fornasier Chair of Applied Numerical Analysis Email: [email protected] ——————– First lecture Munich, Oct. 17 2017 – Fallstudien der Modellbildung 1 INTRODUCTION Main topics: 1. After a short introduction on the Hilbert spaces, we describe the concepts of Fourier series, Fourier transforms and their discrete implementation, in particular the algorithm of the Fast Fourier Transform (FFT). 2. To connect the continuous Fourier transforms and the discrete one, we need to address the Shannon sampling theory (analog-to-digital conversion). For that it will be fundamental to understand the Poisson summation formula which will allow us to estimate also the errors in the analog-to-digital conversion, the so-called aliasing errors. 3. We shall introduce systems for robust analog-to-digital INTRODUCTION 2 conversion called frames in Hilbert spaces. We address special cases of frames, in particular Gabor frames in their continuous and discrete versions and the implementation of their so-called canonical duals. Applications to audio signals and in image compression will be showed. 4. We address in more detail the study case of the fresco restoration and how to use the tools we considered so far to solve it. INTRODUCTION 3 THE IMPORTANCE OF HARMONIC ANALYSIS We can synthesize a variety of complicated functions by • means of pure sinusoids in the same way we can produce a chord of C major pushing the keyboard (C, E, G) of a piano. It was Joseph Fourier (http://www-gap.dcs.st- • and.ac.uk/ history/Mathematicians/Fourier.html) who ∼ first developed the modern methods of trigonometric series and integrals in the study of the heat conduction in the solids (Analytical Theory of Heat, 1815). THE IMPORTANCE OF HARMONIC ANALYSIS 4 SOME OF THE MILESTONES The most cited paper in mathematics • J. W. Cooley and J. W. Tukey, An algorithm for the machine computation of complex Fourier series, Math. Comp., 19 (1965), 297-301. Almost 3/4 of the Nobel prizes in Physics are given on • work using methods and tools from Fourier analysis. F. N. Magill, ed., The Nobel Prize Winners — Physics, Vol 1-3, Salem Press. Englewood Cliffs, NJ. 1989. Francis Crick, James Watson and Maurice Wilkins got the • Nobel prize for the medicine in 1962 for the discovery of the molecular structure of the DNA. This was the first example of the use of Fourier methods on data coming from X ray diffraction. SOME OF THE MILESTONES 5 Herbert Hauptmann (a mathematician) and Jerome • Karle shared in 1985 the Nobel prize for chemistry after having shown how to use systematically Fourier analysis in order to determine the structure of large molecules from X ray diffraction data. W. A. Hendrickson, the 1985 Nobel Prize in Chemistery, Science 231 (1986), 362-364. The starting of the time-frequency analysis and the • wavelets (1960-1990). A large number of technological products (CD-DVD, high • definition TV, digital phones, medical imaging instruments ...) are based on discrete Fourier analysis. SOME OF THE MILESTONES 6 HILBERT SPACES Let be a vector space. A scalar product u,v is a map H h i from to C such that: H×H (i) au + bv,z = a u,z + b v,z for all u,v,z and a,b C. h i h i h i ∈H ∈ (ii) u,v = v,u for all u,v . h i h i ∈H (iii) u,u R, u,u 0 for all u and u,u =0 if u =0. h i∈ h i≥ ∈H h i 6 6 HILBERT SPACES 7 We recall that a scalar product verify the Cauchy-Schwarz inequality (which will be proved in the exercises): u,v u,u 1/2 v,v 1/2 u,v . (1) |h i|≤h i h i ∀ ∈H and that u = u,u 1/2 define a norm for . k k h i H A Hilbert spaces is a vector space endowed with a scalar H product u,v and is complete with respect to the norm h i u,u 1/2. h i HILBERT SPACES 8 Example 0.1 Some relevant examples: Let Ω Rn. The vector space of functions • ⊂ L2(Ω) = f :Ω C f 2dx < is a Hilbert spaces with { → | Ω | | ∞} the scalar product: R u,v = u(x)v(x)dx. h i ZΩ Let Ω Zn. The vector space • d ⊂ 2 C 2 ℓ (Ωd)= f :Ωd k Ωd f(k) < is a Hilbert { → | ∈ | | ∞} spaces with the scalar product: P u,v = u(k)v(k). h i k Ωd X∈ In particular if Ω = d< then ℓ2(Ω )= Cd. | d| ∞ d HILBERT SPACES 9 Definition 0.2 Let E be a topological vector space. We say that E′ is the topological dual space of E, i.e., E′={ϕ from E to C ϕ is continuous and linear}. Given two Hilbert spaces | , , the set of linear operators T : , i.e., H K H→K T (au + bv)= aT (v)+ bT (v), which are also continuous is a vector space which, endowed with the norm Tu K k k is a complete normed space, T supu ,u=0 u H k| |kH→K ≡ ∈H 6 k k i.e., a Banach space, and we indicate it with ( , ). In L H K particular, if = the we set ( ) ( , ) and if = C H K L H ≡L H H K then we have ( , )= ′. L H K H HILBERT SPACES 10 Theorem 0.3 (Representation theorem of Riesz-Frechet) Let H be a Hilbert space. For every ϕ ′ there exists a unique ∈H f such that ∈H ϕ,v ϕ(v)= v,f v . h i≡ h i ∀ ∈H Moreover we have f = ϕ ′ sup ϕ,v . k k k kH ≡ v =1 |h i| k k HILBERT SPACES 11 Proposition 0.4 (Bessel inequality) Let uα α A be an { } ∈ orthonormal system in , i.e., uα,uβ = δα,β where δ , is the H h i · · Kronecker symbol. Then for x : ∈H x,u 2 x 2. |h αi| ≤k k α A X∈ In particular {α x,u =0} is countable. |h αi 6 HILBERT SPACES 12 Theorem 0.5 (Fourier) Let uα α A be a countable { } ∈ orthonormal system. Then the following are equivalent: (i) x = α A x,uα uα for all x . ∈ h i ∈H P 2 2 (ii) (Parseval idendity) x = α A x,uα for all x . k k ∈ |h i| ∈H (iii) (Completeness) If x andP if x,u =0 for all α, then ∈H h αi x =0. 2 The sequence x,uα is such that α A x,uα < , then h i ∈ |h i| ∞ the series α A x,uα uα is convergent in and converges to ∈ h i P H x. A orthonormal set which verifies one of the previous P conditions is called an orthonormal basis for the Hilbert space . H HILBERT SPACES 13 Theorem 0.6 Every Hilbert space has an orthonormal basis. Definition 0.7 A Hilbert space is separable if an only if it has H a countable orthonormal basis. HILBERT SPACES 14 FOURIER SERIES AND TRANSFORM A trigonometric series (or Fourier series) in complex form of period τ > 0 is a function series of the type: 1 T (x)= c e2πinx/τ (2) √τ n n Z X∈ Set a0 =2c0, an = cn + c n, bn = i(cn c n) (3) − − − we have, by the Euler formulas (eiw = cos(w)+ i sin(w)), that 1 a0 ∞ T (x)= + (ak cos(2πkx/τ)+ bk sin(2πkx/τ)) (4) √τ 2 ! kX=1 FOURIER SERIES AND TRANSFORM 15 1 2πinx/τ We observe now that e n Z e { √τ } ∈ τ τ cos(2πkx/τ) k N sin(2πkx/τ) k N,k=0 are an { 2 } ∈ { 2 } ∈ 6 orthonormal system in the Hilbert space = L2(0,τ). For p S p H example 1 1 1 τ e2πinx/τ , e2πimx/τ = e2πinx/τ e2πimx/τ dx h√τ √τ i τ 0 Z τ 1 2πi(n m)x/τ = e − dx τ Z0 1 2πi(n m)x = e − dx = δm,n. Z0 FOURIER SERIES AND TRANSFORM 16 We wonder whether they consitute systems of orthonormal bases. We consider the function πx x2 f(x)= . 2 − 4 Note that it is symmetric and therefore the coefficients b (f)= f, τ sin(2πkx/τ) vanish for all k. By computing k h 2 i (Exercise! Integrate twice by parts) instead the coefficients p a (f)= f, τ cos(2πkx/τ) we obtain the trigonometric series k h 2 i associated to f given by p π2 ∞ cos(kx) T (x)= . (5) f 6 − k2 kX=1 FOURIER SERIES AND TRANSFORM 17 Theorem 0.8 (Pointwise convergence) Let f : R C periodic → with period τ > 0 and locally integrable. Assume that in + x R the limits f(x ) e f(x−) exist and are finite, and that 0 ∈ 0 0 the left and right finite difference + f(x + h) f(x ) f(x h)+ f(x−) 0 − 0 , 0 − 0 , h h are bounded for any h> 0 small. Then the series Tf of f converges in x0 to the mean of the values of the right and left limits of f in x0: + 1 f(x ) f(x−) T (x )= f,e2πinξ/τ e2πinx/τ = 0 − 0 . f 0 τ h i 2 n Z X∈ In particular if f ′(x0) exists then Tf (x0)= f(x0). FOURIER SERIES AND TRANSFORM 18 2.5 2.5 2 2 1.5 1.5 1 1 0.5 0.5 0 0 1 2 3 4 5 6 0 1 2 3 4 5 6 2 2 πx x π cos (kx) Figure 1: f(x)= = ∞ 2 .
Recommended publications
  • Calculus 1 to 4 (2004–2006)
    Calculus 1 to 4 (2004–2006) Axel Schuler¨ January 3, 2007 2 Contents 1 Real and Complex Numbers 11 Basics .......................................... 11 Notations ..................................... 11 SumsandProducts ................................ 12 MathematicalInduction. 12 BinomialCoefficients............................... 13 1.1 RealNumbers................................... 15 1.1.1 OrderedSets ............................... 15 1.1.2 Fields................................... 17 1.1.3 OrderedFields .............................. 19 1.1.4 Embedding of natural numbers into the real numbers . ....... 20 1.1.5 The completeness of Ê .......................... 21 1.1.6 TheAbsoluteValue............................ 22 1.1.7 SupremumandInfimumrevisited . 23 1.1.8 Powersofrealnumbers.. .. .. .. .. .. .. 24 1.1.9 Logarithms ................................ 26 1.2 Complexnumbers................................. 29 1.2.1 TheComplexPlaneandthePolarform . 31 1.2.2 RootsofComplexNumbers . 33 1.3 Inequalities .................................... 34 1.3.1 MonotonyofthePowerand ExponentialFunctions . ...... 34 1.3.2 TheArithmetic-Geometricmeaninequality . ...... 34 1.3.3 TheCauchy–SchwarzInequality . .. 35 1.4 AppendixA.................................... 36 2 Sequences and Series 43 2.1 ConvergentSequences .. .. .. .. .. .. .. .. 43 2.1.1 Algebraicoperationswithsequences. ..... 46 2.1.2 Somespecialsequences . .. .. .. .. .. .. 49 2.1.3 MonotonicSequences .. .. .. .. .. .. .. 50 2.1.4 Subsequences............................... 51 2.2 CauchySequences
    [Show full text]
  • Conceptual Power Series Knowledge of STEM Majors
    Paper ID #21246 Conceptual Power Series Knowledge of STEM Majors Dr. Emre Tokgoz, Quinnipiac University Emre Tokgoz is currently the Director and an Assistant Professor of Industrial Engineering at Quinnipiac University. He completed a Ph.D. in Mathematics and another Ph.D. in Industrial and Systems Engineer- ing at the University of Oklahoma. His pedagogical research interest includes technology and calculus education of STEM majors. He worked on several IRB approved pedagogical studies to observe under- graduate and graduate mathematics and engineering students’ calculus and technology knowledge since 2011. His other research interests include nonlinear optimization, financial engineering, facility alloca- tion problem, vehicle routing problem, solar energy systems, machine learning, system design, network analysis, inventory systems, and Riemannian geometry. c American Society for Engineering Education, 2018 Mathematics & Engineering Majors’ Conceptual Cognition of Power Series Emre Tokgöz [email protected] Industrial Engineering, School of Engineering, Quinnipiac University, Hamden, CT, 08518 Taylor series expansion of functions has important applications in engineering, mathematics, physics, and computer science; therefore observing responses of graduate and senior undergraduate students to Taylor series questions appears to be the initial step for understanding students’ conceptual cognitive reasoning. These observations help to determine and develop a successful teaching methodology after weaknesses of the students are investigated. Pedagogical research on understanding mathematics and conceptual knowledge of physics majors’ power series was conducted in various studies ([1-10]); however, to the best of our knowledge, Taylor series knowledge of engineering majors was not investigated prior to this study. In this work, the ability of graduate and senior undergraduate engineering and mathematics majors responding to a set of power series questions are investigated.
    [Show full text]
  • 1 Infinite Sequences and Series
    1 Infinite Sequences and Series In experimental science and engineering, as well as in everyday life, we deal with integers, or at most rational numbers. Yet in theoretical analysis, we use real and complex numbers, as well as far more abstract mathematical constructs, fully expecting that this analysis will eventually provide useful models of natural phenomena. Hence we proceed through the con- struction of the real and complex numbers starting from the positive integers1. Understanding this construction will help the reader appreciate many basic ideas of analysis. We start with the positive integers and zero, and introduce negative integers to allow sub- traction of integers. Then we introduce rational numbers to permit division by integers. From arithmetic we proceed to analysis, which begins with the concept of convergence of infinite sequences of (rational) numbers, as defined here by the Cauchy criterion. Then we define irrational numbers as limits of convergent (Cauchy) sequences of rational numbers. In order to solve algebraic equations in general, we must introduce complex numbers and the representation of complex numbers as points in the complex plane. The fundamental theorem of algebra states that every polynomial has at least one root in the complex plane, from which it follows that every polynomial of degree n has exactly n roots in the complex plane when these roots are suitably counted. We leave the proof of this theorem until we study functions of a complex variable at length in Chapter 4. Once we understand convergence of infinite sequences, we can deal with infinite series of the form ∞ xn n=1 and the closely related infinite products of the form ∞ xn n=1 Infinite series are central to the study of solutions, both exact and approximate, to the differ- ential equations that arise in every branch of physics.
    [Show full text]
  • Complex Analysis Mario Bonk
    Complex Analysis Mario Bonk Course notes for Math 246A and 246B University of California, Los Angeles Contents Preface 6 1 Algebraic properties of complex numbers 8 2 Topological properties of C 18 3 Differentiation 26 4 Path integrals 38 5 Power series 43 6 Local Cauchy theorems 55 7 Power series representations 62 8 Zeros of holomorphic functions 68 9 The Open Mapping Theorem 74 10 Elementary functions 79 11 The Riemann sphere 86 12 M¨obiustransformations 92 13 Schwarz's Lemma 105 14 Winding numbers 113 15 Global Cauchy theorems 122 16 Isolated singularities 129 17 The Residue Theorem 142 18 Normal families 152 19 The Riemann Mapping Theorem 161 3 CONTENTS 4 20 The Cauchy transform 170 21 Runge's Approximation Theorem 179 References 187 Preface These notes cover the material of a course on complex analysis that I taught repeatedly at UCLA. In many respects I closely follow Rudin's book on \Real and Complex Analysis". Since Walter Rudin is the unsurpassed master of mathematical exposition for whom I have great admiration, I saw no point in trying to improve on his presentation of subjects that are relevant for the course. The notes give a fairly accurate account of the material covered in class. They are rather terse as oral discussions that gave further explanations or put results into perspective are mostly omitted. In addition, all pictures and diagrams are currently missing as it is much easier to produce them on the blackboard than to put them into print. 6 1 Algebraic properties of complex numbers 1.1.
    [Show full text]
  • Function Series)
    Series with variable terms (function series) Sequence consisting of terms that are all in the form of a function is called a sequence with variable terms, or a function sequence {fn} = {fn(x)} = f1(x), f2(x), ..., fn(x), ... Let all functions that are terms of the sequence {fn} be defined at some point (number) x0, then the convergence (divergence) of the given function sequence {fn} at the point x0 can be considered. Sequence {fn} that is convergent (divergent) at all points of some set M is said to be convergent (divergent) at the set M. Set of all such points at which the given sequence {fn} is convergent is called the domain of convergence of the sequence {fn}. Let the sequence {fn} be convergent on the set M, then a function is defined on the set M such that f (x0 ) lim fn (x0 ),x0 M n and it is called the limit of the sequence {fn} on the set M f lim fn n Therefore f lim fn on M x0 M , 0,n0 :n N,n n0 fn (x0 ) - f (x0 ) n Function f need not to be continuous on M, an if is continuous we speak about uniform convergence of the sequence with variable terms. Function series Let all terms of a sequence with variable terms {fn} be defined on a non- empty se M. Expression fn f1 f2 ... fn ... n1 is called the series with variable terms (function series). Let n sn f i f12 f ... f n , n 1,2,... i1 fn Function sn is called the n-th partial sum of the series .
    [Show full text]
  • MAT 5610, Analysis I Part III
    Introduction Review Derivative Integral Riemann-Stieltjes Integral Sequences & Series MAT 5610, Analysis I Part III Wm C Bauldry [email protected] Spring, 2011 MAT 5610: 0 0 Today Introduction Review Derivative Integral Riemann-Stieltjes Integral Sequences & Series MAT 5610: 0 Introduction Review Derivative Integral Riemann-Stieltjes Integral Sequences & Series Outerlude MAT 5610: 19 Introduction Review Derivative Integral Riemann-Stieltjes Integral Sequences & Series Seriesly Fun Definition • A series is a sequence of partial sums with the nth term given by Pn Sn = ak for some fixed p Z k=p 2 Pn • A sequence bn n p can be written as a series Sn = k p ak by f g ≥ = setting an = bn bn 1 and bp 1 = 0: − − − Examples X1 1 π2 X1 ( 1)k+1 1. = 4. − = ln(2) k2 6 k k=1 k=1 X1 1 k 2. = e X1 ( 1) +1 sin(k) k! 5. − = k=0 k 1 1 k=1 X 1 X 1 3. =1= sin(1) k(k + 1) k(k − 1) arctan k=1 k=2 1 + cos(1) MAT 5610: 20 Introduction Review Derivative Integral Riemann-Stieltjes Integral Sequences & Series Harmonious Series RECALL: Definition P A series 1 ak converges to A R iff for every " > 0 there is an k=p 2 n∗ N s.t. whenever n n∗, then Sn A < ": 2 ≥ j − j Proposition P • If ak converges, then ak 0: P ! • If ak 0; then ak diverges. 6! Example (Nicole Oresme (c.1360)) The harmonic series P 1=k diverges. Take segments that are greater than 1=2 to show S n 1 + n=2.
    [Show full text]
  • An Introduction to Complex Analysis
    An Introduction to Complex Analysis JIŘÍ BOUCHALA AND MAREK LAMPART Preface Complex analysis is one of the most interesting of the fundamental topics in the undergraduate mathematics course. Its importance to applications means that it can be studied both from a very pure perspective and a very applied perspective. This text book for students takes into account the varying needs and backgrounds for students in mathematics, science, and engineering. It covers all topics likely to feature in this course, including the subjects: • complex numbers, • differentiation, • integration, • Cauchy’s theorem and its consequences, • Laurent and Taylor series, • conformal maps and harmonic functions, • the residue theorem. Since the topics of complex analysis are not elementary subjects, there are some reasonable assumptions about what readers should know. The reader should be fa- miliar with relevant standard topics taught in the area of real analysis of real func- tions of one and multiple variables, sequences, and series. This text is mostly a translation from the Czech original [1]. The authors are grateful to their colleagues for their comments that improved this text, to John Cawley who helped with the correction of many typos and En- glish grammar, and also to RNDr. Alžběta Lampartová for her kind help with the typesetting process. doc. RNDr. Marek Lampart, Ph.D. November 18, 2020 2 Contents 1 Complex numbers and Gauss plane 5 1.1 Complex numbers . .5 1.2 Geometric interpretation and argument of complex numbers . .6 1.3 Infinity . .8 1.4 Neighbourhood of a point . .9 1.5 Sequence of complex numbers . .9 2 Complex functions of a real and a complex variable 11 2.1 Complex functions .
    [Show full text]
  • Arxiv:1609.02803V2 [Math.NT] 29 Mar 2017 Nterfrne 1,1] Diinlntto O Special for Notation Additional 15]
    SQUARE SERIES GENERATING FUNCTION TRANSFORMATIONS MAXIE D. SCHMIDT SCHOOL OF MATHEMATICS GEORGIA INSTITUTE OF TECHNOLOGY 117 SKILES BUILDING 686 CHERRY STREET NW ATLANTA, GA 30332 [email protected] Abstract. We construct new integral representations for transformations of the ordinary generating function for a sequence, hfni, into the form of a generating function that enu- 2 n merates the corresponding “square series” generating function for the sequence, hq fni, at an initially fixed non-zero q ∈ C. The new results proved in the article are given by integral–based transformations of ordinary generating function series expanded in terms of the Stirling numbers of the second kind. We then employ known integral representations for the gamma and double factorial functions in the construction of these square series trans- formation integrals. The results proved in the article lead to new applications and integral representations for special function series, sequence generating functions, and other related applications. A summary Mathematica notebook providing derivations of key results and applications to specific series is provided online as a supplemental reference to readers. 1. Notation and Conventions Most of the notational conventions within the article are consistent with those employed in the references [11, 15]. Additional notation for special parameterized classes of the square series expansions studied in the article is defined in Table 1 on page 4. We utilize this notation for these generalized classes of square series functions throughout the article. The following list provides a description of the other primary notations and related conventions employed throughout the article specific to the handling of sequences and the coefficients of formal power series: ◮ Sequences and Generating Functions: The notation fn f0,f1,f2,..
    [Show full text]
  • Convergence and Divergence of Fourier Series
    Undergraduate Thesis Degree in Mathematics Faculty of Mathematics University of Barcelona Convergence and Divergence of Fourier Series Author: Miguel García Fernández Advisor: Dr. María Jesús Carro Rossell Department: Mathematics and Informatics Barcelona, January 19, 2018 Abstract In this project we study the convergence of Fourier series. Specifically, we first give some positive results about pointwise and uniform convergence, and then we prove two essential negative results: there exists a continuous function whose Fourier series diverges at some point and an integrable function whose Fourier series diverges almost at every point. In the case of divergence, we show that one can use other summability methods in order to represent the function as a trigonometric series. i ii Acknowledgements I want to acknowledge my thesis director María Jesús Carro for her extremely valuable help and her ability to make me grasp the beauty of this subject. I would also like to thank my girlfriend and all of my relatives and friends who gave me their moral support. iii iv Contents Abstract i Acknowledgements iii Introduction 1 1 Fourier Series 5 1.1 Trigonometric series . .5 1.2 Orthogonality . .6 1.3 Fourier Series . .7 1.4 Properties of Fourier coefficients . .8 1.5 Bessel’s inequality . .9 2 Positive results on pointwise and uniform convergence 13 2.1 Dirichlet Kernel . 13 2.2 Riemann-Lebesgue Lemma . 16 2.3 Localization principle . 18 2.4 Dirichlet’s theorem . 19 2.5 Dini’s criterion . 20 2.6 Uniform convergence . 21 3 Divergence of Fourier series 25 3.1 Divergence of Fourier series of continuous functions .
    [Show full text]
  • Mathematics 120 Solutions for HWK 21B 2 Function Series That Are Geometric
    Mathematics 120 Solutions for HWK 21b 2 function series that are geometric ∞ √x n 35. p671. For the series 1 , find the interval of convergence and, within this interval, 2 − n=0 find the sum of the seriesX as a function of x. Notice that this series isn’t actually a power series, but it is geometric. It has first term a = 1 and √x common ratio r = 1. It will converge absolutely provided r < 1, in other words provided 2 − | | √x that 1 < 1, and it will diverge otherwise. The convergence condition can be rewritten in | 2 − | √x the form 1 < 1 < 1. Solve for x as follows: − 2 − √x 1 < 1 < 1 − 2 − √x 0 < < 2 2 0 < √x < 4 0 < x < 16 Thus the interval of convergence is (0, 16). Using the formula for the sum of a geometric series, we can write the sum of the series as a function of x: ∞ √x n 1 2 1 = = 2 − √x 4 √x n=0 1 ( 1) − X − 2 − provided 0 < x < 16. 39. p671. For what values of x does the series 1 1 1 n 1 (x 3) + (x 3)2 + + (x 3)n + − 2 − 4 − ··· − 2 − ··· converge? What is its sum? What series do you get if you differentiate the given series term by term? For what values of x does the new series converge? What is its sum? 1 This series, which is a power series, is also geometric, with a = 1 and r = 2 (x 3). It converges 1 − − if and only if r < 1, in other words iff 2 (x 3) < 1.
    [Show full text]
  • Sequences and Series Notes for MATH 3100 at the University Of
    Sequences and Series Notes for MATH 3100 at the University of Georgia Spring Semester 2010 Edward A. Azoff With additions by V. Alexeev and D. Benson Contents Introduction 5 1. Overview 5 2. Prerequisites 6 3. References 7 4. Notations 7 5. Acknowledgements 7 Chapter 1. Real Numbers 9 1. Fields 9 2. Order 12 3. Eventually Positive Functions 14 4. Absolute Value 15 5. Completeness 17 6. Induction 18 7. Least Upper Bounds via Decimals 21 Exercises 22 Chapter 2. Sequences 27 1. Introduction 27 2. Limits 28 3. Algebra of Limits 32 4. Monotone Sequences 34 5. Subsequences 35 6. Cauchy Sequences 37 7. Applications of Calculus 38 Exercises 39 Chapter 3. Series 45 1. Introduction 45 2. Comparison 48 3. Justification of Decimal Expansions 50 4. Ratio Test 52 5. Integral Test 52 6. Series with Sign Changes 53 7. Strategy 54 8. Abel's Inequality and Dirichlet's Test 55 Exercises 56 3 4 CONTENTS Chapter 4. Applications to Calculus 63 Exercises 67 Chapter 5. Taylor's Theorem 71 1. Statement and Proof 71 2. Taylor Series 75 3. Operations on Taylor Polynomials and Series 76 Exercises 81 Chapter 6. Power Series 85 1. Domains of Convergence 85 2. Uniform Convergence 88 3. Analyticity of Power Series 91 Exercises 92 Chapter 7. Complex Sequences and Series 95 1. Motivation 95 2. Complex Numbers 96 3. Complex Sequences 97 4. Complex Series 98 5. Complex Power Series 99 6. De Moivre's Formula 101 Exercises 102 Chapter 8. Constructions of R 105 1. Formal Decimals 106 2.
    [Show full text]
  • Lecture 2: Linear Algebra, Infinite Dimensional Spaces And
    Lecture 2: Linear Algebra, Infinite Dimensional Spaces and Functional Analysis Johan Thim ([email protected]) April 6, 2021 \You have no respect for logic. I have no respect for those who have no respect for logic." |Julius Benedict 1 Remember Linear algebra? Finite Dimensional Spaces Let V be a linear space (sometimes we say vector space) over the complex (sometimes real) numbers. We recall some definitions from linear algebra. Elements of a linear space can be added and multiplied by constants and still belong to the linear space (this is the linearity): u; v 2 V ) αu + βv 2 V; α; β 2 C (or R): The operations addition and multiplication by constant behaves like we expect (associative, distributive and commutative). Multiplication of vectors is not defined in general, but as we shall see we can define different useful products in many cases. Linear combination Definition. Let u1; u2; : : : ; un 2 V . We call n X u = αkuk = α1u1 + α2u2 + ··· + αnun k=1 a linear combination. If n X αkuk = 0 , α1 = α2 = ··· = αn = 0; k=1 we say that u1; u2; : : : ; un are linearly independent. The linear span spanfu1; u2; : : : ; ung of the vectors u1; u2; : : : ; un is defined as the set of all linear combinations of these vectors (which is a linear space). You've seen plenty of linear spaces before. One such example is the euclidian space Rn consisting of elements (x1; x2; : : : ; xn), where xi 2 R. Recall also that you've seen linear spaces that consisted of polynomials. The fact that our definition is general enough to cover many cases will prove to be very fruitful.
    [Show full text]