Linear Differential Equations Math 130 Linear Algebra

Total Page:16

File Type:pdf, Size:1020Kb

Linear Differential Equations Math 130 Linear Algebra where A and B are arbitrary constants. Both of these equations are homogeneous linear differential equations with constant coefficients. An nth-order linear differential equation is of the form Linear Differential Equations n 00 0 Math 130 Linear Algebra anf (t) + ··· + a2f (t) + a1f (t) + a0f(t) = b: D Joyce, Fall 2013 that is, some linear combination of the derivatives It's important to know some of the applications up through the nth derivative is equal to b. In gen- of linear algebra, and one of those applications is eral, the coefficients an; : : : ; a1; a0, and b can be any to homogeneous linear differential equations with functions of t, but when they're all scalars (either constant coefficients. real or complex numbers), then it's a linear differ- ential equation with constant coefficients. When b What is a differential equation? It's an equa- is 0, then it's homogeneous. tion where the unknown is a function and the equa- For the rest of this discussion, we'll only consider tion is a statement about how the derivatives of the at homogeneous linear differential equations with function are related. constant coefficients. The two example equations 0 Perhaps the most important differential equation are such; the first being f −kf = 0, and the second 00 is the exponential differential equation. That's the being f + f = 0. one that says a quantity is proportional to its rate of change. If we let t be the independent variable, f(t) What do they have to do with linear alge- the quantity that depends on t, and k the constant bra? Their solutions form vector spaces, and the of proportionality, then the differential equation is dimension of the vector space is the order n of the equation. 0 f (t) = kf(t): The first example was the first-order equation f 0 − kf = 0. Its solutions were Aekt where A was Its general solution is an arbitrary constant. The set of these solutions f(t) = Aekt is a vector space because the 0 function is one so- lution, they're closed under addition, and they're where A is an arbitrary constant. This differential closed under multiplication by constants. equation has applications as the exponential model The second example was the second-order equa- of population growth, radioactive decay, compound tion f 00 + f = 0. Its solutions, A cos t + B sin t form interest, Newton's law of cooling, and lot's more. a two-dimensional vector space. Another important differential equation is the In general the set of solutions will always be a one that the sine and cosine function satisfies. For vector space. The zero function is always a solution; both of those functions, their second derivative is that's because we're only considering homogeneous their negation. They satisfy the differential equa- differential equations. If f and g both satisfy the tion equation, then so does f +g. Finally, if c is a scalar f 00(t) = −f(t): and f satisfies the equation, so does cf. That's called a second order differential equation since the second derivative is involved. The general So, how do you solve these equations, and solution to this differential equation is why does the dimension of the solution space equal the order of the equation? Let's take f(t) = A cos t + B sin t an example to illustrate it. It should be general 1 enough to show the method, but not two compli- You can use Euler's identity to convert between the cated. Consider the fourth-order equation two forms. 2 0000 000 00 0 We still have the other factor (D − 2) to deal f − 4f + 5f − 4f − 4f = 0: with. The double root at 2 complicates the solu- The trick is to treat derivatives as differential tions. I'll leave out the derivation of the solution 2 operators|things which operate on functions. We to the differential equation (D − 2) t = 0, and just d give its general solution, f(t) = Cte2t + Det2. You could denote this operator as as is common in dt can check that it works. Analogous solutions can calculus, but a simple uppercase D makes it eas- be found when there are multiple roots rather than ier to see what's going on. Then the differential just double roots. equation looks like In summary, this example differential equation, f 0000 − 4f 000 + 5f 00 − 4f 0 − 4f = 0, has the general D4f − 4D3f + 5D2f − 4Df − 4f = 0; solution and that can be rewritten as f(t) = Aeit + Be−it + Cte2t + Det2: (D4 − 4D3 + 5D2 − 4D − 4)f = 0: We haven't shown that there aren't any other solu- tions, but we'll skip that part since we're just doing Now, I chose this example to factor nicely. The a survey on the topic, not a whole course. differential operator D4−4D3+5D2−4D−4 factors as (D2 + 1)(D2 − 4D + 4), which further factors as Dynamical systems. You might ask, are these (D2 + 1)(D − 2)2. That first quadratic polynomial, really important? Yes. Linear dynamical systems D2 + 1, is irreducible over R but factors over C, are modelled using these equations. so to make things easier, we'll work over C. That In such a system you have several things that gives us the factorization into linear factors change over time. Suppost they're the quantities (D − i)(D + i)(D − 2)2: x; y; and z. Some of these things affect others pos- itively, some negatively. If x affects y positively, The Fundamental Theorem of Algebra assures us then y0 will have a term kx where k is positive, but that we can always factor an nth degree polynomial if negatively, then k is negative. A linear dynamical into linear factors over C, so what happened in this system is a system of linear equations like example will also happen in the general case. The 8 x0 = + 2y − z Fundamental Theorem of Algebra connnects the or- < y0 = 2x der of the differential equation to the dimension of : z0 = y − 3z the solution space. Now we can break down the differential equations For this example, x and y affect each other posi- into linear pieces. We can solve (D − i)f = 0 since tively in a positive feedback loop, and y positively it's just the exponential differential equation. It has affects z, but z negatively affects x and itself. solutions f(t) = Aeit. Likewise (D+i)f = 0 has the Although it's a system of three linear differential solutions f(t) = Be−it. That gives us solutions for equations, it's equivalent to one third order differ- (D2 + 1)f = 0, namely Aeit + Be−it. Note that we ential equation. already saw a different description of the solutions Dynamical systems like this are used in physics, for this equation, f 00 − f = 0, and that was as chemistry, biology, economics, and almost any sub- A cos t + B sin t. The connection between the two ject that calls itself a science. forms of the solutions is Euler's identity Math 130 Home Page at eit = cos t + i sin t: http://math.clarku.edu/~djoyce/ma130/ 2.
Recommended publications
  • Bessel's Differential Equation Mathematical Physics
    R. I. Badran Bessel's Differential Equation Mathematical Physics Bessel's Differential Equation: 2 Recalling the DE y n y 0 which has a sinusoidal solution (i.e. sin nx and cos nx) and knowing that these solutions can be treated as power series, we can find a solution to the Bessel's DE which is written as: 2 2 2 x y xy (x p )y 0 . The solution is represented by a series. This series very much look like a damped sine or cosine. It is called a Bessel function. To solve the Bessel' DE, we apply the Frobenius method by mn assuming a series solution of the form y an x . n0 Substitute this solution into the DE equation and after some mathematical steps you may find that the indicial equation is 2 2 m p 0 where m= p. Also you may get a1=0 and hence all odd a's are zero as well. The recursion relation can be found as a a n n2 (n m 2)2 p 2 with (n=0, 1, 2, 3, ……etc.). Case (1): m= p (seeking the first solution of Bessel DE) We get the solution 2 4 p x x y a x 1 2(2p 2) 2 4(2p 2)(2p 4) This can be rewritten as: x p2n J (x) y a (1)n p 2n n0 2 n!( p n)! 1 Put a 2 p p! The Bessel function has the factorial form x p2n J (x) (1)n p 2n p , n0 n!( p n)!2 R.
    [Show full text]
  • The Standard Form of a Differential Equation
    Fall 06 The Standard Form of a Differential Equation Format required to solve a differential equation or a system of differential equations using one of the command-line differential equation solvers such as rkfixed, Rkadapt, Radau, Stiffb, Stiffr or Bulstoer. For a numerical routine to solve a differential equation (DE), we must somehow pass the differential equation as an argument to the solver routine. A standard form for all DEs will allow us to do this. Basic idea: get rid of any second, third, fourth, etc. derivatives that appear, leaving only first derivatives. Example 1 2 d d 5 yx()+3 ⋅ yx()−5yx ⋅ () 4x⋅ 2 dx dx This DE contains a second derivative. How do we write a second derivative as a first derivative? A second derivative is a first derivative of a first derivative. d2 d d yx() yx() 2 dx dxxd Step 1: STANDARDIZATION d Let's define two functions y0(x) and y1(x) as y0()x yx() and y1()x y0()x dx Then this differential equation can be written as d 5 y1()x +3y ⋅ 1()x −5y ⋅ 0()x 4x dx This DE contains 2 functions instead of one, but there is a strong relationship between these two functions d y1()x y0()x dx So, the original DE is now a system of two DEs, d d 5 y1()x y0()x and y1()x +3y ⋅ 1()x −5y ⋅ 0()x 4x⋅ dx dx The convention is to write these equations with the derivatives alone on the left-hand side. d y0()x y1()x dx This is the first step in the standardization process.
    [Show full text]
  • CORSO ESTIVO DI MATEMATICA Differential Equations Of
    CORSO ESTIVO DI MATEMATICA Differential Equations of Mathematical Physics G. Sweers http://go.to/sweers or http://fa.its.tudelft.nl/ sweers ∼ Perugia, July 28 - August 29, 2003 It is better to have failed and tried, To kick the groom and kiss the bride, Than not to try and stand aside, Sparing the coal as well as the guide. John O’Mill ii Contents 1Frommodelstodifferential equations 1 1.1Laundryonaline........................... 1 1.1.1 Alinearmodel........................ 1 1.1.2 Anonlinearmodel...................... 3 1.1.3 Comparingbothmodels................... 4 1.2Flowthroughareaandmore2d................... 5 1.3Problemsinvolvingtime....................... 11 1.3.1 Waveequation........................ 11 1.3.2 Heatequation......................... 12 1.4 Differentialequationsfromcalculusofvariations......... 15 1.5 Mathematical solutions are not always physically relevant . 19 2 Spaces, Traces and Imbeddings 23 2.1Functionspaces............................ 23 2.1.1 Hölderspaces......................... 23 2.1.2 Sobolevspaces........................ 24 2.2Restrictingandextending...................... 29 2.3Traces................................. 34 1,p 2.4 Zero trace and W0 (Ω) ....................... 36 2.5Gagliardo,Nirenberg,SobolevandMorrey............. 38 3 Some new and old solution methods I 43 3.1Directmethodsinthecalculusofvariations............ 43 3.2 Solutions in flavours......................... 48 3.3PreliminariesforCauchy-Kowalevski................ 52 3.3.1 Ordinary differentialequations............... 52 3.3.2 Partial differentialequations...............
    [Show full text]
  • Differential Equations and Linear Algebra
    Chapter 1 First Order Equations 1.1 Four Examples : Linear versus Nonlinear A first order differential equation connects a function y.t/ to its derivative dy=dt. That rate of change in y is decided by y itself (and possibly also by the time t). Here are four examples. Example 1 is the most important differential equation of all. dy dy dy dy 1/ y 2/ y 3/ 2ty 4/ y2 dt D dt D dt D dt D Those examples illustrate three linear differential equations (1, 2, and 3) and a nonlinear differential equation. The unknown function y.t/ is squared in Example 4. The derivative y or y or 2ty is proportional to the function y in Examples 1, 2, 3. The graph of dy=dt versus y becomes a parabola in Example 4, because of y2. It is true that t multiplies y in Example 3. That equation is still linear in y and dy=dt. It has a variable coefficient 2t, changing with time. Examples 1 and 2 have constant coefficient (the coefficients of y are 1 and 1). Solutions to the Four Examples We can write down a solution to each example. This will be one solution but it is not the complete solution, because each equation has a family of solutions. Eventually there will be a constant C in the complete solution. This number C is decided by the starting value of y at t 0, exactly as in ordinary integration. The integral of f.t/ solves the simplest differentialD equation of all, with y.0/ C : D dy t 5/ f.t/ The complete solution is y.t/ f.s/ds C : dt D D C Z0 1 2 Chapter 1.
    [Show full text]
  • The Calculus of Trigonometric Functions the Calculus of Trigonometric Functions – a Guide for Teachers (Years 11–12)
    1 Supporting Australian Mathematics Project 2 3 4 5 6 12 11 7 10 8 9 A guide for teachers – Years 11 and 12 Calculus: Module 15 The calculus of trigonometric functions The calculus of trigonometric functions – A guide for teachers (Years 11–12) Principal author: Peter Brown, University of NSW Dr Michael Evans, AMSI Associate Professor David Hunt, University of NSW Dr Daniel Mathews, Monash University Editor: Dr Jane Pitkethly, La Trobe University Illustrations and web design: Catherine Tan, Michael Shaw Full bibliographic details are available from Education Services Australia. Published by Education Services Australia PO Box 177 Carlton South Vic 3053 Australia Tel: (03) 9207 9600 Fax: (03) 9910 9800 Email: [email protected] Website: www.esa.edu.au © 2013 Education Services Australia Ltd, except where indicated otherwise. You may copy, distribute and adapt this material free of charge for non-commercial educational purposes, provided you retain all copyright notices and acknowledgements. This publication is funded by the Australian Government Department of Education, Employment and Workplace Relations. Supporting Australian Mathematics Project Australian Mathematical Sciences Institute Building 161 The University of Melbourne VIC 3010 Email: [email protected] Website: www.amsi.org.au Assumed knowledge ..................................... 4 Motivation ........................................... 4 Content ............................................. 5 Review of radian measure ................................. 5 An important limit ....................................
    [Show full text]
  • MTHE / MATH 237 Differential Equations for Engineering Science
    i Queen’s University Mathematics and Engineering and Mathematics and Statistics MTHE / MATH 237 Differential Equations for Engineering Science Supplemental Course Notes Serdar Y¨uksel November 26, 2015 ii This document is a collection of supplemental lecture notes used for MTHE / MATH 237: Differential Equations for Engineering Science. Serdar Y¨uksel Contents 1 Introduction to Differential Equations ................................................... .......... 1 1.1 Introduction.................................... ............................................ 1 1.2 Classification of DifferentialEquations ............ ............................................. 1 1.2.1 OrdinaryDifferentialEquations ................. ........................................ 2 1.2.2 PartialDifferentialEquations .................. ......................................... 2 1.2.3 HomogeneousDifferentialEquations .............. ...................................... 2 1.2.4 N-thorderDifferentialEquations................ ........................................ 2 1.2.5 LinearDifferentialEquations ................... ........................................ 2 1.3 SolutionsofDifferentialequations ................ ............................................. 3 1.4 DirectionFields................................. ............................................ 3 1.5 Fundamental Questions on First-Order Differential Equations ...................................... 4 2 First-Order Ordinary Differential Equations ..................................................
    [Show full text]
  • THE DYNAMICAL SYSTEMS APPROACH to DIFFERENTIAL EQUATIONS INTRODUCTION the Mathematical Subject We Call Dynamical Systems Was
    BULLETIN (New Series) OF THE AMERICAN MATHEMATICAL SOCIETY Volume 11, Number 1, July 1984 THE DYNAMICAL SYSTEMS APPROACH TO DIFFERENTIAL EQUATIONS BY MORRIS W. HIRSCH1 This harmony that human intelligence believes it discovers in nature —does it exist apart from that intelligence? No, without doubt, a reality completely independent of the spirit which conceives it, sees it or feels it, is an impossibility. A world so exterior as that, even if it existed, would be forever inaccessible to us. But what we call objective reality is, in the last analysis, that which is common to several thinking beings, and could be common to all; this common part, we will see, can be nothing but the harmony expressed by mathematical laws. H. Poincaré, La valeur de la science, p. 9 ... ignorance of the roots of the subject has its price—no one denies that modern formulations are clear, elegant and precise; it's just that it's impossible to comprehend how any one ever thought of them. M. Spivak, A comprehensive introduction to differential geometry INTRODUCTION The mathematical subject we call dynamical systems was fathered by Poin­ caré, developed sturdily under Birkhoff, and has enjoyed a vigorous new growth for the last twenty years. As I try to show in Chapter I, it is interesting to look at this mathematical development as the natural outcome of a much broader theme which is as old as science itself: the universe is a sytem which changes in time. Every mathematician has a particular way of thinking about mathematics, but rarely makes it explicit.
    [Show full text]
  • 1 Introduction
    1 Introduction 1.1 Basic Definitions and Examples Let u be a function of several variables, u(x1; : : : ; xn). We denote its partial derivative with respect to xi as @u uxi = : @xi @ For short-hand notation, we will sometimes write the partial differential operator as @x . @xi i With this notation, we can also express higher-order derivatives of a function u. For example, for a function u = u(x; y; z), we can express the second partial derivative with respect to x and then y as @2u uxy = = @y@xu: @y@x As you will recall, for “nice” functions u, mixed partial derivatives are equal. That is, uxy = uyx, etc. See Clairaut’s Theorem. In order to express higher-order derivatives more efficiently, we introduce the following multi-index notation. A multi-index is a vector ® = (®1; : : : ; ®n) where each ®i is a nonnegative integer. The order of the multi-index is j®j = ®1 + ::: + ®n. Given a multi-index ®, we define @j®ju D®u = = @®1 ¢ ¢ ¢ @®n u: (1.1) ®1 ®n x1 xn @x1 ¢ ¢ ¢ @xn Example 1. Let u = u(x; y) be a function of two real variables. Let ® = (1; 2). Then ® is a multi-index of order 3 and ® 2 D u = @x@y u = uxyy: If k is a nonnegative integer, we define Dku = fD®u : j®j = kg; (1.2) the collection of all partial derivatives of order k. 1 Example 2. If u = u(x1; : : : ; xn), then D u = fuxi : i = 1; : : : ; ng. With this notation, we are now ready to define a partial differential equation.
    [Show full text]
  • Differential Equations
    Chapter 5 Differential equations 5.1 Ordinary and partial differential equations A differential equation is a relation between an unknown function and its derivatives. Such equations are extremely important in all branches of science; mathematics, physics, chemistry, biochemistry, economics,. Typical example are • Newton’s law of cooling which states that the rate of change of temperature is proportional to the temperature difference between it and that of its surroundings. This is formulated in mathematical terms as the differential equation dT = k(T − T ), dt 0 where T (t) is the temperature of the body at time t, T0 the temperature of the surroundings (a constant) and k a constant of proportionality, • the wave equation, ∂2u ∂2u = c2 , ∂t2 ∂x2 where u(x, t) is the displacement (from a rest position) of the point x at time t and c is the wave speed. The first example has unknown function T depending on one variable t and the relation involves the first dT order (ordinary) derivative . This is a ordinary differential equation, abbreviated to ODE. dt The second example has unknown function u depending on two variables x and t and the relation involves ∂2u ∂2u the second order partial derivatives and . This is a partial differential equation, abbreviated to PDE. ∂x2 ∂t2 The order of a differential equation is the order of the highest derivative that appears in the relation. The unknown function is called the dependent variable and the variable or variables on which it depend are the independent variables. A solution of a differential equation is an expression for the dependent variable in terms of the independent one(s) which satisfies the relation.
    [Show full text]
  • Asymptotic Analysis and Singular Perturbation Theory
    Asymptotic Analysis and Singular Perturbation Theory John K. Hunter Department of Mathematics University of California at Davis February, 2004 Copyright c 2004 John K. Hunter ii Contents Chapter 1 Introduction 1 1.1 Perturbation theory . 1 1.1.1 Asymptotic solutions . 1 1.1.2 Regular and singular perturbation problems . 2 1.2 Algebraic equations . 3 1.3 Eigenvalue problems . 7 1.3.1 Quantum mechanics . 9 1.4 Nondimensionalization . 12 Chapter 2 Asymptotic Expansions 19 2.1 Order notation . 19 2.2 Asymptotic expansions . 20 2.2.1 Asymptotic power series . 21 2.2.2 Asymptotic versus convergent series . 23 2.2.3 Generalized asymptotic expansions . 25 2.2.4 Nonuniform asymptotic expansions . 27 2.3 Stokes phenomenon . 27 Chapter 3 Asymptotic Expansion of Integrals 29 3.1 Euler's integral . 29 3.2 Perturbed Gaussian integrals . 32 3.3 The method of stationary phase . 35 3.4 Airy functions and degenerate stationary phase points . 37 3.4.1 Dispersive wave propagation . 40 3.5 Laplace's Method . 43 3.5.1 Multiple integrals . 45 3.6 The method of steepest descents . 46 Chapter 4 The Method of Matched Asymptotic Expansions: ODEs 49 4.1 Enzyme kinetics . 49 iii 4.1.1 Outer solution . 51 4.1.2 Inner solution . 52 4.1.3 Matching . 53 4.2 General initial layer problems . 54 4.3 Boundary layer problems . 55 4.3.1 Exact solution . 55 4.3.2 Outer expansion . 56 4.3.3 Inner expansion . 57 4.3.4 Matching . 58 4.3.5 Uniform solution . 58 4.3.6 Why is the boundary layer at x = 0? .
    [Show full text]
  • Qualitative Analysis of Differential Equations
    QUALITATIVE ANALYSIS OF DIFFERENTIAL EQUATIONS Alexander Panfilov arXiv:1803.05291v1 [math.GM] 10 Mar 2018 det A D=0 stable spiral non−stable spiral 6 3 5 4 2 stable center non−stable node node tr A 1 saddle 2 QUALITATIVE ANALYSIS OF DIFFERENTIAL EQUATIONS Alexander Panfilov Theoretical Biology, Utrecht University, Utrecht c 2010 2010 2 Contents 1 Preliminaries 5 1.1 Basic algebra . 5 1.1.1 Algebraic expressions . 5 1.1.2 Limits . 6 1.1.3 Equations . 7 1.1.4 Systems of equations . 8 1.2 Functions of one variable . 9 1.3 Graphs of functions of one variable . 11 1.4 Implicit function graphs . 18 1.5 Exercises . 19 2 Selected topics of calculus 23 2.1 Complex numbers . 23 2.2 Matrices . 25 2.3 Eigenvalues and eigenvectors . 27 2.4 Functions of two variables . 32 2.5 Exercises . 35 3 Differential equations of one variable 37 3.1 Differential equations of one variable and their solutions . 37 3.1.1 Definitions . 37 3.1.2 Solution of a differential equation . 39 3.2 Qualitative methods of analysis of differential equations of one variable . 42 3.2.1 Phase portrait . 42 3.2.2 Equilibria, stability, global plan . 43 3.3 Systems with parameters. Bifurcations. 46 3.4 Exercises . 48 4 System of two linear differential equations 51 4.1 Phase portraits and equilibria . 51 4.2 General solution of linear system . 53 4.3 Real eigen values. Saddle, node. 56 4.3.1 Saddle; l1 < 0;l2 > 0, or l1 > 0;l2 < 0 ....................
    [Show full text]
  • Scalar Ordinary Differential Equations
    December 5, 2012. c Copyright 2012 R Clark Robinson Scalar Ordinary Differential Equations by R. Clark Robinson My textbook on systems of differential equations [5] assumes that the reader has had a first course on (scalar) differential equations, although not much from such a course is actually used. For students who have not already had such a course, these notes give a quick treatment of the topics about scalar ordinary differential equations from such a course that are related to the material of the book. (Nothing about power series solutions or the Laplace transform is discussed.) A standard reference for the scalar equations is Boyce and DiPrima [2]. dx d2x As in [5], we denote byx ˙ and byx ¨. The differential equationx ˙ = ax is usually dt dt2 considered in calculus courses, where a is a fixed parameter. An explicit expression for the solution at is x(t) = x0e where x(0) = x0. An important property of the solution is that x(t) has unlimited growth if a > 0 and decays to zero if a < 0. This differential equation is linear in x. An equation such asx ˙ = t3x is also linear, even though it is nonlinear in t. An example of a nonlinear scalar equation is the logistic equationx ˙ = x − x2. A scalar differential equations that only involve one derivative with respect to time is called a first order differential equation. A general first order scalar differential equation is given byx ˙ = f(t, x), where f(t, x) can be a function of possibly both t and x and is called the rate function.
    [Show full text]