The Local Power of the Gradient Test

Total Page:16

File Type:pdf, Size:1020Kb

The Local Power of the Gradient Test The local power of the gradient test Artur J. Lemonte, Silvia L. P. Ferrari Departamento de Estat´ıstica, Universidade de Sao˜ Paulo, Rua do Matao,˜ 1010, Sao˜ Paulo/SP, 05508-090, Brazil Abstract The asymptotic expansion of the distribution of the gradient test statistic is de- rived for a composite hypothesis under a sequence of Pitman alternative hypotheses converging to the null hypothesis at rate n¡1=2, n being the sample size. Compar- isons of the local powers of the gradient, likelihood ratio, Wald and score tests reveal no uniform superiority property. The power performance of all four criteria in one- parameter exponential family is examined. Key words: Asymptotic expansions; Chi-square distribution; Gradient test; Likeli- hood ratio test; Pitman alternative; Power function; Score test; Wald test. 1 Introduction The most commonly used large sample tests are the likelihood ratio (Wilks, 1938), Wald (Wald, 1943) and Rao score (Rao, 1948) tests. Recently, Terrell (2002) proposed a new test statistic that shares the same first order asymptotic properties with the likelihood ratio (LR), Wald (W ) and Rao score (SR) statistics. The new statistic, referred to as the gradient statistic (ST ), is markedly simple. In fact, Rao (2005) wrote: “The suggestion by Terrell is attractive as it is simple to compute. It would be of interest to investigate the performance of the [gradient] statistic.” The present paper goes in this direction. > Let x = (x1; : : : ; xn) be a random vector of n independent observations with prob- ability density function ¼(x j θ) that depends on a p-dimensional vector of unknown > parameters θ = (θ1; : : : ; θp) . Consider the problem of testing the composite null hy- > > > > pothesis H0 : θ2 = θ20 against H1 : θ2 6= θ20, where θ = (θ1 ; θ2 ) , θ1 = (θ1; : : : ; θq) > and θ2 = (θq+1; : : : ; θp) , θ20 representing a (p¡q)-dimensional fixed vector. Let ` be the Pn total log-likelihood function, i.e. ` = `(θ) = l=1 log ¼(xl j θ). Let U(θ) = @`=@θ = > > > (U1(θ) ; U2(θ) ) be the corresponding total score function partitioned following the partition of θ. The restricted and unrestricted maximum likelihood estimators of θ are b b> b> > e e> > > θ = (θ1 ; θ2 ) and θ = (θ1 ; θ20) , respectively. 1 The gradient statistic for testing H0 is e > b e ST = U(θ) (θ ¡ θ): e e > b Since U1(θ) = 0, ST = U2(θ) (θ2 ¡ θ20). Clearly, ST has a very simple form and does not involve knowledge of the information matrix, neither expected nor observed, and no matrices, unlike W and SR. Asymptotically, ST has a central chi-square distribution with p ¡ q degrees of freedom under H0. Terrell (2002) points out that the gradient statistic “is not transparently non-negative, even though it must be so asymptotically.” His Theorem 2 implies that if the log-likelihood function is concave and is differentiable at θe, then ST ¸ 0. In this paper we derive the asymptotic distribution of the gradient statistic for a com- posite null hypothesis under a sequence of Pitman alternatives converging to the null hypothesis at a convergence rate n¡1=2. In other words, the sequence of alternative hy- ¡1=2 > potheses is H1n : θ2 = θ20 + n ², where ² = (²q+1; : : : ; ²p) . Similar results for the likelihood ratio and Wald tests were obtained by Hayakawa (1975) and for the score test, by Harris & Peers (1980). Comparison of local power properties of the competing tests will be performed. Our results will be specialized to the case of the one-parameter exponential family. A brief discussion closes the paper. 2 Notation and preliminaries Our notation follows that of Hayakawa (1975, 1977). We introduce the following log- likelihood derivatives 2 3 ¡1=2 @` ¡1 @ ` ¡3=2 @ ` yr = n ; yrs = n ; yrst = n ; @θr @θr@θs @θr@θs@θt their arrays > y = (y1; : : : ; yp) ; Y = ((yrs)); Y::: = ((yrst)); the corresponding cumulants ·rs = E(yrs);·r;s = E(yrys); 1=2 1=2 1=2 ·rst = n E(yrst);·r;st = n E(yryst);·r;s;t = n E(yrysyt) and their arrays K = ((·r;s)); K::: = ((·rst)); K:;:: = ((·r;st)); K:;:;: = ((·r;s;t)): We make the same assumptions as in Hayakawa (1975). In particular, it is assumed that the ·’s are all O(1) and they are not functionally independent; for instance, ·r;s = ¡·rs. 2 Relations among them were first obtained by Bartlett (1953a,b). Also, it is assumed that Y is non-singular and that K is positive definite with inverse K¡1 = ((·r;s)) say. For triple-suffix quantities we use the following summation notation Xp Xp K::: ± a ± b ± c = ·rstarbsct; K:;:: ± M ± b = ·r;stmrsbt; r;s;t=1 r;s;t=1 where M is a p £ p matrix and a, b and c are p £ 1 column vectors. > > > The partition θ = (θ1 ; θ2 ) induces the corresponding partitions: " # " # " # Y Y K K K11 K12 Y = 11 12 ; K = 11 12 ; K¡1 = ; 21 22 Y21 Y22 K21 K22 K K > > > a = (a1 ; a2 ) , etc. Also, Xp Xp K2:: ± a2 ± b ± c = ·rstarbsct: r=q+1 s;t=1 Using a procedure analogous to that of Hayakawa (1975), we can write the asymptotic ¡1=2 expansion of ST for the composite hypothesis up to order n as 1 S = ¡(Zy + »)>Y (Zy + ») ¡ p K ± (Zy + ») ± Y ¡1y ± Y ¡1y T 2 n ::: 1 ¡ p K ± (Zy + ») ± (Z y ¡ ») ± (Z y ¡ ») + O (n¡1); 2 n ::: 0 0 p ¡1 where Z = Y ¡ Z0, " # " # ¡1 ¡1 Y11 0 Y11 Y12 Z0 = ; » = ²; 0 0 ¡Ip¡q Ip¡q being the identity matrix of order p ¡ q. We can now use a multivariate Edgeworth Type A series expansion of the joint density function of y and Y up to order n¡1=2 (Peers, 1971), which has the form · 1 f = f 1 + p (K ± K¡1y ± K¡1y ± K¡1y ¡ 3K ± K¡1 ± K¡1y) 1 0 6 n :;:;: :;:;: ¸ 1 ¡ p K ± K¡1y ± D + O(n¡1); n :;:: where ½ ¾ p 1 Y f = (2¼)¡p=2jKj¡1=2 exp ¡ y>K¡1y ±(y ¡ · ); 0 2 rs rs r;s=1 0 D = ((dbc)), dbc = ± (ybc ¡ ·bc)=±(ybc ¡ ·bc), with ±(¢) being the Dirac delta function (Bracewell, 1999), to obtain the moment generating function of ST , M(t) say. 3 ¡1=2 From f1 and the asymptotic expansion of ST up to order n , we arrive, after long algebra, at µ ¶ ¡ 1 (p¡q) t > M(t) = (1 ¡ 2t) 2 exp ² K ² 1 ¡ 2t 22:1 · ¸ 1 £ 1 + p (A d + A d2 + A d3) + O(n¡1); n 1 2 3 ¡1 where d = 2t=(1 ¡ 2t), K22:1 = K22 ¡ K21K11 K12, 1¡ ¢ A = ¡ K ± K¡1 ± ²¤ + 4K ± A ± ²¤ + K ± A ± ²¤ + K ± ²¤ ± ²¤ ± ²¤ ; 1 4 ::: :;:: ::: ::: 1¡ ¢ A = ¡ K ± K¡1 ± ²¤ ¡ K ± A ± ²¤ ¡ 2K ± ²¤ ± ²¤ ± ²¤ ; 2 4 ::: ::: :;:: " # " # ¡1 ¡1 1 ¤ ¤ ¤ ¤ K11 K12 K11 0 A3 = ¡ K::: ± ² ± ² ± ² ; ² = ²; A = : 12 ¡Ip¡q 0 0 ¡(p¡q)=2 > When n ! 1, M(t) ! (1¡2t) expf2t¸=(1¡2t)g, where ¸ = ² K22:1²=2, and hence the limiting distribution of ST is a non-central chi-square distribution with p ¡ q degrees of freedom and non-centrality parameter ¸. Under H0, i.e. when ² = 0, M(t) = ¡(p¡q)=2 ¡1 (1 ¡ 2t) + O(n ) and, as expected, ST has a central chi-square distribution with p ¡ q degrees of freedom up to an error of order n¡1. Also, from M(t) we may obtain the ¡1=2 first three moments of ST up to order n as 2A 8(A + A ) ¹0 (S ) = p ¡ q + ¸ + p 1 ; ¹ (S ) = 2(p ¡ q + 2¸) + 1p 2 1 T n 2 T n and 6(A + 2A + A ) ¹ (S ) = 8(p ¡ q + 3¸) + 1 p 2 3 : 3 T n 3 Main result The moment generating function of ST in a neighborhood of θ2 = θ20 can be written, after some algebra, as µ ¶ ¡ 1 (p¡q) t > y M(t) = (1 ¡ 2t) 2 exp ² K ² 1 ¡ 2t 22:1 · ¸ 1 X3 £ 1 + p a (1 ¡ 2t)¡k + O(n¡1); n k k=0 4 where 1© a = Ky ± (K¡1)y ± (²¤)y ¡ (4K + 3K )y ± Ay ± (²¤)y 1 4 ::: :;:: ::: y ¤ y ¤ y ¤ y ¡ 2(K::: + 2K:;::) ± (² ) ± (² ) ± (² ) y ¤ y ¤ yª ¡ 2(K2:: + K2;::) ± ² ± (² ) ± (² ) ; 1© (1) a = ¡ Ky ± (K¡1 ¡ A)y ± (²¤)y 2 4 ::: y ¤ y ¤ y ¤ yª ¡ (K::: + 2K:;::) ± (² ) ± (² ) ± (² ) ; 1 a = ¡ Ky ± (²¤)y ± (²¤)y ± (²¤)y; 3 12 ::: > > > and a0 = ¡(a1+a2+a3). The symbol “y” denotes evaluation at θ = (θ1 ; θ20) . Inverting M(t), we arrive at the following theorem, our main result. Theorem 1 The asymptotic expansion of the distribution of the gradient statistic for test- ing a composite hypothesis under a sequence of local alternatives converging to the null hypothesis at rate n¡1=2 is 1 X3 Pr(S · x) = G (x) + p a G (x) + O(n¡1); (2) T f;¸ n k f+2k;¸ k=0 where Gm;¸(x) is the cumulative distribution function of a non-central chi-square variate with m degrees of freedom and non-centrality parameter ¸. Here, f = p ¡ q, ¸ = > y ² K22:1²=2 and the ak’s are given in (1). If q = 0, the null hypothesis is simple, ²¤ = ¡² and A = 0. Therefore, an immediate consequence of Theorem 1 is the following corollary. Corollary 1 The asymptotic expansion of the distribution of the gradient statistic for test- ing a simple hypothesis under a sequence of local alternatives converging to the null hypothesis at rate n¡1=2 is given by (2) with f = p, ¸ = ²>Ky²=2 and 1 1© ª a = Ky ± ² ± ² ± ²; a = ¡ Ky ± (K¡1)y ± ² ¡ 2Ky ± ² ± ² ± ² ; 0 6 ::: 1 4 ::: :;:: 1© ª 1 a = Ky ± (K¡1)y ± ² ¡ (K + 2K )y ± ² ± ² ± ² ; a = Ky ± ² ± ² ± ²: 2 4 ::: ::: :;:: 3 12 ::: 4 Power comparisons between the rival tests To first order ST , LR, W and SR have the same asymptotic distributional properties under either the null or local alternative hypotheses.
Recommended publications
  • Abel's Identity, 131 Abel's Test, 131–132 Abel's Theorem, 463–464 Absolute Convergence, 113–114 Implication of Condi
    INDEX Abel’s identity, 131 Bolzano-Weierstrass theorem, 66–68 Abel’s test, 131–132 for sequences, 99–100 Abel’s theorem, 463–464 boundary points, 50–52 absolute convergence, 113–114 bounded functions, 142 implication of conditional bounded sets, 42–43 convergence, 114 absolute value, 7 Cantor function, 229–230 reverse triangle inequality, 9 Cantor set, 80–81, 133–134, 383 triangle inequality, 9 Casorati-Weierstrass theorem, 498–499 algebraic properties of Rk, 11–13 Cauchy completeness, 106–107 algebraic properties of continuity, 184 Cauchy condensation test, 117–119 algebraic properties of limits, 91–92 Cauchy integral theorem algebraic properties of series, 110–111 triangle lemma, see triangle lemma algebraic properties of the derivative, Cauchy principal value, 365–366 244 Cauchy sequences, 104–105 alternating series, 115 convergence of, 105–106 alternating series test, 115–116 Cauchy’s inequalities, 437 analytic functions, 481–482 Cauchy’s integral formula, 428–433 complex analytic functions, 483 converse of, 436–437 counterexamples, 482–483 extension to higher derivatives, 437 identity principle, 486 for simple closed contours, 432–433 zeros of, see zeros of complex analytic on circles, 429–430 functions on open connected sets, 430–432 antiderivatives, 361 on star-shaped sets, 429 for f :[a, b] Rp, 370 → Cauchy’s integral theorem, 420–422 of complex functions, 408 consequence, see deformation of on star-shaped sets, 411–413 contours path-independence, 408–409, 415 Cauchy-Riemann equations Archimedean property, 5–6 motivation, 297–300
    [Show full text]
  • 11.3-11.4 Integral and Comparison Tests
    11.3-11.4 Integral and Comparison Tests The Integral Test: Suppose a function f(x) is continuous, positive, and decreasing on [1; 1). Let an 1 P R 1 be defined by an = f(n). Then, the series an and the improper integral 1 f(x) dx either BOTH n=1 CONVERGE OR BOTH DIVERGE. Notes: • For the integral test, when we say that f must be decreasing, it is actually enough that f is EVENTUALLY ALWAYS DECREASING. In other words, as long as f is always decreasing after a certain point, the \decreasing" requirement is satisfied. • If the improper integral converges to a value A, this does NOT mean the sum of the series is A. Why? The integral of a function will give us all the area under a continuous curve, while the series is a sum of distinct, separate terms. • The index and interval do not always need to start with 1. Examples: Determine whether the following series converge or diverge. 1 n2 • X n2 + 9 n=1 1 2 • X n2 + 9 n=3 1 1 n • X n2 + 1 n=1 1 ln n • X n n=2 Z 1 1 p-series: We saw in Section 8.9 that the integral p dx converges if p > 1 and diverges if p ≤ 1. So, by 1 x 1 1 the Integral Test, the p-series X converges if p > 1 and diverges if p ≤ 1. np n=1 Notes: 1 1 • When p = 1, the series X is called the harmonic series. n n=1 • Any constant multiple of a convergent p-series is also convergent.
    [Show full text]
  • 3.3 Convergence Tests for Infinite Series
    3.3 Convergence Tests for Infinite Series 3.3.1 The integral test We may plot the sequence an in the Cartesian plane, with independent variable n and dependent variable a: n X The sum an can then be represented geometrically as the area of a collection of rectangles with n=1 height an and width 1. This geometric viewpoint suggests that we compare this sum to an integral. If an can be represented as a continuous function of n, for real numbers n, not just integers, and if the m X sequence an is decreasing, then an looks a bit like area under the curve a = a(n). n=1 In particular, m m+2 X Z m+1 X an > an dn > an n=1 n=1 n=2 For example, let us examine the first 10 terms of the harmonic series 10 X 1 1 1 1 1 1 1 1 1 1 = 1 + + + + + + + + + : n 2 3 4 5 6 7 8 9 10 1 1 1 If we draw the curve y = x (or a = n ) we see that 10 11 10 X 1 Z 11 dx X 1 X 1 1 > > = − 1 + : n x n n 11 1 1 2 1 (See Figure 1, copied from Wikipedia) Z 11 dx Now = ln(11) − ln(1) = ln(11) so 1 x 10 X 1 1 1 1 1 1 1 1 1 1 = 1 + + + + + + + + + > ln(11) n 2 3 4 5 6 7 8 9 10 1 and 1 1 1 1 1 1 1 1 1 1 1 + + + + + + + + + < ln(11) + (1 − ): 2 3 4 5 6 7 8 9 10 11 Z dx So we may bound our series, above and below, with some version of the integral : x If we allow the sum to turn into an infinite series, we turn the integral into an improper integral.
    [Show full text]
  • The Binomial Series 16.3   
    The Binomial Series 16.3 Introduction In this Section we examine an important example of an infinite series, the binomial series: p(p − 1) p(p − 1)(p − 2) 1 + px + x2 + x3 + ··· 2! 3! We show that this series is only convergent if |x| < 1 and that in this case the series sums to the value (1 + x)p. As a special case of the binomial series we consider the situation when p is a positive integer n. In this case the infinite series reduces to a finite series and we obtain, by replacing x with b , the binomial theorem: a n(n − 1) (b + a)n = bn + nbn−1a + bn−2a2 + ··· + an. 2! Finally, we use the binomial series to obtain various polynomial expressions for (1 + x)p when x is ‘small’. ' • understand the factorial notation $ Prerequisites • have knowledge of the ratio test for convergence of infinite series. Before starting this Section you should ... • understand the use of inequalities '& • recognise and use the binomial series $% Learning Outcomes • state and use the binomial theorem On completion you should be able to ... • use the binomial series to obtain numerical approximations & % 26 HELM (2008): Workbook 16: Sequences and Series ® 1. The binomial series A very important infinite series which occurs often in applications and in algebra has the form: p(p − 1) p(p − 1)(p − 2) 1 + px + x2 + x3 + ··· 2! 3! in which p is a given number and x is a variable. By using the ratio test it can be shown that this series converges, irrespective of the value of p, as long as |x| < 1.
    [Show full text]
  • Series: Convergence and Divergence Comparison Tests
    Series: Convergence and Divergence Here is a compilation of what we have done so far (up to the end of October) in terms of convergence and divergence. • Series that we know about: P∞ n Geometric Series: A geometric series is a series of the form n=0 ar . The series converges if |r| < 1 and 1 a1 diverges otherwise . If |r| < 1, the sum of the entire series is 1−r where a is the first term of the series and r is the common ratio. P∞ 1 2 p-Series Test: The series n=1 np converges if p1 and diverges otherwise . P∞ • Nth Term Test for Divergence: If limn→∞ an 6= 0, then the series n=1 an diverges. Note: If limn→∞ an = 0 we know nothing. It is possible that the series converges but it is possible that the series diverges. Comparison Tests: P∞ • Direct Comparison Test: If a series n=1 an has all positive terms, and all of its terms are eventually bigger than those in a series that is known to be divergent, then it is also divergent. The reverse is also true–if all the terms are eventually smaller than those of some convergent series, then the series is convergent. P P P That is, if an, bn and cn are all series with positive terms and an ≤ bn ≤ cn for all n sufficiently large, then P P if cn converges, then bn does as well P P if an diverges, then bn does as well. (This is a good test to use with rational functions.
    [Show full text]
  • Calculus Terminology
    AP Calculus BC Calculus Terminology Absolute Convergence Asymptote Continued Sum Absolute Maximum Average Rate of Change Continuous Function Absolute Minimum Average Value of a Function Continuously Differentiable Function Absolutely Convergent Axis of Rotation Converge Acceleration Boundary Value Problem Converge Absolutely Alternating Series Bounded Function Converge Conditionally Alternating Series Remainder Bounded Sequence Convergence Tests Alternating Series Test Bounds of Integration Convergent Sequence Analytic Methods Calculus Convergent Series Annulus Cartesian Form Critical Number Antiderivative of a Function Cavalieri’s Principle Critical Point Approximation by Differentials Center of Mass Formula Critical Value Arc Length of a Curve Centroid Curly d Area below a Curve Chain Rule Curve Area between Curves Comparison Test Curve Sketching Area of an Ellipse Concave Cusp Area of a Parabolic Segment Concave Down Cylindrical Shell Method Area under a Curve Concave Up Decreasing Function Area Using Parametric Equations Conditional Convergence Definite Integral Area Using Polar Coordinates Constant Term Definite Integral Rules Degenerate Divergent Series Function Operations Del Operator e Fundamental Theorem of Calculus Deleted Neighborhood Ellipsoid GLB Derivative End Behavior Global Maximum Derivative of a Power Series Essential Discontinuity Global Minimum Derivative Rules Explicit Differentiation Golden Spiral Difference Quotient Explicit Function Graphic Methods Differentiable Exponential Decay Greatest Lower Bound Differential
    [Show full text]
  • Learning Goals: Power Series • Master the Art of Using the Ratio Test
    Learning Goals: Power Series • Master the art of using the ratio test to find the radius of convergence of a power series. • Learn how to find the series associated with the end points of the interval of convergence. 1 X xn • Become familiar with the series : n! n=0 xn • Become familiar with the limit lim : n!1 n! • Know the Power series representation of ex • Learn how to manipulate the power series representation of ex using tools previously mastered such as substitution, integration and differentiation. • Learn how to use power series to calculate limits. 1 Power Series, Stewart, Section 11.8 In this section, we will use the ratio test to determine the Radius of Convergence of a given power series. We will also determine the interval of convergence of the given power series if this is possible using the tests for convergence that we have already developed, namely, recognition as a geometric series, harmonic series or alternating harmonic series, telescoping series, the divergence test along with the fact that a series is absolutely convergent converges. The ratio and root tests will be inconclusive at the end points of the interval of convergence in the examples below since we use them to determine the radius of convergence. We may not be able to decide on convergence or divergence for some of the end points with our current tools. We will expand our methods for testing individual series for convergence in subsequent sections and tie up any loose ends as we proceed. We recall the definition of the Radius of Convergence and Interval of Convergence of a power series below.
    [Show full text]
  • Sequences, Series and Taylor Approximation (Ma2712b, MA2730)
    Sequences, Series and Taylor Approximation (MA2712b, MA2730) Level 2 Teaching Team Current curator: Simon Shaw November 20, 2015 Contents 0 Introduction, Overview 6 1 Taylor Polynomials 10 1.1 Lecture 1: Taylor Polynomials, Definition . .. 10 1.1.1 Reminder from Level 1 about Differentiable Functions . .. 11 1.1.2 Definition of Taylor Polynomials . 11 1.2 Lectures 2 and 3: Taylor Polynomials, Examples . ... 13 x 1.2.1 Example: Compute and plot Tnf for f(x) = e ............ 13 1.2.2 Example: Find the Maclaurin polynomials of f(x) = sin x ...... 14 2 1.2.3 Find the Maclaurin polynomial T11f for f(x) = sin(x ) ....... 15 1.2.4 QuestionsforChapter6: ErrorEstimates . 15 1.3 Lecture 4 and 5: Calculus of Taylor Polynomials . .. 17 1.3.1 GeneralResults............................... 17 1.4 Lecture 6: Various Applications of Taylor Polynomials . ... 22 1.4.1 RelativeExtrema .............................. 22 1.4.2 Limits .................................... 24 1.4.3 How to Calculate Complicated Taylor Polynomials? . 26 1.5 ExerciseSheet1................................... 29 1.5.1 ExerciseSheet1a .............................. 29 1.5.2 FeedbackforSheet1a ........................... 33 2 Real Sequences 40 2.1 Lecture 7: Definitions, Limit of a Sequence . ... 40 2.1.1 DefinitionofaSequence .......................... 40 2.1.2 LimitofaSequence............................. 41 2.1.3 Graphic Representations of Sequences . .. 43 2.2 Lecture 8: Algebra of Limits, Special Sequences . ..... 44 2.2.1 InfiniteLimits................................ 44 1 2.2.2 AlgebraofLimits.............................. 44 2.2.3 Some Standard Convergent Sequences . .. 46 2.3 Lecture 9: Bounded and Monotone Sequences . ..... 48 2.3.1 BoundedSequences............................. 48 2.3.2 Convergent Sequences and Closed Bounded Intervals . .... 48 2.4 Lecture10:MonotoneSequences .
    [Show full text]
  • Calculus Online Textbook Chapter 10
    Contents CHAPTER 9 Polar Coordinates and Complex Numbers 9.1 Polar Coordinates 348 9.2 Polar Equations and Graphs 351 9.3 Slope, Length, and Area for Polar Curves 356 9.4 Complex Numbers 360 CHAPTER 10 Infinite Series 10.1 The Geometric Series 10.2 Convergence Tests: Positive Series 10.3 Convergence Tests: All Series 10.4 The Taylor Series for ex, sin x, and cos x 10.5 Power Series CHAPTER 11 Vectors and Matrices 11.1 Vectors and Dot Products 11.2 Planes and Projections 11.3 Cross Products and Determinants 11.4 Matrices and Linear Equations 11.5 Linear Algebra in Three Dimensions CHAPTER 12 Motion along a Curve 12.1 The Position Vector 446 12.2 Plane Motion: Projectiles and Cycloids 453 12.3 Tangent Vector and Normal Vector 459 12.4 Polar Coordinates and Planetary Motion 464 CHAPTER 13 Partial Derivatives 13.1 Surfaces and Level Curves 472 13.2 Partial Derivatives 475 13.3 Tangent Planes and Linear Approximations 480 13.4 Directional Derivatives and Gradients 490 13.5 The Chain Rule 497 13.6 Maxima, Minima, and Saddle Points 504 13.7 Constraints and Lagrange Multipliers 514 CHAPTER Infinite Series Infinite series can be a pleasure (sometimes). They throw a beautiful light on sin x and cos x. They give famous numbers like n and e. Usually they produce totally unknown functions-which might be good. But on the painful side is the fact that an infinite series has infinitely many terms. It is not easy to know the sum of those terms.
    [Show full text]
  • The Ratio Test, Integral Test, and Absolute Convergence
    MATH 1D, WEEK 3 { THE RATIO TEST, INTEGRAL TEST, AND ABSOLUTE CONVERGENCE INSTRUCTOR: PADRAIC BARTLETT Abstract. These are the lecture notes from week 3 of Ma1d, the Caltech mathematics course on sequences and series. 1. Homework 1 data • HW average: 91%. • Comments: none in particular { people seemed to be pretty capable with this material. 2. The Ratio Test So: thus far, we've developed a few tools for determining the convergence or divergence of series. Specifically, the main tools we developed last week were the two comparison tests, which gave us a number of tools for determining whether a series converged by comparing it to other, known series. However, sometimes this P 1 P n isn't enough; simply comparing things to n and r usually can only get us so far. Hence, the creation of the following test: Theorem 2.1. If fang is a sequence of positive numbers such that a lim n+1 = r; n!1 an for some real number r, then P1 • n=1 an converges if r < 1, while P1 • n=1 an diverges if r > 1. If r = 1, this test is inconclusive and tells us nothing. Proof. The basic idea motivating this theorem is the following: if the ratios an+1 an eventually approach some value r, then this series eventually \looks like" the geo- metric series P rn; consequently, it should converge whenever r < 1 and diverge whenever r > 1. an+1 To make the above concrete: suppose first that r > 1. Then, because limn!1 = an r;, we know that there is some N 2 N such that 8n ≥ N, a n+1 > 1 an )an+1 > an: But this means that the an's are eventually an increasing sequence starting at some value aN > 0; thus, we have that limn!1 an 6= 0 and thus that the sum P1 n=1 an cannot converge.
    [Show full text]
  • Series Convergence Tests Math 122 Calculus III D Joyce, Fall 2012
    Series Convergence Tests Math 122 Calculus III D Joyce, Fall 2012 Some series converge, some diverge. Geometric series. We've already looked at these. We know when a geometric series 1 X converges and what it converges to. A geometric series arn converges when its ratio r lies n=0 a in the interval (−1; 1), and, when it does, it converges to the sum . 1 − r 1 X 1 The harmonic series. The standard harmonic series diverges to 1. Even though n n=1 1 1 its terms 1, 2 , 3 , . approach 0, the partial sums Sn approach infinity, so the series diverges. The main questions for a series. Question 1: given a series does it converge or diverge? Question 2: if it converges, what does it converge to? There are several tests that help with the first question and we'll look at those now. The term test. The only series that can converge are those whose terms approach 0. That 1 X is, if ak converges, then ak ! 0. k=1 Here's why. If the series converges, then the limit of the sequence of its partial sums n th X approaches the sum S, that is, Sn ! S where Sn is the n partial sum Sn = ak. Then k=1 lim an = lim (Sn − Sn−1) = lim Sn − lim Sn−1 = S − S = 0: n!1 n!1 n!1 n!1 The contrapositive of that statement gives a test which can tell us that some series diverge. Theorem 1 (The term test). If the terms of the series don't converge to 0, then the series diverges.
    [Show full text]
  • MA 231 Vector Analysis
    MA 231 Vector Analysis Stefan Adams 2010, revised version from 2007, update 02.12.2010 Contents 1 Gradients and Directional Derivatives 1 2 Visualisation of functions f : Rm ! Rn 4 2.1 Scalar fields, n =1 ........................4 2.2 Vector fields, n > 1........................8 2.3 Curves and Surfaces . 10 3 Line integrals 16 3.1 Integrating scalar fields . 16 3.2 Integrating vector fields . 17 4 Gradient Vector Fields 20 4.1 FTC for gradient vector fields . 21 4.2 Finding a potential . 26 4.3 Radial vector fields . 30 5 Surface Integrals 33 5.1 Surfaces . 33 5.2 Integral . 36 5.3 Kissing problem . 40 6 Divergence of Vector Fields 45 6.1 Flux across a surface . 45 6.2 Divergence . 48 7 Gauss's Divergence Theorem 52 8 Integration by Parts 59 9 Green's theorem and curls in R2 61 9.1 Green's theorem . 61 9.2 Application . 66 10 Stokes's theorem 72 10.1 Stokes's theorem . 72 10.2 Polar coordinates . 78 11 Complex Derivatives and M¨obiustransformations 80 12 Complex Power Series 89 13 Holomorphic functions 99 14 Complex integration 103 15 Cauchy's theorem 107 16 Cauchy's formulae 117 16.1 Cauchy's formulae . 117 16.2 Taylor's and Liouville's theorem . 120 17 Real Integrals 122 18 Power series for Holomorphic functions 126 18.1 Power series representation . 126 18.2 Power series representation - further results . 128 19 Laurent series and Cauchy's Residue Formula 130 19.1 Index . 130 19.2 Laurent series . 138 ii Preface Health Warning: These notes give the skeleton of the course and are not a substitute for attending lectures.
    [Show full text]