Chapter 6 Implicit Function Theorem
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
A Geometric Take on Metric Learning
A Geometric take on Metric Learning Søren Hauberg Oren Freifeld Michael J. Black MPI for Intelligent Systems Brown University MPI for Intelligent Systems Tubingen,¨ Germany Providence, US Tubingen,¨ Germany [email protected] [email protected] [email protected] Abstract Multi-metric learning techniques learn local metric tensors in different parts of a feature space. With such an approach, even simple classifiers can be competitive with the state-of-the-art because the distance measure locally adapts to the struc- ture of the data. The learned distance measure is, however, non-metric, which has prevented multi-metric learning from generalizing to tasks such as dimensional- ity reduction and regression in a principled way. We prove that, with appropriate changes, multi-metric learning corresponds to learning the structure of a Rieman- nian manifold. We then show that this structure gives us a principled way to perform dimensionality reduction and regression according to the learned metrics. Algorithmically, we provide the first practical algorithm for computing geodesics according to the learned metrics, as well as algorithms for computing exponential and logarithmic maps on the Riemannian manifold. Together, these tools let many Euclidean algorithms take advantage of multi-metric learning. We illustrate the approach on regression and dimensionality reduction tasks that involve predicting measurements of the human body from shape data. 1 Learning and Computing Distances Statistics relies on measuring distances. When the Euclidean metric is insufficient, as is the case in many real problems, standard methods break down. This is a key motivation behind metric learning, which strives to learn good distance measures from data. -
33 .1 Implicit Differentiation 33.1.1Implicit Function
Module 11 : Partial derivatives, Chain rules, Implicit differentiation, Gradient, Directional derivatives Lecture 33 : Implicit differentiation [Section 33.1] Objectives In this section you will learn the following : The concept of implicit differentiation of functions. 33 .1 Implicit differentiation \ As we had observed in section , many a times a function of an independent variable is not given explicitly, but implicitly by a relation. In section we had also mentioned about the implicit function theorem. We state it precisely now, without proof. 33.1.1Implicit Function Theorem (IFT): Let and be such that the following holds: (i) Both the partial derivatives and exist and are continuous in . (ii) and . Then there exists some and a function such that is differentiable, its derivative is continuous with and 33.1.2Remark: We have a corresponding version of the IFT for solving in terms of . Here, the hypothesis would be . 33.1.3Example: Let we want to know, when does the implicit expression defines explicitly as a function of . We note that and are both continuous. Since for the points and the implicit function theorem is not applicable. For , and , the equation defines the explicit function and for , the equation defines the explicit function Figure 1. y is a function of x. A result similar to that of theorem holds for function of three variables, as stated next. Theorem : 33.1.4 Let and be such that (i) exist and are continuous at . (ii) and . Then the equation determines a unique function in the neighborhood of such that for , and , Practice Exercises : Show that the following functions satisfy conditions of the implicit function theorem in the neighborhood of (1) the indicated point. -
Integrated Calculus/Pre-Calculus
Furman University Department of Mathematics Greenville, SC, 29613 Integrated Calculus/Pre-Calculus Abstract Mark R. Woodard Contents JJ II J I Home Page Go Back Close Quit Abstract This work presents the traditional material of calculus I with some of the material from a traditional precalculus course interwoven throughout the discussion. Pre- calculus topics are discussed at or soon before the time they are needed, in order to facilitate the learning of the calculus material. Miniature animated demonstra- tions and interactive quizzes will be available to help the reader deepen his or her understanding of the material under discussion. Integrated This project is funded in part by the Mellon Foundation through the Mellon Furman- Calculus/Pre-Calculus Wofford Program. Many of the illustrations were designed by Furman undergraduate Mark R. Woodard student Brian Wagner using the PSTricks package. Thanks go to my wife Suzan, and my two daughters, Hannah and Darby for patience while this project was being produced. Title Page Contents JJ II J I Go Back Close Quit Page 2 of 191 Contents 1 Functions and their Properties 11 1.1 Functions & Cartesian Coordinates .................. 13 1.1.1 Functions and Functional Notation ............ 13 1.2 Cartesian Coordinates and the Graphical Representa- tion of Functions .................................. 20 1.3 Circles, Distances, Completing the Square ............ 22 1.3.1 Distance Formula and Circles ................. 22 Integrated 1.3.2 Completing the Square ...................... 23 Calculus/Pre-Calculus 1.4 Lines ............................................ 24 Mark R. Woodard 1.4.1 General Equation and Slope-Intercept Form .... 24 1.4.2 More On Slope ............................. 24 1.4.3 Parallel and Perpendicular Lines ............. -
Calculus Terminology
AP Calculus BC Calculus Terminology Absolute Convergence Asymptote Continued Sum Absolute Maximum Average Rate of Change Continuous Function Absolute Minimum Average Value of a Function Continuously Differentiable Function Absolutely Convergent Axis of Rotation Converge Acceleration Boundary Value Problem Converge Absolutely Alternating Series Bounded Function Converge Conditionally Alternating Series Remainder Bounded Sequence Convergence Tests Alternating Series Test Bounds of Integration Convergent Sequence Analytic Methods Calculus Convergent Series Annulus Cartesian Form Critical Number Antiderivative of a Function Cavalieri’s Principle Critical Point Approximation by Differentials Center of Mass Formula Critical Value Arc Length of a Curve Centroid Curly d Area below a Curve Chain Rule Curve Area between Curves Comparison Test Curve Sketching Area of an Ellipse Concave Cusp Area of a Parabolic Segment Concave Down Cylindrical Shell Method Area under a Curve Concave Up Decreasing Function Area Using Parametric Equations Conditional Convergence Definite Integral Area Using Polar Coordinates Constant Term Definite Integral Rules Degenerate Divergent Series Function Operations Del Operator e Fundamental Theorem of Calculus Deleted Neighborhood Ellipsoid GLB Derivative End Behavior Global Maximum Derivative of a Power Series Essential Discontinuity Global Minimum Derivative Rules Explicit Differentiation Golden Spiral Difference Quotient Explicit Function Graphic Methods Differentiable Exponential Decay Greatest Lower Bound Differential -
INTRODUCTION to ALGEBRAIC GEOMETRY 1. Preliminary Of
INTRODUCTION TO ALGEBRAIC GEOMETRY WEI-PING LI 1. Preliminary of Calculus on Manifolds 1.1. Tangent Vectors. What are tangent vectors we encounter in Calculus? 2 0 (1) Given a parametrised curve α(t) = x(t); y(t) in R , α (t) = x0(t); y0(t) is a tangent vector of the curve. (2) Given a surface given by a parameterisation x(u; v) = x(u; v); y(u; v); z(u; v); @x @x n = × is a normal vector of the surface. Any vector @u @v perpendicular to n is a tangent vector of the surface at the corresponding point. (3) Let v = (a; b; c) be a unit tangent vector of R3 at a point p 2 R3, f(x; y; z) be a differentiable function in an open neighbourhood of p, we can have the directional derivative of f in the direction v: @f @f @f D f = a (p) + b (p) + c (p): (1.1) v @x @y @z In fact, given any tangent vector v = (a; b; c), not necessarily a unit vector, we still can define an operator on the set of functions which are differentiable in open neighbourhood of p as in (1.1) Thus we can take the viewpoint that each tangent vector of R3 at p is an operator on the set of differential functions at p, i.e. @ @ @ v = (a; b; v) ! a + b + c j ; @x @y @z p or simply @ @ @ v = (a; b; c) ! a + b + c (1.2) @x @y @z 3 with the evaluation at p understood. -
Lecture 2 Tangent Space, Differential Forms, Riemannian Manifolds
Lecture 2 tangent space, differential forms, Riemannian manifolds differentiable manifolds A manifold is a set that locally look like Rn. For example, a two-dimensional sphere S2 can be covered by two subspaces, one can be the northen hemisphere extended slightly below the equator and another can be the southern hemisphere extended slightly above the equator. Each patch can be mapped smoothly into an open set of R2. In general, a manifold M consists of a family of open sets Ui which covers M, i.e. iUi = M, n ∪ and, for each Ui, there is a continuous invertible map ϕi : Ui R . To be precise, to define → what we mean by a continuous map, we has to define M as a topological space first. This requires a certain set of properties for open sets of M. We will discuss this in a couple of weeks. For now, we assume we know what continuous maps mean for M. If you need to know now, look at one of the standard textbooks (e.g., Nakahara). Each (Ui, ϕi) is called a coordinate chart. Their collection (Ui, ϕi) is called an atlas. { } The map has to be one-to-one, so that there is an inverse map from the image ϕi(Ui) to −1 Ui. If Ui and Uj intersects, we can define a map ϕi ϕj from ϕj(Ui Uj)) to ϕi(Ui Uj). ◦ n ∩ ∩ Since ϕj(Ui Uj)) to ϕi(Ui Uj) are both subspaces of R , we express the map in terms of n ∩ ∩ functions and ask if they are differentiable. -
Quasi–Geodesic Flows
Quasi{geodesic flows Maciej Czarnecki UniwersytetL´odzki,Katedra Geometrii ul. Banacha 22, 90-238L´od´z,Poland e-mail: [email protected] 1 Contents 1 Hyperbolic manifolds and hyperbolic groups 4 1.1 Hyperbolic space . 4 1.2 M¨obiustransformations . 5 1.3 Isometries of hyperbolic spaces . 5 1.4 Gromov hyperbolicity . 7 1.5 Hyperbolic surfaces and hyperbolic manifolds . 8 2 Foliations and flows 10 2.1 Foliations . 10 2.2 Flows . 10 2.3 Anosov and pseudo{Anosov flows . 11 2.4 Geodesic and quasi{geodesic flows . 12 3 Compactification of decomposed plane 13 3.1 Circular order . 13 3.2 Construction of universal circle . 13 3.3 Decompositions of the plane and ordering ends . 14 3.4 End compactification . 15 4 Quasi{geodesic flow and its end extension 16 4.1 Product covering . 16 4.2 Compactification of the flow space . 16 4.3 Properties of extension and the Calegari conjecture . 17 5 Non{compact case 18 5.1 Spaces of spheres . 18 5.2 Constant curvature flows on H2 . 18 5.3 Remarks on geodesic flows in H3 . 19 2 Introduction These are cosy notes of Erasmus+ lectures at Universidad de Granada, Spain on April 16{18, 2018 during the author's stay at IEMath{GR. After Danny Calegari and Steven Frankel we describe a structure of quasi{ geodesic flows on 3{dimensional hyperbolic manifolds. A flow in an action of the addirtive group R o on given manifold. We concentrate on closed 3{dimensional hyperbolic manifolds i.e. having locally isometric covering by the hyperbolic space H3. -
5. the Inverse Function Theorem We Now Want to Aim for a Version of the Inverse Function Theorem
5. The inverse function theorem We now want to aim for a version of the Inverse function Theorem. In differential geometry, the inverse function theorem states that if a function is an isomorphism on tangent spaces, then it is locally an isomorphism. Unfortunately this is too much to expect in algebraic geometry, since the Zariski topology is too weak for this to be true. For example consider a curve which double covers another curve. At any point where there are two points in the fibre, the map on tangent spaces is an isomorphism. But there is no Zariski neighbourhood of any point where the map is an isomorphism. Thus a minimal requirement is that the morphism is a bijection. Note that this is not enough in general for a morphism between al- gebraic varieties to be an isomorphism. For example in characteristic p, Frobenius is nowhere smooth and even in characteristic zero, the parametrisation of the cuspidal cubic is a bijection but not an isomor- phism. Lemma 5.1. If f : X −! Y is a projective morphism with finite fibres, then f is finite. Proof. Since the result is local on the base, we may assume that Y is affine. By assumption X ⊂ Y × Pn and we are projecting onto the first factor. Possibly passing to a smaller open subset of Y , we may assume that there is a point p 2 Pn such that X does not intersect Y × fpg. As the blow up of Pn at p, fibres over Pn−1 with fibres isomorphic to P1, and the composition of finite morphisms is finite, we may assume that n = 1, by induction on n. -
Implicit Differentiation
opes. A Neurips 2020 Tut orial by Marc Deisenro A Swamps of integrationnumerical b Monte Carlo Heights C Fo r w w m a r o al r N izi ng Flo d -ba h ckw ime ar Of T d D B ea c h Hills There E Unrolling Backprop Bay f Expectations and Sl and fExpectations B ack Again: A Tale o Tale A Again: ack and th and opes. A Neurips 2020 Tut orial by Marc Deisenro A Swamps of integrationnumerical b Monte Carlo Heights C Fo r w Implicit of Vale w m a r o al r N izi ng Flo d -ba h G ckw ime ar Of T d D B Differentiation ea c h Hills There E Unrolling Backprop Bay f Expectations and Sl and fExpectations B ack Again: A Tale o Tale A Again: ack and th and Implicit differentiation Cheng Soon Ong Marc Peter Deisenroth December 2020 oon n S O g g ’s n Tu e t hC o d r n C i a a h l t M a o t a M r r n c e D e s i Motivation I In machine learning, we use gradients to train predictors I For functions f(x) we can directly obtain its gradient rf(x) I How to represent a constraint? G(x; y) = 0 E.g. conservation of mass 1 dy = 3x2 + 4x + 1 dx Observe that we can write the equation as x3 + 2x2 + x + 4 − y = 0 which is of the form G(x; y) = 0. -
The Orientation Manifesto (For Undergraduates)
The Orientation Manifesto (for undergraduates) Timothy E. Goldberg 11 November 2007 An orientation of a vector space is represented by an ordered basis of the vector space. We think of an orientation as a twirl, namely the twirl that rotates the first basis vector to the second, and the second to the third, and so on. Two ordered bases represent the same orientation if they generate the same twirl. (This amounts to the linear transformation taking one basis to the other having positive determinant.) If you think about it carefully, there are only ever two choices of twirls, and hence only two choices of orientation. n Because each R has a standard choice of ordered basis, fe1; e2; : : : ; eng (where ei is has 1 in the ith coordinates and 0 everywhere else), each Rn has a standard choice of orientation. The standard orientation of R is the twirl that points in the positive direction. The standard orientation of R2 is the counterclockwise twirl, moving from 3 e1 = (1; 0) to e2 = (0; 1). The standard orientation of R is a twirl that sweeps from the positive x direction to the positive y direction, and up the positive z direction. It's like a directed helix, pointed up and spinning in the counterclockwise direction if viewed from above. See Figure 1. An orientation of a curve, or a surface, or a solid body, is really a choice of orientations of every single tangent space, in such a way that the twirls all agree with each other. (This can be made horribly precise, when necessary.) There are several ways for a manifold to pick up an orientation. -
On Manifolds of Negative Curvature, Geodesic Flow, and Ergodicity
ON MANIFOLDS OF NEGATIVE CURVATURE, GEODESIC FLOW, AND ERGODICITY CLAIRE VALVA Abstract. We discuss geodesic flow on manifolds of negative sectional curva- ture. We find that geodesic flow is ergodic on the tangent bundle of a manifold, and present the proof for both n = 2 on surfaces and general n. Contents 1. Introduction 1 2. Riemannian Manifolds 1 2.1. Geodesic Flow 2 2.2. Horospheres and Horocycle Flows 3 2.3. Curvature 4 2.4. Jacobi Fields 4 3. Anosov Flows 4 4. Ergodicity 5 5. Surfaces of Negative Curvature 6 5.1. Fuchsian Groups and Hyperbolic Surfaces 6 6. Geodesic Flow on Hyperbolic Surfaces 7 7. The Ergodicity of Geodesic Flow on Compact Manifolds of Negative Sectional Curvature 8 7.1. Foliations and Absolute Continuity 9 7.2. Proof of Ergodicity 12 Acknowledgments 14 References 14 1. Introduction We want to understand the behavior of geodesic flow on a manifold M of constant negative curvature. If we consider a vector in the unit tangent bundle of M, where does that vector go (or not go) when translated along its unique geodesic path. In a sense, we will show that the vector goes \everywhere," or that the vector visits a full measure subset of T 1M. 2. Riemannian Manifolds We first introduce some of the initial definitions and concepts that allow us to understand Riemannian manifolds. Date: August 2019. 1 2 CLAIRE VALVA Definition 2.1. If M is a differentiable manifold and α :(−, ) ! M is a dif- ferentiable curve, where α(0) = p 2 M, then the tangent vector to the curve α at t = 0 is a function α0(0) : D ! R, where d(f ◦ α) α0(0)f = j dt t=0 for f 2 D, where D is the set of functions on M that are differentiable at p. -
Manifolds, Tangent Vectors and Covectors
Physics 250 Fall 2015 Notes 1 Manifolds, Tangent Vectors and Covectors 1. Introduction Most of the “spaces” used in physical applications are technically differentiable man- ifolds, and this will be true also for most of the spaces we use in the rest of this course. After a while we will drop the qualifier “differentiable” and it will be understood that all manifolds we refer to are differentiable. We will build up the definition in steps. A differentiable manifold is basically a topological manifold that has “coordinate sys- tems” imposed on it. Recall that a topological manifold is a topological space that is Hausdorff and locally homeomorphic to Rn. The number n is the dimension of the mani- fold. On a topological manifold, we can talk about the continuity of functions, for example, of functions such as f : M → R (a “scalar field”), but we cannot talk about the derivatives of such functions. To talk about derivatives, we need coordinates. 2. Charts and Coordinates Generally speaking it is impossible to cover a manifold with a single coordinate system, so we work in “patches,” technically charts. Given a topological manifold M of dimension m, a chart on M is a pair (U, φ), where U ⊂ M is an open set and φ : U → V ⊂ Rm is a homeomorphism. See Fig. 1. Since φ is a homeomorphism, V is also open (in Rm), and φ−1 : V → U exists. If p ∈ U is a point in the domain of φ, then φ(p) = (x1,...,xm) is the set of coordinates of p with respect to the given chart.