Distributed Averaging Using Non-Doubly Stochastic Matrices

Total Page:16

File Type:pdf, Size:1020Kb

Distributed Averaging Using Non-Doubly Stochastic Matrices Weighted Gossip: Distributed Averaging Using Non-Doubly Stochastic Matrices Florence B´en´ezit Vincent Blondel Patrick Thiran John Tsitsiklis Martin Vetterli ENS-INRIA, France UCL, Belgium EPFL, Switzerland MIT, USA EPFL, Switzerland Abstract—This paper presents a general class of gossip- Then the destination node sends the average back through the based averaging algorithms, which are inspired from Uniform same route so that all the nodes in the route can update their Gossip [1]. While Uniform Gossip works synchronously on values to the average. Path Averaging is efficient in terms complete graphs, weighted gossip algorithms allow asynchronous rounds and converge on any connected, directed or undirected of energy consumption, but it demands some long distance graph. Unlike most previous gossip algorithms [2]–[6], Weighted coordination to make sure that all the values in the route were Gossip admits stochastic update matrices which need not be updated correctly. Routing information back and forth might as doubly stochastic. Double-stochasticity being very restrictive in well introduce delay issues, because a node that is engaged in a distributed setting [7], this novel degree of freedom is essential a route needs to wait for the update to come back before it can and it opens the perspective of designing a large number of new gossip-based algorithms. To give an example, we present proceed to another round. Furthermore, in a mobile network, one of these algorithms, which we call One-Way Averaging. It is or in a highly dynamic network, routing the information back based on random geographic routing, just like Path Averaging [5], on the same route might even not succeed. except that routes are one way instead of round trip. Hence in This work started with the goal of designing a unidirectional this example, getting rid of double stochasticity allows us to add gossip algorithm fulfilling the following requirements: robustness to Path Averaging. • Keep a geographic routing communication scheme be- cause it is highly diffusive, I. INTRODUCTION • Avoid routing back data: instead of long distance agree- Gossip algorithms were recently developed to solve the ments, only agreements between neighbors are allowed, distributed average consensus problem [1]–[6]. Every node i • Route crossing is possible at any time, without introduc- in a network holds a value xi and wants to learn the average ing errors in the algorithm. xave of all the values in the network in a distributed way. Most As we were designing One-Way Averaging, we happened to gossip algorithms were designed for wireless sensor networks, prove the correctness of a broad set of gossip-based algo- which are usually modeled as random geometric graphs and rithms, which we present in this paper along with One-Way sometimes as lattices. Ideally a distributed averaging algorithm Averaging. These algorithms can be asynchronous and they should be efficient in terms of energy and delay without use stochastic diffusion matrices which are not necessarily requiring too much knowledge about the network topology doubly stochastic, as announced by the title of the paper. at each node, nor sophisticated coordination between nodes. In Section II, we give some background on gossip algo- The simplest gossip algorithm is Pairwise Gossip, where rithms, and we explain why Uniform Gossip is a key algorithm random pairs of connected nodes iteratively and locally aver- to get inspired from when building a unidirectional gossip age their values until convergence to the global average [2]. algorithm. In Section III, we present Weighted Gossip, an Pairwise local averaging is an easy task, which does not re- asynchronous generalization of Uniform Gossip, which was quire global knowledge nor global coordination, thus Pairwise already suggested in [1] but had remained unnamed. We show Gossip fulfills the requirements of our distributed problem. in Section IV that weighted gossip algorithms converge to However, the convergence speed of Pairwise Gossip suffers xave, which is a novel result to the best of our knowledge. In from the locality of the updates, and it was shown that averag- Section V, we describe in detail One-Way Averaging and we ing random geographic routes instead of local neighborhoods show on simulations that the good diffusivity of geographic is an order-optimal communication scheme to run gossip. routes in Path Averaging persists in One-Way Averaging. Let n be the number of nodes in the network. On random Computing the speed of convergence of weighted gossip geometric graphs, Pairwise Gossip requires Θ(n2) messages algorithms remains open and is part of future work. whereas Path Averaging requires only Θ(n log n) messages II. BACKGROUND ON GOSSIP ALGORITHMS under some conditions [5]. x The previous algorithm gained efficiency at the price of The values to be averaged are gathered in a vector (0) and more complex coordination. At every round of Path Averaging, at any iteration t, the current estimates of the average xave are x a random node wakes up and generates a random route. gathered in (t). Gossip algorithms update estimates linearly. W Values are aggregated along the route and the destination node At any iteration t, there is a matrix (t) such that: computes the average of the values collected along the route. x(t)T = x(t 1)T W (t). − In gossip algorithms that converge to average consensus, W (t) Theorem 3.1 (Non-biased estimator): If the estimates is doubly stochastic: W (t)1 = 1 ensures that the global x(t) = s(t)/ω(t) converge to a consensus, then the T T average is conserved, and 1 W (t) = 1 guarantees stable consensus value is the average xave. consensus. To perform averaging on a one way route, W (t) Proof: Let c be the consensus value. For any ǫ> 0, there should be upper triangular (up to a node index permutation). is an iteration t0 after which, for any node i, xi(t) c <ǫ. | − | But the only matrix that is both doubly stochastic and upper Then, for any t>t0, si(t) cωi(t) < ǫωi(t) (weights are triangular matrix is the identity matrix. Thus, unidirectional always positive). Hence,| summing− over| i, averaging requires to drop double stochasticity. s ω s ω ω Uniform Gossip solves this issue in the following way. ( i(t) c i(t)) i(t) c i(t) <ǫ i(t). x − ≤ | − | Instead of updating one vector (t) of variables, it updates a Xi Xi Xi s ω vector (t) of sums, and a vector (t) of weights. Uniform Using Eq. (5), (6), the previous equation can be written as Gossip initializes s(0) = x(0) and ω(0) = 1. At any time, the nxave nc < nǫ, which is equivalent to xave c < ǫ. | − | | − | vector of estimates is x(t) = s(t)/ω(t), where the division Hence c = xave. is performed elementwise. The updates are computed with In the next section, we show that, although sums and weights stochastic diffusion matrices D(t) t>0: do not reach a consensus, the estimates xi(t) 1≤i≤n converge { } to a consensus under some conditions.{ } s(t)T = s(t 1)T D(t), (1) − ω(t)T = ω(t 1)T D(t). (2) IV. CONVERGENCE − In this section we prove that Weighted Gossip succeeds in Kempe et al. [1] prove that the algorithm converges to a other cases than just Uniform Gossip. consensus on x (lim x(t) = x 1) in the special case ave t ave Assumption 1: D(t) 0 is a stationary and ergodic se- D D t> where for any node i, ii(t)=1/2 and ij (t)=1/2 for quence of stochastic{ matrices} with positive diagonals, and one node j chosen i.i.d. uniformly at random. As a key remark, E[D] is irreducible. D note that here (t) is not doubly stochastic. The algorithm is Irreducibility means that the graph formed by edges (i, j) synchronous and it works on complete graphs without routing, such that P[Dij > 0] > 0 is connected, which requires the and on other graphs with routing. We show in this paper connectivity of the network. Note that i.i.d. sequences are that the idea works with many more sequences of matrices stationary and ergodic. Stationarity implies that E[D] does not D(t) t>0 than just the one used in Uniform Gossip. { } depend on t. Positive diagonals means that each node should III. WEIGHTED GOSSIP always keep part of its sum and weight: i, t, Dii(t) > 0. Theorem 4.1 (Main Theorem): Under∀ Assumption 1, We call Weighted Gossip the class of gossip-based algo- Weighted Gossip using D(t) 0 converges to a consensus rithms following the sum and weight structure of Uniform t> with probability 1, i.e. lim{ }x(t)= x 1. Gossip described above (Eq. (1) and (2)). A weighted gossip t→∞ ave To prove Th. 4.1, we will start by upper bounding the algorithm is entirely characterized by the distribution of its error x(t) xave1 ∞ with a non-increasing function f(t) diffusion matrices D(t) t>0. Let P (s,t) := D(s)D(s + k − k n { } (Lemma 4.1): let ηji(t)= Pji(t) Pji(t)/n = Pji(t) 1) ... D(t) and let P(t) := P (1,t). Then − j=1 − ωi(t)/n, then f is defined as f(t)P = max1≤i≤n fi(t), where T T n s(t) = x(0) P (t), (3) fi(t) = ηji(t) /ωi(t). Then, we will prove that f(t) j=1 | | ω(t)T = 1T P (t). (4) vanishesP to 0 by showing that ηji(t) vanishes to 0 (weak ergodicity argument of Lemma 4.3) and that ωi(t) is bounded If a weighted gossip algorithm is asynchronous, then, away from 0 infinitely often (Lemma 4.4).
Recommended publications
  • Adjacency and Incidence Matrices
    Adjacency and Incidence Matrices 1 / 10 The Incidence Matrix of a Graph Definition Let G = (V ; E) be a graph where V = f1; 2;:::; ng and E = fe1; e2;:::; emg. The incidence matrix of G is an n × m matrix B = (bik ), where each row corresponds to a vertex and each column corresponds to an edge such that if ek is an edge between i and j, then all elements of column k are 0 except bik = bjk = 1. 1 2 e 21 1 13 f 61 0 07 3 B = 6 7 g 40 1 05 4 0 0 1 2 / 10 The First Theorem of Graph Theory Theorem If G is a multigraph with no loops and m edges, the sum of the degrees of all the vertices of G is 2m. Corollary The number of odd vertices in a loopless multigraph is even. 3 / 10 Linear Algebra and Incidence Matrices of Graphs Recall that the rank of a matrix is the dimension of its row space. Proposition Let G be a connected graph with n vertices and let B be the incidence matrix of G. Then the rank of B is n − 1 if G is bipartite and n otherwise. Example 1 2 e 21 1 13 f 61 0 07 3 B = 6 7 g 40 1 05 4 0 0 1 4 / 10 Linear Algebra and Incidence Matrices of Graphs Recall that the rank of a matrix is the dimension of its row space. Proposition Let G be a connected graph with n vertices and let B be the incidence matrix of G.
    [Show full text]
  • Graph Equivalence Classes for Spectral Projector-Based Graph Fourier Transforms Joya A
    1 Graph Equivalence Classes for Spectral Projector-Based Graph Fourier Transforms Joya A. Deri, Member, IEEE, and José M. F. Moura, Fellow, IEEE Abstract—We define and discuss the utility of two equiv- Consider a graph G = G(A) with adjacency matrix alence graph classes over which a spectral projector-based A 2 CN×N with k ≤ N distinct eigenvalues and Jordan graph Fourier transform is equivalent: isomorphic equiv- decomposition A = VJV −1. The associated Jordan alence classes and Jordan equivalence classes. Isomorphic equivalence classes show that the transform is equivalent subspaces of A are Jij, i = 1; : : : k, j = 1; : : : ; gi, up to a permutation on the node labels. Jordan equivalence where gi is the geometric multiplicity of eigenvalue 휆i, classes permit identical transforms over graphs of noniden- or the dimension of the kernel of A − 휆iI. The signal tical topologies and allow a basis-invariant characterization space S can be uniquely decomposed by the Jordan of total variation orderings of the spectral components. subspaces (see [13], [14] and Section II). For a graph Methods to exploit these classes to reduce computation time of the transform as well as limitations are discussed. signal s 2 S, the graph Fourier transform (GFT) of [12] is defined as Index Terms—Jordan decomposition, generalized k gi eigenspaces, directed graphs, graph equivalence classes, M M graph isomorphism, signal processing on graphs, networks F : S! Jij i=1 j=1 s ! (s ;:::; s ;:::; s ;:::; s ) ; (1) b11 b1g1 bk1 bkgk I. INTRODUCTION where sij is the (oblique) projection of s onto the Jordan subspace Jij parallel to SnJij.
    [Show full text]
  • Network Properties Revealed Through Matrix Functions 697
    SIAM REVIEW c 2010 Society for Industrial and Applied Mathematics Vol. 52, No. 4, pp. 696–714 Network Properties Revealed ∗ through Matrix Functions † Ernesto Estrada Desmond J. Higham‡ Abstract. The emerging field of network science deals with the tasks of modeling, comparing, and summarizing large data sets that describe complex interactions. Because pairwise affinity data can be stored in a two-dimensional array, graph theory and applied linear algebra provide extremely useful tools. Here, we focus on the general concepts of centrality, com- municability,andbetweenness, each of which quantifies important features in a network. Some recent work in the mathematical physics literature has shown that the exponential of a network’s adjacency matrix can be used as the basis for defining and computing specific versions of these measures. We introduce here a general class of measures based on matrix functions, and show that a particular case involving a matrix resolvent arises naturally from graph-theoretic arguments. We also point out connections between these measures and the quantities typically computed when spectral methods are used for data mining tasks such as clustering and ordering. We finish with computational examples showing the new matrix resolvent version applied to real networks. Key words. centrality measures, clustering methods, communicability, Estrada index, Fiedler vector, graph Laplacian, graph spectrum, power series, resolvent AMS subject classifications. 05C50, 05C82, 91D30 DOI. 10.1137/090761070 1. Motivation. 1.1. Introduction. Connections are important. Across the natural, technologi- cal, and social sciences it often makes sense to focus on the pattern of interactions be- tween individual components in a system [1, 8, 61].
    [Show full text]
  • Diagonal Sums of Doubly Stochastic Matrices Arxiv:2101.04143V1 [Math
    Diagonal Sums of Doubly Stochastic Matrices Richard A. Brualdi∗ Geir Dahl† 7 December 2020 Abstract Let Ωn denote the class of n × n doubly stochastic matrices (each such matrix is entrywise nonnegative and every row and column sum is 1). We study the diagonals of matrices in Ωn. The main question is: which A 2 Ωn are such that the diagonals in A that avoid the zeros of A all have the same sum of their entries. We give a characterization of such matrices, and establish several classes of patterns of such matrices. Key words. Doubly stochastic matrix, diagonal sum, patterns. AMS subject classifications. 05C50, 15A15. 1 Introduction Let Mn denote the (vector) space of real n×n matrices and on this space we consider arXiv:2101.04143v1 [math.CO] 11 Jan 2021 P the usual scalar product A · B = i;j aijbij for A; B 2 Mn, A = [aij], B = [bij]. A permutation σ = (k1; k2; : : : ; kn) of f1; 2; : : : ; ng can be identified with an n × n permutation matrix P = Pσ = [pij] by defining pij = 1, if j = ki, and pij = 0, otherwise. If X = [xij] is an n × n matrix, the entries of X in the positions of X in ∗Department of Mathematics, University of Wisconsin, Madison, WI 53706, USA. [email protected] †Department of Mathematics, University of Oslo, Norway. [email protected]. Correspond- ing author. 1 which P has a 1 is the diagonal Dσ of X corresponding to σ and P , and their sum n X dP (X) = xi;ki i=1 is a diagonal sum of X.
    [Show full text]
  • The Generalized Dedekind Determinant
    Contemporary Mathematics Volume 655, 2015 http://dx.doi.org/10.1090/conm/655/13232 The Generalized Dedekind Determinant M. Ram Murty and Kaneenika Sinha Abstract. The aim of this note is to calculate the determinants of certain matrices which arise in three different settings, namely from characters on finite abelian groups, zeta functions on lattices and Fourier coefficients of normalized Hecke eigenforms. Seemingly disparate, these results arise from a common framework suggested by elementary linear algebra. 1. Introduction The purpose of this note is three-fold. We prove three seemingly disparate results about matrices which arise in three different settings, namely from charac- ters on finite abelian groups, zeta functions on lattices and Fourier coefficients of normalized Hecke eigenforms. In this section, we state these theorems. In Section 2, we state a lemma from elementary linear algebra, which lies at the heart of our three theorems. A detailed discussion and proofs of the theorems appear in Sections 3, 4 and 5. In what follows below, for any n × n matrix A and for 1 ≤ i, j ≤ n, Ai,j or (A)i,j will denote the (i, j)-th entry of A. A diagonal matrix with diagonal entries y1,y2, ...yn will be denoted as diag (y1,y2, ...yn). Theorem 1.1. Let G = {x1,x2,...xn} be a finite abelian group and let f : G → C be a complex-valued function on G. Let F be an n × n matrix defined by F −1 i,j = f(xi xj). For a character χ on G, (that is, a homomorphism of G into the multiplicative group of the field C of complex numbers), we define Sχ := f(s)χ(s).
    [Show full text]
  • Dynamical Systems Associated with Adjacency Matrices
    DISCRETE AND CONTINUOUS doi:10.3934/dcdsb.2018190 DYNAMICAL SYSTEMS SERIES B Volume 23, Number 5, July 2018 pp. 1945{1973 DYNAMICAL SYSTEMS ASSOCIATED WITH ADJACENCY MATRICES Delio Mugnolo Delio Mugnolo, Lehrgebiet Analysis, Fakult¨atMathematik und Informatik FernUniversit¨atin Hagen, D-58084 Hagen, Germany Abstract. We develop the theory of linear evolution equations associated with the adjacency matrix of a graph, focusing in particular on infinite graphs of two kinds: uniformly locally finite graphs as well as locally finite line graphs. We discuss in detail qualitative properties of solutions to these problems by quadratic form methods. We distinguish between backward and forward evo- lution equations: the latter have typical features of diffusive processes, but cannot be well-posed on graphs with unbounded degree. On the contrary, well-posedness of backward equations is a typical feature of line graphs. We suggest how to detect even cycles and/or couples of odd cycles on graphs by studying backward equations for the adjacency matrix on their line graph. 1. Introduction. The aim of this paper is to discuss the properties of the linear dynamical system du (t) = Au(t) (1.1) dt where A is the adjacency matrix of a graph G with vertex set V and edge set E. Of course, in the case of finite graphs A is a bounded linear operator on the finite di- mensional Hilbert space CjVj. Hence the solution is given by the exponential matrix etA, but computing it is in general a hard task, since A carries little structure and can be a sparse or dense matrix, depending on the underlying graph.
    [Show full text]
  • Adjacency Matrices Text Reference: Section 2.1, P
    Adjacency Matrices Text Reference: Section 2.1, p. 114 The purpose of this set of exercises is to show how powers of a matrix may be used to investigate graphs. Special attention is paid to airline route maps as examples of graphs. In order to study graphs, the notion of graph must first be defined. A graph is a set of points (called vertices,ornodes) and a set of lines called edges connecting some pairs of vertices. Two vertices connected by an edge are said to be adjacent. Consider the graph in Figure 1. Notice that two vertices may be connected by more than one edge (A and B are connected by 2 distinct edges), that a vertex need not be connected to any other vertex (D), and that a vertex may be connected to itself (F). Another example of a graph is the route map that most airlines (or railways) produce. A copy of the northern route map for Cape Air from May 2001 is Figure 2. This map is available at the web page: www.flycapeair.com. Here the vertices are the cities to which Cape Air flies, and two vertices are connected if a direct flight flies between them. Figure 2: Northern Route Map for Cape Air -- May 2001 Application Project: Adjacency Matrices Page 2 of 5 Some natural questions arise about graphs. It might be important to know if two vertices are connected by a sequence of two edges, even if they are not connected by a single edge. In Figure 1, A and C are connected by a two-edge sequence (actually, there are four distinct ways to go from A to C in two steps).
    [Show full text]
  • On Structured Realizability and Stabilizability of Linear Systems
    On Structured Realizability and Stabilizability of Linear Systems Laurent Lessard Maxim Kristalny Anders Rantzer Abstract We study the notion of structured realizability for linear systems defined over graphs. A stabilizable and detectable realization is structured if the state-space matrices inherit the sparsity pattern of the adjacency matrix of the associated graph. In this paper, we demonstrate that not every structured transfer matrix has a structured realization and we reveal the practical meaning of this fact. We also uncover a close connection between the structured realizability of a plant and whether the plant can be stabilized by a structured controller. In particular, we show that a structured stabilizing controller can only exist when the plant admits a structured realization. Finally, we give a parameterization of all structured stabilizing controllers and show that they always have structured realizations. 1 Introduction Linear time-invariant systems are typically represented using transfer functions or state- space realizations. The relationship between these representations is well understood; every transfer function has a minimal state-space realization and one can easily move between representations depending on the need. In this paper, we address the question of whether this relationship between representa- tions still holds for systems defined over directed graphs. Consider the simple two-node graph of Figure 1. For i = 1, 2, the node i represents a subsystem with inputs ui and outputs yi, and the edge means that subsystem 1 can influence subsystem 2 but not vice versa. The transfer matrix for any such a system has the sparsity pattern S1. For a state-space realization to make sense in this context, every state should be as- sociated with a subsystem, which means that the state should be computable using the information available to that subsystem.
    [Show full text]
  • A Note on the Spectra and Eigenspaces of the Universal Adjacency Matrices of Arbitrary Lifts of Graphs
    A note on the spectra and eigenspaces of the universal adjacency matrices of arbitrary lifts of graphs C. Dalf´o,∗ M. A. Fiol,y S. Pavl´ıkov´a,z and J. Sir´aˇnˇ x Abstract The universal adjacency matrix U of a graph Γ, with adjacency matrix A, is a linear combination of A, the diagonal matrix D of vertex degrees, the identity matrix I, and the all-1 matrix J with real coefficients, that is, U = c1A + c2D + c3I + c4J, with ci 2 R and c1 6= 0. Thus, as particular cases, U may be the adjacency matrix, the Laplacian, the signless Laplacian, and the Seidel matrix. In this note, we show that basically the same method introduced before by the authors can be applied for determining the spectra and bases of all the corresponding eigenspaces of arbitrary lifts of graphs (regular or not). Keywords: Graph; covering; lift; universal adjacency matrix; spectrum; eigenspace. 2010 Mathematics Subject Classification: 05C20, 05C50, 15A18. 1 Introduction For a graph Γ on n vertices, with adjacency matrix A and degree sequence d1; : : : ; dn, the universal adjacency matrix is defined as U = c1A+c2D +c3I +c4J, with ci 2 R and c1 6= 0, where D = diag(d1; : : : ; dn), I is the identity matrix, and J is the all-1 matrix. See, for arXiv:1912.04740v1 [math.CO] 8 Dec 2019 instance, Haemers and Omidi [10] or Farrugia and Sciriha [5]. Thus, for given values of the ∗Departament de Matem`atica, Universitat de Lleida, Igualada (Barcelona), Catalonia, [email protected] yDepartament de Matem`atiques,Universitat Polit`ecnicade Catalunya; and Barcelona Graduate
    [Show full text]
  • 4/2/2015 1.0.1 the Laplacian Matrix and Its Spectrum
    MS&E 337: Spectral Graph Theory and Algorithmic Applications Spring 2015 Lecture 1: 4/2/2015 Instructor: Prof. Amin Saberi Scribe: Vahid Liaghat Disclaimer: These notes have not been subjected to the usual scrutiny reserved for formal publications. 1.0.1 The Laplacian matrix and its spectrum Let G = (V; E) be an undirected graph with n = jV j vertices and m = jEj edges. The adjacency matrix AG is defined as the n × n matrix where the non-diagonal entry aij is 1 iff i ∼ j, i.e., there is an edge between vertex i and vertex j and 0 otherwise. Let D(G) define an arbitrary orientation of the edges of G. The (oriented) incidence matrix BD is an n × m matrix such that qij = −1 if the edge corresponding to column j leaves vertex i, 1 if it enters vertex i, and 0 otherwise. We may denote the adjacency matrix and the incidence matrix simply by A and B when it is clear from the context. One can discover many properties of graphs by observing the incidence matrix of a graph. For example, consider the following proposition. Proposition 1.1. If G has c connected components, then Rank(B) = n − c. Proof. We show that the dimension of the null space of B is c. Let z denote a vector such that zT B = 0. This implies that for every i ∼ j, zi = zj. Therefore z takes the same value on all vertices of the same connected component. Hence, the dimension of the null space is c. The Laplacian matrix L = BBT is another representation of the graph that is quite useful.
    [Show full text]
  • Determinants Associated to Zeta Matrices of Posets
    DETERMINANTS ASSOCIATED TO ZETA MATRICES OF POSETS Cristina M. Ballantine Sharon M. Frechette John B. Little College of the Holy Cross April 1, 2004 t Abstract. We consider the matrix ZP = ZP + ZP , where the entries of ZP are the values of the zeta function of the ¯nite poset P . We give a combinatorial interpreta- tion of the determinant of ZP and establish a recursive formula for this determinant in the case in which P is a boolean algebra. x1. Introduction The theory of partially ordered sets (posets) plays an important role in enumer- ative combinatorics and the MÄobiusinversion formula for posets generalizes several fundamental theorems including the number-theoretic MÄobiusinversion theorem. For a detailed review of posets and MÄobiusinversion we refer the reader to [S1], chapter 3, and [Sa]. Below we provide a short exposition of the basic facts on the subject following [S1]. A partially ordered set (poset) P is a set which, by abuse of notation, we also call P together with a binary relation, called a partial order and denoted ·, satisfying: (1) x · x for all x 2 P (reflexivity). (2) If x · y and y · x, then x = y (antisymmetry). (3) If x · y and y · z, then x · z (transitivity). 1991 Mathematics Subject Classi¯cation. 15A15, 05C20, 05C50, 06A11. Key words and phrases. poset, zeta function, MÄobiusfunction. Typeset by AMS-TEX 1 2 DETERMINANTS OF ZETA MATRICES Two elements x and y are comparable if x · y or y · x. Otherwise they are incomparable. We write x < y to mean x · y and x 6= y.
    [Show full text]
  • GPU Accelerated Approach to Numerical Linear Algebra and Matrix Analysis with CFD Applications
    University of Central Florida STARS HIM 1990-2015 2014 GPU Accelerated Approach to Numerical Linear Algebra and Matrix Analysis with CFD Applications Adam Phillips University of Central Florida Part of the Mathematics Commons Find similar works at: https://stars.library.ucf.edu/honorstheses1990-2015 University of Central Florida Libraries http://library.ucf.edu This Open Access is brought to you for free and open access by STARS. It has been accepted for inclusion in HIM 1990-2015 by an authorized administrator of STARS. For more information, please contact [email protected]. Recommended Citation Phillips, Adam, "GPU Accelerated Approach to Numerical Linear Algebra and Matrix Analysis with CFD Applications" (2014). HIM 1990-2015. 1613. https://stars.library.ucf.edu/honorstheses1990-2015/1613 GPU ACCELERATED APPROACH TO NUMERICAL LINEAR ALGEBRA AND MATRIX ANALYSIS WITH CFD APPLICATIONS by ADAM D. PHILLIPS A thesis submitted in partial fulfilment of the requirements for the Honors in the Major Program in Mathematics in the College of Sciences and in The Burnett Honors College at the University of Central Florida Orlando, Florida Spring Term 2014 Thesis Chair: Dr. Bhimsen Shivamoggi c 2014 Adam D. Phillips All Rights Reserved ii ABSTRACT A GPU accelerated approach to numerical linear algebra and matrix analysis with CFD applica- tions is presented. The works objectives are to (1) develop stable and efficient algorithms utilizing multiple NVIDIA GPUs with CUDA to accelerate common matrix computations, (2) optimize these algorithms through CPU/GPU memory allocation, GPU kernel development, CPU/GPU communication, data transfer and bandwidth control to (3) develop parallel CFD applications for Navier Stokes and Lattice Boltzmann analysis methods.
    [Show full text]