Practical Parallel Hypergraph Algorithms

Total Page:16

File Type:pdf, Size:1020Kb

Practical Parallel Hypergraph Algorithms Practical Parallel Hypergraph Algorithms Julian Shun [email protected] MIT CSAIL Abstract v While there has been signicant work on parallel graph pro- 0 cessing, there has been very surprisingly little work on high- e0 performance hypergraph processing. This paper presents v0 v1 v1 a collection of ecient parallel algorithms for hypergraph processing, including algorithms for betweenness central- e1 ity, maximal independent set, k-core decomposition, hyper- v2 trees, hyperpaths, connected components, PageRank, and v2 v3 e single-source shortest paths. For these problems, we either 2 provide new parallel algorithms or more ecient implemen- v3 tations than prior work. Furthermore, our algorithms are theoretically-ecient in terms of work and depth. To imple- (a) Hypergraph (b) Bipartite representation ment our algorithms, we extend the Ligra graph processing Figure 1. An example hypergraph representing the groups framework to support hypergraphs, and our implementa- , , , , , , and , , and its bipartite repre- { 0 1 2} { 1 2 3} { 0 3} tions benet from graph optimizations including switching sentation. between sparse and dense traversals based on the frontier size, edge-aware parallelization, using buckets to prioritize processing of vertices, and compression. Our experiments represented as hyperedges, can contain an arbitrary number on a 72-core machine and show that our algorithms obtain of vertices. Hyperedges correspond to group relationships excellent parallel speedups, and are signicantly faster than among vertices (e.g., a community in a social network). An algorithms in existing hypergraph processing frameworks. example of a hypergraph is shown in Figure 1a. CCS Concepts • Computing methodologies → Paral- Hypergraphs have been shown to enable richer analy- lel algorithms; Shared memory algorithms. sis of structured data in various domains, such as protein network analysis [76], machine learning [100], and image 1 Introduction processing [15, 27]. Various graph algorithms have been A graph contains vertices and edges, where a vertex repre- extended to the hypergraph setting, and we list some ex- sents an entity of interest, and an edge between two vertices amples of algorithms and their applications here. Between- represents an interaction between the two corresponding ness centrality on hypergraphs has been used for hierarchi- entities. There has been signicant work on developing al- cal community detection [12] and measuring importance gorithms and programming frameworks for ecient graph of hypergraphs vertices [77]. k-core decomposition in hy- processing due to their applications in various domains, such pergraphs can be applied to invertible Bloom lookup tables, as social network and Web analysis, cyber-security, and sci- low-density parity-check codes, and set reconciliation [45]. entic computations. One limitation of modeling data using PageRank and random walks on hypergraphs have been used graphs is that only binary relationships can be expressed, and for image segmentation and spectral clustering and shown can lead to loss of information from the original data. Hyper- to outperform graph-based methods [26, 27, 100]. Shortest graphs are a generalization of graphs where the relationships, paths, hyperpaths, and hypertrees have been used for solv- ing optimization problems [30, 70], satisability problems Permission to make digital or hard copies of all or part of this work for and deriving functional dependencies in databases [30], and personal or classroom use is granted without fee provided that copies are not made or distributed for prot or commercial advantage and that copies bear modeling information spread and nding important actors this notice and the full citation on the rst page. Copyrights for components in social networks [31]. Independent sets on hypergraphs of this work owned by others than ACM must be honored. Abstracting with have been applied to routing problems [2] and determining credit is permitted. To copy otherwise, or republish, to post on servers or to satisability of boolean formulas [48]. redistribute to lists, requires prior specic permission and/or a fee. Request Although there are many applications of hypergraphs, permissions from [email protected]. there has been little research on parallel hypergraph process- PPoPP ’20, February 22–26, 2020, San Diego, CA, USA © 2020 Association for Computing Machinery. ing. The main contribution of this paper is a suite of ecient ACM ISBN 978-1-4503-6818-6/20/02...$15.00 parallel hypergraph algorithms, including algorithms for hps://doi.org/10.1145/3332466.3374527 betweenness centrality, maximal independent set, k-core 232 PPoPP ’20, February 22–26, 2020, San Diego, CA, USA Julian Shun decomposition, hypertrees, hyperpaths, connected compo- usage and performance is signicantly worse than that of nents, PageRank, and single-source shortest paths. For these Hygra (2.8x–30.6x slower while using 235x more space on problems, we provide either new parallel hypergraph algo- the Friendster hypergraph). rithms (e.g., betweenness centrality and k-core decomposi- Our work shows that high-performance hypergraph pro- tion) or more ecient implementations than prior work. Ad- cessing can be done using just a single multicore machine, ditionally, we show that most of our algorithms are theoretically- on which we can process all existing publicly-available hy- ecient in terms of their work and depth complexities. pergraphs. Prior work has shown that graph processing We observe that our parallel hypergraph algorithms can can be done eciently on just a single multicore machine be implemented eciently by taking advantage of graph pro- (e.g., [24, 25, 67, 69, 81, 87, 96, 101]), and this work extends cessing machinery. To implement our parallel hypergraph the observation to hypergraphs. algorithms, we made relatively simple extensions to the Ligra The rest of the paper is organized as follows. Section 2 graph processing framework [81] and we call the extended discusses related work on graph and hypergraph process- framework Hygra. As with Ligra, Hygra is well-suited for ing. Section 3 describes hypergraph notation as well as the frontier-based algorithms, where small subsets of elements computational model and parallel primitives that we use in (referred to as frontiers) are processed in parallel on each the paper. Section 4 introduces the Hygra framework. Sec- iteration. We use a bipartite graph representation to store tion 5 describes our new parallel hypergraph algorithms hypergraphs, and use Ligra’s data structures for represent- implemented using Hygra. Section 6 presents our experi- ing subsets of vertices and hyperedges as well as operators mental evaluation of our algorithms, and comparisons with for mapping application-specic functions over these ele- alternative approaches. Finally, we conclude in Section 7. ments. The operators for processing subsets of vertices and hyperedges are theoretically-ecient, which enables us to 2 Related Work implement parallel hypergraph algorithms with strong the- oretical guarantees. Separating the operations on vertices Graph Processing. There has been signicant work on de- from operations on hyperedges is crucial for eciency and veloping graph libraries and frameworks to reduce program- requires carefully dening functions for vertices and hyper- ming eort by providing high-level operators that capture edges to preserve correctness. Hygra inherits from Ligra vari- common algorithm design patterns (e.g., [19, 21, 22, 28, 33– ous optimizations developed for graphs, including switching 35, 38–40, 42, 47, 51, 56, 60, 61, 63–65, 68, 69, 71–73, 75, 78, 81, between dierent traversal strategies based on the size of 84–87, 91, 94, 96, 99, 101], among many others; see [66, 79, 93] the frontier (direction optimization), edge-aware paralleliza- for surveys). Many of these frameworks can process large tion, bucketing for prioritizing the processing of vertices, graphs eciently, but none of them directly support hyper- and compression. graph processing. Our experiments on a variety of real-world and synthetic hypergraphs show that our algorithms implemented in Hy- Hypergraph Processing. As far as we know, HyperX [46] gra achieve good parallel speedup and scalability with re- and MESH [41] are the only existing high-level programming spect to input size. On 72 cores with hyper-threading, we frameworks for hypergraph processing, and they are built achieve a parallel speedup of between 8.5–76.5x. We also for distributed memory on top of Spark [95]. Algorithms nd that the direction optimization improves performance are written using hyperedge programs and vertex programs for hypergraphs algorithms compared to using a single tra- that are iteratively applied on hyperedges and vertices, re- versal strategy. Compared to HyperX [46] and MESH [41], spectively. HyperX stores hypergraphs using xed-length tu- which are the only existing high-level programming frame- ples containing vertex and hyperedge identiers, and MESH works for hypergraph processing that we are aware of, our stores the hypergraph as a bipartite graph. HyperX includes results are signicantly faster. For example, one iteration algorithms for random walks, label propagation, and spectral of PageRank on the Orkut community hypergraph with 2.3 learning. MESH includes PageRank, PageRank-Entropy (a million vertices and 15.3 million hyperedges [59] takes 0.083s variant of PageRank that also computes the entropy of ver- on 72 cores and 3.31s on one thread in Hygra, while taking tex ranks
Recommended publications
  • Practical Parallel Hypergraph Algorithms
    Practical Parallel Hypergraph Algorithms Julian Shun [email protected] MIT CSAIL Abstract v0 While there has been significant work on parallel graph pro- e0 cessing, there has been very surprisingly little work on high- v0 v1 v1 performance hypergraph processing. This paper presents a e collection of efficient parallel algorithms for hypergraph pro- 1 v2 cessing, including algorithms for computing hypertrees, hy- v v 2 3 e perpaths, betweenness centrality, maximal independent sets, 2 v k-core decomposition, connected components, PageRank, 3 and single-source shortest paths. For these problems, we ei- (a) Hypergraph (b) Bipartite representation ther provide new parallel algorithms or more efficient imple- mentations than prior work. Furthermore, our algorithms are Figure 1. An example hypergraph representing the groups theoretically-efficient in terms of work and depth. To imple- fv0;v1;v2g, fv1;v2;v3g, and fv0;v3g, and its bipartite repre- ment our algorithms, we extend the Ligra graph processing sentation. framework to support hypergraphs, and our implementations benefit from graph optimizations including switching between improved compared to using a graph representation. Unfor- sparse and dense traversals based on the frontier size, edge- tunately, there is been little research on parallel hypergraph aware parallelization, using buckets to prioritize processing processing. of vertices, and compression. Our experiments on a 72-core The main contribution of this paper is a suite of efficient machine and show that our algorithms obtain excellent paral- parallel hypergraph algorithms, including algorithms for hy- lel speedups, and are significantly faster than algorithms in pertrees, hyperpaths, betweenness centrality, maximal inde- existing hypergraph processing frameworks.
    [Show full text]
  • Multilevel Hypergraph Partitioning with Vertex Weights Revisited
    Multilevel Hypergraph Partitioning with Vertex Weights Revisited Tobias Heuer ! Karlsruhe Institute of Technology, Karlsruhe, Germany Nikolai Maas ! Karlsruhe Institute of Technology, Karlsruhe, Germany Sebastian Schlag ! Karlsruhe Institute of Technology, Karlsruhe, Germany Abstract The balanced hypergraph partitioning problem (HGP) is to partition the vertex set of a hypergraph into k disjoint blocks of bounded weight, while minimizing an objective function defined on the hyperedges. Whereas real-world applications often use vertex and edge weights to accurately model the underlying problem, the HGP research community commonly works with unweighted instances. In this paper, we argue that, in the presence of vertex weights, current balance constraint definitions either yield infeasible partitioning problems or allow unnecessarily large imbalances and propose a new definition that overcomes these problems. We show that state-of-the-art hypergraph partitioners often struggle considerably with weighted instances and tight balance constraints (even with our new balance definition). Thus, we present a recursive-bipartitioning technique that isable to reliably compute balanced (and hence feasible) solutions. The proposed method balances the partition by pre-assigning a small subset of the heaviest vertices to the two blocks of each bipartition (using an algorithm originally developed for the job scheduling problem) and optimizes the actual partitioning objective on the remaining vertices. We integrate our algorithm into the multilevel hypergraph
    [Show full text]
  • On Decomposing a Hypergraph Into K Connected Sub-Hypergraphs
    Egervary´ Research Group on Combinatorial Optimization Technical reportS TR-2001-02. Published by the Egrerv´aryResearch Group, P´azm´any P. s´et´any 1/C, H{1117, Budapest, Hungary. Web site: www.cs.elte.hu/egres . ISSN 1587{4451. On decomposing a hypergraph into k connected sub-hypergraphs Andr´asFrank, Tam´asKir´aly,and Matthias Kriesell February 2001 Revised July 2001 EGRES Technical Report No. 2001-02 1 On decomposing a hypergraph into k connected sub-hypergraphs Andr´asFrank?, Tam´asKir´aly??, and Matthias Kriesell??? Abstract By applying the matroid partition theorem of J. Edmonds [1] to a hyper- graphic generalization of graphic matroids, due to M. Lorea [3], we obtain a gen- eralization of Tutte's disjoint trees theorem for hypergraphs. As a corollary, we prove for positive integers k and q that every (kq)-edge-connected hypergraph of rank q can be decomposed into k connected sub-hypergraphs, a well-known result for q = 2. Another by-product is a connectivity-type sufficient condition for the existence of k edge-disjoint Steiner trees in a bipartite graph. Keywords: Hypergraph; Matroid; Steiner tree 1 Introduction An undirected graph G = (V; E) is called connected if there is an edge connecting X and V X for every nonempty, proper subset X of V . Connectivity of a graph is equivalent− to the existence of a spanning tree. As a connected graph on t nodes contains at least t 1 edges, one has the following alternative characterization of connectivity. − Proposition 1.1. A graph G = (V; E) is connected if and only if the number of edges connecting distinct classes of is at least t 1 for every partition := V1;V2;:::;Vt of V into non-empty subsets.P − P f g ?Department of Operations Research, E¨otv¨osUniversity, Kecskem´etiu.
    [Show full text]
  • Hypergraph Packing and Sparse Bipartite Ramsey Numbers
    Hypergraph packing and sparse bipartite Ramsey numbers David Conlon ∗ Abstract We prove that there exists a constant c such that, for any integer ∆, the Ramsey number of a bipartite graph on n vertices with maximum degree ∆ is less than 2c∆n. A probabilistic argument due to Graham, R¨odland Ruci´nskiimplies that this result is essentially sharp, up to the constant c in the exponent. Our proof hinges upon a quantitative form of a hypergraph packing result of R¨odl,Ruci´nskiand Taraz. 1 Introduction For a graph G, the Ramsey number r(G) is defined to be the smallest natural number n such that, in any two-colouring of the edges of Kn, there exists a monochromatic copy of G. That these numbers exist was proven by Ramsey [19] and rediscovered independently by Erd}osand Szekeres [10]. Whereas the original focus was on finding the Ramsey numbers of complete graphs, in which case it is known that t t p2 r(Kt) 4 ; ≤ ≤ the field has broadened considerably over the years. One of the most famous results in the area to date is the theorem, due to Chvat´al,R¨odl,Szemer´ediand Trotter [7], that if a graph G, on n vertices, has maximum degree ∆, then r(G) c(∆)n; ≤ where c(∆) is just some appropriate constant depending only on ∆. Their proof makes use of the regularity lemma and because of this the bound it gives on the constant c(∆) is (and is necessarily [11]) very bad. The situation was improved somewhat by Eaton [8], who proved, by using a variant of the regularity lemma, that the function c(∆) may be taken to be of the form 22c∆ .
    [Show full text]
  • Hypernetwork Science: from Multidimensional Networks to Computational Topology∗
    Hypernetwork Science: From Multidimensional Networks to Computational Topology∗ Cliff A. Joslyn,y Sinan Aksoy,z Tiffany J. Callahan,x Lawrence E. Hunter,x Brett Jefferson,z Brenda Praggastis,y Emilie A.H. Purvine,y Ignacio J. Tripodix March, 2020 Abstract cations, and physical infrastructure often afford a rep- resentation as such a set of entities with binary rela- As data structures and mathematical objects used tionships, and hence may be analyzed utilizing graph for complex systems modeling, hypergraphs sit nicely theoretical methods. poised between on the one hand the world of net- Graph models benefit from simplicity and a degree of work models, and on the other that of higher-order universality. But as abstract mathematical objects, mathematical abstractions from algebra, lattice the- graphs are limited to representing pairwise relation- ory, and topology. They are able to represent com- ships between entities, while real-world phenomena plex systems interactions more faithfully than graphs in these systems can be rich in multi-way relation- and networks, while also being some of the simplest ships involving interactions among more than two classes of systems representing topological structures entities, dependencies between more than two vari- as collections of multidimensional objects connected ables, or properties of collections of more than two in a particular pattern. In this paper we discuss objects. Representing group interactions is not possi- the role of (undirected) hypergraphs in the science ble in graphs natively, but rather requires either more of complex networks, and provide a mathematical complex mathematical objects, or coding schemes like overview of the core concepts needed for hypernet- “reification” or semantic labeling in bipartite graphs.
    [Show full text]
  • Adjacency Matrix
    CSE 373 Graphs 3: Implementation reading: Weiss Ch. 9 slides created by Marty Stepp http://www.cs.washington.edu/373/ © University of Washington, all rights reserved. 1 Implementing a graph • If we wanted to program an actual data structure to represent a graph, what information would we need to store? for each vertex? for each edge? 1 2 3 • What kinds of questions would we want to be able to answer quickly: 4 5 6 about a vertex? about edges / neighbors? 7 about paths? about what edges exist in the graph? • We'll explore three common graph implementation strategies: edge list , adjacency list , adjacency matrix 2 Edge list • edge list : An unordered list of all edges in the graph. an array, array list, or linked list • advantages : 1 2 3 easy to loop/iterate over all edges 4 5 6 • disadvantages : hard to quickly tell if an edge 7 exists from vertex A to B hard to quickly find the degree of a vertex (how many edges touch it) 0 1 2 3 4 56 7 8 (1, 2) (1, 4) (1, 7) (2, 3) 2, 5) (3, 6)(4, 7) (5, 6) (6, 7) 3 Graph operations • Using an edge list, how would you find: all neighbors of a given vertex? the degree of a given vertex? whether there is an edge from A to B? 1 2 3 whether there are any loops (self-edges)? • What is the Big-Oh of each operation? 4 5 6 7 0 1 2 3 4 56 7 8 (1, 2) (1, 4) (1, 7) (2, 3) 2, 5) (3, 6)(4, 7) (5, 6) (6, 7) 4 Adjacency matrix • adjacency matrix : An N × N matrix where: the non-diagonal entry a[i,j] is the number of edges joining vertex i and vertex j (or the weight of the edge joining vertex i and vertex j).
    [Show full text]
  • A Framework for Transductive and Inductive Learning on Hypergraphs
    Deep Hyperedges: a Framework for Transductive and Inductive Learning on Hypergraphs Josh Payne IBM T. J. Watson Research Center Yorktown Heights, NY 10598 [email protected] Abstract From social networks to protein complexes to disease genomes to visual data, hypergraphs are everywhere. However, the scope of research studying deep learning on hypergraphs is still quite sparse and nascent, as there has not yet existed an effective, unified framework for using hyperedge and vertex embeddings jointly in the hypergraph context, despite a large body of prior work that has shown the utility of deep learning over graphs and sets. Building upon these recent advances, we propose Deep Hyperedges (DHE), a modular framework that jointly uses contextual and permutation-invariant vertex membership properties of hyperedges in hypergraphs to perform classification and regression in transductive and inductive learning settings. In our experiments, we use a novel random walk procedure and show that our model achieves and, in most cases, surpasses state-of-the-art performance on benchmark datasets. Additionally, we study our framework’s performance on a variety of diverse, non-standard hypergraph datasets and propose several avenues of future work to further enhance DHE. 1 Introduction and Background As data becomes more plentiful, we find ourselves with access to increasingly complex networks that can be used to express many different types of information. Hypergraphs have been used to recommend music [1], model cellular and protein-protein interaction networks [2, 3], classify images and perform 3D object recognition [4, 5], diagnose Alzheimer’s disease [6], analyze social relationships [7, 8], and classify gene expression [9]—the list goes on.
    [Show full text]
  • Introduction to Graphs
    Multidimensional Arrays & Graphs CMSC 420: Lecture 3 Mini-Review • Abstract Data Types: • Implementations: • List • Linked Lists • Stack • Circularly linked lists • Queue • Doubly linked lists • Deque • XOR Doubly linked lists • Dictionary • Ring buffers • Set • Double stacks • Bit vectors Techniques: Sentinels, Zig-zag scan, link inversion, bit twiddling, self- organizing lists, constant-time initialization Constant-Time Initialization • Design problem: - Suppose you have a long array, most values are 0. - Want constant time access and update - Have as much space as you need. • Create a big array: - a = new int[LARGE_N]; - Too slow: for(i=0; i < LARGE_N; i++) a[i] = 0 • Want to somehow implicitly initialize all values to 0 in constant time... Constant-Time Initialization means unchanged 1 2 6 12 13 Data[] = • Access(i): if (0≤ When[i] < count and Where[When[i]] == i) return Where[] = 6 13 12 Count = 3 Count holds # of elements changed Where holds indices of the changed elements. When[] = 1 3 2 When maps from index i to the time step when item i was first changed. Access(i): if 0 ≤ When[i] < Count and Where[When[i]] == i: return Data[i] else: return DEFAULT Multidimensional Arrays • Often it’s more natural to index data items by keys that have several dimensions. E.g.: • (longitude, latitude) • (row, column) of a matrix • (x,y,z) point in 3d space • Aside: why is a plane “2-dimensional”? Row-major vs. Column-major order • 2-dimensional arrays can be mapped to linear memory in two ways: 1 2 3 4 5 1 2 3 4 5 1 1 2 3 4 5 1 1 5 9 13 17 2 6 7 8 9 10 2 2 6 10 14 18 3 11 12 13 14 15 3 3 7 11 15 19 4 16 17 18 19 20 4 4 8 12 16 20 Row-major order Column-major order Addr(i,j) = Base + 5(i-1) + (j-1) Addr(i,j) = Base + (i-1) + 4(j-1) Row-major vs.
    [Show full text]
  • The Hitchhiker's Guide to Graph Exchange Formats
    The Hitchhiker’s Guide to Graph Exchange Formats Prof. Matthew Roughan [email protected] http://www.maths.adelaide.edu.au/matthew.roughan/ Work with Jono Tuke UoA June 4, 2015 M.Roughan (UoA) Hitch Hikers Guide June 4, 2015 1 / 31 Graphs Graph: G(N; E) I N = set of nodes (vertices) I E = set of edges (links) Often we have additional information, e.g., I link distance I node type I graph name M.Roughan (UoA) Hitch Hikers Guide June 4, 2015 2 / 31 Why? To represent data where “connections” are 1st class objects in their own right I storing the data in the right format improves access, processing, ... I it’s natural, elegant, efficient, ... Many, many datasets M.Roughan (UoA) Hitch Hikers Guide June 4, 2015 3 / 31 ISPs: Internode: layer 3 http: //www.internode.on.net/pdf/network/internode-domestic-ip-network.pdf M.Roughan (UoA) Hitch Hikers Guide June 4, 2015 4 / 31 ISPs: Level 3 (NA) http://www.fiberco.org/images/Level3-Metro-Fiber-Map4.jpg M.Roughan (UoA) Hitch Hikers Guide June 4, 2015 5 / 31 Telegraph submarine cables http://en.wikipedia.org/wiki/File:1901_Eastern_Telegraph_cables.png M.Roughan (UoA) Hitch Hikers Guide June 4, 2015 6 / 31 Electricity grid M.Roughan (UoA) Hitch Hikers Guide June 4, 2015 7 / 31 Bus network (Adelaide CBD) M.Roughan (UoA) Hitch Hikers Guide June 4, 2015 8 / 31 French Rail http://www.alleuroperail.com/europe-map-railways.htm M.Roughan (UoA) Hitch Hikers Guide June 4, 2015 9 / 31 Protocol relationships M.Roughan (UoA) Hitch Hikers Guide June 4, 2015 10 / 31 Food web M.Roughan (UoA) Hitch Hikers
    [Show full text]
  • Cocircuits of Vector Matroids
    RICE UNIVERSITY Cocircuits of Vector Matroids by John David Arellano A THESIS SUBMITTED IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE Master of Arts APPROVED, THESIS COMMITTEE: ?~ Ill::f;Cks, Chair Associate Professor of Computational and Applied Mathematics ~~~~ Richard A. Tapia Maxfield-Oshman Professor of Engineering University Professor of Computational and Applied Mathematics Wotao Yin Assistant Professor of Computational and Applied Mathematics Houston, Texas August, 2011 ABSTRACT Cocircuits of Vector Matroids by John David Arellano In this thesis, I present a set covering problem (SCP) formulation of the matroid cogirth problem, finding the cardinality of the smallest cocircuit of a matroid. Ad­ dressing the matroid cogirth problem can lead to significantly enhancing the design process of sensor networks. The solution to the matroid cogirth problem provides the degree of redundancy of the corresponding sensor network, and allows for the evalu­ ation of the quality of the network. I provide an introduction to matroids, and their relation to the degree of redundancy problem. I also discuss existing methods devel­ oped to solve the matroid cogirth problem and the SCP. Computational results are provided to validate a branch-and-cut algorithm that addresses the SCP formulation. Acknowledgments I would like to thank my parents and family for the love and support throughout my graduate career. I would like to thank my advisor, Dr. Illya Hicks, and the rest of my committee for their guidance and support. I would also like to thank Dr. Maria Cristina Villalobos for her guidance and support during my undergraduate career. A thanks also goes to Nabor Reyna, Dr.
    [Show full text]
  • 9 the Graph Data Model
    CHAPTER 9 ✦ ✦ ✦ ✦ The Graph Data Model A graph is, in a sense, nothing more than a binary relation. However, it has a powerful visualization as a set of points (called nodes) connected by lines (called edges) or by arrows (called arcs). In this regard, the graph is a generalization of the tree data model that we studied in Chapter 5. Like trees, graphs come in several forms: directed/undirected, and labeled/unlabeled. Also like trees, graphs are useful in a wide spectrum of problems such as com- puting distances, finding circularities in relationships, and determining connectiv- ities. We have already seen graphs used to represent the structure of programs in Chapter 2. Graphs were used in Chapter 7 to represent binary relations and to illustrate certain properties of relations, like commutativity. We shall see graphs used to represent automata in Chapter 10 and to represent electronic circuits in Chapter 13. Several other important applications of graphs are discussed in this chapter. ✦ ✦ ✦ ✦ 9.1 What This Chapter Is About The main topics of this chapter are ✦ The definitions concerning directed and undirected graphs (Sections 9.2 and 9.10). ✦ The two principal data structures for representing graphs: adjacency lists and adjacency matrices (Section 9.3). ✦ An algorithm and data structure for finding the connected components of an undirected graph (Section 9.4). ✦ A technique for finding minimal spanning trees (Section 9.5). ✦ A useful technique for exploring graphs, called “depth-first search” (Section 9.6). 451 452 THE GRAPH DATA MODEL ✦ Applications of depth-first search to test whether a directed graph has a cycle, to find a topological order for acyclic graphs, and to determine whether there is a path from one node to another (Section 9.7).
    [Show full text]
  • Introducing Hypergraph Signal Processing: Theoretical Foundation and Practical Applications Songyang Zhang, Zhi Ding , Fellow, IEEE, and Shuguang Cui , Fellow, IEEE
    IEEE INTERNET OF THINGS JOURNAL, VOL. 7, NO. 1, JANUARY 2020 639 Introducing Hypergraph Signal Processing: Theoretical Foundation and Practical Applications Songyang Zhang, Zhi Ding , Fellow, IEEE, and Shuguang Cui , Fellow, IEEE Abstract—Signal processing over graphs has recently attracted be modeled as nodes while the physical interconnections or significant attention for dealing with the structured data. Normal social relationships among users are represented as edges [3]. graphs, however, only model pairwise relationships between Taking an advantage of graph models in characterizing the nodes and are not effective in representing and capturing some high-order relationships of data samples, which are common complex data structures, graph signal processing (GSP) has in many applications, such as Internet of Things (IoT). In this emerged as an exciting and promising new tool for processing article, we propose a new framework of hypergraph signal pro- the large data sets with complex structures. A typical appli- cessing (HGSP) based on the tensor representation to generalize cation of GSP is in image processing, where image pixels the traditional graph signal processing (GSP) to tackle high- are modeled as graph signals embedding in nodes while pair- order interactions. We introduce the core concepts of HGSP and define the hypergraph Fourier space. We then study the spec- wise similarities between pixels are captured by edges [6]. trum properties of hypergraph Fourier transform (HGFT) and By modeling the images using graphs, tasks, such as image explain its connection to mainstream digital signal processing. We segmentation can take advantage of graph partition and GSP derive the novel hypergraph sampling theory and present the filters.
    [Show full text]