Semantic Community Identification in Large Attribute Networks

Total Page:16

File Type:pdf, Size:1020Kb

Semantic Community Identification in Large Attribute Networks Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence (AAAI-16) Semantic Community Identification in Large Attribute Networks Xiao Wang1,5,DiJin1, Xiaochun Cao2, Liang Yang2,3, Weixiong Zhang4,5 1School of Computer Science and Technology, Tianjin University, Tianjin 300072, China 2State Key Laboratory of Information Security, IIE, Chinese Academy of Sciences, Beijing 100093, China 3School of Information Engineering, Tianjin University of Commerce, Tianjin 300134, China 4College of Math and Computer Science, Institute for Systems Biology, Jianghan University, Wuhan, Hubei 430056, China 5Department of Computer Science and Engineering, Washington University in St. Louis, St. Louis, MO 63130, USA {wangxiao cv, jindi}@tju.edu.cn, {caoxiaochun, yangliang}@iie.ac.cn, [email protected] Abstract to be assigned correctly to the right communities by only re- Identification of modular or community structures of a net- lying on network topology. Therefore, it is insufficient to ac- work is a key to understanding the semantics and functions curately determine the community structure using network of the network. While many network community detection topology alone. In addition to network topology, semantic methods have been developed, which primarily explore net- information, e.g., that of node attributes, is often available. work topologies, they provide little semantic information of For example, a node (i.e., a person) in a social network is the communities discovered. Although structures and seman- often annotated by a personal profile with information such tics are closely related, little effort has been made to discover as education background, circle of friends and profession; and analyze these two essential network properties together. a node (i.e., a paper) in a citation network is typically an- By integrating network topology and semantic information notated with title, abstract and key words. Different from on nodes, e.g., node attributes, we study the problems of de- network topology, node semantics capture characteristics of tection of communities and inference of their semantics si- multaneously. We propose a novel nonnegative matrix factor- individual nodes and provide a piece of valuable informa- ization (NMF) model with two sets of parameters, the com- tion orthogonal to information of network topology. Integra- munity membership matrix and community attribute matrix, tion of network topological and semantic information holds and present efficient updating rules to evaluate the parameters a great potential for community identification. with a convergence guarantee. The use of node attributes im- Nevertheless, it is technically challenging to effectively proves upon community detection and provides a semantic in- combine these two pieces of valuable albeit orthogonal in- terpretation to the resultant network communities. Extensive experimental results on synthetic and real-world networks not formation. Particularly, two obstacles need to be addressed only show the superior performance of the new method over in order to properly integrate these two types of informa- the state-of-the-art approaches, but also demonstrate its abil- tion. First, how to adequately characterize a community. The ity to semantically annotate the communities. most existing methods for community detection mainly rely on network topologies. However, missing, meaningless or Introduction even erroneous edges are ubiquitous in real networks, which casts doubts on the accuracy and/or correctness of the net- Complex systems can be represented in networks or graphs. work communities discovered based on network topology One of the most prominent features of such networks is the alone. While the nodes in a community are highly con- community structure, where the nodes within a community nected, they should also have similar characteristics, re- are densely connected whereas nodes in different commu- flected by attributes. Thus, nodes attributes may carry es- nities are sparsely connected (Girvan and Newman 2002). sential information of communities that is complementary to Community structures help reveal organizational structures the information of network topology. Therefore, even though and functional components of a complex system. Therefore, two nodes are not directly connected, they may belong to the community detection is an essential step toward characteri- same community if they share the same characteristics, and zation of a complex system. the use of node attributes may enhance community discov- Network topology, an important network description, has ery. Second, how to adequately interpret or semantically an- been broadly exploited by the most existing methods for notate communities. Functional analysis of network commu- community detection. However, network topology reflects nities is typically and independent, post-processing task fol- merely one aspect of a network and is often noisy. As a re- lowing community detection. The result from a community sult, using network topology alone may not necessarily give discovery often provides little information beyond network rise to a satisfactory partition of a network. For instance, it topology regarding why a group of nodes from a commu- is not uncommon that two nodes that belong to the same nity, their semantic meaning, or potential functions. In order community are not directly connected, and a node connect- to semantically annotate a community, supplemental infor- ing to multiple communities for distinct reasons is difficult mation, e.g., background information and/or domain knowl- Copyright c 2016, Association for the Advancement of Artificial edge, is usually required. Even though such domain infor- Intelligence (www.aaai.org). All rights reserved. mation is available, how to fully utilize such information re- 265 mains challenging, application specific and time consuming. cial relations and user generated content in a social network To address the above two problems, we propose and de- (Pei, Chakraborty, and Sycara 2015). However, this method velop in this paper a method, named as Semantic Commu- focused on utilizing additional content information to detect nity Identification (SCI), to identify network communities communities, and failed to study the relationship between with semantic annotation. The SCI method integrates net- communities and these content. work topological and node semantic information; it com- bines topology based community memberships and node- SCI: The network model attribute based community attributes (or semantics) in the framework of nonnegative matrix factorization (NMF, (Se- Consider an undirected network G =(V,E) with n nodes V and e edges E, represented by a binary-valued adjacency ung and Lee 2001)). The key intuition behind SCI stems in n×n two observations: two nodes are likely to be connected if matrix A ∈ R . Associated with each node i are its at- their community memberships are similar, and two nodes tributes Si, which may be semantic characteristics of the likely belong to the same community if their attributes are node. The attributes of a node are in the form of an m- consistent with the underlying community attributes to be dimensional binary-valued vector, and the attributes of all the nodes can be represented by a node attribute matrix learned. To make the novel SCI method effective, we intro- n×m duce a sparsity penalty in order to select the most related at- S ∈ R . The problem of community identification is to tributes for each community and devise a multiplicative up- partition the network G into k communities as well as to dating rule with a convergence guarantee. Extensive exper- infer the related attributes or semantics of each community. iments on synthetic and real networks, in comparison with Modeling network topologies. We define the propensity several state-of-the-art methods, are performed to assess the of node i belonging to community j as Uij. The commu- performance of SCI. nity membership of all the nodes in the network is then U =(Uij), where i =1, 2, ..., n and j =1, 2, ..., k. Con- Related work sequently UirUpr presents the expected number of edges Several community detection methods, as reviewed in (Xie, between nodes i and p in community r. Summing over all communities, the expected number of edges between i and Kelley, and Szymanski 2013), have been developed to ex- k plore network topologies, including the well-known ones p is r=1 UirUpr. This process of generating edges implies based on nonnegative matrix factorization (NMF) (Wang et that if two nodes have similar community memberships, they al. 2011; Yang and Leskovec 2013) and stochastic block- have a high propensity to be linked. The expected number of model (SBM) (Karrer and Newman 2011). Among these edges between pairs of nodes should be as closely consistent methods are ones that combines network topologies and as possible with the network topology denoted by A, which node attributes (content or features). In particular, a uni- gives rise to the following function in matrix formulation: fied method was suggested to combine a conditional model T 2 min A − UU F . (1) for topology analysis and a discriminative model for mak- U≥0 ing use of node attributes (Yang et al. 2009). However, this method focuses on community detection without inferring Modeling node attributes. We define the propensity of the most relevant attributes for each community. Edge con- community r to have attribute q as Cqr. So for all the com- tent was also leveraged to improve community detection
Recommended publications
  • Network Topologies Topologies
    Network Topologies Topologies Logical Topologies A logical topology describes how the hosts access the medium and communicate on the network. The two most common types of logical topologies are broadcast and token passing. In a broadcast topology, a host broadcasts a message to all hosts on the same network segment. There is no order that hosts must follow to transmit data. Messages are sent on a First In, First Out (FIFO) basis. Token passing controls network access by passing an electronic token sequentially to each host. If a host wants to transmit data, the host adds the data and a destination address to the token, which is a specially-formatted frame. The token then travels to another host with the destination address. The destination host takes the data out of the frame. If a host has no data to send, the token is passed to another host. Physical Topologies A physical topology defines the way in which computers, printers, and other devices are connected to a network. The figure provides six physical topologies. Bus In a bus topology, each computer connects to a common cable. The cable connects one computer to the next, like a bus line going through a city. The cable has a small cap installed at the end called a terminator. The terminator prevents signals from bouncing back and causing network errors. Ring In a ring topology, hosts are connected in a physical ring or circle. Because the ring topology has no beginning or end, the cable is not terminated. A token travels around the ring stopping at each host.
    [Show full text]
  • Topological Optimisation of Artificial Neural Networks for Financial Asset
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by LSE Theses Online The London School of Economics and Political Science Topological Optimisation of Artificial Neural Networks for Financial Asset Forecasting Shiye (Shane) He A thesis submitted to the Department of Management of the London School of Economics for the degree of Doctor of Philosophy. April 2015, London 1 Declaration I certify that the thesis I have presented for examination for the MPhil/PhD degree of the London School of Economics and Political Science is solely my own work other than where I have clearly indicated that it is the work of others (in which case the extent of any work carried out jointly by me and any other person is clearly identified in it). The copyright of this thesis rests with the author. Quotation from it is permitted, provided that full acknowledgement is made. This thesis may not be reproduced without the prior written consent of the author. I warrant that this authorization does not, to the best of my belief, infringe the rights of any third party. 2 Abstract The classical Artificial Neural Network (ANN) has a complete feed-forward topology, which is useful in some contexts but is not suited to applications where both the inputs and targets have very low signal-to-noise ratios, e.g. financial forecasting problems. This is because this topology implies a very large number of parameters (i.e. the model contains too many degrees of freedom) that leads to over fitting of both signals and noise.
    [Show full text]
  • Networking Solutions for Connecting Bluetooth Low Energy Devices - a Comparison
    292 3 MATEC Web of Conferences , 0200 (2019) https://doi.org/10.1051/matecconf/201929202003 CSCC 2019 Networking solutions for connecting bluetooth low energy devices - a comparison 1,* 1 1 2 Mostafa Labib , Atef Ghalwash , Sarah Abdulkader , and Mohamed Elgazzar 1Faculty of Computers and Information, Helwan University, Egypt 2Vodafone Company, Egypt Abstract. The Bluetooth Low Energy (BLE) is an attractive solution for implementing low-cost, low power consumption, short-range wireless transmission technology and high flexibility wireless products,which working on standard coin-cell batteries for years. The original design of BLE is restricted to star topology networking, which limits network coverage and scalability. In contrast, other competing technologies like Wi-Fi and ZigBee overcome those constraints by supporting different topologies such as the tree and mesh network topologies. This paper presents a part of the researchers' efforts in designing solutions to enable BLE mesh networks and implements a tree network topology which is not supported in the standard BLE specifications. In addition, it discusses the advantages and drawbacks of the existing BLE network solutions. During analyzing the existing solutions, we highlight currently open issues such as flooding-based and routing-based solutions to allow end-to-end data transmission in a BLE mesh network and connecting BLE devices to the internet to support the Internet of Things (IoT). The approach proposed in this paper combines the default BLE star topology with the flooding based mesh topology to create a new hybrid network topology. The proposed approach can extend the network coverage without using any routing protocol. Keywords: Bluetooth Low Energy, Wireless Sensor Network, Industrial Wireless Mesh Network, BLE Mesh Network, Direct Acyclic Graph, Time Division Duplex, Time Division Multiple Access, Internet of Things.
    [Show full text]
  • Optimizing the Topology of Bluetooth Wireless Personal Area Networks Marco Ajmone Marsan, Carla F
    Optimizing the Topology of Bluetooth Wireless Personal Area Networks Marco Ajmone Marsan, Carla F. Chiasserini, Antonio Nucci, Giuliana Carello, Luigi De Giovanni Abstract— In this paper, we address the problem of determin- ing an optimal topology for Bluetooth Wireless Personal Area Networks (BT-WPANs). In BT-WPANs, multiple communication channels are available, thanks to the use of a frequency hopping technique. The way network nodes are grouped to share the same channel, and which nodes are selected to bridge traffic from a channel to another, has a significant impact on the capacity and the throughput of the system, as well as the nodes’ battery life- time. The determination of an optimal topology is thus extremely important; nevertheless, to the best of our knowledge, this prob- lem is tackled here for the first time. Our optimization approach is based on a model derived from constraints that are specific to the BT-WPAN technology, but the level of abstraction of the model is such that it can be related to the slave slave & bridge more general field of ad hoc networking. By using a min-max for- mulation, we find the optimal topology that provides full network master master & bridge connectivity, fulfills the traffic requirements and the constraints posed by the system specification, and minimizes the traffic load of Fig. 1. BT-WPAN topology. the most congested node in the network, or equivalently its energy consumption. Results show that a topology optimized for some traffic requirements is also remarkably robust to changes in the traffic pattern. Due to the problem complexity, the optimal so- Master and slaves send and receive traffic alternatively, so as lution is attained in a centralized manner.
    [Show full text]
  • A Framework for Wireless Broadband Network for Connecting the Unconnected
    A Framework for Wireless Broadband Network for Connecting the Unconnected Meghna Khaturia, Prasanna Chaporkar and Abhay Karandikar Department of Electrical Engineering, Indian Institute of Technology Bombay, Mumbai-400076 Email: fmeghnak,chaporkar,[email protected] Abstract—A significant barrier in providing affordable rural providing broadband in rural areas of India. Ashwini [6] broadband is to connect the rural and remote places to the optical and Aravind [7] are some other examples of rural network Point of Presence (PoP) over a distances of few kilometers. A testbeds deployed in India. Hop-Scotch is a long distance Wi- lot of work has been done in the area of long distance Wi- Fi networks. However, these networks require tall towers and Fi network based in UK [8]. LinkNet is a 52 node wireless high gain (directional) antennas. Also, they work in unlicensed network deployed in Zambia [9]. Also, there has been a band which has Effective Isotropically Radiated Power (EIRP) substantial research interest in designing the long distance Wi- limit (e.g. 1 W in India) which restricts the network design. In Fi based mesh networks for rural areas [10]–[12]. All these this work, we propose a Long Term Evolution-Advanced (LTE- efforts are based on IEEE 802.11 standard [13] in unlicensed A) network operating in TV UHF to connect the remote areas to the optical PoP. In India, around 100 MHz of TV UHF band i.e. 2:4 GHz or 5:8 GHz. When working with these band IV (470-585 MHz) is unused at any location and can frequency bands over a long distance point to point link, be put to an effective use in these areas [1].
    [Show full text]
  • Spectral Analysis of the Adjacency Matrix of Random Geometric Graphs
    Spectral Analysis of the Adjacency Matrix of Random Geometric Graphs Mounia Hamidouche?, Laura Cottatellucciy, Konstantin Avrachenkov ? Departement of Communication Systems, EURECOM, Campus SophiaTech, 06410 Biot, France y Department of Electrical, Electronics, and Communication Engineering, FAU, 51098 Erlangen, Germany Inria, 2004 Route des Lucioles, 06902 Valbonne, France [email protected], [email protected], [email protected]. Abstract—In this article, we analyze the limiting eigen- multivariate statistics of high-dimensional data. In this case, value distribution (LED) of random geometric graphs the coordinates of the nodes can represent the attributes of (RGGs). The RGG is constructed by uniformly distribut- the data. Then, the metric imposed by the RGG depicts the ing n nodes on the d-dimensional torus Td ≡ [0; 1]d and similarity between the data. connecting two nodes if their `p-distance, p 2 [1; 1] is at In this work, the RGG is constructed by considering a most rn. In particular, we study the LED of the adjacency finite set Xn of n nodes, x1; :::; xn; distributed uniformly and matrix of RGGs in the connectivity regime, in which independently on the d-dimensional torus Td ≡ [0; 1]d. We the average vertex degree scales as log (n) or faster, i.e., choose a torus instead of a cube in order to avoid boundary Ω (log(n)). In the connectivity regime and under some effects. Given a geographical distance, rn > 0, we form conditions on the radius rn, we show that the LED of a graph by connecting two nodes xi; xj 2 Xn if their `p- the adjacency matrix of RGGs converges to the LED of distance, p 2 [1; 1] is at most rn, i.e., kxi − xjkp ≤ rn, the adjacency matrix of a deterministic geometric graph where k:kp is the `p-metric defined as (DGG) with nodes in a grid as n goes to infinity.
    [Show full text]
  • Assortativity of Links in Directed Networks
    Assortativity of links in directed networks Mahendra Piraveenan1, Kon Shing Kenneth Chung1, and Shahadat Uddin1 1Centre for Complex Systems Research, Faculty of Engineering and IT, The University of Sydney, NSW 2006, Australia Abstract— Assortativity is the tendency in networks where many technological and biological networks are slightly nodes connect with other nodes similar to themselves. De- disassortative, while most social networks, predictably, tend gree assortativity can be quantified as a Pearson correlation. to be assortative in terms of degrees [3], [5]. Recent work However, it is insufficient to explain assortative or disassor- defined degree assortativity for directed networks in terms tative tendencies of individual links, which may be contrary of in-degrees and out-degrees, and showed that an ensemble to the overall tendency in the network. In this paper we of definitions are possible in this case [6], [7]. define and analyse link assortativity in the context of directed It could be argued, however, that the overall assortativity networks. Using synthesised and real world networks, we tendency of a network may not be reflected by individual show that the overall assortativity of a network may be due links of the network. For example, it is possible that in a to the number of assortative or disassortative links it has, social network, which is overall assortative, some people the strength of such links, or a combination of both factors, may maintain their ‘fan-clubs’. In this situation, people who which may be reinforcing or opposing each other. We also have a great number of friends may be connected to people show that in some directed networks, link assortativity can who are less famous, or even loners.
    [Show full text]
  • Wi-Fi® Mesh Networks: Discover New Wireless Paths
    Wi-Fi® mesh networks: Discover new wireless paths Victor Asovsky WiLink™ 8 System Engineer Yaniv Machani WiLink 8 Software Team Leader Texas Instruments Table of Contents Abstract ...................................................................................................1 Introduction .............................................................................................1 Mesh network use case .........................................................................2 General capabilities ...............................................................................2 Range extension use case .....................................................................3 AP offloading use case ..........................................................................3 Wi-Fi mesh key features ........................................................................4 Homogenous ........................................................................................4 Self-forming ...........................................................................................4 Dynamic path selection .........................................................................4 Self-healing ...........................................................................................5 Possible issues in mesh networking ......................................................6 WLAN mesh deployment considerations .............................................7 Number of hops ....................................................................................7
    [Show full text]
  • Spatial Analysis and Modeling of Urban Transportation Networks
    Spatial analysis and modeling of urban transportation networks Jingyi Lin Doctoral Thesis in Geodesy and Geoinformatics with Specialization in Geoinformatics Royal Institute of Technology Stockholm, Sweden, 2017 TRITA SoM 2017-15 ISRN KTH/SoM/2017-15/SE ISBN 978-91-7729-613-3 Doctoral Thesis Royal Institute of Technology (KTH) Department of Urban Planning and Environment Division of Geodesy and Geoinformatics SE-100 44 Stockholm Sweden © Jingyi Lin, 2017 Printed by US AB, Sweden 2017 Abstract Transport systems in general, and urban transportation systems in particular, are the backbone of a country or a city, therefore play an intrinsic role in the socio- economic development. There have been numerous studies on real transportation systems from multiple fileds, including geography, urban planning, and engineering. Geographers have extensively investigated transportation systems, and transport geography has developed as an important branch of geography with various studies on system structure, efficiency optimization, and flow distribution. However, the emergence of complex network theory provided a brand-new perspective for geographers and other researchers; therefore, it invoked more widespread interest in exploring transportation systems that present a typical node-link network structure. This trend inspires the author and, to a large extent, constitutes the motivation of this thesis. The overall objective of this thesis is to study and simulate the structure and dynamics of urban transportation systems, including aviation systems and ground transportation systems. More specificically, topological features, geometric properties, and dynamic evolution processes are explored and discussed in this thesis. To illustrate different construction mechanisms, as well as distinct evolving backgrounds of aviation systems and ground systems, China’s aviation network, U.S.
    [Show full text]
  • A Centrality Measure for Urban Networks Based on the Eigenvector Centrality Concept
    This is a repository copy of A Centrality Measure for Urban Networks Based on the Eigenvector Centrality Concept.. White Rose Research Online URL for this paper: https://eprints.whiterose.ac.uk/120372/ Version: Accepted Version Article: Agryzkov, Taras, Tortosa, Leandro, Vicent, Jose et al. (1 more author) (2017) A Centrality Measure for Urban Networks Based on the Eigenvector Centrality Concept. Environment and Planning B: Urban Analytics and City Science. ISSN 2399-8083 https://doi.org/10.1177/2399808317724444 Reuse Items deposited in White Rose Research Online are protected by copyright, with all rights reserved unless indicated otherwise. They may be downloaded and/or printed for private study, or other acts as permitted by national copyright laws. The publisher or other rights holders may allow further reproduction and re-use of the full text version. This is indicated by the licence information on the White Rose Research Online record for the item. Takedown If you consider content in White Rose Research Online to be in breach of UK law, please notify us by emailing [email protected] including the URL of the record and the reason for the withdrawal request. [email protected] https://eprints.whiterose.ac.uk/ Journal Title A Centrality Measure for Urban XX(X):1–15 c The Author(s) 2015 Reprints and permission: Networks Based on the Eigenvector sagepub.co.uk/journalsPermissions.nav DOI: 10.1177/ToBeAssigned Centrality Concept www.sagepub.com/ Taras Agryzkov1 Leandro Tortosa1 Jose´ F. Vicent1 and Richard Wilson2 Abstract A massive amount of information as geo-referenced data is now emerging from the digitization of contemporary cities.
    [Show full text]
  • Network Topologies
    Network Topologies Table of Contents Network Design and Architectures ................................................................................................. 2 Network Topology........................................................................................................................... 3 Bus ................................................................................................................................................... 7 Ring ................................................................................................................................................. 9 Bus ................................................................................................................................................. 11 Ring ............................................................................................................................................... 12 Dual-Ring ....................................................................................................................................... 13 Star ................................................................................................................................................ 14 Extended Star ................................................................................................................................ 16 Mesh ............................................................................................................................................. 18 Wireless ........................................................................................................................................
    [Show full text]
  • Transportation Network Analysis
    Transportation Network Analysis Volume I: Static and Dynamic Traffic Assignment Stephen D. Boyles Civil, Architectural, and Environmental Engineering The University of Texas at Austin Nicholas E. Lownes Civil and Environmental Engineering University of Connecticut Avinash Unnikrishnan Civil and Environmental Engineering Portland State University Version 0.8 (Public beta) Updated August 25, 2019 ii Preface This book is the product of ten years of teaching transportation network anal- ysis, at the The University of Texas at Austin, the University of Wyoming, the University Connecticut, and Portland State University. This version is being released as a public beta, with a final first edition hopefully to be released within a year. In particular, we aim to improve the quality of the figures, add some additional examples and exercises, and add historical and bibliographic notes to each chapter. A second volume, covering transit, freight, and logistics, is also under preparation. Any help you can offer to improve this text would be greatly appreciated, whether spotting typos, math or logic errors, inconsistent terminology, or any other suggestions about how the content can be better explained, better orga- nized, or better presented. We gratefully acknowledge the support of the National Science Foundation under Grants 1069141/1157294, 1254921, 1562109/1562291, 1636154, 1739964, and 1826230. Travis Waller (University of New South Wales) and Chris Tamp`ere (Katholieke Universiteit Leuven) hosted visits by the first author to their re- spective institutions, and provided wonderful work environments where much of this writing was done. Difficulty Scale for Exercises Inspired by Donald Knuth's The Art of Computer Programming, the exercises are marked with estimates of their difficulty.
    [Show full text]