Arxiv:2101.00414V1 [Physics.Soc-Ph] 2 Jan 2021 2
Total Page:16
File Type:pdf, Size:1020Kb
Dynamic Hidden-Variable Network Models Harrison Hartle,1 Fragkiskos Papadopoulos,2 and Dmitri Krioukov1, 3 1Network Science Institute, Northeastern University, Boston, MA, USA 2Department of Electrical Engineering, Computer Engineering and Informatics, Cyprus University of Technology, 3036 Limassol, Cyprus 3Northeastern University, Departments of Physics, Mathematics, and Electrical&Computer Engineering, Boston, MA, USA Models of complex networks often incorporate node-intrinsic properties abstracted as hidden variables. The probability of connections in the network is then a function of these variables. Real- world networks evolve over time, and many exhibit dynamics of node characteristics as well as of linking structure. Here we introduce and study natural temporal extensions of static hidden-variable network models with stochastic dynamics of hidden variables and links. The rates of the hidden variable dynamics and link dynamics are controlled by two parameters, and snapshots of networks in the dynamic models may or may not be equivalent to a static model, depending on the location in the parameter phase diagram. We quantify deviations from static-like behavior, and examine the level of structural persistence in the considered models. We explore temporal versions of popular static models with community structure, latent geometry, and degree-heterogeneity. We do not attempt to directly model real networks, but comment on interesting qualitative resemblances, discussing possible extensions, generalizations, and applications. I. INTRODUCTION without hidden variables. For example, hidden vari- ables underly network models incorporating realistic fea- Networks are ubiquitous in nature [1{9], and their tures such as community structure (stochastic block mod- study relies heavily on the mathematical and compu- els [20]), latent geometry (random geometric graphs tational analysis of simple models [10, 11], typically in [21]), and degree-heterogeneity (soft configuration mod- the form of random networks built according to some els [22]). stochastic rules. In many models, nodes are assigned However, such models do not capture the dynamics characteristics (such as fitnesses [12, 13] or spatial co- of node-characteristics, nor the impact thereof on net- ordinates in a physical [14] or latent space [15{17]), work structure. The influence of dynamic node-states on which in turn affect the network's structural forma- evolving link-structure has been investigated in the con- tion. Such models fall under the umbrella of hidden- text of adaptive networks [23{28], but in that case node- variables models [18], because they depend on internal states arise due to a highly complex feedback, interacting node-characteristics that are only implicitly expressed by with one another through co-evolving links. Such mod- the network structure, through effects on link-formation. els are more realistic and have interesting features, but Usually, hidden variables (HVs) are not externally spec- they do not directly explore the impact of dynamic node- ified as parameters { rather, their probability distribu- properties on dynamic network structure. tion is specified [12, 19], and they are sampled during There is a wide abundance of real-world examples of the network's formation. Two sources of randomness un- dynamic node-properties influencing dynamics of net- derly such networks: the random HVs of nodes, and the work structure, such as: random formation of edges given those HVs. In general, a) changing habits, interests, jobs, and other at- hidden-variables models are defined by the following pro- tributes of people in social networks [29], cedure: 1. A random hidden-variable configuration H is b) changing geospatial coordinates of organisms dur- drawn with probability density ρ(H) from a set of ing formation of social ties, group-memberships, possible hidden-variable configurations H. and pathogenic contact networks [30{34], arXiv:2101.00414v1 [physics.soc-ph] 2 Jan 2021 2. Graph G is then drawn with conditional probability c) changing phenotypic traits of species as they bio- P(GjH) from a set of possible graphs G. logically evolve in ecological networks [35, 36], As a result, the overall probability of sampling any par- d) changing marketing and administrative strategies ticular graph G 2 G is equal to of entities in economic networks [37, 38], Z e) changing demographic and infrastructural charac- P(G) = P(GjH)ρ(H)dH: (1) H teristics of cities in evolving highway and airport networks [39{41], Hidden-variables models, due to their capacity to en- code nodewise heterogeneity, are in many cases capa- f) changing gene-expression levels of neurons in devel- ble of exhibiting more structural realism than models oping connectomes [42, 43], 2 g) changing consumption-levels of residential nodes in graphs [21], soft configuration models [22], and hyper- evolving power grids [44, 45], bolic graphs [15]. These examples relate to, and par- tially encompass, several models of networks with dy- h) changing displayed content of websites on the namic node-properties that have been previously studied evolving world-wide web [46, 47]. { for instance dynamic latent space models [74{77], dy- These examples motivate the development of a simple namic random geometric graphs [78, 79], and dynamic modeling framework describing the impact of dynamic stochastic block models [72, 73]. The framework we study node-characteristics on dynamic link-structure. Such a is also widely generalizable to other contexts. framework would provide a temporal analogue of how Our study takes a step towards realistic modeling of node-properties influence network structure in hidden- dynamic networks with dynamic node properties. It in- variables models. In fact, it is standard practice to derive troduces a family of temporal network models that ex- temporal versions of static-network concepts [48{66], as tends static hidden-variables models to the temporal set- has been done for several models of static networks with ting, providing theoretical insight into the kinds of struc- hidden variables such as stochastic block models [67{73]. ture that can emerge as a consequence of the influence of Motivated by these considerations, here we study tem- hidden-variable dynamics on network-structure dynam- poral extensions of general static hidden-variables mod- ics. The framework can be used for studying real-world els, obtained by introducing dynamics of hidden variables temporal networks under the null hypothesis that physi- and of links. In these models each node has an evolv- cal or latent dynamic hidden variables drive the dynam- ing hidden variable, and each node-pair has a pairwise ics of network structure. Additionally, motivated by the affinity (equal to the connection probability in the static phenomenology emerging in these models, we speculate hidden-variables model), which is a function of the hid- that links in some real systems are out of equilibrium with den variables of both nodes. Pairwise affinities evolve respect to hidden-variables, partially explaining the pres- over time due to their dependence on a pair of evolving ence of long-ranged links in geometrically-embedded sys- hidden variables. The network itself evolves via node- tems and inter-group connectivity in modular systems. pairs being selected to re-evaluate their connections, re- In SectionII, we describe the properties that we use to sampling them with connection probability equal to the characterize the models we introduce. We then introduce pair's affinity at the moment of re-evaluation. These sys- the static and temporal hidden-variables model families tems are governed by just two parameters beyond those in Section III, followed by various limiting regimes in Sec- of any static model: a rate of hidden-variable dynamics tionIV. SectionV provides several examples illustrating σ, and a rate of link-resampling !. temporal hidden-variables models. We then consider a We find that these models have snapshots that are sta- variant of the family of models in SectionVI, incorpo- tistically equivalent to networks generated from the static rating an additional dynamic mechanism that enforces model in the following cases: static-model connection probabilities. The final sections are dedicated to descriptions of related work (Section a) if there is a sufficient timescale separation VII) and a discussion of our results and the implications (slow hidden-variable-dynamics relative to link- thereof (Section VIII). Appendices provide the details of dynamics), several calculations and procedures left out of the main text. b) if connectivity is a deterministic function of hidden variables, c) if hidden variables are held fixed, or II. DESIRED PROPERTIES OF DYNAMIC HIDDEN-VARIABLES MODELS d) if we add an additional dynamic mechanism whereby links actively respond to changes in hidden variables. This section outlines the properties that we use to char- acterize the family of dynamic hidden-variables models We also identify the conditions under which model net- that we introduce. Our goal is to construct natural tem- works evolve gradually, i.e., exhibit link-persistence, and poral versions of static networks with hidden variables, evaluate qualitative resemblances of snapshots to some and to understand the consequences of having introduced real networks which arise as deviations from static-model such dynamics. Our approach is via a Markov chain on behavior. We obtain analytical and numerical results graphs and hidden-variable configurations, with sources for effective