Arxiv:2008.13503V1 [Nlin.CG] 31 Aug 2020 Istic Discrete Dynamical Systems Based on Their Asymptotic Computation Time with Increasing Space Size
Total Page:16
File Type:pdf, Size:1020Kb
Classification of Complex Systems Based on Transients Barbora Hudcova1;2 and Tomas Mikolov2 1Charles University, Prague 2Czech Institute of Informatics, Robotics and Cybernetics, CTU, Prague Abstract Introducing Cellular Automata Informally, a cellular automaton (CA) can be perceived as In order to develop systems capable of modeling artificial life, a k-dimensional grid consisting of identical finite state au- we need to identify, which systems can produce complex be- tomata. They are all updated synchronously in discrete time havior. We present a novel classification method applicable to steps based on an identical update function depending only any class of deterministic discrete space and time dynamical systems. The method distinguishes between different asymp- on the states of automata in their local neighborhood. A for- totic behaviors of a systems average computation time be- mal definition can be found in Kari (2005). fore entering a loop. When applied to elementary cellular au- CAs were first studied as models of self replicating struc- tomata, we obtain classification results, which correlate very tures (Neumann and Burks (1966), Langton (1984), Reggia well with Wolfram’s manual classification. Further, we use et al. (1993)). Subsequently, they were examined as dynam- it to classify 2D cellular automata to show that our technique can easily be applied to more complex models of computa- ical systems (Hedlund (1969), Vichniac (1984), Gutowitz tion. We believe this classification method can help to de- et al. (1987), Crutchfield and Young (1989)), or as mod- velop systems, in which complex structures emerge. els of computation (Toffoli (1977), Mitchell (1998)). Being so simple to simulate, yet capable of complex behavior and emergent phenomena (Crutchfield and Hanson (1993), Han- son (2009)), CAs provide a convenient tool to examine the Introduction key, yet undefined notions of complexity and emergence. There are many approaches to searching for systems capable Basic Notions of open-ended evolution. One option is to carefully design a model and observe its dynamics. Iconic examples were de- We study the simple class of elementary cellular automata signed by Ray (1991), Ofria and Wilke (2004), or Soros and (ECAs), which are one-dimensional CAs with two states Stanley (2014). However, as we lack any formal definition f0; 1g and neighborhood of size 3. We examine the case of open-endedness or complexity, there is no formal method of a finite cyclic grid of size n 2 N and denote each ECA by n n n of proving the system is indeed ”interesting”. Conversely, the tuple (f0; 1g ;F ) where F : f0; 1g ! f0; 1g is the lacking definitions of such key terms, it seems extremely global update rule. difficult to design such systems systematically. We identify each local rule f determining an ECA with the Wolfram number of the ECA defined as: Approaching the problem of searching for open- endedness bottom up, we define a classification of determin- 20f(0; 0; 0)+21f(0; 0; 1)+22f(0; 1; 0)+:::+27f(1; 1; 1): arXiv:2008.13503v1 [nlin.CG] 31 Aug 2020 istic discrete dynamical systems based on their asymptotic computation time with increasing space size. This method We will refer to each ECA as a ”rule k” where k is the cor- gives a surprisingly clear classification of the toy class of el- responding Wolfram number of its underlying local rule. ementary cellular automata, which seems to correspond well Given an ECA (f0; 1gn;F ) we define the trajectory of a to Wolfram’s established yet informal four types of cellular configuration u 2 f0; 1gn as the sequence automata dynamics. Subsequently, we use the classification to discover two-dimensional automata with emergent behav- (u; F (u);F 2(u);:::): ior. This demonstrates that the transient classification can be used to navigate us towards regions of interesting systems. The space-time diagram of such simulation is obtained by Even though we are far from giving sufficient conditions for plotting the configurations as a horizontal rows of black and complexity, we hope this method helps us understand, which white squares (corresponding to states 1 and 0) with vertical formally defined properties correlate with it. axis determining the time, which is progressing downwards. n As the set of all grid configurations f0; 1g is finite, ev- 0 10 20 30 40 0 10 20 30 40 0 0 ery trajectory (u0; u1 = F (u0); u2 = F (u1);:::) even- 5 5 tually becomes periodic. We call the preperiod of this se- 10 10 15 15 quence the transient of initial configuration u and denote its 20 20 length by t . More formally, we define t to be the small- 25 25 u u 30 30 est positive integer i, for which there exist j 2 N, j > i, 35 35 such that F i(u) = F j(u). The periodic part of the se- 40 40 0 50 100 150 200 0 50 100 150 200 quence is called an attractor. The phase space of an ECA 0 0 (f0; 1gn;F ) is a graph with vertices V = f0; 1gn and edges 50 50 E = f(u; F (u)); u 2 f0; 1gng. Such a graph is composed of components each containing one attractor and multiple 100 100 transient paths leading to the attractor. The phase space 150 150 completely characterizes the dynamics of the system, it is 200 200 however infeasible to describe it for large n. We note that properties of CA phase spaces were exam- Figure 1: Space-time diagrams of rules from each Wolfram’s ined among others by Wuensche and Lesser (2001). Pre- class. Class 1 rule 32 is on top left, Class 2 rule 108 on top cisely for this purpose, a software was designed by Wuen- right. Both are simulated for 40 time steps on a grid of size sche (2016). 50. At the bottom row we have Class 4 rule 110 on the left Cellular Automata Classifications and Class 3 rule 30 on the right. The two are simulated for 200 steps on a grid of size 250. Even though there are many interesting definitions of com- plexity (Chaitin (1966), Bennett (1988), McShea (1996)), 0 20 40 60 80 0 20 40 60 80 none of them seems to be perfectly suitable for studying 0 0 complex systems. A crucial result helping us understand the 10 10 20 20 notion of complexity in the context of dynamical systems 30 30 would be a suitable classification of CAs, which would nav- 40 40 igate us toward a region of CAs with complex behavior. An 50 50 ideal classification would be based on a rigorously defined 60 60 70 70 and easily measurable property. 80 80 In this section we describe three qualitatively different classifications of ECAs and subsequently, we will compare Figure 2: On the left, rule 126 is simulated with an initial our results to them. condition consisting of a single 1 bit padded with 0’s. On Wolfram’s Classification the right, the same rule is simulated with a random initial configuration. The most intuitive and simple approach to examining the dy- namics of CAs is to observe their space-time diagrams. This method was particularly proclaimed by Wolfram (2002). Zenil’s Classification Therein, he established an informal classification of CA dy- namics based on such diagrams. He distinguishes the fol- Zenil (2009) studied the compression size of the space-time lowing classes, which are shown in Figure 1. diagrams of each ECA simulated for a fixed amount of steps. Using a clustering technique, he obtained two classes Class 1 ::: quickly resolves to a homogenous state roughly distinguishing between Wolfram’s simple classes 1 and 2 and complex classes 3 and 4. We show our reproduc- Class 2 ::: exhibits simple periodic behavior tion of Zenil’s results in Figure 3. Class 3 ::: exhibits chaotic or random behavior His method nicely formalizes Wolfram’s observations of Class 4 ::: produces localized structures that interact the space-time diagrams. However, the results depend on the with each other in complicated ways choice of initial conditions as well as the grid size, data rep- resentation, and the compression algorithm. We conducted The main issue is that we have no formal method of classi- multiple experiments presented in Figure 4, which show that fying CAs in this way. Moreover, the behavior of some CAs Zenil’s results are very sensitive to the choice of such param- can vary with different initial configurations. An example eters. being rule 126, which oscillates between Class 2 and Class In vast CA spaces, where it is not feasible to examine ev- 3 behavior, as shown in Figure 2. The transient classification ery CA and mark it into one of Wolfram’s classes by hand, we present in this paper deals with both these issues. it would not be clear how the parameter values should be a given CA and a grid size n, we randomly sample initial 10000 configurations u 2 f0; 1gn and estimate the average tran- 8000 1 P sient length µn = 2n u2f0;1gn tu. Using regression, we 6000 1 estimate the asymptotic growth of the sequence (µn)n=1. 4000 Below, we motivate the study of this property. 2000 Compressed size in bytes In non-classical models of compuation (Stepney (2012)), 0 0 50 100 150 200 250 the process of traversing CA’s transients can be perceived as ECA Rules the process of self-organization, in which information can be aggregated in an irreversible manner. The attractors are Figure 3: Reproduction of Zenil’s results (Zenil (2009)). then viewed as memory storage units, from which the infor- The purple cluster corresponds to the interesting Class 3 and mation about the output can be extracted.