Chapter 6: Starting from Randomness

Section 7: The Notion of Attractors

Entropies and dimensions [in cellular automata]

There are 2n sequences possible for n cells that are each either black or white. But as we have seen, in most cellular automata not all these sequences can occur except in the initial conditions. The number of sequences sn of length n that can actually occur is given by

Apply[Plus, Flatten[MatrixPower[m, n]]]

where the adjacency matrix m is given by

MapAt[(1 + #) &, Table[0, {Length[net]}, {Length[net]}], Flatten[MapIndexed[{First[#2], Last[#1]} &, net, {2}], 1]]

For rule 32, for example, sn turns out to be Fibonacci[n + 3], so that for large n it is approximately GoldenRation. For any rule, sn for large n will behave like κn, where κ is the largest eigenvalue of m. For rule 126 after 1 step, the characteristic polynomial for m is x3 - 2 x2 + x - 1, giving κ 1.755. After 2 steps, the polynomial is

x13 - 4 x12 + 6 x11 - 5 x10 + 3 x9 - 3 x8 + 5 x7 - 3 x6 - x5 + 4 x4 - 2 x3 + x2 - x + 1

giving κ 1.732. Note that κ is always an algebraic number—or strictly a so-called Perron number, obtained from a polynomial with leading coefficient 1. (Note that any possible Perron number can be obtained for example from some finite complement language.)

It is often convenient to fit sn for large n to the form 2h n, where h is the so-called spatial (topological) entropy (see page 1084), given by Log[2, κ]. The value of this for successive t never increases; for the first 3 steps in rule 126 it is for example approximately 1, 0.811, 0.793. The exact value of h after more steps tends to be very difficult to find, and indeed the question of whether its limiting value after infinitely many steps satisfies a given bound—say even being nonzero—is in general undecidable (see page 1138).

If one associates with each possible sequence of length n a number Sum[ai 2-i, {i, n}], then the set of sequences that actually occur at a given step form a Cantor set (see note below), whose Hausdorff dimension turns out to be exactly h.

Image Source Notebooks:

From Stephen Wolfram: A New Kind of Science [citation]