G5 Brain Networks and Topology
General references for this lecture are the books of Fornito, Zalesky and Bullmore (Fundamentals of Brain Network Analysis), Sporns (Networks of the Brain and Discovering the Human Connectome), Chung and Lu (Complex Graphs and Networks) and Lovász (Large Networks and Graph Limits); full details are in the references at the end.
Graphs
Definition G5.1 (Graphs). A graph
- a set
of vertices (nodes); - a set
of edges (connections); - a boundary map
giving the boundary vertices of each edge, .
A directed graph (a graph with oriented edges) has source and target maps
A looping edge is an edge with
A graph can carry additional data: label functions
The slides show a gallery of twelve small named graphs: the
Network graphs
Large real-world networks are graphs too. The slides show an example from Facebook: about ten hub vertices, each joined to a large fan of vertices that have no other connections, with the hubs linked to each other (and to one very large central hub) by a sparser set of edges; the vertices are colored by type.
Increasing randomness
Watts and Strogatz (1998) interpolate between a regular graph and a random graph. Start from a regular ring lattice, in which each vertex is joined to its nearest neighbors on each side. With probability
Brain networks
Macroscopic scale: brain areas
At the macroscopic scale the vertices of a brain network are brain areas. The first figure shows how such a network is built. (A) Edges come from diffusion tensor imaging (DTI, an MRI technique that measures the diffusion of water along nerve fibers) and tractography (the reconstruction of fiber tracts from it). (B) Nodes come from a structural parcellation of an MRI scan into anatomical regions. (C) Together these give a structural network drawn on the brain, and (D) its connectivity matrix. (E) Network characteristics are then computed, as global or local measures: clustering coefficient (low or high clustering), path length (short or long), small-worldness (from regular to random), efficiency (inefficient or efficient) and modularity (fewer or more modules). (F) Another characteristic is the rich club: a set of high-degree nodes densely connected to each other, with rich-club connections between them, feeder connections from rich-club to non-rich-club nodes, and local connections among the others.
A second figure, from van den Heuvel and Sporns (2011), shows the same pipeline for a group of subjects: DTI data and a parcellation of a T1 anatomical (structural MRI) scan give an individual anatomical network for each subject; this gives individual connectivity matrices
Microscopic scale: individual neurons
At the microscopic scale the vertices are individual neurons. The slides show a rendering of the largest mapped network of individual cortical neurons as of 2016 (Clay Reid, Allen Institute; Wei-Chung Lee, Harvard Medical School; Sam Ingersoll, graphic artist): a dense tangle of neurites with the cell bodies shown as small spheres.
Modeling brain networks with graphs
Several features of brain networks have to be built into the graph model:
- Spatial embeddings: embedded graphs
, with their knotting and linking, and topological invariants of embedded graphs. - Vertex labels (heterogeneity of node types): distinguishing different kinds of neurons or different areas.
- Edge labels (heterogeneity of edge types).
- Orientations (directionality of connections): directed graphs.
- Weights (connection strengths).
- Dynamical changes of the network topology.
Connectivity and adjacency matrices
Definition G5.2 (Connectivity matrix). Let
The sign of
Definition G5.3 (Adjacency matrix). The adjacency matrix
If there are no parallel (oriented) edges, the graph
The slides illustrate this with EEG (electroencephalography, electrical recordings from sensors on the scalp). The EEG signals give an averaged matrix of couplings between the EEG sensors, which defines a weighted undirected network on the sensor positions over the head; thresholding this matrix gives a binary adjacency matrix and an unweighted undirected network. Either one describes the topology of the brain network.
Filtering the connectivity matrix
There are various methods for filtering the connectivity matrix, for example pruning weaker connections: keep only the entries above a threshold. The slides show brain networks of about 30, 190 and 650 nodes drawn inside the brain, each with its binary adjacency matrix below it.
Density, weight and degree
Definition G5.4 (Connection density and total weight). The connection density is
How connectivity varies across nodes is measured by the valence of vertices (node degree), and by the distribution of the values of the vertex valence over the graph. For example, most vertices may have few connections while a few hubs have many connections, as in airplane travel or math collaborations.
Definition G5.5 (In-degree and out-degree). The valence of a vertex is
Every edge has exactly one source and one target, so
Degree distributions
The degree distribution
Erdős–Rényi graphs
Definition G5.6 (Erdős–Rényi graphs). Erdős–Rényi graphs are random graphs generated by connecting vertices randomly, each pair with the same probability
For Erdős–Rényi graphs the degree distribution is binomial:
The slides show an Erdős–Rényi graph generated with
As
However, Erdős–Rényi graphs are not a good model for brain networks.
Scale-free networks
Definition G5.7 (Scale-free networks). A network is scale-free if its degree distribution follows a power law:
A power law decays more slowly than the binomial distribution: it has a fat tail, so highly connected nodes (large
(In this language, nodes are vertices, links are edges, and the number of links of a node is its valence.)
Broad scale networks
Broad scale networks form an intermediate class, more realistic as models of brain networks. Their degree distribution is an exponentially truncated power law
Weight distributions
For weighted vertices, with weights
- the geometry of the embedded graph, with distribution of interregional distances
Gaussian; - a distance-dependent cost of long-distance connections,
which together produce a drop in the probability of long-distance connections with strong weights.
Centrality
A node is more “central” to a network the more
- it is highly connected (large valence): degree;
- it is located on the shortest paths between other nodes: betweenness;
- it is close to a large number of other nodes (for example via highly connected neighbors): closeness.
The valence
In each of these four networks,
Perron–Frobenius centrality
Perron–Frobenius centrality is based on the version of the Perron–Frobenius theorem for non-negative matrices.
Definition G5.8. Let
is primitive if there is such that is positive. is irreducible if for all there is such that . (This implies that is primitive.)- The directed graph
has vertices and an edge from to iff . The matrix is irreducible iff is strongly connected: every vertex is reachable through an oriented path from every other vertex. - The period
is the greatest common divisor of the lengths of all closed directed paths in .
Theorem G5.9 (Perron–Frobenius theorem). Assume
and is an eigenvalue of (the Perron–Frobenius eigenvalue); it is simple.- There are a left eigenvector
and a right eigenvector for with all components positive (the Perron–Frobenius eigenvectors); these are the only eigenvectors with all positive components. - There are exactly
complex eigenvalues on the circle . - The spectrum is invariant under multiplication by
.
Now take
Definition G5.10 (Perron–Frobenius centrality). The PF centrality of a vertex
For an undirected graph
A vertex has high PF centrality if it has high degree (many neighbors), if its neighbors have high degree, or both. One can use either
PageRank centrality
PageRank centrality is the centrality used by Google.
Definition G5.11 (PageRank centrality). Let
This scales the contributions of the neighbors of node
Delta centrality
Delta centrality measures how much a topological property of the graph changes if a vertex is removed. For a graph
Definition G5.12 (Delta centrality). Let
Comparing centralities
The slides show the same network of a few hundred nodes colored by four centrality measures, from blue (low) to red (high): (A) betweenness, (B) closeness, (C) eigenvector (PF) and (D) degree. The measures pick out different nodes: betweenness is high at only a few nodes near the middle, closeness decreases smoothly from the middle of the network to its edges, eigenvector centrality is concentrated in one dense cluster at the lower right, and degree is highest in that same cluster and in a second dense cluster to its left.
A smaller example:
For this graph the slides compare degree, eigenvector, PageRank, closeness and betweenness centrality in bar charts, with the nodes in the order
Centrality in brain networks
Zuo, Ehmke, Mennes, Imperati, Castellanos, Sporns and Milham (Network Centrality in the Human Functional Connectome, 2012) mapped eigenvector centrality and PageRank centrality over the human cortex. The slides show their maps of both measures (as z-statistics) on the lateral and medial surfaces of the left and right hemispheres, together with a row of axial brain slices.
Connected components
What is the right notion of “connectedness” for a large graph? Small components breaking off should not matter, but large components becoming separated should. So the question is whether there is one large component.
For Erdős–Rényi graphs, the size of the largest component (with
- it increases sharply at
; - the graph tends to be connected for
; - for
the graph is fragmented: many connected components of comparable (small) size; - for
one giant component emerges; other components of smaller size still exist.
The slides show the emergence of connectedness in a random network on
Threshold for connectedness
The following argument is from Acemoglu and Ozdaglar’s lecture notes.
Definition G5.13 (Threshold function). Let
Proposition G5.14 (Threshold for connectedness).
Proof. Case
Case
The giant component
There are two phase transitions:
- at
the graph becomes connected; - at
one giant component emerges.
For the second, use a similar method, with threshold function
Case
The figure (from Acemoglu and Ozdaglar) compares the two processes. In the Erdős–Rényi graph process the number of new neighbors of vertex
Case
However, the branching process
Robustness to lesions
Remove a vertex
Core and periphery
Definition G5.15 (Core, periphery, cliques).
- The core is a subset of vertices highly connected to each other (hubs).
- The periphery consists of nodes connected to core vertices but not to each other.
- Maximal cliques are maximally connected subsets of nodes.
Definition G5.16 (k-core decomposition). For the
The slides show the
Paths and the flow of information
Consider the topology and flow of information along directed graphs. Networks are compared through their path length (which is close to minimal in a random graph). The path length between two vertices is the minimum number of oriented edges, or the minimum total weight of these edges, needed to go from one to the other.
Definition G5.17 (Walks, trails, paths).
- A walk is a sequence of oriented edges in which the target of each edge is the source of the next; revisiting vertices and edges is allowed.
- A trail is the same, but with no edge repetitions (edges are visited only once).
- A path has no edge repetitions and no vertex repetitions (both vertices and edges are visited only once).
Warning: terminology varies in the literature.
Shortest paths are geodesics, with the edge weights as metric. To average the path length over all shortest paths in the graph: at each vertex
The main idea is that brain networks with the shortest average path length integrate information better.
In a graph with several connected components, for
The graph Laplacian
The graph Laplacian measures the flow of information in a graph.
Definition G5.18 (Graph Laplacian). Let
Here
Dynamics on networks
In brain networks there are fast dynamics, on a timescale of about 100 milliseconds: variability in the functional coupling of neurons and brain regions, with the underlying functional anatomy unchanged. There are also slow dynamics: long-lasting changes in neuron interactions due to plasticity, growth and rewiring.
Types of dynamics include diffusion processes, random walks, synchronization, information flow and energy flow. The topology of the graph plays a role in the spontaneous emergence of global (collective) dynamical states. In multiscale dynamics, the dynamics at one scale is influenced by the states and dynamics at larger and smaller scales. A mean field model describes the dynamics at a scale by averaging over the effects at all smaller scales.
Consider the synchronization of a system of coupled oscillators at the vertices, with coupling along the edges.
- If the graph is very regular (for example a lattice), synchronized states are difficult to achieve.
- Small-world networks are easier to synchronize.
- Fully random graphs synchronize more easily, but the synchronized state is also very easily disrupted: it is difficult to maintain synchronization.
- More complex types of behavior occur with non-identical oscillators (different weights at different vertices) and in the presence of noise.
- It is still an open question what role the topology of the graph, and changes in it, play in supporting self-organized criticality.
Expander graphs
We return to expander graphs. Heuristically, an expander graph
- Spectral property: as for Ramanujan graphs, if
is a matrix associated to , then is contained in the spectrum of the analogous operator on the covering tree. - Pseudo-random behavior:
behaves in some sense like a random graph. - Information is passed easily through the network.
- Random walk: a random walker on the graph gets lost quickly.
- Boundary: every subset of the vertices that is not “too large” has a “large” boundary.
There are different ways of formalizing these: edge expanders, vertex expanders, spectral expanders. How can one detect a good expander property? Via other data, especially spectral data and the zeta function.
Expansion constant
For sets of vertices
Definition G5.19 (Expansion constant). The expansion constant of a graph
This is the analog of the Cheeger constant for differentiable manifolds. It is related to the spectral gap (Chung). Let
There are various other Cheeger-type inequalities in terms of spectral data, and a similar notion of edge expansion.
Bipartite expanders and codes
An expander graph has a large expansion parameter and low degree. Of particular interest are bipartite expander graphs.
Definition G5.20 (
Bipartite expander graphs are good for constructing codes with good error-correcting properties: the number of errors corrected is
Expander graphs in neuroscience
The following is work of Rishidev Chaudhuri and Ila Fiete on bipartite expander Hopfield networks. Hopfield networks are models for neural memory: stored states are recovered from noisy or partial input. The slides show a small network in which a partial input pattern (some neurons active, one missing) evolves under the network dynamics into the stored memory, where the missing neuron has switched on. The good error-correcting properties of expander bipartite graphs carry over to these networks.
In their model the stable states of the Hopfield network are determined by sparse constraints with expander structure. The figure shows four constraint nodes, each a small subnetwork of neurons, linked through a bipartite graph to a row of eight neurons, some of them active.
This gives a model of neural codes with higher-order correlations (which give better coding properties), unlike a neural code with many neurons that are rarely activated and pairwise decorrelated. The figure shows a large population with sparse transient activation linked through a bipartite expander graph to a dense stable coding core.
Quantum chaos
The basic idea
Classical (continuous) dynamical systems show regular and chaotic behavior. The slides illustrate this with billiards (a point bouncing around inside a region). In integrable billiards (a disk, a rectangle, an ellipse) the motion is regular: in the disk a trajectory stays tangent to an inner circle, and in the ellipse it fills a region bounded by curves. In chaotic billiards (a square with a circular obstacle, a stadium, a rounded region with an inward cusp) the motion is irregular and a trajectory fills the whole region.
Next consider the properties of the Schrödinger equation associated to a chaotic classical system. The slides show a trajectory in a chaotic billiard next to a plot of a quantum eigenfunction on the same region (pictures by Arnd Bäcker).
- The spectral properties are related to the counting of periodic orbits of the chaotic classical system, and to Random Matrix Theory (the statistics of eigenvalues of large random matrices).
- The quantum versions of classical integrable systems have a Poisson distribution of eigenvalues.
- The quantum versions of chaotic classical systems follow the eigenvalue distribution of Random Matrix Theory (Dyson’s circular ensemble).
Quantum chaos on graphs
The main references are Kottos and Smilansky, Periodic orbit theory and spectral statistics for quantum graphs (Annals of Physics 274, 1999), and Smilansky, Quantum chaos on discrete graphs (J. Phys. A 40, 2007). In summary:
- one distinguishes quantum (metric) graphs from discrete graphs;
- the spectral statistics of the Schrödinger operator on quantum graphs are similar to those of Random Matrix Theory (which describes generic quantum Hamiltonians);
- there is a similarity with chaotic Hamiltonian dynamical systems: a similar trace formula describes spectral densities in terms of sums over periodic orbits;
- the zeta function of a Perron–Frobenius operator on the graph has the same expression in terms of periodic orbits (like the Ruelle dynamical zeta function for Hamiltonian dynamical systems);
- for discrete graphs, the spectral properties come from the Ihara zeta function.
Quantum graphs
Here is a quick overview of the quantum graph case. The Schrödinger equation on quantum graphs is good for modeling traveling waves in networks. Assign to each oriented edge
The spectrum is given by the zeros of
Discrete graphs
For discrete graphs:
- the Laplacian
of the discrete graph is built from the (weighted) connectivity matrix and the diagonal matrix of vertex valencies; - there are zeta functions and trace formulae for discrete graphs;
- the eigenvalues of the graph Laplacian are related to the nontrivial poles of the Ihara zeta function of the graph;
- again the zeta function is related to the counting of periodic orbits of a subshift of finite type.
Zeta functions of graphs
This part follows Audrey Terras, Zeta functions and Chaos (A Window Into Zeta and Modular Physics, MSRI Publications 57, 2010).
The model zeta function is the Riemann zeta function
Another model example is the Selberg zeta function
Paths on graphs and “primes”
Start from an undirected graph and assign arbitrary orientations to its edges. For an oriented edge
Definition G5.21 (Backtracking, tails, primes). Let
has a backtrack if for some . has a tail if .- The equivalence class of a closed path
consists of all its cyclic permutations: , and so on. - A closed path is primitive if it has no backtracking and
for any path and . - The primes of the graph are the equivalence classes of tail-less primitive closed paths.
Ihara zeta function
Definition G5.22 (Ihara zeta function). The Ihara zeta function of a graph
Theorem G5.23 (Bass determinant formula).
is the rank of the fundamental group ; is the vertex adjacency matrix: the matrix whose -entry is the number of directed edges from to ; is the diagonal matrix with -th entry .
Example G5.24. For the tetrahedron graph
Vertices of valence one are not good for the zeta function, because of tails (loops and multiple edges are fine).
Riemann hypothesis for the Ihara zeta function
The following is due to Lubotzky, Phillips and Sarnak. Consider
Definition G5.25 (Ihara Riemann Hypothesis). A
For a graph, this is equivalent to being a Ramanujan graph: the nontrivial spectrum of the adjacency matrix of the graph (the eigenvalues other than
Pole locations for regular graphs
Using the determinant formula for the Ihara zeta function, one finds the possible locations of the poles for a
- The poles on the circle
are those that satisfy the Riemann Hypothesis. - Nontrivial poles (
) on the other lines (the real segments) are non-RH poles. - For a
-regular graph, is always the closest pole to . - Alon conjecture: the Riemann Hypothesis is approximately true for most regular graphs (and asymptotically 27% of regular graphs satisfy it exactly).
Spectra of random real symmetric matrices
The statistics of the spectra of random real symmetric matrices behave similarly to the statistics of the imaginary parts of
Beyond the regular case
Let
Definition G5.26 (Ihara Riemann Hypothesis for irregular graphs). A graph
In the irregular case there is no good functional equation for the Ihara zeta function. Writing
Ruelle zeta function
Consider a dynamical system given by the iterates of a map
Definition G5.27 (Ruelle zeta function). The Ruelle zeta function is
This is a generalization of the Artin–Mazur zeta function
Subshifts of finite type
Definition G5.28 (Subshift of finite type of a graph).
- The alphabet
is the set of directed edges of a graph (each edge with both orientations). - The transition matrix
, with entries in , is the edge adjacency matrix. - The admissible words are the sequences
with for all ; they are the (infinite) paths in without backtracking. - The shift map
maps to .
On the admissible words,
Matrices associated to graphs
To a graph one associates:
- the vertex adjacency matrix
; - the graph Laplacian
, with the diagonal matrix of degrees of the vertices; - the edge adjacency matrix
: the matrix (counting edges and their inverses) whose entry is if feeds into , that is, and .
Theorem G5.29 (Hashimoto determinant formula). With
Theorem G5.30 (Kotani–Sunada). Let
Spacing of Ihara poles
The slides compare two histograms of spacings between Ihara poles: for a Euclidean graph (a Cayley graph of an abelian group, whose vertices are the group elements, with each element joined to its products with a fixed set of generators) and for a random regular graph. The Euclidean case looks like a Poisson distribution: the histogram is highest at spacing
Spectral properties of the edge adjacency matrix
Theorem G5.31 (Girko circle law). The eigenvalues of a set of random
The edge adjacency matrix
By the Kotani–Sunada theorem, the spectrum of
- A random graph with
vertices, mean degree and edge probability . The green circle is the RH circle; most eigenvalues lie in a thin band just inside it, between a smaller inner circle and a larger outer one. - A random cover of the graph made of two loops with one extra vertex on one loop: a graph mapping onto it as a local isomorphism with
sheets (each vertex of the base has preimages), each sheet a copy of a spanning tree. The eigenvalues fill an annular region with cusps at the top and bottom, between the green circle and an inner circle. - An abelian covering of the same graph, with Galois group
. Here the eigenvalues line up along regular curves, and the spacing histogram is far from the Wigner-type (green) curve.
Detecting expander properties
The last slide uses these tools to detect poor or good expander properties. It shows three graphs, each made of several dense clusters joined through a central vertex, with the histogram of degrees of each graph below it, and below that the poles of each graph’s Ihara zeta function together with the green RH circle and the outer and inner Kotani–Sunada circles.
References
- Alex Fornito, Andrew Zalesky, Edward Bullmore, Fundamentals of Brain Network Analysis, Elsevier, 2016.
- Olaf Sporns, Networks of the Brain, MIT Press, 2010.
- Olaf Sporns, Discovering the Human Connectome, MIT Press, 2012.
- Fan Chung, Linyuan Lu, Complex Graphs and Networks, American Mathematical Society, 2004.
- László Lovász, Large Networks and Graph Limits, American Mathematical Society, 2012.
- Watts and Strogatz (1998), small-world networks (rewiring model).
- van den Heuvel and Sporns (2011), group-averaged structural brain network (figure).
- Clay Reid (Allen Institute), Wei-Chung Lee (Harvard Medical School), Sam Ingersoll (graphic artist), largest mapped network of individual cortical neurons, 2016 (image).
- X. N. Zuo, R. Ehmke, M. Mennes, D. Imperati, F. X. Castellanos, O. Sporns, M. P. Milham, Network Centrality in the Human Functional Connectome, Cerebral Cortex 22 (2012), no. 8, 1862–1875.
- Daron Acemoglu, Asu Ozdaglar, Lecture Notes on Networks.
- P. Hagmann, L. Cammoun, X. Gigandet, R. Meuli, C. J. Honey, V. J. Wedeen, O. Sporns, “Mapping the Structural Core of Human Cerebral Cortex”, PLoS Biology, 2008.
- Rishidev Chaudhuri, Ila Fiete, work on bipartite expander Hopfield networks.
- Arnd Bäcker, pictures of billiards and eigenfunctions, http://www.physik.tu-dresden.de/~baecker/.
- Tsampikos Kottos, Uzy Smilansky, Periodic orbit theory and spectral statistics for quantum graphs, Annals of Physics 274 (1999) 76–124.
- Uzy Smilansky, Quantum chaos on discrete graphs, J. Phys. A 40 (2007), no. 27, F621–F630.
- Audrey Terras, Zeta functions and Chaos, in A Window Into Zeta and Modular Physics, MSRI Publications 57, 2010.
- Also cited by name: Chung (Cheeger inequality and spectral gap); Lubotzky, Phillips and Sarnak (Ramanujan graphs); Bass, Hashimoto and Kotani–Sunada (Ihara zeta function); Alon (conjecture); Girko (circle law).