S. D. V. Stephens

notes / Basic Neuroscience and Geometry of Neuroscience / chapter 7: Neurons and Neural Codes

G3 The Neuron as a Dynamical System

This is Lecture 2 of Geometry of Neuroscience (Ma 191b, Caltech, Winter 2026), “Neurons and the Brain: The Neuron as a Dynamical System”. It has two parts:

  1. Neurons and the brain: a quick neuroscience overview.
  2. Individual neurons as nonlinear dynamical systems.

The reference for the first part is Liqun Luo’s Principles of Neurobiology. The references for the second part are Hoppensteadt’s An Introduction to the Mathematics of Neurons, Izhikevich’s Dynamical Systems in Neuroscience and Pesin–Climenhaga’s Lectures on Fractal Geometry and Dynamical Systems, with Ermentrout–Terman’s Mathematical Foundations of Neuroscience and the paper of Kostova, Ravindran and Schonbek on the FitzHugh–Nagumo model as additional reading. Full details are in the references at the end.

Part 1: Neurons and the brain

Brains of different animals

Nervous systems come in very different sizes. The slides show a photograph of each animal (and of a mouse brain and a human brain) next to these facts:

Animal Neurons Remarks
Jellyfish 5600 The simplest form of brain, a “nerve net”; used for sensation, feeding and locomotion. The box jellyfish has 24 eyes.
Worm (C. elegans) 302 (sensory, motor and interneurons) Its 7000 connections are completely mapped, which allows a full understanding of simple circuits (e.g. the response to touch).
Insect (Drosophila) 100,000 Displays sophisticated social and cognitive behaviors (memory, spatial navigation).
Fish (zebrafish) 100,000 Transparent in the larval stage, so every single neuron can be imaged during behavior. Interesting behaviors: prey capture, sleep.
Mouse about 70 million Shares many of the same features as the human brain, both anatomically and functionally.
Human 100 billion Each hemisphere is the size of an extra large pizza; there are 4 km of axons per mm³.

Expansion of the neocortex

A slide on the expansion of the neocortex collects several images: a Nissl-stained section of cortex showing its layers I–VI; a reconstruction, based on the fossil record, of the brain of an early mammal from 85 million years ago (olfactory bulb, piriform cortex, rhinal sulcus, a small neocortex, superior colliculus, cerebellum; scale bar 1 cm); coronal sections of a mouse brain and a human brain, the human one with a much larger and folded cortex; sections of a normal mouse brain next to that of a mouse expressing β-catenin in neuroepithelial progenitors, whose cortex is enlarged and folded; and MRI images of “double cortex”.

The neocortex is the six-layered structure that forms part of the cerebral cortex. It is involved in higher-order brain functions: sensory perception, cognition, spatial reasoning and language. The slide shows a classical drawing of the layers (molecular layer, layer of small pyramidal cells, layer of large pyramidal cells, layer of polymorphous cells, with the fiber bands: plexus of Exner, band of Bechterew, outer band of Baillarger or band of Gennari, inner band of Baillarger, deep tangential fibers, and the white medullary substance below), together with a picture of the human neocortex divided into lobes. The lobes and their functions:

  • frontal lobe: attention, short-term memory, planning, motivation;
  • parietal lobe: integrating sensory information, spatial sense, navigation;
  • occipital lobe: vision;
  • temporal lobe: smell and sound, semantics for speech and vision, processing of complex stimuli, forming of long-term memory.

Columnar structure. The cortex is composed of discrete, modular columns of neurons, characterized by a consistent connectivity profile. The basic units are minicolumns, with the same types of neurons and the same connectivity; these combine into modules, the hypercolumns. The slide shows a 3D reconstruction of five columns in rat vibrissal cortex, with layers 1 to 6 between the pial surface and the white matter (underlying image from Marcel Oberlaender, Beyond the Cortical Column, Neuroinformatics 2012), and a schematic of an array of cortical columns (layers L1, L2/3, L4, L5, L6) with a neuron’s dendrites and axon inside a column and its position in a section of the brain.

Organization of the central nervous system

Two labelled drawings show the organization of the central nervous system. A midsagittal section shows the corpus callosum, cingulate gyrus, fornix, anterior and posterior commissures, pineal gland, the diencephalon (thalamus and hypothalamus) with the hypothalamic sulcus, the midbrain, the cerebral aqueduct, the fourth ventricle and the cerebellum. A horizontal section shows the corpus callosum (genu and splenium), septum pellucidum, the anterior horn of the lateral ventricle, head and tail of the caudate nucleus, the internal capsule (anterior limb, genu, posterior limb), the foramen of Monro, putamen, globus pallidus, third ventricle, thalamus, amygdala, hippocampus and fornix.

The neuron

Definition G3.1 (Neurons and glia). Neurons are the nerve cells that send and receive signals. Glia are support cells: they provide structure in the brain, maintain homeostasis, provide insulation by forming myelin (oligodendrocytes), provide nutrients (astrocytes), etc.

The slide’s picture shows a neuron (dendrites, axons) next to an astrocyte and an oligodendrocyte, two types of glial cell. Neurons come in many shapes; the next picture shows three types, with dendrites in blue and axons in red: a pyramidal cell (apical dendrite, basal dendrites, cell body, and an axon going to distant targets via the white matter), a basket cell (cell body and a spread of axon terminals) and a motor neuron (cell body, wide dendritic tree, and an axon going to muscle).

Signaling between neurons and circuit motifs

A neuron receives signals on its dendrites, at synapses with the axon tips of previous neurons; an electrical signal travels from the cell body along the axon to the axon tips, which form synapses on the dendrites of the next neuron.

Neurons are wired into a small number of recurring circuit motifs, drawn below with excitatory neurons in green, inhibitory neurons in red, excitatory connections ending in a triangle and inhibitory connections ending in a dot:

  • A. Feedforward excitation: a chain of excitatory neurons, each exciting the next.
  • B. Feedforward inhibition: an excitatory neuron excites an inhibitory neuron, which inhibits the next excitatory neuron.
  • C. Convergence/divergence: several neurons converge onto one neuron, which in turn diverges onto several neurons.
  • D. Lateral inhibition: a neuron excites inhibitory neurons that inhibit its neighbours.
  • E. Feedback/recurrent inhibition: in E1 a neuron excites a second neuron, which excites an inhibitory neuron that inhibits the first; in E2 four inhibitory neurons form a ring, each inhibiting the next.
  • F. Feedback/recurrent excitation: in F1 the downstream neuron excites the neuron that excites it; in F2 a neuron receiving input excites itself (a) and is part of an excitatory loop (b).
Six neural circuit motifs drawn with green excitatory and red inhibitory neurons: feedforward excitation, feedforward inhibition, convergence and divergence, lateral inhibition, feedback inhibition (a three-neuron loop and a ring of four inhibitory neurons) and feedback excitation (a two-neuron loop and a neuron with a self-connection inside an excitatory loop).

Hierarchical organization of the brain

The brain is organized hierarchically. The slide shows three images. The first is a stained section of somatosensory cortex (S1) with layers L2/3 and L4 marked. The second is a schematic of the anatomical features of cortico-cortical connections that Felleman and Van Essen (1991) used to assign hierarchical relationships between visual cortical areas: forward (ascending) connections terminate in layer 4 and originate either from superficial layers or from both superficial and deep layers; feedback (descending) connections terminate outside layer 4 and originate either from deep layers or from both superficial and deep layers; lateral connections terminate in all layers. The third is Felleman and Van Essen’s hierarchy of visual areas, from the retinal ganglion cells (RGC) and LGN through V1, V2, V3, V4, MT, MST and the parietal and inferotemporal areas up to the entorhinal cortex (ER) and hippocampus (HC).

The fruitfulness of “following the anatomy”

Three examples show what has been learned by following the anatomy:

  • Hubel and Wiesel: orientation selectivity. A neuron in visual cortex fires strongly for a bar at one orientation and weakly for others; its response (spikes per second) as a function of stimulus orientation is a bell-shaped tuning curve.
  • Edvard and May-Britt Moser: grid cells. The spikes of a place cell, plotted over the path of an animal exploring an enclosure, cluster in one place; those of a grid cell form a regular grid of firing fields.
  • Michael Fee: sparse HVC neurons. During a zebra finch’s song motif (syllables a, b, c, d, shown in a spectrogram), each projection neuron of the song nucleus HVC fires a single brief burst (a few ms) at one moment of the song.

If one wants to understand function in biology, one should study structure. (Francis Crick)

Synaptic transmission

At the level of single neurons, signaling between neurons happens by synaptic transmission. The slide’s figure walks through the steps at a chemical synapse, where a myelinated axon ends on a dendrite:

  1. Transmitter is synthesized and then stored in vesicles.
  2. An action potential invades the presynaptic terminal.
  3. Depolarization of the presynaptic terminal causes the opening of voltage-gated Ca²⁺ channels.
  4. Ca²⁺ flows in through the channels.
  5. Ca²⁺ causes vesicles to fuse with the presynaptic membrane.
  6. Transmitter is released into the synaptic cleft via exocytosis.
  7. Transmitter binds to receptor molecules in the postsynaptic membrane.
  8. Postsynaptic channels open or close.
  9. The postsynaptic current causes an excitatory or inhibitory postsynaptic potential that changes the excitability of the postsynaptic cell.
  10. Vesicular membrane is retrieved from the plasma membrane.

Calcium influx is necessary for neurotransmitter release. In the experiment on the slide, the presynaptic neuron is voltage-clamped (its potential is imposed and the current measured) while the postsynaptic membrane potential is recorded. In the control, a 3 ms step of the presynaptic potential from about mV to about mV produces an inward presynaptic calcium current and a postsynaptic depolarization from about mV to about mV. With a Ca²⁺ channel blocker the calcium current disappears and there is no postsynaptic response. Release therefore depends on voltage-gated calcium channels.

Resting potential and action potential

At rest, ion concentrations differ across the membrane. The slide’s figure gives K⁺ at 4 mM outside and 120 mM inside, Na⁺ at 150 mM outside and 15 mM inside, Cl⁻ at 120 mM outside and 5 mM inside; the inside of the membrane is negatively charged relative to the outside. These gradients are maintained by the Na⁺–K⁺ ATPase, which uses one ATP (giving ADP and Pᵢ) to pump 3 Na⁺ out and 2 K⁺ in, and by the K⁺–Cl⁻ cotransporter. A second picture shows K⁺ diffusing out through potassium channels, Na⁺ diffusing in through sodium channels, and the Na⁺/K⁺ pump.

Each ion has a reversal potential, at which the diffusion potential exactly counterbalances the electrical potential: where and are the concentrations of the ion outside and inside, is its valence, is the gas constant, the temperature and Faraday’s constant.

The action potential is the spike in membrane potential that a neuron fires. After a stimulus, the membrane potential rises from the resting state ( mV); if it does not reach the threshold (about mV) the initiation fails and the potential falls back. Once the threshold is crossed, the membrane depolarizes rapidly up to about mV, then repolarizes, overshooting below the resting potential during the refractory period before returning to rest; the whole event takes about 2 ms.

Schematic action potential: voltage in millivolts against time in milliseconds, rising from a resting state of -70 mV past a threshold of -55 mV to a peak of +40 mV, then repolarizing and undershooting during the refractory period, with two small failed initiations that stay below threshold.

The slide’s accompanying pictures show the membrane at rest (Na⁺ at high concentration outside, K⁺ at high concentration inside, outside positive) and during the action potential (Na⁺ entering the cell, so that the charges across the membrane are locally reversed), and a neuron along whose axon this region of reversed charge travels from the cell body towards the axon terminals: the propagation of the action potential.

Part 2: The neuron as a nonlinear dynamical system

Modeling the neuron

Modeling the neuron is an interplay of electrophysiology, the bifurcation mechanisms of dynamical systems, and the computational properties of neurons. A neuron can be described

  • in terms of ions and channels,
  • in terms of input/output relations,
  • as a nonlinear dynamical system.

From the third point of view, a neuron is a dynamical system near a transition (a bifurcation) between resting and spiking activity. The idea is to deduce computational properties of neurons from the geometry of the phase portrait at the bifurcations of the nonlinear dynamical system.

Properties of neurons

  • There are about neurons in the human brain.
  • Neurons can transmit electric signals over long distances.
  • A neuron can receive input from as many as other neurons through synapses.
  • Neurons are organized in neuronal circuits.
  • Spikes are the main means of communication between neurons.
  • Neurons have a firing threshold.

The Hodgkin–Huxley model

The Hodgkin–Huxley model is based on the giant axon of the squid. The slide’s figure (from Eckert, Animal Physiology, W. H. Freeman, 2000, Fig. 5-21) shows the squid with its stellate ganglion and the stellate nerve containing the giant axon; the experimental setup, with a stimulus electrode, a recording electrode and a reference electrode on the axon connected to an amplifier; and the recorded membrane potential, which jumps from mV to about mV and back within about 2 ms.

Deriving the Hodgkin–Huxley equation

Definition G3.2 (Membrane potential). Every cell has a membrane potential the difference between the electric potential inside and outside the cell membrane. The resting potential is the potential across the membrane when the cell is at rest; for a typical neuron it is about mV.

Sodium and potassium channels are of two kinds: non-gated channels, which are always open, and voltage-gated channels, which open or close depending on conditions on the membrane potential.

  • An inward current consists of positively charged ions entering the cell, such as Na⁺. It raises the membrane potential: the membrane is depolarized.
  • An outward current consists of positively charged ions leaving the cell, such as K⁺, or negatively charged ions entering the cell, such as Cl⁻. It lowers the membrane potential: the membrane is hyperpolarized.

First step: the Nernst–Planck equation

The Nernst–Planck equation describes the general flux of an ion driven by electrical and concentration gradients across a membrane. Let be the concentration of some ion and the potential at a point of the membrane. Two effects contribute to the flux.

  • Diffusion, from high to low concentration. The diffusive flux is where the diffusion constant depends on the size of the molecules.
  • Electrical drift. The electric field is , and with the mobility of the ion the drift flux is

The total flux across the membrane is . At equilibrium ; the condition that the corresponding current flux vanishes is the Nernst–Planck equation. Its solution uses the Einstein relation between the mobility and the diffusion coefficient, where is Boltzmann’s constant, the temperature and the charge of the ion.

Proposition G3.3 (Nernst equilibrium potential). At equilibrium, the potential difference between two points is

Proof. The condition reads , that is, . Integrating, , so By the Einstein relation , which gives the formula. ∎

Remark. Taking inside and outside the membrane, this says , which is the reversal potential seen earlier, since for an ion of charge .

Away from equilibrium, the Nernst–Planck equation for the flux, with diffusion parameter , is

The Hodgkin–Huxley circuit

The Nernst–Planck equation does not explain the mechanism through which channels open and close. To model the dynamics of action potentials, Hodgkin and Huxley added voltage-gated conductance variables. The membrane is modelled as an electrical circuit: between the extracellular and intracellular sides, a capacitor (the membrane) sits in parallel with one branch for each ionic current. Each branch has a conductance in series with a battery whose voltage is the reversal potential of that ion; the sodium and potassium conductances are variable (voltage-gated), while the chloride and leak conductances are fixed.

Hodgkin-Huxley equivalent circuit of the membrane: between the extracellular and intracellular sides, parallel branches for sodium, potassium, chloride and leak currents, each a conductance in series with a battery for the reversal potential (sodium and potassium conductances variable), in parallel with the membrane capacitance.

Conservation of current in this circuit gives If denotes the fraction of open channels for ion , it evolves by where and are the voltage-dependent rates at which closed channels open and open channels close.

The Hodgkin–Huxley equations

In the Hodgkin–Huxley model of the giant squid axon there are three currents:

  • a persistent voltage-gated K⁺ current, with four activation gates;
  • a transient voltage-gated Na⁺ current, with three activation gates;
  • a leak current (Cl⁻).

The activation variables are the probabilities that an activation gate is open, and the inactivation variable is the probability that the inactivation gate is open.

Definition G3.4 (Hodgkin–Huxley equations). where is the reversal potential of each ion, the potential at which there is no net flow of that ion across the membrane.

Propagation of the action potential

To follow the action potential along the axon, let depend on the position along the axon as well. Then where is the radius of the axon, the resistance of the axoplasm, and the currents are as above, each of the gate-model form (here the exponents count gates, as in for sodium and for potassium).

The nonlinearities are in the rate functions and : These are Hodgkin and Huxley’s original empirical fits (rates in ms⁻¹), in which is measured in mV as the displacement of the membrane potential from its resting value, with depolarization counted as negative. The equations are then treated numerically.

Injected current as a bifurcation parameter

The injected current acts as a bifurcation parameter. Plotting for increasing (the slide gives in nanoamps) shows, in turn: no firing; firing of a single spike; and a cycle with a train of spikes. Between these regimes the amplitude of the response jumps suddenly, with no gradual increase: a bifurcation phenomenon.

Three simulated voltage traces of the Hodgkin-Huxley model over 50 ms: for injected current -3 the potential settles near -68 mV without firing, for 5 it fires one spike and returns to rest through damped oscillations, for 10 it fires a periodic train of spikes.

The traces drawn here are computed from the standard Hodgkin–Huxley parameters, starting at rest ( mV in the modern convention), with a current density in µA/cm²: for the potential just settles at a slightly lower level, for the neuron fires one spike and then returns to rest through damped oscillations, and for it fires periodically.

Remark (Linearization and the center manifold). The linearization of the Hodgkin–Huxley system at its fixed point (in the spiking regime) has two negative eigenvalues and two complex eigenvalues with small positive real part. The components along the eigenvectors of the negative eigenvalues decay to zero for large . The eigenvectors of the complex eigenvalues define the center manifold: solutions of the 4-dimensional system flow towards the center manifold, a 2-dimensional plane, and the limit cycle lies in the center manifold plane.

The Hodgkin-Huxley limit cycle for injected current 10, projected to the plane of voltage (from -75 to +30 mV) and the potassium activation variable n (from about 0.39 to 0.75), traversed counterclockwise around the unstable equilibrium near -60 mV.

The figure shows the limit cycle for , projected to the -plane, as on the slide. (For the parameters used here the eigenvalues of the linearization at the equilibrium are approximately , and , as described in the remark.)

The FitzHugh–Nagumo model

The FitzHugh–Nagumo model (1961) is a simplified version of the Hodgkin–Huxley dynamics. The neuron receives signals along its dendrites (the dendritic tree), processes them in the soma, and sends a single output along the axon; the slide’s picture shows the soma, the dendrites, the initial segment (axon hillock), the axon with its myelin sheath, and the terminals (endings, “buttons”).

The voltage difference at one location in the axon affects the time evolution of the voltage differences at nearby locations, so the action potential propagates along the length of the axon. One therefore models

  • the time evolution of the action potential at a given site on the axon, and
  • the diffusion of the action potential along the axon.

Heuristics: damped oscillators

Here is a heuristic for the form of the equation. Let be the action potential at a particular site on the axon.

Definition G3.5 (Damped harmonic oscillator). The (linear) damped harmonic oscillator is where the constant measures how strongly the oscillations are damped. In first order form,

A more refined model is a nonlinear damped harmonic oscillator, in which the constant is replaced by a function of .

Definition G3.6 (Van der Pol equation). The van der Pol equation (which comes from electrical circuits) is In first order form, since the first equation gives .

For small the damping coefficient is negative, so small oscillations grow, while for large they are damped; the solutions settle onto a periodic relaxation oscillation, shown here for , .

A solution u(t) of the van der Pol equation with zeta = 5 and c = 1 for t from 10 to 50: a relaxation oscillation of period about 11.6 that drifts slowly from 2 towards 1 and from -2 towards -1 and jumps quickly between the two levels.

The FitzHugh–Nagumo model is based on a version of the nonlinear damped harmonic oscillator, a more general form of the van der Pol equation.

The FitzHugh–Nagumo equations

Definition G3.7 (Bonhoeffer–van der Pol oscillator). The Bonhoeffer–van der Pol nonlinear damped harmonic oscillator is with parameters to be set empirically and an external forcing term .

Definition G3.8 (FitzHugh–Nagumo equation). The FitzHugh–Nagumo equation is where is the cubic polynomial

This only models the action potential in time at a fixed site, with no varying spatial dimension. To include dependence on a spatial coordinate, let : This form is used for the propagation of signals (traveling waves) in excitable media.

Discrete modeling: a coupled map lattice

For numerical simulations one discretizes the FitzHugh–Nagumo equation. Fix an increment and replace

  • the time derivative by ,
  • the second space derivative by .

Writing , this gives a finite difference equation, here without external forcing: with coefficients and the diffusion term (from the second space derivative) The empirical assumptions on the parameters are: small, near , and near one.

Definition G3.9 (Coupled map lattice). A discrete system of this type is a coupled map lattice:

  • are only defined on a discrete set, the lattice ;
  • each time step is modelled by a local map , here
  • the local maps at the different sites are coupled together by interaction terms like .

Coupled map lattices are a useful method for studying PDEs. The main problem is controlling the error term, which can grow rapidly after a number of iterations.

Fixed points of the local map

We now study the local map

Proposition G3.10 (Fixed points of the local map). The origin is a fixed point for all values of the parameters. Let For the origin is the only fixed point; for there is one additional fixed point; for there are the origin and two more fixed points.

Proof. The fixed-point equations are and , that is, Besides , the (real) solutions of the second equation are the roots of , namely The discriminant is nonnegative if and only if ; it vanishes for , giving one additional fixed point, and is positive for , giving two. ∎

So the behavior of the equation changes at the threshold .

Stability of fixed points

The Jacobian matrix describes the linear approximation of in a neighbourhood of a point: where the error term (the nonlinearities) is small when is sufficiently near . At a fixed point of a nonlinear map with linearization , the stability properties of the fixed point are determined by the eigenvalues of the linearization.

Proposition G3.11 (Fixed points in the plane). Let be a fixed point of whose linearization has eigenvalues not on the unit circle. Then is

  • an attractive fixed point if ;
  • a saddle point if ;
  • a repelling fixed point if .

The slide’s table summarizes the behavior near a fixed point of a two-dimensional discrete dynamical system according to the eigenvalues of the linearization:

Eigenvalues Stable () Lyapunov stable () Unstable ()
Real stable point: , neutral point: , , or saddle point: , ; unstable point: ,
Complex conjugate stable spiral focus: neutral center: unstable spiral focus:

Its sketches show orbits moving in along both eigendirections at a stable point, in along one and out along the other at a saddle, out along both at an unstable point, spiralling in or out at a focus, and circling at a neutral center.

Linearization of the FitzHugh–Nagumo map

The Jacobian of the local map is and its eigenvalues at a fixed point give the stability of that fixed point. If are sufficiently small, the eigenvalues are approximately and the value of at the fixed point.

Proposition G3.12 (Stability of the origin). At the fixed point the eigenvalues are close to and , and for . Hence, for :

  • for , the origin is an attracting fixed point;
  • for , the origin is a saddle point.

Moreover , so when the stability of changes there are already two more fixed points.

To find the stability at the other fixed points, approximate both their location and the value of there. From the first fixed-point equation, the fixed points lie on the cubic and they are the points of intersection of this cubic curve with the line . If is very small compared with , the line is almost horizontal, and the fixed points are approximately the intersections of the cubic with , namely , and .

Proposition G3.13 (Stability of the other fixed points).

  • At the eigenvalues of are approximately and . Since , the second eigenvalue has , so this is a saddle point for all .
  • At the eigenvalues of are approximately and . The second eigenvalue has when , so for this is an attractive fixed point, and for a saddle.
Schematic of the cubic v = -(A/alpha) u (u - theta)(u - 1) and the line v = beta u / (1 - gamma) meeting in three fixed points: the origin (stable), a first fixed point near (theta, 0) (saddle) and a second fixed point near (1, 0) (stable).

The figure above is a schematic of the cubic curve and the line (not to scale: for small the cubic is much taller and the line much flatter). The slides show the same geometry twice: once as two panels in a -plane, with the cubic, the line, the direction field (panel A) and trajectories that fall vertically onto the cubic and then move along it towards the outer fixed points (panel B); and once as a direction field with the cubic and a line through the origin meeting it in three points.

Cases. For there are three fixed points: the origin is stable, the first fixed point is a saddle, and the second is stable. The trajectory approaching the first fixed point is a separatrix between the basins of attraction of the origin and of the second fixed point.

As increases further:

  • At a value before (namely ) the second eigenvalue at the origin changes sign; this reverses the direction of the left/right motion of trajectories near the origin, which now jump from side to side.
  • A similar reversal happens at the second fixed point near .
  • If (that is, ), the origin changes behavior to a saddle before the second fixed point does.
  • In this range, what happens to the trajectories now leaving the origin in a near-horizontal direction? The first fixed point is also a saddle, repelling in the horizontal direction...
  • The linear approximation at the fixed points gives an incomplete picture: one must also look at the behavior of periodic orbits. The trajectories leaving the origin are attracted by a periodic orbit of period 2, , which appears around the origin when .

Definition G3.14 (Morse–Smale system). A Morse–Smale system is a dynamical system with finitely many periodic orbits (including fixed points), in which all orbits converge to a periodic orbit.

Period doubling and chaos

The period-doubling cascade

  • In the range of the parameter discussed above, the FitzHugh–Nagumo model is a Morse–Smale dynamical system.
  • When the parameter is increased beyond , the orbit of order 2 stops being attractive, and two further points of order 4 appear near each (now unstable) point of order 2: a new attractive orbit of period 4.
  • This is a cascade of period doubling: the period 4 orbit becomes unstable, giving rise to a stable period 8 orbit, and so on, with the stable orbit of period becoming unstable and a new stable orbit of period emerging from the bifurcation.
  • Numerical estimates indicate that the bifurcation values of the parameter converge to a value as .
  • The dynamical system is Morse–Smale in the range .
  • In fact there are two sequences of such periodic orbits: one around , to the left of the stable curve through the first fixed point , and one around the second fixed point , to the right of the stable curve through the first fixed point.

Constructing bifurcation diagrams

  1. Fix a value of the parameter and an initial condition (near the origin).
  2. Compute a sufficiently large number of iterates.
  3. Plot the resulting positions .
  4. Repeat for other values of .
  5. Repeat the whole process for other initial conditions (near the second fixed point, and near the other fixed points where one expects to find a period-doubling cascade).

Typically one such bifurcation diagram (near one of the fixed points involved) looks like the picture on the slide: as the parameter increases, a single branch of fixed points splits into two branches (period 2), each of which splits again (period 4, then 8, …) at parameter values that come closer and closer together, after which the points fill out bands (chaos), interrupted by thin windows of periodic behavior.

Cascade bifurcations and chaos theory

What happens in these diagrams beyond the period-doubling series, for ? One sees a much more complicated behavior, and periodic orbits of periods other than ; one also finds orbits that are dense in a Cantor set and do not approach a periodic orbit.

The period doublings have a universal behavior: where is the Feigenbaum constant, a universal constant.

Definition G3.15 (Sharkovsky’s ordering). Sharkovsky’s ordering of the natural numbers is Here denotes this ordering of , which differs from the usual one.

Theorem G3.16 (Sharkovsky’s theorem). If a continuous map has a periodic point of period , then it also has periodic points of every period with in Sharkovsky’s ordering.

Corollary G3.17. If a continuous map has only finitely many periodic orbits, then all their periods are powers of .

Remark. The result requires (the proof is based on the intermediate value theorem). It is not true for maps : for instance , for which every periodic orbit other than the fixed point has period .

Sharkovsky’s theorem is a very useful result for explaining period-doubling cascades, by reducing to a one-dimensional dynamics.

Theorem G3.18 (Period three implies chaos (Li–Yorke)). For a continuous map of the line, a periodic orbit of period three implies infinitely many periodic orbits, of arbitrary periods in , and sensitive dependence on initial conditions for orbits (which no longer necessarily converge to a periodic orbit).

This is the theorem of Tien-Yien Li and James A. Yorke, Period Three Implies Chaos, The American Mathematical Monthly 82 (1975), no. 10, 985–992. The typical behavior past , at the end of the period-doubling cascade, is a chaos region with arbitrary periodic orbits.

Bifurcation diagrams of the FitzHugh–Nagumo model

The slide shows the bifurcation diagram of the discrete FitzHugh–Nagumo model with , , and , as varies from 3 to 7. It is redrawn here from a direct computation with the same parameters, plotting the first coordinate of the iterates.

Computed bifurcation diagram of the discrete FitzHugh-Nagumo map with theta = 0.51, alpha = 0.01, beta = 0.02, gamma = 0.8, plotting u against A from 3 to 7: fixed points at u = 0 and u = 1 undergo period-doubling cascades starting near A = 3.92 and A = 4.08, turn into chaotic bands with periodic windows, and the two chaotic regions merge near A = 6.5.

For these values and : the branch at splits first, then the branch at . Each starts a cascade of period doublings ending in chaotic bands with periodic windows, and for near the two chaotic regions merge.

A second slide, taken from the article at http://iopscience.iop.org/article/10.1088/1367-2630/12/5/053040, shows a bifurcation diagram for the electric potential in a version of the FitzHugh–Nagumo model, plotting against a parameter ranging over : a period-doubling cascade of the maxima, then from about a chaotic region interrupted by periodic windows.

Trajectories of the continuous FitzHugh–Nagumo model

The same phenomena can be seen in the trajectories of the original continuous FitzHugh–Nagumo ODE. The slides show a sequence of phase portraits in the -plane.

  • With three fixed points (the origin), and : the fixed points and are stable and is unstable. Trajectories starting on either side of the stable curve of converge to or to .
  • For other parameter values, the fixed points and are stable, with an unstable periodic orbit around .
  • With an external forcing as well: a limit cycle appears through a Hopf bifurcation near , moves upward with increasing , and disappears in another Hopf bifurcation near . The slide shows the limit cycles for seven values of , labelled a to g: small cycles near the two Hopf bifurcations (a and g) and large relaxation cycles in between.
  • A sequence of orbits for values of : seventeen schematic phase portraits, labelled A to Q, show how the configuration of fixed points (, , , and in some panels two further points , ), the separatrices of the saddle and the periodic orbits changes as varies, from a panel (A) with a single fixed point surrounded by a spiralling orbit to a panel (Q) with a single fixed point surrounded by a spiralling orbit.

The resulting picture

The resulting picture of the model, in the phase plane of membrane potential and recovery variable , is built from two nullclines: the cubic , where , and the line , where . Their intersection is the resting state. A large enough perturbation from rest sends the trajectory on a long excursion around the cubic, which is the spike. The slide labels the regions of the phase plane with FitzHugh’s names: resting, quasi-threshold, self-excitatory, regenerative, active, absolutely refractory, relatively refractory, hyperpolarized, depolarized, and the “no man’s land” near the middle branch of the cubic.

Phase plane of the FitzHugh-Nagumo model with membrane potential u horizontally and recovery variable w vertically: the cubic nullcline w = u - u^3/3, the line w = (u + 0.7)/0.8, the resting state at their intersection, several trajectories with arrows, and FitzHugh's region labels (resting, quasi-threshold, self-excitatory, regenerative, active, absolutely refractory, relatively refractory, hyperpolarized, depolarized, no man's land).

The trajectories in this figure are computed for , with . Starting slightly to the left of the middle branch of the cubic, a trajectory returns to rest along the left branch; starting slightly to the right, it is carried over to the right branch (active), climbs it, jumps back across the top (absolutely refractory) and slides down the left branch (relatively refractory) to rest.

Further slides illustrate the same behavior:

  • A figure with two cases (labelled in Portuguese: polynomial nullcline, linear nullcline, orbit, time): in (a) an orbit started on the right makes one excursion around the cubic and then spirals into the fixed point where the two nullclines meet, and (b) the corresponding shows one spike followed by damped oscillations to rest; in (c), with the intersection of the nullclines moved slightly along the cubic, the orbit converges to a limit cycle around the fixed point, and (d) is a periodic train of spikes.
  • A “V–W plane plot” with the V-nullcline (the cubic), the W-nullcline (the line) and one trajectory, which starts at the origin, crosses to the right branch, climbs it, jumps across to the left branch and descends to the fixed point near the minimum of the cubic. Two vertical lines, near the two turning points of the cubic, divide the plane into Regions 1, 2 and 3. With an external forcing term one moves the cubic curve, and with it the intersections with the line.
  • Varying the external forcing. For small the line meets the cubic on its left branch, at a stable resting state. Increasing raises the cubic, until the intersection lies on the middle branch; the resting state becomes unstable and the neuron spikes. For a sequence of increasing the trajectories are a family of limit cycles (repetitive spiking), and for large the intersection moves onto the right branch, where it is stable again: the neuron stays depolarized and spiking is blocked. The slide’s inset traces read “resting”, “spiking”, “blocked”.

Conclusion

  • A single neuron is a complicated nonlinear dynamical system.
  • Spiking behavior arises from the bifurcation pattern, the stability properties of the equilibria (fixed points), and the occurrence of limit cycles.
  • Varying the parameters (the injected current and the parameter ) creates a pattern of bifurcations.
  • Bifurcation cascades and chaos are possible.

Later in the course we will deal with larger neuronal architectures, beyond the single-neuron case.

References

  • Liqun Luo, Principles of Neurobiology, Garland Science, 2016.
  • F. C. Hoppensteadt, An Introduction to the Mathematics of Neurons: Modeling in the Frequency Domain, Cambridge University Press, 1997.
  • Eugene M. Izhikevich, Dynamical Systems in Neuroscience, MIT Press, 2007.
  • Yakov Pesin, Vaughn Climenhaga, Lectures on Fractal Geometry and Dynamical Systems, American Mathematical Society, 2009.
  • G. Bard Ermentrout, David H. Terman, Mathematical Foundations of Neuroscience, Springer, 2010.
  • Tanya Kostova, Renuka Ravindran, Maria Schonbek, FitzHugh–Nagumo revisited: types of bifurcations, periodical forcing and stability regions by a Lyapunov functional, Internat. J. Bifur. Chaos Appl. Sci. Engrg. 14 (2004), no. 3, 913–925.
  • Tien-Yien Li, James A. Yorke, Period three implies chaos, The American Mathematical Monthly 82 (1975), no. 10, 985–992.
  • D. J. Felleman, D. C. Van Essen (1991), on the hierarchy of visual cortical areas (source of the hierarchy figure).
  • Marcel Oberlaender, Beyond the Cortical Column, Neuroinformatics 2012 (source of the cortical column reconstruction).
  • R. Eckert, Animal Physiology, W. H. Freeman and Co., New York, 2000, Fig. 5-21 (source of the squid giant axon figure).
  • New Journal of Physics 12 (2010), article 053040, http://iopscience.iop.org/article/10.1088/1367-2630/12/5/053040 (source of the FitzHugh–Nagumo bifurcation diagram for ).