G3 The Neuron as a Dynamical System
This is Lecture 2 of Geometry of Neuroscience (Ma 191b, Caltech, Winter 2026), “Neurons and the Brain: The Neuron as a Dynamical System”. It has two parts:
- Neurons and the brain: a quick neuroscience overview.
- Individual neurons as nonlinear dynamical systems.
The reference for the first part is Liqun Luo’s Principles of Neurobiology. The references for the second part are Hoppensteadt’s An Introduction to the Mathematics of Neurons, Izhikevich’s Dynamical Systems in Neuroscience and Pesin–Climenhaga’s Lectures on Fractal Geometry and Dynamical Systems, with Ermentrout–Terman’s Mathematical Foundations of Neuroscience and the paper of Kostova, Ravindran and Schonbek on the FitzHugh–Nagumo model as additional reading. Full details are in the references at the end.
Part 1: Neurons and the brain
Brains of different animals
Nervous systems come in very different sizes. The slides show a photograph of each animal (and of a mouse brain and a human brain) next to these facts:
| Animal | Neurons | Remarks |
|---|---|---|
| Jellyfish | 5600 | The simplest form of brain, a “nerve net”; used for sensation, feeding and locomotion. The box jellyfish has 24 eyes. |
| Worm (C. elegans) | 302 (sensory, motor and interneurons) | Its 7000 connections are completely mapped, which allows a full understanding of simple circuits (e.g. the response to touch). |
| Insect (Drosophila) | 100,000 | Displays sophisticated social and cognitive behaviors (memory, spatial navigation). |
| Fish (zebrafish) | 100,000 | Transparent in the larval stage, so every single neuron can be imaged during behavior. Interesting behaviors: prey capture, sleep. |
| Mouse | about 70 million | Shares many of the same features as the human brain, both anatomically and functionally. |
| Human | 100 billion | Each hemisphere is the size of an extra large pizza; there are 4 km of axons per mm³. |
Expansion of the neocortex
A slide on the expansion of the neocortex collects several images: a Nissl-stained section of cortex showing its layers I–VI; a reconstruction, based on the fossil record, of the brain of an early mammal from 85 million years ago (olfactory bulb, piriform cortex, rhinal sulcus, a small neocortex, superior colliculus, cerebellum; scale bar 1 cm); coronal sections of a mouse brain and a human brain, the human one with a much larger and folded cortex; sections of a normal mouse brain next to that of a mouse expressing β-catenin in neuroepithelial progenitors, whose cortex is enlarged and folded; and MRI images of “double cortex”.
The neocortex is the six-layered structure that forms part of the cerebral cortex. It is involved in higher-order brain functions: sensory perception, cognition, spatial reasoning and language. The slide shows a classical drawing of the layers (molecular layer, layer of small pyramidal cells, layer of large pyramidal cells, layer of polymorphous cells, with the fiber bands: plexus of Exner, band of Bechterew, outer band of Baillarger or band of Gennari, inner band of Baillarger, deep tangential fibers, and the white medullary substance below), together with a picture of the human neocortex divided into lobes. The lobes and their functions:
- frontal lobe: attention, short-term memory, planning, motivation;
- parietal lobe: integrating sensory information, spatial sense, navigation;
- occipital lobe: vision;
- temporal lobe: smell and sound, semantics for speech and vision, processing of complex stimuli, forming of long-term memory.
Columnar structure. The cortex is composed of discrete, modular columns of neurons, characterized by a consistent connectivity profile. The basic units are minicolumns, with the same types of neurons and the same connectivity; these combine into modules, the hypercolumns. The slide shows a 3D reconstruction of five columns in rat vibrissal cortex, with layers 1 to 6 between the pial surface and the white matter (underlying image from Marcel Oberlaender, Beyond the Cortical Column, Neuroinformatics 2012), and a schematic of an array of cortical columns (layers L1, L2/3, L4, L5, L6) with a neuron’s dendrites and axon inside a column and its position in a section of the brain.
Organization of the central nervous system
Two labelled drawings show the organization of the central nervous system. A midsagittal section shows the corpus callosum, cingulate gyrus, fornix, anterior and posterior commissures, pineal gland, the diencephalon (thalamus and hypothalamus) with the hypothalamic sulcus, the midbrain, the cerebral aqueduct, the fourth ventricle and the cerebellum. A horizontal section shows the corpus callosum (genu and splenium), septum pellucidum, the anterior horn of the lateral ventricle, head and tail of the caudate nucleus, the internal capsule (anterior limb, genu, posterior limb), the foramen of Monro, putamen, globus pallidus, third ventricle, thalamus, amygdala, hippocampus and fornix.
The neuron
Definition G3.1 (Neurons and glia). Neurons are the nerve cells that send and receive signals. Glia are support cells: they provide structure in the brain, maintain homeostasis, provide insulation by forming myelin (oligodendrocytes), provide nutrients (astrocytes), etc.
The slide’s picture shows a neuron (dendrites, axons) next to an astrocyte and an oligodendrocyte, two types of glial cell. Neurons come in many shapes; the next picture shows three types, with dendrites in blue and axons in red: a pyramidal cell (apical dendrite, basal dendrites, cell body, and an axon going to distant targets via the white matter), a basket cell (cell body and a spread of axon terminals) and a motor neuron (cell body, wide dendritic tree, and an axon going to muscle).
Signaling between neurons and circuit motifs
A neuron receives signals on its dendrites, at synapses with the axon tips of previous neurons; an electrical signal travels from the cell body along the axon to the axon tips, which form synapses on the dendrites of the next neuron.
Neurons are wired into a small number of recurring circuit motifs, drawn below with excitatory neurons in green, inhibitory neurons in red, excitatory connections ending in a triangle and inhibitory connections ending in a dot:
- A. Feedforward excitation: a chain of excitatory neurons, each exciting the next.
- B. Feedforward inhibition: an excitatory neuron excites an inhibitory neuron, which inhibits the next excitatory neuron.
- C. Convergence/divergence: several neurons converge onto one neuron, which in turn diverges onto several neurons.
- D. Lateral inhibition: a neuron excites inhibitory neurons that inhibit its neighbours.
- E. Feedback/recurrent inhibition: in E1 a neuron excites a second neuron, which excites an inhibitory neuron that inhibits the first; in E2 four inhibitory neurons form a ring, each inhibiting the next.
- F. Feedback/recurrent excitation: in F1 the downstream neuron excites the neuron that excites it; in F2 a neuron receiving input excites itself (a) and is part of an excitatory loop (b).
Hierarchical organization of the brain
The brain is organized hierarchically. The slide shows three images. The first is a stained section of somatosensory cortex (S1) with layers L2/3 and L4 marked. The second is a schematic of the anatomical features of cortico-cortical connections that Felleman and Van Essen (1991) used to assign hierarchical relationships between visual cortical areas: forward (ascending) connections terminate in layer 4 and originate either from superficial layers or from both superficial and deep layers; feedback (descending) connections terminate outside layer 4 and originate either from deep layers or from both superficial and deep layers; lateral connections terminate in all layers. The third is Felleman and Van Essen’s hierarchy of visual areas, from the retinal ganglion cells (RGC) and LGN through V1, V2, V3, V4, MT, MST and the parietal and inferotemporal areas up to the entorhinal cortex (ER) and hippocampus (HC).
The fruitfulness of “following the anatomy”
Three examples show what has been learned by following the anatomy:
- Hubel and Wiesel: orientation selectivity. A neuron in visual cortex fires strongly for a bar at one orientation and weakly for others; its response (spikes per second) as a function of stimulus orientation is a bell-shaped tuning curve.
- Edvard and May-Britt Moser: grid cells. The spikes of a place cell, plotted over the path of an animal exploring an enclosure, cluster in one place; those of a grid cell form a regular grid of firing fields.
- Michael Fee: sparse HVC neurons. During a zebra finch’s song motif (syllables a, b, c, d, shown in a spectrogram), each projection neuron of the song nucleus HVC fires a single brief burst (a few ms) at one moment of the song.
If one wants to understand function in biology, one should study structure. (Francis Crick)
Synaptic transmission
At the level of single neurons, signaling between neurons happens by synaptic transmission. The slide’s figure walks through the steps at a chemical synapse, where a myelinated axon ends on a dendrite:
- Transmitter is synthesized and then stored in vesicles.
- An action potential invades the presynaptic terminal.
- Depolarization of the presynaptic terminal causes the opening of voltage-gated Ca²⁺ channels.
- Ca²⁺ flows in through the channels.
- Ca²⁺ causes vesicles to fuse with the presynaptic membrane.
- Transmitter is released into the synaptic cleft via exocytosis.
- Transmitter binds to receptor molecules in the postsynaptic membrane.
- Postsynaptic channels open or close.
- The postsynaptic current causes an excitatory or inhibitory postsynaptic potential that changes the excitability of the postsynaptic cell.
- Vesicular membrane is retrieved from the plasma membrane.
Calcium influx is necessary for neurotransmitter release. In the experiment on the slide, the presynaptic neuron is voltage-clamped (its potential
Resting potential and action potential
At rest, ion concentrations differ across the membrane. The slide’s figure gives K⁺ at 4 mM outside and 120 mM inside, Na⁺ at 150 mM outside and 15 mM inside, Cl⁻ at 120 mM outside and 5 mM inside; the inside of the membrane is negatively charged relative to the outside. These gradients are maintained by the Na⁺–K⁺ ATPase, which uses one ATP (giving ADP and Pᵢ) to pump 3 Na⁺ out and 2 K⁺ in, and by the K⁺–Cl⁻ cotransporter. A second picture shows K⁺ diffusing out through potassium channels, Na⁺ diffusing in through sodium channels, and the Na⁺/K⁺ pump.
Each ion has a reversal potential, at which the diffusion potential exactly counterbalances the electrical potential:
The action potential is the spike in membrane potential that a neuron fires. After a stimulus, the membrane potential rises from the resting state (
The slide’s accompanying pictures show the membrane at rest (Na⁺ at high concentration outside, K⁺ at high concentration inside, outside positive) and during the action potential (Na⁺ entering the cell, so that the charges across the membrane are locally reversed), and a neuron along whose axon this region of reversed charge travels from the cell body towards the axon terminals: the propagation of the action potential.
Part 2: The neuron as a nonlinear dynamical system
Modeling the neuron
Modeling the neuron is an interplay of electrophysiology, the bifurcation mechanisms of dynamical systems, and the computational properties of neurons. A neuron can be described
- in terms of ions and channels,
- in terms of input/output relations,
- as a nonlinear dynamical system.
From the third point of view, a neuron is a dynamical system near a transition (a bifurcation) between resting and spiking activity. The idea is to deduce computational properties of neurons from the geometry of the phase portrait at the bifurcations of the nonlinear dynamical system.
Properties of neurons
- There are about
neurons in the human brain. - Neurons can transmit electric signals over long distances.
- A neuron can receive input from as many as
other neurons through synapses. - Neurons are organized in neuronal circuits.
- Spikes are the main means of communication between neurons.
- Neurons have a firing threshold.
The Hodgkin–Huxley model
The Hodgkin–Huxley model is based on the giant axon of the squid. The slide’s figure (from Eckert, Animal Physiology, W. H. Freeman, 2000, Fig. 5-21) shows the squid with its stellate ganglion and the stellate nerve containing the giant axon; the experimental setup, with a stimulus electrode, a recording electrode and a reference electrode on the axon connected to an amplifier; and the recorded membrane potential, which jumps from
Deriving the Hodgkin–Huxley equation
Definition G3.2 (Membrane potential). Every cell has a membrane potential
Sodium and potassium channels are of two kinds: non-gated channels, which are always open, and voltage-gated channels, which open or close depending on conditions on the membrane potential.
- An inward current consists of positively charged ions entering the cell, such as Na⁺. It raises the membrane potential: the membrane is depolarized.
- An outward current consists of positively charged ions leaving the cell, such as K⁺, or negatively charged ions entering the cell, such as Cl⁻. It lowers the membrane potential: the membrane is hyperpolarized.
First step: the Nernst–Planck equation
The Nernst–Planck equation describes the general flux of an ion driven by electrical and concentration gradients across a membrane. Let
- Diffusion, from high to low concentration. The diffusive flux is
where the diffusion constant depends on the size of the molecules. - Electrical drift. The electric field is
, and with the mobility of the ion the drift flux is
The total flux across the membrane is
Proposition G3.3 (Nernst equilibrium potential). At equilibrium, the potential difference between two points
Proof. The condition
Remark. Taking
Away from equilibrium, the Nernst–Planck equation for the flux, with diffusion parameter
The Hodgkin–Huxley circuit
The Nernst–Planck equation does not explain the mechanism through which channels open and close. To model the dynamics of action potentials, Hodgkin and Huxley added voltage-gated conductance variables. The membrane is modelled as an electrical circuit: between the extracellular and intracellular sides, a capacitor
Conservation of current in this circuit gives
The Hodgkin–Huxley equations
In the Hodgkin–Huxley model of the giant squid axon there are three currents:
- a persistent voltage-gated K⁺ current, with four activation gates;
- a transient voltage-gated Na⁺ current, with three activation gates;
- a leak current (Cl⁻).
The activation variables
Definition G3.4 (Hodgkin–Huxley equations).
Propagation of the action potential
To follow the action potential along the axon, let
The nonlinearities are in the rate functions
Injected current as a bifurcation parameter
The injected current
The traces drawn here are computed from the standard Hodgkin–Huxley parameters, starting at rest (
Remark (Linearization and the center manifold). The linearization of the Hodgkin–Huxley system at its fixed point (in the spiking regime) has two negative eigenvalues and two complex eigenvalues with small positive real part. The components along the eigenvectors of the negative eigenvalues decay to zero for large
The figure shows the limit cycle for
The FitzHugh–Nagumo model
The FitzHugh–Nagumo model (1961) is a simplified version of the Hodgkin–Huxley dynamics. The neuron receives signals along its dendrites (the dendritic tree), processes them in the soma, and sends a single output along the axon; the slide’s picture shows the soma, the dendrites, the initial segment (axon hillock), the axon with its myelin sheath, and the terminals (endings, “buttons”).
The voltage difference at one location in the axon affects the time evolution of the voltage differences at nearby locations, so the action potential propagates along the length of the axon. One therefore models
- the time evolution of the action potential at a given site on the axon, and
- the diffusion of the action potential along the axon.
Heuristics: damped oscillators
Here is a heuristic for the form of the equation. Let
Definition G3.5 (Damped harmonic oscillator). The (linear) damped harmonic oscillator is
A more refined model is a nonlinear damped harmonic oscillator, in which the constant
Definition G3.6 (Van der Pol equation). The van der Pol equation (which comes from electrical circuits) is
For small
The FitzHugh–Nagumo model is based on a version of the nonlinear damped harmonic oscillator, a more general form of the van der Pol equation.
The FitzHugh–Nagumo equations
Definition G3.7 (Bonhoeffer–van der Pol oscillator). The Bonhoeffer–van der Pol nonlinear damped harmonic oscillator is
Definition G3.8 (FitzHugh–Nagumo equation). The FitzHugh–Nagumo equation is
This only models the action potential in time at a fixed site, with no varying spatial dimension. To include dependence on a spatial coordinate, let
Discrete modeling: a coupled map lattice
For numerical simulations one discretizes the FitzHugh–Nagumo equation. Fix an increment
- the time derivative by
, - the second space derivative by
.
Writing
Definition G3.9 (Coupled map lattice). A discrete system of this type is a coupled map lattice:
are only defined on a discrete set, the lattice ;- each time step is modelled by a local map
, here - the local maps at the different sites are coupled together by interaction terms like
.
Coupled map lattices are a useful method for studying PDEs. The main problem is controlling the error term, which can grow rapidly after a number of iterations.
Fixed points of the local map
We now study the local map
Proposition G3.10 (Fixed points of the local map). The origin
Proof. The fixed-point equations are
So the behavior of the equation changes at the threshold
Stability of fixed points
The Jacobian matrix
Proposition G3.11 (Fixed points in the plane). Let
- an attractive fixed point if
; - a saddle point if
; - a repelling fixed point if
.
The slide’s table summarizes the behavior near a fixed point of a two-dimensional discrete dynamical system according to the eigenvalues
| Eigenvalues | Stable ( |
Lyapunov stable ( |
Unstable ( |
|---|---|---|---|
| Real | stable point: |
neutral point: |
saddle point: |
| Complex conjugate | stable spiral focus: |
neutral center: |
unstable spiral focus: |
Its sketches show orbits moving in along both eigendirections at a stable point, in along one and out along the other at a saddle, out along both at an unstable point, spiralling in or out at a focus, and circling at a neutral center.
Linearization of the FitzHugh–Nagumo map
The Jacobian of the local map is
Proposition G3.12 (Stability of the origin). At the fixed point
- for
, the origin is an attracting fixed point; - for
, the origin is a saddle point.
Moreover
To find the stability at the other fixed points, approximate both their location and the value of
Proposition G3.13 (Stability of the other fixed points).
- At
the eigenvalues of are approximately and . Since , the second eigenvalue has , so this is a saddle point for all . - At
the eigenvalues of are approximately and . The second eigenvalue has when , so for this is an attractive fixed point, and for a saddle.
The figure above is a schematic of the cubic curve and the line (not to scale: for small
Cases. For
As
- At a value before
(namely ) the second eigenvalue at the origin changes sign; this reverses the direction of the left/right motion of trajectories near the origin, which now jump from side to side. - A similar reversal happens at the second fixed point near
. - If
(that is, ), the origin changes behavior to a saddle before the second fixed point does. - In this range, what happens to the trajectories now leaving the origin in a near-horizontal direction? The first fixed point is also a saddle, repelling in the horizontal direction...
- The linear approximation at the fixed points gives an incomplete picture: one must also look at the behavior of periodic orbits. The trajectories leaving the origin are attracted by a periodic orbit of period 2,
, which appears around the origin when .
Definition G3.14 (Morse–Smale system). A Morse–Smale system is a dynamical system with finitely many periodic orbits (including fixed points), in which all orbits converge to a periodic orbit.
Period doubling and chaos
The period-doubling cascade
- In the range of the parameter
discussed above, the FitzHugh–Nagumo model is a Morse–Smale dynamical system. - When the parameter
is increased beyond , the orbit of order 2 stops being attractive, and two further points of order 4 appear near each (now unstable) point of order 2: a new attractive orbit of period 4. - This is a cascade of period doubling: the period 4 orbit becomes unstable, giving rise to a stable period 8 orbit, and so on, with the stable orbit of period
becoming unstable and a new stable orbit of period emerging from the bifurcation. - Numerical estimates indicate that the bifurcation values
of the parameter converge to a value as . - The dynamical system is Morse–Smale in the range
. - In fact there are two sequences of such periodic orbits: one around
, to the left of the stable curve through the first fixed point , and one around the second fixed point , to the right of the stable curve through the first fixed point.
Constructing bifurcation diagrams
- Fix a value of the parameter
and an initial condition (near the origin). - Compute a sufficiently large number of iterates.
- Plot the resulting positions
. - Repeat for other values of
. - Repeat the whole process for other initial conditions (near the second fixed point, and near the other fixed points where one expects to find a period-doubling cascade).
Typically one such bifurcation diagram (near one of the fixed points involved) looks like the picture on the slide: as the parameter increases, a single branch of fixed points splits into two branches (period 2), each of which splits again (period 4, then 8, …) at parameter values that come closer and closer together, after which the points fill out bands (chaos), interrupted by thin windows of periodic behavior.
Cascade bifurcations and chaos theory
What happens in these diagrams beyond the period-doubling series, for
The period doublings have a universal behavior:
Definition G3.15 (Sharkovsky’s ordering). Sharkovsky’s ordering of the natural numbers is
Theorem G3.16 (Sharkovsky’s theorem). If a continuous map
Corollary G3.17. If a continuous map
Remark. The result requires
Sharkovsky’s theorem is a very useful result for explaining period-doubling cascades, by reducing to a one-dimensional dynamics.
Theorem G3.18 (Period three implies chaos (Li–Yorke)). For a continuous map of the line, a periodic orbit of period three implies infinitely many periodic orbits, of arbitrary periods in
This is the theorem of Tien-Yien Li and James A. Yorke, Period Three Implies Chaos, The American Mathematical Monthly 82 (1975), no. 10, 985–992. The typical behavior past
Bifurcation diagrams of the FitzHugh–Nagumo model
The slide shows the bifurcation diagram of the discrete FitzHugh–Nagumo model with
For these values
A second slide, taken from the article at http://iopscience.iop.org/article/10.1088/1367-2630/12/5/053040, shows a bifurcation diagram for the electric potential
Trajectories of the continuous FitzHugh–Nagumo model
The same phenomena can be seen in the trajectories
- With three fixed points
(the origin), and : the fixed points and are stable and is unstable. Trajectories starting on either side of the stable curve of converge to or to . - For other parameter values, the fixed points
and are stable, with an unstable periodic orbit around . - With an external forcing
as well: a limit cycle appears through a Hopf bifurcation near , moves upward with increasing , and disappears in another Hopf bifurcation near . The slide shows the limit cycles for seven values of , labelled a to g: small cycles near the two Hopf bifurcations (a and g) and large relaxation cycles in between. - A sequence of orbits for values of
: seventeen schematic phase portraits, labelled A to Q, show how the configuration of fixed points ( , , , and in some panels two further points , ), the separatrices of the saddle and the periodic orbits changes as varies, from a panel (A) with a single fixed point surrounded by a spiralling orbit to a panel (Q) with a single fixed point surrounded by a spiralling orbit.
The resulting picture
The resulting picture of the model, in the phase plane of membrane potential
The trajectories in this figure are computed for
Further slides illustrate the same behavior:
- A figure with two cases (labelled in Portuguese: polynomial nullcline, linear nullcline, orbit, time): in (a) an orbit started on the right makes one excursion around the cubic and then spirals into the fixed point where the two nullclines meet, and (b) the corresponding
shows one spike followed by damped oscillations to rest; in (c), with the intersection of the nullclines moved slightly along the cubic, the orbit converges to a limit cycle around the fixed point, and (d) is a periodic train of spikes. - A “V–W plane plot” with the V-nullcline (the cubic), the W-nullcline (the line) and one trajectory, which starts at the origin, crosses to the right branch, climbs it, jumps across to the left branch and descends to the fixed point near the minimum of the cubic. Two vertical lines, near the two turning points of the cubic, divide the plane into Regions 1, 2 and 3. With an external forcing term
one moves the cubic curve, and with it the intersections with the line. - Varying the external forcing. For small
the line meets the cubic on its left branch, at a stable resting state. Increasing raises the cubic, until the intersection lies on the middle branch; the resting state becomes unstable and the neuron spikes. For a sequence of increasing the trajectories are a family of limit cycles (repetitive spiking), and for large the intersection moves onto the right branch, where it is stable again: the neuron stays depolarized and spiking is blocked. The slide’s inset traces read “resting”, “spiking”, “blocked”.
Conclusion
- A single neuron is a complicated nonlinear dynamical system.
- Spiking behavior arises from the bifurcation pattern, the stability properties of the equilibria (fixed points), and the occurrence of limit cycles.
- Varying the parameters (the injected current
and the parameter ) creates a pattern of bifurcations. - Bifurcation cascades and chaos are possible.
Later in the course we will deal with larger neuronal architectures, beyond the single-neuron case.
References
- Liqun Luo, Principles of Neurobiology, Garland Science, 2016.
- F. C. Hoppensteadt, An Introduction to the Mathematics of Neurons: Modeling in the Frequency Domain, Cambridge University Press, 1997.
- Eugene M. Izhikevich, Dynamical Systems in Neuroscience, MIT Press, 2007.
- Yakov Pesin, Vaughn Climenhaga, Lectures on Fractal Geometry and Dynamical Systems, American Mathematical Society, 2009.
- G. Bard Ermentrout, David H. Terman, Mathematical Foundations of Neuroscience, Springer, 2010.
- Tanya Kostova, Renuka Ravindran, Maria Schonbek, FitzHugh–Nagumo revisited: types of bifurcations, periodical forcing and stability regions by a Lyapunov functional, Internat. J. Bifur. Chaos Appl. Sci. Engrg. 14 (2004), no. 3, 913–925.
- Tien-Yien Li, James A. Yorke, Period three implies chaos, The American Mathematical Monthly 82 (1975), no. 10, 985–992.
- D. J. Felleman, D. C. Van Essen (1991), on the hierarchy of visual cortical areas (source of the hierarchy figure).
- Marcel Oberlaender, Beyond the Cortical Column, Neuroinformatics 2012 (source of the cortical column reconstruction).
- R. Eckert, Animal Physiology, W. H. Freeman and Co., New York, 2000, Fig. 5-21 (source of the squid giant axon figure).
- New Journal of Physics 12 (2010), article 053040,
http://iopscience.iop.org/article/10.1088/1367-2630/12/5/053040(source of the FitzHugh–Nagumo bifurcation diagram for ).