PART 03 / Intermediate

From neurons to brains

How do interacting cells produce reliable sensorimotor behavior?

Illustrated introduction

What you will learn

Compare feedforward and recurrent circuits using explicit inputs, states, outputs, and perturbations.

Before you begin: Biological neuroscience

The interaction is the computation

A circuit combines inputs, internal state and outputs. In a feedforward network, activity moves through successive transformations. Recurrent connections allow past activity to influence the next state. A reflex is better understood as a loop through sensing, circuitry, body and environment than as a chain that ends at a motor command.

Inhibition can improve a representation

Suppose neighboring units respond to similar inputs. Subtracting a fraction of neighboring activity can emphasize differences. This is a toy contrast computation, not a claim that every biological inhibitory circuit implements the same rule. A small circuit can reveal a useful computational motif while leaving its detailed physiology unresolved.

Feedback can stabilize or amplify

In a linear recurrent toy, each step multiplies previous activity by a gain. Gains smaller than one in magnitude make the zero-input state decay; gains greater than one can amplify it without bound. Real networks introduce nonlinearities, multiple modes, noise and regulation. The simple calculation teaches why connectivity and dynamics must be studied together.

A neural-network perspective

Recurrence supplies a form of state without requiring a database. It can support integration and temporary retention, but does not automatically produce memory with useful capacity or robust decisions. Test the circuit with pulses, distractors and missing input. For robotics, include the actuator and sensor delays in the feedback loop.

SEE THE RELATIONSHIPS

From structure to behavior.

Network: a labelled conceptual diagram
Figure 3.1 · Network. Original educational diagram; synthetic, not a measured result.
The reasoning pathSensory input then Circuit state then Motor output then New sensory input1. Sensory input2. Circuit state3. Motor output4. New sensory input
A learning flow for this part. Follow the assumptions through to an observable result.

MAKE THE IDEA PRECISE

The mathematics.

x_(t+1) = a x_t + b u_t
Symbols and units
SymbolMeaning
x_tScalar circuit state at time step t
aRecurrent retention gain, dimensionless
bInput gain
u_tExternal input at time step t

Build the equation, step by step

  1. Separate the previous state contribution a x from the input contribution b u. This is a discrete linear approximation, not an anatomical identity.
  2. Set u to zero and apply the rule repeatedly: x after k steps equals a to the power k times the initial state.
  3. For this scalar model, magnitudes shrink when |a| < 1. A negative a alternates the sign. At |a| > 1, magnitudes grow unless a nonlinear limit intervenes.

WORK THROUGH THE NUMBERS

Worked example

With no new input and a = 0.8, an initial state of 1 becomes 0.8, 0.64 and 0.512. These are exact updates of this discrete model, not a fitted biological decay.

A small Python experiment.

Python 3 · Standard library only · Synthetic educational example. Run this in your own notebook or a local file.

x = 1.0
values = []
for _ in range(3):
    x = 0.8*x
    values.append(round(x, 3))
print(values)

Expected output

[0.8, 0.64, 0.512]

Change one quantity, predict the result, and then run the code again. Explain any difference before adding complexity.

Test your understanding.

Try it: Try a = -0.8 and a = 1.1. Explain alternating decay versus growth.

Self-check: Why does a stable recurrent circuit still need input?

Stability means disturbances do not grow without bound; it does not mean useful activity appears spontaneously. With |a| < 1 and no new input, this model forgets its initial state. Persistent memory needs an appropriate mechanism, not just the word recurrence.

Where this model stops: One scalar stability condition does not establish stability of a large nonlinear circuit.

A research question: Can a recurrent motif retain useful information while rejecting irrelevant perturbations?

Record evidence in your mastery worksheet →

THE NEXT LAYER

Chapter depth map.

This introduction provides a first model. The following chapters are outlines for deeper future editions; their full treatments have not yet been published.

Circuit building blocks

3.1 Small circuits, useful computations · Outline
  1. 3.1.1 Neural circuits and microcircuits
  2. 3.1.2 Feedforward chains and convergence
  3. 3.1.3 Recurrent excitation and inhibition
  4. 3.1.4 Lateral inhibition and competition
  5. 3.1.5 Input-output curves and causal perturbations
3.2 Sensing and moving · Outline
  1. 3.2.1 Sensory transduction and sensory pathways
  2. 3.2.2 Motor neurons and motor systems
  3. 3.2.3 Reflex arcs and feedback loops
  4. 3.2.4 Central pattern generators and rhythmic behavior
  5. 3.2.5 Body and environment as part of the closed loop

Coordination over time

3.3 Choosing, attending and navigating · Outline
  1. 3.3.1 Decision circuits and evidence accumulation
  2. 3.3.2 Attention-like selection without anthropomorphism
  3. 3.3.3 Heading and navigation representations
  4. 3.3.4 Feedforward predictions versus feedback corrections
  5. 3.3.5 Distinguishing behavioral evidence from circuit speculation
3.4 Remembering and stabilizing · Outline
  1. 3.4.1 Persistent activity and memory circuits
  2. 3.4.2 Attractor dynamics and noise
  3. 3.4.3 Gain control and homeostatic regulation
  4. 3.4.4 Circuit lesions and model ablations
  5. 3.4.5 Emergence as a testable system property

Read with the original sources.

These readings support the concepts and deeper investigation. The worked numbers and illustrations above are teaching examples.

Complete source register →

Where next?