For a list of all posts go here.
Introduction
In previous posts, we explored how motivation emerges from dopaminergic dynamics. Tonic dopamine modulated behavioral vigor, determining whether an agent explored, persisted, or disengaged. Phasic dopamine, in turn, enabled cue learning and sensitization, allowing neutral stimuli to acquire motivational power and, under certain conditions, produce addiction-like behavior.
In all those cases, behavior was organized around approach.
But adaptive agents must do more than pursue what is rewarding. They must also avoid what is harmful. They must detect danger, respond to uncertainty, and sometimes refrain from acting altogether.
This post explores fear as the computational counterpart of motivation: a process not of energizing action, but of constraining it. While motivation pulls the agent toward goals, fear shapes the space of actions that are considered safe.
Conceptual framing
If dopamine answers the question:
“Is it worth acting?”
then noradrenaline answers:
“Is it safe to act?”
In this framework, fear is not treated as an emotion in the psychological sense, but as a computational modulation of precision over threat and avoidance.
We introduce two variables:
Phasic noradrenaline (NAPhasic): a transient signal triggered by unexpected threat or volatility.
Tonic noradrenaline (NATonic): a slower, accumulating state representing sustained arousal and threat expectation.
Together, they determine how strongly the agent weights interoceptive discomfort and how readily it shifts away from current strategies.
From reward prediction to threat prediction
In the motivational model, phasic dopamine was driven by reward prediction error — the difference between expected and received reward.
Here, phasic noradrenaline is driven by unexpected threat.
This can be formalized in two equivalent ways:
As unexpected increases in interoceptive discomfort, or
As volatility in prediction error, indicating that the environment is less predictable than expected.
In both cases, the key idea is the same:
Noradrenaline signals that the world is not behaving as expected, and that current assumptions may be unsafe.
Tonic arousal and the amplification of discomfort
Phasic noradrenaline does not act alone. Repeated exposure to unexpected threat leads to a sustained increase in tonic noradrenaline.
This has a crucial consequence:
The same external situation produces greater internal discomfort.
In computational terms, tonic noradrenaline scales the gain of interoceptive signals. The environment does not need to become more dangerous; it only needs to be perceived as such.
This creates a shift from:
objective threat
tosubjective threat sensitivity.
Fear as avoidance precision
In the motivational model, dopamine increased the precision of policies leading to reward.
In the fear model, noradrenaline increases the precision of policies that avoid harm.
Action selection becomes a balance between:
Expected reward (approach), and
Expected discomfort (avoidance), amplified by tonic arousal.
When noradrenaline is low:
The agent tolerates risk.
Exploration and goal pursuit dominate.
When noradrenaline is high:
Avoidance dominates.
The agent becomes cautious, then inhibited, and eventually unable to act.
Threat learning and generalization
A key feature of fear is that it extends beyond the original source of harm.
When unexpected discomfort occurs in a given state, the representation of that state — and nearby states — becomes associated with threat.
Over time, this produces:
Generalization: safe contexts are treated as dangerous.
Persistence: threat remains even after the original cause is gone.
This is the avoidance counterpart of cue sensitization in addiction.
If phasic dopamine turns neutral cues into objects of desire,
phasic noradrenaline turns neutral contexts into objects of avoidance.
Emergent behavioral regimes
As in the motivational models, different regimes emerge from the interaction between tonic and phasic dynamics.
(a) Low tonic noradrenaline
Low sensitivity to threat
Risk-taking behavior
Weak avoidance learning
Interpretation: under-reactivity or emotional blunting.
(b) Moderate tonic noradrenaline
Adaptive fear responses
Flexible avoidance
Balanced exploration and caution
Interpretation: healthy behavior.
(c) Moderate tonic noradrenaline with strong sensitization
Specific avoidance patterns
Persistent fear of particular contexts
Interpretation: phobia-like behavior.
(d) High tonic noradrenaline with strong sensitization
Generalized avoidance
Failure to approach goals
Persistent discomfort even in safe conditions
Interpretation: trauma-like regime.
Comparison with motivation
The symmetry with the dopaminergic system is striking:
| Motivation (Dopamine) | Fear (Noradrenaline) |
|---|---|
| Approach behavior | Avoidance behavior |
| Reward prediction error | Threat / volatility signal |
| Cue sensitization | Threat generalization |
| Addiction (wanting without liking) | Trauma (fear without danger) |
| Increased policy precision (approach) | Increased policy precision (avoidance) |
Motivation expands the space of action.
Fear constrains it.
Both are necessary. Both can become pathological.
What this model does not yet explain
This minimal formulation does not yet include:
Interactions with dopaminergic motivation
Social or contextual modulation of fear
Long-term recovery or extinction mechanisms
Multimodal perception and real-world complexity
These limitations are deliberate. As in previous posts, the goal is to isolate the core computational principles before integrating them into richer systems.
Looking ahead
While the present model treats fear as a computational counterpart to motivation — emerging from precision over threat and avoidance — it remains deliberately minimal. It does not yet engage with rich sensory input, language, or real-world interaction. The next phase of this project will extend these mechanisms beyond abstract environments, integrating artificial motivation, curiosity, and fear into agents grounded in vision and voice, powered by systems such as Gemini and OpenAI models. The goal is to explore how these fundamental drives operate when perception becomes high-dimensional, when interaction becomes continuous, and when internal states must be inferred from complex sensory streams. In doing so, the project moves from isolated simulations toward embodied, multimodal agents — where the dynamics of approach and avoidance are no longer theoretical constructs, but active forces shaping behavior in real time.
Conclusion
Fear is not simply the absence of motivation. It is an active process that shapes behavior by increasing sensitivity to threat and constraining the space of possible actions.
By introducing phasic and tonic noradrenaline into the computational framework, we see how adaptive mechanisms for detecting uncertainty and avoiding harm can give rise to persistent avoidance, generalization, and trauma-like dynamics.
If dopamine determines what we pursue,
noradrenaline determines what we avoid.
Together, they define the boundaries of behavior.
No comments:
Post a Comment