Research & Papers

Shimizu & Toyoizumi's STP theory enables rapid temporal coding in neural networks

A new information-theoretic model shows how presynaptic plasticity can reshape neural representations in real time.

Deep Dive

In a new paper on arXiv, researchers Genki Shimizu and Taro Toyoizumi from RIKEN Center for Brain Science present a normative information-theoretic theory of associative short-term synaptic plasticity (STP). Unlike traditional views that treat STP as a simple presynaptic filter independent of postsynaptic activity, recent experiments have shown that STP can be associative—depending on both pre- and postsynaptic coactivation. The authors extend Fisher-information-based learning to Tsodyks-Markram synapses, deriving learning rules for two key parameters: baseline synaptic weight and release probability. These rules operate under resource constraints to maximize the information encoded in neural firing about incoming stimuli.

The resulting model produces several striking predictions. For slowly varying inputs, the release-probability plasticity generates anti-causal connectivity—meaning synapses strengthen for inputs that precede spiking—and enhances response offset during sustained drive. After the stimulus is removed, the network exhibits reverse replay of activity sequences, a phenomenon observed in biological hippocampal place cells. Linear-response analysis reveals that STP introduces frequency-dependent phase selectivity, and constraints on release probability tune the temporal asymmetry of synaptic transmission. This positions release-probability plasticity as a principled, rapidly reconfigurable substrate for temporal coding, with potential implications for designing adaptive neural network architectures in AI and neuromorphic computing.

Key Points
  • Derived learning rules for baseline weight and release probability using Fisher-information optimization under resource constraints.
  • Model predicts anti-causal connectivity and enhanced response offset for slowly varying inputs, enabling reverse replay after stimulus removal.
  • Release-probability plasticity tunes temporal asymmetry and frequency-dependent phase selectivity, supporting rapidly reconfigurable temporal coding.

Why It Matters

This theory bridges synaptic plasticity and temporal coding, offering a blueprint for adaptive neural network architectures.