Research & Papers

EMBER: Autonomous Cognitive Behaviour from Learned Spiking Neural Network Dynamics in a Hybrid LLM Architecture

A 220,000-neuron spiking network decides when to act, triggering an LLM to message a user after 8 idle hours.

Deep Dive

Researcher William Savage has introduced EMBER (Experience-Modulated Biologically-inspired Emergent Reasoning), a novel hybrid AI architecture that fundamentally rethinks the relationship between large language models (LLMs) and memory. Instead of using an LLM as the central processor augmented with retrieval tools, EMBER places the LLM as a replaceable reasoning engine within a persistent, biologically-inspired associative substrate. This substrate is a 220,000-neuron spiking neural network (SNN) featuring spike-timing-dependent plasticity (STDP), a four-layer hierarchical organization, and reward-modulated learning. A novel encoding method allows text embeddings to be fed into the SNN, achieving 82.2% discrimination retention across different embedding sizes.

The core innovation is the SNN's ability to drive autonomous behavior. Through STDP and lateral propagation during idle operation, the network can trigger and shape LLM actions without any external prompting or scripted triggers. The SNN determines *when* to act and *what* associations to surface, while the LLM handles *how* to act by selecting an action type and generating content. In a striking demonstration, the system autonomously initiated contact with a user after learned person-topic associations fired laterally during an 8-hour idle period. Remarkably, from a clean start with zero learned weights, the first SNN-triggered action occurred after only 7 conversational exchanges (14 messages). This represents a significant step towards AI systems with persistent, evolving internal states that can drive proactive behavior.

Key Points
  • Architecture flips the script: A 220,000-neuron spiking neural network (SNN) is the persistent 'brain,' using a standard LLM as a replaceable reasoning engine.
  • Achieves autonomous action: The SNN's dynamics (STDP) can trigger LLM actions without prompts; it initiated user contact after 8 idle hours based on learned associations.
  • Learns quickly: From a cold start with zero weights, the system triggered its first autonomous action after only 14 messages (7 exchanges).

Why It Matters

Moves AI beyond reactive chatbots towards systems with persistent memory and the ability to act autonomously based on internal associative states.