witheFlow: Real-time emotion-driven audio effects modulation from biosignals
Your heartbeat and sweat now shape guitar pedals in real time
Deep Dive
Researchers introduce witheFlow, a lightweight open-source system that modulates audio effects during live music performance by extracting features from biosignals and audio input. Accepted at NeurIPS 2025 Creative AI Track, it runs locally on a laptop with a compatible DAW and sensors, offering a new way for humans and machines to collaborate on emotional expression.
Key Points
- Modulates audio effects via biosignal (heart rate, GSR) and audio feature extraction in real time
- Lightweight system runs locally on a laptop with a DAW and standard sensors; fully open-source
- Accepted at NeurIPS 2025 Creative AI Track, emphasizing human-AI collaboration in music
Why It Matters
witheFlow turns performer physiology into a creative control signal, redefining live music expression and human-AI co-creation.