PHOTON: Non-Invasive Optical Tracking of Key-Lever Motion in Historical Keyboard Instruments
A new open-source system captures expressive gestures on harpsichords and clavichords
Researchers Noah Jaffe and John Ashley Burgoyne have introduced PHOTON (PHysical Optical Tracking of Notes), a non-invasive optical sensing system designed to measure key-lever motion in historical keyboard instruments. PHOTON tracks the vertical displacement of the key lever itself, capturing motion shaped by both performer input and the instrument's mechanically imposed, time-varying load. Reflective optical sensors mounted beneath the distal end of each lever provide continuous displacement, timing, and articulation data without interfering with the action.
Unlike existing optical systems designed for modern pianos, PHOTON accommodates the diverse geometries, limited clearances, and non-standard layouts of harpsichords, clavichords, and early fortepianos. Its modular, low-profile architecture enables high-resolution, low-latency sensing across multiple manuals and variable key counts. Beyond performance capture, PHOTON provides real-time MIDI output and supports empirical study of expressive gesture, human-instrument interaction, and the construction of instrument-specific MIDI corpora. The complete system is released as open-source hardware and software, from schematics and PCB layouts developed in KiCad to firmware written in CircuitPython, lowering the barrier to adoption, replication, and extension.
- PHOTON uses reflective optical sensors mounted beneath each key lever to track vertical displacement
- Supports non-standard layouts of harpsichords, clavichords, and early fortepianos with high resolution and low latency
- System is fully open-source, including KiCad schematics, PCB layouts, and CircuitPython firmware
Why It Matters
PHOTON enables precise study of historical instrument performance, bridging musicology and AI with open-source sensing.