Micro-DualNet: Dual-Path Spatio-Temporal Network for Micro-Action Recognition

A team of researchers from Children's Hospital of Philadelphia (CHOP) and the University of Pennsylvania has introduced Micro-DualNet, a novel dual-path spatio-temporal network designed to recognize micro-actions—subtle, localized movements lasting 1-3 seconds, such as scratching one's head or tapping fingers. These actions are critical for social communication and fine-grained video understanding but have been poorly served by existing computer vision systems, which typically commit to a single spatio-temporal decomposition that cannot handle the diversity of micro-actions.

Micro-DualNet addresses this by processing anatomically-grounded spatial entities through parallel Spatial-Temporal (ST) and Temporal-Spatial (TS) pathways. The ST path captures spatial configurations before modeling temporal dynamics, while the TS path reverses this order to prioritize temporal dynamics. Instead of fixed fusion, the model introduces entity-level adaptive routing, where each body part learns its optimal processing preference, complemented by a Mutual Action Consistency (MAC) loss that enforces cross-path coherence. The model achieves state-of-the-art results on the iMiGUE dataset and competitive performance on the MA-52 dataset, marking a significant advance in fine-grained video understanding for applications in social robotics, mental health monitoring, and human-computer interaction.