VR study shows eye-tracking and feedback enhance social intelligence tests

A new study by Mohammad Fahim Abrar, Shayla Sharmin, and Roghayeh Leila Barmaki investigates how presentation medium and trial-level feedback influence performance on the Reading the Mind in the Eyes Test (RMET), a classic measure of social intelligence. The team implemented the RMET in Unity for both desktop and virtual reality (VR), with VR precisely controlling stimulus distance and field of view. Twenty participants were split into VR and desktop groups, and both groups completed the test under two conditions: with immediate correctness feedback and without. Eye-tracking and EEG data were recorded and synchronized with behavioral logs, enabling fine-grained analysis of gaze patterns and neural engagement.

The results revealed that immediate feedback was associated with significantly longer fixation durations and higher EEG-based engagement, though it did not affect overall accuracy or task completion time. Interestingly, presentation medium (VR vs. desktop) did not produce reliable objective differences, but participants gave VR higher usability ratings—while also finding it more effortful. These findings suggest that VR can serve as a controlled platform for studying social intelligence as a process-aware assessment, combining multimodal data (gaze, EEG, behavior) with ecological validity. The authors note that future work could scale the sample and explore adaptive feedback algorithms, potentially leading to more personalized social cognition training tools.