VR escape room study uses multimodal data to measure reasoning

Eileen McGivney and eight co-authors have published a study exploring how virtual reality (VR) environments can assess learning processes in real time, rather than relying solely on pre-post content retention tests. In their VR escape room, participants solved hands-on logic puzzles that required problem-solving strategies and verbal metacognitive reflections. The researchers captured multimodal data from player activity logs and spoken dialogue to analyze whether responses were based on genuine reasoning or guesswork. This approach leverages VR's unique ability to immerse users in sustained dialog and multimodal interactions, providing richer insights into higher-order skills.

The findings, presented at the 20th International Conference of the Learning Sciences (ICLS 2026), demonstrate that combining logfile data with verbal data yields meaningful measures of learning processes. By examining how participants reasoned through puzzles versus random guessing, the study offers a framework for embedding assessment directly into immersive learning experiences. For professionals building training simulations or educational VR, this method could enable real-time feedback on problem-solving abilities, moving beyond simple knowledge recall to evaluate how learners think and adapt.