Original title: Listening Comprehension in Virtual Reality: An Eye-Tracking Study on Contextual Cues
Ting-Yu Liu, Tobias Appel, Pauline Frick, Marc Halfmann +4 · September 2026
Understanding spoken words in a foreign language is tough, and researchers want to know how visual cues in virtual reality, or VR, help people listen. In this study, scientists tracked where learners looked in a virtual environment to see how they take in visual information. The setup tested how people react to background objects and virtual people, known as actors. Researchers found that virtual actors draw and hold learners' eyes the most. These actors also control how a person's attention shifts back and forth between people and other visual clues around the room. This shows that seeing a virtual person in VR directly steers what learners focus on, which might help explain how lifelike digital environments help our brains build knowledge while learning a new language.
Imagine you are in a busy kitchen trying to follow a recipe. You have ingredients on the counter and a chef nearby. If the chef is there, you keep glancing at them for guidance, and you shift your attention between the chef and the ingredients. Here, the virtual actors are like the chef, and the contextual cues are like the ingredients; the researchers tracked where learners looked to see how social presence directs attention during language learning.
Language learners in VR often struggle to focus on the right cues. This study shows that virtual actors naturally draw attention and guide shifts between social and contextual information. Designers can use this to create more effective immersive lessons that keep learners engaged.
The study is descriptive and does not establish causation. Findings are tentative and point toward a possible mechanism, not a confirmed one. The eye-tracking data are limited to the specific virtual environments and the set of 24 context AOIs and 3 actor AOIs. The results may not generalize to other VR setups or languages.
Ask anything about this paper. Answers come from its abstract, and say so when the abstract doesn't cover your question.
Listening Comprehension in Virtual Reality: An Eye-Tracking Study on Contextual Cues — Ting-Yu Liu, Tobias Appel, Pauline Frick et al. — EdArXiv — doi:10.35542/osf.io/r9en7_v2
Abstract licence: CC BY
Explanation generated by Synthesis from the abstract — it is not the original paper. This is a preprint, so it hasn't necessarily been peer reviewed.