Original title: Neural tracking of surprisal and semantic distance in naturalistic movie viewing
Ryan O’Leary, Hailey Smith, Emily Myers, Jamie Reilly +1 · September 2026
When we listen to people speak, our brains constantly try to guess what word is coming next. Scientists often measure this guessing through surprisalA measure of how unexpected a word is given the context that came before it., which tells us how unexpected a word is. However, unexpected words also carry new meanings that might not easily connect to earlier words. This connection can be tracked using semantic distanceA measure of how far apart two pieces of language are in meaning, based on a high-dimensional space of word meanings., a metric that measures how related two words are in meaning. Researchers wanted to see if the brain treats these two processes separately. They scanned people's brains while they watched the movie 500 Days of Summer. They tracked how the brain responded word by word. Adding surprisal or semantic distance improved predictions of activity in language areas across both sides of the brain, including the temporal lobes and parts of the frontal lobe and cerebellum. Most importantly, both metrics explained unique activity in the temporal cortex. This shows our brains track probability and meaning separately.
You are listening to a friend tell a story. You often predict the next word based on how surprising it would be. But you also check how the new word fits with the overall meaning. If you only used one method, you might miss important information. In this paper, the brain does both: it tracks both the surprise of each word and its meaning connection, even while watching a movie.
This matters because it reveals that the brain does not rely on a single prediction system when understanding language. Instead, it tracks both how surprising a word is and how it relates to previous words in meaning. These findings extend our understanding of language processing from simple listening to rich, real-world situations like watching a movie.
The study is limited to one movie and 20 participants, so results may not generalize to all types of audiovisual content or populations. It shows correlation between brain activity and linguistic measures, not causation. Other linguistic or cognitive factors not included might also explain the observed brain responses.
Ask anything about this paper. Answers come from its abstract, and say so when the abstract doesn't cover your question.
Neural tracking of surprisal and semantic distance in naturalistic movie viewing — Ryan O’Leary, Hailey Smith, Emily Myers et al. — bioRxiv — doi:10.64898/2026.09.09.749230
Abstract licence: CC BY
Explanation generated by Synthesis from the abstract — it is not the original paper. This is a preprint, so it hasn't necessarily been peer reviewed.