Ocular Speech Tracking

Many studies focus on the neural mechanisms underlying speech processing, which is crucial for a better understanding of natural communication, especially under challenging conditions. This project addresses a newly discovered phenomenon called "ocular speech tracking," in which eye movements synchronize with speech signals and may play a supportive role in processing speech. The goal of this project is to decipher the functional relevance of this phenomenon and to investigate its dependence on lifelong visual experience. The project addresses key questions across four comprehensive work packages: First, it explores how ocular speech tracking occurs during natural speech over extended periods and under varying conditions of attention and intelligibility. Second, it analyzes whether similar eye movements also occur in simplified, non-speech auditory scenarios. Third, it systematically examines the effects of eye movements on neural activity in auditory processing regions. Fourth, it investigates whether the phenomenon is innate or shaped by audiovisual experiences during development by including individuals with congenital and later-onset blindness. Theprojectcombinesinnovative methodologicalapproaches such as magnetoencephalography (MEG), eye-tracking, and machine learning to analyze the interaction between eye movements and neural processes in detail. These approaches enable a deeper understanding of the neural foundations of speech processing and the potential supportive role of eye movements in this process. In the long term, the results of this project could have practical implications, particularly for the development of new technologies to improve hearing aids. The ability to use eye movements as a simple, accessible method for assessing hearing and speech processing capabilities could have transformative impacts on human-technology interaction and the treatment of hearing loss.