Oscillatory correlates of linguistic ...
Document type :
Article dans une revue scientifique
Permalink :
Title :
Oscillatory correlates of linguistic prediction and modality effects during listening to auditory-only and audiovisual sentences
Author(s) :
Brunelliere, Angele [Auteur]
Sciences Cognitives et Sciences Affectives (SCALab) - UMR 9193
Vincent, Marion [Auteur]
Sciences Cognitives et Sciences Affectives (SCALab) - UMR 9193
Delrue, Laurence [Auteur]
Savoirs, Textes, Langage (STL) - UMR 8163 [STL]

Sciences Cognitives et Sciences Affectives (SCALab) - UMR 9193
Vincent, Marion [Auteur]

Sciences Cognitives et Sciences Affectives (SCALab) - UMR 9193
Delrue, Laurence [Auteur]
Savoirs, Textes, Langage (STL) - UMR 8163 [STL]
Journal title :
International Journal of Psychophysiology
Abbreviated title :
International Journal of Psychophysiology
Volume number :
178
Pages :
9-21
Publisher :
Elsevier BV
Publication date :
2022-08
ISSN :
0167-8760
English keyword(s) :
oscillations
prediction
audiovisual speech
sentence processing
prediction
audiovisual speech
sentence processing
HAL domain(s) :
Sciences cognitives
English abstract : [en]
In natural listening situations, understanding spoken sentences requires interactions between several multisensory to linguistic levels of information. In two electroencephalographical studies, we examined the neuronal ...
Show more >In natural listening situations, understanding spoken sentences requires interactions between several multisensory to linguistic levels of information. In two electroencephalographical studies, we examined the neuronal oscillations of linguistic prediction produced by unimodal and bimodal sentence listening to observe how these brain correlates were affected by the sensory streams delivering linguistic information. Sentence contexts which were strongly predictive of a particular word were ended by a possessive adjective matching or not the gender of the predicted word. Alpha, beta and gamma oscillations were investigated as they were considered to play a crucial role in the predictive process. During the audiovisual or auditory-only listening to sentences, no evidence of word prediction was observed. In contrast, in a more challenging listening situation during which bimodal audiovisual streams switched to unimodal auditory stream, gamma power was sensitive to word prediction based on prior sentence context. Results suggest that prediction spreading from higher sentence levels to lower word levels is optional during unimodal and bimodal sentence listening and is observed when the listening situation is more challenging. Alpha and beta oscillations were found to decrease when semantically constraining sentences were delivered in the audiovisual modality in comparison with the auditory-only modality. Altogether, our findings bear major implications for our understanding of the neural mechanisms that support predictive processing in multimodal language comprehension.Show less >
Show more >In natural listening situations, understanding spoken sentences requires interactions between several multisensory to linguistic levels of information. In two electroencephalographical studies, we examined the neuronal oscillations of linguistic prediction produced by unimodal and bimodal sentence listening to observe how these brain correlates were affected by the sensory streams delivering linguistic information. Sentence contexts which were strongly predictive of a particular word were ended by a possessive adjective matching or not the gender of the predicted word. Alpha, beta and gamma oscillations were investigated as they were considered to play a crucial role in the predictive process. During the audiovisual or auditory-only listening to sentences, no evidence of word prediction was observed. In contrast, in a more challenging listening situation during which bimodal audiovisual streams switched to unimodal auditory stream, gamma power was sensitive to word prediction based on prior sentence context. Results suggest that prediction spreading from higher sentence levels to lower word levels is optional during unimodal and bimodal sentence listening and is observed when the listening situation is more challenging. Alpha and beta oscillations were found to decrease when semantically constraining sentences were delivered in the audiovisual modality in comparison with the auditory-only modality. Altogether, our findings bear major implications for our understanding of the neural mechanisms that support predictive processing in multimodal language comprehension.Show less >
Language :
Anglais
Audience :
Internationale
Administrative institution(s) :
Université de Lille
CNRS
CHU Lille
CNRS
CHU Lille
Research team(s) :
Équipe Langage
Submission date :
2022-10-16T20:58:26Z
2022-10-19T07:16:04Z
2022-10-19T07:16:04Z
Files
- Manuscript_PostPrint.pdf
- Non spécifié
- Open access
- Access the document