Oscillatory correlates of linguistic ...
Type de document :
Article dans une revue scientifique
URL permanente :
Titre :
Oscillatory correlates of linguistic prediction and modality effects during listening to auditory-only and audiovisual sentences
Auteur(s) :
Brunelliere, Angele [Auteur]
Sciences Cognitives et Sciences Affectives (SCALab) - UMR 9193
Vincent, Marion [Auteur]
Sciences Cognitives et Sciences Affectives (SCALab) - UMR 9193
Delrue, Laurence [Auteur]
Savoirs, Textes, Langage (STL) - UMR 8163 [STL]
Sciences Cognitives et Sciences Affectives (SCALab) - UMR 9193
Vincent, Marion [Auteur]
Sciences Cognitives et Sciences Affectives (SCALab) - UMR 9193
Delrue, Laurence [Auteur]
Savoirs, Textes, Langage (STL) - UMR 8163 [STL]
Titre de la revue :
International Journal of Psychophysiology
Nom court de la revue :
International Journal of Psychophysiology
Numéro :
178
Pagination :
9-21
Éditeur :
Elsevier BV
Date de publication :
2022-08
ISSN :
0167-8760
Mot(s)-clé(s) en anglais :
oscillations
prediction
audiovisual speech
sentence processing
prediction
audiovisual speech
sentence processing
Discipline(s) HAL :
Sciences cognitives
Résumé en anglais : [en]
In natural listening situations, understanding spoken sentences requires interactions between several multisensory to linguistic levels of information. In two electroencephalographical studies, we examined the neuronal ...
Lire la suite >In natural listening situations, understanding spoken sentences requires interactions between several multisensory to linguistic levels of information. In two electroencephalographical studies, we examined the neuronal oscillations of linguistic prediction produced by unimodal and bimodal sentence listening to observe how these brain correlates were affected by the sensory streams delivering linguistic information. Sentence contexts which were strongly predictive of a particular word were ended by a possessive adjective matching or not the gender of the predicted word. Alpha, beta and gamma oscillations were investigated as they were considered to play a crucial role in the predictive process. During the audiovisual or auditory-only listening to sentences, no evidence of word prediction was observed. In contrast, in a more challenging listening situation during which bimodal audiovisual streams switched to unimodal auditory stream, gamma power was sensitive to word prediction based on prior sentence context. Results suggest that prediction spreading from higher sentence levels to lower word levels is optional during unimodal and bimodal sentence listening and is observed when the listening situation is more challenging. Alpha and beta oscillations were found to decrease when semantically constraining sentences were delivered in the audiovisual modality in comparison with the auditory-only modality. Altogether, our findings bear major implications for our understanding of the neural mechanisms that support predictive processing in multimodal language comprehension.Lire moins >
Lire la suite >In natural listening situations, understanding spoken sentences requires interactions between several multisensory to linguistic levels of information. In two electroencephalographical studies, we examined the neuronal oscillations of linguistic prediction produced by unimodal and bimodal sentence listening to observe how these brain correlates were affected by the sensory streams delivering linguistic information. Sentence contexts which were strongly predictive of a particular word were ended by a possessive adjective matching or not the gender of the predicted word. Alpha, beta and gamma oscillations were investigated as they were considered to play a crucial role in the predictive process. During the audiovisual or auditory-only listening to sentences, no evidence of word prediction was observed. In contrast, in a more challenging listening situation during which bimodal audiovisual streams switched to unimodal auditory stream, gamma power was sensitive to word prediction based on prior sentence context. Results suggest that prediction spreading from higher sentence levels to lower word levels is optional during unimodal and bimodal sentence listening and is observed when the listening situation is more challenging. Alpha and beta oscillations were found to decrease when semantically constraining sentences were delivered in the audiovisual modality in comparison with the auditory-only modality. Altogether, our findings bear major implications for our understanding of the neural mechanisms that support predictive processing in multimodal language comprehension.Lire moins >
Langue :
Anglais
Audience :
Internationale
Établissement(s) :
Université de Lille
CNRS
CHU Lille
CNRS
CHU Lille
Équipe(s) de recherche :
Équipe Langage
Date de dépôt :
2022-10-16T20:58:26Z
2022-10-19T07:16:04Z
2022-10-19T07:16:04Z
Fichiers
- Manuscript_PostPrint.pdf
- Non spécifié
- Accès libre
- Accéder au document