Oscillatory correlates of linguistic ...
Document type :
Compte-rendu et recension critique d'ouvrage
Title :
Oscillatory correlates of linguistic prediction and modality effects during listening to auditory-only and audiovisual sentences
Author(s) :
Brunelliere, Angele [Auteur]
Laboratoire Sciences Cognitives et Sciences Affectives - UMR 9193 [SCALab]
Vincent, Marion [Auteur]
Laboratoire Sciences Cognitives et Sciences Affectives - UMR 9193 [SCALab]
Delrue, Laurence [Auteur]
Savoirs, Textes, Langage (STL) - UMR 8163 [STL]

Laboratoire Sciences Cognitives et Sciences Affectives - UMR 9193 [SCALab]
Vincent, Marion [Auteur]

Laboratoire Sciences Cognitives et Sciences Affectives - UMR 9193 [SCALab]
Delrue, Laurence [Auteur]
Savoirs, Textes, Langage (STL) - UMR 8163 [STL]
Journal title :
International Journal of Psychophysiology
Pages :
9-21
Publisher :
Elsevier
Publication date :
2022
ISSN :
0167-8760
English keyword(s) :
oscillations
prediction
audiovisual speech
sentence processing
prediction
audiovisual speech
sentence processing
HAL domain(s) :
Sciences cognitives/Linguistique
English abstract : [en]
In natural listening situations, understanding spoken sentences requires interactions between several multisensory to linguistic levels of information. In two electroencephalographical studies, we examined the neuronal ...
Show more >In natural listening situations, understanding spoken sentences requires interactions between several multisensory to linguistic levels of information. In two electroencephalographical studies, we examined the neuronal oscillations of linguistic prediction produced by unimodal and bimodal sentence listening to observe how these brain correlates were affected by the sensory streams delivering linguistic information. Sentence contexts which were strongly predictive of a particular word were ended by a possessive adjective matching or not the gender of the predicted word. Alpha, beta and gamma oscillations were investigated as they were considered to play a crucial role in the predictive process. During the audiovisual or auditory-only listening to sentences, no evidence of word prediction was observed. In contrast, in a more challenging listening situation during which bimodal audiovisual streams switched to unimodal auditory stream, gamma power was sensitive to word prediction based on prior sentence context. Results suggest that prediction spreading from higher sentence levels to lower word levels is optional during unimodal and bimodal sentence listening and is observed when the listening situation is more challenging. Alpha and beta oscillations were found to decrease when semantically constraining sentences were delivered in the audiovisual modality in comparison with the auditory-only modality. Altogether, our findings bear major implications for our understanding of the neural mechanisms that support predictive processing in multimodal language comprehension.Show less >
Show more >In natural listening situations, understanding spoken sentences requires interactions between several multisensory to linguistic levels of information. In two electroencephalographical studies, we examined the neuronal oscillations of linguistic prediction produced by unimodal and bimodal sentence listening to observe how these brain correlates were affected by the sensory streams delivering linguistic information. Sentence contexts which were strongly predictive of a particular word were ended by a possessive adjective matching or not the gender of the predicted word. Alpha, beta and gamma oscillations were investigated as they were considered to play a crucial role in the predictive process. During the audiovisual or auditory-only listening to sentences, no evidence of word prediction was observed. In contrast, in a more challenging listening situation during which bimodal audiovisual streams switched to unimodal auditory stream, gamma power was sensitive to word prediction based on prior sentence context. Results suggest that prediction spreading from higher sentence levels to lower word levels is optional during unimodal and bimodal sentence listening and is observed when the listening situation is more challenging. Alpha and beta oscillations were found to decrease when semantically constraining sentences were delivered in the audiovisual modality in comparison with the auditory-only modality. Altogether, our findings bear major implications for our understanding of the neural mechanisms that support predictive processing in multimodal language comprehension.Show less >
Language :
Anglais
Popular science :
Non
Collections :
Source :
Files
- https://hal.univ-lille.fr/hal-03820446/document
- Open access
- Access the document
- https://hal.univ-lille.fr/hal-03820446/file/Manuscript_PostPrint.pdf
- Open access
- Access the document
- https://hal.univ-lille.fr/hal-03820446/document
- Open access
- Access the document
- https://hal.univ-lille.fr/hal-03820446/file/Manuscript_PostPrint.pdf
- Open access
- Access the document
- https://hal.univ-lille.fr/hal-03820446/document
- Open access
- Access the document
- https://hal.univ-lille.fr/hal-03820446/file/Manuscript_PostPrint.pdf
- Open access
- Access the document
- https://hal.univ-lille.fr/hal-03820446/document
- Open access
- Access the document
- https://hal.univ-lille.fr/hal-03820446/file/Manuscript_PostPrint.pdf
- Open access
- Access the document
- document
- Open access
- Access the document
- Manuscript_PostPrint.pdf
- Open access
- Access the document