Title :

Oscillatory correlates of linguistic prediction and modality effects during listening to auditory-only and audiovisual sentences

Author(s) :

Brunelliere, Angele [Auteur]
Laboratoire Sciences Cognitives et Sciences Affectives - UMR 9193 [SCALab]
Vincent, Marion [Auteur]
Laboratoire Sciences Cognitives et Sciences Affectives - UMR 9193 [SCALab]
Delrue, Laurence [Auteur]
Savoirs, Textes, Langage (STL) - UMR 8163 [STL]

Journal title :

International Journal of Psychophysiology

Pages :

9-21

Publisher :

Elsevier

Publication date :

2022

ISSN :

0167-8760

English keyword(s) :

oscillations
prediction
audiovisual speech
sentence processing

HAL domain(s) :

Sciences cognitives/Linguistique

English abstract : [en]

In natural listening situations, understanding spoken sentences requires interactions between several multisensory to linguistic levels of information. In two electroencephalographical studies, we examined the neuronal ...
Show more >In natural listening situations, understanding spoken sentences requires interactions between several multisensory to linguistic levels of information. In two electroencephalographical studies, we examined the neuronal oscillations of linguistic prediction produced by unimodal and bimodal sentence listening to observe how these brain correlates were affected by the sensory streams delivering linguistic information. Sentence contexts which were strongly predictive of a particular word were ended by a possessive adjective matching or not the gender of the predicted word. Alpha, beta and gamma oscillations were investigated as they were considered to play a crucial role in the predictive process. During the audiovisual or auditory-only listening to sentences, no evidence of word prediction was observed. In contrast, in a more challenging listening situation during which bimodal audiovisual streams switched to unimodal auditory stream, gamma power was sensitive to word prediction based on prior sentence context. Results suggest that prediction spreading from higher sentence levels to lower word levels is optional during unimodal and bimodal sentence listening and is observed when the listening situation is more challenging. Alpha and beta oscillations were found to decrease when semantically constraining sentences were delivered in the audiovisual modality in comparison with the auditory-only modality. Altogether, our findings bear major implications for our understanding of the neural mechanisms that support predictive processing in multimodal language comprehension.Show less >

Language :

Anglais

Peer reviewed article :

Oui

Audience :

Internationale

Popular science :

Non

ANR Project :

L'adaptation des représentations linguistiques en cours d'interaction sociale : une approche dynamique de la communication orale

Collections :

• Savoirs, Textes, Langage (STL) - UMR 8163

Source :

Harvested from HAL