Quantifying lip-read-induced suppression and facilitation of the auditory N1 and P2 reveals peak enhancements and delays

Authors

  • Martijn Baart

    Corresponding author
    1. BCBL. Basque Center on Cognition, Brain and Language, Donostia–San Sebastián, Spain
    2. Department of Cognitive Neuropsychology, Tilburg University, Tilburg, The Netherlands
    • Address correspondence to: Martijn Baart, Basque Center on Cognition, Brain and Language, Paseo Mikeletegi, 69, 2nd floor, 20009, Donostia–San Sebastián, Spain. E-mail: m.baart@bcbl.eu

    Search for more papers by this author

  • This work was supported by grant FPDI-2013-15661 from the Spanish Ministry of Economy and Competitiveness (MINECO) and Severo Ochoa program grant SEV-2015-049. The author would like to thank all authors who made their data available. He would also like to thank Doug Davidson and Blair Armstrong for insightful discussions, and Arthur Samuel and Alejandro Pérez for their comments on earlier versions of this manuscript.

Abstract

Lip-read speech suppresses and speeds up the auditory N1 and P2 peaks, but these effects are not always observed or reported. Here, the robustness of lip-read-induced N1/P2 suppression and facilitation in phonetically congruent audiovisual speech was assessed by analyzing peak values that were taken from published plots and individual data. To determine whether adhering to the additive model of AV integration (i.e., A+V ≠ AV, or AV−V ≠ A) is critical for correct characterization of lip-read-induced effects on the N1 and P2, auditory data was compared to AV and to AV−V. On average, the N1 and P2 were consistently suppressed and sped up by lip-read information, with no indication that AV integration effects were significantly modulated by whether or not V was subtracted from AV. To assess the possibility that variability in observed N1/P2 amplitudes and latencies may explain why N1/P2 suppression and facilitation are not always found, additional correlations between peak values and size of the AV integration effects were computed. These analyses showed that N1/P2 peak values correlated with the size of AV integration effects. However, it also became apparent that a portion of the AV integration effects was characterized by lip-read-induced peak enhancements and delays rather than suppressions and facilitations, which, for the individual data, seemed related to particularly small/early A-only peaks and large/late AV(−V) peaks.

Ancillary