Sources of Variance in the Audiovisual Perception of Speech in Noise
Celina C. Nahanni, Justin M. Deonarine, Martin Paré, Kevin G. Munhall

Date: 2012-06-20 02:30 PM – 04:00 PM
Last modified: 2012-04-27

Abstract


The sight of a talker’s face dramatically influences the perception of auditory speech. This effect is most commonly observed when subjects are presented audiovisual (AV) stimuli in the presence of acoustic noise. However, the magnitude of the gain in perception that vision adds varies considerably in published work. Here we report data from an ongoing study of individual differences in AV speech perception when English words are presented in an acoustically noisy background. A large set of monosyllablic nouns was presented at 7 signal-to-noise ratios (pink noise) in both AV and auditory-only (AO) presentation modes. The stimuli were divided into 14 blocks of 25 words and each block was equated for spoken frequency using the SUBTLEXus database (Brysbaert & New, 2009). The presentation of the stimulus blocks was counterbalanced across subjects for noise level and presentation. In agreement with Sumby & Pollack (1954), the accuracy of both AO and AV increase monotonically with signal strength with the greatest visual gain being when the auditory signal was weakest. These average results mask considerable variability due to subject (individual differences in auditory and visual perception), stimulus (lexical type, token articulation) and presentation (signal and noise attributes) factors. We will discuss how these sources of variance impede comparisons between studies.

References


Brysbaert, M., New, B. 2009. Moving beyond Kučera and Francis: A critical Evaluation of Current Word Frequency Norms and the Introduction of a New and Improved Word Frequency Measure for American English. Behavior Research Methods. 41:977-990.

Sumby WH, Pollack I. 1954. Visual Contribution to Speech Intelligibility in Noise. Journal of the Acoustical Society of America. 26:212-215.

Conference System by Open Conference Systems & MohSho Interactive