Using audiovisual feedback during speaking
Jennifer Chesters, Riikka Möttönen

Date: 2012-06-19 01:30 PM – 03:00 PM
Last modified: 2012-04-25

Abstract


The sensory systems have an important role in speech production. Monitoring sensory consequences of articulatory movements supports fluent speaking. It is well known that delayed auditory feedback disrupts fluency of speech. Also, there is some evidence that immediate visual feedback, i.e., seeing one’s own articulatory movements in a mirror, decreases the disruptive effect of delayed auditory feedback (Jones and Striemer, 2007). It is unknown whether delayed visual feedback affects fluency of speech. Here, we aimed to investigate the effects of delayed auditory, visual and audiovisual feedback on speech fluency. 20 native English speakers (with no history of speech and language problems) participated in the experiment. Participants received delayed (200 ms) or immediate auditory feedback, whilst repeating sentences. Moreover, they received either no visual feedback, immediate visual feedback or delayed visual feedback (200 ms, 400 ms, 600 ms). Under delayed auditory feedback, the duration of sentences was longer and number of speech errors was greater than under immediate auditory feedback, confirming that delayed auditory feedback disrupts speech. Immediate visual feedback had no effect on speech fluency. Importantly, fluency of speech was most disrupted when both auditory and visual feedback was delayed, suggesting that delayed visual feedback strengthened the disruptive effect of delayed auditory feedback. However, delayed visual feedback combined with immediate auditory feedback had no effect on speech fluency. Our findings demonstrate that although visual feedback is not available during speaking in every-day life, it can be integrated with auditory feedback and influence fluency of speech.

References


Jones, J.A., and Striemer, D. (2007) Speech disruption during delayed auditory feedback with simultaneous visual feedback. Journal of the Acoustical Society of America, 122 (4), 135-141.

Conference System by Open Conference Systems & MohSho Interactive