Multisensory disambiguation of a temporal pattern

Caterina Bertini, Claudia Passamonti, Benjamin Rowland, Barry Stein
Poster
Time: 2009-07-02  09:00 AM – 10:30 AM
Last modified: 2009-06-04

Abstract


A compelling corpus of studies have shown that the integration of two weakly effective visual and auditory stimuli can have profound behavioural effects, both in enhancing perceptual sensitivity and improving orientation and localization performance. However, whether multisensory integration can also aid in disambiguating temporal patterns amidst the presence of noise is poorly understood. To examine the possible impact of this process on such performance, human subjects were asked to judge the presence or absence of a periodic sequence (target) of visual (Experiment A) or auditory (Experiment B) stimuli that were embedded in a complex background (i.e., noise). The background consisted of randomized sequences of visual and auditory stimuli (“distracters�). The target was a 1 Hz sequence of unisensory stimuli (Visual or Auditory) or bisensory (AV) synchronous stimuli presented in spatial coincidence, as if derived from a common event; or in spatial disparity as if derived from different events. When the AV stimuli were presented in spatial coincidence there was a significant increase in performance. The accuracy of target recognition improved significantly (in experiments A and B), and there was a significant increase in reaction speed (in experiment A) compared to that under each unisensory condition. In contrast, no significant effects were observed when the AV stimuli were spatially disparate. These results show that multisensory integration can aid in the disambiguation of periodic and therefore salient temporal patterns in a complex background, and suggest that it may be of substantial utility in detecting and identifying the sources of biologically relevant audio-visual events.

Conference System by Open Conference Systems & MohSho Interactive Multimedia