Does temporal adaptation affect multisensory integration?

Vanessa Harrar, Charles Spence, Laurence Harris

Last modified: 2013-05-05

Abstract


Generally speaking, multisensory integration is more likely to occur when the stimuli are synchronous [1]. Repeated exposure to temporally offset multisensory stimuli can change the perceived delay between the stimuli so that synchrony is perceived closer to the adapted delay rather than physical synchrony [2]. If the perception of synchrony is adaptable, might the point (or delay) of maximal integration also be altered after adaptation? Temporal adaptation might be achieved by changing the processing times of the component stimuli [3-4], or changing the integration mechanism. In the present study, each participant underwent daily adaptation to either synchronous or asynchronous (auditory lagging by 200ms, or visual lagging by 60ms) stimulus pairs. To assess unimodal processing time changes, we measured reactions times (RTs) to audio and visual stimuli after adaptation. In order to assess the effects of adaptation on multisensory integration, we measured RTs to synchronously presented AV stimuli and compared these with the RTs predicted from the Miller’s race model [5] for each participant [6]. The results comparing RTs following synchronous and asynchronous adaptation conditions are discussed in the context of perception versus action and current models of multisensory integration. The RTs changed considerably over a period of a week; these patterns are discussed in the context of learning to perceive synchrony.

Keywords


Reaction time; Race model; Adaptation; Synchrony

References


  1. Stein BE, Meredith MA (1993) Merging of the senses. Cambridge, MA: MIT Press.
  2. Fujisaki W, Shimojo S, Kashino M, Nishida S (2004) Nature Neuroscience, 7: 773-338.
  3. Harrar V, Harris LR (2008) Experimental Brain Research, 186: 517-524.
  4. Navarra J, Hartcher-O’Brien J, Piazza E, Spence C (2009) PNAS, 106: 9169-9173.
  5. Miller JO (1982). Cognitive Psychology, 14: 247-279.
  6. Molholm S, Ritter W, Javitt DC, Foxe JJ (2004) Cerebral Cortex, 14: 52–465.

Conference System by Open Conference Systems & MohSho Interactive