Neural bases of phase shifted audiovisual stimuli

Daniel Bergmann, Hans-Jochen Heinze, Hans-Jochen Heinze, Hans-Jochen Heinze, Toemme Noesselt, Hans-Jochen Heinze, Toemme Noesselt, Hans-Jochen Heinze, Toemme Noesselt, Toemme Noesselt, Toemme Noesselt
Poster
Last modified: 2008-05-13

Abstract


In order to generate unified perceptions of the environment information from different sensory inputs needs to be integrated; spatial, contextual and temporal constraints can determine multisensory integration (e.g. Driver & Noesselt, 2008). Focusing on temporal processes, previous publications have emphasized the role of (multisensory) brain areas such as insula, intraparietal sulcus and superior temporal sulcus for the temporal integration of complex audiovisual inputs. This fMRI-study investigates the neural correlates of audiovisual temporal processing and perception using simple stimuli. We employed stimulus sequences of combined LED flashes and sound bursts that could be either phase-shifted or synchronous with a presentation rate of 4 Hz. Stimuli were presented through LEDs and Piezo-speakers inside the scanner. SOAs were either 125 ms or 63 ms in each direction (phase shift 1800/900). Each of the asynchrony conditions was judged by the participants by means of synchrony judgments. A rapid sparse sampling design with silent interscan periods for stimulus presentation was applied (TR=2 s, pause=2 s). Behavioral results indicate a reduction in synchronous percepts with increasing phase shifts. In accord, fMRI-analysis revealed a cortical network of sensory-specific and multisensory brain areas that are modulated by audiovisual physical (a)synchrony and the participants' percepts.

Conference System by Open Conference Systems & MohSho Interactive Multimedia