Vision, haptics, and attention: A further investigation of crossmodal interactions while exploring a 3D Necker cube

Marco Bertamini, Luigi Masala, Georg Meyer, Nicola Bruno
Poster
Last modified: 2008-05-13

Abstract


To study the time course of the merging of visual and haptic information we recorded the changes over time of a three-dimentional Necker cube which participants explored with their hands. Touch reduces the likelihood of the illusory percept, consistent with a multisensory view of three-dimensional form perception. In addition, when stationary and haptic exploration alternate, transitions from stationary to moving (motion onset) play a crucial role in inhibiting illusory reversals. A temporal analysis of the probability of the illusion occurring after different types of transitions revealed a suppression lasting 2-4 seconds after motion onset (Bruno et al., 2007). In a new study we monitored eye movements and instructed participants about fixation. Although the percept does depend on which vertex is fixated, we ruled out a role of changes of fixation as a mediating factor for the effect of motion onset. In another study we introduced a change of position for the hand as a new type of transition. This type of change did not produce the same inhibition generated by the motion onset. We suggest that motion onset does not simply draw attention towards haptic information. Rather, the influence of haptics peaks briefly after new information becomes available.

Conference System by Open Conference Systems & MohSho Interactive Multimedia