How does temporal frequency affect impression formation for audio-visual stimuli?
Last modified: 2011-09-07
Abstract
In this study, we examined the effects of the temporal frequency of the audio–visual stimuli on the impression formation and perception of the temporal congruency. In our previous study (2010) with two temporal frequency conditions (108, and 216bpm), we found that both of the processing which underlies the impression formation of the temporal congruency and the processing which underlies the perceptual judgment depend not only upon the time lag between the audio and visual stimuli, but also upon the temporal frequency of the stimuli. As visual stimulus, we used repetitive luminance change of the computer graphic image with a constant temporal frequency (87, 108, 146, or 216bpm). As audio stimulus, we used periodic drum sounds consisted of a low tam and three cymbals. There were nine conditions for asynchrony between the visual and audio stimuli (±0, 96, 192, 288, and 384ms). We found that the range of the audio-visual asynchrony for the temporal congruent impression is much narrower than the range for the temporal congruent perception. These results suggest that the perception of the temporal congruency does not determine the impression formation for the temporal congruency.
References
Boliver, V. J., Cohen, A. J., & Fentress, J. C. (1994). Semantic and formal congruency in music and motion pictures: Effects on the interpretation of visual action. Psychomusicology, 13, 28-59. Iwamiya, S. (1994). Interactions between auditory and visual processing when listening to music in an audiovisual context: 1. Matching 2. Audio quality. Psychomusicology, 13, 133-154. Iwamiya, S., Sugano, Y., & Kouda, K. (2000). The Effect of Synchronization of Temporal Structures of Sound and Motion Picture on the Impression of Audio–visual Contents, SMC2000 Conference Proceedings, 1222-1225.