EyeMusic: A Colorful Experience for the Blind
Last modified: 2013-05-05
Abstract
Various sensory substitution devices (SSDs) have been designed in the past decades with the aim of creating a visual experience for the blind. We will present the EyeMusic, a visual-to-auditory SSD for the blind, providing both shape and color information. Our design uses musical notes generated by natural instruments to convey the visual information. This creates a pleasant user experience and facilitates prolonged use. We further present behavioral results showing that shape and color information are indeed decodable from the generated auditory stimuli.
Keywords
Sensory-substitution devices (SSD); Blindness; Color vision;
References
Cross-sensory transfer of sensory-motor information: visuomotor learning affects performance on an audiomotor task, using sensory-substitution Levy-Tzedek S., Novick I., Arbel R., Abboud S., Maidenbaum S., Vaadia E., Amedi A. Scientific Reports, 2; 949 (2012) Fast, Accurate Reaching Movements with a Visual-to-Auditory Sensory Substitution Device Levy-Tzedek S., Hanassy S., Abboud S., Maidenbaum s., Amedi A. Restorative Neurology and Neuroscience 30(4); 313-323 (2012) Reich L, Szwed M, Cohen L, Amedi A. A Ventral Visual Stream Reading Center Independent of Visual Experience. Current Biology 2011; 21: 1–6. Striem-Amit E, Dehaene S, Cohen L, Amedi A. Reading with sounds: Sensory substitution selectively activates the visual word form area in the blind Neuron 2012