Don Vaughn and David Eagleman Release “Synesthetic”, Musical iPhone App: eyeFi
Developed by neuroscientists Don Vaughn and David Eagleman, this app is based on sensory substitution technology that was originally developed for blind people to be able to ‘see’ their world by auditory feedback. Don and David decided to develop this technology into a musical entertainment version, allowing the auditory feedback to be more mysterious, melodious, beat-filled and beautiful. With this app, you substitute one sense for another.
eyeFi is a way of hearing the world with your iPhone camera. Depending on where you point the camera, you generate different music. This is a revolution in music generation. By choosing your focal point — a modern painting, dancing friends, moving cars, simple sidewalks, swaying trees — you will generate rich combinations and opulent textures of musical sound.
eyeFi features several soundscapes for you to mold with your camera, from hip hop to electronica to rock. Watch each soundscape’s sliders move up and down, modulating the track volumes, as the scene changes. Press the music note to bring up the soundscape picker and press the note again to load the selected soundscape
-Hints for use
Walk around and point the camera at various scenes. Shake it around. Point it at yourself in the mirror. See what people in the coffee shop sound like. Listen to what a dog’s wagging tail sounds like. Point it at distant traffic. Get all your friends to dance in front of the camera.