How well can you see with your ears?
Breakthrough device could train the brains of blind people to build images of the world around them
How well can you ‘see’ with your ears? Device offers new alternative to blind people
A device that trains the brain to turn sounds into images could be used as an alternative to invasive treatment for blind and partially-sighted people, say researchers at the University of Bath.
The vOICe sensory substitution device is a revolutionary tool that helps blind people to use sounds to build an image in their minds of the things around them.
It work as the sensors collect data from the external environment. This is then relayed to a coupling system that interprets and transduces the information and then replays it to a stimulator. After training, people learn to use the information gained from this stimulation to experience a perception of the sensation they lack instead of the actually stimulated sensation.
A research team, led by Dr Michael Proulx from the University’s Department of Psychology, looked at how blindfolded sighted participants responded to an eye test using the device.
Sensory substitution devices are not only an alternative, but might also be best employed in combination with such invasive techniques to train the brain to see again or for the first time
They were asked to perform a standard eyechart test called the Snellen Tumbling E test, which asks them to view the letter E turned in four different directions and in various sizes. Normal, best-corrected visual acuity is considered 20/20, calculated in terms of the distance, in feet, and the size of the E on the eyechart.
The participants, even without any training in the use of the device, were able to achieve the best performance possible, nearly 20/400. This limit appears to be the highest resolution currently possible with the ever-improving technology.
Dr Michael Proulx said: “This level of visual performance exceeds that of the current invasive technique for vision restoration, such as stem cell implants and retinal prostheses after extensive training.
“A recent study found successful vision at a level of 20/800 after the use of stem cells. Although this might improve with time and provide the literal sensation of sight, the affordable and non-invasive nature of The vOICe provides another option.
“Sensory substitution devices are not only an alternative, but might also be best employed in combination with such invasive techniques to train the brain to see again or for the first time.”
The findings are reported in the paper How well do you see what you hear? The acuity of visual-to-auditory sensory substitution, published in the journal Frontiers in Psychology , as part of a special topic in Cognitive Science on synaesthesia research.
The research team included the inventor of The vOICe sensory substitution device, Dr Peter Meijer of The Netherlands, and Alastair Haigh and Dave Brown of Queen Mary University, London.