SSDs are non-invasive sensory aids that provide visual information to the blind via their existing senses. For example, using a visual-to-auditory SSD in a clinical or everyday setting, users wear a miniature video camera connected to a small computer (or smart phone) and stereo headphones.
The images are converted into “soundscapes,” using a predictable algorithm, allowing the user to listen to and then interpret the visual information coming from the camera.
Remarkably, proficient users who have had a dedicated (but relatively brief) training as part of a research protocol in he laboratory of Dr. Amir Amedi, of the Edmond and Lily Safra Center for Brain Sciences and the Institute for Medical Research Israel-Canada at the Hebrew University, are able to use SSDs to identify complex everyday objects, locate people and their postures, and read letters and words.
In addition to SSDs’ clinical opportunities, using functional magnetic resonance imaging opens a unique window for studying the organization of the visual cortex without visual experience by studying the brain of congenitally blind individuals.
The results of the study in Amedi’s lab, recently published in the journal Cerebral Cortex, are surprising. Not only can the sounds, which represent vision, activate the visual cortex of people who have never seen before, but they do so in a way organized according to the large-scale organization and segregation of the two visual processing streams.
For the past three decades, it has been known that visual processing is carried out in two parallel pathways. The ventral occipito-temporal “what” pathway, or the “ventral stream,” has been linked with visual processing of form, object identity and color. Its counterpart is considered to be the dorsal occipito-parietal “where/how” pathway, or the “dorsal stream,” which analyzes visuo-spatial information about object location and participates in visuo-motor planning.
Although this double dissociation between the processing of the two streams has been thoroughly validated, what remained unclear was the role of visual experience in shaping this functional architecture of the brain. Does this fundamental large-scale organizational principle depend on visual experience?
Using sensory substitution, the Hebrew University scientists, led by Ph.D. student Ella Striem-Amit and Dr. Amedi, discovered that the visual cortex of the blind shows a similar dorsal/ventral visual pathway division-of-labor when perceiving sounds that convey the relevant visual information; e.g., when the blind are requested to identify either the location or the shape of an SSD “image,” they activate an area in the dorsal or in the ventral streams, respectively.
This shows that the most important large-scale organization of the visual system into the two streams can develop at least to some extent even without any visual experience, suggesting instead that this division-of-labor is not at all visual in its nature.
Recent research from Amedi’s lab and from other research groups have demonstrated that multiple brain areas are not specific to their input sense (vision, audition or touch), but rather to the task or computation they perform, which may be computed with various modalities.
Extending these finding to a large-scale division-of-labor of the visual system further contributes crucial information towards postulating that the whole brain may be task-specific rather than dependent on a specific sensory input. "The brain is not a sensory machine, although it often looks like one; it is a task machine," summed up Amedi.
These findings suggest that the blind brain can potentially be “awakened” to processing visual properties and tasks, even after lifelong blindness, with the aid of visual rehabilitation, using future medical advances, such as retinal prostheses, say the researchers. A summary of these ideas were published recently in a review in Current Opinion in Neurology by Lior Reich and Shachar Maidenbaum from Amedi’s lab.A photo of Dr. Amedi wearing one of the SSD devices developed as the result of research in his lab is available at:.
CONTACT:Jerry Barach, Hebrew University Foreign Press Liaison
Jerry Barach | Hebrew University of Jerusalem
The genes are not to blame
20.07.2018 | Technische Universität München
Targeting headaches and tumors with nano-submarines
20.07.2018 | Universitätsmedizin der Johannes Gutenberg-Universität Mainz
A new manufacturing technique uses a process similar to newspaper printing to form smoother and more flexible metals for making ultrafast electronic devices.
The low-cost process, developed by Purdue University researchers, combines tools already used in industry for manufacturing metals on a large scale, but uses...
For the first time ever, scientists have determined the cosmic origin of highest-energy neutrinos. A research group led by IceCube scientist Elisa Resconi, spokesperson of the Collaborative Research Center SFB1258 at the Technical University of Munich (TUM), provides an important piece of evidence that the particles detected by the IceCube neutrino telescope at the South Pole originate from a galaxy four billion light-years away from Earth.
To rule out other origins with certainty, the team led by neutrino physicist Elisa Resconi from the Technical University of Munich and multi-wavelength...
For the first time a team of researchers have discovered two different phases of magnetic skyrmions in a single material. Physicists of the Technical Universities of Munich and Dresden and the University of Cologne can now better study and understand the properties of these magnetic structures, which are important for both basic research and applications.
Whirlpools are an everyday experience in a bath tub: When the water is drained a circular vortex is formed. Typically, such whirls are rather stable. Similar...
Physicists working with Roland Wester at the University of Innsbruck have investigated if and how chemical reactions can be influenced by targeted vibrational excitation of the reactants. They were able to demonstrate that excitation with a laser beam does not affect the efficiency of a chemical exchange reaction and that the excited molecular group acts only as a spectator in the reaction.
A frequently used reaction in organic chemistry is nucleophilic substitution. It plays, for example, an important role in in the synthesis of new chemical...
Optical spectroscopy allows investigating the energy structure and dynamic properties of complex quantum systems. Researchers from the University of Würzburg present two new approaches of coherent two-dimensional spectroscopy.
"Put an excitation into the system and observe how it evolves." According to physicist Professor Tobias Brixner, this is the credo of optical spectroscopy....
13.07.2018 | Event News
12.07.2018 | Event News
03.07.2018 | Event News
20.07.2018 | Power and Electrical Engineering
20.07.2018 | Information Technology
20.07.2018 | Materials Sciences