Can sensory data be fed through unusual sensory channels?
And can the brain learn to extract the meaning of such information streams?
Yes and yes. Sensory substitution is a non-invasive technique for circumventing the loss of one sense by feeding its information through another channel. We are leveraging this technique to develop a non-invasive, low-cost vibratory vest to allow those with deafness or severe hearing impairments to perceive auditory information through small vibrations on their torso.
(Figure from Scott Novich and David Eagleman)
Watch a video explaining the background and future of the Vest from the TED2015 conference:
To make this work, we are capitalizing on recent advances in audio codecs and digital signal processing. In parallel, we are forging new research paths to maximize the information capacity of skin–for example, by using small ‘sweeps’ of vibratory motors rather than a single motor that turns on and off. As it turns out, people are much better at detecting these sweeps (green data points, below):
(Data from Novich and Eagleman, 2015)
For the larger theoretical ideas behind this project, see a 3 minute video on BigThink: Welcome to Your Future Brain.
The long term goal of our work is to better understand how sensory streams can be re-packaged into atypical sensory channels to restore perception or give new perceptions. Beyond applications for hearing, this research will contribute to a generalized framework for designing devices to send any kinds of information to the brain for sensory processing via atypical sensory modalities. Such a framework will feed both rehabilitative and assistive technologies
For more on the principles of neural plasticity that underlie this work, please keep an eye out for David’s upcoming book on brain plasticity, LiveWired.
"David Eagleman may be the best combination of scientist and fiction-writer alive."
- Stewart Brand
"David Eagleman offers startling lessons.... His method in both Sum and his new book, Incognito, is to ask us to cast off our lazy, commonplace assumptions."
- The Guardian
"Eagleman has a talent for testing the untestable, for taking seemingly sophomoric notions and using them to nail down the slippery stuff of consciousness."
- The New Yorker
"[A] neuroscientist and polymath."
- Wall Street Journal
"What Eagleman seems to be calling for is a new Enlightenment."
- Sunday Herald
"A popularizer of impressive gusto...[Eagleman] aims, grandly, to do for the study of the mind what Copernicus did for the study of the stars."
- New York Observer
"David Eagleman is the kind of guy who really does make being a neuroscientist look like fun."
- New York Times