Skip to content

Medical emergency? What to do

Significant advance in our understanding of how sound is encoded for transmission to the brain

3-RXPublished February 28, 20064 min read

Key points

  • Scientists at Carnegie Mellon University have discovered that our ears use the most efficient way to process the sounds we hear, from babbling brooks to wailing babies.
  • The research provides a new mathematical framework for understanding sound processing and suggests that our hearing is highly optimized in terms of signal coding--the process by which sounds are translated into information by our brains--for the range of sounds we experience.
  • "We found that the optimal code for natural sounds is the same as that for speech.
  • Until now, scientists and engineers have relied on Fourier transformations--initially discovered 200 years ago--to separate and re-constitute parameters like frequency and intensity as part of traditional sound signal processing.

Scientists at Carnegie Mellon University have discovered that our ears use the most efficient way to process the sounds we hear, from babbling brooks to wailing babies.

These results represent a significant advance in our understanding of how sound is encoded for transmission to the brain, according to the authors, whose work is published with an accompanying "News and Views" editorial in the Feb. 23 issue of Nature.

The research provides a new mathematical framework for understanding sound processing and suggests that our hearing is highly optimized in terms of signal coding--the process by which sounds are translated into information by our brains--for the range of sounds we experience. The same work also has far-reaching, long-term technological implications, such as providing a predictive model to vastly improve signal processing for better quality compressed digital audio files and designing brain-like codes for cochlear implants, which restore hearing to the deaf.

To achieve their results, the researchers took a radically different approach to analyzing how the brain processes sound signals. Abstracting from the neural code at the auditory nerve, they represented sound as a discrete set of time points, or a "spike code," in which acoustic components are represented only in terms of their temporal relationship with each other. That's because the intensity and basic frequency of a given feature are essentially "kernalized," or compressed mathematically, into a single spike. This is similar to a player piano roll that can reproduce any song by recording what note to press when the spike code encodes any natural sound in terms of the precise timings of the elemental acoustic features. Remarkably, when the researchers derived the optimal set of features for natural sounds, they corresponded exactly to the patterns observed by neurophysiologists in the auditory nerves.

"We've found that timing of just a sparse number of spikes actually encodes the whole range of nature sounds, including components of speech such as vowels and consonants, and natural environment sounds like footsteps in a forest or a flowing stream," said Michael Lewicki, associate professor of computer science at Carnegie Mellon and a member of the Center for the Neural Basis of Cognition (CNBC). "We found that the optimal code for natural sounds is the same as that for speech. Oddly enough, cats share our own optimal auditory code for the English language."

"Our work is the only research to date that efficiently processes auditory code as kernalized spikes," said Evan Smith, a graduate student in psychology at the CNBC.

Until now, scientists and engineers have relied on Fourier transformations--initially discovered 200 years ago--to separate and re-constitute parameters like frequency and intensity as part of traditional sound signal processing.

"Our new signal processing framework appears far more efficient, effective and concise in conveying a rich variety of natural sounds than anything else," Lewicki said.

The approach by Smith and Lewicki dissects sound based only on the timing of compressed "spikes" associated with vowels (like cat vocalizations), consonants (like rocks hitting one another) and sibilants (ambient noise).

To gather sounds for their research, the scientists traipsed through the woods and recorded cracking branches, crunching leaves and wind rustling through leaves before returning to the laboratory to de-code the information contained in this rich set of sounds. They also discovered what they consider the most "natural" sound: if they play back a random set of spikes, it sounds like running water.

"We're very excited about this work because we can give a simple theoretical account of the auditory code which predicts how we could optimize signal processing to one day allow for much more efficient data storage on everything from DVDs to iPods," Lewicki said.

"For instance, if we could use a cochlear implant to 'talk' to the auditory nerve in a more natural way via our discovered coding, then we could quite possibly design implants that would convey sounds to the brain that are much more intelligible," he said.

http://www.cmu.edu

The content on this site is for information only and is not a substitute for professional medical advice, diagnosis or treatment. Drug information pages are an archive and may be out of date: always follow your prescriber, your pharmacist and the current product label. In an emergency, call 911.

Filed underBrain

Keep reading

Brain

New Brain Tumor Vaccine to Be Tested in Humans

For patients with low-grade gliomas, or slow growing brain tumors, a shot in the arm might soon lead to a new treatment therapy. A groundbreaking, first in humans vaccine will be tested in an early phase clinical…

3 min read

Brain

No family link seen between Parkinson's, melanoma

Research has suggested that families affected by melanoma skin cancer may also have a higher-than-average rate of Parkinson's disease -- but a large new study found no evidence of such a link. This doesn't mean no…

4 min read

When to get help

Reading is for later. These need care now.

Call 911 or go to an emergency department if you or someone with you has any of these:

  • Chest pain or pressureEspecially with breathlessness, sweating or pain in the arm, jaw or back. It can be a heart attack.
  • Face drooping, arm weakness, slurred speechSigns of a stroke. Note the time they started: treatment works best within hours.
  • Severe trouble breathingIncluding a severe allergic reaction with swelling of the lips, tongue or throat.
  • Thoughts of suicideCall or text 988 (Suicide & Crisis Lifeline, US) any time, day or night.

Outside the US, call your local emergency number.

See a doctor within days

  1. 01A new lump, or a sore that does not healMost lumps are harmless, but anything that grows or lasts more than a few weeks should be checked.
  2. 02Unexplained weight loss or lasting fatigueLosing weight without trying, or tiredness that does not lift, can have many causes worth finding.
  3. 03A new medicine and new symptomsSide effects and interactions are common. Ask your pharmacist or prescriber before you stop anything.

General guidance only. If you are unsure how urgent a symptom is, call your doctor or a nurse advice line.