(Press-News.org) Contact information: Hilary Hurd Anyaso
h-anyaso@northwestern.edu
847-491-4887
Northwestern University
Seeing the song
Study aims to understand how, when the auditory system registers complex auditory-visual synchrony
EVANSTON, Ill. --- Imagine the brain's delight when experiencing the sounds of Beethoven's "Moonlight Sonata" while simultaneously taking in a light show produced by a visualizer.
A new Northwestern University study did much more than that.
To understand how the brain responds to highly complex auditory-visual stimuli like music and moving images, the study tracked parts of the auditory system involved in the perceptual processing of "Moonlight Sonata" while it was synchronized with the light show made by the iTunes Jelly visualizer.
The study shows how and when the auditory system encodes auditory-visual synchrony between complex and changing sounds and images.
Much of related research looks at how the brain processes simple sounds and images. Locating a woodpecker in a tree, for example, is made easier when your brain combines the auditory (pecking) and visual (movement of the bird) streams and judges that they are synchronous. If they are, the brain decides that the two sensory inputs probably came from a single source.
While that research is important, Julia Mossbridge, lead author of the study and research associate in psychology at Northwestern, said it also is critical to expand investigations to highly complex stimuli like music and movies.
"These kinds of things are closer to what the brain actually has to manage to process in every moment of the day," she said. "Further, it's important to determine how and when sensory systems choose to combine stimuli across their boundaries.
"If someone's brain is mis-wired, sensory information could combine when it's not appropriate," she said. "For example, when that person is listening to a teacher talk while looking out a window at kids playing, and the auditory and visual streams are integrated instead of separated, this could result in confusion and misunderstanding about which sensory inputs go with what experience."
It was already known that the left auditory cortex is specialized to process sounds with precise, complex and rapid timing; this gift for auditory timing may be one reason that in most people, the left auditory cortex is used to process speech, for which timing is critical. The results of this study show that this specialization for timing applies not just to sounds, but to the timing of complex and dynamic sounds and images.
Previous research indicates that there are multi-sensory areas in the brain that link sounds and images when they change in similar ways, but much of this research is focused particularly on speech signals (e.g., lips moving as vowels and consonants are heard). Consequently, it hasn't been clear what areas of the brain process more general auditory-visual synchrony or how this processing differs when sounds and images should not be combined.
"It appears that the brain is exploiting the left auditory cortex's gift at processing auditory timing, and is using similar mechanisms to encode auditory-visual synchrony, but only in certain situations; seemingly only when combining the sounds and images is appropriate," Mossbridge said.
###
In addition to Mossbridge, co-authors include Marcia Grabowecky and Satoru Suzuki of Northwestern. The article "Seeing the song: Left auditory structures may track auditory-visual dynamic alignment" will appear Oct. 23 in PLOS ONE.
NORTHWESTERN NEWS: http://www.northwestern.edu/newscenter/
Seeing the song
Study aims to understand how, when the auditory system registers complex auditory-visual synchrony
2013-10-24
ELSE PRESS RELEASES FROM THIS DATE:
Men tend to walk slower when walking with romantic partners
2013-10-24
Men tend to walk slower when walking with romantic partners
Walking speed depends on the relationship of the person with whom they are walking
When walking with female romantic partners, males tend to slow down by about 7%, according to new research published Oct ...
Emotionally intelligent people may influence the emotions of others based on their own goals
2013-10-24
Emotionally intelligent people may influence the emotions of others based on their own goals
Emotional intelligence may not always be associated with prosociality
Emotionally intelligent people have the ability to manipulate others to satisfy their own interest, according ...
Environmental factors help limit gene flow between different giraffe species
2013-10-24
Environmental factors help limit gene flow between different giraffe species
Rainfall and vegetation help explain genetic differences in giraffes
Giraffe species may only breed with each other based on the timing of rainfall in their local environments, according ...
South African 'living stone' plant adapts to extreme conditions in new ways
2013-10-24
South African 'living stone' plant adapts to extreme conditions in new ways
'Living stone' employs new way to improve underground photosynthesis, minimize water loss in dry conditions
A unique plant that lives underground uses multiple mechanisms to boost photosynthesis ...
Child born with HIV still in remission after 18 months off treatment, experts report
2013-10-24
Child born with HIV still in remission after 18 months off treatment, experts report
A 3-year-old Mississippi child born with HIV and treated with a combination of antiviral drugs unusually early continues to do well and remains free of active infection 18 months ...
UC Riverside astronomers help discover the most distant known galaxy
2013-10-24
UC Riverside astronomers help discover the most distant known galaxy
Galaxy is seen as it was just 700 million years after the Big Bang
RIVERSIDE, Calif. — University of California, Riverside astronomers Bahram Mobasher and Naveen Reddy are members of ...
Long-term study links box jellyfish abundance, environmental variability at Waikiki Beach
2013-10-24
Long-term study links box jellyfish abundance, environmental variability at Waikiki Beach
UH Manoa researchers analyze climate and oceanographic connections
You can almost set your watch to it.
A familiar sight to local beachgoers, the box jellyfish ...
Food additive may prevent spread of deadly new avian flu
2013-10-24
Food additive may prevent spread of deadly new avian flu
A common food additive can block a deadly new strain of avian influenza virus from infecting healthy cells, report researchers at the University of Illinois at Chicago College of Medicine in the online ...
UCLA chemists use MRI to peek at temperatures of gases inside catalytic reactors
2013-10-24
UCLA chemists use MRI to peek at temperatures of gases inside catalytic reactors
UCLA chemists for the first time have employed magnetic resonance imaging (MRI) — a technique normally reserved for medical clinicians peering inside the human ...
Researchers show how plants tell the time
2013-10-24
Researchers show how plants tell the time
Plants use sugars to tell the time of day, according to research published in Nature today
Plants use sugars to tell the time of day, according to research published in Nature today.
Plants, ...
LAST 30 PRESS RELEASES:
CMD-OPT model enables the discovery of a potent and selective RIPK2 inhibitor as preclinical candidate for the treatment of acute liver injury
Melatonin receptor 1a alleviates sleep fragmentation-aggravated testicular injury in T2DM by suppression of TAB1/TAK1 complex through FGFR1
Single-cell RNA sequencing reveals Shen-Bai-Jie-Du decoction retards colorectal tumorigenesis by regulating the TMEM131–TNF signaling pathway-mediated differentiation of immunosuppressive dendritic ce
Acta Pharmaceutica Sinica B Volume 15, Issue 7 Publishes
New research expands laser technology
Targeted radiation offers promise in patients with metastasized small cell lung cancer to the brain
A high clinically translatable strategy to anti-aging using hyaluronic acid and silk fibroin co-crosslinked hydrogels as dermal regenerative fillers
Mount Sinai researchers uncover differences in how males and females change their mind when reflecting on past mistakes
CTE and normal aging are difficult to distinguish, new study finds
Molecular arms race: How the genome defends itself against internal enemies
Tiny chip speeds up antibody mapping for faster vaccine design
KTU experts reveal why cultural heritage is important for community unity
More misfolded proteins than previously known may contribute to Alzheimer’s and dementia
“Too much going on”: Autistic adults overwhelmed by non-verbal social cues
What’s driving America’s deep freezes in a warming world?
A key role of brain protein in learning and memory is deciphered by scientists
Heart attacks don’t follow a Hollywood script
Erin M. Schuman wins 2026 Nakasone Award for discovery on neural synapse function and change during formation of memories
Global ocean analysis could replace costly in-situ sound speed profiles in seafloor positioning, study finds
Power in numbers: Small group professional coaching reduces rates of physician burnout by nearly 30%
Carbon capture, utilization, and storage: A comprehensive review of CCUS-EOR
New high-temperature stable dispersed particle gel for enhanced profile control in CCUS applications
State gun laws and firearm-related homicides and suicides
Use of tobacco and cannabis following state-level cannabis legalization
Long-term obesity and biological aging in young adults
Eindhoven University of Technology and JMIR Publications announce unlimited open access publishing agreement
Orphan nuclear receptors in metabolic dysfunction-associated steatotic liver disease development
A technological breakthrough for ultra-fast and greener AI
Pusan National University researchers identify key barriers hindering data-driven smart manufacturing adoption
Inking heterometallic nanosheets: A scalable breakthrough for coating, electronics, and electrocatalyst applications
[Press-News.org] Seeing the songStudy aims to understand how, when the auditory system registers complex auditory-visual synchrony