How do we combine faces and voices?

New research reveals the brain networks involved in recognising people

2011-03-10

(Press-News.org) Milan, Italy, 9 March 2011 – Human social interactions are shaped by our ability to recognise people. Faces and voices are known to be some of the key features that enable us to identify individual people, and they are rich in information such as gender, age, and body size, that lead to a unique identity for a person. A large body of neuropsychological and neuroimaging research has already determined the various brain regions responsible for face recognition and voice recognition separately, but exactly how our brain goes about combining the two different types of information (visual and auditory) is still unknown. Now a new study, published in the March 2011 issue of Elsevier's Cortex (http://www.sciencedirect.com/science/journal/00109452), has revealed the brain networks involved in this "cross-modal" person recognition.

A team of researchers in Belgium used functional magnetic resonance imaging (fMRI) to measure brain activity in 14 participants while they performed a task in which they recognised previously learned faces, voices, and voice-face associations. Dr Frédéric Joassin, Dr Salvatore Campanella, and colleagues compared the brain areas activated when recognising people using information from only their faces (visual areas), or only their voices (auditory areas), to those activated when using the combined information. They found that voice-face recognition activated specific "cross-modal" regions of the brain, located in areas known as the left angular gyrus and the right hippocampus. Further analysis also confirmed that the right hippocampus was connected to the separate visual and auditory areas of the brain.

Recognising a person from the combined information of their face and voice therefore relies not only on the same brain networks involved in using only visual or only auditory information, but also on brain regions associated with attention (left angular gyrus) and memory (hippocampus). According to the authors, the findings support a dynamic vision of cross-modal interactions in which the areas involved in processing both face and voice information are not simply the final stage of a hierarchical model, but rather, they may work in parallel and influence each other.

### Notes to Editors: The article is "Cross-modal interactions between human faces and voices involved in person recognition" by Frédéric Joassin, Mauro Pesenti, Pierre Maurage, Emilie Verreckt, Raymond Bruyer, Salvatore Campanella, and appears in Cortex, Volume 47, Issue 3 (March 2011), published by Elsevier in Italy. Full text of the article featured above is available to members of the media upon request. Please contact the Elsevier press office, newsroom@elsevier.com. To schedule an interview, contact Dr Salvatore Campanella, salvatore.campanella@chu-brugmann.be.

About Cortex Cortex is an international journal devoted to the study of cognition and of the relationship between the nervous system and mental processes, particularly as these are reflected in the behaviour of patients with acquired brain lesions, normal volunteers, children with typical and atypical development, and in the activation of brain regions and systems as recorded by functional neuroimaging techniques. It was founded in 1964 by Ennio De Renzi. The Editor in-chief of Cortex is Sergio Della Sala, Professor of Human Cognitive Neuroscience at the University of Edinburgh. Fax: 0131 6513230, e-mail: cortex@ed.ac.uk. Cortex is available online at http://www.sciencedirect.com/science/journal/00109452

About Elsevier Elsevier is a world-leading publisher of scientific, technical and medical information products and services. The company works in partnership with the global science and health communities to publish more than 2,000 journals, including The Lancet and Cell, and close to 20,000 book titles, including major reference works from Mosby and Saunders. Elsevier's online solutions include SciVerse ScienceDirect, SciVerse Scopus, Reaxys, MD Consult and Nursing Consult, which enhance the productivity of science and health professionals, and the SciVal suite and MEDai's Pinpoint Review, which help research and health care institutions deliver better outcomes more cost-effectively.

A global business headquartered in Amsterdam, Elsevier employs 7,000 people worldwide. The company is part of Reed Elsevier Group PLC, a world-leading publisher and information provider, which is jointly owned by Reed Elsevier PLC and Reed Elsevier NV. The ticker symbols are REN (Euronext Amsterdam), REL (London Stock Exchange), RUK and ENL (New York Stock Exchange).

ELSE PRESS RELEASES FROM THIS DATE:

Alcohol abuse history influences quality of life following liver transplant

2011-03-10

A history of alcohol abuse significantly impacts quality of life for patients after liver transplant, according to researchers at Henry Ford Hospital. "Transplant recipients with alcoholic cirrhosis experienced less improvement in physical quality of life and reported greater pain and physical limitations than non-alcoholics after transplant surgery," says Anne Eshelman, Ph.D., Henry Ford Behavioral Health Services, lead author of the study. "Understanding alcoholic and nonalcoholic patients' post-transplant change in quality of life may assist in treatment planning. ...

EU tariffs obstacle to trade with the rest of the world

2011-03-10

Increased imports often mean cheaper products for EU consumers and greater opportunities for producers in other countries to export their products, but also increased competition for EU producers. "I have compared various product groups and found that the effects of a reduction in tariffs would be different for fruit and vegetables and for cereals", says Cecilia Hammarlund, who is behind the report Handel med hinder – effekter av tullar på EU:s jordbruksimport (Trade with obstacles – effects of tariffs on EU agricultural imports). The study shows that an average reduction ...

Redefining normal blood pressure

2011-03-10

As many as 100 million Americans may currently be misclassified as having abnormal blood pressure, according to Dr. Brent Taylor from the Veterans Affairs Health Care System in Minneapolis and the University of Minnesota and his colleagues. Their findings1 show that these people are not actually more likely to die prematurely than those with 'normal' blood pressure, i.e. below 120/80. Taylor and colleagues' article in the Journal of General Internal Medicine², published by Springer, also shows that in those under 50, diastolic blood pressure* is the more important predictor ...

Learning to see consciously

2011-03-10

Our brains process many more stimuli than we become aware of. Often images enter our brain without being noticed: visual information is being processed, but does not reach consciousness, that is, we do not have an impression of it. Then, what is the difference between conscious and unconscious perception, and can both forms of perception be changed through practice? These questions are important not only for basic research, but also for the treatment of patients with perceptual deficits due to brain lesions e.g. following a stroke. Scientists at the MPI for Brain Research ...

How do people respond to being touched by a robot?

2011-03-10

For people, being touched can initiate many different reactions from comfort to discomfort, from intimacy to aggression. But how might people react if they were touched by a robot? Would they recoil, or would they take it in stride? In an initial study, researchers at the Georgia Institute of Technology found people generally had a positive response toward being touched by a robotic nurse, but that their perception of the robot's intent made a significant difference. The research is being presented today at the Human-Robot Interaction conference in Lausanne, Switzerland. "What ...

Toward real time observation of electron dynamics in atoms and molecules

2011-03-10

Quebec City, March 9, 2011 – Another step has been taken in matter imaging. By using very short flashes of light produced by a technology developed at the national infrastructure Advanced Laser Light Source (ALLS) located at INRS University, researchers have obtained groundbreaking information on the electronic structure of atoms and molecules by observing for the first time ever electronic correlations using the method of high harmonic generation (HHG). Made by a team of researchers from the Energy, Materials, and Telecommunications Center of INRS and the National Research ...

Combating cucurbit yellow stunting disorder virus

2011-03-10

This release is available in Spanish. U.S. Department of Agriculture (USDA) scientists are working to give melon growers some relief from cucurbit yellow stunting disorder virus, or CYSDV. In 2006, Agricultural Research Service (ARS) plant pathologist Bill Wintermantel with the U.S. Agricultural Research Station in Salinas, Calif., and university colleagues identified the plant disease that growers in California's Imperial Valley and nearby Yuma, Ariz., noticed was spreading through their cucurbit fields. Cucurbit crops affected included cantaloupe and honeydew melons. ARS ...

Synthetic biology: TUM researchers develop novel kind of fluorescent protein

2011-03-10

This release is available in German. Proteins are the most important functional biomolecules in nature with numerous applications in life science research, biotechnology and medicine. So how can they be modified in the most effective way to attain certain desired properties? In the past, the modifications were usually carried out either chemically or via genetic engineering. The team of Professor Arne Skerra from the TUM Chair of Biological Chemistry has now developed a more elegant combined solution: By extending the otherwise universal genetic code, the scientists are ...

Banana peels get a second life as water purifier

2011-03-10

To the surprisingly inventive uses for banana peels — which include polishing silverware, leather shoes, and the leaves of house plants — scientists have added purification of drinking water contaminated with potentially toxic metals. Their report, which concludes that minced banana peel performs better than an array of other purification materials, appears in ACS's journal Industrial & Engineering Chemistry Research. Gustavo Castro and colleagues note that mining processes, runoff from farms, and industrial wastes can all put heavy metals, such as lead and copper, into ...

An advance toward blood transfusions that require no typing

2011-03-10

Scientists are reporting an "important step" toward development of a universal blood product that would eliminate the need to "type" blood to match donor and recipient before transfusions. A report on the "immunocamouflage" technique, which hides blood cells from antibodies that could trigger a potentially fatal immune reaction that occurs when blood types do not match, appears in the ACS journal, Biomacromolecules. Maryam Tabrizian and colleagues note that blood transfusions require a correct match between a donor and the recipient's blood. This can be a tricky proposition ...

LAST 30 PRESS RELEASES:

Adding immunotherapy to neoadjuvant chemoradiation may improve outcomes in esophageal cancer

Scientists transform blood into regenerative materials, paving the way for personalized, blood-based, 3D-printed implants

The Lancet: Without immediate action nearly 260 million people in the USA predicted to have overweight or obesity by 2050

Standardized autism screening during pediatric well visits identified more, younger children with high likelihood for autism diagnosis

Researchers shed light on skin tone bias in breast cancer imaging

Study finds humidity diminishes daytime cooling gains in urban green spaces

Tennessee RiverLine secures $500,000 Appalachian Regional Commission Grant for river experience planning and design standards

[Press-News.org] How do we combine faces and voices?
New research reveals the brain networks involved in recognising people