(Press-News.org) If you think having your phone identify the nearest bus stop is cool, wait until it identifies your mood.
New research by a team of engineers at the University of Rochester may soon make that possible. At the IEEE Workshop on Spoken Language Technology on Dec. 5, the researchers will describe a new computer program that gauges human feelings through speech, with substantially greater accuracy than existing approaches.
Surprisingly, the program doesn't look at the meaning of the words. "We actually used recordings of actors reading out the date of the month – it really doesn't matter what they say, it's how they're saying it that we're interested in," said Wendi Heinzelman, professor of electrical and computer engineering.
Heinzelman explained that the program analyzes 12 features of speech, such as pitch and volume, to identify one of six emotions from a sound recording. And it achieves 81 percent accuracy – a significant improvement on earlier studies that achieved only about 55 percent accuracy.
The research has already been used to develop a prototype of an app. The app displays either a happy or sad face after it records and analyzes the user's voice. It was built by one of Heinzelman's graduate students, Na Yang, during a summer internship at Microsoft Research. "The research is still in its early days," Heinzelman added, "but it is easy to envision a more complex app that could use this technology for everything from adjusting the colors displayed on your mobile to playing music fitting to how you're feeling after recording your voice."
Heinzelman and her team are collaborating with Rochester psychologists Melissa Sturge-Apple and Patrick Davies, who are currently studying the interactions between teenagers and their parents. "A reliable way of categorizing emotions could be very useful in our research,". Sturge-Apple said. "It would mean that a researcher doesn't have to listen to the conversations and manually input the emotion of different people at different stages."
Teaching a computer to understand emotions begins with recognizing how humans do so.
"You might hear someone speak and think 'oh, he sounds angry!' But what is it that makes you think that?" asks Sturge-Apple. She explained that emotion affects the way people speak by altering the volume, pitch and even the harmonics of their speech. "We don't pay attention to these features individually, we have just come to learn what angry sounds like – particularly for people we know," she adds.
But for a computer to categorize emotion it needs to work with measurable quantities. So the researchers established 12 specific features in speech that were measured in each recording at short intervals. The researchers then categorized each of the recordings and used them to teach the computer program what "sad," "happy," "fearful," "disgusted," or "neutral" sound like.
The system then analyzed new recordings and tried to determine whether the voice in the recording portrayed any of the known emotions. If the computer program was unable to decide between two or more emotions, it just left that recording unclassified.
"We want to be confident that when the computer thinks the recorded speech reflects a particular emotion, it is very likely it is indeed portraying this emotion," Heinzelman explained.
Previous research has shown that emotion classification systems are highly speaker dependent; they work much better if the system is trained by the same voice it will analyze. "This is not ideal for a situation where you want to be able to just run an experiment on a group of people talking and interacting, like the parents and teenagers we work with," Sturge-Apple explained.
Their new results also confirm this finding. If the speech-based emotion classification is used on a voice different from the one that trained the system, the accuracy dropped from 81 percent to about 30 percent. The researchers are now looking at ways of minimizing this effect, for example, by training the system with a voice in the same age group and of the same gender. As Heinzelman said, "there are still challenges to be resolved if we want to use this system in an environment resembling a real-life situation, but we do know that the algorithm we developed is more effective than previous attempts."
###
Na Yang was awarded a grant by the International Speech Communication Association to attend the SLT Workshop.
For more information on the project visit http://www.ece.rochester.edu/projects/wcng/project_bridge.html.
About the University of Rochester
The University of Rochester is one of the nation's leading private universities. Located in Rochester, N.Y., the University gives students exceptional opportunities for interdisciplinary study and close collaboration with faculty through its unique cluster-based curriculum. Its College, School of Arts and Sciences, and Hajim School of Engineering and Applied Sciences are complemented by its Eastman School of Music, Simon School of Business, Warner School of Education, Laboratory for Laser Energetics, School of Medicine and Dentistry, School of Nursing, Eastman Institute for Oral Health, and the Memorial Art Gallery.
Smartphones might soon develop emotional intelligence
An algorithm for speech-based emotion classification
2012-12-04
ELSE PRESS RELEASES FROM THIS DATE:
Webcams offer a low-cost way to tune lasers for serious science
2012-12-04
Every photon in a laser beam marches in lockstep, at an identical wavelength that depends on what the laser is used for – for example, infrared lasers that drive the optic fiber internet. For many applications, lasers need to be precisely tuned to those wavelengths, and the wavelength-measuring instruments can be more expensive than the lasers themselves. Now, using a handful of inexpensive components – including an off-the-shelf computer webcam and a small diffraction grating, a device for splitting and diffracting light into several beams – researchers have built a diffraction ...
Crucial step in AIDS virus maturation simulated for first time
2012-12-04
Barcelona, 04 December 2012. - Bioinformaticians at IMIM (Hospital del Mar Medical Research Institute) and UPF (Pompeu Fabra University) have used molecular simulation techniques to explain a specific step in the maturation of the HIV virions, i.e., how newly formed inert virus particles become infectious, which is essential in understanding how the virus replicates. These results, which have been published in the latest edition of PNAS, could be crucial to the design of future antiretrovirals.
HIV virions mature and become infectious as a result of the action of a protein ...
Brain Injury Symptoms May Persist Years Longer Than Previously Thought
2012-12-04
Brain injury symptoms may persist years longer than previously thought
Roughly 1.7 million people suffer traumatic brain injuries each year in the United States, according to the Centers for Disease Control and Prevention. In serious cases, TBI can result in permanent disabilities and may even be fatal. What's more, recent research suggests that even mild to moderate TBI symptoms may persist for years after an initial head trauma.
What is traumatic brain injury?
A traumatic brain injury occurs when a bump or blow to the head causes the brain to collide with the ...
NJ Bill Could Lead To Changes In Alimony Decisions
2012-12-04
NJ bill could lead to changes in alimony decisions
A new bill proposed in the New Jersey legislature has sparked conversations regarding alimony and prenuptial agreements in the state. The proposed law would alter the current standards used by judges in making determinations regarding both alimony and prenups.
The bill would change the way in which judges consider whether alimony should be awarded to one spouse or the other, and the appropriate payment. The law would eliminate some types of assets when calculating a spouse's income. The assets that would no longer ...
Charging Juveniles as Adults in Maryland: Jail Plans Spark Debate
2012-12-04
Charging Juveniles as Adults in Maryland: Jail Plans Spark Debate
Charging Juveniles as Adults in Maryland: Jail Plans Spark Debate
Maryland Governor Martin O'Malley says plans to build a controversial new juvenile detention facility in downtown Baltimore are "moving forward," according to a recent Baltimore Sun article. The proposed 120-bed facility will cost an estimated $70 million to construct and is intended to house juvenile offenders who have been charged as adults.
Currently, juveniles facing adult criminal charges are held in an annex of the ...
New Study Reports That Fewer Teens Are Drinking And Driving
2012-12-04
New study reports that fewer teens are drinking and driving
North Carolina residents are aware that teenage drunk driving is a serious problem. Fortunately, a new study reveals that the number of teens who drink and drive dropped by half between 1991 and 2011.
Driving under the influence declining among teens
According to the U.S. Centers for Disease Control and Prevention, nine out of 10 teens under age 16 said they did not drink and drive in 2011. This is a 54 percent decrease from 1991.
Although the CDC director notes that this is good news, it also means ...
Law Enforcement in Missouri Targets Synthetic Drugs
2012-12-04
Law Enforcement in Missouri Targets Synthetic Drugs
Law Enforcement in Missouri Targets Synthetic Drugs
A few years ago synthetic drugs emerged onto the shelves and counters of gas stations and convenience stores in Missouri and elsewhere across the country, and for a time the creation, distribution and use of the substances flew under the radar of law enforcement. As synthetic drug activity has been incorporated into traditional drug laws, federal and state authorities step up their efforts to police and prosecute those associated with synthetic drugs, particularly ...
New Beauty Magazine & GoodGirlPR to Host Beauty Bar Relief Event for Hurricane Sandy Survivors
2012-12-04
GoodGirlPR and New Beauty Magazine are excited to host a special beauty bar relief party. The event will bring an evening of pampering and Kamoni Ice cocktails along with complimentary Fancy Face makeovers, hairstyling by the Beauty Bar, and OPI manicures. Guests are invited to contribute monetary donations, canned goods, and clothing to help those affected by Hurricane Sandy.
Event Details:
Who: New Beauty Magazine & GoodGirlPR
What: Beauty Bar Relief Event
When: December 3, 2012, 6:30PM-9:30PM
Where: Blink Beauty, 32 Union Square E, Suite 311, ...
Success? Failure? Defeat? Victory? What's Your Story? Sometimes All That's Left for a Poor Man is his Story
2012-12-04
Pastor and Publishing author James Langston's book, Out of the Ashes, is receiving rave reviews. The book has ranked in the top 100 in tag categories "Jesus Christ," "Call to Salvation," and "Church Leadership."
Out of the Ashes takes readers on an exciting and thought provoking journey: a journey that touches the very essence of why Believers often face difficult and challenging situations. While none of us adore these trials of faith, in them, God is reshaping our lives for His service.
Langston writes, "I wish I could say that ...
TranZcenter -The Truth about the Transportation Industry
2012-12-04
TranZcenter -The Truth about the Transportation Industry.........
While many industries these days are struggling with the idea of reducing their workforce and facing cutbacks in order to survive these tough economic times, that is not the case in the trucking industry. This career field is seeing an impressive increase in the number of trucking jobs available, and Mr. Milton Collier believe there will be even more opportunities presented should the economy begin to rebound.
Reasons for Shortage
A number of factors have led to a shortage of truckers. One major ...
LAST 30 PRESS RELEASES:
Program takes aim at drinking, unsafe sex, and sexual assault on college campuses
Inability to pay for healthcare reaches record high in U.S.
Science ‘storytelling’ urgently needed amid climate and biodiversity crisis
KAIST Develops Retinal Therapy to Restore Lost Vision
Adipocyte-hepatocyte signaling mechanism uncovered in endoplasmic reticulum stress response
Mammals were adapting from life in the trees to living on the ground before dinosaur-killing asteroid
Low LDL cholesterol levels linked to reduced risk of dementia
Thickening of the eye’s retina associated with greater risk and severity of postoperative delirium in older patients
Almost one in ten people surveyed report having been harmed by the NHS in the last three years
Enhancing light control with complex frequency excitations
New research finds novel drug target for acute myeloid leukemia, bringing hope for cancer patients
New insight into factors associated with a common disease among dogs and humans
Illuminating single atoms for sustainable propylene production
New study finds Rocky Mountain snow contamination
Study examines lactation in critically ill patients
UVA Engineering Dean Jennifer West earns AIMBE’s 2025 Pierre Galletti Award
Doubling down on metasurfaces
New Cedars-Sinai study shows how specialized diet can improve gut disorders
Making moves and hitting the breaks: Owl journeys surprise researchers in western Montana
PKU Scientists simulate the origin and evolution of the North Atlantic Oscillation
ICRAFT breakthrough: Unlocking A20’s dual role in cancer immunotherapy
How VR technology is changing the game for Alzheimer’s disease
A borrowed bacterial gene allowed some marine diatoms to live on a seaweed diet
Balance between two competing nerve proteins deters symptoms of autism in mice
Use of antifungals in agriculture may increase resistance in an infectious yeast
Awareness grows of cancer risk from alcohol consumption, survey finds
The experts that can outsmart optical illusions
Pregnancy may reduce long COVID risk
Scientists uncover novel immune mechanism in wheat tandem kinase
Three University of Virginia Engineering faculty elected as AAAS Fellows
[Press-News.org] Smartphones might soon develop emotional intelligenceAn algorithm for speech-based emotion classification