(Press-News.org) Recent advancements in speech emotion recognition have highlighted the significant potential of deep learning technologies across various applications. However, these deep learning models are susceptible to adversarial attacks. A team of researchers at the University of Milan systematically evaluated the impact of white-box and black-box attacks on different languages and genders within speech emotion recognition. The research was published May 27 in Intelligent Computing, a Science Partner Journal.
The research underscores the considerable vulnerability of convolutional neural network long short-term memory models to adversarial examples, which are carefully designed “perturbed” inputs that lead models to produce erroneous predictions. The findings indicate that all considered adversarial attacks can significantly reduce the performance of speech emotion recognition models. According to the authors, the susceptibility of these models to adversarial attacks “could trigger serious consequences."
The researchers proposed a methodology for audio data processing and feature extraction that is tailored to the convolutional neural network long short-term memory architecture. They examined three datasets, EmoDB for German, EMOVO for Italian and RAVDESS for English. They utilized the Fast Gradient Sign Method, the Basic Iterative Method, DeepFool, the Jacobian-based Saliency Map Attack and Carlini and Wagner for white-box attacks and the One-Pixel Attack and Boundary Attack for black-box scenarios.
The black-box attacks, especially the Boundary Attack, achieved impressive results despite their limited access to the internal workings of the models. Even though the white-box attacks had no such limitations, the black-box attacks sometimes outperformed them; that is, they generated adversarial examples with superior performance and lower disruption. The authors said, "These observations are alarming as they imply that attackers can potentially achieve remarkable results without any understanding of the model’s internal operation, simply by scrutinizing its output."
The research incorporated a gender-based perspective to investigate the differential impacts of adversarial attacks on male and female speech as well as on speech in different languages. In evaluating the impacts of attacks across three languages, only minor performance differences were observed. English appeared the most susceptible while Italian displayed the highest resistance. The detailed examination of male and female samples indicated a slight superiority in male samples, which exhibited marginally lesser accuracy and perturbation, particularly in white-box attack scenarios. However, the variations between male and female samples were negligible.
"We devised a pipeline to standardize samples across the 3 languages and extract log-Mel spectrograms. Our methodology involved augmenting datasets using pitch shifting and time stretching techniques while maintaining a maximum sample duration of 3 seconds," the authors explained. Additionally, to ensure methodological consistency, the team used the same convolutional neural network long short-term memory architecture for all experiments.
While the publication of research revealing vulnerabilities in speech emotion recognition models might seem like it could provide attackers with valuable information, not sharing these findings could potentially be more detrimental. Transparency in research allows both attackers and defenders to understand the weaknesses in these systems. By making these vulnerabilities known, researchers and practitioners can better prepare and fortify their systems against potential threats, ultimately contributing to a more secure technological landscape.
END
Researchers expose vulnerability of speech emotion recognition models to adversarial attacks
2024-08-09
ELSE PRESS RELEASES FROM THIS DATE:
Classical music lifts our mood by synchronizing our “extended amygdala”
2024-08-09
Whether Bach, Beethoven, or Mozart, it’s widely recognized that classical music can affect a person’s mood. In a study published August 9 in the Cell Press journal Cell Reports, scientists in China use brainwave measurements and neural imaging techniques to show how Western classical music elicits its positive effects on the brain. Their goal is to find more effective ways to use music to activate the brain in those who otherwise don’t respond, such as people with treatment-resistant depression.
“Our research integrates the fields of neuroscience, psychiatry, and ...
New technology uses light to engrave erasable 3D images
2024-08-09
Imagine if physicians could capture three-dimensional projections of medical scans, suspending them inside an acrylic cube to create a hand-held reproduction of a patient's heart, brain, kidneys, or other organs. Then, when the visit is done, a quick blast of heat erases the projection and the cube is ready for the next scan.
A new report in the journal Chem by researchers at Dartmouth and Southern Methodist University (SMU) outlines a technical breakthrough that could enable such scenarios, and others with widespread utility.
The study introduces a technique that uses a specialized ...
How did mental health parity laws affect new moms?
2024-08-09
Pregnant and postpartum women with depression and anxiety have a slightly better chance of getting psychotherapy these days, a new study finds. And they are paying less of their own money when they do.
The changes in care and cost happened mainly after the Affordable Care Act took effect in 2014, and to a lesser extent after the Mental Health Parity and Addiction Equity Act, or MHPAEA, took effect in 2010, the analysis shows.
Both laws aimed at reducing insurance-related barriers to mental health care.
Even so, only about 10% of women with private insurance ...
Universal free school meals and school and student outcomes
2024-08-09
About The Study: In this systematic review, universal free school meals were associated with increased meal participation, no or slight improvements in attendance, and decreased obesity prevalence and suspension rates; certainty of evidence was moderate for lunch participation and low or very low for other outcomes. Studies did not report several important outcomes, such as diet quality and food security, suggesting the need for more high-quality research encompassing policy-relevant indicators.
Corresponding Author: To ...
Researchers crack a key celiac mystery
2024-08-09
People with celiac disease must navigate everyday life by avoiding gluten, a protein in wheat, rye and barley which can trigger painful symptoms in the gut, impede the absorption of nutrients and raise the risk of other serious long-term issues.
The autoimmune disorder affects about 1 per cent of the population. Its rate of occurrence has roughly doubled in the past 25 years, but there is no treatment available.
An interdisciplinary team of medical and engineering researchers centred at Canada’s McMaster University and including colleagues from the US, Australia, and Argentina, has spent the ...
Continuing climate warming trend and pronounced interannual variability in precipitation in the Three Gorges Region in 2022–2023
2024-08-09
The Three Gorges Region of the Yangtze River (TGR) in China has a unique geographical location, complex geomorphological features, and a fragile and sensitive climate. The Three Gorges Project, as a large-scale comprehensive water conservancy hub project in the region, has not only greatly changed the nature, society and economy of the area, but also brought great benefits and created problems, such as environmental and climatic impacts. Therefore, it is of great importance to conduct climate and environmental monitoring in the region.
Recently, a team led by Chen Xianyan, a Professor at ...
Is doping of Spiro-OMeTAD a requirement for efficient and stable perovskite indoor photovoltaics?
2024-08-09
In this work, we study the outdoor and indoor photovoltaic performance of LHP-based devices utilizing Spiro-OMeTAD as the hole-transport material with commonly used dopants such as lithium bis(trifluoromethanesulfonyl)imide (Li-TFSI) or without any dopants. We find out that, despite the expected low performance of devices employing undoped Spiro-OMeTAD layer under 1-Sun illumination (up to 7.7% efficiency), the devices achieve up to 25.6% efficiency under 1000 lux illumination, which is comparable to the doped counterpart devices achieving up to 29.7% efficiency. This is mainly due to the major improvement in fill factor when going towards low-light ...
HKUST engineering researchers enhance perovskite solar cells durability with first-of-its-kind chiral-structured “springy” interface
2024-08-09
A research team led by the School of Engineering of the Hong Kong University of Science and Technology (HKUST) has constructed an unprecedented chiral-structured interface in perovskite solar cells, which enhances the reliability and power conversion efficiency of this fast-advancing solar technology and accelerates its commercialization.
A perovskite solar cell (PSC) is a type of solar cell that includes perovskite-structured compound materials, which are inexpensive to produce and simple to manufacture. Unlike conventional silicon solar cells that require expensive high-temperature, high-vacuum fabrication processes, perovskites can ...
GSA announces 2024 Award Winners honoring excellence in geoscience
2024-08-09
Boulder, Colo., USA: The Geological Society of America (GSA) is proud to announce the recipients of the 2024 GSA Awards, recognizing outstanding contributions to the geoscience community. Each awardee has demonstrated exceptional dedication, innovation, and impact in their respective fields.
GSA President’s Medal
Kathy Jefferson Bancroftis, a Paiute-Shoshone community leader and environmental protector, is honored for her advocacy and education on water misuse and environmental degradation in the Owens Valley, ...
Retrotransposon DNA zip code for myeloma cell internalization
2024-08-09
“GT is a fascinating evolutionary phenomenon observed in lower species and humans, albeit with differing impacts and mechanisms.”
BUFFALO, NY- August 9, 2024 – A new editorial was published in Oncoscience (Volume 11) on July 13, 2024, entitled, “Unveiling retrotransposon-derived DNA zip code for myeloma cell internalization.”
The complex interplay between extracellular genetic material and the tumor's genetic landscape presents a significant challenge in grasping cancer evolution, tumor genetic heterogeneity, and treatment response. Earlier research has revealed the role of circulating tumor DNA (ctDNA) in mediating the gene expression among ...