(Press-News.org) A groundbreaking technology that can recognize human emotions in real time has been developed by Professor Jiyun Kim and his research team in the Department of Material Science and Engineering at UNIST. This innovative technology is poised to revolutionize various industries, including next-generation wearable systems that provide services based on emotions.
Understanding and accurately extracting emotional information has long been a challenge due to the abstract and ambiguous nature of human affects such as emotions, moods, and feelings. To address this, the research team has developed a multi-modal human emotion recognition system that combines verbal and non-verbal expression data to efficiently utilize comprehensive emotional information.
At the core of this system is the personalized skin-integrated facial interface (PSiFI) system, which is self-powered, facile, stretchable, and transparent. It features a first-of-its-kind bidirectional triboelectric strain and vibration sensor that enables the simultaneous sensing and integration of verbal and non-verbal expression data. The system is fully integrated with a data processing circuit for wireless data transfer, enabling real-time emotion recognition.
Utilizing machine learning algorithms, the developed technology demonstrates accurate and real-time human emotion recognition tasks, even when individuals are wearing masks. The system has also been successfully applied in a digital concierge application within a virtual reality (VR) environment.
The technology is based on the phenomenon of “friction charging,” where objects separate into positive and negative charges upon friction. Notably, the system is self-generating, requiring no external power source or complex measuring devices for data recognition.
Professor Kim commented, “Based on these technologies, we have developed a skin-integrated face interface (PSiFI) system that can be customized for individuals.” The team utilized a semi-curing technique to manufacture a transparent conductor for the friction charging electrodes. Additionally, a personalized mask was created using a multi-angle shooting technique, combining flexibility, elasticity, and transparency.
The research team successfully integrated the detection of facial muscle deformation and vocal cord vibrations, enabling real-time emotion recognition. The system’s capabilities were demonstrated in a virtual reality “digital concierge” application, where customized services based on users’ emotions were provided.
Jin Pyo Lee, the first author of the study, stated, “With this developed system, it is possible to implement real-time emotion recognition with just a few learning steps and without complex measurement equipment. This opens up possibilities for portable emotion recognition devices and next-generation emotion-based digital platform services in the future.”
The research team conducted real-time emotion recognition experiments, collecting multimodal data such as facial muscle deformation and voice. The system exhibited high emotional recognition accuracy with minimal training. Its wireless and customizable nature ensures wearability and convenience.
Furthermore, the team applied the system to VR environments, utilizing it as a “digital concierge” for various settings, including smart homes, private movie theaters, and smart offices. The system’s ability to identify individual emotions in different situations enables the provision of personalized recommendations for music, movies, and books.
Professor Kim emphasized, “For effective interaction between humans and machines, human-machine interface (HMI) devices must be capable of collecting diverse data types and handling complex integrated information. This study exemplifies the potential of using emotions, which are complex forms of human information, in next-generation wearable systems.”
The research was conducted in collaboration with Professor Lee Pui See of Nanyang Technical University in Singapore and was supported by the National Research Foundation of Korea (NRF) and the Korea Institute of Materials (KIMS) under the Ministry of Science and ICT. The study was published online on January 15 in Nature Communications.
Journal Reference
Jin Pyo Lee, Hanhyeok Jang, Yeonwoo Jang, et al., “Encoding of multi-modal emotional information via personalized skin-integrated wireless facial interface,” Nat. Commun., (2024).
END
World’s first real-time wearable human emotion recognition technology developed!
2024-02-22
[Attachments] See images for this press release:
ELSE PRESS RELEASES FROM THIS DATE:
MD Anderson acquires inducible switch technologies for cell therapy
2024-02-22
HOUSTON ― The University of Texas MD Anderson Cancer Center today announced it has acquired certain assets from Bellicum Pharmaceuticals, Inc. related to the CaspaCIDe® switch platform and the GoCAR® platform. The transaction also includes clinical-grade stocks of rimiducid, an agent used to trigger the switches.
As a result of this acquisition, MD Anderson may incorporate these platforms into its own cell therapy programs. The institution also intends to make the technology ...
UTSA doctoral student studies solutions to prevent contaminated water sources
2024-02-22
From Bangladesh to India to Texas, Tom Varner is leveraging his research to improve sources for drinking water around the world.
Varner, a UTSA doctoral student in environmental science and engineering, explored the mobility of arsenic from the sediments surrounding the Meghna River in Bangladesh as part of a National Science Foundation-funded project.
The river flows through central Bangladesh, where elevated concentrations of arsenic in the groundwater threaten the welfare of millions of people. Long-term exposure to arsenic, which is toxic when ingested, can lead ...
Treating newly-diagnosed Crohn’s patients with advanced therapy leads to dramatic improvements in outcomes
2024-02-22
A large-scale clinical trial of treatment strategies for Crohn’s disease has shown that offering early advanced therapy to all patients straight after diagnosis can drastically improve outcomes, including by reducing the number of people requiring urgent abdominal surgery for treatment of their disease by ten-fold.
The PROFILE trial, led by researchers at the University of Cambridge, involved 386 patients with newly-diagnosed active Crohn’s disease. Recruiting from 40 hospitals across the UK, and supported by the National Institute for Health and Care Research (NIHR) Clinical Research Network, it sought to test whether a biomarker – a genetic signature ...
Uncovering anxiety: Scientists identify causative pathway and potential cures
2024-02-22
Anxiety-related disorders can have a profound impact on the mental health and quality of life of affected individuals. Understanding the neural circuits and molecular mechanisms that trigger anxiety can aid in the development of effective targeted pharmacological treatments. Delta opioid receptors (DOP), which localize in the regions of the brain associated with emotional regulation, play a key role in the development of anxiety. Several studies have demonstrated the therapeutic effects of DOP agonists (synthetic compounds which selectively bind to DOPs and mimic the effect of ...
Stronger storms free more nutrients from mud flats
2024-02-22
If storms become stronger in the future due to climate change, more nitrogen may be released from the bottom of coastal seas. This is shown by research of marine biogeochemist Dunia Rios-Yunes at NIOZ in Yerseke. Rios-Yunes will defend her PhD-thesis today at the University of Utrecht. “The dynamics of nutrients in deltas and estuaries have been a bit of a blind spot for marine science, so far”, she says.
Inflatable couch
For her experiments, Rios-Yunes spent many hours on an inflatable couch on ...
New study is first step in predicting carbon emissions in agriculture
2024-02-22
MINNEAPOLIS / ST. PAUL (02/19/2024)—For the first time, researchers at the University of Minnesota Twin Cities (UMN) and the University of Illinois Urbana-Champaign (UIUC) have demonstrated that it is possible to provide accurate, high-resolution predictions of carbon cycles in agroecosystems, which could help mitigate the impacts of climate change.
The study by scholars from the UMN-led National Artificial Intelligence Institute for Climate-Land Interactions, Mitigation, Adaptation, Tradeoffs and Economy (AI-CLIMATE) and UIUC-led Agroecosystem Sustainability ...
Air pollution hides increases in rainfall
2024-02-22
We know that greenhouse gas emissions like carbon dioxide should increase rainfall. The emissions heat the atmosphere, causing a one-two punch: warmer oceans make it easier for water to evaporate, and warmer air can hold more water vapor, meaning more moisture is available to fall as rain. But for much of the 20th century, that increase in precipitation didn’t clearly show up in the data.
A new study led by researchers at the Department of Energy’s Lawrence Berkeley National Laboratory (Berkeley ...
Damage to cell membranes causes cell aging
2024-02-22
Our cells are surrounded by a fragile membrane that’s only 5 nanometers thick, 1/20 of a soap bubble. Cells are easily damaged by physiological activities, including muscle contraction and tissue injury. To cope with such damage, cells are equipped with mechanisms that can repair membrane damage to a certain degree.
Mechanical damage to the cell membrane was previously believed to trigger two simple cellular outcomes: recovery or death. In this study, however, the researchers uncovered a third outcome – cellular senescence.
“When I started this project, I simply aimed to understand ...
Mice surprise: Australian researchers discover new native species
2024-02-22
Australia can lay claim to two new species of native rodent thanks to a study from The Australian National University (ANU).
The aptly named delicate mouse was previously thought to be a single species spanning a massive stretch of the country from the Pilbara in Western Australia, across parts of the Northern Territory and through Queensland down to the New South Wales border.
But researchers at ANU and CSIRO thought there might be more to the story.
Lead author Dr Emily Roycroft, from ANU, said we now know there ...
Latest research redefines neurodevelopmental risks, outcomes for congenital heart disease
2024-02-22
Statement Highlights:
A new American Heart Association scientific statement updates more than a decade of research identifying, managing and preventing neurodevelopmental delays and disorders among people with congenital heart disease.
The new statement outlines important changes since the Association’s last statement in 2012, such as revised criteria to determine which children and adults are at high risk for neurological developmental delays and disorders, as well as an updated list of factors that may increase the risk.
Critical next ...