Best way to bust deepfakes? Use AI to find real signs of life, say Klick Labs scientists

Researchers identify audio deepfakes with new algorithm and vocal biomarkers

2024-03-21

(Press-News.org) NEW YORK, NY / TORONTO, ON – March, 21, 2024 – Artificial intelligence may make it difficult for even the most discerning ears to detect deepfake voices – as recently evidenced in the fake Joe Biden robocall and the bogus Taylor Swift cookware ad on Meta – but scientists at Klick Labs say the best approach might actually come down to using AI to look for what makes us human.

Inspired by their clinical studies using vocal biomarkers to help enhance health outcomes, and their fascination with sci-fi films like “Blade Runner,” the Klick researchers created an audio deepfake detection method that taps into signs of life, such as breathing patterns and micropauses in speech.

“Our findings highlight the potential to use vocal biomarkers as a novel approach to flagging deepfakes because they lack the telltale signs of life inherent in authentic content,” said Yan Fossat, senior vice president of Klick Labs and principal investigator of the study. “These signs are usually undetectable to the human ear, but are now discernible thanks to machine learning and vocal biomarkers.”

‘Investigation of Deepfake Voice Detection using Speech Pause Patterns: Algorithm Development and Validation,’ published today in the open-access journal JMIR Biomedical Engineering, describes how vocal biomarkers, along with machine learning, can be used to distinguish between deepfakes and authentic audio with reliable precision. As part of the study, Fossat and his team at Klick Labs looked at 49 participants from diverse backgrounds and accents. Deepfake models were then trained on voice samples provided by the participants, and deepfake audio samples were generated for each person. After analyzing speech pause metrics, the scientists discovered their models could distinguish between the real and fakes with approximately 80 percent accuracy.

These findings follow recent high-profile voice cloning scams, Meta’s announced plan to introduce AI-generated content labels, and the Federal Communications Commission’s February ruling to make deepfake voices in robocalls illegal. In December, a PBS NewsHour report cited public policy and AI experts’ concerns that deepfake usage will increase with the upcoming U.S. presidential election.

While the new study offers one solution to this growing problem, Fossat acknowledged the need to keep evolving detection technology as deepfakes become more and more realistic.

Today’s news highlights Klick’s ongoing work in vocal biomarkers and AI. In October, it announced groundbreaking research in Mayo Clinic Proceedings: Digital Health around the AI model it created to detect Type 2 diabetes using 10 seconds of voice.

About Klick Applied Sciences (including Klick Labs)

Klick Applied Sciences’ diverse team of data scientists, engineers, and biological scientists conducts scientific research and develops AI/ML and software solutions as part of the company’s work to support commercial efforts using its proven business, scientific, medical, and technological expertise. Its 2019 Voice Assistants Medical Name Comprehension study laid the scientific foundation for rigorously testing voice assistant consumer devices in a controlled manner. Klick Applied Sciences is part of the Klick Group of companies, which also includes Klick Health (including Klick Katalyst and btwelve), Klick Media Group, Klick Consulting, Klick Ventures, and Sensei Labs. Established in 1997, Klick has offices in New York, Philadelphia, Toronto, London, São Paulo, and Singapore. Klick has consistently been ranked a Best Managed Company, Great Place to Work, Best Workplace for Women, Best Workplace for Inclusion, Best Workplace for Professional Services, and Most Admired Corporate Culture.

For more information, or a copy of the abstract, please contact Klick PR at pr@klick.com or 416-214-4977.

Kulangareth NV, Kaufman J, Oreskovic J, Fossat Y

Investigation of Deepfake Voice Detection Using Speech Pause Patterns: Algorithm Development and Validation

JMIR Biomed Eng 2024;9:e56245

URL: https://biomedeng.jmir.org/2024/1/e56245/

doi: 10.2196/56245

END

ELSE PRESS RELEASES FROM THIS DATE:

The protein that protects insulin-producing cells

2024-03-21

Although there are many differences between type 1 diabetes and type 2 diabetes, there are also similarities, such as inflammation of the insulin-producing cells. Researchers at Lund University have studied a protein called C3, which plays a central role in the body’s immune system. The protein is secreted from cells and is found in large quantities in the blood. Previous studies by the same researchers have shown that C3 is also present inside cells and plays an important role there. Now, their latest study in PNAS shows that the protein C3 protects insulin-producing cells from damage and death when it is present ...

World’s first N-channel diamond field-effect transistor

2024-03-21

1. A NIMS research team has developed the world’s first n-channel diamond MOSFET (metal-oxide-semiconductor field-effect transistor). The developed n-channel diamond MOSFET provides a key step toward CMOS (complementary metal-oxide-semiconductor: one of the most popular technologies in the computer chip) integrated circuits for harsh-environment- applications as well as the development of diamond power electronics. 2. Semiconductor diamond has outstanding physical properties such as ultra wide-bandgap energy of 5.5 eV, high carriers mobilities, ...

Adults younger than 40 with ideal heart health had lower heart disease, stroke, and kidney disease risk

2024-03-21

Research Highlights: A study of nearly 4 million young adults under age 40 in South Korea found that those who had ideal cardiovascular health were nearly two-thirds less likely to develop heart disease, stroke and/or kidney disease during a 12-year follow-up period. Adults who had low heart health scores at study baseline in 2009-2010 but improved their cardiovascular health thereafter also had a reduced risk of heart disease, stroke or kidney disease compared to people with persistent low heart health scores. Embargoed until 10:30 a.m. CT/11:30 a.m. ET, Thursday, March 21, 2024 CHICAGO, March 21, 2024 — An ...

CZI launches AI Advisory Group and residency program to accelerate development of virtual cell models

2024-03-21

Today, the Chan Zuckerberg Initiative (CZI) announced several key appointments and a new AI residency program to advance the organization’s AI strategy for science, which is focused on building predictive models of healthy and diseased cells. Several AI experts from academia and industry have joined a newly established AI Advisory Group, which will provide guidance to leaders at CZI and across the Chan Zuckerberg Biohub Network as these organizations work to enable AI at scale for nonprofit life science research. In addition, CZI is launching an AI residency program to develop foundational AI/ML models and tools that will enable ...

Natural molecule found in coffee and human body increases NAD+ levels, improves muscle function during ageing

2024-03-21

A research consortium led by Nestlé Research in Switzerland and the Yong Loo Lin School of Medicine, National University of Singapore (NUS Medicine) made a recent discovery that the natural molecule trigonelline present in coffee, fenugreek, and also in the human body, can help to improve muscle health and function. In an international collaboration among the University of Southampton, University of Melbourne, University of Tehran, University of South Alabama, University of Toyama and University of Copenhagen, the work builds on a previous collaborative ...

As we age, our cells are less likely to express longer genes

2024-03-21

Aging may be less about specific “aging genes” and more about how long a gene is. Many of the changes associated with aging could be occurring due to decreased expression of long genes, say researchers in an opinion piece publishing March 21 in the journal Trends in Genetics. A decline in the expression of long genes with age has been observed in a wide range of animals, from worms to humans, in various human cell and tissue types, and also in individuals with neurodegenerative disease. Mouse experiments show that the phenomenon can be mitigated via known anti-aging factors, including dietary restriction. “If you ask me, this ...

Researchers name prehistoric amphibian ancestor discovered in Smithsonian collection after Kermit the Frog

2024-03-21

Scientists have uncovered the fossilized skull of a 270-million-year-old ancient amphibian ancestor in the collection of the Smithsonian’s National Museum of Natural History. In a paper published today, March 21, in the Zoological Journal of the Linnean Society, the team of researchers described the fossil as a new species of proto-amphibian, which they named Kermitops gratus in honor of the iconic Muppet, Kermit the Frog. According to Calvin So, a doctoral student at the George Washington University and the lead author on the new paper, naming the new creature after the beloved frog character, who was created ...

Better cancer trials could be around the corner

2024-03-21

Cold Spring Harbor Laboratory Associate Professor and Cancer Center member Tobias Janowitz led a COVID-19 clinical trial with Northwell Health in 2021. When he and Clinical Fellow Hassal Lee reviewed the data, a surprising trend emerged. “The patient roster was very diverse,” Janowitz explains. “We’d made no deliberate effort toward that other than conducting the trial remotely.” When it comes to cancer trials, many variables impact patient participation. One measurable factor is distance. On average, people are less likely to ...

Long-term body mass index variability and adverse cardiovascular outcomes

2024-03-21

About The Study: This analysis including 157,000 individuals from two large study cohorts found that among U.S. veterans, higher body mass index (BMI) variability was a significant risk marker associated with adverse cardiovascular events independent of mean BMI across major racial and ethnic groups. Results were consistent in the UK Biobank for the cardiovascular death end point. Further studies should investigate the phenotype of high BMI variability. Authors: Yan V. Sun, Ph.D., M.S., ...

Postconcussive symptoms after early childhood concussion

2024-03-21

About The Study: In this early childhood study including 303 children, concussion was associated with more postconcussive symptoms than orthopedic injuries or typical development up to three months after injury. Given the limited verbal and cognitive abilities typical of early childhood, using developmentally appropriate manifestations and behaviors is a valuable way of tracking postconcussive symptoms and could aid in concussion diagnosis in young children. Authors: Miriam Beauchamp, Ph.D., of the Universite de Montreal, is the corresponding author. To access the embargoed study: Visit our For The Media website at ...

LAST 30 PRESS RELEASES:

Tambourine Philanthropies commits over $5 million in new funding for research into ALS, in partnership with the Milken Institute

E-bike incentives prove to be worth the investment

Trotting robots reveal emergence of animal gait transitions

Lundquist investigator Dr. Ashraf Ibrahim is the lead author in the landmark study on pioneering oral fungal infection treatment showing promise in preclinical trials

Deep-learning decoding for a noninvasive brain-computer interface

Elucidating the role of a shared lncRNA-miRNA-mRNA network in exacerbating Parkinson’s disease symptoms in the context of COVID-19 infection

American College of Lifestyle Medicine announces unique screening tool for clinicians to efficiently assess patient dietary patterns

Unlocking the genetic mysteries behind plant adaptation: New insights into the evolution of a water-saving trait in the pineapple family (bromeliaceae)