PRESS-NEWS.org - Press Release Distribution
PRESS RELEASES DISTRIBUTION

Navigating the labyrinth: How AI tackles complex data sampling

2024-06-24
(Press-News.org)

The world of artificial intelligence (AI) has recently seen significant advancements in generative models, a type of machine-learning algorithms that “learn” patterns from set of data in order to generate new, similar sets of data. Generative models are often used for things like drawing images and natural language generation – a famous example are the models used to develop chatGPT.

Generative models have had remarkable success in various applications, from image and video generation to composing music and to language modeling. The problem is that we are lacking in theory, when it comes to the capabilities and limitations of generative models; understandably, this gap can seriously affect how we develop and use them down the line.

One of the main challenges has been the ability to effectively pick samples from complicated data patterns, especially given the limitations of traditional methods when dealing with the kind of high-dimensional and complex data commonly encountered in modern AI applications.

Now, a team of scientists led by Florent Krzakala and Lenka Zdeborová at EPFL has investigated the efficiency of modern neural network-based generative models. The study, now published in PNAS, compares these contemporary methods against traditional sampling techniques, focusing on a specific class of probability distributions related to spin glasses and statistical inference problems.

The researchers analyzed generative models that use neural networks in unique ways to learn data distributions and generate new data instances that mimic the original data.

The team looked at flow-based generative models, which learn from a relatively simple distribution of data and “flow” to a more complex one; diffusion-based models, which remove noise from data; and generative autoregressive neural networks, which generate sequential data by predicting each new piece based on the previously generated ones.

The researchers employed a theoretical framework to analyze the performance of the models in sampling from known probability distributions. This involved mapping the sampling process of these neural network methods to a Bayes optimal denoising problem – essentially, they compared how each model generates data by likening it to a problem of removing noise from information.

The scientists drew inspiration from the complex world of spin glasses, materials with intriguing magnetic behavior, to analyze modern data generation techniques. This allowed them to explore how neural network-based generative models navigate the intricate landscapes of data.

The approach allowed them to study the nuanced capabilities and limitations of the generative models against more traditional algorithms like Monte Carlo Markov Chains (algorithms used to generate samples from complex probability distributions) and Langevin Dynamics (a technique for sampling from complex distributions by simulating the motion of particles under thermal fluctuations).

The study revealed that modern diffusion-based methods may face challenges in sampling due to a first-order phase transition in the algorithm’s denoising path. What this means is that they can run into problems because of sudden change in how they remove noise from the data they're working with. Despite identifying regions where traditional methods outperform, the research also highlighted scenarios where neural network-based models exhibit superior efficiency.

This nuanced understanding offers a balanced perspective on the strengths and limitations of both traditional and contemporary sampling methods. The research is a guide to more robust and efficient generative models in AI; by providing a clearer theoretical foundation, it can help develop next-generation neural networks capable of handling complex data generation tasks with unprecedented efficiency and accuracy.

Reference

Davide Ghio, Yatin Dandi, Florent Krzakala, Lenka Zdeborovà. Sampling with flows, diffusion and autoregressive neural networks: A spin-glass perspective. PNAS 24 June 2024. DOI: 10.1073/pnas.2311810121

END



ELSE PRESS RELEASES FROM THIS DATE:

Hydrothermal vents on seafloors of ‘ocean worlds’ could support life, new study says

Hydrothermal vents on seafloors of ‘ocean worlds’ could support life, new study says
2024-06-24
We’ve all seen the surreal footage in nature documentaries showing hydrothermal vents on the frigid ocean floor—bellowing black plumes of super-hot water—and the life forms that cling to them. Now, a new study by UC Santa Cruz researchers suggests that lower-temperature vents, which are common across Earth's seafloor, may help to create life-supporting conditions on "ocean worlds" in our solar system. Ocean worlds are planets and moons that have—or had in the past—a liquid ocean, often under an icy shell or within their rocky interior. In Earth's solar system, several of Jupiter's and Saturn's moons are ocean worlds, and ...

New USF study: Mindfulness and managing emotions lead to better sleep

New USF study: Mindfulness and managing emotions lead to better sleep
2024-06-24
Media Contact: John Dudley (814) 490-3290 (cell) jjdudley@usf.edu TAMPA, Fla. (June 24, 2024) – Mindfulness – focusing on the present moment – can improve sleep, reduce stress and improve overall health. A new University of South Florida-led study helps explain why. Researchers studied 144 nurses over two weeks to see how well they could stay focused on the present and how often they fixated on negative thoughts. The nurses completed surveys three times a day and reported their sleep quality the following morning. The findings shed light on how mindfulness relates to emotion ...

JACC to serve cardiovascular community, shape future under new editor

2024-06-24
The first issue of JACC, the flagship journal of the American College of Cardiology, under new Editor-in-Chief Harlan M. Krumholz, MD, SM, FACC, publishes today, ushering in a new era of one of the world’s leading scholarly journals. “I envision JACC, with all its strengths, as a transformative platform for building community, elevating strong science, influencing clinical practice, supporting career development, and improving patient outcomes.” Krumholz said in his Editor’s Page. “JACC and its group of journals can play a pivotal role in serving our community and shaping the future.” Under his editorship, JACC will be guided by ...

Revived technology used to count individual photons from distant galaxies

Revived technology used to count individual photons from distant galaxies
2024-06-24
Using an instrument on the 4.1-meter Southern Astrophysical Research Telescope, researchers obtained the first astronomical spectrum using skipper charge-coupled devices (CCDs). The results were presented on June 16 at the Society of Photo-Optical Instrumentation Engineers Astronomical Telescopes + Instrumentation meeting in Japan by Edgar Marrufo Villalpando, a physics PhD candidate at the University of Chicago and a Fermilab DOE Graduate Instrumentation Research Award Fellow. “This is a major milestone for skipper-CCD technology,” said Alex Drlica-Wagner, a cosmologist at the U.S. Department of Energy’s Fermi ...

U of T researchers develop RNA-targeting technology for precisely manipulating parts of human genes

U of T researchers develop RNA-targeting technology for precisely manipulating parts of human genes
2024-06-24
Researchers at the University of Toronto have harnessed a bacterial immune defense system, known as CRISPR, to efficiently and precisely control the process of RNA splicing. The technology opens the door to new applications, including systematically interrogating the functions of parts of genes and correcting splicing deficiencies that underlie numerous diseases and disorders. “Almost all human genes produce RNA transcripts that undergo the process of splicing, whereby coding segments, called exons, are joined together and non-coding segments, called introns, are removed and typically degraded,” said Jack Daiyang Li, first author on the study and PhD student ...

NexusXp™ – SLAS’s new interactive pavilion at SLAS2025 will showcase automation integration and collaboration

NexusXp™ – SLAS’s new interactive pavilion at SLAS2025 will showcase automation integration and collaboration
2024-06-24
Oak Brook, IL – The Society for Laboratory Automation and Screening (SLAS) will launch NexusXp, its new interactive pavilion at SLAS2025 to showcase collaborative and integrated lab automation scenarios. NexusXp combines Nexus, the Latin word for link or connection where multiple elements meet, with the modern “Xp” to signify the “Xperience” of making that critical link or connection. Through this new pavilion, SLAS will demonstrate how automation integration transforms research and enables scientific breakthroughs. “NexusXp is an exclusive event or attendee ...

Engineers developing atom-thick material for efficient, ultrafast, light-based electronics

Engineers developing atom-thick material for efficient, ultrafast, light-based electronics
2024-06-24
AMES, Iowa – A Google Cloud video takes you inside a company data center in southwest Iowa’s Council Bluffs.   There you are, in the middle of a long, industrial corridor. You slowly move past rack after rack after rack of the computer servers that are, Google says, “helping to keep the internet humming 24/7.”   Part of that hum is the power that keeps those data centers up and running.   “Think about when you use your computer,” said Matthew ...

Study reveals same genes that can drive cancer also guide neural-circuit growth

Study reveals same genes that can drive cancer also guide neural-circuit growth
2024-06-24
LAWRENCE — Many people are familiar with oncogenes — genes long known to be involved in cancers in humans, such as the gene “Src.”  What’s less widely understood is that oncogenes didn’t evolve just to cause cancer in species, but rather to control events of normal growth and differentiation. “As an organism grows from a single fertilized egg to form all the different tissue types, these oncogenes, including Src, evolved to control these normal events,” said Erik Lundquist, professor of molecular ...

Leveraging gold nanostars for precision laser interstitial thermal therapy

Leveraging gold nanostars for precision laser interstitial thermal therapy
2024-06-24
“Gold nanostars amplify brain-tumor selective laser interstitial thermal therapy.” BUFFALO, NY- June 24, 2024 – A new editorial paper was published in Oncotarget's Volume 15 on June 14, 2024, entitled, “Leveraging gold nanostars for precision laser interstitial thermal therapy.” In this new editorial, researchers Aden P. Haskell-Mendoza, Ethan S. Srinivasan, Tuan Vo-Dinh and Peter E. Fecci from Duke University discuss laser interstitial thermal therapy (LITT). Over the past decade, LITT has become an important tool for the neurosurgical treatment of a variety of intracranial pathologies, including focal epilepsies, vascular malformations, and ...

Biodiversity loss from 2010 oil spill worse than predicted

Biodiversity loss from 2010 oil spill worse than predicted
2024-06-24
A new peer-reviewed study from researchers at The University of Texas at Arlington; the University of Nevada, Reno; Mokwon University in Daejeon, Korea; and Texas A&M University at Corpus Christi shows the Deepwater Horizon (DWH) oil spill of 2010 affected wildlife and their habitat much more than previously understood. “Overall, we found the area of deep-sea floor affected by the DWH spill was significantly larger than previously thought,” said Masoud Rostami, an author of the study and assistant ...

LAST 30 PRESS RELEASES:

Being physically active, even just a couple of days a week, may be key to better health

High-fat diet promote breast cancer metastasis in animal models

A router for photons

Nurses and AI collaborate to save lives, reduce hospital stays

Multi-resistance in bacteria predicted by AI model

Tinker Tots: A citizen science project to explore ethical dilemmas in embryo selection

Sensing sickness

Cost to build multifamily housing in California more than twice as high as in Texas

Program takes aim at drinking, unsafe sex, and sexual assault on college campuses

Inability to pay for healthcare reaches record high in U.S.

Science ‘storytelling’ urgently needed amid climate and biodiversity crisis

KAIST Develops Retinal Therapy to Restore Lost Vision​

Adipocyte-hepatocyte signaling mechanism uncovered in endoplasmic reticulum stress response

Mammals were adapting from life in the trees to living on the ground before dinosaur-killing asteroid

Low LDL cholesterol levels linked to reduced risk of dementia

Thickening of the eye’s retina associated with greater risk and severity of postoperative delirium in older patients

Almost one in ten people surveyed report having been harmed by the NHS in the last three years

Enhancing light control with complex frequency excitations

New research finds novel drug target for acute myeloid leukemia, bringing hope for cancer patients

New insight into factors associated with a common disease among dogs and humans

Illuminating single atoms for sustainable propylene production

New study finds Rocky Mountain snow contamination

Study examines lactation in critically ill patients

UVA Engineering Dean Jennifer West earns AIMBE’s 2025 Pierre Galletti Award

Doubling down on metasurfaces

New Cedars-Sinai study shows how specialized diet can improve gut disorders

Making moves and hitting the breaks: Owl journeys surprise researchers in western Montana

PKU Scientists simulate the origin and evolution of the North Atlantic Oscillation

ICRAFT breakthrough: Unlocking A20’s dual role in cancer immunotherapy

How VR technology is changing the game for Alzheimer’s disease

[Press-News.org] Navigating the labyrinth: How AI tackles complex data sampling