(Press-News.org) Image
Artificial neural networks may soon be able to process time-dependent information, such as audio and video data, more efficiently. The first memristor with a 'relaxation time' that can be tuned is reported today in Nature Electronics, in a study led by the University of Michigan.
Memristors, electrical components that store information in their electrical resistance, could reduce AI's energy needs by about a factor of 90 compared to today's graphical processing units. Already, AI is projected to account for about half a percent of the world's total electricity consumption in 2027, and that has the potential to balloon as more companies sell and use AI tools.
"Right now, there's a lot of interest in AI, but to process bigger and more interesting data, the approach is to increase the network size. That's not very efficient," said Wei Lu, the James R. Mellor Professor of Engineering at U-M and co-corresponding author of the study with John Heron, U-M associate professor of materials science and engineering.
The problem is that GPUs operate very differently from the artificial neural networks that run the AI algorithms—the whole network and all its interactions must be sequentially loaded from the external memory, which consumes both time and energy. In contrast, memristors offer energy savings because they mimic key aspects of the way that both artificial and biological neural networks function without external memory. To an extent, the memristor network can embody the artificial neural network.
"We anticipate that our brand-new material system could improve the energy efficiency of AI chips six times over the state-of-the-art material without varying time constants," said Sieun Chae, a recent U-M Ph.D. graduate in materials science and engineering and co-first-author of the study with Sangmin Yoo, a recent U-M PhD graduate in electrical and computer engineering.
In a biological neural network, timekeeping is achieved through relaxation. Each neuron receives electrical signals and sends them on, but it isn't a guarantee that a signal will move forward. Some threshold of incoming signals must be reached before the neuron will send its own, and it has to be met in a certain amount of time. If too much time passes, the neuron is said to relax as the electrical energy seeps out of it. Having neurons with different relaxation times in our neural networks helps us understand sequences of events.
Memristors operate a little differently. Rather than the total presence or absence of a signal, what changes is how much of the electrical signal gets through. Exposure to a signal reduces the resistance of the memristor, allowing more of the next signal to pass. In memristors, relaxation means that the resistance rises again over time.
While Lu's group had explored building relaxation time into memristors in the past, it was not something that could be systematically controlled. But now, Lu and Heron's team have shown that variations on a base material can provide different relaxation times, enabling memristor networks to mimic this timekeeping mechanism.
The team built the materials on the superconductor YBCO, made of yttrium, barium, carbon and oxygen. It has no electrical resistance at temperatures below -292 Fahrenheit, but they wanted it for its crystal structure. It guided the organization of the magnesium, cobalt, nickel, copper and zinc oxides in the memristor material.
Heron calls this type of oxide, an entropy-stabilized oxide, the "kitchen sink of the atomic world"—the more elements they add, the more stable it becomes. By changing the ratios of these oxides, the team achieved time constants ranging from 159 to 278 nanoseconds, or trillionths of a second. The simple memristor network they built learned to recognize the sounds of the numbers zero to nine. Once trained, it could identify each number before the audio input was complete.
These memristors were made through an energy-intensive process because the team needed perfect crystals to precisely measure their properties, but they anticipate that a simpler process would work for mass manufacturing.
"So far, it's a vision, but I think there are pathways to making these materials scalable and affordable," Heron said. "These materials are earth-abundant, nontoxic, cheap and you can almost spray them on."
The research was funded by the National Science Foundation. It was done in partnership with researchers at the University of Oklahoma, Cornell University and Pennsylvania State University.
The device was built in the Lurie Nanofabrication Facility and studied at the Michigan Center for Materials Characterization.
Lu is also a professor of electrical and computer engineering and materials science and engineering. Chae is now an assistant professor of electrical engineering and computer science at Oregon State University.
Study: Efficient data processing using tunable entropy-stabilized oxide memristors (DOI: 10.1038/s41928-024-01169-1)
END
AI chips could get a sense of time
Timekeeping in the brain is done with neurons that relax at different rates after receiving a signal; now memristors—hardware analogues of neurons—can do that too
2024-05-20
ELSE PRESS RELEASES FROM THIS DATE:
PARC model of care associated with fewer deaths among veterans post-ICU
2024-05-20
EMBARGOED UNTIL: 10:15 a.m. PT, Monday, May 20, 2024
PARC MODEL OF CARE ASSOCIATED WITH FEWER DEATHS AMONG VETERANS POST-ICU
Session: B18 – Bridging Gaps to Improve Long-Term Outcomes
The Post-Acute Recovery Center: A Telehealth Care Model to Improve Patient-Centered Outcomes for High-Risk Survivors of Critical Illness
Date and Time: Monday, May 20, 2024, 10:15 a.m. PT
Location: San Diego Convention Center, Room 32A-B (Upper Level)
ATS 2024, San Diego – Research presented at the ATS 2024 International Conference demonstrates that veterans who received ...
Department of Energy announces $6 million for isotope R&D
2024-05-20
WASHINGTON, D.C. - Today, the U.S. Department of Energy (DOE) announced $6 million in funding for 12 awards across eight efforts to advance research in isotope enrichment, targetry, and separations. This funding is part of a key federal program that produces critical isotopes otherwise unavailable or in short supply in the U.S.
Isotopes, or variations of the same elements that have the same number of protons but different numbers of neutrons, have unique properties that make them powerful in medical diagnostic and treatment applications. They are also essential for applications in quantum information science, nuclear power, national security, and more.
“These ...
World leaders still need to wake up to AI risks, say leading experts ahead of AI Safety Summit
2024-05-20
UNDER EMBARGO UNTIL 19:00 BST / 14:00 ET MONDAY 20 MAY 2024.
World leaders still need to wake up to AI risks, say leading experts ahead of AI Safety Summit
More information, including a copy of the paper, can be found online at the Science press package at https://www.eurekalert.org/press/scipak/, or can be requested from scipak@aaas.org
Leading AI scientists are calling for stronger action on AI risks from world leaders, warning that progress has been insufficient since the first AI Safety Summit in Bletchley Park six months ago.
Then, the world’s leaders pledged to govern AI responsibly. However, as the second AI Safety Summit in Seoul ...
*FREE* Managing extreme AI risks amidst rapid technological development
2024-05-20
Although researchers have warned of the extreme risks posed by rapidly developing artificial intelligence (AI) technologies, there is a lack of consensus about how to manage them. In a Policy Forum, Yoshua Bengio and colleagues examine the risks of advancing AI technologies – from the social and economic impacts, malicious uses, and the possible loss of human control over autonomous AI systems – and recommend directions for proactive and adaptive governance to mitigate them. They call on major technology companies and public funders to invest more – at least one-third of their budgets – into assessing and ...
Advancing 3D mapping with tandem dual-antenna SAR interferometry
2024-05-20
The new Tandem Dual-Antenna Spaceborne Synthetic Aperture Radar (SAR) Interferometry (TDA-InSAR) system, addresses the limitations of current spaceborne Synthetic Aperture Radar (SAR) systems by providing a more reliable and efficient method for 3D surface mapping. The system's innovative design allows for single-pass acquisitions, significantly reducing the time required for data collection and enhancing the precision of 3D reconstructions in various terrains, including built-up areas and vegetation canopies.
Synthetic Aperture Radar (SAR) interferometry (InSAR) is a powerful tool for producing high-resolution topographic maps. However, traditional InSAR techniques face ...
Mount Sinai launches Center for Healthcare Readiness to strengthen practice and partnerships in public health emergency response
2024-05-20
The Icahn School of Medicine at Mount Sinai announced the launch of its new Center for Healthcare Readiness, bringing together a diverse team of academic and operational experts to strengthen the Mount Sinai Health System’s strategies and the U.S. health care sector’s capacity to prepare for and respond to any large-scale public health emergency.
The Center will work with both Mount Sinai’s own resources, and public and private partners at the local, regional, and federal levels, to pursue strategies in research, advocacy, innovation, and collaboration to plan ...
Study sheds light on bacteria associated with pre-term birth
2024-05-20
Researchers from North Carolina State University have found that multiple species of Gardnerella, bacteria sometimes associated with bacterial vaginosis (BV) and pre-term birth, can coexist in the same vaginal microbiome. The findings add to the emerging picture of Gardnerella’s effects on human health.
Gardnerella is a group of anaerobic bacteria that are commonly found in the vaginal microbiome. Higher levels of the bacteria are a signature of BV and associated with higher risk of pre-term birth, ...
Evolving market dynamics foster consumer inattention that can lead to risky purchases
2024-05-20
CORVALLIS, Ore. – Researchers have developed a new theory of how changing market conditions can lead large numbers of otherwise cautious consumers to buy risky products such as subprime mortgages, cryptocurrency or even cosmetic surgery procedures.
These changes can occur in categories of products that are generally low risk when they enter the market. As demand increases, more companies may enter the market and try to attract consumers with lower priced versions of the product that carry more risk. If the negative effects of that risk are not immediately noticeable, the market can evolve to keep consumers ignorant of the risks, said Michelle Barnhart, an associate professor ...
Ex-cigarette smokers who vape may be at higher risk for lung cancer
2024-05-20
EMBARGOED UNTIL: 9:15 a.m. PT, May 20, 2024
Session: B20 – Lung Screening: One Size Does Not Fit All
Association of Electronic Cigarette Use After Conventional Smoking Cessation with Lung Cancer Risk: A Nationwide Cohort Study
Date and Time: Monday, May 20, 2024, 9:15 a.m. PT
Location: San Diego Convention Center, Room 30A-B (Upper Level)
ATS 2024, San Diego – Former cigarette smokers who use e-cigarettes or vaping devices may be at higher risk for lung cancer than those who don’t ...
The impacts of climate change on food production
2024-05-20
A new peer-reviewed study from researchers at The University of Texas at Arlington; the University of Nevada, Reno; and Virginia Tech shows that climate change has led to decreased pollen production from plants and less pollen more diversity than previously thought, which could have a significant impact on food production.
“This research is crucial as it examines the long-term impacts of climate change on plant-pollinator interactions,” said Behnaz Balmaki, lead author of the study and an assistant professor of research in biology at UTA. “This study investigates how shifts in flowering times and extreme weather events affect the availability of critical food ...
LAST 30 PRESS RELEASES:
QUT scientists create material to turn waste heat into clean power
Major new report sets out how to tackle the ‘profound and lasting impact’ of COVID-19 on cardiovascular health
Cosmic crime scene: White dwarf found devouring Pluto-like icy world
Major report tackles Covid’s cardiovascular crisis head-on
A third of licensed GPs in England not working in NHS general practice
ChatGPT “thought on the fly” when put through Ancient Greek maths puzzle
Engineers uncover why tiny particles form clusters in turbulent air
GLP-1RA drugs dramatically reduce death and cardiovascular risk in psoriasis patients
Psoriasis linked to increased risk of vision-threatening eye disease, study finds
Reprogramming obesity: New drug from Italian biotech aims to treat the underlying causes of obesity
Type 2 diabetes may accelerate development of multiple chronic diseases, particularly in the early stages, UK Biobank study suggests
Resistance training may improve nerve health, slow aging process, study shows
Common and inexpensive medicine halves the risk of recurrence in patients with colorectal cancer
SwRI-built instruments to monitor, provide advanced warning of space weather events
Breakthrough advances sodium-based battery design
New targeted radiation therapy shows near-complete response in rare sarcoma patients
Does physical frailty contribute to dementia?
Soccer headers and brain health: Study finds changes within folds of the brain
Decoding plants’ language of light
UNC Greensboro study finds ticks carrying Lyme disease moving into western NC
New implant restores blood pressure balance after spinal cord injury
New York City's medical specialist advantage may be an illusion, new NYU Tandon research shows
Could a local anesthetic that doesn’t impair motor function be within reach?
1 in 8 Italian cetacean strandings show evidence of fishery interactions, with bottlenose and striped dolphins most commonly affected, according to analysis across four decades of data and more than 5
In the wild, chimpanzees likely ingest the equivalent of several alcoholic drinks every day
Warming of 2°C intensifies Arctic carbon sink but weakens Alpine sink, study finds
Bronze and Iron Age cultures in the Middle East were committed to wine production
Indian adolescents are mostly starting their periods at an earlier age than 25 years ago
Temporary medical centers in Gaza known as "Medical Points" (MPs) treat an average of 117 people daily with only about 7 staff per MP
Rates of alcohol-induced deaths among the general population nearly doubled from 1999 to 2024
[Press-News.org] AI chips could get a sense of timeTimekeeping in the brain is done with neurons that relax at different rates after receiving a signal; now memristors—hardware analogues of neurons—can do that too