(Press-News.org) Researchers have created a small device that ‘sees’ and creates memories in a similar way to humans, in a promising step towards one day having applications that can make rapid, complex decisions such as in self-driving cars.
The neuromorphic invention is a single chip enabled by a sensing element, doped indium oxide, that’s thousands of times thinner than a human hair and requires no external parts to operate.
RMIT University engineers in Australia led the work, with contributions from researchers at Deakin University and the University of Melbourne.
The team’s research demonstrates a working device that captures, processes and stores visual information. With precise engineering of the doped indium oxide, the device mimics a human eye’s ability to capture light, pre-packages and transmits information like an optical nerve, and stores and classifies it in a memory system like the way our brains can.
Collectively, these functions could enable ultra-fast decision making, the team says.
Team leader Professor Sumeet Walia said the new device can perform all necessary functions – sensing, creating and processing information, and retaining memories – rather than relying on external energy-intensive computation, which prevents real-time decision making.
“Performing all of these functions on one small device had proven to be a big challenge until now,” said Walia from RMIT’s School of Engineering.
“We’ve made real-time decision making a possibility with our invention, because it doesn’t need to process large amounts of irrelevant data and it’s not being slowed down by data transfer to separate processors.”
What did the team achieve and how does the technology work?
The new device was able to demonstrate an ability to retain information for longer periods of time, compared to previously reported devices, without the need for frequent electrical signals to refresh the memory. This ability significantly reduces energy consumption and enhances the device’s performance.
Their findings and analysis are published in Advanced Functional Materials.
First author and RMIT PhD researcher Aishani Mazumder said the human brain used analog processing, which allowed it to process information quickly and efficiently using minimal energy.
“By contrast, digital processing is energy and carbon intensive, and inhibits rapid information gathering and processing,” she said.
“Neuromorphic vision systems are designed to use similar analog processing to the human brain, which can greatly reduce the amount of energy needed to perform complex visual tasks compared with today’s technologies
What are the potential applications?
The team used ultraviolet light as part of their experiments, and are working to expand this technology even further for visible and infrared light – with many possible applications such as bionic vision, autonomous operations in dangerous environments, shelf-life assessments of food and advanced forensics.
“Imagine a self-driving car that can see and recognise objects on the road in the same way that a human driver can or being able to able to rapidly detect and track space junk. This would be possible with neuromorphic vision technology.”
Walia said neuromorphic systems could adapt to new situations over time, becoming more efficient with more experience.
“Traditional computer vision systems – which cannot be miniaturised like neuromorphic technology – are typically programmed with specific rules and can't adapt as easily,” he said.
“Neuromorphic robots have the potential to run autonomously for long periods, in dangerous situations where workers are exposed to possible cave-ins, explosions and toxic air.”
The human eye has a single retina that captures an entire image, which is then processed by the brain to identify objects, colours and other visual features.
The team’s device mimicked the retina’s capabilities by using single-element image sensors that capture, store and process visual information on one platform, Walia said.
“The human eye is exceptionally adept at responding to changes in the surrounding environment in a faster and much more efficient way than cameras and computers currently can,” he said.
“Taking inspiration from the eye, we have been working for several years on creating a camera that possesses similar abilities, through the process of neuromorphic engineering.”
Support for the research
The team used the Micro Nano Research Facility and the Microscopy and Microanalysis Research Facility at RMIT.
The work was also supported by the Australian Research Council and the National Computational Infrastructure.
The team’s research, ‘Long duration persistent photocurrent in 3 nm thin doped indium oxide for integrated light sensing and in-sensor neuromorphic computation’, is published in Advanced Functional Materials (DOI: 10.1002/adfm.202303641).
Note: Once the paper has been published online, it will be available at the following URL: https://doi.org/10.1002/adfm.202303641. This link will go live after the embargo ends.
MULTIMEDIA FOR MEDIA USE
Here’s a link to photos related to the research that media can download and use: https://cloudstor.aarnet.edu.au/plus/s/cKmHNR61dLLY0Zg
Here’s a link to a YouTube video featuring the team’s chip technology: Professor Sumeet Walia - Winner, 2022 Eureka Prize for Emerging Leader in Science - YouTube
We can provide RAW video footage, upon request.
END
Tiny device mimics human vision and memory abilities
2023-06-14
[Attachments] See images for this press release:
ELSE PRESS RELEASES FROM THIS DATE:
Solar cells can, finally, stand the heat
2023-06-14
SDE BOKER, Israel, June 14, 2023 – Photovoltaic technology is indispensable for our ability to mitigate climate change. Nonetheless, more than 70% of the energy made available to us by the sun is wasted in conventional photovoltaic cells. There is little hope for sustainable technological advancement without addressing this issue.
The operational temperature is a critical factor in a solar cell's ability to convert sunlight to free energy. Accordingly, much research has been directed toward understanding the temperature effects in the efficiency of photovoltaic solar cells. Surprisingly, ...
Scientists develop novel biosensing-membrane for glucose detection and monitoring
2023-06-14
Glucose oxidase (GOx)-based biosensors have attracted much attention for their potential in rapid glucose detection and continuous monitoring, which are crucial for disease diagnosis and prevention, as well as for controllable production in sugar-making and fermentation processes.
The glucose oxidase/electrocatalysts/electrode (GOx/ECs/electrode) cascade system serves as the core part of most glucose biosensing devices (both invasive and non-invasive). However, patterned assembly of these cascade sensing units remains challenging, thus limiting the ...
Improving word intelligibility of bone-conducted speech using bone-conduction headphones
2023-06-14
Ishikawa, Japan -- Bone-conduction (BC) headphones enhance hearing capability by generating vibrations in bone or skin close to the ear, including the regio temporalis. They simultaneously leave the ear canal open to allow the surrounding air-conducted (AC) sounds for normal hearing. However, word intelligibility – recognition ability – is often poor during bone-conducted speech perceived using BC headphones due to the attenuation of its high-frequency components, especially under noisy conditions. While inserting ear plugs in the ear canal help improve ...
Study shines new light on old drug for trauma care
2023-06-14
A new study from Australia, New Zealand and Germany published in the New England Journal of Medicine raises important questions about the success or otherwise of emergency medicine.
The study examined the drug tranexamic acid, which is commonly used to limit bleeding during surgery. However, its usefulness in emergency settings as a pre-emptive strike in life-threatening bleeding has been controversial, and recent studies have provided contradictory results about whether or not it saves lives or causes dangerous blood clotting.
The Pre-hospital ...
Cutting back on social media reduces anxiety, depression, loneliness
2023-06-14
AMES, IA — Last month, the American Psychological Association and the U.S. Surgeon General both issued health advisories. Their concerns and recommendations for teens, parents and policymakers addressed a mounting body of research that shows two trends are intertwined.
Young people are using social media more, and their mental health is suffering.
Researchers at Iowa State University found a simple intervention could help. During a two-week experiment with 230 college students, half were asked to limit their ...
DESI data sheds more light on 3D map of cosmos, study of universe
2023-06-14
Dr. Mustapha Ishak-Boushaki, a theoretical astrophysicist at The University of Texas at Dallas, has spent his career seeking answers to some of the universe’s greatest mysteries, including why the expansion of the universe seems to be accelerating and whether gravity behaves differently beyond our closest cosmic neighbors.
To study these and other questions, a large collaboration of scientists, including Ishak-Boushaki and UTD physics doctoral students Cristhian Garcia Quintero, Leonel Medina Varela and Yunan Xie, are using data from the Dark Energy Spectroscopic ...
Under the weather: Scientists should spend more time in the rain
2023-06-14
Scientists need to get out of the lab and into the rain, say an interdisciplinary group of researchers led by John T. Van Stan of Cleveland State University. Writing in the journal BioScience, the authors make the case that human observation of storm events (be it rain, snow, or occult deposition) is key to understanding wet weather and its myriad effects on the natural world.
Recently, Van Stan and colleagues noted a trend in the scientific community towards relying on remote ...
Gene provides clues for preventing common diabetes side effect of corticosteroid treatment
2023-06-14
A study led by researchers at the Garvan Institute of Medical Research shows for the first time how a gene called RELA, known to regulate inflammation, also plays an essential role in maintaining normal blood-sugar levels.
The findings, published in Diabetologia, have implications for the prevention of steroid-induced diabetes, a temporary form of diabetes that affects up to half of hospital patients treated with high-dose steroids.
“Our discovery sheds new light on a complex network of factors governing glucose metabolism and how it can go awry in diabetes,” says Professor ...
How prescribed burns could limit megafires in California, Oregon, and Washington
2023-06-14
Wildfire smoke is a threat to air quality, public health, and ecosystems throughout the U.S. Notwithstanding the impact of this year’s Canadian wildfires, the West typically sees much higher exposure to wildfire smoke than other regions of the country. New research from Harvard University, the U.S. Forest Service, and National Oceanic and Atmospheric Administration indicates that controlled burns – particularly in coastal areas of northern California and the Pacific Northwest – could dramatically reduce the overall amount of wildfire smoke exposure in vulnerable rural communities and dense ...
Specialty drugs accounted for most new product launches in the past decade. Why do we know so little about how clinical studies influence their diffusion?
2023-06-14
Researchers from McGill University and Ontario Tech University published a new Journal of Marketing article that examines the drivers of specialty drug diffusion.
The study, forthcoming in the Journal of Marketing, is titled “Scientific Evidence Production and Specialty Drug Diffusion” and is authored by Demetrios Vakratsas and Wei-Lin Wang.
A notable trend in the pharmaceutical industry is the development of specialty drugs to treat complex, severe diseases, often with a limited number of patients. Of the 219 new drugs (or new active substances, NASs) that were launched in the U.S. between 2014 and 2018, 136 ...