(Press-News.org) A research team led by Professor Jia Pan and Professor Yifan Evan Peng from the Department of Computer Science and Department of Electrical & Electronic Engineering under the Faculty of Engineering at the University of Hong Kong (HKU), in collaboration with the researcher at Australian National University, has recently developed a groundbreaking neuromorphic exposure control (NEC) system that revolutionizes machine vision under extreme lighting variations. Published in Nature Communications, this biologically inspired system mimics human peripheral vision to achieve unprecedented speed and robustness in dynamic perception environments.
Traditional automatic exposure (AE) systems rely on iterative image feedback, creating a chicken-and-egg dilemma that fails in sudden brightness shifts (e.g., tunnels, glare). The NEC system solves this by integrating event cameras — sensors that capture per-pixel brightness changes as asynchronous “events” — with a novel Trilinear Event Double Integral (TEDI) algorithm. This approach: Operates at 130 million events/sec on a single CPU, enabling edge deployment.
"Like how our pupils instantly adapt to light, NEC mimics biological synergy between retinal pathways," explained Mr. Shijie Lin, the first-author of the article. "By fusing event streams with physical light metrics, we bypass traditional bottlenecks to deliver lighting-agnostic vision."
In tests, the team has validated NEC across mission-critical scenarios:
Autonomous Driving: Improved detection accuracy (mAP +47.3%) when vehicles exit tunnels into blinding sunlight.
Augmented Reality (AR): Achieved 11% higher pose estimation (PCK) for hand tracking under surgical lights.
3D Reconstruction: Enabled continuous SLAM in overexposed environments where conventional methods fail.
Medical AR Assistance: Maintained clear intraoperative visualization despite dynamic spotlight adjustments.
Professor Jia Pan said, "This breakthrough represents a significant leap in machine vision by bridging the gap between biological principles and computational efficiency. The NEC system not only addresses the limitations of traditional exposure control but also paves the way for more adaptive and resilient vision systems in real-world applications, from autonomous vehicles to medical robotics."
Professor Evan Y. Peng commented, "Our collaborative work has been instrumental in pushing the boundaries of neuromorphic engineering. By leveraging event-based sensing and bio-inspired algorithms, we’ve created a system that is not only faster but also more robust under extreme conditions. This is a testament to the power of interdisciplinary research in solving diverse complex engineering challenges."
In the long term, the NEC paradigm offers a novel event-frame processing scheme that reduces the processing burden of high-resolution events/images and incorporates bio-plausible principles into the low-level control of the machine eyes. This opens new avenues for camera design, system control, and downstream algorithms. The team’s success in embodying neuromorphic synergy in various systems is a milestone that can inspire many optical/image/neuromorphic processing pipelines and implies direct economic and practical implications for the industry.
For details about the research article, please visit:
https://www.nature.com/articles/s41467-024-54789-8
About Professor Jia Pan
Jia Pan is an Associate Professor in the Department of Computer Science at the University of Hong Kong (HKU). His research focuses on robotics, artificial intelligence, motion planning, and human-robot interaction. Professor Pan is particularly known for his work in developing algorithms for robot motion, collision detection, and optimization, with applications in autonomous systems and industrial robotics. He has published extensively in top-tier conferences and journals in robotics and AI, earning recognition for his innovative contributions to the field.
About Professor Yifan “Evan” Peng
Yifan Evan Peng is an Assistant Professor at HKU Electrical & Electronic Engineering and Computer Science, leading the Computational Imaging & Mixed Representation Laboratory. He was a Postdoctoral Research Scholar at Stanford University. He received his PhD in Computer Science the University of British Columbia, and both his MS and BS in Optical Science and Engineering from the State Key Lab of Modern Optical Instrumentation, Zhejiang University. Professor Peng’s research interest lies in the interdisciplinary field of Optics, Graphics, Vision, and Artificial Intelligence, particularly with the focus of: Computational Optics, Imager, Sensor, and Display; Holography & VR/AR/MR; Human-centered Visual & Sensory Systems.
For media enquiries, please contact:
Faculty of Engineering, HKU
Ms Christina Chung (Tel: 3910 3324; Email: chungmc@hku.hk)
Ms Natalie Yuen (Tel: 3917 1924; Email: natyuen@hku.hk)
END
HKU researchers unveil neuromorphic exposure control system to improve machine vision in extreme lighting environments
2025-03-04
[Attachments] See images for this press release:
ELSE PRESS RELEASES FROM THIS DATE:
Researchers develop highly robust, reconfigurable, and mechanochromic cellulose photonic hydrogels
2025-03-04
Inspired by the natural Bouligand structure, researchers have been developing advanced materials for applications in impact-resistant bioplastics, ceramic armor, and biomimetic alloy composites. Most existing materials are still composed of single-scale brittle units despite the progress in improving the plasticity of materials. The lack of hierarchical active interfaces and autonomous response capabilities limits their ductility and overall functionality.
Therefore, researchers aim to develop Bouligand-structured materials with multi-level active ...
Researchers develop new in-cell ultraviolet photodissociation top-down mass spectrometry method
2025-03-04
Proteins in cells are highly flexible and often exist in multiple conformations, each with unique abilities to bind ligands. These conformations are regulated by the organism to control protein function. Currently, most studies on protein structure and activity are conducted using purified proteins in vitro, which cannot fully replicate the complex of the intracellular environment and maybe influenced by the purification process or buffer conditions.
In a study published in Journal of the American Chemical Society, a team led by Prof. WANG Fangjun ...
Researchers develop innovative tool for rapid pathogen detection
2025-03-04
Researchers from the Zhang Liye Laboratory have developed a groundbreaking tool that revolutionizes the way researchers design primers for detecting pathogens. This new pipeline, which scans entire genomes to identify the most effective primer sets, could significantly enhance the speed and accuracy of diagnosing infectious diseases. The findings, published on 15 Feb 2025 in Frontiers of Computer Science, address a critical challenge in quantitative PCR (qPCR) primer design.
Unlike existing software that requires manual selection of specific genes or regions, this new tool automatically ...
New insights into how cancer evades the immune system
2025-03-04
Research into immunotherapy against cancer typically focuses on better recognition of cancer cells by the body's own immune system. Researchers at Amsterdam UMC and Moffitt Cancer Center have taken a different approach. They investigated how cancer affects the energy management of a patient’s T cells and showed for the first time that contact with chronic lymphocytic leukaemia (CLL) cells leads to a serious energy crisis in these cells. These findings are published today in Cellular & Molecular Immunology, building on a publication earlier this month in Blood Advances. ...
3 Ways to reduce child sexual abuse rates
2025-03-04
The sexual abuse of children affects 15 percent of girls and 8 percent of boys worldwide, incurring high public costs and devastating consequences for its survivors. In the United States, at least one in four girls and one in 20 boys experience sexual abuse. A US Preventive Services Task Force report recently concluded there’s not enough evidence that prevention is effective.
Now, a new study published in JAMA Pediatrics provides the missing evidence that coordinated, community-wide primary prevention efforts can significantly reduce child sexual abuse rates. The counties in the study that received the educational measures ...
A third of children worldwide forecast to be obese or overweight by 2050
2025-03-04
Obesity rates are set to skyrocket, with one in six children and adolescents worldwide forecast to be obese by 2050, according to a new study. But with significant increases predicted within the next five years, the researchers stress urgent action now could turn the tide on the public health crisis.
The research, led by Murdoch Children’s Research Institute (MCRI) and published in The Lancet, found a third of children and adolescents will be overweight (385 million) or obese (360 million) within the next 25 years. The forecast equates ...
Contraction inhibitors after 30 weeks have no effect on baby's health
2025-03-04
The use of tocolytic drugs in cases of threatened premature birth after 30 weeks of pregnancy does not improve the baby’s health. This is shown by the largest study concerning the effectiveness of tocolytic drugs on the health of babies, led by Amsterdam UMC, the results of which were published today in The Lancet.
Worldwide, 1 in 10 pregnancies result in premature birth. Children born prematurely face a higher risk of mortality and serious health problems, both in the short and long term. As a results, tocolytic drugs have been used a standard treatment for many ...
Nearly 1 in 5 US college athletes reports abusive supervision by their coaches
2025-03-04
Nearly 1 in 5 college athletes reports some form of abusive supervision—defined as sustained hostile verbal and non-verbal behaviours—by their coaches, reveals an analysis of survey responses, involving National Collegiate Athletic Association (NCAA) athletes, and published online in the British Journal of Sports Medicine.
While there is no evidence of vulnerability according to race/ethnicity, sexual orientation, or gender, athletes with disabilities and those participating in team sports seem to be most at risk, the findings indicate.
Athletes view their coaches as role models, which makes their interactions susceptible ...
THE LANCET: More than half of adults and a third of children and adolescents predicted to have overweight or obesity by 2050
2025-03-04
**Study includes country-level data for 204 countries and territories worldwide. A link to summary tables for rates in selected countries as well as country-level data is included at the end of the press release**
Most comprehensive global analysis to date estimates that overweight and obesity rates in adults (aged 25 or older) and children and adolescents (aged 5-24 years) more than doubled over the past three decades (1990-2021), affecting 2.11 billion adults and 493 million young people worldwide in 2021.
Weight gain varies widely across the globe with more than half ...
Ideal nitrogen fertilizer rates in Corn Belt have been climbing for decades, Iowa State study shows
2025-03-03
AMES, Iowa – The amount of nitrogen fertilizer needed to maximize the profitability of corn production in the Midwest has been increasing by about 1.2% per year for the past three decades, according to new Iowa State University research.
The study, published last month in Nature Communications, analyzed data from prior long- and short-term studies by Iowa State and the University of Illinois to calculate the Corn Belt’s steadily rising optimum nitrogen rates, which researchers had thought were static ...