Neural partially linear additive model
2025-01-16
(Press-News.org)
Interpretability has drawn increasing attention in machine learning. Partially linear additive models provide an attractive middle ground between the simplicity of generalized linear model and the flexibility of generalized additive model, and are important models for addressing the two interpretability problems of feature selection and structure discovery. The existing partially linear additive models still have various imperfect performances in terms of fitting ability.
To solve the problems, a research team lad by Han LI published their new research on 15 December 2024 in Frontiers of Computer Science co-published by Higher Education Press and Springer Nature.
The team combined the neural network and the partially linear additive model to proposed a Neural Partially Linear Additive Model (NPLAM), which can automatically distinguishes insignificant, linear, and nonlinear features. On the one hand, neural network construction fits data better than spline function under the same parameter amount; on the other hand, learnable gate design and sparsity regular-term maintain the ability of feature selection and structure discovery.
In the research, they analyze the hypothesis space and optimization problem of the partially linear additive model, and employ neural networks to build sub-models for each nonlinear feature without defining basis functions, which are much more efficient with little accuracy loss. In order to judge important features and linear feature, they introduce learnable feature selection gate and structure discovery gate, and use a lasso penalization to address three forms of model selection: deciding which features are at all relevant in the model, deciding which of those features should be fit linearly versus nonlinearly, and encouraging sparsity of all weights in a neural network. In theory, they establish the sample complexity error bounds of the proposed model by Rademacher complexity. they have provided empirical evidence via some experiments, which shows that the proposed model can tackle the interpretability problem by introducing double gates and lasso penalty, and has excellent performance.
Future work can focus on introducing the interaction of input features to improve the expressiveness of the neural partially linear additive model and designing a new neural partially linear additive model that takes feature ranking into account.
DOI: 10.1007/s11704-023-2662-3
END
[Attachments] See images for this press release:
ELSE PRESS RELEASES FROM THIS DATE:
2025-01-16
Researchers have used dung records to create high-resolution maps of herbivore distribution around the world. Their new study, recently published in Nature Food, reveals a strong positive relationship between dung presence and grazing pressure, meaning the amount of dung found in a particular location could help us understand approximately how many herbivores live there.
Many people consider dung simply as the manure left behind by horses and cows at country shows, or something to be avoided when you visit the cousins’ farm. But dung is actually an important resource for millions of people worldwide.
Dung ...
2025-01-16
Senior midwives and researchers with experience in criminal and social justice are among those calling for improved maternity provision for pregnant women in UK prisons.
In an article published by The BMJ today, Laura Abbott and colleagues highlight gaps in clinical care for pregnant women and say the systemic problems need tackling urgently to protect the health of pregnant women, new mothers, and babies while in criminal justice settings.
Figures from April 2023 to March 2024 show that 229 pregnant women ...
2025-01-16
The UK needs an overarching national strategy to tackle alcohol related harms, argue experts in The BMJ today, as deaths from alcohol in England reach their highest level on record.
Julia Sinclair at the University of Southampton and colleagues warn that successive government cuts have led to reduced provision and quality of alcohol treatment, and say sustained funding is needed for screening and care, while industry must also shoulder some of the costs.
Alcohol is widely available and drunk by around 80% of adults in the UK and is now well established as ...
2025-01-16
Regular aerobic exercise could significantly reduce disease markers associated with Alzheimer’s, new research led by scientists at the University of Bristol (UK) and the Federal University of São Paulo (Brazil) has found. The findings provide new hope in the battle against this devastating disorder.
Published in the journal Brain Research, the study highlights how physical activity not only protects healthy brain cells but also restores balance in the aging brain.
The research focused on ...
2025-01-16
Cambridge researchers are leading the first phase of a new research project that will lay the groundwork for future studies into the impact on children of smartphone and social media use.
The work has been commissioned by the UK government’s Department for Science, Innovation and Technology after a review by the UK Chief Medical Officer in 2019 found the evidence base around the links to children’s mental health were insufficient to provide strong conclusions suitable to inform policy.
The project – led by a team at the University of Cambridge, in collaboration with researchers at several leading UK universities ...
2025-01-15
DARIEN, IL — The American Academy of Sleep Medicine Foundation is proud to announce a partnership with the Howard University Medical Alumni Association to support medical students at Howard University. Through the HUMAA scholarship program, the AASM Foundation is sponsoring five scholarships, each valued at $3,000.
“By supporting medical students at Howard University, we’re empowering the next generation of medical professionals who will shape the future of health care,” said Dr. R. Nisha Aurora, president of the AASM Foundation. “We’re also hoping to inspire students to consider careers ...
2025-01-15
As climate change drives increasingly severe hurricanes, U.S. coastal communities are bearing the brunt of mounting losses. With regulations failing to curb the damage, homeowners have become the front line of defense — but their efforts often fall short, a recent study reveals.
Led by Tracy Kijewski-Correa, professor of engineering and global affairs at the Keough School of Global Affairs at the University of Notre Dame, the study, published in the International Journal of Disaster Risk Reduction, explored how homeowners respond in the aftermath of hurricanes when reconstruction becomes ...
2025-01-15
A new publication from Opto-Electronic Advances; DOI 10.29026/oea.2025.240159, discusses on-chip light control of semiconductor optoelectronic devices using integrated metasurfaces.
Since the initial demonstration of the first semiconductor laser in the early 1960s, semiconductor optoelectronic devices have achieved unparalleled commercial success and permeated every facet of human lives from communication, lighting, and entertainment to medicine. Furthermore, in response to the emergence of novel applications, such as the consumer electronics, AR/VR ...
2025-01-15
Maytal Saar-Tsechansky was standing a few meters from Israeli Prime Minister Yitzhak Rabin in 1995, when he was assassinated by a right-wing extremist in Tel Aviv.
“At the time, Rabin was promoting peace with the Palestinians,” says Saar-Tsechansky, professor of information, risk, and operations management and the Mary John and Ralph Spence Centennial Professor at Texas McCombs. “The assassination was the result of a lot of incitement, of some people claiming that he was the enemy of the people.”
Although she typically studies artificial intelligence, the traumatic incident planted a seed for a different interest: how to ease political divisions. She began ...
2025-01-15
A common antihistamine may offer hope for patients with a rare genetic disease that can lead to severe liver damage and ultimately require transplantation, according to new research from Rutgers Health.
The study in Cellular and Molecular Gastroenterology and Hepatology found that chlorcyclizine, a decades-old allergy medication, could potentially treat erythropoietic protoporphyria (EPP), a condition that creates extreme skin light sensitivity and can produce toxic levels of protoporphyrin in the liver, bone marrow, red cells, and plasma.
"There is an unmet need for these patients," said Bishr Omary, senior ...
LAST 30 PRESS RELEASES:
[Press-News.org] Neural partially linear additive model
