PRESS-NEWS.org - Press Release Distribution
PRESS RELEASES DISTRIBUTION

UVA researchers engineer AI breakthrough in human action detection technology

UVA researchers engineer AI breakthrough in human action detection technology
2024-10-16
(Press-News.org) What if a security camera could not only capture video but understand what’s happening — distinguishing between routine activities and potentially dangerous behavior in real time? That’s the future being shaped by researchers at the University of Virginia’s School of Engineering and Applied Science with their latest breakthrough: an AI-driven intelligent video analyzer capable of detecting human actions in video footage with unprecedented precision and intelligence.

The system, called the Semantic and Motion-Aware Spatiotemporal Transformer Network (SMAST), promises a wide range of societal benefits from enhancing surveillance systems and improving public safety to enabling more advanced motion tracking in healthcare and refining how autonomous vehicles navigate through complex environments.

“This AI technology opens doors for real-time action detection in some of the most demanding environments,” said professor and chair of the Department of Electrical and Computer Engineering, Scott T. Acton, and the lead researcher on the project. “It’s the kind of advancement that can help prevent accidents, improve diagnostics and even save lives.”

AI-Driven Innovation for Complex Video Analysis So, how does it work? At its core, SMAST is powered by artificial intelligence. The system relies on two key components to detect and understand complex human behaviors. The first is a multi-feature selective attention model, which helps the AI focus on the most important parts of a scene — like a person or object — while ignoring unnecessary details. This makes the system more accurate at identifying what’s happening, such as recognizing someone throwing a ball instead of just moving their arm.

The second key feature is a motion-aware 2D positional encoding algorithm, which helps the AI track how things move over time. Imagine watching a video where people are constantly shifting positions —this tool helps the AI remember those movements and understand how they relate to each other. By integrating these features, SMAST can accurately recognize complex actions in real time, making it more effective in high-stakes scenarios like surveillance, healthcare diagnostics, or autonomous driving.

SMAST redefines how machines detect and interpret human actions. Current systems struggle with chaotic, unedited contiguous video footage, often missing the context of events. But SMAST’s innovative design allows it to capture the dynamic relationships between people and objects with remarkable accuracy, powered by the very AI components that allow it to learn and adapt from data.

Setting New Standards in Action Detection Technology This technological leap means the AI system can identify actions like a runner crossing a street, a doctor performing a precise procedure or even a security threat in a crowded space. SMAST has already outperformed top-tier solutions across key academic benchmarks including AVA, UCF101-24 and EPIC-Kitchens, setting new standards for accuracy and efficiency.

“The societal impact could be huge,” said Matthew Korban, a postdoctoral research associate in Acton’s lab working on the project. “We’re excited to see how this AI technology might transform industries, making video-based systems more intelligent and capable of real-time understanding.”

This research is based on the work published in the article "A Semantic and Motion-Aware Spatiotemporal Transformer Network for Action Detection" in the IEEE Transactions on Pattern Analysis and Machine Intelligence. The authors of the paper are Matthew Korban, Peter Youngs, and Scott T. Acton from the University of Virginia.

The project was supported by the National Science Foundation (NSF) under Grant 2000487 and Grant 2322993.

About UVA Engineering: As part of the top-ranked, comprehensive University of Virginia, UVA Engineering is one of the nation’s oldest and most respected engineering schools. Our mission is to make the world a better place by creating and disseminating knowledge and by preparing future engineering leaders. Outstanding students and faculty from around the world choose UVA Engineering because of our growing and internationally recognized education and research programs. UVA is the No. 1 public engineering school in the country for the percentage of women graduates, among schools with at least 75 degree earners; among the top engineering schools in the United States for the four-year graduation rate of undergraduate students; and among the top-growing public engineering schools in the country for the rate of Ph.D. enrollment growth. Our research program has grown by 95% since 2016. Learn more at engineering.virginia.edu.

END

[Attachments] See images for this press release:
UVA researchers engineer AI breakthrough in human action detection technology UVA researchers engineer AI breakthrough in human action detection technology 2

ELSE PRESS RELEASES FROM THIS DATE:

Bolstering the fight against antibiotic-resistant bacteria

2024-10-16
GAINESVILLE, Fla. — University of Florida Health scientists exploring how combinations of antibiotics can fight resistant bacteria have been awarded an $11.8 million grant for work that could help save the tens of thousands of lives lost yearly to infections that are increasingly plaguing humanity. The National Institutes of Health, or NIH, grant to the UF College of Medicine and the UF College of Pharmacy will support scientists working to uncover the mechanics of how bacteria and antibiotics interact, down to the molecular level. That mechanistic knowledge ...

Deep learning illuminates atmospheric blocking events of past, future

Deep learning illuminates atmospheric blocking events of past, future
2024-10-16
Atmospheric blocking events are persistent, high-impact weather patterns that occur when large-scale high-pressure systems become stationary and divert the jet stream and storm tracks for days to weeks, and can be associated with record-breaking flooding or heat waves, such as in Europe in 2023. In a new study, University of Hawai‘i at Mānoa atmospheric scientist Christina Karamperidou used a deep learning model to infer the frequency of blocking events over the past 1,000 years and shed light on how future climate change may impact these significant phenomena.    “This study set out to extract a paleoweather signal from ...

Kidney transplantation among those with HIV infections shown safe and effective

2024-10-16
It is just as safe and effective for people with HIV in need of kidney transplantation to get their organ from donors who are also HIV positive as it is from donors who are not infected with the virus, a new study shows. Survival rates for organ recipients one and three years after the procedure were the same for donors with or without HIV. Also the same were risks of serious side effects, such as infection, fever, and rejection in the donated organ. In what is the largest comparative trial of the experimental procedures since the first transplant was performed in the United States in 2016, researchers ...

Longer-term data from SWOG S1826 trial confirm nivolumab-AVD benefit in Hodgkin lymphoma

2024-10-16
In mid-2023, the SWOG S1826 phase 3 trial in advanced Hodgkin lymphoma reported highly positive primary results earlier than expected, after the trial’s second planned interim analysis found the preset threshold for efficacy had already been reached.  Now, a follow-up analysis with additional data – a median follow-up of 2.1 years – confirms the durability of those initial findings: among the 970 newly diagnosed adolescents and adults randomized to the trial, those who received a combination of nivolumab plus AVD chemotherapy (N-AVD) had a significantly lower risk of cancer progression ...

In landmark study, immunotherapy boosts survival of advanced Hodgkin lymphoma

2024-10-16
A treatment that rallies the immune system to destroy cancer raised the survival rate for advanced Hodgkin lymphoma patients to a remarkable 92 percent, suggesting a new standard therapy for the disease. The New England Journal of Medicine published the innovative clinical trial results this week. Young people are most at risk to get Hodgkin lymphoma, an uncommon blood and immune system cancer that falls within the general category of lymphomas. With this new treatment, scientists believe they ...

Kidney transplantation between donors and recipients with HIV is safe

Kidney transplantation between donors and recipients with HIV is safe
2024-10-16
WHAT:  Kidney transplantation from deceased donors with HIV (HIV D+) to recipients with HIV (HIV R+) was safe and comparable to kidney transplantation from donors without HIV (HIV D-) in a multicenter observational study in the United States. The clinical outcomes observed were consistent with smaller pilot studies, but this National Institutes of Health (NIH)-funded clinical trial was the first statistically powered to demonstrate noninferiority, which means that an approach being studied is as good as standard clinical practice. The results were published today ...

Brown researchers show how gut hormones control aging in flies and how it relates to human biology

Brown researchers show how gut hormones control aging in flies and how it relates to human biology
2024-10-16
PROVIDENCE, R.I. [Brown University] — Biologists at Brown University have discovered how a neuropeptide hormone made in the gut of flies can control their lifespan. The findings, published in PNAS, have implications for humans, too, the researchers say — especially as new diabetes and obesity medications based on gut hormones in the same family of the fly hormone are becoming more widespread. For the past two decades, study author Marc Tatar, a professor of biology affiliated with the Center on the Biology of Aging at Brown University, has studied how the hormones insulin and insulin-like ...

Which clot-busting drug is tied to better recovery after stroke?

2024-10-16
EMBARGOED FOR RELEASE UNTIL 4 P.M. ET, WEDNESDAY, OCTOBER 16, 2024 MINNEAPOLIS – For people with ischemic stroke, treatment with the clot-busting drug tenecteplase is associated with a slightly higher likelihood of an excellent recovery and reduced disability three months later than the drug alteplase, according to a meta-analysis published in the October 16, 2024, online issue of Neurology®, the medical journal of the American Academy of Neurology. Researchers found that the likelihood of good recovery was similar ...

Study: breast cancer drug shows potential for rare appendix cancer

Study: breast cancer drug shows potential for rare appendix cancer
2024-10-16
Researchers at University of California San Diego School of Medicine found an FDA-approved drug used to treat breast cancer has the potential to be an effective therapeutic for a specific type of appendix cancer.  The clinical trial results, publishing in the October 16, 2024 online edition of the Journal of Clinical Oncology, showed the oral medication, known as palbociclib, stabilized tumor growth and reduced blood tumor marker levels in patients with peritoneal mucinous carcinomatosis (PMC). This form of cancer originates in the appendix and is often resistant to standard chemotherapy. “Finding that a breast cancer drug is ...

Specific type of DNA could be a target of future cancer therapies

2024-10-16
Research published in Nature Genetics on Oct.14, by Yale Cancer Center researchers at Yale School of Medicine, found a higher concentration of a specific kind of DNA — extrachromosomal or ecDNA — in more aggressive and advanced cancers that could mark them as targets for future therapies.  Using data available from The Cancer Genome Atlas, the International Cancer Genomics Consortium, the Hartwig Medical Foundation, and the Glioma Longitudinal Analysis Consortium, the researchers considered more than 8,000 tumor samples, divided between newly diagnosed untreated tumors and those that had been through previous treatments ...

LAST 30 PRESS RELEASES:

New guideline standardizes consent for research participants in Canada

Research as reconciliation: Oil sands and health

AI risks overwriting history and the skills of historians have never been more important, leading academic outlines in new paper

The Lancet Diabetes & Endocrinology: Higher doses of semaglutide can safely enhance weight loss and improve health for adults living with obesity, two new clinical trials confirm

Trauma focused therapy shows promise for children struggling with PTSD

School meals could drive economic growth and food system transformation

Home training for cerebellar ataxias

Dry eyes affect over half the general population, yet only a fifth receive diagnosis and treatment

Researchers sound warning about women with type 2 diabetes taking oral HRT

Overweight and obesity don’t always increase the risk of an early death, Danish study finds

Cannabis use associated with a quadrupling of risk of developing type 2 diabetes, finds study of over 4 million adults

Gestational diabetes linked to cognitive decline in mothers and increased risk of developmental delays, ADHD and autism among children

Could we use eye drops instead of reading glasses as we age?

Patients who had cataracts removed or their eyesight corrected with a new type of lens have good vision over all distances without spectacles

AI can spot which patients need treatment to prevent vision loss in young adults

Half of people stop taking popular weight-loss drug within a year, national study finds

Links between diabetes and depression are similar across Europe, study of over-50s in 18 countries finds

Smoking increases the risk of type 2 diabetes, regardless of its characteristics

Scientists trace origins of now extinct plant population from volcanically active Nishinoshima

AI algorithm based on routine mammogram + age can predict women’s major cardiovascular disease risk

New hurdle seen to prostate screening: primary-care docs

MSU researchers explore how virtual sports aid mental health

Working together, cells extend their senses

Cheese fungi help unlock secrets of evolution

Researchers find brain region that fuels compulsive drinking

Mental health effects of exposure to firearm violence persist long after direct exposure

Research identifies immune response that controls Oropouche infection and prevents neurological damage

University of Cincinnati, Kent State University awarded $3M by NSF to share research resources

Ancient DNA reveals deeply complex Mastodon family and repeated migrations driven by climate change

Measuring the quantum W state

[Press-News.org] UVA researchers engineer AI breakthrough in human action detection technology