(Press-News.org) A University of Texas at Arlington researcher is working to increase the security of natural language generation (NLG) systems, such as those used by ChatGPT, to guard against misuse and abuse that could allow the spread of misinformation online.
Shirin Nilizadeh, assistant professor in the Department of Computer Science and Engineering, has earned a five-year, $567,609 Faculty Early Career Development Program (CAREER) grant from the National Science Foundation (NSF) for her research. Understanding the vulnerabilities of artificial intelligence (AI) to online misinformation is “an important and timely problem to address,” she said.
“These systems have complex architectures and are designed to learn from whatever information is on the internet. An adversary might try to poison these systems with a collection of adversarial or false information,” Nilizadeh said. “The system will learn the adversarial information in the same way it learns truthful information. The adversary can also use some system vulnerabilities to generate malicious content. We first need to understand the vulnerabilities of these systems to develop detection and prevention techniques that improve their resilience to these attacks.”
The CAREER Award is the NSF’s most prestigious honor for junior faculty. Recipients are outstanding researchers but are also expected to be outstanding teachers through research, educational excellence and integrating education and research at their home institutions.
Nilizadeh’s research will include a comprehensive look at the types of attacks that NLG systems are susceptible to and the creation of AI-based optimization methods to examine the systems against different attack models. She also will explore an in-depth analysis and characterization of vulnerabilities that lead to attacks and develop defensive methods to protect NLG systems.
The work will focus on two common natural language generation techniques: summarization, and question-answering. In summarization, the AI is given a list of articles and asked to summarize their content. In question answering, the system is given a document, finds answers to questions in that document and generates text answers.
Hong Jiang, chair of the Department of Computer Science and Engineering, underscored the importance of Nilizadeh’s research.
“With large language models and text-generation systems revolutionizing how we interact with machines and enabling the development of novel applications for health care, robotics and beyond, serious concerns emerge about how these powerful systems may be misused, manipulated or cause privacy leakages and security threats,” Jiang said. “It is threats like these that Dr. Nilizadeh’s CAREER Award seeks to defend against by exploring novel methods for enhancing the robustness of such systems so that misuses can be detected and mitigated, and end-users can trust and explain the outcomes generated by the systems.”
END
Researcher explores vulnerabilities of AI systems to online misinformation
UTA researcher earns grant to increase security of natural language generation systems
2023-06-12
ELSE PRESS RELEASES FROM THIS DATE:
Food-drug interactions could be impactful for some lung cancer patients according to new study in JNCCN
2023-06-12
PLYMOUTH MEETING, PA [June 12, 2023] — New research in the June 2023 issue of JNCCN—Journal of the National Comprehensive Cancer Network found that when alectinib—a safe and effective small molecule kinase inhibitor used to treat some types of advanced lung cancer—was taken with a fuller breakfast, or with lunch, it resulted in significantly higher drug concentrations than when taken with a low-fat breakfast. The researchers, based out of Rotterdam, The Netherlands, evaluated 20 randomized patients who took one of two daily alectinib doses with either low-fat yogurt ...
U.S. consumers judge morality of armed self-protection on case-by-case basis, OSU research shows
2023-06-12
CORVALLIS, Ore. – American consumers use their understanding of gun rights when judging the morality of civilians’ use of guns to protect themselves from crime, and that assessment varies depending on specific scenarios, new research from Oregon State University shows.
The study’s objective was to explore Americans’ understanding of the Second Amendment, the only constitutional right that explicitly entitles individuals to a consumer product, and how that understanding guides which gun-related behaviors are deemed morally acceptable. The authors also examined how recent court rulings and legal and market ...
Magic cocktail generates lung’s most critical immune cell in the lab
2023-06-12
SAN ANTONIO (June 12, 2023) — Researchers at Texas Biomedical Research Institute have succeeded in generating the lung’s most important immune cell, the alveolar macrophage, in the lab. The cell culture model will make it much easier and inexpensive for researchers around the world to investigate lung inflammatory diseases and test new potential therapies.
Macrophages are the “Pac-Man” of the immune system, eating up garbage throughout tissues in the body. Alveolar macrophages specifically live in the lining of lung’s air sacs where air exchange occurs, and are usually the first immune cells to encounter pathogens entering the deep lungs, such as SARS-CoV-2 ...
Evolutionary fuel: Researchers study maintenance of an ancient chromosomal inversion
2023-06-12
LOGAN, UTAH, USA -- Genetic variation is the ultimate fuel for evolution, says Utah State University evolutionary geneticist Zachariah Gompert. But, over centuries, that fuel reservoir gets depleted in the course of natural selection and random genetic drift.
Whether, or how, genetic variation can persist over the long haul remains a big question for scientists. Gompert and colleagues from the University of Montpellier in France, the United Kingdom’s John Innes Centre, the National Autonomous University of México, Querétaro; ...
Jefferson Lab Virtual Series serves up science brain teasers
2023-06-12
NEWPORT NEWS, VA – Here’s a question for you… Is it possible to learn key science concepts in three minutes or less? The answer: We sure hope so. The U.S. Department of Energy’s Thomas Jefferson National Accelerator Facility is now offering a new playlist called “Here’s a Question” as part of its long-running Frostbite Theater video series. In the “Here’s a Question” videos, longtime Frostbite Theater hosts Steve Gagnon and Joanna Griffin help viewers understand the scientific concepts underlying iron oxidation, magnetism and thermodynamics - and many more!
The series is the newest featured playlist ...
Experiment in Brazil identifies flood-prone areas of cities
2023-06-12
Scientists affiliated with the National Space Research Institute (INPE) in Brazil have combined models that predict urban expansion and land-use changes with hydrodynamic models to create a methodology capable of supplying geographical information that identifies flood-prone areas of cities, especially those vulnerable to the impact of extremely heavy rainfall.
The groundbreaking study was based on data for São Caetano do Sul, a city in metropolitan São Paulo, but the methodology can be used by other cities to devise public policies and make ...
Updating cars as fast as a smart phone
2023-06-12
Cyber-physical systems, such as vehicles, trains, airplanes, smart homes, or production facilities, combine electronic and mechanical elements with software. Development of these systems is highly complex due to the large number of dependencies among the components. “When a car’s wire harness is modified, the diameter of the cable duct also has to be changed,” says Professor Ralf Reussner, Spokesman of the CRC at KIT. This must be agreed upon by electrical engineers, software engineers and mechanical engineers. ...
Excessive alcohol consumption may accelerate Alzheimer’s disease progression
2023-06-12
LA JOLLA, CA—Alcohol use disorder (AUD) quickens the pace of Alzheimer’s disease progression when paired with genetic susceptibility. Scripps Research and University of Bologna scientists reported in the journal eNeuro on June 12, 2023, that repeated alcohol intoxication is associated with changes to gene expression indicative of disease progression in the brains of mice that are genetically predisposed to Alzheimer’s. When repeatedly exposed to intoxicating amounts of alcohol, ...
A step toward safe and reliable autopilots for flying
2023-06-12
In the film “Top Gun: Maverick,” Maverick, played by Tom Cruise, is charged with training young pilots to complete a seemingly impossible mission — to fly their jets deep into a rocky canyon, staying so low to the ground they cannot be detected by radar, then rapidly climb out of the canyon at an extreme angle, avoiding the rock walls. Spoiler alert: With Maverick’s help, these human pilots accomplish their mission.
A machine, on the other hand, would struggle to complete the same pulse-pounding task. To an autonomous aircraft, for instance, the most straightforward path toward the target is in conflict with what the machine needs ...
Mass General Hospital researchers uncover why light-to-moderate drinking is tied to better heart health
2023-06-12
BOSTON – A new study led by investigators from Massachusetts General Hospital, a founding member of the Mass General Brigham healthcare system, offers an explanation for why light-to-moderate alcohol consumption may be associated with lower risk of heart disease. For the first time, researchers found that alcohol, in light to moderate quantities, was associated with long-term reductions in stress signaling in the brain. This impact on the brain’s stress systems appeared to significantly account for the reductions in cardiovascular events seen in light to moderate drinkers participating in the ...
LAST 30 PRESS RELEASES:
Scientists trace origins of now extinct plant population from volcanically active Nishinoshima
AI algorithm based on routine mammogram + age can predict women’s major cardiovascular disease risk
New hurdle seen to prostate screening: primary-care docs
MSU researchers explore how virtual sports aid mental health
Working together, cells extend their senses
Cheese fungi help unlock secrets of evolution
Researchers find brain region that fuels compulsive drinking
Mental health effects of exposure to firearm violence persist long after direct exposure
Research identifies immune response that controls Oropouche infection and prevents neurological damage
University of Cincinnati, Kent State University awarded $3M by NSF to share research resources
Ancient DNA reveals deeply complex Mastodon family and repeated migrations driven by climate change
Measuring the quantum W state
Researchers find a way to use antibodies to direct T cells to kill Cytomegalovirus-infected cells
Engineers create mini microscope for real-time brain imaging
Funding for training and research in biological complexity
The Journal of Nuclear Medicine Ahead-of-Print Tip Sheet: September 12, 2025
ISSCR statement on the scientific and therapeutic value of human fetal tissue research
Novel PET tracer detects synaptic changes in spinal cord and brain after spinal cord injury
Wiley advances Knowitall Solutions with new trendfinder application for user-friendly chemometric analysis and additional enhancements to analytical workflows
Benchmark study tracks trends in dog behavior
OpenAI, DeepSeek, and Google vary widely in identifying hate speech
Research spotlight: Study identifies a surprising new treatment target for chronic limb threatening ischemia
Childhood loneliness and cognitive decline and dementia risk in middle-aged and older adults
Parental diseases of despair and suicidal events in their children
Acupuncture for chronic low back pain in older adults
Acupuncture treatment improves disabling effects of chronic low back pain in older adults
How interstellar objects similar to 3I/ATLAS could jump-start planet formation around infant stars
Rented e-bicycles more dangerous than e-scooters in cities
Ditches as waterways: Managing ‘ditch-scapes’ to strengthen communities and the environment
In-situ molecular passivation enables pure-blue perovskite LEDs via vacuum thermal evaporation
[Press-News.org] Researcher explores vulnerabilities of AI systems to online misinformationUTA researcher earns grant to increase security of natural language generation systems