(Press-News.org) A University of Texas at Arlington researcher is working to increase the security of natural language generation (NLG) systems, such as those used by ChatGPT, to guard against misuse and abuse that could allow the spread of misinformation online.
Shirin Nilizadeh, assistant professor in the Department of Computer Science and Engineering, has earned a five-year, $567,609 Faculty Early Career Development Program (CAREER) grant from the National Science Foundation (NSF) for her research. Understanding the vulnerabilities of artificial intelligence (AI) to online misinformation is “an important and timely problem to address,” she said.
“These systems have complex architectures and are designed to learn from whatever information is on the internet. An adversary might try to poison these systems with a collection of adversarial or false information,” Nilizadeh said. “The system will learn the adversarial information in the same way it learns truthful information. The adversary can also use some system vulnerabilities to generate malicious content. We first need to understand the vulnerabilities of these systems to develop detection and prevention techniques that improve their resilience to these attacks.”
The CAREER Award is the NSF’s most prestigious honor for junior faculty. Recipients are outstanding researchers but are also expected to be outstanding teachers through research, educational excellence and integrating education and research at their home institutions.
Nilizadeh’s research will include a comprehensive look at the types of attacks that NLG systems are susceptible to and the creation of AI-based optimization methods to examine the systems against different attack models. She also will explore an in-depth analysis and characterization of vulnerabilities that lead to attacks and develop defensive methods to protect NLG systems.
The work will focus on two common natural language generation techniques: summarization, and question-answering. In summarization, the AI is given a list of articles and asked to summarize their content. In question answering, the system is given a document, finds answers to questions in that document and generates text answers.
Hong Jiang, chair of the Department of Computer Science and Engineering, underscored the importance of Nilizadeh’s research.
“With large language models and text-generation systems revolutionizing how we interact with machines and enabling the development of novel applications for health care, robotics and beyond, serious concerns emerge about how these powerful systems may be misused, manipulated or cause privacy leakages and security threats,” Jiang said. “It is threats like these that Dr. Nilizadeh’s CAREER Award seeks to defend against by exploring novel methods for enhancing the robustness of such systems so that misuses can be detected and mitigated, and end-users can trust and explain the outcomes generated by the systems.”
END
Researcher explores vulnerabilities of AI systems to online misinformation
UTA researcher earns grant to increase security of natural language generation systems
2023-06-12
ELSE PRESS RELEASES FROM THIS DATE:
Food-drug interactions could be impactful for some lung cancer patients according to new study in JNCCN
2023-06-12
PLYMOUTH MEETING, PA [June 12, 2023] — New research in the June 2023 issue of JNCCN—Journal of the National Comprehensive Cancer Network found that when alectinib—a safe and effective small molecule kinase inhibitor used to treat some types of advanced lung cancer—was taken with a fuller breakfast, or with lunch, it resulted in significantly higher drug concentrations than when taken with a low-fat breakfast. The researchers, based out of Rotterdam, The Netherlands, evaluated 20 randomized patients who took one of two daily alectinib doses with either low-fat yogurt ...
U.S. consumers judge morality of armed self-protection on case-by-case basis, OSU research shows
2023-06-12
CORVALLIS, Ore. – American consumers use their understanding of gun rights when judging the morality of civilians’ use of guns to protect themselves from crime, and that assessment varies depending on specific scenarios, new research from Oregon State University shows.
The study’s objective was to explore Americans’ understanding of the Second Amendment, the only constitutional right that explicitly entitles individuals to a consumer product, and how that understanding guides which gun-related behaviors are deemed morally acceptable. The authors also examined how recent court rulings and legal and market ...
Magic cocktail generates lung’s most critical immune cell in the lab
2023-06-12
SAN ANTONIO (June 12, 2023) — Researchers at Texas Biomedical Research Institute have succeeded in generating the lung’s most important immune cell, the alveolar macrophage, in the lab. The cell culture model will make it much easier and inexpensive for researchers around the world to investigate lung inflammatory diseases and test new potential therapies.
Macrophages are the “Pac-Man” of the immune system, eating up garbage throughout tissues in the body. Alveolar macrophages specifically live in the lining of lung’s air sacs where air exchange occurs, and are usually the first immune cells to encounter pathogens entering the deep lungs, such as SARS-CoV-2 ...
Evolutionary fuel: Researchers study maintenance of an ancient chromosomal inversion
2023-06-12
LOGAN, UTAH, USA -- Genetic variation is the ultimate fuel for evolution, says Utah State University evolutionary geneticist Zachariah Gompert. But, over centuries, that fuel reservoir gets depleted in the course of natural selection and random genetic drift.
Whether, or how, genetic variation can persist over the long haul remains a big question for scientists. Gompert and colleagues from the University of Montpellier in France, the United Kingdom’s John Innes Centre, the National Autonomous University of México, Querétaro; ...
Jefferson Lab Virtual Series serves up science brain teasers
2023-06-12
NEWPORT NEWS, VA – Here’s a question for you… Is it possible to learn key science concepts in three minutes or less? The answer: We sure hope so. The U.S. Department of Energy’s Thomas Jefferson National Accelerator Facility is now offering a new playlist called “Here’s a Question” as part of its long-running Frostbite Theater video series. In the “Here’s a Question” videos, longtime Frostbite Theater hosts Steve Gagnon and Joanna Griffin help viewers understand the scientific concepts underlying iron oxidation, magnetism and thermodynamics - and many more!
The series is the newest featured playlist ...
Experiment in Brazil identifies flood-prone areas of cities
2023-06-12
Scientists affiliated with the National Space Research Institute (INPE) in Brazil have combined models that predict urban expansion and land-use changes with hydrodynamic models to create a methodology capable of supplying geographical information that identifies flood-prone areas of cities, especially those vulnerable to the impact of extremely heavy rainfall.
The groundbreaking study was based on data for São Caetano do Sul, a city in metropolitan São Paulo, but the methodology can be used by other cities to devise public policies and make ...
Updating cars as fast as a smart phone
2023-06-12
Cyber-physical systems, such as vehicles, trains, airplanes, smart homes, or production facilities, combine electronic and mechanical elements with software. Development of these systems is highly complex due to the large number of dependencies among the components. “When a car’s wire harness is modified, the diameter of the cable duct also has to be changed,” says Professor Ralf Reussner, Spokesman of the CRC at KIT. This must be agreed upon by electrical engineers, software engineers and mechanical engineers. ...
Excessive alcohol consumption may accelerate Alzheimer’s disease progression
2023-06-12
LA JOLLA, CA—Alcohol use disorder (AUD) quickens the pace of Alzheimer’s disease progression when paired with genetic susceptibility. Scripps Research and University of Bologna scientists reported in the journal eNeuro on June 12, 2023, that repeated alcohol intoxication is associated with changes to gene expression indicative of disease progression in the brains of mice that are genetically predisposed to Alzheimer’s. When repeatedly exposed to intoxicating amounts of alcohol, ...
A step toward safe and reliable autopilots for flying
2023-06-12
In the film “Top Gun: Maverick,” Maverick, played by Tom Cruise, is charged with training young pilots to complete a seemingly impossible mission — to fly their jets deep into a rocky canyon, staying so low to the ground they cannot be detected by radar, then rapidly climb out of the canyon at an extreme angle, avoiding the rock walls. Spoiler alert: With Maverick’s help, these human pilots accomplish their mission.
A machine, on the other hand, would struggle to complete the same pulse-pounding task. To an autonomous aircraft, for instance, the most straightforward path toward the target is in conflict with what the machine needs ...
Mass General Hospital researchers uncover why light-to-moderate drinking is tied to better heart health
2023-06-12
BOSTON – A new study led by investigators from Massachusetts General Hospital, a founding member of the Mass General Brigham healthcare system, offers an explanation for why light-to-moderate alcohol consumption may be associated with lower risk of heart disease. For the first time, researchers found that alcohol, in light to moderate quantities, was associated with long-term reductions in stress signaling in the brain. This impact on the brain’s stress systems appeared to significantly account for the reductions in cardiovascular events seen in light to moderate drinkers participating in the ...
LAST 30 PRESS RELEASES:
Consistent policy, not “patchwork” regulations, recommended for the coexistence of crops
LEDs shed light on efficient tomato cultivation
2025 Ig Physics Nobel Prize for perfect pasta sauce
Bright squeezed light in the kilohertz frequency band
Water flowed on ancient asteroid
AI model offers accurate and explainable insights to support autism assessment
Process for dealing with sexual misconduct by doctors requires major reform
Severe pregnancy sickness raises risk of mental health conditions by over 50%
Early humans may have walked from Türkiye to mainland Europe, new groundbreaking research suggests
New study shows biochar’s electrical properties can influence rice field methane emissions
Guangdong faces largest chikungunya outbreak on record
Tirzepatide improves blood sugar control in children aged 10-17 years with type 2 diabetes inadequately controlled on existing therapies (SURPASS-PEDS trial)
An old drug, in a low dose, shown to be safe and effective in preventing progression of type 1 diabetes in children and young people (MELD-ATG trial)
Study reports potential effects of verapamil in slowing progression of type 1 diabetes
Fresh hope for type 1 diabetes as daily pill that slows onset confirms promise at 2-year follow-up
New estimates predict over 4 million missing people who would be alive in 2025 if not for inadequate type 1 diabetes care
So what should we call this – a grue jay?
Chicago Quantum Exchange-led coalition advances to final round in NSF Engine competition
Study identifies candidates for therapeutic targets in pediatric germ cell tumors
Media alert: The global burden of CVD
Study illuminates contributing factors to blood vessel leakage
What nations around the world can learn from Ukraine
Mixing tree species does not always make forests more drought-resilient
Public confidence in U.S. health agencies slides, fueled by declines among Democrats
“Quantum squeezing” a nanoscale particle for the first time
El Niño spurs extreme daily rain events despite drier monsoons in India
Two studies explore the genomic diversity of deadly mosquito vectors
Zebra finches categorize their vocal calls by meaning
Analysis challenges conventional wisdom about partisan support for US science funding
New model can accurately predict a forest’s future
[Press-News.org] Researcher explores vulnerabilities of AI systems to online misinformationUTA researcher earns grant to increase security of natural language generation systems