PRESS-NEWS.org - Press Release Distribution
PRESS RELEASES DISTRIBUTION

Real or fake text? We can learn to spot the difference

Computer scientists at the University of Pennsylvania prove that people can be trained to tell the difference between AI-generated and human-written text. Their new paper debuts the results of the largest-ever human study on AI detection.

2023-02-27
(Press-News.org) The most recent generation of chatbots has surfaced longstanding concerns about the growing sophistication and accessibility of artificial intelligence.

Fears about the integrity of the job market — from the creative economy to the managerial class — have spread to the classroom as educators rethink learning in the wake of ChatGPT.

Yet while apprehensions about employment and schools dominate headlines, the truth is that the effects of large-scale language models such as ChatGPT will touch virtually every corner of our lives. These new tools raise society-wide concerns about artificial intelligence’s role in reinforcing social biases, committing fraud and identity theft, generating fake news, spreading misinformation and more.

A team of researchers at the University of Pennsylvania School of Engineering and Applied Science is seeking to empower tech users to mitigate these risks. In a peer-reviewed paper presented at the February 2023 meeting of the Association for the Advancement of Artificial Intelligence, the authors demonstrate that people can learn to spot the difference between machine-generated and human-written text.

Before you choose a recipe, share an article, or provide your credit card details, it’s important to know there are steps you can take to discern the reliability of your source.

The study, led by Chris Callison-Burch, Associate Professor in the Department of Computer and Information Science (CIS), along with Liam Dugan and Daphne Ippolito, Ph.D. students in CIS, provides evidence that AI-generated text is detectable.

“We’ve shown that people can train themselves to recognize machine-generated texts,” says Callison-Burch. “People start with a certain set of assumptions about what sort of errors a machine would make, but these assumptions aren’t necessarily correct. Over time, given enough examples and explicit instruction, we can learn to pick up on the types of errors that machines are currently making.”

“AI today is surprisingly good at producing very fluent, very grammatical text,” adds Dugan. “But it does make mistakes. We prove that machines make distinctive types of errors — common-sense errors, relevance errors, reasoning errors and logical errors, for example — that we can learn how to spot.”

The study uses data collected using Real or Fake Text?, an original web-based training game.

This training game is notable for transforming the standard experimental method for detection studies into a more accurate recreation of how people use AI to generate text.

In standard methods, participants are asked to indicate in a yes-or-no fashion whether a machine has produced a given text. This task involves simply classifying a text as real or fake and responses are scored as correct or incorrect.

The Penn model significantly refines the standard detection study into an effective training task by showing examples that all begin as human-written. Each example then transitions into generated text, asking participants to mark where they believe this transition begins. Trainees identify and describe the features of the text that indicate error and receive a score.

The study results show that participants scored significantly better than random chance, providing evidence that AI-created text is, to some extent, detectable.

“Our method not only gamifies the task, making it more engaging, it also provides a more realistic context for training,” says Dugan. “Generated texts, like those produced by ChatGPT, begin with human-provided prompts.”

The study speaks not only to artificial intelligence today, but also outlines a reassuring, even exciting, future for our relationship to this technology.

“Five years ago,” says Dugan, “models couldn’t stay on topic or produce a fluent sentence. Now, they rarely make a grammar mistake. Our study identifies the kind of errors that characterize AI chatbots, but it’s important to keep in mind that these errors have evolved and will continue to evolve. The shift to be concerned about is not that AI-written text is undetectable. It’s that people will need to continue training themselves to recognize the difference and work with detection software as a supplement.”

“People are anxious about AI for valid reasons,” says Callison-Burch. “Our study gives points of evidence to allay these anxieties. Once we can harness our optimism about AI text generators, we will be able to devote attention to these tools’ capacity for helping us write more imaginative, more interesting texts.”

Ippolito, the Penn study’s co-leader and current Research Scientist at Google, complements Dugan’s focus on detection with her work’s emphasis on exploring the most effective use cases for these tools. She contributed, for example, to Wordcraft, an AI creative writing tool developed in tandem with published writers. None of the writers or researchers found that AI was a compelling replacement for a fiction writer, but they did find significant value in its ability to support the creative process.

“My feeling at the moment is that these technologies are best suited for creative writing,” says Callison-Burch. “News stories, term papers, or legal advice are bad use cases because there’s no guarantee of factuality.”

“There are exciting positive directions that you can push this technology in,” says Dugan. “People are fixated on the worrisome examples, like plagiarism and fake news, but we know now that we can be training ourselves to be better readers and writers.”

END


ELSE PRESS RELEASES FROM THIS DATE:

Adverse Pregnancy Outcomes May Help Identify Future Heart Disease Risk

2023-02-27
(Boston)—Many pregnancy complications are associated with future heart disease. Such complications include gestational diabetes, preterm birth, fetal growth restriction and hypertensive disorders of pregnancy (gestational hypertension, preeclampsia and related disorders), and together they are referred to as adverse pregnancy outcomes (APOs).  Although APOs are recognized as a useful way to identify individuals with increased risk for future heart disease, it is not known how often APOs occur before traditional heart ...

LSU Health New Orleans pain protocol eliminates need for opioids following knee replacement in most patients

2023-02-27
New Orleans, LA – A study led by Vinod Dasa, MD, Professor of Orthopaedics at LSU Health New Orleans School of Medicine, reports that a novel surgical pain management strategy following total knee arthroplasty (TKA), or total knee replacement, provided pain relief without opioids. The researchers also found that changing prescriptions for opioids at discharge from automatic to upon request dramatically decreased opioid use. Their results are published in the Journal of Experimental Orthopaedics, available here.        “About 70% of opioid-naïve ...

Researchers pursue green technology to capture carbon dioxide emissions

Researchers pursue green technology to capture carbon dioxide emissions
2023-02-27
New award from the U.S. Dept. of Energy will help researchers develop green technology to capture carbon dioxide emissions from power plants BALTIMORE, MD (February 27, 2022)—Researchers from the University of Maryland Center for Environmental Science (UMCES) and the Institute of Marine and Environmental Technology (IMET) have been awarded a three-year, $2 million grant from the U.S. Department of Energy to understand how microalgae can be used to reduce carbon dioxide emissions from power plants. “Climate change is one of the biggest challenges facing our society today and IMET is thrilled ...

The rediscovery of an ethereal fairy lantern brightly illuminates their mysterious past

The rediscovery of an ethereal fairy lantern brightly illuminates their mysterious past
2023-02-27
Green leaves and photosynthesis were once considered key features of plants. However, some plants have since abandoned this process, obtaining their nutrients from other organisms. One such plant is the genus of Thismia, commonly known as fairy lanterns, which is characterised by its unusual appearance, elusiveness, and lack of photosynthesis. Fairy lanterns are rare and only grow in specific places. They live underground with their colourful flowers rising above the soil, which can sometimes make them look like mushrooms. Around 90 species of Thismia have been found, but many are ...

Study identifies four distinct pain trajectories in nursing home residents

2023-02-27
INDIANAPOLIS – Despite awareness that pain is common in nursing home residents, there has been minimal attention focused on how this pain changes over time. A new study from Regenstrief Institute and Indiana University School of Nursing researchers presents compelling evidence of the existence of four distinct pain trajectories in this population. This new understanding of pain over time can help nursing home staff and clinicians better understand, recognize and respond to risk factors associated with persistent pain in individuals living in nursing homes. Ultimately, consideration of pain trajectories may alter courses of care and illness, ...

Key laboratory conducted a literature review on advancement in microfluidic actuated & controlled systems and application for lab-on-chip in space life science

Key laboratory conducted a literature review on advancement in microfluidic actuated & controlled systems and application for lab-on-chip in space life science
2023-02-27
The use of space environment to carry out life science research is of great significance to issues affecting the occurrence and development of life on earth by space flight and space environment; however, there are limitations in complex manipulation, research models based on mammalian and 2D cell culture experiments, and etc. Microfluidic chips, also known as "lab-on-chip (LOC)", integrates the related functions of traditional laboratories on a micron-level chip with low energy consumption, high throughput, and automation, which can realize long-term experimental operation, and remote data recording and transmission, thus ...

Academic report shines light on what United States midterm election results could mean for Biden, Trump and future of American politics

2023-02-27
What the United States midterm election results revealed about the current state of democracy in the country  – and the challenges that might lie ahead for both major parties – is examined in a new report led by a politics expert from London's Kingston University. Academics from institutions across the United Kingdom, United States and the Republic of Ireland have contributed to the Exploring the 2022 US Midterms briefing paper, recently published by the American Politics Group of the Political Studies Association. The report is designed to act as a bridge ...

People save more money when their goals fit their personality traits

2023-02-27
People whose savings goals align well with their dominant personality traits are more likely to save money, according to research published by the American Psychological Association. In the U.S. and around the world, savings rates are critically low. In October 2022, the Bureau of Economic Analysis reported Americans save just 2.3% of their income, the lowest in nearly two decades. Although people report wanting to save more money, saving is difficult -- in part because it requires people to overcome the psychological hurdle of making a sacrifice in the present to ...

Political ideology plays role in how people view boundaries

2023-02-27
COLUMBUS, Ohio – A new study may reveal part of the reason why conservatives are more likely than liberals to reject some COVID-19 health measures: They see boundaries as restrictions.   Liberals were more likely to see some of the measures used in the pandemic – such as social distancing rules and plexiglass separators in restaurants and stores – as providing guidance, rather than restrictions.   “There seems to be a fundamental ideological difference in how people view boundaries,” said Selin Malkoc, co-author of the study and professor of marketing at The Ohio State University’s Fisher College of Business.   “Conservatives ...

Indoor ‘queen banking’ could help beekeepers deal with changing climate

Indoor ‘queen banking’ could help beekeepers deal with changing climate
2023-02-27
OTHELLO, Wash. — Keeping queen bees chilled in indoor refrigeration units can make the practice of “queen banking” — storing excess queens in the spring to supplement hives in the fall — more stable and less labor-intensive, a Washington State University study found. It may also help strengthen honey bee survival in the face of a changing climate. In a paper published in the Journal of Apicultural Research, researchers compared queen banks stored in refrigerated units to those stored in the conventional ...

LAST 30 PRESS RELEASES:

Walking, moving more may lower risk of cardiovascular death for women with cancer history

Intracortical neural interfaces: Advancing technologies for freely moving animals

Post-LLM era: New horizons for AI with knowledge, collaboration, and co-evolution

“Sloshing” from celestial collisions solves mystery of how galactic clusters stay hot

Children poisoned by the synthetic opioid, fentanyl, has risen in the U.S. – eight years of national data shows

USC researchers observe mice may have a form of first aid

VUMC to develop AI technology for therapeutic antibody discovery

Unlocking the hidden proteome: The role of coding circular RNA in cancer

Advancing lung cancer treatment: Understanding the differences between LUAD and LUSC

Study reveals widening heart disease disparities in the US

The role of ubiquitination in cancer stem cell regulation

New insights into LSD1: a key regulator in disease pathogenesis

Vanderbilt lung transplant establishes new record

Revolutionizing cancer treatment: targeting EZH2 for a new era of precision medicine

Metasurface technology offers a compact way to generate multiphoton entanglement

Effort seeks to increase cancer-gene testing in primary care

Acoustofluidics-based method facilitates intracellular nanoparticle delivery

Sulfur bacteria team up to break down organic substances in the seabed

Stretching spider silk makes it stronger

Earth's orbital rhythms link timing of giant eruptions and climate change

Ammonia build-up kills liver cells but can be prevented using existing drug

New technical guidelines pave the way for widespread adoption of methane-reducing feed additives in dairy and livestock

Eradivir announces Phase 2 human challenge study of EV25 in healthy adults infected with influenza

New study finds that tooth size in Otaria byronia reflects historical shifts in population abundance

nTIDE March 2025 Jobs Report: Employment rate for people with disabilities holds steady at new plateau, despite February dip

Breakthrough cardiac regeneration research offers hope for the treatment of ischemic heart failure

Fluoride in drinking water is associated with impaired childhood cognition

New composite structure boosts polypropylene’s low-temperature toughness

While most Americans strongly support civics education in schools, partisan divide on DEI policies and free speech on college campuses remains

Revolutionizing surface science: Visualization of local dielectric properties of surfaces

[Press-News.org] Real or fake text? We can learn to spot the difference
Computer scientists at the University of Pennsylvania prove that people can be trained to tell the difference between AI-generated and human-written text. Their new paper debuts the results of the largest-ever human study on AI detection.