(Press-News.org) With the assumption that students are going to use artificial intelligence and large language models such as ChatGPT to do their homework, researchers in the Department of Aerospace Engineering in The Grainger College of Engineering, University of Illinois Urbana-Champaign set out to learn how well the free version of ChatGPT would compare with human students in a semester-long undergraduate control systems course.
The results: On straightforward math homework, ChatGPT got an A, but with some quirky answers. However, on higher-level problems that require reasoning, it got a D.
“We found ChatGPT technology can get an A on structured, straightforward questions. On open-ended questions it got a 62, brining ChatGPT’s semester grade down to an 82, a low B. The class average for the human students was 84.85 percent because they could handle the problems that required higher-level reasoning,” said Ph.D. student Gokul Puthumanaillam.
The study concludes that a student who puts in minimal effort, showing no effort to learn the material, could use ChatGPT exclusively, get a B and pass the course. The problem is the passing grade might be the combination of A+ in simple math and D- in analysis. They haven’t learned much.
“Like calculators in math classes, ChatGPT is a tool that’s here to stay and that students will use. What the results of this study pointed out to me is that I need to adjust as an educator,” said Puthumanaillam’s advisor Melkior Ornik. “I plan to consider how I design my courses so that, over time, I include more higher-level questions, perhaps including project-based assignments. Students will still use programs like ChatGPT to do the simpler math problems, but by adding more open-ended questions, they’ll also reach a higher level of critical thinking and truly learn the material.”
Puthumanaillam said although ChatGPT is fast and mostly correct on structured questions, it’s wise to use it with caution.
“A student might take 20 minutes to answer a question. ChatGPT solves it in less than 20 seconds, but the correctness is sometimes questionable.”
He also described examples of strange behavior from ChatGPT’s homework such as using inappropriate technical jargon and saying things that were simply not true.
“Despite the fact that we provided all of the course material needed to ChatGPT, it still hallucinated, using words like quasi periodic oscillations that were never used in the class, in the lectures or course materials.”
The study considered the type of student who chooses to put in minimal effort. Puthumanaillam said the premium version of ChatGPT may be slightly more capable of solving the analytical questions and can store more memory to solve longer, more complex problems. The researchers chose to use the free version of the software because the average student probably wouldn’t want to spend the monthly fee.
Puthumanaillam noted that there were no team assignments in the course, the ChatGPT prompts used the exact language as the human students received, and it was all conducted synchronously.
“When the students were doing their homework, ChatGPT was also doing the homework. ChatGPT was just an extra student in the class.”
Did ChatGPT learn from its mistakes?
“When we told ChatGPT it was wrong on a multiple-choice question, gave it the correct option, then a variation of the same question, yes, it did better. In a sense, it was learning but overall, it was stagnant. If it scored 90 percent in homework, it ended up scoring 90 or 92 at the conclusion of the semester.”
This work was supported by the Grants for Advancement of Teaching in Engineering program at The Grainger College of Engineering, University of Illinois Urbana-Champaign. Aerospace Professor Tim Bretl, along with Ph.D. students Grayson Schaer and Pranay Thangeda, created the project environments, developed course materials and the PrairieLearn infrastructure.
The study, “The Lazy Student's Dream: ChatGPT Passing an Engineering Course on Its Own,” by Gokul Puthumanaillam and Melkior Ornik is available online and will be presented at 14th International Federation of Automatic Control Symposium on Advances in Control Education in June. DOI: 10.48550/arXiv.2503.05760
The syllabus and course materials for AE 353: Aerospace Control Systems, as well as sample prompts used in the research are available online.
END
Using ChatGPT, students might pass a course, but with a cost
2025-04-21
ELSE PRESS RELEASES FROM THIS DATE:
Psilocibin, or “magic mushroom,” use increased among all age groups since decriminalization in 2019
2025-04-21
Embargoed for release until 5:00 p.m. ET on Monday 21 April 2025
Follow @Annalsofim on X, Facebook, Instagram, threads, and Linkedin
Below please find summaries of new articles that will be published in the next issue of Annals of Internal Medicine. The summaries are not intended to substitute for the full articles as a source of information. This information is under strict embargo and by taking it into possession, media representatives are committing to the terms of the embargo not only on their own behalf, but also on behalf ...
More Americans are using psilocybin—especially those with mental health conditions, study shows
2025-04-21
Use of psilocybin, the hallucinogenic chemical found in what is known as “magic mushrooms,” has increased significantly nationwide since 2019, according to a new study led by researchers at the University of Colorado Anschutz Medical Campus and Rocky Mountain Poison and Drug Safety.
The study was published today in the Annals of Internal Medicine.
The researchers found that psilocybin use increased across all age groups, with the largest rise in young adults and older adults.
“We found that since 2019, the number ...
Meta-analysis finds Transcendental Meditation reduces post-traumatic stress disorder (PTSD) symptoms across populations and cultures
2025-04-21
Just published is the third new study showing that TM is highly effective in reducing stress in a wide array of populations. This meta-analysis included 15 studies with over 1,200 participants from military and civilian backgrounds. Using rigorous meta-analytic methods, the study found a large effect size of 1.01 for TM compared to control groups. An effect size over 0.80 is considered a large effect that the person, their family, and their medical staff would likely notice and discuss.
Effective across multiple ethnicities and trauma types
TM was consistently effective for people ...
AACR: Five MD Anderson researchers honored with 2025 Scientific Achievement Awards
2025-04-21
CHICAGO — Five scientists from The University of Texas MD Anderson Cancer Center will be recognized with Scientific Achievement Awards and honors at the American Association for Cancer Research (AACR) Annual Meeting 2025. These awards highlight significant achievements in translational research and oncology leadership from both early career and internationally renowned scientists and clinicians.
The honors include:
AACR-Daniel D. Von Hoff Award for Outstanding Contributions to Education & Training in Cancer Research: ...
How not to form a state: Research reveals how imbalanced social-ecological acceleration led to collapse in early medieval Europe
2025-04-21
Understanding the acceleration of human impacts on the environment is key to addressing the complex planetary and social challenges of the Anthropocene. But even as the inter-relatedness of environmental, political, and social processes becomes clearer, the conditions that produce sustainable outcomes remain little understood.
Now, a new study examines the acceleration of social-ecological changes in the first kingdom in Poland, the Piast dynasty, identifying the factors that contributed to its failure. Using new high-resolution ...
Introduced trees are becoming more common in the eastern United States, while native diversity declines
2025-04-21
In the largest study of its kind, researchers at the Florida Museum of Natural History have used data from a 120-year-old program managed by the U.S. Department of Agriculture to quantify the effects of introduced species.
The researchers included more than 5 million measurements from individual trees across much of eastern North America and showed the rate at which introduced species are spreading has increased over the last two decades. Additionally, native tree diversity is on the decline in areas where exotic species originally introduced by humans have encroached.
This ...
The chemical basis for life can form in interstellar ice
2025-04-21
The Krebs cycle is a series of chemical reactions that occur in the cells of living beings. It can produce energy from the degradation of certain types of molecules (lipids, sugars, proteins). This energy is then used by the cell to produce the energy essential to cell function.
These fine layers of ice form on dust grains in space, and are irradiated by ultraviolet radiation and cosmic rays.
Organic molecules that play a role in the chemical processes behind the origins of life.
At the Nice Institute of Chemistry (CNRS/Université Côte ...
How safe is the air to breathe? 50 million people in the US do not know
2025-04-21
UNIVERSITY PARK, Pa. — In 2024, more than 50 million people in the United States lived in counties with no air-quality monitoring, according to a new study from researchers in the Penn State College of Health and Human Development.
Rural counties — especially counties in the Midwest and South — were less likely to have an air-quality monitoring site. Air quality measures are used to estimate people’s exposure to air pollution, which makes monitoring a critical public health tool, according to Nelson Roque, assistant professor of human development and family studies and ...
DDT residues persist in trout in some Canadian lakes 70 years after insecticide treatment, often at levels ten times that recommended as safe for the wildlife which consumes the fish
2025-04-21
DDT residues persist in trout in some Canadian lakes 70 years after insecticide treatment, often at levels ten times that recommended as safe for the wildlife which consumes the fish
Article URL: https://plos.io/4lp9Fhx
Article title: Legacy DDT and its metabolites in Brook Trout from lakes within forested watersheds treated with aerial applications of insecticides
Author countries: Canada
Funding: This research was supported by funding from the New Brunswick Wildlife Trust Fund (JK; F000-201; www.nbwtf.ca), the Natural Sciences and Engineering Research Council of Canada (NSERC) ...
Building ‘cellular bridges’ for spinal cord repair after injury
2025-04-21
COLUMBUS, Ohio – Capitalizing on the flexibility of tiny cells inside the body’s smallest blood vessels may be a powerful spinal cord repair strategy, new research suggests.
In mouse experiments, scientists introduced a specific type of recombinant protein to the site of a spinal cord injury where these cells, called pericytes, had flooded the lesion zone. Once exposed to this protein, results showed, pericytes change shape and inhibit the production of some molecules while secreting others, creating “cellular bridges” that support regeneration of axons – the long, slender extensions of nerve cell bodies that transmit messages.
Researchers ...