(Press-News.org)
Agents, chatbots and other tools based on artificial intelligence (AI) are increasingly used in everyday life by many. So-called large language model (LLM)-based agents, such as ChatGPT and Llama, have become impressively fluent in the responses they form, but quite often provide convincing yet incorrect information. Researchers at the University of Tokyo draw parallels between this issue and a human language disorder known as aphasia, where sufferers may speak fluently but make meaningless or hard-to-understand statements. This similarity could point toward better forms of diagnosis for aphasia, and even provide insight to AI engineers seeking to improve LLM-based agents.
This article was written by a human being, but the use of text-generating AI is on the rise in many areas. As more and more people come to use and rely on such things, there’s an ever-increasing need to make sure that these tools deliver correct and coherent responses and information to their users. Many familiar tools, including ChatGPT and others, appear very fluent in whatever they deliver. But their responses cannot always be relied upon due to the amount of essentially made-up content they produce. If the user is not sufficiently knowledgeable about the subject area in question, they can easily fall foul of assuming this information is right, especially given the high degree of confidence ChatGPT and others show.
“You can’t fail to notice how some AI systems can appear articulate while still producing often significant errors,” said Professor Takamitsu Watanabe from the International Research Center for Neurointelligence (WPI-IRCN) at the University of Tokyo. “But what struck my team and I was a similarity between this behavior and that of people with Wernicke’s aphasia, where such people speak fluently but don’t always make much sense. That prompted us to wonder if the internal mechanisms of these AI systems could be similar to those of the human brain affected by aphasia, and if so, what the implications might be.”
To explore this idea, the team used a method called energy landscape analysis, a technique originally developed by physicists seeking to visualize energy states in magnetic metal, but which was recently adapted for neuroscience. They examined patterns in resting brain activity from people with different types of aphasia and compared them to internal data from several publicly available LLMs. And in their analysis, the team did discover some striking similarities. The way digital information or signals are moved around and manipulated within these AI models closely matched the way some brain signals behaved in the brains of people with certain types of aphasia, including Wernicke’s aphasia.
“You can imagine the energy landscape as a surface with a ball on it. When there’s a curve, the ball may roll down and come to rest, but when the curves are shallow, the ball may roll around chaotically,” said Watanabe. “In aphasia, the ball represents the person’s brain state. In LLMs, it represents the continuing signal pattern in the model based on its instructions and internal dataset.”
The research has several implications. For neuroscience, it offers a possible new way to classify and monitor conditions like aphasia based on internal brain activity rather than just external symptoms. For AI, it could lead to better diagnostic tools that help engineers improve the architecture of AI systems from the inside out. Though, despite the similarities the researchers discovered, they urge caution not to make too many assumptions.
“We’re not saying chatbots have brain damage,” said Watanabe. “But they may be locked into a kind of rigid internal pattern that limits how flexibly they can draw on stored knowledge, just like in receptive aphasia. Whether future models can overcome this limitation remains to be seen, but understanding these internal parallels may be the first step toward smarter, more trustworthy AI too.”
###
Journal article: Takamitsu Watanabe, Katsuma Inoue, Yasuo Kuniyoshi, Kohei Nakajima, Kazuyuki Aihara “Comparison of large language model with aphasia”, Advanced Science, https://doi.org/10.1002/advs.202414016
Funding: This work was supported by Grant-in-aid for Research Activity from Japan Society for Promotion of Sciences (19H03535, 21H05679, 23H04217, JP20H05921), The University of Tokyo Excellent Young Researcher Project, Showa University Medical Institute of Developmental Disabilities Research, JST Moonshot R&D Program (JPMJMS2021), JST FOREST Program (24012854), Institute of AI and Beyond of UTokyo, Cross-ministerial Strategic Innovation Promotion Program (SIP) on “Integrated Health Care System” (JPJ012425).
Research Contact:
Professor Takamitsu Watanabe
International Research Center for Neurointelligence
The University of Tokyo Institutes for Advanced Study
7-3-1 Hongo Bunkyo-ku, Tokyo 113-0033 Japan.
takamitsu-watanabe@g.ecc.u-tokyo.ac.jp
International Research Center for Neurointelligence (WPI-IRCN) - https://ircn.jp/en/
Press contact:
Mr. Rohan Mehra
Public Relations Group, The University of Tokyo,
7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8656, Japan
press-releases.adm@gs.mail.u-tokyo.ac.jp
About The University of Tokyo:
The University of Tokyo is Japan's leading university and one of the world's top research universities. The vast research output of some 6,000 researchers is published in the world's top journals across the arts and sciences. Our vibrant student body of around 15,000 undergraduate and 15,000 graduate students includes over 4,000 international students. Find out more at www.u-tokyo.ac.jp/en/ or follow us on X (formerly Twitter) at @UTokyo_News_en.
END
Snus users who stopped using snus experienced higher blood pressure and gained weight. This has been shown by a research group at Linköping University, Sweden, in a study on 33 people, published in Harm Reduction Journal.
The use and marketing of nicotine snus, which does not contain tobacco, is increasing in the UK, the US, Sweden, and other countries. Nicotine is an addictive substance which, among other things, causes blood pressure and heart rate to rise immediately after intake. But it is unclear what happens in ...
That fit people have a reduced risk of premature death from various diseases is a recurring result in many studies. New research from Uppsala University shows that people with high fitness levels in their late teens also have a reduced risk of dying from random accidents. This suggests that the associations seen in previous studies have probably been misleading.
Many observational studies have shown that people who exercise more and have good cardiorespiratory fitness early in life are at lower risk of premature death from causes such as cancer and cardiovascular disease. However, a new study published in the European Journal of Preventive ...
When was the last time you sat in a garden and simply let your gaze wander? Observation gardens are built especially for this purpose, but can also fulfil other functions, such as providing aid for meditation.
Now, an international team of researchers has investigated what it is about these gardens that makes us feel more relaxed when we sit down to observe them. To do so, they assessed the impact of Kyoto’s famous Murin-an garden and compared it to a less vigorously maintained garden. The results were published in Frontiers in Neuroscience.
“Well-designed Japanese gardens have evocative and abstract sceneries designed in great detail. These sceneries encourage the viewer ...
Researchers derived pragmatic models that accurately distinguish mild, moderate and severe pneumonia in children, based on evidence from a study performed in 73 Emergency Departments (EDs) in 14 countries through the international Pediatric Emergency Research Network (PERN). The new predictive tools are intended to complement clinician judgement in deciding whether a child’s pneumonia warrants hospitalization or intensive care. The study was published in Lancet Child and Adolescent Health.
Community-acquired ...
Mindfulness-based therapy can offer significant relief for individuals who are still depressed after receiving treatment, according to a new clinical trial.
Researchers hope their findings, published in Lancet Psychiatry, could provide a new treatment pathway for people with depression who have not benefitted from previous treatment. The study was led by a researcher from the University of Surrey, sponsored by the Sussex Partnership NHS Foundation Trust, and funded by the National Institute for Health and Care Research (NIHR).
Mindfulness-based cognitive therapy (MBCT) differs from other psychological therapies by using intensive training in mindfulness meditation to help people develop ...
About The Study: In 2023 and 2024, more Part D beneficiaries were affected by their insurer exiting the marketplace than in previous years. This increase could be associated with changes to Medicare Part D from the Inflation Reduction Act (IRA), which increased Part D plan sponsor financial liability. These IRA provisions were designed to lower out-of-pocket costs for Part D beneficiaries, but increased Part D plan exits could lead to more limited coverage options and less competitive Part D marketplaces.
Corresponding Author: To contact ...
A small cluster of cells deep within our brains, called the locus coeruleus, affects how awake and attentive we are, how we respond to stress, how we cope with anxiety and fear, and how we create memories and learn.
The locus coeruleus, Latin for "blue spot," is also involved in a wide range of neurological and neuropsychiatric conditions such as anxiety and depression, post-traumatic stress disorder and Alzheimer’s diseases.
Yet despite its importance, relatively little is known how the locus coeruleus works. It is known to receive inputs from throughout ...
DURHAM, N.C. -- Have you ever been stuck on a problem, puzzling over something for what felt like ages without getting anywhere, but then suddenly the answer came to you like a bolt from the blue?
We’ve all experienced that “aha! moment,” that sudden clarity or magical epiphany you feel when a new idea or perspective pops into your head as if out of nowhere.
Now, new evidence from brain imaging research shows that these flashes of insight aren’t just satisfying — they actually reshape how your brain represents information, and help sear it into memory.
Led by ...
PHILADELPHIA – While it may seem intuitive that people would die without life-saving medications, Penn and Harvard researchers have connected losing a federally funded prescription drug assistance program and an increase in mortality. The program, called the Medicare Part D Low-Income Subsidy (LIS), helps 14.2 million low-income Medicare beneficiaries, many of whom are older Americans, afford their medications. Nationally,12.5 million people who are eligible for and enrolled in both Medicare and Medicaid (“dual eligibles”) automatically qualify for the LIS, which ...
Chronic obstructive pulmonary disease (COPD) is the fourth leading cause of death in the United States, most often caused by cigarette smoking or long-term exposure to air pollutants. While there is no cure, progression can be slowed by reducing exposure to these factors.
A new study from Mass General Brigham researchers uncovered another factor linked to progression of the disease: the accumulation of mucus in the lungs. People with COPD who had persistent airway-clogging mucus plugs over a five-year period had a faster decline in lung function than those who didn’t have the plugs. The study points toward therapies that disrupt these plugs as a ...
