PRESS-NEWS.org - Press Release Distribution
PRESS RELEASES DISTRIBUTION

Coming out to a chatbot?

Researchers explore the limitations of mental health chatbots in LGBTQ+ communities

2024-05-13
(Press-News.org) Today, there are dozens of large language model (LLM) chatbots aimed at mental health care — addressing everything from loneliness among seniors to anxiety and depression in teens. 

But the efficacy of these apps is unclear. Even more unclear is how well these apps work in supporting specific, marginalized groups like LGBTQ+ communities. 

A team of researchers from the Harvard John A. Paulson School of Engineering and Applied Sciences, Emory University, Vanderbilt University and the University of California Irvine, found that while large language models can offer fast, on-demand support, they frequently fail to grasp the specific challenges that many members of the LGBTQ+ community face. 

That failure could lead the chatbot to give at best unhelpful and at worst dangerous advice.

The paper is being presented this week at the ACM (Association of Computing Machinery) conference on Human Factors in Computing System in Honolulu, Hawaiʻi. 

The researchers interviewed 31 participants — 18 identifying as LGBTQ+ and 13 as non-LGBTQ+ — about their usage of LLM-based chatbots for mental health support and how the chatbots supported their individual needs.

On one hand, many participants reported that the chatbots offered a sense of solidarity and a safe space to explore and express their identities. Some used the chatbots for practice coming out to friends and family, others to practice asking someone out for the first time.  

But many of the participants also noted the programs’ shortfalls. 

One participant wrote, “I don’t think I remember any time that it gave me a solution. It will just be like empathetic. Or maybe, if I would tell it that I’m upset with someone being homophobic. It will suggest, maybe talking to that person. But most of the time it just be like, ‘I’m sorry that happened to you.’”

“The boilerplate nature of the chatbots’ responses highlights their failure to recognize the complex and nuanced LGBTQ+ identities and experiences, making the chatbots’ suggestions feel emotionally disengaged,” said Zilin Ma, a PhD student at SEAS and co-first author of the paper. 

Because these chatbots tend to be sycophantic, said Ma, they’re actually very bad at simulating hostility, which makes them ill-suited to practice potentially fraught conversations like coming out. 

They also gave some participants staggeringly bad advice — telling one person to quit their job after experiencing workplace homophobia, without considering their financial or personal consequences.

Ma, who is in the lab of Krzysztof Gajos, the Gordon McKay Professor of Computer Science, stressed that while there are ways to improve these programs, it is not a panacea. 

“There are ways we could improve these limitations by fine tuning the LLMs for contexts relevant to LGBTQ+ users or implementing context-sensitive guardrails or regularly updating feedback loops, but we wonder if this tendency to implement technology at every aspect of social problem is the right approach,” said Ma. “We can optimize all these LLMs all we want but there are aspects of LGBTQ+ mental health that cannot be solved with LLM chatbots — such as discrimination, bullying, the stress of coming out or the lack of representation. For that, we need a holistic support system for LGBTQ+ people.”

One area where LLM chatbots could be useful is in the training of human counselors or online community moderators. 

“Rather than having teens in crisis talk to the chatbot directly, you could use the chatbot to train counselors,” said Ma. “Then you have a real human to talk to, but it empowers the counselors with technology, which is a socio-technical solution which I think works well in this case.”

 “Research in public health suggests that interventions that directly target the affected individuals – like the chatbots for improving individual well-being – risk leaving the most vulnerable people behind,” said Gajos. “It is harder but potentially more impactful to change the communities themselves through training counselors or online community moderators.”

The research was co-authored by Yiyang Mei, Yinru Long, Zhaoyuan “Nick” Su and Gajos.

END


ELSE PRESS RELEASES FROM THIS DATE:

Persistent strain of cholera defends itself against forces of change, scientists find

2024-05-13
A deadly strain of cholera bacteria that emerged in Indonesia back in 1961 continues to spread widely to this day, claiming thousands of lives around the world every year, sickening millions — and, with its persistence, baffling scientists. Finally, in a study published today in Nature, researchers from The University of Texas at Austin have discovered how this dangerous strain has held out over decades. A longstanding mystery about the strain of Vibrio cholerae (V. cholerae) responsible for the seventh global cholera pandemic is how this lineage has managed ...

Rice study reveals insights into protein evolution

Rice study reveals insights into protein evolution
2024-05-13
Rice University’s Peter Wolynes and his research team have unveiled a breakthrough in understanding how specific genetic sequences, known as pseudogenes, evolve. Their paper was published May 13 by the Proceedings of the National Academy of Sciences of the United States of America Journal. Led by Wolynes, the D.R. Bullard-Welch Foundation Professor of Science, professor of chemistry, biosciences and physics and astronomy and co-director of the Center for Theoretical Biological Physics (CTBP), the team focused on deciphering the complex energy landscapes of de-evolved, putative protein sequences corresponding to pseudogenes. Pseudogenes are ...

Low testosterone in men associated with higher risk for death

2024-05-13
Embargoed for release until 5:00 p.m. ET on Monday 13 May 2024     Annals of Internal Medicine Tip Sheet      @Annalsofim     Below please find summaries of new articles that will be published in the next issue of Annals of Internal Medicine. The summaries are not intended to substitute for the full articles as a source of information. This information is under strict embargo and by taking it into possession, media representatives are committing to the terms of the embargo not ...

Chatbots tell people what they want to hear

2024-05-13
Chatbots share limited information, reinforce ideologies, and, as a result, can lead to more polarized thinking when it comes to controversial issues, according to new Johns Hopkins University–led research.  The study challenges perceptions that chatbots are impartial and provides insight into how using conversational search systems could widen the public divide on hot-button issues and leave people vulnerable to manipulation.  “Because people are reading a summary paragraph generated by AI, they think they’re getting unbiased, fact-based answers,” said lead author Ziang Xiao, an assistant professor of computer ...

Herpes cure with gene editing makes progress in laboratory studies

Herpes cure with gene editing makes progress in laboratory studies
2024-05-13
SEATTLE — May 13, 2024 — Researchers at Fred Hutch Cancer Center have found in pre-clinical studies that an experimental gene therapy for genital and oral herpes removed 90% or more of the infection and suppressed how much virus can be released from an infected individual, which suggests that the therapy would also reduce the spread of the virus. “Herpes is very sneaky. It hides out among nerve cells and then reawakens and causes painful skin blisters,” said Keith Jerome, MD, PhD, professor ...

Catch and release can give sea turtles the bends #ASA186

Catch and release can give sea turtles the bends #ASA186
2024-05-13
OTTAWA, Ontario, May 13, 2024 – Six out of seven sea turtle species are endangered, and humans are primarily responsible. Commercial fishing activities are the largest human-caused disturbance to sea turtles due to accidental capture. Fishers are typically unaware if a sea turtle is caught in their net until it’s completely pulled out of the water. However, releasing sea turtles without veterinary evaluations can be harmful. When accidentally caught, the turtles’ normal diving processes are interrupted, ...

Researchers unveil unique tidal disruption event with unprecedented early optical bump

2024-05-13
A research team from the University of Science and Technology of China (USTC) of the Chinese Academy of Sciences (CAS) presented a detailed analysis of a tidal disruption event (TDE) with unique characteristics, providing new insights into the behavior of TDEs and their multiwavelength emissions. The study was published online in The Astrophysical Journal Letters. When a star ventures too close to a supermassive black hole at the center of a galaxy, it gets torn apart by the black hole's immense tidal forces, resulting ...

Researchers discover "topological hall effect" in two-dimensional quantum magnets

Researchers discover topological hall effect in two-dimensional quantum magnets
2024-05-13
In a recent study published in Nature Physics, researchers from the Hefei Institutes of Physical Science of the Chinese Academy of Sciences, together with researchers of University of Science and Technology of China, have introduced the concept of the "Topological Kerr Effect" by using the low-temperature magnetic field microscopy system and the magnetic force microscopy imaging system supported by the steady-state high magnetic field experimental facility. The study holds great promise for advancing our understanding of topological magnetic ...

Like dad and like mum…all in one plant

2024-05-13
In a new study, led by Charles Underwood from the Max Planck Institute for Plant Breeding Research (MPIPZ) in Cologne, Germany, scientists established a system to generate clonal sex cells in tomato plants and used them to design the genomes of offspring. The fertilization of a clonal egg from one parent by a clonal sperm from another parent led to plants containing the complete genetic information of both parents. The study is now published in Nature Genetics. Hybrid seeds, combining two different parent lines with specific favorable traits, are popular in agriculture as they give rise to robust crops with enhanced productivity, and have been utilized by farmers ...

New molecule mimics the anti-clotting action of blood-sucking organisms

New molecule mimics the anti-clotting action of blood-sucking organisms
2024-05-13
DURHAM, N.C. – Nature gave ticks, mosquitos and leaches a quick-acting way to keep blood from clotting while they extract their meal from a host.   Now the key to that method has been harnessed by a team of Duke researchers as a potential anti-clotting agent that could be used as an alternative to heparin during angioplasty, dialysis care, surgeries and other procedures.   Publishing in the journal Nature Communications, the researchers describe a synthetic molecule that mimics the effects of compounds in the saliva of blood-sucking critters. Importantly, the new molecule can also ...

LAST 30 PRESS RELEASES:

Final data and undiscovered images from NASA’s NEOWISE

Nucleoporin93: A silent protector in vascular health

Can we avert the looming food crisis of climate change?

Alcohol use and antiobesity medication treatment

Study reveals cause of common cancer immunotherapy side effect

New era in amphibian biology

Harbor service, VAST Data provide boost for NCSA systems

New prognostic model enhances survival prediction in liver failure

China focuses on improving air quality via the coordinated control of fine particles and ozone

Machine learning reveals behaviors linked with early Alzheimer’s, points to new treatments

Novel gene therapy trial for sickle cell disease launches

Engineering hypoallergenic cats

Microwave-induced pyrolysis: A promising solution for recycling electric cables

Cooling with light: Exploring optical cooling in semiconductor quantum dots

Breakthrough in clean energy: Scientists pioneer novel heat-to-electricity conversion

Study finds opposing effects of short-term and continuous noise on western bluebird parental care

Quantifying disease impact and overcoming practical treatment barriers for primary progressive aphasia

Sports betting and financial market data show how people misinterpret new information in predictable ways

Long COVID brain fog linked to lung function

Concussions slow brain activity of high school football players

Study details how cancer cells fend off starvation and death from chemotherapy

Transformation of UN SDGs only way forward for sustainable development 

New study reveals genetic drivers of early onset type 2 diabetes in South Asians 

Delay and pay: Tipping point costs quadruple after waiting

Magnetic tornado is stirring up the haze at Jupiter's poles

Cancers grow uniformly throughout their mass

Researchers show complex relationship between Arctic warming and Arctic dust

Brain test shows that crabs process pain

Social fish with low status are so stressed out it impacts their brains

Predicting the weather: New meteorology estimation method aids building efficiency

[Press-News.org] Coming out to a chatbot?
Researchers explore the limitations of mental health chatbots in LGBTQ+ communities