(Press-News.org) ITHACA, N.Y. – A Cornell University-led research team has developed an artificial intelligence-powered ring equipped with micro-sonar technology that can continuously and in real time track fingerspelling in American Sign Language (ASL).
In its current form, SpellRing could be used to enter text into computers or smartphones via fingerspelling, which is used in ASL to spell out words without corresponding signs, such as proper nouns, names and technical terms. With further development, the device – believed to be the first of its kind – could revolutionize ASL translation by continuously tracking entire signed words and sentences.
“Many other technologies that recognize fingerspelling in ASL have not been adopted by the deaf and hard-of-hearing community because the hardware is bulky and impractical,” said Hyunchul Lim, a doctoral student in the field of information science. “We sought to develop a single ring to capture all of the subtle and complex finger movement in ASL.”
Lim is lead author of “SpellRing: Recognizing Continuous Fingerspelling in American Sign Language using a Ring,” which will be presented at the Association of Computing Machinery’s conference on Human Factors in Computing Systems (CHI), April 26-May 1 in Yokohama, Japan.
SpellRing is worn on the thumb and equipped with a microphone and speaker. Together they send and receive inaudible sound waves that track the wearer’s hand and finger movements, while a mini gyroscope tracks the hand’s motion.
A proprietary deep-learning algorithm then processes the sonar images and predicts the ASL fingerspelled letters in real time and with similar accuracy as many existing systems that require more hardware.
Developers evaluated SpellRing with 20 experienced and novice ASL signers, having them naturally and continuously fingerspell a total of more than 20,000 words of varying lengths. SpellRing’s accuracy rate was between 82% and 92%, depending on the difficulty of words.
“There’s always a gap between the technical community who develop tools and the target community who use them,” said Cheng Zhang, assistant professor of information science and a paper co-author. “We’ve bridged some of that gap. We designed SpellRing for target users who evaluated it.”
Lim’s future work will include integrating the micro-sonar system into eyeglasses to capture upper body movements and facial expressions, for a more comprehensive ASL translation system.
“Deaf and hard-of-hearing people use more than their hands for ASL. They use facial expressions, upper body movements and head gestures,” said Lim, who completed basic and intermediate ASL courses at Cornell as part of his SpellRing research. “ASL is a very complicated, complex visual language.”
This research was funded by the National Science Foundation.
For additional information, see this Cornell Chronicle story.
Media note: Video can be viewed and downloaded here: https://cornell.box.com/v/SpellRing-ASL
-30-
END
AI ring tracks spelled words in American Sign Language
2025-03-18
ELSE PRESS RELEASES FROM THIS DATE:
What’s behind the ‘pop and slosh’ when opening a swing-top bottle of beer?
2025-03-18
WASHINGTON, March 18, 2025 — In a fun experiment, Max Koch, a researcher at the University of Göttingen in Germany — who also happens to be passionate about homebrewing — decided to use a high-speed camera to capture what occurs while opening a swing-top bottle of homebrew.
When Robert Mettin, who leads the Ultrasound and Cavitation group at the university’s Third Institute of Physics, Biophysics, suggested that Koch should submit the findings to the special “kitchen flows” issue of Physics of Fluids, from AIP Publishing, Koch and his colleagues chose to ...
Adherence to annual lung cancer screening and rates of cancer diagnosis
2025-03-18
About The Study: In this multicenter cohort study of adults undergoing lung cancer screening, screening adherence was associated with increased overall and early-stage lung cancer detection rates; however, adherence decreased annually after baseline screening, suggesting that it is an important lung cancer screening quality metric.
Corresponding author: To contact the corresponding author, Roger Y. Kim, M.D., M.S.C.E., email roger.kim@pennmedicine.upenn.edu.
To access the embargoed study: Visit our For The Media website at this link https://media.jamanetwork.com/
(doi: ...
Geographic access to cancer care and treatment and outcomes of early-stage non–small cell lung cancer
2025-03-18
About The Study: In this cohort study, geographic access to cancer care was associated with guideline-recommended treatment for early-stage non–small cell lung cancer (NSCLC) and outcomes, particularly in socially marginalized patients, underscoring the importance of ensuring appropriate geographic allocations of cancer care resources and addressing travel barriers to health care to improve NSCLC treatment, prognosis, and equity.
Corresponding authors: To contact the corresponding ...
Trauma surgeons propose ‘precision transfusion’ approach to pre-hospital care
2025-03-18
When someone is traumatically injured, giving them blood products before they arrive at the hospital – such as at the scene or during emergency transport – can improve their likelihood of survival and recovery. But patients with certain traumatic injuries have better outcomes when administered specific blood components.
University of Pittsburgh School of Medicine and UPMC scientist-surgeons announced today in Cell Reports Medicine that giving plasma that has been separated from other parts of donated blood improves outcomes in patients with traumatic brain injury (TBI) or shock, whereas giving unseparated or “whole” ...
New artificial intelligence tool accelerates disease treatments
2025-03-18
University of Virginia School of Medicine scientists have created a computational tool to accelerate the development of new disease treatments. The tool goes beyond current artificial intelligence (AI) approaches by identifying not just which patient populations may benefit but also how the drugs work inside cells.
The researchers have demonstrated the tool’s potential by identifying a promising candidate to prevent heart failure, a leading cause of death in the United States and around the world.
The new AI tool called LogiRx, can predict how drugs will affect biological processes in the body, helping scientists understand the effects the drugs will have ...
CCA appoints expert panel on enhancing national research infrastructure
2025-03-18
Canada’s research infrastructure is essential to the future of science and innovation, economic prosperity, and well-being throughout the country. At the request of Innovation, Science, and Economic Development Canada, the CCA has formed an expert panel to support the federal government in optimizing Canada’s research infrastructure—from its national-scale scientific facilities to its digital platforms and collaborative networks—through evidence synthesis and strategic insights. Janet King, Chair of Polar Knowledge Canada’s Board of Directors and Vice-Chair of the Canadian Light Source’s Board of Directors, will serve ...
Rising Stars: PPPL researchers honored in 2024 Physics of Plasmas Early Career Collection
2025-03-18
Celebrating fresh thinking in plasma physics is essential to the continued growth of the field, and this year’s Physics of Plasmas Early Career Collection highlights some of the most promising new voices pushing the boundaries of discovery.
The prestigious collection highlights top papers from all areas of plasma physics research authored by individuals who defended their dissertations within the past five years. This year, three researchers at the U.S. Department of Energy’s Princeton Plasma Physics Laboratory (PPPL) are featured in the Early Career Collection:
Staff Research ...
Add some spice: Curcumin helps treat mycobacterium abscessus
2025-03-18
Highlights:
Mycobacterium abscessus can cause dangerous lung infections.
Treatment usually requires a combination of antibiotics for more than a year.
Researchers in China report that curcumin, found in turmeric, can enhance treatment with bedaquiline, an antimycobacterial.
Animal studies showed that treatment with the combination led to a faster clearance of the infection.
Washington, D.C.—Mycobacterium abscessus is a fast-growing, pathogenic mycobacteria that can cause lung infections, and people who have respiratory conditions or are immunocompromised ...
Coastal guardians pioneer a new way to protect the Florida Keys’ shorelines
2025-03-18
By 2050, sea levels along the United States coast are expected to rise by 0.25 to 0.30 meters, increasing flooding in low-lying areas. Due to its unique geography and infrastructure network, the Florida Keys is particularly at risk of climate hazards such as sea level rise, hurricanes and flooding. Since 2015, the Florida Keys has experienced four hurricanes – Irma (2107), Ian (2022), Helene (2024) and Milton (2024).
Nature-based solutions, such as restoring mangroves and coastal strands, can help mitigate these risks by stabilizing shorelines, improving ecosystems ...
Study shows rise in congenital heart defects in states with restrictive abortion laws
2025-03-18
The incidence of babies born with serious heart defects, known as cyanotic congenital heart disease (CCHD), rose in states that enacted restrictive abortion laws following the U.S. Supreme Court’s 2022 ruling that put abortion laws in the hands of the states, according to a study being presented at the American College of Cardiology’s Annual Scientific Session (ACC.25).
The study is the first to look at rates of congenital heart defects since the Dobbs v. Jackson Women’s Health Organization ...