(Press-News.org) Screen readers, which convert digital text to audio, can make computers more accessible to many disabled users — including those who are blind, low vision or dyslexic. Yet slideshow software, such as Microsoft PowerPoint and Google Slides, isn’t designed to make screen reader output coherent. Such programs typically rely on Z-order — which follows the way objects are layered on a slide — when a screen reader navigates through the contents. Since the Z-order doesn’t adequately convey how a slide is laid out in two-dimensional space, slideshow software can be inaccessible to people with disabilities.
A team led by researchers at the University of Washington has created A11yBoard for Google Slides, a browser extension and phone app that allows blind users to navigate through complex slide layouts and text. Combining a desktop computer with a mobile device, A11yBoard lets users work with audio, touch, gesture, speech recognition and search to understand where different objects are located on a slide and move these objects around to create rich layouts. For instance, a user can touch a textbox on the screen, and the screen reader will describe its color and position. Then, using a voice command, the user can shrink that textbox and left-align it with the slide’s title.
The team presented its research Oct. 25 at ASSETS 2023 in New York. A11yBoard is not yet available to the public.
“For a long time and even now, accessibility has often been thought of as, ‘We’re doing a good job if we enable blind folks to use modern products.’ Absolutely, that's a priority,” said senior author Jacob O. Wobbrock, a UW professor in the Information School. “But that is only half of our aim, because that’s only letting blind folks use what others create. We want to empower people to create their own content, beyond a PowerPoint slide that’s just a title and a text box.”
A11yBoard for Google Slides builds on a line of research in Wobbrock’s lab exploring how blind users interact with “artboards” — digital canvases on which users work with objects such as textboxes, shapes, images and diagrams. Slideshow software relies on a series of these artboards. When lead author Zhuohao (Jerry) Zhang, a UW doctoral student in the iSchool, joined Wobbrock’s lab, the two sought a solution to the accessibility flaws in creativity tools, like slideshow software. Drawing on earlier research from Wobbrock’s lab on the problems blind people have using artboards, Wobbrock and Zhang presented a prototype of A11yBoard in April. They then worked to create a solution that’s deployable through existing software, settling on a Google Slides extension.
For the current paper, the researchers worked with co-author Gene S-H Kim, an undergraduate at Stanford University, who is blind, to improve the interface. The team tested it with two other blind users, having them recreate slides. The testers both noted that A11yBoard greatly improved their ability to understand visual content and to create slides themselves without constant back-and-forth iterations with collaborators; they needed to involve a sighted assistant only at the end of the process.
The testers also highlighted spots for improvement: Remaining continuously aware of objects’ positions while trying to edit them still presented a challenge, and users were forced to do each action individually, such as aligning several visual groups from left to right, instead completing these repeated actions in batches. Because of how Google Slides functions, the app’s current version also does not allow users to undo or redo edits across different devices.
Ultimately, the researchers plan to release the app to the public. But first they plan to integrate a large language model, such as GPT, into the program.
“That will potentially help blind people author slides more efficiently, using natural language commands like, ‘Align these five boxes using their left edge,’” Zhang said. “Even as an accessibility researcher, I’m always amazed at how inaccessible these commonplace tools can be. So with A11yBoard we’ve set out to change that.”
This research was funded in part by the University of Washington’s Center for Research and Education on Accessible Technology and Experiences (UW CREATE).
For more information, contact Zhang at zhuohao@uw.edu and Wobbrock at wobbrock@uw.edu.
END
A Google Slides extension can make presentation software more accessible for blind users
2023-10-30
[Attachments] See images for this press release:
ELSE PRESS RELEASES FROM THIS DATE:
Prisons vulnerable to natural disasters, but ill-prepared
2023-10-30
Three-quarters of Colorado prisons are likely to experience a natural disaster in the coming years, but due to aging infrastructure and outdated policies, many are ill-equipped to keep residents safe, suggests new CU Boulder research.
The study, published in the journal Natural Hazards Review, comes on the heels of one of the hottest summers on record and as U.S. lawmakers are calling for an investigation into a rash of what are believed to be heat-related deaths in the nation’s prisons.
In other research, including interviews and focus groups with 35 formerly incarcerated Coloradans, the researchers found that most had already suffered from climate-related hazards, experiencing ...
Virtual cognitively enhanced tai chi program improves cognition and executive function in older adults with mild cognitive impairment
2023-10-30
Embargoed for release until 5:00 p.m. ET on Monday 30 October 2023
Annals of Internal Medicine Tip Sheet
@Annalsofim
Below please find summaries of new articles that will be published in the next issue of Annals of Internal Medicine. The summaries are not intended to substitute for the full articles as a source of information. This information is under strict embargo and by taking it into possession, media representatives are committing to the terms of the embargo not only on their own behalf, but also ...
Research Brief: Study uncovers hundred-year lifespans for three freshwater fish species in the Arizona desert
2023-10-30
A recent study found some of the oldest animals in the world living in a place you wouldn’t expect: fishes in the Arizona desert. Researchers found the second genus of animal ever for which three or more species have known lifespans greater than 100 years, which could open the doors to aging studies across disciplines, such as gerontology and senescence (aging) among vertebrates.
The study centers around a series of fish species within the Ictiobus genus, known as buffalofishes. Minnesota has native populations of each of the three species studied: bigmouth buffalo, smallmouth buffalo and black buffalo. The importance of this research is underscored ...
UMaine, UVM researchers conduct first-ever study of cultural adaptation to climate change
2023-10-30
As the impacts of climate change grow, society and people struggle to adapt to the challenges of the new reality. Change, however, is difficult, and adapting to new ways of life or new ways of doing business often requires a change in culture.
To determine how culture and society adapt to a changing climate, a team of researchers from the University of Maine and the University of Vermont (UVM) have conducted the first-ever study of cultural adaptation to climate change. Using the science of cultural evolution to examine data on which crops farmers plant across the U.S., their work can help inspire more effective policy solutions to survive in ...
New frequency comb can identify molecules in 20-nanosecond snapshots
2023-10-30
From monitoring concentrations of greenhouse gases to detecting COVID in the breath, laser systems known as frequency combs can identify specific molecules as simple as carbon dioxide and as complex as monoclonal antibodies with unprecedented accuracy and sensitivity. Amazing as they are, however, frequency combs have been limited in how fast they can capture a high-speed process such as hypersonic propulsion or the folding of proteins into their final three-dimensional shapes.
Now, researchers at the National Institute of Standards ...
Hospital care for children has shifted from general hospitals to children’s hospitals over last 20 years
2023-10-30
CHAPEL HILL, NC – Historically, most children in the United States who needed to be hospitalized were treated at general hospitals that treat both children and adults. But the number of hospitals providing inpatient care for children has decreased over the last decade, and many of them struggled to keep up with the demand for children’s care during a viral infection surge in the fall of 2022.
Now children are much more likely to be treated at children’s hospitals that are concentrated into fewer locations, according to a new study led by UNC School of Medicine researchers.
“The ...
The brain may learn about the world the same way some computational models do
2023-10-30
CAMBRIDGE, MA -- To make our way through the world, our brain must develop an intuitive understanding of the physical world around us, which we then use to interpret sensory information coming into the brain.
How does the brain develop that intuitive understanding? Many scientists believe that it may use a process similar to what’s known as “self-supervised learning.” This type of machine learning, originally developed as a way to create more efficient models for computer vision, allows computational models to learn about visual scenes based solely on the similarities and differences between them, with no ...
Largest brain autopsy study of female intimate partner violence decedents reveals brain injury pathology unlike that seen among male contact sports athletes
2023-10-30
The largest brain autopsy study of women who had experienced intimate partner violence reveals substantial vascular and white matter damage in the brain, but no evidence of chronic traumatic encephalopathy (CTE), the neurodegenerative disease recognized among male contact sports athletes who sustain repeated head trauma.
The international collaboration, led by a team from the Brain Injury Research Center of Mount Sinai in collaboration with the New York City Office of the Chief Medical Examiner, appears in the most recent issue of Acta Neuropathologica.
Importantly, ...
Soy expansion in Brazil linked to increase in childhood leukemia deaths
2023-10-30
URBANA, Ill. – Over the past decades, Brazil has become the world’s leading soybean producer, as well as the leading consumer of pesticides. Despite concerns about potential public health consequences, little is known about the effects of pesticide exposure in the general population. A new study from the University of Illinois Urbana-Champaign in collaboration with the University of Denver and University of Wisconsin-Madison looks at how soy expansion and increased pesticide use in Brazil’s Cerrado and Amazon biomes correlate with increased childhood cancer mortality.
“The Brazilian Amazon region is undergoing a transition ...
Amazon deforestation linked to long distance climate warming
2023-10-30
Deforestation in the Amazon causes land surfaces up to 100 kilometres away to get warmer, according to a new study.
The research, by a team of British and Brazilian scientists, led by Dr Edward Butt at the University of Leeds, suggests that tropical forests play a critical role in cooling the land surface - and that effect can play out over considerable distances.
It is known that when tropical forests are cleared, the climate in the immediate vicinity gets warmer.
In this latest study, the researchers wanted to know if deforestation in the Amazon was resulting in climate warming further afield, and the study examined the impact of forest loss on sites up to ...