A graph transformer with boundary-aware attention for semantic segmentation
2024-11-08
(Press-News.org)
The transformer-based semantic segmentation approaches, which divide the image into different regions by sliding windows and model the relation inside each window, have achieved outstanding success. However, since the relation modeling between windows was not the primary emphasis of previous work, it was not fully utilized.
To solve the problems, a research team led by Zizhang Wu published their new research on 15 October 2024 in Frontiers of Computer Science co-published by Higher Education Press and Springer Nature.
The team proposed a Graph-Segmenter, including a Graph Transformer and a Boundary-aware Attention module, which is an effective network for simultaneously modeling the more profound relation between windows in a global view and various pixels inside each window as a local one, and for substantial low-cost boundary adjustment. Specifically, they treat every window and pixel inside the window as nodes to construct graphs for both views and devise the Graph Transformer. The introduced boundary-aware attention module optimizes the edge information of the target objects by modeling the relationship between the pixel on the object's edge.
In the research, they proposed a novel relation modeling method acting on sliding windows, using graph convolutions to establish relationships between windows and pixels inside each window, which enhanced the backbone to address the issues above. In particular, they regard each window or the pixels inside as nodes for the graph network and use the visual similarity between nodes to establish the edges between nodes. After that, they use the graph network further to update the nodes and edges of the graph. So that different nodes can adaptively establish connections and update information in network transmission to realize the nonlinear relationship modeling between different windows and different pixels inside. In brief, the network's overall feature learning and characterization capabilities are further improved by enhancing the long-distance nonlinear modeling capabilities between different windows and different pixels inside, which leads to an evident rise in performance.
Furthermore, they introduce an efficient boundary-aware attention-enhanced segmentation head that optimizes the boundary of objects in the semantic segmentation task, allowing us to reduce the labeling cost even further while simultaneously improving the accuracy of the semantic segmentation in the boundary of the objects under consideration. To put it another way, they develop a lightweight local information-aware attention module that allows for improved boundary segmentation. By determining the weights of the pixels around an object's border and applying various attention coefficients to distinct pixels via local perception, it is possible to reinforce the important pixels that are critical in categorization while weakening the interfering pixels. The attention module used in this study has just a few common CNN layers, which makes it efficient for segmentation boundary adjustments when considering the size, floating point operations, and latency time of the segmentation data.
DOI: 10.1007/s11704-023-2563-5
END
[Attachments] See images for this press release:
ELSE PRESS RELEASES FROM THIS DATE:
2024-11-08
TUCSON, Ariz., November 7, 2024 — Critical Path Institute® (C-Path) today announced key leadership appointments: Diane Stephenson, Ph.D., has been promoted to Vice President of Neurology, and Nadine Tatton, Ph.D., has been welcomed as the new Executive Director of C-Path’s Critical Path for Alzheimer’s Disease (CPAD) Consortium.
With over 30 years of specialized research in neuroscience and drug development and having served as the Executive Director of the Critical Path for Parkinson’s Consortium (CPP) for nearly 15 years, Dr. Stephenson has been an extraordinary partner in advancing our understanding ...
2024-11-08
First-of-its-kind analysis of US national data reveals significant disparities in individual well-being as measured by lifespan, education, and income.
White males make up largest share of the group with lowest well-being while American Indian and Alaska Native individuals, and Black males, face the most significant challenges to overall well-being.
Populations at the lowest levels of well-being across the US are especially concentrated in the Deep South, Appalachia, and the Rust Belt.
The ...
2024-11-08
Exercise-only programmes help cut the severity of the ‘baby blues’ and the risk of major clinical depression in new mums, finds a pooled data analysis of the available evidence, published in the British Journal of Sports Medicine.
But at least 80 weekly minutes of moderate intensity exercise, such as brisk walking, water aerobics, stationary cycling, and resistance training with bands, weights, or body weight are needed to achieve the effects, the findings show.
Maternal depression and anxiety are relatively common after giving birth and associated with reduced self-care and compromised infant caregiving and bonding, ...
2024-11-08
Changes in the make-up of the gut microbiome are linked to the onset of clinically evident rheumatoid arthritis in those at risk of the disease because of genetic, environmental, or immunological factors, suggests research published online in the Annals of the Rheumatic Diseases.
It’s not clear if this instability is a cause or consequence of disease development, emphasise the researchers, but the findings might nevertheless help to identify those at risk as well as paving the way for preventive and personalised treatment strategies, they suggest.
Previously published research consistently shows an unfavourable imbalance in ...
2024-11-08
Changes in the gut microbiome before rheumatoid arthritis is developed could provide a window of opportunity for preventative treatments, new research suggests.
Bacteria associated with inflammation is found in the gut in higher amounts roughly ten months before patients develop clinical rheumatoid arthritis, a longitudinal study by Leeds researchers has found.
Affecting more than half a million people in the UK, rheumatoid arthritis is a chronic disease that causes swelling, pain and stiffness in the ...
2024-11-08
A new study has exposed for the first time how inhabitants of the smallest countries globally, contributing least to climate change, already bear the brunt of its devastating consequences and the burden is likely to worsen.
The research, led by the University of Bristol, showed on average nearly one in five people (20%) in Small Island Developing States (SIDS) – totalling some 8.5million – are now exposed to coastal and inland flooding. For three of the 57 countries concentrated in the Pacific, Caribbean, Indian Ocean, ...
2024-11-08
An independent review, Uniting the UK’s Health Data: A Huge Opportunity for Society, published today (8 November 2024), has found that complexities and inefficiencies are impeding the use of the UK’s rich sources of health data to improve people’s health and lives. Researchers and analysts frequently have to wait many months – or even years – to securely access health data to improve care and for vital research into diseases like dementia, cancer and heart disease.
Led by Professor ...
2024-11-07
BIRMINGHAM, Ala. – In 1937, President Franklin Roosevelt signed the National Cancer Act, launching a nationwide effort to combat the disease. Eighty-seven years later, despite significant progress, cancer treatment often falls short, with 50 to 80 percent of patients not responding to treatment and more than 600,000 cancer deaths annually in the United States.
What if clinicians could predict the success of any cancer treatment, ensuring each patient receives the most effective care?
The challenge lies in the diverse nature of the disease. There are hundreds of different types of cancers, characterized by the specific type of cell from which they originate. Even patients ...
2024-11-07
Picture this: You’re at a bar when someone starts hitting shamelessly on your spouse or significant other, who doesn’t flirt back. As the scene unfolds, your base instincts kick in—annoyance, anger, jealousy—followed by a heightened sexual desire for your partner. You’re ready to reclaim the attention that should be rightfully yours, correct?
Not necessarily, according to a new study in the Journal of Sex Research by researchers at Reichman University in Herzliya, Israel, and ...
2024-11-07
ROCHESTER, Minn. — A study at Mayo Clinic suggests that an hourglass-shaped stent could improve blood flow and ease severe and reoccurring chest pain in people with microvascular disease. Of 30 participants in a phase 2 clinical trial, 76% saw improvement in their day-to-day life. For example, some participants who reported not being able to walk around the block or up a flight of stairs without chest pain were able to do these ordinary physical activities at the end of a 120-day period. Clinical measures of blood flow related to the microvasculature of the heart significantly improved during ...
LAST 30 PRESS RELEASES:
[Press-News.org] A graph transformer with boundary-aware attention for semantic segmentation