Intuition-guided reinforcement learning for soft tissue manipulation with unknown constraints
2025-05-20
(Press-News.org)
A research paper by scientists at Hefei University of Technology presented an intuition-guided deep reinforcement learning framework for soft tissue manipulation under unknown constraints.
The research paper, published on Apr. 14, 2025 in the journal Cyborg and Bionic Systems.
Intraoperative soft tissue manipulation is a critical challenge in autonomous robotic surgery. Furthermore, the intricate in vivo environment surrounding the target soft tissues poses additional hindrances to autonomous robotic decision-making. Previous studies assumed the grasping point was known and the target deformation could be achieved. The constraints were assumed to be constant during the operation, and there were no obstacles around the soft tissue. “To address these problems, we proposed an intuition-guided deep reinforcement learning framework based on soft actor-critic (ID-SAC) for soft tissue manipulation under unknown constraints.” said the author Xian He, a researcher at Hefei University of Technology.
The process of this framework can be divided into the following two parts. The first part is selection and evaluation of grasping points in autonomous soft tissue manipulation by robots. A deep Q-networkbased algorithm was proposed to address the initial point selection issue in soft tissue manipulation. First, high-dimensional states were described and used as inputs to the network, which outputs the action value for each grasping point. The grasping point corresponding to the maximum action value was selected as the initial grasping point. Simultaneously, a grasp point quality assessment network was designed to predict the success rate of a selected grasp point for achieving the soft tissue manipulation task. The point selection operation was revised if the success rate during testing fell below a certain threshold. Subsequently, based on the selected grasp points, autonomous robotic manipulation uses a simulated IM mode akin to a physician’s approach to execute the manipulation task. Safety constraints were designed to ensure that when the soft tissue undergoes excessive deformation, the robot relinquishes the manipulation task. The network is updated through feedback from the manipulation trajectories of each point selection. A reward function was developed based on expert knowledge.
The second part deep reinforcement learning-based fusion strategy for soft tissue manipulation modes. The SAC algorithm was used to execute soft tissue manipulation tasks after selecting initial grasping points in step 1, addressing the intricate and dynamic environment of soft tissue manipulation within the body. The regulatory factor is set as the action of the reinforcement learning algorithm to autonomously integrate multiple soft tissue manipulation modes, such that the manipulation strategy integrates the advantages of different manipulation modes and improves the robot’s ability to make autonomous decisions in complex scenes.
The framework was tested through simulations using a liver model. The results showed that the proposed approach could effectively handle three deformation tasks (position-based, curve-based, and region-based) while accounting for obstacles and dynamic disturbances. It was also demonstrated that the ID-SAC algorithm outperformed traditional SAC algorithms in terms of task performance and exploration capabilities, especially in scenarios with obstacles and unknown disturbances. When comparing the robotic system’s performance to human manipulation, the robot exhibited faster task completion times, smoother trajectories, and more efficient manipulation, although human operators sometimes maintained better control in certain complex scenarios. “Our ID-SAC framework provided a new solution for autonomous operation of robots in complex and dynamic soft tissue surgical environments, with broad prospects for medical and surgical applications.” said Xian He.
Authors of the paper include Xian He, Shuai Zhang, Jian Chu, Tongyu Jia, Lantao Yu, and Bo Ouyang.
This work was supported in part by the Young Scientists Fund of the National Natural Science Foundation of China (grant no. 52305018), in part by the National Key Research and Development Program of China (grant no. 2023YFB4706000), in part by the Joint Funds Program of the National Natural Science Foundation of China (grant no. U21A20517), and in part by the Basic Science Centre Program of the National Natural Science Foundation of China (grant no. 72188101).
The paper, “Intuition-guided Reinforcement Learning for Soft Tissue Manipulation with Unknown Constraints” was published in the journal Cyborg and Bionic Systems on Apr. 14, 2025, at DOI: 10.34133/cbsystems.0114.
END
ELSE PRESS RELEASES FROM THIS DATE:
2025-05-20
A team of Mount Sinai surgeons has performed the first heart-liver-kidney triple organ transplants in New York. They successfully completed two of these complex surgeries on patients from Westchester County, who have since returned home and are making full recoveries.
Heart-liver-kidney transplants are extremely rare—only 58 have been done across the country since the United Network for Organ Sharing, the government agency that oversees transplantation, started tracking cases in 1987. The two procedures at The Mount Sinai Hospital, which took place on January 10 and March 8, were among only four to date in the ...
2025-05-20
Sharks have been evolving for more than 450 million years, developing skeletons not from bone, but from a tough, mineralized form of cartilage. These creatures are more than just fast swimmers – they’re built for efficiency. Their spines act like natural springs, storing and releasing energy with each tailbeat, allowing them to move through the water with smooth, powerful grace.
Now, scientists are peering inside shark skeletons at the nanoscale, revealing a microscopic “sharkitecture” that helps these ancient apex predators withstand extreme physical demands of constant motion.
Using synchrotron X-ray nanotomography with detailed ...
2025-05-20
Americans perceive small juries of content experts as the most legitimate moderators of potentially misleading content on social media, according to a survey, but perceive large, nationally representative or politically balanced juries with minimum knowledge qualifications as comparably legitimate. Social media content moderation policies tend to attract criticism, with some calling for more aggressive removal of harmful and misleading content and others decrying moderation as censorship and accusing expert moderators of being politically biased. Less clear is what the general public would like to see in terms of content ...
2025-05-20
A Perspective proposes a pathway to improvements in sustainability of marine ecosystems and resources in China. Based on environmental accounting used in China’s terrestrial ecosystems, the approach would implement policy and governance to ensure accountability for sustainable use of marine systems. Laurence J. McCook and colleagues argue that the ecosystem goods and services provided to the nation by oceans and coastal ecosystems—including seagrass beds, salt marshes, coral reefs, and mangrove forests—are ...
2025-05-20
A drug used to treat type 2 diabetes may also be effective in slowing the progression of prostate cancer. This is shown by an international study in which researchers at Umeå University, Sweden, have participated. The researchers have found that drugs that regulate a particular protein have a key role in reducing prostate cancer recurrence among diabetic patients.
"This is a significant discovery. For the first time, we have clinical observations showing that prostate cancer patients with diabetes who received drugs targeting the protein remained relapse-free during the period we followed them," ...
2025-05-20
New cases of dementia in the United States declined from 2015 to 2021, but the number of people living with the condition continued to rise due to population ageing, with nearly 2.9 million traditional Medicare beneficiaries (around 12%) living with a dementia diagnosis in 2021, finds a study published by The BMJ today.
What’s more, a greater burden of dementia was seen in marginalized and low resource communities, highlighting the importance of policy approaches to promote equitable dementia care, say the ...
2025-05-20
TEMPE, Ariz. — The Physicians Committee for Responsible Medicine filed a complaint with the National Institutes of Health’s Office of Laboratory Animal Welfare today, May 19, 2025, asking for an investigation of Arizona State University’s use of animals to study the effects of dietary supplements on adults with Down syndrome.
“Arizona State University cannot justify its use of mice to study a common nutrient that could be easily and ethically studied in consenting human volunteers,” the complaint says. “These uses of animals run afoul of the ...
2025-05-20
St. Jude Children’s Research Hospital leukemia researcher Charles G. Mullighan, MBBS (Hons), MSc, MD, senior deputy director of the St. Jude Comprehensive Cancer Center, has been elected as a Fellow of the Royal Society of London, the oldest scientific academy in continuous existence.
Mullighan was selected to join the Royal Society for his trailblazing contributions to genomic research, which have advanced the understanding, diagnosis and treatment of acute leukemia, notably childhood acute lymphoblastic leukemia ...
2025-05-20
Efforts to limit the global temperature increase to 1.5°C under the Paris Climate Agreement may not go far enough to save the world’s ice sheets, according to a new study.
Research led by Durham University, UK, suggests the target should instead be closer to 1°C to avoid significant losses from the polar ice sheets and prevent a further acceleration in sea level rise.
The team reviewed a wealth of evidence to examine the effect that the 1.5°C target would have on the ice sheets in Greenland and Antarctica, which together store enough ice to raise global sea levels by almost 65 metres.
The mass of ice lost from these ice ...
2025-05-20
CAMBRIDGE, MA -- By combining information from many large datasets, MIT researchers have identified several new potential targets for treating or preventing Alzheimer’s disease.
The study revealed genes and cellular pathways that haven’t been linked to Alzheimer’s before, including one involved in DNA repair. Identifying new drug targets is critical because many of the Alzheimer’s drugs that have been developed to this point haven’t been as successful as hoped.
Working with researchers at Harvard Medical School, the team used data from humans and fruit flies to identify cellular pathways linked to neurodegeneration. ...
LAST 30 PRESS RELEASES:
[Press-News.org] Intuition-guided reinforcement learning for soft tissue manipulation with unknown constraints
