(Press-News.org) A robot, trained for the first time by watching videos of seasoned surgeons, executed the same surgical procedures as skillfully as the human doctors.
The successful use of imitation learning to train surgical robots eliminates the need to program robots with each individual move required during a medical procedure and brings the field of robotic surgery closer to true autonomy, where robots could perform complex surgeries without human help.
“It’s really magical to have this model and all we do is feed it camera input and it can predict the robotic movements needed for surgery,” said senior author Axel Krieger. “We believe this marks a significant step forward toward a new frontier in medical robotics.”
The findings led by Johns Hopkins University researchers are being spotlighted this week at the Conference on Robot Learning in Munich, a top event for robotics and machine learning.
The team, which included Stanford University researchers, used imitation learning to train the da Vinci Surgical System robot to perform fundamental surgical procedures: manipulating a needle; lifting body tissue, and suturing. The model combined imitation learning with the same machine learning architecture that underpins ChatGPT. However, where ChatGPT works with words and text, this model speaks “robot” with kinematics, a language that breaks down the angles of robotic motion into math.
The researchers fed their model hundreds of videos recorded from wrist cameras placed on the arms of da Vinci robots during surgical procedures. These videos, recorded by surgeons all over the world, are used for post-operative analysis and then archived. Nearly 7,000 da Vinci robots are used worldwide, and more than 50,000 surgeons are trained on the system, creating a large archive of data for robots to “imitate.”
While the da Vinci system is widely used, researchers say it’s notoriously imprecise. But the team found a way to make the flawed input work. The key was training the model to perform relative movements rather than absolute actions, which are inaccurate.
“All we need is image input and then this AI system finds the right action,” said lead author Ji Woong “Brian” Kim. “We find that even with a few hundred demos the model is able to learn the procedure and generalize new environments it hasn’t encountered.”
The team trained the robot to perform three tasks: manipulate a needle, lift body tissue, and suture. In each case, the robot trained on the team’s model performed the same surgical procedures as skillfully as human doctors.
“Here the model is so good learning things we haven’t taught it,” Krieger said. “Like if it drops the needle, it will automatically pick it up and continue. This isn’t something I taught it do.”
The model could be used to quickly train a robot to perform any type of surgical procedure, the researchers said. The team is now using imitation learning to train a robot to perform not just small surgical tasks but a full surgery.
Before this advancement, programming a robot to perform even a simple aspect of a surgery required hand-coding every step. Someone might spend a decade trying to model suturing, Krieger said. And that’s suturing for just one type of surgery.
“It’s very limiting,” Krieger said. “What is new here is we only have to collect imitation learning of different procedures, and we can train a robot to learn it in a couple days. It allows us to accelerate to the goal of autonomy while reducing medical errors and achieving more accurate surgery.”
Authors from Johns Hopkins include PhD student Samuel Schmidgall; Associate Research Engineer Anton Deguet; and Associate Professor of Mechanical Engineering Marin Kobilarov. Stanford University authors are PhD student Tony Z. Zhao
END
Robot that watched surgery videos performs with skill of human doctor
Breakthrough training system opens ‘new frontier’ in medical robotics
2024-11-11
ELSE PRESS RELEASES FROM THIS DATE:
“Emotional contagion” a factor in senior’s mental health
2024-11-11
Madeleine and Paul are sitting on a park bench. As she tells Paul about her financial worries and how she’s been struggling for months to make ends meet, Madeleine’s eyes well with tears. Paul is moved by her distress; her woes resonate with him and heighten his own fears. His heart grows heavy and his own eyes become moist, too.
What’s going on? A kind of behavioural mirroring, what psychologists call “emotional contagion.”
“Just as some people are more likely to catch a respiratory virus through close contact, others are more susceptible to ‘catching’ the emotions of the people around them,” explained Marie-Josée ...
Fear of another heart attack may be a major source of ongoing stress for survivors
2024-11-11
Research Highlights:
Fear of another heart attack was a significant ongoing contributor to how heart attack survivors perceive their health, according to a new study.
While anxiety and depression are recognized as common conditions after a heart attack, they did not explain the impact of fear of recurrence in this study.
The researchers suggest that fear of another heart attack should be evaluated and addressed separately from depression and anxiety.
Note: The study featured in this news release is a research abstract. Abstracts presented at the American ...
Let’s talk about sex: Heart patients want guidance from health care professionals
2024-11-11
Research Highlights:
A small survey of adults aged 30 to 89 (average age of 65) in Sweden who have heart conditions found that there is a significant difference between the sexual health information they seek and what is provided to them by their health care professionals and the health care system.
Despite 76% of patients with heart conditions reporting that sexual health affects their mood and well-being, only 5% received information or counseling about sexual health.
Researchers suggest health care professionals adjust their patient care practices to ensure that discussing sexual health becomes a standard and respected topic in health ...
Heart disease more common in past redlined areas linked to limited access to healthy foods
2024-11-11
Research Highlights:
Heart disease, Type 2 diabetes, high blood pressure and obesity were more common and linked to reduced access to healthy food among people who lived in neighborhoods previously subjected to structural racism-based policies that limited home ownership — an outlawed practice known as redlining.
Researchers say testing interventions to help improve access to healthy food or boost social and economic resources could mitigate the still-present impact of outdated policies like redlining.
Note: The study featured in this news release is a research abstract. Abstracts presented at American Heart Association’s scientific meetings are not peer-reviewed, and the ...
Heart disease could hit up to 28 years sooner for people with CKM syndrome
2024-11-11
Research Highlights:
Scientists conducted a simulation study to estimate the impact of cardiovascular-kidney-metabolic (CKM) syndrome on cardiovascular disease (CVD) risk prediction.
The study found that adults with chronic kidney disease would have elevated CVD risk eight years earlier than those without the disease. In addition, people with Type 2 diabetes would have an elevated CVD risk about a decade sooner than those without it.
Among adults with both Type 2 diabetes and chronic kidney disease, women ...
MESA heart disease risk score worked well with or without race included
2024-11-11
Research Highlights:
A version of the Multi-Ethnic Study of Atherosclerosis (MESA) heart disease risk score that did not include race predicted heart disease risk just as well as the original version that includes race.
The original MESA risk score, developed in 2015[1], combines traditional risk factors, sex and race with a coronary artery calcium score.
The MESA formula without race may be used for people who identify with more than one racial or ethnic group or those who prefer not to disclose their race or ethnicity.
Note: The study featured in this ...
Bystander CPR up to 10 minutes after cardiac arrest may protect brain function
2024-11-11
This news release contains updated information and data not included in the abstract.
Research Highlights:
The sooner a lay rescuer (bystander) starts cardiopulmonary resuscitation (CPR) on a person having a cardiac arrest at home or in public, up to 10 minutes after the arrest, the better the chances of survival and brain protection, according to an analysis of nearly 200,000 out-of-hospital cardiac arrest cases in the U.S. from 2013 to 2022.
Among the study’s findings, people who received CPR within two minutes of out-of-hospital cardiac arrest had 81% higher odds of survival to release from the hospital ...
911 dispatcher assistance improved chances of receiving bystander CPR
2024-11-11
Research Highlights:
A study of nearly 2,400 cardiac arrest cases in North Carolina found that when emergency dispatchers (telecommunicators) provided cardiopulmonary resuscitation (CPR) instructions to 911 callers, people were more likely to provide aid for both men and women.
The study’s findings indicate that when a telecommunicator provided assistance to callers, bystander CPR was performed 44% of the time on women and 40% on men, compared to 9% on women and 11% on men when telecommunicator assistance was not provided.
Researchers found the telecommunicator role critical in instructing bystanders to act quickly, possibly instrumental in reducing sex disparities ...
GLP-1, SGLT2 medications may lower stroke survivor’s risk of future heart attack, stroke
2024-11-11
Research Highlights:
In an analysis of more than 7,000 stroke survivors, those who were taking either a GLP1-receptor agonist or an SGLT2 inhibitor medication had a lower risk of a subsequent stroke, heart attack or death compared to peers who were not prescribed the medications during a three-year follow up period.
The analysis used health data from the Rochester Epidemiology Project collected from 2000 to 2022. The first GLP-1 medication was prescribed beginning in 2006, and the authors included cases beginning in 2000 to increase the power of the study, they noted.
Note: The study featured in this news release ...
TYK2 transforms tau from ‘good guy’ to a ‘bad guy’ that contributes to Alzheimer’s disease
2024-11-11
Researchers at Baylor College of Medicine, the Jan and Dan Duncan Neurological Research Institute (Duncan NRI) at Texas Children’s Hospital and collaborating institutions discovered that the enzyme TYK2 transforms the normal protein tau into one that accumulates in the brain and contributes to the development of Alzheimer’s disease in animal models. Published in Nature Neuroscience, the study suggests that partially restraining TYK2 could be a strategy to reduce tau levels and toxicity.
“Many studies have shown that the accumulation ...
LAST 30 PRESS RELEASES:
Chemists create world’s thinnest spaghetti
Empowering neuroscience: Large open brain models released
From traditional to technological: Advancements in fresco conservation
Design and imagination as essential tools during the climate crisis
Innovating archaeology: HKU scholars utilize immersive 3D tech to document and study the human past
What's the story, morning glory?
The unsolved mystery sounds of the Southern Ocean #ASA187
These wild chimpanzees play as adults to better cooperate as a group
Physical activity and all-cause mortality by age in 4 multinational megacohorts
Prenatal diet and infant growth from birth to age 24 months
Obesity prevention at an early age
New method for designing artificial proteins
MSU expert: How AI can help people understand research and increase trust in science
Urgent need to enable more farmers and contractors to revive England’s network of hedgerows
ASH inclusion program retained and engaged hematologists underrepresented in field, 20-year analysis shows
How anti-obesity drugs are linked to food waste
Discovery explains kidney damage caused by blood pressure drugs
NYU Langone performs world’s first fully robotic double lung transplant
APSS accepting sleep and circadian research abstracts and session proposals for SLEEP 2025 in Seattle
DNA repair: A look inside the cell’s ‘repair café’
Astronomers take the first close-up picture of a star outside our galaxy
Here’s something Americans agree on: Sports build character
Engineering nature’s blueprint: Dendron-based assemblies for chlorophyll’s materials
Study reveals how cell types shape human brain networks
New genetic explanation for heart condition revealed
Poor mental health linked to browsing negative content online
People with migraine at high risk of depression during pandemic
Climate-driven hazards increases risk for millions of coastal residents, study finds
Females sleep less, awaken more frequently than males
Most Americans want primary care providers to address mental health
[Press-News.org] Robot that watched surgery videos performs with skill of human doctorBreakthrough training system opens ‘new frontier’ in medical robotics