PRESS-NEWS.org - Press Release Distribution
PRESS RELEASES DISTRIBUTION

Copy and paste: New AI tool helps computers interpret the world

USC computer science researchers present new technique to “copy and paste” virtual 3D objects into real indoor scenes, improving how computers see and interpret the world

Copy and paste: New AI tool helps computers interpret the world
2023-12-13
(Press-News.org) Copy and paste. 

It’s a simple concept. 

You define some text or image on your computer, copy it, and paste it where you want it. 

Now, think of that new leather sofa you crave. 

Popular augmented reality (AR) apps allow you to cut and paste an image of the sofa into a photo of your living room to see if you like it before buying. 

A team of researchers at USC Viterbi’s Thomas Lord Department of Computer Science has now developed a similar technique to copy virtual 3D objects and paste them into real indoor scenes. This creates an overall natural and realistic image in terms of spatial relationships, object orientations and lighting. 

What’s more, the technique – called 3D Copy-Paste – can teach computers how to recognize the virtual 3D object in a multitude of different settings without having to rely on the tedious and expensive process of having a human feed the computer with reams of data. 

“This is about training machine-learning systems how to recognize 3D objects in indoor scenes with a method that significantly improves existing 3D object models and achieves state-of-the-art performance,” said computer science Professor Laurent Itti.  

One of Itti’s doctoral students, Yunhao “Andy” Ge, is presenting a research paper, 3D Copy-Paste: Physically Plausible Object Insertion for Monocular 3D Detection, at the 37th Conference on Neural Information Processing Systems (NeurIPS 2023) in New Orleans, Dec. 11-16. 

“This is the first paper to show that we can insert photo-realistic 3D objects into a real-world indoor scene and create enough data to train an AI model to scale up recognition of such objects on its own,” Ge said.  

Itti and Ge collaborated on the project with Assistant Professor of Computer Science Jiajun Wu and his fourth-year Ph.D. student at Stanford University, Hong-Xing “Koven” Yu, as well as four computer scientists with Bosch Research North America: Cheng Zhao, Yuliang Guo, Xinyu Huang, and Liu Ren. 

‘Profound’ implications 

The 3D Copy-Paste tool is what’s known in the AI world as a generative data augmentation technique, in which algorithms are taught to produce coherent and meaningful content that closely resembles human-created output by learning from patterns, trends, and relationships. 

3D Copy-Paste could have “profound” implications for both the computer graphics and computer vision fields, Itti and Ge said.

Take, for example, autonomous driving technology. 

An image of a cow is most associated with pastures and other bucolic settings. 

If you want to teach an AI in a self-driving car to avoid hitting a cow in front of your moving vehicle, the AI initially might get confused—a cow normally isn’t found in the middle of a road. You would have to feed it an image of a cow in front of a car for it to recognize the object quickly.  

But the 3D Copy-Paste tool allows a computer to recognize an object in an endless variety of environments without having to be frontloaded with a ton of images. And it can create new images that don’t exist in the real world – say, a cow walking on the moon – that blend in seamlessly with a photo of an indoor environment and appear to be physically plausible.  

“You don’t need any human to do manual labeling,” Ge explained, “because when this virtual 3D object is inserted into a real indoor scene, it automatically generates labels for the AI to understand.” 

Added Itti: “This tool can generate millions of combinations of an image of an object, which allows the AI model to be trained that much better because of the high-quality data this tool creates.”  

The key is making the inserted object physically plausible, which means it won’t “collide” with existing objects and will have the correct lighting. 3D Copy-Paste first identifies physically feasible locations and poses for the inserted objects to prevent collisions with the existing room layout. Subsequently, it estimates spatially varying illumination for the insertion location, enabling the immersive blending of the virtual objects into the original scene with plausible appearances and shadows. 

Virtual additions 

In short, 3D Copy-Paste can improve how computers see and interpret things in 3D space.

“As AR technology becomes more widespread and used in various applications,” Ge said, “the techniques we’ve developed can help enhance the user experience and make virtual objects blend seamlessly into our real world.” 

Another application of 3D Copy-Paste could be in the digitization of industrial workflows. 

As industrial enterprises shift toward digitizing their workflows and creating digital twins of real-world assets, the ability to insert realistic 3D objects into these digital representations becomes crucial, Itti and Ge said. 

The 3D Copy-Paste method, they said, could ensure that any virtual additions to these digital twins, such as new equipment or structures, are done in a physically accurate and visually coherent manner. 

“Our findings highlight the potential of 3D data augmentation in improving the performance of 3D perception tasks, opening up new avenues for research and practical applications,” Ge said. 

 

END

[Attachments] See images for this press release:
Copy and paste: New AI tool helps computers interpret the world Copy and paste: New AI tool helps computers interpret the world 2 Copy and paste: New AI tool helps computers interpret the world 3

ELSE PRESS RELEASES FROM THIS DATE:

Consumers grapple with confusion over food-date labels

Consumers grapple with confusion over food-date labels
2023-12-13
Consumers grapple with confusion over food-date labels The use of food-date labels such as “use-by” and “best if used by” causes consumer confusion that results in many Americans discarding food that is safe to eat or donate, according to the November 2023 Consumer Food Insights Report. The survey-based report out of Purdue University’s Center for Food Demand Analysis and Sustainability assesses food spending, consumer satisfaction and values, support of agricultural ...

This adaptive roof tile can cut both heating and cooling costs

2023-12-13
(Santa Barbara, Calif.) — About half of an average American building’s energy consumption is spent on heating and cooling. That’s a lot of money spent, fossil fuel burned and strain on an aging energy infrastructure during times of severe temperatures. It’s also a problem UC Santa Barbara researchers Charlie Xiao, Elliot Hawkes and Bolin Liao are hoping to make a dent in. In a paper in the journal Device, the trio present an adaptive tile, which when deployed in arrays on roofs, can lower heating ...

WFIRM and partnering institutions awarded five-year, $6 million grant on kidney, urology, and hematology research

2023-12-13
WINSTON-SALEM, NC, December 13, 2023 - The Wake Forest Institute for Regenerative Medicine (WFIRM) has received a $6 million grant from the National Institute for Diabetes, Digestive and Kidney Diseases, part of the National Institutes of Health. Alongside five other North Carolina institutions, the collaborative effort aims to address critical issues and advance research in the fields of kidney, urology and hematology. Dr. Anthony Atala, the W. Boyce professor and chair of urology at Wake Forest University School of Medicine and director of WFIRM, Dr. Ronald Falk, Nan and Hugh Cullman Eminent professor of medicine at UNC, and Dr. Thomas Ortel, professor of medicine ...

Beef farming that keeps cattle on lifelong grass diets may have higher carbon footprint

Beef farming that keeps cattle on lifelong grass diets may have higher carbon footprint
2023-12-13
Beef operations that keep cattle on lifelong grass-based diets may have an overall higher carbon footprint than those that switch cattle to grain-based diets partway through their lives. Daniel Blaustein-Rejto of the Breakthrough Institute, USA, and colleagues present these findings in the open-access journal PLOS ONE on December 13.  Cattle on lifelong grass diets are known as “pasture finished,” while those that switch from grass to grain before slaughter are “grain finished.” Prior research has suggested that ...

Vikings in Sweden suffered from tooth decay

Vikings in Sweden suffered from tooth decay
2023-12-13
Vikings in Sweden suffered from painful dental issues and occasionally tried to treat them, according to a study published December 13, 2023 in the open-access journal PLOS ONE by Carolina Bertilsson of the University of Gothenburg, Sweden and colleagues. In 2005, excavations in Varnhem, Sweden uncovered the remains of a Christian church, nearby which was a cemetery containing thousands of Viking graves dating to the 10th-12th century AD. In this study, Bertilsson and colleagues performed clinical and radiographical examination of the dentition of individuals from this site. In total, the team analyzed over 2300 teeth ...

The methane and nitrous oxide we exhale might contribute - in a very small way - to greenhouse gas emissions, with breath analysis indicating this may comprise up to 0.1% of UK emissions of the gases

The methane and nitrous oxide we exhale might contribute - in a very small way - to greenhouse gas emissions, with breath analysis indicating this may comprise up to 0.1% of UK emissions of the gases
2023-12-13
The methane and nitrous oxide we exhale might contribute - in a very small way - to greenhouse gas emissions, with breath analysis indicating this may comprise up to 0.1% of UK emissions of the gases ### Article URL:  https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0295157 Article Title: Measurements of methane and nitrous oxide in human breath and the development of UK scale emissions Author Countries: UK Funding: The analysis was funded by the UK NERC grant E/S003614/2 ‘Detection and Attribution of Regional greenhouse gas Emissions in the UK (DAREUK)’. ...

Moms who participate in baby massage report reduced postnatal depression symptoms and better interactions with their child, per systematic review

Moms who participate in baby massage report reduced postnatal depression symptoms and better interactions with their child, per systematic review
2023-12-13
Moms who participate in baby massage report reduced postnatal depression symptoms and better interactions with their child, per systematic review ### Article URL:  https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0294156 Article Title: The effectiveness of mother-led infant massage on symptoms of maternal postnatal depression: A systematic review Author Countries: Ireland Funding: The authors received no specific funding for this work. END ...

Yoga nidra might be a path to better sleep and improved memory

Yoga nidra might be a path to better sleep and improved memory
2023-12-13
Practicing yoga nidra—a kind of mindfulness training— might improve sleep, cognition, learning, and memory, even in novices, according to a pilot study publishing in the open-access journal PLOS ONE on December 13 by Karuna Datta of the Armed Forces Medical College in India, and colleagues. After a two-week intervention with a cohort of novice practitioners, the researchers found that the percentage of delta-waves in deep sleep increased and that all tested cognitive abilities improved. Unlike more active forms of yoga, which focus on physical postures, breathing, and muscle control, yoga nidra guides people into a state of conscious relaxation ...

Cognitive strategies for augmenting the body with a wearable, robotic arm

2023-12-13
Neuroengineer Silvestro Micera develops advanced technological solutions to help people regain sensory and motor functions that have been lost due to traumatic events or neurological disorders. Until now, he had never before worked on enhancing the human body and cognition with the help of technology. Now in a study published in Science Robotics, Micera and his team report on how diaphragm movement can be monitored for successful control of an extra arm, essentially augmenting a healthy individual with a third – robotic – arm. “This study opens up new and exciting opportunities, ...

Earliest evidence for domestic yak found using both archaeology, ancient DNA

Earliest evidence for domestic yak found using both archaeology, ancient DNA
2023-12-13
The high-altitude hero of the Himalayas, yak are among the few large animals that can survive the extremely cold, harsh and oxygen-poor conditions of the Tibetan Plateau. In the mountainous regions of Asia, yak and yak-cattle hybrids serve as vital sources of meat, milk, transportation and fuel. However, little is known about their history: when or where yak were domesticated. In a study published Dec. 13 in Science Advances, an international team of researchers that includes archaeologists at Washington University in St. Louis report archaeologically and genetically confirmed evidence for domestic yak, dating back 2,500 years, by far the oldest record. The researchers ...

LAST 30 PRESS RELEASES:

New guideline standardizes consent for research participants in Canada

Research as reconciliation: Oil sands and health

AI risks overwriting history and the skills of historians have never been more important, leading academic outlines in new paper

The Lancet Diabetes & Endocrinology: Higher doses of semaglutide can safely enhance weight loss and improve health for adults living with obesity, two new clinical trials confirm

Trauma focused therapy shows promise for children struggling with PTSD

School meals could drive economic growth and food system transformation

Home training for cerebellar ataxias

Dry eyes affect over half the general population, yet only a fifth receive diagnosis and treatment

Researchers sound warning about women with type 2 diabetes taking oral HRT

Overweight and obesity don’t always increase the risk of an early death, Danish study finds

Cannabis use associated with a quadrupling of risk of developing type 2 diabetes, finds study of over 4 million adults

Gestational diabetes linked to cognitive decline in mothers and increased risk of developmental delays, ADHD and autism among children

Could we use eye drops instead of reading glasses as we age?

Patients who had cataracts removed or their eyesight corrected with a new type of lens have good vision over all distances without spectacles

AI can spot which patients need treatment to prevent vision loss in young adults

Half of people stop taking popular weight-loss drug within a year, national study finds

Links between diabetes and depression are similar across Europe, study of over-50s in 18 countries finds

Smoking increases the risk of type 2 diabetes, regardless of its characteristics

Scientists trace origins of now extinct plant population from volcanically active Nishinoshima

AI algorithm based on routine mammogram + age can predict women’s major cardiovascular disease risk

New hurdle seen to prostate screening: primary-care docs

MSU researchers explore how virtual sports aid mental health

Working together, cells extend their senses

Cheese fungi help unlock secrets of evolution

Researchers find brain region that fuels compulsive drinking

Mental health effects of exposure to firearm violence persist long after direct exposure

Research identifies immune response that controls Oropouche infection and prevents neurological damage

University of Cincinnati, Kent State University awarded $3M by NSF to share research resources

Ancient DNA reveals deeply complex Mastodon family and repeated migrations driven by climate change

Measuring the quantum W state

[Press-News.org] Copy and paste: New AI tool helps computers interpret the world
USC computer science researchers present new technique to “copy and paste” virtual 3D objects into real indoor scenes, improving how computers see and interpret the world