(Press-News.org) PITTSBURGH—Editors of photos routinely resize objects, or move them up, down or sideways, but Carnegie Mellon University researchers are adding an extra dimension to photo editing by enabling editors to turn or flip objects any way they want, even exposing surfaces not visible in the original photograph.
A chair in a photograph of a living room, for instance, can be turned around or even upside down in the photo, displaying sides of the chair that would have been hidden from the camera, yet appearing to be realistic.
This three-dimensional manipulation of objects in a single, two-dimensional photograph is possible because 3-D numerical models of many everyday objects — furniture, cookware, automobiles, clothes, appliances — are readily available online. The research team led by Yaser Sheikh, associate research professor of robotics, found they could create realistic edits by fitting these models into the geometry of the photo and then applying colors, textures and lighting consistent with the photo.
"In the real world, we're used to handling objects — lifting them, turning them around or knocking them over," said Natasha Kholgade, a Ph.D. student in the Robotics Institute and lead author of the study. "We've created an environment that gives you that same freedom when editing a photo."
Kholgade will present the team's findings Aug. 13 at the SIGGRAPH 2014 Conference on Computer Graphics and Interactive Techniques in Vancouver, Canada. A video demonstrating the new system is available on the project website at http://www.cs.cmu.edu/~om3d/.
Though the system is designed for use with digital imagery, it enables the same 3-D manipulation of objects in paintings and in historical photos. Objects that can be manipulated in photos also can be animated; the researchers demonstrated that an origami bird held in a hand can be made to flap its wings and fly away, or a taxi cab shown in a street scene can levitate, flip over to reveal its undercarriage and zip off into the heavens.
"Instead of simply editing 'what we see' in the photograph, our goal is to manipulate 'what we know' about the scene behind the photograph," Kholgade said.
Other researchers have used depth-based segmentation to perform viewpoint changes in photos or have used modeling of photographed objects, but neither approach enables hidden areas to be revealed. Another alternative is to insert a new 2-D or 3-D object into a photo, but those approaches discard information from the original photo regarding lighting and appearance, so the results are less than seamless.
One of the catches to using publicly available 3-D models is that the models seldom, if ever, fit a photo exactly. Variations occur between the models and the physical objects; real-life objects such as seat cushions and backpacks are sometimes deformed as they are used, and appearances may change because of aging, weathering or lighting.
To fix these variations, the researchers developed a technique to semi-automatically align the model to the geometry of the object in the photo while preserving the symmetries in the object. The system then automatically estimates the environmental illumination and appearance of the hidden parts of the object — the visible side of a seat cushion or of a banana is used to create a plausible appearance for the opposite side. If the photo doesn't contain pertinent appearance information — such as the underside of a taxicab — the system uses the appearance of the stock 3-D model.
Though a wide variety of stock models is available online, models are not available for every object in a photo. But that limitation is likely to subside, particularly as 3-D scanning and printing technologies become ubiquitous. "The more pressing question will soon be, not whether a particular model exists online, but whether the user can find it," Sheikh said. One thrust of future research will thus need to be automating the search for 3-D models in a database of millions.
INFORMATION:
This research was sponsored, in part, by a Google Research Award. In addition to Kholgade and Sheikh, the team included Tomas Simon, a Ph.D. student in the Robotics Institute, and Alexei Efros, a former CMU faculty member now an associate professor of electrical engineering and computer science at the University of California, Berkeley.
The Robotics Institute is part of Carnegie Mellon's top-ranked School of Computer Science, which is celebrating its 25th year. Follow the school on Twitter @SCSatCMU.
About Carnegie Mellon University:
Carnegie Mellon is a private, internationally ranked research university with programs in areas ranging from science, technology and business, to public policy, the humanities and the arts. More than 12,000 students in the university's seven schools and colleges benefit from a small student-to-faculty ratio and an education characterized by its focus on creating and implementing solutions for real problems, interdisciplinary collaboration and innovation. A global university, Carnegie Mellon has campuses in Pittsburgh, Pa., California's Silicon Valley and Qatar, and programs in Africa, Asia, Australia, Europe and Mexico.
Carnegie Mellon photo editing tool enables object images to be manipulated in 3-D
With help of stock 3-D models, photographed items can be turned, flipped, animated
2014-08-05
ELSE PRESS RELEASES FROM THIS DATE:
Rituals can help older people remember to take their asthma meds
2014-08-05
Storing it in the bathroom and making it part of a daily routine may be helpful advice that doctors can give their older asthmatic patients who struggle to remember to take their daily prescribed medication. This advice comes from Alex Federman, Associate Professor of Medicine at the Icahn School of Medicine in New York City, senior author of a study which discusses how elderly asthmatics cope with taking their inhaled corticosteroid medication as prescribed. The findings appear in the Journal of General Internal Medicine, published by Springer.
The regular use of such ...
Clues to the ageing of tendons unlocked for the first time
2014-08-05
University of Liverpool scientists have examined the mechanisms that cause ageing in the tendons of horses, opening up the possibility of better treatment for humans.
It has been understood for many years that tendons are highly prone to injury and that this likelihood increases as they age. Why this happens, is currently poorly understood
Now, using samples taken from young and old horses, which have similar tendon properties to those of humans, the team of researchers, which also included scientists from Queen Mary University of London, performed a range of tests ...
Scientists call for increased conservation efforts to save black bears
2014-08-05
COLUMBIA, Mo. – Between 1880 and 1920, the Central Interior Highlands (CIH), consisting of Missouri, Oklahoma and Arkansas, saw the height of deforestation that also decreased the habitat for black bears and other forest species. To combat the decline of black bears and repopulate the mountainous region, more than 250 bears from Minnesota and Manitoba were relocated to Arkansas in the 1950s and 1960s. Now, researchers at the University of Missouri have analyzed genetic diversity in black bears in the CIH and have determined that coordinated conservation management is still ...
Obesity paradox in survival from sepsis
2014-08-05
ANN ARBOR, Mich. – University of Michigan Health System researchers revealed an obesity paradox among older Americans suffering from sepsis.
In a study of 1,404 Medicare beneficiaries, heavier patients were more likely to survive sepsis, a life-threatening infection that can lead to a stay in a hospital's intensive care unit.
The findings, published in the August issue of Critical Care Medicine, raise interesting questions about how obesity impacts the body's response to infection. Obesity is most often connected with worse, not better, health outcomes.
"Physicians ...
Researchers determine why tendons break down with age
2014-08-05
Scientists at Queen Mary University of London (QMUL) have identified differences in the proteins present in young and old tendons, in new research that could guide the development of treatments to stop tissue breakdown from occurring.
Tendon structure in horses is similar to humans, and both face common injuries. The researchers used a horse model to undertake a thorough analysis of all the proteins and protein fragments present in healthy and injured tendons.
Working with scientists at the University of Liverpool, the team collected data, which shows that healthy, ...
Used-cigarette butts offer energy storage solution
2014-08-05
A group of scientists from South Korea have converted used-cigarette butts into a high-performing material that could be integrated into computers, handheld devices, electrical vehicles and wind turbines to store energy.
Presenting their findings today, 5 August 2014, in IOP Publishing's journal Nanotechnology, the researchers have demonstrated the material's superior performance compared to commercially available carbon, graphene and carbon nanotubes.
It is hoped the material can be used to coat the electrodes of supercapacitors—electrochemical components that can ...
Mammography benefits women over 75
2014-08-05
OAK BROOK, Ill. – Mammography-detected breast cancer is associated with a shift to earlier stage diagnosis in older women, subsequently reducing the rate of more advanced, difficult-to-treat cases, according to a new study published online in the journal Radiology. Researchers said the findings lend support to regular mammography screening in women ages 75 and older.
The value of mammography screening in older women has been subject to much debate in recent years. The American Cancer Society recommends annual mammograms for women age 75 and older as long as they are ...
Patients with autism spectrum disorder are not sensitive to 'being imitated'
2014-08-05
A Japanese research group led by Prof Norihiro Sadato, a professor of the National Institute for Physiological Sciences (NIPS), National Institutes of Natural Sciences (NINS), has found that people with autism spectrum disorders (ASD) have decreased activity in an area in the brain critical for understanding if his/her movement was imitated by others. These results will be published in Neuroscience Research (available online at http://www.sciencedirect.com/science/article/pii/S0168010214001254).
The research group of Norihiro Sadato, a professor of NIPS, Hirotaka Kosaka, ...
Boost for cancer prevention research
2014-08-05
Queen's University scientists are helping to spearhead a new £6 million initiative to find better ways to prevent cancer.
The new initiative, led by Cancer Research UK with matching investment from the BUPA Foundation, aims to support cutting-edge research to find better ways to prevent cancer.
It is estimated that more than four in ten cancer cases could be prevented by lifestyle changes, such as not smoking, keeping a healthy body weight, cutting back on alcohol, eating a healthy diet, keeping active and staying safe in the sun.
Professor Frank Kee, who directs the ...
Research explores why interval walking training is better than continuous walking training
2014-08-05
New research published in Diabetologia (the journal of the European Association for the Study of Diabetes) suggests that training with alternating levels of walking intensity (interval training) could be better than walking at a constant speed to help manage blood sugar in people with type 2 diabetes. The research is by Dr Thomas Solomon, University of Copenhagen, Denmark, and colleagues.
The effects of exercise on blood sugar (glycaemic) control in individuals with type 2 diabetes are well documented but the optimal exercise intensity and type remains to be defined. ...
LAST 30 PRESS RELEASES:
Thirty-year mystery of dissonance in the “ringing” of black holes explained
Less intensive works best for agricultural soil
Arctic rivers project receives “national champion” designation from frontiers foundation
Computational biology paves the way for new ALS tests
Study offers new hope for babies born with opioid withdrawal syndrome
UT, Volkswagen Group of America celebrate research partnership
New Medicare program could dramatically improve affordability for cancer drugs – if patients enroll
Are ‘zombie’ skin cells harmful or helpful? The answer may be in their shapes
University of Cincinnati Cancer Center presents research at AACR 2025
Head and neck, breast, lung and survivorship studies headline Dana-Farber research at AACR Annual Meeting 2025
AACR: Researchers share promising results from MD Anderson clinical trials
New research explains why our waistlines expand in middle age
Advancements in muon detection: Taishan Antineutrino Observatory's innovative top veto tracker
Chips off the old block
Microvascular decompression combined with nerve combing for atypical trigeminal neuralgia
Cutting the complexity from digital carpentry
Lung immune cell type “quietly” controls inflammation in COVID-19
Fiscal impact of expanded Medicare coverage for GLP-1 receptor agonists to treat obesity
State and sociodemographic trends in US cigarette smoking with future projections
Young adults drive historic decline in smoking
NFCR congratulates Dr. Robert C. Bast, Jr. on receiving the AACR-Daniel D. Von Hoff Award for Outstanding Contributions to Education and Training in Cancer Research
Chimpanzee stem cells offer new insights into early embryonic development
This injected protein-like polymer helps tissues heal after a heart attack
FlexTech inaugural issue launches, pioneering interdisciplinary innovation in flexible technology
In Down syndrome mice, 40Hz light and sound improve cognition, neurogenesis, connectivity
Methyl eugenol: potential to inhibit oxidative stress, address related diseases, and its toxicological effects
A vascularized multilayer chip reveals shear stress-induced angiogenesis in diverse fluid conditions
AI helps unravel a cause of Alzheimer's disease and identify a therapeutic candidate
Coalition of Autism Scientists critiques US Department of Health and Human Services Autism Research Initiative
Structure dictates effectiveness, safety in nanomedicine
[Press-News.org] Carnegie Mellon photo editing tool enables object images to be manipulated in 3-DWith help of stock 3-D models, photographed items can be turned, flipped, animated