(Press-News.org) A research group at Disney Research Pittsburgh has developed a computer vision system that, much like humans, can continuously improve its ability to recognize objects by picking up hints while watching videos.
Like most other object recognition systems, the Disney system builds a conceptual model of an object, be it an airplane or a soap dispenser, by using a learning algorithm to analyze a number of example images of the object.
What's different about the Disney system is that it then uses that model to identify objects, when it can, in videos. As it does, it sometimes is able to glean new information about such objects, enabling it to make its own model of the object more complex. And that in turn enables the system to more readily recognize such objects in a wider variety of conditions.
"This process continues, potentially indefinitely, over the lifetime of the recognition system," said Leonid Sigal, a senior research scientist at Disney Research Pittsburgh. "This is a learning system that is continuously evolving through unsupervised experience to build a more complete and complex model of the world."
Sigal and his co-investigators - Alina Kuznetsova and Bodo Rosenhahn of Leibniz University Hannover, and former Disney post-doctoral researcher Sung Ju Hwang, now of Ulsan National Institute of Science and Technology in South Korea - will present their findings at the IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015, June 7-12, in Boston.
Recognizing objects in images, though often easy for humans, remains a challenge for automated systems. Systems that learn to recognize objects using one set of images may have difficulty recognizing those same objects in the real world, or under different sets of conditions, or domains.
Rather than try to get a system to more accurately recognize objects using its original model for that object in new domains, the Disney group took a different approach - expanding the object domain incrementally. That means that the system's model for each object will be continuously fine-tuned as the system encounters new information.
One potential problem is that the system, which does this fine tuning without human supervision, may start ascribing attributes to an object that aren't pertinent and lead to errors in detection, but thus far this "domain drift" has not been detected by the Disney researchers.
They tested their incremental learning method against several other leading object recognition methods, using two standard video datasets that included a variety of objects found in the home. In most instances, it outperformed the other methods in detecting items such as microwave ovens, mugs and stoves and demonstrated that it not only got better with experience at detecting these objects in the videos, but also in detecting objects from its original training images.
INFORMATION:
For more information, visit the project web site at http://www.disneyresearch.com/publication/expanding-object-detectors-horizon.
About Disney Research
Disney Research is a network of research laboratories supporting The Walt Disney Company. Its purpose is to pursue scientific and technological innovation to advance the company's broad media and entertainment efforts. Vice Presidents Jessica Hodgins and Markus Gross manage Disney Research facilities in Los Angeles, Pittsburgh, Zürich, and Boston and work closely with the Pixar and ILM research groups in the San Francisco Bay Area. Research topics include computer graphics, animation, video processing, computer vision, robotics, wireless & mobile computing, human-computer interaction, displays, behavioral economics, and machine learning.
An algorithm developed through collaboration of Disney Research Pittsburgh and Boston University can improve the automated recognition of actions in a video, a capability that could aid in video search and retrieval, video analysis and human-computer interaction research.
The core idea behind the new method is to express each action, whether it be a pedestrian strolling down the street or a gymnast performing a somersault, as a series of space-time patterns. These begin with elementary body movements, such as a leg moving up or an arm flexing. But these movements also ...
URBANA, Ill. - Contrary to popular belief, foreclosed properties do not always lead to unkempt lawns. University of Illinois researchers used remote sensing technology to observe rapid change in U.S. urban settings, specifically homes in Maricopa County, Arizona, that foreclosed over about a 10-year period.
"We learned that when a property is foreclosed, it's more nuanced than nature just coming in and taking over," said U of I professional geographer Bethany Cutts. "Foreclosure doesn't always mean management stops."
Cutts said the team of researchers chose to test ...
Tropical Cyclone 01A has been moving in a northerly direction through the Northern Indian Ocean, and is now curving to the west, moving into the Gulf of Oman. NASA's Aqua satellite and RapidScat instruments gathered imagery and data on the storm. Three days of RapidScat imagery showed how sustained winds increased around the entire storm.
The first tropical cyclone of the Northern Indian Ocean Season was born on Sunday, June 7. Tropical Cyclone 1A developed near 16.3 North latitude and 68.5 East longitude, about 536 nautical miles (616.8 miles/992.7 km) south of Karachi, ...
Raising healthy chicks is always a challenge, but in a cold, fish-free Arctic lake, it's an enormous undertaking. Red-throated Loon (Gavia stellata) parents must constantly fly back and forth between their nesting lakes and the nearby ocean, bringing back fish to feed their growing young, and a new study suggests that the chicks grow fast and fledge while they're still small so that they can reach the food-rich ocean themselves and give their parents a break.
Growing chicks must take in enough energy to move around, grow, and maintain their body temperature. The bigger ...
That weathering has to do with the weather is obvious in itself. All the more astonishing, therefore, are the research results of a group of scientists from the GFZ German Research Center for Geosciences in Potsdam and Stanford University, USA, which show that variations in the weathering of rocks over the past 2 million years have been relatively uniform despite the distinct glacial and interglacial periods and the associated fluctuations in the Earth's climate.
The researchers have observed a most stable behavior in marine sediments, fed year after year through the ...
Over geologic time, the work of rain and other processes that chemically dissolve rocks into constituent molecules that wash out to sea can diminish mountains and reshape continents.
Scientists are interested in the rates of these chemical weathering processes because they have big implications for the planet's carbon cycle, which shuttles carbon dioxide between land, sea, and air and influences global temperatures.
A new study, published online on June 8 in the journal Nature Geoscience, by a team of scientists from Stanford and Germany's GFZ Research Center for Geosciences ...
The global movement patterns of all four seasonal influenza viruses are illustrated in research published today in the journal Nature, providing a detailed account of country-to-country virus spread over the last decade and revealing unexpected differences in circulation patterns between viruses.
In the study, an international team of researchers led by the University of Cambridge and the Fred Hutchinson Cancer Research Center, and including all five World Health Organization (WHO) Influenza Collaborating Centres, report surprising differences between the various types ...
Sydney, Australia: Patterns of peak rainfall during storms will intensify as the climate changes and temperatures warm, leading to increased flash flood risks in Australia's urban catchments, new UNSW Australia research suggests.
Civil engineers from the UNSW Water Research Centre have analysed close to 40,000 storms across Australia spanning 30 years and have found warming temperatures are dramatically disrupting rainfall patterns, even within storm events.
Essentially, the most intense downpours are getting more extreme at warmer temperatures, dumping larger volumes ...
New York, NY, June 8, 2015 - Professional physician associations consider certain routine tests before elective surgery to be of low value and high cost, and have sought to discourage their utilization. Nonetheless, a new national study by researchers at NYU Langone Medical Center finds that despite these peer-reviewed recommendations, no significant changes have occurred over a 14-year period in the rates of several kinds of these pre-operative tests.
The results are to publish online on June 8, 2015 in JAMA Internal Medicine.
"Our findings suggest that professional ...
Both statin and nonstatin cholesterol-lowering drugs were associated with memory loss in the first 30 days after patients started taking the medications when compared with nonusers, but researchers suggest the association may have resulted because patients using the medications may have more contact with their physicians and therefore be more likely to detect any memory loss, according to an article published online by JAMA Internal Medicine.
Acute memory loss associated with the use of statins has been described in case reports and case studies, as well as in some studies, ...
