(Press-News.org) Contact information: Byron Spice
bspice@cs.cmu.edu
412-268-9068
Carnegie Mellon University
Carnegie Mellon computer searches web 24/7 to analyze images and teach itself common sense
NEIL program labels images, learns associations with minimal help from people
PITTSBURGH—A computer program called the Never Ending Image Learner (NEIL) is running 24 hours a day at Carnegie Mellon University, searching the Web for images, doing its best to understand them on its own and, as it builds a growing visual database, gathering common sense on a massive scale.
NEIL leverages recent advances in computer vision that enable computer programs to identify and label objects in images, to characterize scenes and to recognize attributes, such as colors, lighting and materials, all with a minimum of human supervision. In turn, the data it generates will further enhance the ability of computers to understand the visual world.
But NEIL also makes associations between these things to obtain common sense information that people just seem to know without ever saying — that cars often are found on roads, that buildings tend to be vertical and that ducks look sort of like geese. Based on text references, it might seem that the color associated with sheep is black, but people — and NEIL — nevertheless know that sheep typically are white.
"Images are the best way to learn visual properties," said Abhinav Gupta, assistant research professor in Carnegie Mellon's Robotics Institute. "Images also include a lot of common sense information about the world. People learn this by themselves and, with NEIL, we hope that computers will do so as well."
A computer cluster has been running the NEIL program since late July and already has analyzed three million images, identifying 1,500 types of objects in half a million images and 1,200 types of scenes in hundreds of thousands of images. It has connected the dots to learn 2,500 associations from thousands of instances.
The public can now view NEIL's findings at the project website, http://www.neil-kb.com.
The research team, including Xinlei Chen, a Ph.D. student in CMU's Language Technologies Institute, and Abhinav Shrivastava, a Ph.D. student in robotics, will present its findings on Dec. 4 at the IEEE International Conference on Computer Vision in Sydney, Australia.
One motivation for the NEIL project is to create the world's largest visual structured knowledge base, where objects, scenes, actions, attributes and contextual relationships are labeled and catalogued.
"What we have learned in the last 5-10 years of computer vision research is that the more data you have, the better computer vision becomes," Gupta said.
Some projects, such as ImageNet and Visipedia, have tried to compile this structured data with human assistance. But the scale of the Internet is so vast — Facebook alone holds more than 200 billion images — that the only hope to analyze it all is to teach computers to do it largely by themselves.
Shrivastava said NEIL can sometimes make erroneous assumptions that compound mistakes, so people need to be part of the process. A Google Image search, for instance, might convince NEIL that "pink" is just the name of a singer, rather than a color.
"People don't always know how or what to teach computers," he observed. "But humans are good at telling computers when they are wrong."
People also tell NEIL what categories of objects, scenes, etc., to search and analyze. But sometimes, what NEIL finds can surprise even the researchers. It can be anticipated, for instance, that a search for "apple" might return images of fruit as well as laptop computers. But Gupta and his landlubbing team had no idea that a search for F-18 would identify not only images of a fighter jet, but also of F18-class catamarans.
As its search proceeds, NEIL develops subcategories of objects – tricycles can be for kids, for adults and can be motorized, or cars come in a variety of brands and models. And it begins to notice associations – that zebras tend to be found in savannahs, for instance, and that stock trading floors are typically crowded.
NEIL is computationally intensive, the research team noted. The program runs on two clusters of computers that include 200 processing cores.
###
This research is supported by the Office of Naval Research and Google Inc.
The Robotics Institute and Language Technologies Institute are part of Carnegie Mellon's School of Computer Science. Follow the school on Twitter @SCSatCMU.
About Carnegie Mellon University: Carnegie Mellon is a private, internationally ranked research university with programs in areas ranging from science, technology and business, to public policy, the humanities and the arts. More than 12,000 students in the university's seven schools and colleges benefit from a small student-to-faculty ratio and an education characterized by its focus on creating and implementing solutions for real problems, interdisciplinary collaboration and innovation. A global university, Carnegie Mellon has campuses in Pittsburgh, Pa., California's Silicon Valley and Qatar, and programs in Africa, Asia, Australia, Europe and Mexico.
Carnegie Mellon computer searches web 24/7 to analyze images and teach itself common sense
NEIL program labels images, learns associations with minimal help from people
2013-11-20
ELSE PRESS RELEASES FROM THIS DATE:
USF researchers show invasive sparrows immune cells sharpen as they spread
2013-11-20
USF researchers show invasive sparrows immune cells sharpen as they spread
TAMPA, Fla. (Nov. 20, 2013) - When invasive species move into new areas, they often lose their natural enemies, including the microbes that make them sick. But new research ...
Solar-powered battery woven into fabric overcomes hurdle for 'wearable electronics'
2013-11-20
Solar-powered battery woven into fabric overcomes hurdle for 'wearable electronics'
Though some people already seem inseparable from their smartphones, even more convenient, wearable, solar-powered electronics could be on the way soon, woven into clothing ...
Insomnia linked to mortality risk
2013-11-20
Insomnia linked to mortality risk
Researchers associate some insomnia symptoms with higher mortality risk in men
Boston, MA - Insomnia, the most common sleep disorder, affects up to one-third of the population in the United States. In new findings, ...
Reducing the salt in bread without losing saltiness, thanks to a texture trick
2013-11-20
Reducing the salt in bread without losing saltiness, thanks to a texture trick
Want to make bread taste pleasantly salty without adding more salt? Change the bread's texture so it is less dense, say scientists. They report in ACS' Journal of Agricultural ...
Introducing solid foods while continuing to breast feed could prevent child allergies
2013-11-20
Introducing solid foods while continuing to breast feed could prevent child allergies
Introducing solid food with breast milk after the 17th week of birth could reduce food allergies in babies, according to University of Southampton research.
The research, ...
Hormone therapy could enhance the therapeutic effect of head and facial bone grafts
2013-11-20
Hormone therapy could enhance the therapeutic effect of head and facial bone grafts
Bone grafts, which are used to treat head injuries and birth defects, still pose major medical challenges, but scientists are reporting progress toward a new hormone therapy ...
Dismantling Syria's chemical weapons in the midst of war
2013-11-20
Dismantling Syria's chemical weapons in the midst of war
Syria no longer has the capacity to produce new chemical weapons en masse, but arms control experts caution that what remains is the more difficult job of destroying the existing stockpile in the midst ...
EORTC head & neck cancer trial shows assessing HRQOL is valuable to both patients and their doctors
2013-11-20
EORTC head & neck cancer trial shows assessing HRQOL is valuable to both patients and their doctors
In Europe in 2012, there were an estimated 39,900 new cases of laryngeal cancer and 99,600 new cases of oral cavity and pharyngeal cancers (Feraly ...
New research gives clues of antibiotic use and resistance in US children's hospitals
2013-11-20
New research gives clues of antibiotic use and resistance in US children's hospitals
Findings coincide with CDC's Get Smart Week
CHICAGO (November 20, 2013) – Two studies published in the December issue of Infection Control and Hospital Epidemiology ...
Study finds differences in brains of children with nonverbal learning disability
2013-11-20
Study finds differences in brains of children with nonverbal learning disability
EAST LANSING, Mich. — A Michigan State University researcher has discovered the first anatomical evidence that the brains of children with a nonverbal learning disability – long considered ...
LAST 30 PRESS RELEASES:
Eliminating invasive rats may restore the flow of nutrients across food chain networks in Seychelles
World’s first: Lithuanian scientists’ discovery may transform OLED technology and explosives detection
Rice researchers develop superstrong, eco-friendly materials from bacteria
Itani studying translation potential of secure & efficient software updates in industrial internet of things architectures
Elucidating the source process of the 2021 south sandwich islands tsunami earthquake
Zhu studying use of big data in verification of route choice models
Common autoimmune drug may help reverse immunotherapy-induced diabetes, UCLA study finds
Quantum battery device lasts much longer than previous demonstrations
Gamma knife stereotactic radiosurgery for brain metastases from ovarian cancer
Meet the “plastivore” caterpillars that grow fat from eating plastic
Study identifies postoperative delirium as preventable “acute brain failure” with major health and financial implications
Climate change linked to decline in nutritional quality of food
Abdominal fat linked to reduced strength and mobility in adults
Mount Sinai implements Own the Bone® program for fragility fracture patients
Is Earth inside a huge void? 'Sound of the Big Bang' hints at possible solution to Hubble tension
When stem cells feel the squeeze, they start building bone
Revealing Myanmar earthquake as a unique event comprising multiple sub-events, including boomerang-like reverse rupture propagation and supershear rupture
AI helps radiologists spot more lesions in mammograms
Efficient elastic tissues may hold the secrets to Olympic success
Does exercise really improve mental health?
Behind the ballistics of the “explosive” squirting cucumber
Researchers find compound that inhibits cutaneous HPVs
City of Hope Research Spotlight, April/May 2025
The gut microbiota in elderly patients with acute hepatitis E infection
The Three Gorges region of the Yangtze River hits record high temperatures in 2024
Experts urge evidence-based regulations of 7-OH, not restriction, as new science emerges showing safe use
Genes for surviving plague in prairie dogs
New research shows AI chatbots should not replace your therapist
Pusan National University researchers reveal middle-class families hit hardest by South Korea's cost-of-living crisis
Understanding how heat stress reshapes fat metabolism in chickens
[Press-News.org] Carnegie Mellon computer searches web 24/7 to analyze images and teach itself common senseNEIL program labels images, learns associations with minimal help from people