(Press-News.org) Contact information: Byron Spice
bspice@cs.cmu.edu
412-268-9068
Carnegie Mellon University
Carnegie Mellon computer searches web 24/7 to analyze images and teach itself common sense
NEIL program labels images, learns associations with minimal help from people
PITTSBURGH—A computer program called the Never Ending Image Learner (NEIL) is running 24 hours a day at Carnegie Mellon University, searching the Web for images, doing its best to understand them on its own and, as it builds a growing visual database, gathering common sense on a massive scale.
NEIL leverages recent advances in computer vision that enable computer programs to identify and label objects in images, to characterize scenes and to recognize attributes, such as colors, lighting and materials, all with a minimum of human supervision. In turn, the data it generates will further enhance the ability of computers to understand the visual world.
But NEIL also makes associations between these things to obtain common sense information that people just seem to know without ever saying — that cars often are found on roads, that buildings tend to be vertical and that ducks look sort of like geese. Based on text references, it might seem that the color associated with sheep is black, but people — and NEIL — nevertheless know that sheep typically are white.
"Images are the best way to learn visual properties," said Abhinav Gupta, assistant research professor in Carnegie Mellon's Robotics Institute. "Images also include a lot of common sense information about the world. People learn this by themselves and, with NEIL, we hope that computers will do so as well."
A computer cluster has been running the NEIL program since late July and already has analyzed three million images, identifying 1,500 types of objects in half a million images and 1,200 types of scenes in hundreds of thousands of images. It has connected the dots to learn 2,500 associations from thousands of instances.
The public can now view NEIL's findings at the project website, http://www.neil-kb.com.
The research team, including Xinlei Chen, a Ph.D. student in CMU's Language Technologies Institute, and Abhinav Shrivastava, a Ph.D. student in robotics, will present its findings on Dec. 4 at the IEEE International Conference on Computer Vision in Sydney, Australia.
One motivation for the NEIL project is to create the world's largest visual structured knowledge base, where objects, scenes, actions, attributes and contextual relationships are labeled and catalogued.
"What we have learned in the last 5-10 years of computer vision research is that the more data you have, the better computer vision becomes," Gupta said.
Some projects, such as ImageNet and Visipedia, have tried to compile this structured data with human assistance. But the scale of the Internet is so vast — Facebook alone holds more than 200 billion images — that the only hope to analyze it all is to teach computers to do it largely by themselves.
Shrivastava said NEIL can sometimes make erroneous assumptions that compound mistakes, so people need to be part of the process. A Google Image search, for instance, might convince NEIL that "pink" is just the name of a singer, rather than a color.
"People don't always know how or what to teach computers," he observed. "But humans are good at telling computers when they are wrong."
People also tell NEIL what categories of objects, scenes, etc., to search and analyze. But sometimes, what NEIL finds can surprise even the researchers. It can be anticipated, for instance, that a search for "apple" might return images of fruit as well as laptop computers. But Gupta and his landlubbing team had no idea that a search for F-18 would identify not only images of a fighter jet, but also of F18-class catamarans.
As its search proceeds, NEIL develops subcategories of objects – tricycles can be for kids, for adults and can be motorized, or cars come in a variety of brands and models. And it begins to notice associations – that zebras tend to be found in savannahs, for instance, and that stock trading floors are typically crowded.
NEIL is computationally intensive, the research team noted. The program runs on two clusters of computers that include 200 processing cores.
###
This research is supported by the Office of Naval Research and Google Inc.
The Robotics Institute and Language Technologies Institute are part of Carnegie Mellon's School of Computer Science. Follow the school on Twitter @SCSatCMU.
About Carnegie Mellon University: Carnegie Mellon is a private, internationally ranked research university with programs in areas ranging from science, technology and business, to public policy, the humanities and the arts. More than 12,000 students in the university's seven schools and colleges benefit from a small student-to-faculty ratio and an education characterized by its focus on creating and implementing solutions for real problems, interdisciplinary collaboration and innovation. A global university, Carnegie Mellon has campuses in Pittsburgh, Pa., California's Silicon Valley and Qatar, and programs in Africa, Asia, Australia, Europe and Mexico.
Carnegie Mellon computer searches web 24/7 to analyze images and teach itself common sense
NEIL program labels images, learns associations with minimal help from people
2013-11-20
ELSE PRESS RELEASES FROM THIS DATE:
USF researchers show invasive sparrows immune cells sharpen as they spread
2013-11-20
USF researchers show invasive sparrows immune cells sharpen as they spread
TAMPA, Fla. (Nov. 20, 2013) - When invasive species move into new areas, they often lose their natural enemies, including the microbes that make them sick. But new research ...
Solar-powered battery woven into fabric overcomes hurdle for 'wearable electronics'
2013-11-20
Solar-powered battery woven into fabric overcomes hurdle for 'wearable electronics'
Though some people already seem inseparable from their smartphones, even more convenient, wearable, solar-powered electronics could be on the way soon, woven into clothing ...
Insomnia linked to mortality risk
2013-11-20
Insomnia linked to mortality risk
Researchers associate some insomnia symptoms with higher mortality risk in men
Boston, MA - Insomnia, the most common sleep disorder, affects up to one-third of the population in the United States. In new findings, ...
Reducing the salt in bread without losing saltiness, thanks to a texture trick
2013-11-20
Reducing the salt in bread without losing saltiness, thanks to a texture trick
Want to make bread taste pleasantly salty without adding more salt? Change the bread's texture so it is less dense, say scientists. They report in ACS' Journal of Agricultural ...
Introducing solid foods while continuing to breast feed could prevent child allergies
2013-11-20
Introducing solid foods while continuing to breast feed could prevent child allergies
Introducing solid food with breast milk after the 17th week of birth could reduce food allergies in babies, according to University of Southampton research.
The research, ...
Hormone therapy could enhance the therapeutic effect of head and facial bone grafts
2013-11-20
Hormone therapy could enhance the therapeutic effect of head and facial bone grafts
Bone grafts, which are used to treat head injuries and birth defects, still pose major medical challenges, but scientists are reporting progress toward a new hormone therapy ...
Dismantling Syria's chemical weapons in the midst of war
2013-11-20
Dismantling Syria's chemical weapons in the midst of war
Syria no longer has the capacity to produce new chemical weapons en masse, but arms control experts caution that what remains is the more difficult job of destroying the existing stockpile in the midst ...
EORTC head & neck cancer trial shows assessing HRQOL is valuable to both patients and their doctors
2013-11-20
EORTC head & neck cancer trial shows assessing HRQOL is valuable to both patients and their doctors
In Europe in 2012, there were an estimated 39,900 new cases of laryngeal cancer and 99,600 new cases of oral cavity and pharyngeal cancers (Feraly ...
New research gives clues of antibiotic use and resistance in US children's hospitals
2013-11-20
New research gives clues of antibiotic use and resistance in US children's hospitals
Findings coincide with CDC's Get Smart Week
CHICAGO (November 20, 2013) – Two studies published in the December issue of Infection Control and Hospital Epidemiology ...
Study finds differences in brains of children with nonverbal learning disability
2013-11-20
Study finds differences in brains of children with nonverbal learning disability
EAST LANSING, Mich. — A Michigan State University researcher has discovered the first anatomical evidence that the brains of children with a nonverbal learning disability – long considered ...
LAST 30 PRESS RELEASES:
Thirty-year mystery of dissonance in the “ringing” of black holes explained
Less intensive works best for agricultural soil
Arctic rivers project receives “national champion” designation from frontiers foundation
Computational biology paves the way for new ALS tests
Study offers new hope for babies born with opioid withdrawal syndrome
UT, Volkswagen Group of America celebrate research partnership
New Medicare program could dramatically improve affordability for cancer drugs – if patients enroll
Are ‘zombie’ skin cells harmful or helpful? The answer may be in their shapes
University of Cincinnati Cancer Center presents research at AACR 2025
Head and neck, breast, lung and survivorship studies headline Dana-Farber research at AACR Annual Meeting 2025
AACR: Researchers share promising results from MD Anderson clinical trials
New research explains why our waistlines expand in middle age
Advancements in muon detection: Taishan Antineutrino Observatory's innovative top veto tracker
Chips off the old block
Microvascular decompression combined with nerve combing for atypical trigeminal neuralgia
Cutting the complexity from digital carpentry
Lung immune cell type “quietly” controls inflammation in COVID-19
Fiscal impact of expanded Medicare coverage for GLP-1 receptor agonists to treat obesity
State and sociodemographic trends in US cigarette smoking with future projections
Young adults drive historic decline in smoking
NFCR congratulates Dr. Robert C. Bast, Jr. on receiving the AACR-Daniel D. Von Hoff Award for Outstanding Contributions to Education and Training in Cancer Research
Chimpanzee stem cells offer new insights into early embryonic development
This injected protein-like polymer helps tissues heal after a heart attack
FlexTech inaugural issue launches, pioneering interdisciplinary innovation in flexible technology
In Down syndrome mice, 40Hz light and sound improve cognition, neurogenesis, connectivity
Methyl eugenol: potential to inhibit oxidative stress, address related diseases, and its toxicological effects
A vascularized multilayer chip reveals shear stress-induced angiogenesis in diverse fluid conditions
AI helps unravel a cause of Alzheimer's disease and identify a therapeutic candidate
Coalition of Autism Scientists critiques US Department of Health and Human Services Autism Research Initiative
Structure dictates effectiveness, safety in nanomedicine
[Press-News.org] Carnegie Mellon computer searches web 24/7 to analyze images and teach itself common senseNEIL program labels images, learns associations with minimal help from people