(Press-News.org) Researchers at New York University's Courant Institute of Mathematical Sciences have adopted an innovative data collection method for their latest work in the area of computer vision—a music video created by the Dutch progressive-electro band C-Mon & Kypski. Individual frames from the band's recent video for its song "More is Less" served as a unique visual database for the Courant researchers' work to develop computer vision technology.
Computer vision, a developing technology, aims to give eyesight to machines and is currently used in a range of applications. These include Microsoft's Kinect, which detects poses in order for game play to be controlled using only the body, and cell-phone technology that allows users to cash checks by merely snapping a picture.
However, for computer vision to truly mimic the human vision system, it must be able to reliably detect specific objects or individuals under a variety of conditions—poor lighting, cluttered backgrounds, unusual clothing, and other sources of variation. In building such a system, developers have sought to implement an algorithm to perform "pose estimation"—computer recognition of individuals or objects based on their positioning. However, in order for a computer to succeed at pose estimation it must draw from a large database of people or objects in a variety of poses—after detecting a certain pose in its field of vision, it draws on its vast database of images to find a match.
"If we had many examples of people in similar pose, but under differing conditions, we could construct an algorithm that matches based on pose and ignores the distracting information—lighting, clothing, and background," explained Graham Taylor, a post-doctoral fellow at the Courant Institute and one of the project's researchers. "But how do we collect such data?"
Departing from traditional data-collection methods, the team turned to Dutch progressive-electro band C-Mon & Kypski and, specifically, its video crowd-sourcing project--"One Frame of Fame" (http://oneframeoffame.com/)--which asks fans to replace one frame of the band's music video for the song "More or Less" with a capture from their webcams. In the project, a visitor to the band's website is shown a single frame of the video and asked to perform an imitation in front of the camera. The new contribution is spliced into the video that updates once an hour.
"This turned out to be the perfect data source for developing an algorithm that learns to compute similarity based on pose," explained Taylor, who obtained his doctorate in computer science from the University of Toronto. "Armed with the band's data and a few machine learning tricks up our sleeves, we built a system that is highly effective at matching people in similar pose but under widely different settings."
###
The research team, which also includes NYU doctoral student Ian Spiro as well as Courant Professors Chris Bregler and Rob Fergus, will present its findings in at the 24th IEEE Conference on Computer Vision and Pattern Recognition (June 21-23) in Colorado Springs. The paper is available here: http://movement.nyu.edu/imitation.
NYU researchers use innovative data collection method -- A video by Dutch band C-Mon & Kypski
2011-05-18
ELSE PRESS RELEASES FROM THIS DATE:
Research questions reality of 'supersolid' in helium-4
2011-05-18
LOS ALAMOS, New Mexico, May 17, 2011—The long-held, but unproven idea that helium-4 enters into an exotic phase of matter dubbed a "supersolid" when cooled to extremely low temperatures has been challenged in a new paper published recently in Science.
Los Alamos National Laboratory researchers Alexander Balatsky and Matthias Graf joined Cornell University physicist J.C. Séamus Davis and others in describing an alternative explanation for behavior of helium-4 that led scientist to believe for nearly 40 years that the substance could hold properties of a liquid and solid ...
UCSB scientists track environmental influences on giant kelp with help from satellite data
2011-05-18
(Santa Barbara, Calif.) –– Scientists at UC Santa Barbara have developed new methods for studying how environmental factors and climate affect giant kelp forest ecosystems at unprecedented spatial and temporal scales.
The scientists merged data collected underwater by UCSB divers with satellite images of giant kelp canopies taken by the Landsat 5 Thematic Mapper. The findings are published in the feature article of the May 16 issue of Marine Ecology Progress Series.
In this marriage of marine ecology and satellite mapping, the team of UCSB scientists tracked the dynamics ...
Study shows pharmacies' software systems miss potentially dangerous interactions
2011-05-18
TUCSON, Ariz. – A study conducted at the University of Arizona College of Pharmacy found that only 28 percent of pharmacies' clinical decision support software systems – the computer programs that are in place to alert pharmacists to possible medication problems – correctly identified potentially dangerous drug-drug interactions.
The study was conducted at 64 pharmacies across Arizona. Members of the research team tested the pharmacy software using a set of prescription orders for a standardized fictitious patient. The prescriptions consisted of 18 different medications ...
Rigorous study confirms video game playing increases food intake in teens
2011-05-18
The US Centers for Disease Control and Prevention estimates that almost 18% of US teens are obese. Although most experts agree that our growing obesity "epidemic" is driven by both inadequate physical activity and excessive caloric intake, implementing solutions is extraordinarily difficult. One area that has caught the attention of health researchers is the observation that trends in video game playing parallel obesity rates on a population basis. Furthermore, several studies have documented a positive association between how much time a child plays video games and his ...
Researchers discover underlying mechanisms of skin hardening syndromes
2011-05-18
(Boston) - Researchers from Boston University School of Medicine (BUSM) have discovered new details about the underlying mechanisms of skin hardening syndromes. The team connected pharmacological properties of the Novartis Pharma AG drug called balicatib to the skin disorder for the first time after investigating adverse reactions suffered by patients participating in a clinical trial for the treatment of osteoporosis. These findings appear online in the Journal of the American Academy of Dermatology.
Balicatib was developed recently as an osteoporosis drug that can inhibit ...
Why more African Americans turn to Twitter
2011-05-18
EVANSTON, Ill. --- It doesn't matter if you're black or white. If you're interested in celebrity and entertainment news, you're more likely to start using Twitter, according to a new Northwestern University study.
But, African Americans in general report more interest in celebrity and entertainment news and were found to be more likely than whites to start using Twitter. The research, which focused on first-year college students attending the University of Illinois at Chicago (UIC), found 37 percent of black students were using Twitter in 2010 compared to 21 percent ...
Cockroach allergens in homes associated with prevalence of childhood asthma in some neighborhoods
2011-05-18
May 17, 2011 -- In New York City, the prevalence of asthma among children entering school varies by neighborhood anywhere from 3% to 19%, and children growing up within walking distance of each other can have 2-3 fold differences in risk for having asthma. In the first comprehensive effort to understand what drives these localized differences, researchers at Columbia University's Mailman School of Public Health compared the household presence of cockroach, mouse, cat, dust mite and other allergens in neighborhoods with a high prevalence of asthma to that in low-prevalence ...
Experimental treatment offers relief from painful prostate condition
2011-05-18
New findings show that treatment with a specific alpha blocker helps reduce symptoms and improve quality of life for men with chronic prostatitis/chronic pelvic pain syndrome (CP/CPPS).
The alpha-blocker, known as silodosin, works by selectively relaxing the muscles in the bladder neck and prostate. The treatment is already approved in Canada, the United States, the EU and Japan to treat painful symptoms of another prostate gland condition, benign prostatic hyperplasia, commonly referred to as an enlarged prostate.
Despite being the most common form of prostatitis, ...
Sharpening the nanofocus
2011-05-18
Such highly coveted technical capabilities as the observation of single catalytic processes in nanoreactors, or the optical detection of low concentrations of biochemical agents and gases are an important step closer to fruition. Researchers with the U.S. Department of Energy (DOE)'s Lawrence Berkeley National Laboratory (Berkeley Lab), in collaboration with researchers at the University of Stuttgart in Germany, report the first experimental demonstration of antenna-enhanced gas sensing at the single particle level. By placing a palladium nanoparticle on the focusing tip ...
Greenhouse ocean study offers warning for future
2011-05-18
The mass extinction of marine life in our oceans during prehistoric times is a warning that the Earth will see such an extinction again because of high levels of greenhouse gases, according to new research by geologists.
Professor Martin Kennedy from the University of Adelaide (School of Earth & Environmental Sciences) and Professor Thomas Wagner from Newcastle University (Civil Engineering and Geosciences) have been studying 'greenhouse oceans' – oceans that have been depleted of oxygen and suffered from increases in carbon dioxide and temperature.
Using core samples ...