(Press-News.org) CAMBRIDGE, Mass. — Your smartphone snapshots could be instantly converted into professional-looking photographs with just the touch of a button, thanks to a processor chip developed at MIT.
The chip, built by a team at MIT's Microsystems Technology Laboratory, can perform tasks such as creating more realistic or enhanced lighting in a shot without destroying the scene's ambience, in just a fraction of a second. The technology could be integrated with any smartphone, tablet computer or digital camera.
Existing computational photography systems tend to be software applications that are installed onto cameras and smartphones. However, such systems consume substantial power, take a considerable amount of time to run, and require a fair amount of knowledge on the part of the user, says the paper's lead author, Rahul Rithe, a graduate student in MIT's Department of Electrical Engineering and Computer Science.
"We wanted to build a single chip that could perform multiple operations, consume significantly less power compared to doing the same job in software, and do it all in real time," Rithe says. He developed the chip with Anantha Chandrakasan, the Joseph F. and Nancy P. Keithley Professor of Electrical Engineering, fellow graduate student Priyanka Raina, research scientist Nathan Ickes and undergraduate Srikanth Tenneti.
One such task, known as High Dynamic Range (HDR) imaging, is designed to compensate for limitations on the range of brightness that can be recorded by existing digital cameras, to capture pictures that more accurately reflect the way we perceive the same scenes with our own eyes.
To do this, the chip's processor automatically takes three separate "low dynamic range" images with the camera: a normally exposed image, an overexposed image capturing details in the dark areas of the scene, and an underexposed image capturing details in the bright areas. It then merges them to create one image capturing the entire range of brightness in the scene, Rithe says.
Software-based systems typically take several seconds to perform this operation, while the chip can do it in a few hundred milliseconds on a 10-megapixel image. This means it is even fast enough to apply to video, Ickes says. The chip consumes dramatically less power than existing CPUs and GPUs while performing the operation, he adds.
Another task the chip can carry out is to enhance the lighting in a darkened scene more realistically than conventional flash photography. "Typically when taking pictures in a low-light situation, if we don't use flash on the camera we get images that are pretty dark and noisy, and if we do use the flash we get bright images but with harsh lighting, and the ambience created by the natural lighting in the room is lost," Rithe says.
So in this instance the processor takes two images, one with a flash and one without. It then splits both into a base layer, containing just the large-scale features within the shot, and a detailed layer. Finally, it merges the two images, preserving the natural ambience from the base layer of the nonflash shot, while extracting the details from the picture taken with the flash.
To remove unwanted features from the image, such as noise — the unexpected variations in color or brightness created by digital cameras — the system blurs any undesired pixel with its surrounding neighbors, so that it matches those around it. In conventional filtering, however, this means even those pixels at the edges of objects are also blurred, which results in a less detailed image.
But by using what is called a bilateral filter, the researchers are able to preserve these outlines, Rithe says. That is because bilateral filters will only blur pixels with their neighbors if they have been assigned a similar brightness value. Since any objects within the image are likely to have a very different level of brightness than that of their background, this prevents the system from blurring across any edges, he says.
To perform each of these tasks, the chip's processing unit uses a method of organizing and storing data called a bilateral grid. The image is first divided into smaller blocks. For each block, a histogram is then created. This results in a 3-D representation of the image, with the x and y axes representing the position of the block, and the brightness histogram representing the third dimension.
This makes it easy for the filter to avoid blurring across edges, since pixels with different brightness levels are separated in this third axis in the grid structure, no matter how close together they are in the image itself.
The algorithms implemented on the chip are inspired by the computational photography work of associate professor of computer science and engineering Fredo Durand and Bill Freeman, a professor of computer science and engineering in MIT's Computer Science and Artificial Intelligence Laboratory. With the aid of Taiwanese semiconductor manufacturer TSMC's University Shuttle Program, the researchers have already built a working prototype of the chip using 40-nanometer CMOS technology, and integrated it into a camera and display. They will be presenting their chip at the International Solid-State Circuits Conference in San Francisco in February.
###
The work was funded by the Foxconn Technology Group, based in Taiwan.
Written by: Helen Knight, MIT News correspondent
The poor growth seen in children born with complex heart defects may result from factors beyond deficient nutrition. A new study by pediatric researchers suggests that abnormalities in overall growth regulation play a role.
"When compared with their healthy peers, children with congenital heart disease have impaired growth, as measured in weight, length, and head circumference," said senior author Meryl S. Cohen, M.D., a pediatric cardiologist in the Cardiac Center at The Children's Hospital of Philadelphia. "We investigated patterns of poor growth in these children, ...
URBANA – A University of Illinois study has established a possible link between high-fat diets and such childhood brain-based conditions as attention deficit hyperactivity disorder (ADHD) and memory-dependent learning disabilities.
"We found that a high-fat diet rapidly affected dopamine metabolism in the brains of juvenile mice, triggering anxious behaviors and learning deficiencies. Interestingly, when methylphenidate (Ritalin) was administered, the learning and memory problems went away," said Gregory Freund, a professor in the U of I College of Medicine and a member ...
Philadelphia, Pa. (February 19, 2013) - For patients with spinal stenosis, epidural steroid injections (ESI) may actually lead to worse outcomes—whether or not the patient later undergoes surgery, according to a study in the February 15 issue of Spine. The journal is published by Lippincott Williams & Wilkins, a part of Wolters Kluwer Health.
The study raises questions about the benefits of steroid injection—a widely used treatment for the common problem of spinal stenosis in the lower (lumbar) spine. "There was no improvement in outcome with ESI whether patients were ...
WINSTON-SALEM, N.C. – Feb. 19, 2013 – A new study from Wake Forest Baptist Medical Center shows that an increase in fat throughout the thigh is predictive of mobility loss in otherwise healthy older adults.
Lead author Kristen Beavers, Ph.D., and colleagues at Wake Forest Baptist said the findings suggest that prevention of age-related declines in walking speed isn't just about preserving muscle mass, it's also about preventing fat gain.
Walking speed declines with age, said Beavers, and in older adults slower walking speed is a predictor of disability, nursing home ...
Philadelphia, Pa. (February 19, 2013) - Follow-up data on patients with degenerative disease of the upper (cervical) spinal vertebrae show little or no evidence of worsening degeneration over time, according to a study in the February 15 issue of Spine. The journal is published by Lippincott Williams & Wilkins, a part of Wolters Kluwer Health.
For many patients with "unstable" cervical degenerative spondylolisthesis, observation may be a better choice than surgery, according to the new research by Dr Moon Soo Park and colleagues of Medical College of Hallym University, ...
Amsterdam, NL, 19 February 2013 – Raman spectroscopy has enabled incredible advances in numerous scientific fields and is a powerful tool for tissue classification and disease recognition, although there have been considerable challenges to using the method in a clinical setting. Scientists have now demonstrated the advantages of wavelength-modulated Raman spectroscopy, opening the door to wider biomedical and clinical applications such as real-time assessment of tissues during surgery. This study is published in Biomedical Spectroscopy and Imaging.
The inelastic scattering ...
Males and females differ in a lot of traits (besides the obvious ones) and some evolutionary psychologists have proposed hypotheses to explain why. Some argue, for example, that males' slight, but significant, superiority in spatial navigation over females – a phenomenon demonstrated repeatedly in many species, including humans – is probably "adaptive," meaning that over the course of evolutionary history the trait gave males an advantage that led them to have more offspring than their peers.
A new analysis published in The Quarterly Review of Biology found no support ...
The most frequent turning point in father-daughter relationships is shared activity — especially sports — ahead of such pivotal events as when a daughter marries or leaves home, according to a study by Baylor University researchers.
"This is the masculine style of building closeness — called 'closeness in the doing' – whereas the feminine orientation is talking, 'closeness in the dialogue,'" said Mark T. Morman, Ph.D., a professor of communication in Baylor's College of Arts & Sciences. An article about the findings by Morman and former Baylor graduate student Elizabeth ...
CAMBRIDGE, Mass. — In the search for renewable alternatives to gasoline, heavy alcohols such as isobutanol are promising candidates. Not only do they contain more energy than ethanol, but they are also more compatible with existing gasoline-based infrastructure. For isobutanol to become practical, however, scientists need a way to reliably produce huge quantities of it from renewable sources.
MIT chemical engineers and biologists have now devised a way to dramatically boost isobutanol production in yeast, which naturally make it in small amounts. They engineered yeast ...
It is well known that horses show symptoms of stress when ridden but relatively little attention has been paid to the effects on their riders. This is surprising, as equestrian sports rely on the close cooperation between the animals and their riders. How does the horse-rider team cope with the stress involved in competing in an equestrian event?
The issue has now been studied by Mareike von Lewinski in the group of Christine Aurich at the University of Veterinary Medicine, Vienna (Vetmeduni Vienna), together with colleagues at the Vetmeduni Vienna and at the Ecole ...
