PRESS-NEWS.org - Press Release Distribution
PRESS RELEASES DISTRIBUTION

Software may be able to take over from hardware in managing caches

MIT research shows that it may be time to let software, rather than hardware, manage the high-speed on-chip memory banks known as 'caches'

2013-09-13
(Press-News.org) CAMBRIDGE, Mass-- In today's computers, moving data to and from main memory consumes so much time and energy that microprocessors have their own small, high-speed memory banks, known as "caches," which store frequently used data. Traditionally, managing the caches has required fairly simple algorithms that can be hard-wired into the chips.

In the 21st century, however, in order to meet consumers' expectations for steadily increasing computational power, chipmakers have had to begin equipping their chips with more and more cores, or processing units. And as cores proliferate, cache management becomes much more difficult.

Daniel Sanchez, an assistant professor in MIT's Department of Electrical Engineering and Computer Science, believes that it's time to turn cache management over to software. This week, at the International Conference on Parallel Architectures and Compilation Techniques, Sanchez and his student Nathan Beckmann presented a new system, dubbed Jigsaw, that monitors the computations being performed by a multicore chip and manages cache memory accordingly.

In experiments simulating the execution of hundreds of applications on 16- and 64-core chips, Sanchez and Beckmann found that Jigsaw could speed up execution by an average of 18 percent — with more than twofold improvements in some cases — while actually reducing energy consumption by as much as 72 percent. And Sanchez believes that the performance improvements offered by Jigsaw should only increase as the number of cores does.

Location, location, location

In most multicore chips, each core has several small, private caches. But there's also what's known as a last-level cache, which is shared by all the cores. "That cache is on the order of 40 to 60 percent of the chip," Sanchez says. "It is a significant fraction of the area because it's so crucial to performance. If we didn't have that cache, some applications would be an order of magnitude slower."

Physically, the last-level cache is broken into separate memory banks and distributed across the chip; for any given core, accessing the nearest bank takes less time and consumes less energy than accessing those farther away. But because the last-level cache is shared by all the cores, most chips assign data to the banks randomly.

Jigsaw, by contrast, monitors which cores are accessing which data most frequently and, on the fly, calculates the most efficient assignment of data to cache banks. For instance, data being used exclusively by a single core is stored near that core, whereas data that all the cores are accessing with equal frequency is stored near the center of the chip, minimizing the average distance it has to travel.

Jigsaw also varies the amount of cache space allocated to each type of data, depending on how it's accessed. Data that is reused frequently receives more space than data that is accessed infrequently or only once.

In principle, optimizing cache space allocations requires evaluating how the chip as a whole will perform given every possible allocation of cache space to all the computations being performed on all the cores. That calculation would be prohibitively time-consuming, but by ignoring some particularly convoluted scenarios that are extremely unlikely to arise in practice, Sanchez and Beckmann were able to develop an approximate optimization algorithm that runs efficiently even as the number of cores and the different types of data increases dramatically.

Quick study

Of course, since the optimization is based on Jigsaw's observations of the chip's activity, "it's the optimal thing to do assuming that the programs will behave in the next 20 milliseconds the way they did in the last 20 milliseconds," Sanchez says. "But there's very strong experimental evidence that programs typically have stable phases of hundreds of milliseconds, or even seconds."

Sanchez also points out that the new paper represents simply his group's "first cut" at turning cache management over to software. Going forward, they will be investigating, among other things, the co-design of hardware and software to improve efficiency even further and the possibility of allowing programmers themselves to classify data according to their memory-access patterns, so that Jigsaw doesn't have to rely entirely on observation to evaluate memory allocation.

### Written by Larry Hardesty, MIT News Office


ELSE PRESS RELEASES FROM THIS DATE:

NASA satellite sees 2 vortices circling newborn Tropical Storm Man-yi's center

2013-09-13
NASA's Terra satellite passed over newborn Tropical Storm Man-yi and captured and image that clearly showed two vortices rotating around a large center of circulation. Man-yi formed on Sept. 12 in the northwestern Pacific Ocean as the sixteenth tropical depression and by Sept. 13 it strengthened into a tropical storm. When NASA's Terra satellite passed over newborn Tropical Storm Man-yi in the northwestern Pacific Ocean on Sept. 13 at 01:15 UTC, the Moderate Resolution Imaging Spectroradiometer or MODIS instrument captured a visible image of the storm. The MODIS image ...

Catalysts team up with textiles

2013-09-13
This news release is available in German. In future, it will be much easier to produce some active pharmaceutical substances and chemical compounds than was the case to date. An international team working with chemists from the Max-Planck-Institut für Kohlenforschung in Mülheim an der Ruhr have immobilised various catalysts on nylon in a very simple way. Catalysts mediate between the reagents in a chemical reaction and control the process leading to the desired end product. When textile material is used as a support for the chemical auxiliaries, the reaction can ...

NIH clinical study establishes human model of influenza pathogenesis

2013-09-13
WHAT: A National Institutes of Health (NIH) clinical study of healthy adult volunteers who consented to be infected with the 2009 H1N1 influenza virus under carefully controlled conditions has provided researchers with concrete information about the minimum dose of virus needed to produce mild-to-moderate illness. The study also gives a clearer picture of how much time elapses between a known time of infection, the start of viral shedding (a signal of contagiousness), the development of an immune response, and the onset and duration of influenza symptoms. The data obtained ...

The '50-50' chip: Memory device of the future?

2013-09-13
WASHINGTON, D.C. Sept. 13, 2013 -- A new, environmentally-friendly electronic alloy consisting of 50 aluminum atoms bound to 50 atoms of antimony may be promising for building next-generation "phase-change" memory devices, which may be the data-storage technology of the future, according to a new paper published in the journal Applied Physics Letters, which is produced by AIP Publishing. Phase-change memory is being actively pursued as an alternative to the ubiquitous flash memory for data storage applications, because flash memory is limited in its storage density and ...

NASA sees southwesterly wind shear weakened hurricane Humberto

2013-09-13
Southwesterly wind shear has taken its toll on hurricane Humberto, and NASA's TRMM satellite noticed that in rainfall data. When NASA's Tropical Rainfall Measuring Mission or TRMM satellite passed over Hurricane Humberto on September 12, 2013 at 1625 UTC/12:25 p.m. EDT the eye was no longer visible. An analysis derived from TRMM Microwave Imager (TMI) and Precipitation Radar (PR) data showed that most of the precipitation with Humberto was located in the northwestern quadrant, pushed there by the strong southwesterly wind shear. TRMM found that the most intense rain ...

To touch the microcosmos

2013-09-13
WASHINGTON, D.C. Sept. 13, 2013 -- What if you could reach through a microscope to touch and feel the microscopic structures under the lens? In a breakthrough that may usher in a new era in the exploration of the worlds that are a million times smaller than human beings, researchers at Université Pierre et Marie Curie in France have unveiled a new technique that allows microscope users to manipulate samples using a technology known as "haptic optical tweezers." Featured in the journal Review of Scientific Instruments, which is produced by AIP Publishing, the new technique ...

Diets low in polyunsaturated fatty acids may be a problem for youngsters

2013-09-13
In the first study to closely examine the polyunsaturated fatty acid (PUFA) intake among U.S. children under the age of 5, Sarah Keim, PhD, principal investigator in the Center for Biobehavioral Health at The Research Institute at Nationwide Children's Hospital, has found what might be a troubling deficit in the diet of many youngsters. The study, published online today by Maternal and Child Nutrition, used data on nearly 2500 children age 12 to 60 months from the U.S. National Health and Nutrition Examination Survey. PUFAs are essential to human health. A proper ratio ...

Immune to aging

2013-09-13
This news release is available in German. While ageing remains an inevitable fact of life, Max Planck researchers have discovered a microbe that stays forever young by rejuvenating every time it reproduces. The findings, published in Current Biology, provide fundamental insights into the mechanisms of aging. In general, even symmetrically dividing microbes do not split into two exactly identical halves. Detailed investigations revealed that there are mechanisms in place that ensure that one half receives older, often defective, cell material, whereas the other ...

Novelty of eco-friendly bamboo garments lures consumers -- if the price is right, Baylor study shows

2013-09-13
Consumers who plan to buy eco-friendly bamboo apparel are attracted if the price is right, but their next consideration is the novelty of the product, according to a new study by Baylor University researchers. Bamboo has been championed by many as friendly to the environment, although the Federal Trade Commission issued a 2009 consumer alert noting that some pollutants are released in production from bamboo stalks. When it comes to product consumption in general, consumers are influenced by emotion, price, functionality, social image and curiosity, said lead researcher ...

UNC research points to promising treatment for macular degeneration

2013-09-13
CHAPEL HILL, N.C. – Researchers at the University of North Carolina School of Medicine have published new findings in the hunt for a better treatment for macular degeneration. In studies using mice, a class of drugs known as MDM2 inhibitors proved highly effective at regressing the abnormal blood vessels responsible for the vision loss associated with the disease. "We believe we may have found an optimized treatment for macular degeneration," said senior study author Sai Chavala, MD, director of the Laboratory for Retinal Rehabilitation and assistant professor of Ophthalmology ...

LAST 30 PRESS RELEASES:

New take on immunotherapy reinvigorates T cells by blocking uptake of energy-sapping cancer byproducts

How much climate change is in the weather?

Flagship AI-ready dataset released in type 2 diabetes study

Shaking it up: An innovative method for culturing microbes in static liquid medium

Greener and cleaner: Yeast-green algae mix improves water treatment

Acquired immune thrombotic thrombocytopenic purpura (TTP) associated with inactivated COVID-19 vaccine CoronaVac

CIDEC as a novel player in abdominal aortic aneurysm formation

Artificial intelligence: a double-edged sword for the environment?

Current test accommodations for students with blindness do not fully address their needs

Wide-incident-angle wideband radio-wave absorbers boost 5G and beyond 5G applications

A graph transformer with boundary-aware attention for semantic segmentation

C-Path announces key leadership appointments in neurodegenerative disease research

First-of-its-kind analysis of U.S. national data reveals significant disparities in individual well-being as measured by lifespan, education, and income

Exercise programs help cut new mums’ ‘baby blues’ severity and major depression risk

Gut microbiome changes linked to onset of clinically evident rheumatoid arthritis

Signals from the gut could transform rheumatoid arthritis treatment

Pioneering research reveals some of the world’s least polluting populations are at much greater risk of flooding fuelled by climate change

UK’s health data should be recognized as critical national infrastructure, says independent review

A 36-gene predictive score of anti-cancer drug resistance anticipates cancer therapy outcomes

Someone flirts with your spouse. Does that make your partner appear more attractive?

Hourglass-shaped stent could ease severe chest pain from microvascular disease

United Nations ratifies framework to protect people on cash app

Oklahoma State basketball team joins the Nation of Lifesavers

Power of aesthetic species on social media boosts wildlife conservation efforts, say experts

Researchers develop robotic sensory cilia that monitor internal biomarkers to detect and assess airway diseases

Could crowdsourcing hold the key to early wildfire detection?

Reconstruction of historical seasonal influenza patterns and individual lifetime infection histories in humans based on antibody profiles

New study traces impact of COVID-19 pandemic on global movement and evolution of seasonal flu

Presenting a Janus channel of membranes for complete oil-and-water separation

COVID-19 restrictions altered global dispersal of influenza viruses

[Press-News.org] Software may be able to take over from hardware in managing caches
MIT research shows that it may be time to let software, rather than hardware, manage the high-speed on-chip memory banks known as 'caches'