PRESS-NEWS.org - Press Release Distribution
PRESS RELEASES DISTRIBUTION

Better cache management could improve chip performance, cut energy use

2014-02-19
(Press-News.org) Computer chips keep getting faster because transistors keep getting smaller. But the chips themselves are as big as ever, so data moving around the chip, and between chips and main memory, has to travel just as far. As transistors get faster, the cost of moving data becomes, proportionally, a more severe limitation.

So far, chip designers have circumvented that limitation through the use of "caches" — small memory banks close to processors that store frequently used data. But the number of processors — or "cores" — per chip is also increasing, which makes cache management more difficult. Moreover, as cores proliferate, they have to share data more frequently, so the communication network connecting the cores becomes the site of more frequent logjams, as well.

In a pair of recent papers, researchers at MIT and the University of Connecticut have developed a set of new caching strategies for massively multicore chips that, in simulations, significantly improved chip performance while actually reducing energy consumption.

The first paper, presented at the most recent ACM/IEEE International Symposium on Computer Architecture, reported average gains of 15 percent in execution time and energy savings of 25 percent. The second paper, which describes a complementary set of caching strategies and will be presented at the IEEE International Symposium on High Performance Computer Architecture, reports gains of 6 percent and 13 percent, respectively.

The caches on multicore chips are typically arranged in a hierarchy. Each core has its own private cache, which may itself have several levels, while all the cores share the so-called last-level cache, or LLC.

Chips' caching protocols usually adhere to the simple but surprisingly effective principle of "spatiotemporal locality." Temporal locality means that if a core requests a particular piece of data, it will probably request it again. Spatial locality means that if a core requests a particular piece of data, it will probably request other data stored near it in main memory.

So every requested data item gets stored, along with those immediately adjacent to it, in the private cache. If it falls idle, it will eventually be squeezed out by more recently requested data, falling down through the hierarchy — from the private cache to the LLC to main memory — until it's requested again.

Different strokes

There are cases in which the principle of spatiotemporal locality breaks down, however. "An application works on a few, let's say, kilobytes or megabytes of data for a long period of time, and that's the working set," says George Kurian, a graduate student in MIT's Department of Electrical Engineering and Computer Science and lead author on both papers. "One scenario where an application does not exhibit good spatiotemporal locality is where the working set exceeds the private-cache capacity." In that case, Kurian explains, the chip could waste a lot of time cyclically swapping the same data between different levels of the cache hierarchy.

In the paper presented last year, Kurian; his advisor Srini Devadas, the Edwin Sibley Webster Professor of Electrical Engineering and Computer Science at MIT; and Omer Khan, an assistant professor of electrical and computer engineering at the University of Connecticut and a former postdoc in Devadas' lab, presented a hardware design that mitigates that problem. When an application's working set exceeds the private-cache capacity, the MIT researchers' chip would simply split it up between the private cache and the LLC. Data stored in either place would stay put, no matter how recently it's been requested, preventing a lot of fruitless swapping.

Conversely, if two cores working on the same data are constantly communicating in order to keep their cached copies consistent, the chip would store the shared data at a single location in the LLC. The cores would then take turns accessing the data, rather than clogging the network with updates.

The new paper examines the case where, to the contrary, two cores are working on the same data but communicating only infrequently. The LLC is usually treated as a single large memory bank: Data stored in it is stored only once. But physically, it's distributed across the chip in discrete chunks. Kurian, Devadas, and Khan have developed a second circuit that can treat these chunks, in effect, as extensions of the private cache. If two cores are working on the same data, each will receive its own copy in a nearby chunk of the LLC, enabling much faster data access.

Sentry box

The systems presented in both papers require active monitoring of the chips' operation — to determine, for instance, when working sets exceed some bound, or when multiple cores are accessing the same data. In each case, that monitoring requires a little extra circuitry, the equivalent of about 5 percent of the area of the LLC. But, Kurian argues, because transistors keep shrinking, and communication isn't keeping up, chip space is not as crucial a concern as minimizing data transfer. Kurian, Devadas, and Khan are also currently working to combine the two monitoring circuits, so that a single chip could deploy the cache-management strategies reported in both papers.

INFORMATION: Written by Larry Hardesty, MIT News Office


ELSE PRESS RELEASES FROM THIS DATE:

When faced with a hard decision, people tend to blame fate

2014-02-19
Life is full of decisions. Some, like what to eat for breakfast, are relatively easy. Others, like whether to move cities for a new job, are quite a bit more difficult. Difficult decisions tend to make us feel stressed and uncomfortable – we don't want to feel responsible if the outcome is less than desirable. New research suggests that we deal with such difficult decisions by shifting responsibility for the decision to fate. The findings are published in Psychological Science, a journal of the Association for Psychological Science. "Fate is a ubiquitous supernatural ...

UK failing to harness its bioenergy potential

2014-02-19
The UK could generate almost half its energy needs from biomass sources, including household waste, agricultural residues and home-grown biofuels by 2050, new research suggests. Scientists from the Tyndall Centre for Climate Change Research at The University of Manchester found that the UK could produce up to 44% of its energy by these means without the need to import. The study, published in Energy Policy journal, highlights the country's potential abundance of biomass resources that are currently underutilised and totally overlooked by the bioenergy sector. Instead, ...

Making nanoelectronics last longer for medical devices, 'cyborgs'

2014-02-19
The debut of cyborgs who are part human and part machine may be a long way off, but researchers say they now may be getting closer. In a study published in ACS' journal Nano Letters, they report development of a coating that makes nanoelectronics much more stable in conditions mimicking those in the human body. The advance could also aid in the development of very small implanted medical devices for monitoring health and disease. Charles Lieber and colleagues note that nanoelectronic devices with nanowire components have unique abilities to probe and interface with living ...

Gecko-inspired adhesion: Self-cleaning and reliable

Gecko-inspired adhesion: Self-cleaning and reliable
2014-02-19
This news release is available in German. Geckos outclass adhesive tapes in one respect: Even after repeated contact with dirt and dust do their feet perfectly adhere to smooth surfaces. Researchers of the KIT and the Carnegie Mellon University, Pittsburgh, have now developed the first adhesive tape that does not only adhere to a surface as reliably as the toes of a gecko, but also possesses similar self-cleaning properties. Using such a tape, food packagings or bandages might be opened and closed several times. The results are published in the "Interface" journal of ...

Chemical leak in W.Va. shows gaps in research, policy

2014-02-19
The chemical leak that contaminated drinking water in the Charleston, W.Va., area last month put in sharp relief the shortcomings of the policies and research that apply to thousands of chemicals in use today. An article in Chemical & Engineering News (C&EN), the weekly magazine of the American Chemical Society, delves into the details of the accident that forced 300,000 residents to live on bottled water for days. A team of C&EN reporters and editors note that the main chemical that leaked into the water supply is an obscure one called 4-methylcyclohexanemethanol, or ...

Advance in energy storage could speed up development of next-gen electronics

2014-02-19
Electronics are getting smaller all the time, but there's a limit to how tiny they can get with today's materials. Researchers now say, however, that they have developed a way to shrink capacitors — key components that store energy — even further, which could accelerate the development of more compact, high-performance next-gen devices. The study appears in the journal ACS Nano. Takayoshi Sasaki and colleagues point out that many recent improvements have already downsized capacitors significantly. But current technology has almost reached its limit in terms of materials ...

Genetics linked to children viewing high amounts of violent media

2014-02-19
Washington, DC (February 19 2014) – The lifelong debate of nature versus nurture continues—this time in what your children watch. A recent paper published in the Journal of Communication found that a specific variation of the serotonin-transporter gene was linked to children who engaged in increased viewing of violent TV and playing of violent video games. Sanne Nikkelen, Helen Vossen, and Patti Valkenburg of the University of Amsterdam's School of Communication Research, in collaboration with researchers at the Erasmus University Medical Centre in Rotterdam, analyzed ...

Special air filter blocks small particles called UFPs from getting inside cars

2014-02-19
While taking in the scenery during long road trips, passengers also may be taking in potentially harmful ultrafine particles (UFPs) that come into the car through outdoor air vents. Closing the vents reduces UFPs, but causes exhaled carbon dioxide to build up. Now, scientists report in the ACS journal Environmental Science & Technology that installing a newly developed high-efficiency cabin air filter (HECA) could reduce UFP exposure by 93 percent and keep carbon dioxide levels low. Yifang Zhu and Eon Lee explain that most modern cars come with cabin air filters, but ...

Kinetic battery chargers get a boost

2014-02-19
New technology to capture the kinetic energy of our everyday movements, such as walking, and to convert it into electrical energy has come a step closer thanks to research to be published in the International Journal Biomechatronics and Biomedical Robotics. Researchers have for many years attempted to harvest energy from our everyday movements to allow us to trickle charge electronic devices while we are walking without the need for expensive and cumbersome gadgets such as solar panels or hand-cranked chargers. Lightweight devices are limited in the voltage that they ...

A*STAR scientists discover protein's role in human memory and learning functions

2014-02-19
1. Scientists at A*STAR's Institute of Molecular and Cell Biology (IMCB) have identified the precise role of the protein, SNX27, in the pathway leading to memory and learning impairment. The study broadens the understanding of the brain's memory function and could be used to explain defects in the cognitive development of those with Down's syndrome. The newly established knowledge could potentially facilitate exploration of strategies to improve memory and learning abilities in Down's syndrome. 2. Down's syndrome is a genetic condition characterized by the presence ...

LAST 30 PRESS RELEASES:

Inability to pay for healthcare reaches record high in U.S.

Science ‘storytelling’ urgently needed amid climate and biodiversity crisis

KAIST Develops Retinal Therapy to Restore Lost Vision​

Adipocyte-hepatocyte signaling mechanism uncovered in endoplasmic reticulum stress response

Mammals were adapting from life in the trees to living on the ground before dinosaur-killing asteroid

Low LDL cholesterol levels linked to reduced risk of dementia

Thickening of the eye’s retina associated with greater risk and severity of postoperative delirium in older patients

Almost one in ten people surveyed report having been harmed by the NHS in the last three years

Enhancing light control with complex frequency excitations

New research finds novel drug target for acute myeloid leukemia, bringing hope for cancer patients

New insight into factors associated with a common disease among dogs and humans

Illuminating single atoms for sustainable propylene production

New study finds Rocky Mountain snow contamination

Study examines lactation in critically ill patients

UVA Engineering Dean Jennifer West earns AIMBE’s 2025 Pierre Galletti Award

Doubling down on metasurfaces

New Cedars-Sinai study shows how specialized diet can improve gut disorders

Making moves and hitting the breaks: Owl journeys surprise researchers in western Montana

PKU Scientists simulate the origin and evolution of the North Atlantic Oscillation

ICRAFT breakthrough: Unlocking A20’s dual role in cancer immunotherapy

How VR technology is changing the game for Alzheimer’s disease

A borrowed bacterial gene allowed some marine diatoms to live on a seaweed diet

Balance between two competing nerve proteins deters symptoms of autism in mice

Use of antifungals in agriculture may increase resistance in an infectious yeast

Awareness grows of cancer risk from alcohol consumption, survey finds

The experts that can outsmart optical illusions

Pregnancy may reduce long COVID risk

Scientists uncover novel immune mechanism in wheat tandem kinase

Three University of Virginia Engineering faculty elected as AAAS Fellows

Unintentional drug overdoses take a toll across the U.S. unequally, study finds

[Press-News.org] Better cache management could improve chip performance, cut energy use