(Press-News.org) Computer science researchers have turned to unlikely sources - including Enron - for assembling huge collections of spreadsheets that can be used to study how people use this software. The goal is for the data to facilitate research to make spreadsheets more useful.
"We study spreadsheets because spreadsheet software is used to track everything from corporate earnings to employee benefits, and even simple errors can cost organizations millions of dollars," says Emerson Murphy-Hill, an assistant professor of computer science at NC State and co-author of two new papers on the work.
However, there are relatively few public collections of spreadsheet data available for research purposes. For example, the collection currently used by most researchers consists of approximately 4,500 spreadsheets.
But researchers are now making two new collections available - one has 15,000 spreadsheets and the other has more than 249,000.
"In addition, we are publishing a technique that other researchers can use to collect additional spreadsheet data," Murphy-Hill says.
The 15,000 spreadsheet collection consists entirely of spreadsheets collected from internal Enron emails, which were made public after the emails were subpoenaed by prosecutors.
"Our focus is on how users interact with spreadsheets," Murphy-Hill says. "And these spreadsheets actually tell us a lot about how users represent and manipulate data."
To assemble the second set of spreadsheets, called Fuse, the researchers developed their own technique to identify and extract spreadsheets from an online archive of over 5 billion webpages. Using their technique, the researchers collected 249,376 spreadsheets - including spreadsheets made as recently as 2014.
"Fuse used cloud infrastructure to search through billions of webpages to identify and extract the spreadsheets we write about in this paper," says Titus Barik, a Ph.D. student at NC State, researcher at ABB Corporate Research, and lead author of the paper on Fuse. "Commodity cloud computing is incredibly exciting - searching those pages would take about seven years of continuous computation on a single computer, but the economies of scale with cloud computing allowed us to accomplish this with Fuse in only a few days."
"And the fact that Fuse includes recent spreadsheets is a significant advantage over other spreadsheet collections, because the information is more up-to-date and reflects changes in Excel and other spreadsheet software," Murphy-Hill says.
"Fuse is also more reproducible than other spreadsheet collections," says Kevin Lubick, a Ph.D. student at NC State and co-author of a paper about Fuse. "Reproducibility is the cornerstone of good scientific research, but many existing spreadsheet collections are difficult to reproduce. Our technique can be used by anyone, and they'll get the same results we get. But the results will also include any new spreadsheets made available since the last time the program was run."
INFORMATION:
The Enron collection is the subject of a paper called "Enron's Spreadsheets and Related Emails: A Dataset and Analysis," which is being presented at the International Conference on Software Engineering May 20-22 in Florence, Italy. Lead author of the paper is Felienne Hermans of Delft University of Technology. The Fuse paper, "Fuse: A Reproducible, Extendable, Internet-scale Corpus of Spreadsheets," is being presented at the Working Conference on Mining Software Repositories, May 16-17, in Florence, Italy. The Fuse paper was co-authored by NC State Ph.D. students Justin Smith and John Slankas.
NEW YORK (April 29, 2015) - A new study found one in five nursing home residents with advanced dementia harbor strains of drug-resistant bacteria and more than 10 percent of the drug-resistant bacteria are resistant to four or more antibiotic classes. The research was published online today in Infection Control & Hospital Epidemiology, the journal of the Society for Healthcare Epidemiology of America.
"Nursing home residents with advanced dementia usually have an increased need for healthcare worker assistance, as well as frequent exposure to antibiotics. This combination ...
An update search enlarged the pool of study data, but did not change the content of the conclusion of the benefit assessment of stem cell transplantation (SCT) for multiple myeloma conducted in 2012. Overall, the evidence base remained insufficient: Until now, data on quality of life have not been recorded in any study at all. And three large studies, some of which were under German management, have not been completely published even more than 10 years after their completion. This is the conclusion of a rapid report published by the Institute for Quality and Efficiency ...
When consumer budgets grow or shrink, how do spending habits change? A common view is that people with a budget will spend their money on the same number of products, even when their previous budget was lower or higher. But in order to keep their favorite items, consumers whose budgets have shrunk to a particular amount will opt for less variety than someone whose budget has increased to that same amount, according to a new study in the Journal of Marketing Research. Investors beware!
"We call this the budget contraction effect," write authors Kurt A. Carlson (Georgetown ...
(NEWARK, NJ) - April 29, 2014 - A woman is brutally assaulted, but rather than receiving the sympathy she deserves, she is blamed. If she had dressed differently or acted differently, or made wiser choices, others say, she would have been spared her ordeal. For victims, this "victim blaming" is profoundly hurtful, and can lead to secondary victimization.
Psychologists have long realized that blaming victims is a defense mechanism that helps blamers feel better about the world, and see it as fair and just. But ways to prevent victim blaming have been elusive -- until ...
The sun's surface is blisteringly hot at 10,340 degrees Fahrenheit -- but its atmosphere is another 300 times hotter. This has led to an enduring mystery for those who study the sun: What heats the atmosphere to such extreme temperatures? Normally when you move away from a hot source the environment gets cooler, but some mechanism is clearly at work in the solar atmosphere, the corona, to bring the temperatures up so high.
Clear evidence now suggests that the heating mechanism depends on regular, but intermittent explosive bursts of heat, rather than on continuous gradual ...
MISSOULA - Improved drilling technologies and energy demand have resulted in the large-scale expansion of oil and gas development, with 50,000 new wells drilled per year recently in central North America. Locations such as the Bakken, Eagle Ford and the Marcellus Shale are now commonplace, and drilling activity frequently makes news.
But what are the ecological consequences of this accelerated drilling activity? Researchers at the University of Montana have conducted the first-ever broad-scale scientific assessment of how oil and gas development transforms landscapes ...
Casting a large interdisciplinary research net has helped Simon Fraser University archaeologist Dana Lepofsky and 10 collaborators dig deeper into their findings about ancient clam gardens in the Pacific Northwest to formulate new perspectives.
Lepofsky's research team has discovered that Northwest Coast Indigenous people didn't make their living just by gathering the natural ocean's bounty. Rather, from Alaska to Washington, they were farmers who cultivated productive clam gardens to ensure abundant and sustainable clam harvests.
In its new paper published by American ...
Being bigger and bolder holds various benefits for male soldier beetles. They enjoy higher rates of successful courtship and more often land a larger, more fertile mate. These are some of the findings of a study led by Denson McLain of the Georgia Southern University in the US, published in Springer's journal Behavioral Ecology and Sociobiology.
The goldenrod soldier beetle or Pennsylvanian leatherwing (Chauliognathus pennsylvanicus) is native to Northern America. During its peak reproductive season, between September to early October, it only mates once a day. This normally ...
CHICAGO -- Genetic testing of Iñupiat people currently living in Alaska's North Slope is helping Northwestern University scientists fill in the blanks on questions about the migration patterns and ancestral pool of the people who populated the North American Arctic over the last 5,000 years.
"This is the first evidence that genetically ties all of the Iñupiat and Inuit populations from Alaska, Canada and Greenland back to the Alaskan North Slope," said Northwestern's M. Geoffrey Hayes, senior author of the new study to be published April 29, 2015, in the American ...
PULLMAN, Wash.--Climate change may be responsible for the abrupt collapse of civilization on the fringes of the Tibetan Plateau around 2000 B.C.
WSU archaeologist Jade D'Alpoim Guedes and an international team of researchers found that cooling global temperatures at the end of the Holocene Climatic Optimum, a 4,000 year period of warm weather, would have made it impossible for ancient people on the Tibetan Plateau to cultivate millet, their primary food source.
Guedes' team's research recently was published online in the Proceedings of the National Academy of Sciences. ...
