PRESS-NEWS.org - Press Release Distribution
PRESS RELEASES DISTRIBUTION

Reviewing online homework at scale

System clusters similar student programs together, so instructors can identify broad trends

2015-03-30
(Press-News.org) In computer-science classes, homework assignments consist of writing programs. It's easy to create automated tests that determine whether a given program yields the right outputs to a series of inputs. But those tests say nothing about whether the program code is clear or confusing, whether it includes unnecessary computation, and whether it meets the terms of the assignment.

Professors and teaching assistants review students' code to try to flag obvious mistakes, but even in undergraduate lecture courses, they usually don't have time for exhaustive analysis. And that problem is much worse in online courses, with thousands of students, each of whom might have approached a problem in a slightly different way.

In April, at the Association for Computing Machinery's Conference on Human Factors in Computing Systems, MIT researchers will present a new system that automatically compares students' solutions to programming assignments, lumping together those that use the same techniques.

For each approach, the system -- called OverCode -- creates a program template, using variable names that a preponderance of students happen to have converged on. It then displays templates side-by-side, graying out the code they share, so the differences stand out in relief. And from any template, instructors can, if they choose, pull up a list of the student programs that accord with it.

Instructors who notice variations across templates that make no difference in practice can also write rules establishing the equivalence of alternatives. In some instances, for example, "y*x" might yield a different result than "x*y", but -- depending on the ways in which x and y are defined -- in other instances, it won't. When it doesn't, an instructor could further winnow down the number of templates by creating the rule "y*x = x*y".

The system could allow instructors of online courses to provide generalized feedback that addresses a broader swath of their students. But it could also provide information on how computer-science courses -- both online and on campus -- could be better designed.

With online courses, "in a few months, you can have many orders of magnitude of students go through the same material and find all the interesting alternative solutions or make the same errors," says Elena Glassman, an MIT graduate student in computer science and engineering and first author on the new paper. "Then it's taking all those records of what people did and making sense of it so that when we run the course again, it's better, and when we run the course residentially, we're better able to handle the particular 200 students that we're meeting with on a regular basis."

Two programs that perform the same computation may have code that looks somewhat different. The programmers may have chosen different variable names -- "total," say, in one case, versus "result" in the other. Subfunctions may be executed in different orders.

So in addition to comparing programs' code, OverCode observes the values that variables take on as the programs execute. Two programs with variables that take on the same values in the same order are judged to be identical.

In their new paper, Glassman and her collaborators -- her thesis advisor, professor of computer science and engineering Rob Miller; her fellow graduate student Jeremy Scott; Rishabh Singh, who completed his PhD at MIT last year and is now at Microsoft Research; and Philip Guo, an assistant professor of computer science at the University of Rochester -- also report the results of two usability studies that evaluated OverCode.

In the studies, 24 experienced programmers reviewed thousands of students' solutions to three introductory programming assignments, using both OverCode and a standard tool that displays solutions one at a time. For each assignment, the subjects were given 15 minutes to assess the strategies students most commonly used to design a particular function and to provide general feedback on each, complete with example code.

Remarkably, when assessing the simplest of the three assignments, the subjects analyzing raw code performed as well those using OverCode: In both cases, the five strategies they identified covered about half of the student responses.

For the most difficult of the three assignments, however, the OverCode users covered about 45 percent of student responses, while the subjects analyzing raw data covered only about 9 percent. "The strategy starts to shine on more-complicated programs," Glassman says.

INFORMATION:

Related links ARCHIVE: Better how-to videos

ARCHIVE: Automatically grading programming homework



ELSE PRESS RELEASES FROM THIS DATE:

LiDAR studies of the Sept. 2013 Colorado Front Range flooding and debris flows

LiDAR studies of the Sept. 2013 Colorado Front Range flooding and debris flows
2015-03-30
Boulder, Colo., USA - Scott W. Anderson and colleagues use repeat aerial LiDAR to quantify the erosional impact of the heavy rains that inundated the Colorado Front Range in September 2013. The five-day storm triggered more than 1,100 landslides and debris flows in a 3,430-square-kilometer area due to 200-450 mm of heavy, steady rainfall. This number of hillslope failures in a single event represents unprecedented activity for the region in its ~150 years of written history. This study for Geology addresses the role of such large, rare events in shaping landscapes by ...

Promoting maternal interaction improves growth, weight gain in preemies

2015-03-30
An intervention to teach mothers of preterm infants how to interact with their babies more effectively results in better weight gain and growth for the infants, according to a study funded in part by the National Institutes of Health. A subsequent study showed that infants who had the benefit of a major component of this intervention more rapidly developed the muscle control needed for feeding successfully from a bottle. The initial findings were published on line in the Journal of Perinatology and the subsequent study in Advances in Neonatal Care. Briefly, the intervention ...

Short bouts of high-intensity exercise before a fatty meal best for vascular health

2015-03-30
A short burst of intensive exercise before eating a high fat meal is better for blood vessel function in young people than the currently recommended moderate-intensity exercise, according to a new study from the University of Exeter. Cardiovascular diseases including heart attacks and stroke are the leading cause of death in the UK, and the process underlying these diseases start in youth. An impairment in the function of blood vessels is thought to be the earliest event in this process, and this is known to occur in the hours after consuming a high fat meal. Performing ...

New scientific review suggests some women may benefit from considering use of S-equol to ease menopause symptoms

2015-03-30
Northridge, Calif. (March 30, 2015) - The investigational S-equol nutritional supplement may be a viable agent to alleviate certain menopause symptoms, such as hot flashes, according to a new peer-reviewed article in the March Journal of Women's Health (1). "Current data suggest that women may have benefits with S-equol for menopausal vasomotor symptoms and possibly additional benefits, such as skin health. Given the studies supporting safety of S-equol, physicians and health care professionals may consider the use of S-equol as a future first round option for menopause ...

Endoscopes linked to outbreak of drug-resistant E. coli

2015-03-30
NEW YORK (March 30, 2015) - An outbreak of a novel Escherichia coli (E. coli) strain resistant to antibiotics has been linked to contaminated endoscopes in a Washington state hospital. The study indicates that industry standard cleaning guidelines, which were exceeded by hospital staff, may not be sufficient for sterilizing endoscopes adequately. The research was published online in Infection Control & Hospital Epidemiology, the journal of the Society for Healthcare Epidemiology of America. "Although the endoscopes had been reprocessed according to industry standards, ...

Bitter chocolate: Illegal cocoa farms threaten Ivory Coast primates

Bitter chocolate: Illegal cocoa farms threaten Ivory Coast primates
2015-03-30
COLUMBUS, Ohio - Researchers surveying for endangered primates in national parks and forest reserves of Ivory Coast found, to their surprise, that most of these protected areas had been turned into illegal cocoa farms, a new study reports. The researchers surveyed 23 protected areas in the West African nation between 2010 and 2013 and found that about three-quarters of the land in them had been transformed into cocoa production. The Ivory Coast is the largest producer of cocoa beans, providing more than one-third of the world's supply. Cocoa is the main ingredient in ...

Could antibodies from camels protect humans from MERS?

2015-03-30
Antibodies from dromedary camels protected uninfected mice from Middle East Respiratory Syndrome (MERS), and helped infected mice expunge the disease, according to a study published online March 18th in the Journal of Virology, a journal published by the American Society for Microbiology. MERS, which emerged in humans last year in the Saudi Arabian peninsula, causes severe respiratory disease, with a high mortality rate of 35-40 percent. No specific therapy is currently available. "Our results suggest that these antibodies might prove therapeutic for MERS patients, and ...

Two different fat graft techniques have similar effects on facial skin

2015-03-30
March 30, 2015 - Two approaches to fat grafting--injection of fat cells versus fat-derived stem cells--have similar effects in reversing the cellular-level signs of aging skin, reports a study in the April issue of Plastic and Reconstructive Surgery®, the official medical journal of the American Society of Plastic Surgeons (ASPS). Since the facial rejuvenation results are the same, the simpler approach using fat cells plus the "stromal vascular fraction" has advantages over the more time-consuming stem cell fat technique. Dr. Gino Rigotti of Clinica San Francesco, ...

'Google Maps' for the body: A biomedical revolution

2015-03-30
A UNSW Australia collaboration that uses previously top-secret technology to zoom through the human body down to the level of a single cell could be a game-changer for medicine, an international research conference in the United States has been told. The imaging technology, developed by high-tech German optical and industrial measurement manufacturer Zeiss, was originally developed to scan silicon wafers for defects. UNSW Professor Melissa Knothe Tate, the Paul Trainor Chair of Biomedical Engineering, is leading the project, using semiconductor technology to explore ...

'Atomic chicken-wire' is key to faster DNA sequencing

2015-03-30
An unusual and very exciting form of carbon - that can be created by drawing on paper- looks to hold the key to real-time, high throughput DNA sequencing, a technique that would revolutionise medical research and testing. Led by Dr Jiri Cervenka and PhD candidate Nikolai Dontschuk from the University of Melbourne, the study also included scientists from the Australian Synchrotron and La Trobe University and is published in Nature Communications. The Australian researchers have shown that graphene- a one-atom thick sheet of hexagonally arranged carbon, shaped like chicken ...

LAST 30 PRESS RELEASES:

Ancient isolation’s impact on modern ecology

Synaptic protein change during development offers clues on evolution and disease

How commercial rooftop solar power could bring affordable clean energy to low-income homes

Taking a closer look at pulmonary fibrosis genetics

Cats with MDR1 mutation at risk of severe reactions to popular medication

IOP Publishing and IPEM mandate reporting of sex and gender in research 

Dogs trained to detect trauma stress by smelling humans’ breath

Electronic device thermal management made simpler and slightly better!

Study: Dangerous surgical site infections can be reduced with simple prevention protocol

Genetic testing of patients with atrial fibrillation can alert clinicians to potential development of life-threatening conditions

Artificial Intelligence tool successfully predicts fatal heart rhythm

What progress has China made in agriculture green development over the past five years?

ALMA finds new molecular signposts in starburst galaxy

Open waste burning linked to air pollution in Northwestern Greenland

Google Street View reveals how built environment correlates with risk of cardiovascular disease

Connecting the dots to shape growth forces

Parental avoidance of toxic exposures could help prevent autism, ADHD in children, new study shows

Trends in the incidence of renal replacement therapy due to rapidly progressive glomerulonephritis in Japan, 2006–2021

Olympics not likely to swallow up skateboarding’s subversive nature into its corporate spectacle, study says

Looking after the NHS workforce must be a top priority, say experts

Prolonged use of certain hormone drugs linked to increased brain tumor risk

Delirium a ‘strong risk factor’ for dementia among older people

People experiencing homelessness more likely to develop dementia at younger ages, study finds

Can metalens be commercialized at a fraction of the cost?

Reclaim ‘wellness’ from the rich and famous, and restore its political radicalism, new book argues

Curtin research unlocks supernova stardust secrets

New documents reveal patient safety concerns over strike day cover

UTA hosts Solar-bration watch party for April 8 eclipse

Researchers discover molecule that promotes production of cancer cells in triple-negative breast cancer

New tool provides researchers with improved understanding of stem cell aging in the brain

[Press-News.org] Reviewing online homework at scale
System clusters similar student programs together, so instructors can identify broad trends