(Press-News.org) In computer-science classes, homework assignments consist of writing programs. It's easy to create automated tests that determine whether a given program yields the right outputs to a series of inputs. But those tests say nothing about whether the program code is clear or confusing, whether it includes unnecessary computation, and whether it meets the terms of the assignment.
Professors and teaching assistants review students' code to try to flag obvious mistakes, but even in undergraduate lecture courses, they usually don't have time for exhaustive analysis. And that problem is much worse in online courses, with thousands of students, each of whom might have approached a problem in a slightly different way.
In April, at the Association for Computing Machinery's Conference on Human Factors in Computing Systems, MIT researchers will present a new system that automatically compares students' solutions to programming assignments, lumping together those that use the same techniques.
For each approach, the system -- called OverCode -- creates a program template, using variable names that a preponderance of students happen to have converged on. It then displays templates side-by-side, graying out the code they share, so the differences stand out in relief. And from any template, instructors can, if they choose, pull up a list of the student programs that accord with it.
Instructors who notice variations across templates that make no difference in practice can also write rules establishing the equivalence of alternatives. In some instances, for example, "y*x" might yield a different result than "x*y", but -- depending on the ways in which x and y are defined -- in other instances, it won't. When it doesn't, an instructor could further winnow down the number of templates by creating the rule "y*x = x*y".
The system could allow instructors of online courses to provide generalized feedback that addresses a broader swath of their students. But it could also provide information on how computer-science courses -- both online and on campus -- could be better designed.
With online courses, "in a few months, you can have many orders of magnitude of students go through the same material and find all the interesting alternative solutions or make the same errors," says Elena Glassman, an MIT graduate student in computer science and engineering and first author on the new paper. "Then it's taking all those records of what people did and making sense of it so that when we run the course again, it's better, and when we run the course residentially, we're better able to handle the particular 200 students that we're meeting with on a regular basis."
Two programs that perform the same computation may have code that looks somewhat different. The programmers may have chosen different variable names -- "total," say, in one case, versus "result" in the other. Subfunctions may be executed in different orders.
So in addition to comparing programs' code, OverCode observes the values that variables take on as the programs execute. Two programs with variables that take on the same values in the same order are judged to be identical.
In their new paper, Glassman and her collaborators -- her thesis advisor, professor of computer science and engineering Rob Miller; her fellow graduate student Jeremy Scott; Rishabh Singh, who completed his PhD at MIT last year and is now at Microsoft Research; and Philip Guo, an assistant professor of computer science at the University of Rochester -- also report the results of two usability studies that evaluated OverCode.
In the studies, 24 experienced programmers reviewed thousands of students' solutions to three introductory programming assignments, using both OverCode and a standard tool that displays solutions one at a time. For each assignment, the subjects were given 15 minutes to assess the strategies students most commonly used to design a particular function and to provide general feedback on each, complete with example code.
Remarkably, when assessing the simplest of the three assignments, the subjects analyzing raw code performed as well those using OverCode: In both cases, the five strategies they identified covered about half of the student responses.
For the most difficult of the three assignments, however, the OverCode users covered about 45 percent of student responses, while the subjects analyzing raw data covered only about 9 percent. "The strategy starts to shine on more-complicated programs," Glassman says.
INFORMATION:
Related links
ARCHIVE: Better how-to videos
ARCHIVE: Automatically grading programming homework
Boulder, Colo., USA - Scott W. Anderson and colleagues use repeat aerial LiDAR to quantify the erosional impact of the heavy rains that inundated the Colorado Front Range in September 2013. The five-day storm triggered more than 1,100 landslides and debris flows in a 3,430-square-kilometer area due to 200-450 mm of heavy, steady rainfall. This number of hillslope failures in a single event represents unprecedented activity for the region in its ~150 years of written history.
This study for Geology addresses the role of such large, rare events in shaping landscapes by ...
An intervention to teach mothers of preterm infants how to interact with their babies more effectively results in better weight gain and growth for the infants, according to a study funded in part by the National Institutes of Health.
A subsequent study showed that infants who had the benefit of a major component of this intervention more rapidly developed the muscle control needed for feeding successfully from a bottle. The initial findings were published on line in the Journal of Perinatology and the subsequent study in Advances in Neonatal Care.
Briefly, the intervention ...
A short burst of intensive exercise before eating a high fat meal is better for blood vessel function in young people than the currently recommended moderate-intensity exercise, according to a new study from the University of Exeter.
Cardiovascular diseases including heart attacks and stroke are the leading cause of death in the UK, and the process underlying these diseases start in youth. An impairment in the function of blood vessels is thought to be the earliest event in this process, and this is known to occur in the hours after consuming a high fat meal.
Performing ...
Northridge, Calif. (March 30, 2015) - The investigational S-equol nutritional supplement may be a viable agent to alleviate certain menopause symptoms, such as hot flashes, according to a new peer-reviewed article in the March Journal of Women's Health (1).
"Current data suggest that women may have benefits with S-equol for menopausal vasomotor symptoms and possibly additional benefits, such as skin health. Given the studies supporting safety of S-equol, physicians and health care professionals may consider the use of S-equol as a future first round option for menopause ...
NEW YORK (March 30, 2015) - An outbreak of a novel Escherichia coli (E. coli) strain resistant to antibiotics has been linked to contaminated endoscopes in a Washington state hospital. The study indicates that industry standard cleaning guidelines, which were exceeded by hospital staff, may not be sufficient for sterilizing endoscopes adequately. The research was published online in Infection Control & Hospital Epidemiology, the journal of the Society for Healthcare Epidemiology of America.
"Although the endoscopes had been reprocessed according to industry standards, ...
COLUMBUS, Ohio - Researchers surveying for endangered primates in national parks and forest reserves of Ivory Coast found, to their surprise, that most of these protected areas had been turned into illegal cocoa farms, a new study reports.
The researchers surveyed 23 protected areas in the West African nation between 2010 and 2013 and found that about three-quarters of the land in them had been transformed into cocoa production.
The Ivory Coast is the largest producer of cocoa beans, providing more than one-third of the world's supply. Cocoa is the main ingredient in ...
Antibodies from dromedary camels protected uninfected mice from Middle East Respiratory Syndrome (MERS), and helped infected mice expunge the disease, according to a study published online March 18th in the Journal of Virology, a journal published by the American Society for Microbiology. MERS, which emerged in humans last year in the Saudi Arabian peninsula, causes severe respiratory disease, with a high mortality rate of 35-40 percent. No specific therapy is currently available.
"Our results suggest that these antibodies might prove therapeutic for MERS patients, and ...
March 30, 2015 - Two approaches to fat grafting--injection of fat cells versus fat-derived stem cells--have similar effects in reversing the cellular-level signs of aging skin, reports a study in the April issue of Plastic and Reconstructive Surgery®, the official medical journal of the American Society of Plastic Surgeons (ASPS).
Since the facial rejuvenation results are the same, the simpler approach using fat cells plus the "stromal vascular fraction" has advantages over the more time-consuming stem cell fat technique. Dr. Gino Rigotti of Clinica San Francesco, ...
A UNSW Australia collaboration that uses previously top-secret technology to zoom through the human body down to the level of a single cell could be a game-changer for medicine, an international research conference in the United States has been told.
The imaging technology, developed by high-tech German optical and industrial measurement manufacturer Zeiss, was originally developed to scan silicon wafers for defects.
UNSW Professor Melissa Knothe Tate, the Paul Trainor Chair of Biomedical Engineering, is leading the project, using semiconductor technology to explore ...
An unusual and very exciting form of carbon - that can be created by drawing on paper- looks to hold the key to real-time, high throughput DNA sequencing, a technique that would revolutionise medical research and testing.
Led by Dr Jiri Cervenka and PhD candidate Nikolai Dontschuk from the University of Melbourne, the study also included scientists from the Australian Synchrotron and La Trobe University and is published in Nature Communications.
The Australian researchers have shown that graphene- a one-atom thick sheet of hexagonally arranged carbon, shaped like chicken ...
