Bias may exist in rating of medical trainees
2012-12-05
(Press-News.org) Peter Yeates, M.B.B.S., M.Clin.Ed., of the University of Manchester, United Kingdom, and colleagues conducted a study to examine whether observations of the performance of postgraduate year 1 physicians influence raters' scores of subsequent performances.
"The usefulness of performance assessments within medical education is limited by high interrater score variability, which neither rater training nor changes in scale format have successfully ameliorated. Several factors may explain raters' score variability, including a tendency of raters to make assessments by comparing against other recently viewed learners, rather than by using an absolute standard of competence. This has the potential to result in biased judgments," according to background information in the article.
The study consisted of an internet-based randomized experiment using videos of Mini Clinical Evaluation Exercise (Mini-CEX) assessments of postgraduate year 1 trainees interviewing new internal medicine patients. Participants were 41 attending physicians from England and Wales experienced with the Mini-CEX, with 20 watching and scoring 3 good trainee performances and 21 watching and scoring 3 poor performances. All then watched and scored the same 3 borderline video performances. The study was completed between July and November 2011.
The researchers found that attending physicians exposed to videos of good medical trainee performances rated subsequent borderline performances lower than those who had been exposed to poor performances, consistent with a contrast bias. The implication is that a rater of a trainee's performance may be unconsciously influenced by the previous trainee, rather than objectively assessing the individual in isolation.
"With the movement toward competency-based models of education, assessment has largely shifted to a system that relies on judgments of performance compared with a fixed standard at which competence is achieved (criterion referencing). Although this makes conceptual sense (with its inherent ability to reassure both the profession and the public that an acceptable standard has been reached), the findings in this study, which are consistent with contrast bias, suggest that raters may not be capable of reliably judging in this way."
###
(JAMA. 2012;308[21]:2226-2232. Available pre-embargo to the media at http://media.jamanetwork.com)
Media Advisory: To contact Peter Yeates, M.B.B.S., M.Clin.Ed., email peter.yeates@manchester.ac.uk.
END
ELSE PRESS RELEASES FROM THIS DATE:
2012-12-05
Brian P. Lucas, M.D., M.S., of the Cook County Health and Hospitals System and Rush Medical College, Chicago, and colleagues conducted a study to compare the effects of 2- vs. 4-week inpatient attending physician rotations on unplanned patient revisits (a measure to assess the effect on patients), attending evaluations by trainees, and attending propensity for burnout.
"Trainees learn inpatient medicine on the job, providing clinical care to patients as members of ward teams led by attending physicians. Although the structures of these ward teams vary by local educational ...
2012-12-05
Kevin W. Eva, Ph.D., of the University of British Columbia, Vancouver, and colleagues conducted a study to determine whether students deemed acceptable through a revised admissions protocol using a 12-station multiple mini-interview (MMI) would outperform rejected medical students when they later took the Canadian national licensing examinations after completing medical school. The MMI process requires candidates to rotate through brief sequential interviews with structured tasks and independent assessment within each interview.
"Modern conceptions of medical practice ...
2012-12-05
Children with implanted heart-rhythm devices and their parents suffer from a lower quality of life compared with their healthy counterparts and may benefit from psychotherapy according to new research in Circulation: Arrhythmia & Electrophysiology, an American Heart Association journal.
Researchers at the Cincinnati Children's Hospital Medical Center studied 173 children with either a pacemaker (40 patients) or implanted defibrillator (133 patients) to assess their quality of life compared to other children with congenital heart disease and to healthy children. The children, ...
2012-12-05
HOUSTON – (Dec. 4, 2012) –The ability of the eye of a fruit fly (Drosophila melanogaster) to respond to light depends on a delicate ballet that keeps the supply of light sensors called rhodopsin constant as photoreceptors turn on and off in response to light exposures, said researchers from Baylor College of Medicine (www.bcm.edu) and the Jan and Dan Duncan Neurological Research Institute (http://www.nri.texaschildrens.org/) at Texas Children's Hospital in an article that appears online in the journal PLOS Biology (http://www.plosbiology.org/home.action).
The gene Crag ...
2012-12-05
Training human volunteers to control their own brain activity in precise areas of the brain can enhance fundamental aspects of their visual sensitivity, according to a new study. This non-invasive 'neurofeedback' approach could one day be used to improve brain function in patients with abnormal patterns of activity, for example stroke patients.
Researchers at the Wellcome Trust Centre for Neuroimaging at UCL used non-invasive, real-time brain imaging that enabled participants to watch their own brain activity on a screen, a technique known as neurofeedback. During the ...
2012-12-05
New research shows that the concentration of sperm in men's semen has been in steady decline between 1989 and 2005 in France. In addition, there has been a decrease in the number of normally formed sperm. The study is published online today (Wednesday) in Europe's leading reproductive medicine journal Human Reproduction [1].
The study is important because, with over 26,600 men involved, it is probably the largest studied sample in the world and although the results cannot be extrapolated to other countries, it does support other studies from elsewhere that show similar ...
2012-12-05
Poor women who drank tea were viewed as irresponsible as whisky drinkers in early 19th-century Ireland, new research by Durham University has unearthed.
Critics at the time declared that the practice of tea drinking – viewed as a harmless pastime in most past and present societies – was contributing to the stifling of Ireland's economic growth, and was clearly presented as reckless and uncontrollable.
Women who drank tea wasted their time and money, it was said, drawing them away from their duty to care for their husbands and home. It was felt this traditionally female ...
2012-12-05
Research published on bmj.com today suggests that although more babies survived shortly after extreme preterm birth in England in 2006 compared with 1995, the number with major conditions on leaving hospital remained largely unchanged.
A second study, also published today, shows some improvement in the number of extremely preterm children who survived without disability at 3 years of age, but no change in the rate of serious health and developmental problems over the same 10-year period.
Taken together, these two large studies (known as the EPICure studies) suggest ...
2012-12-05
Health inequalities between England's richest and poorest areas have widened in the ten years between 1999 and 2008. Researchers warn, in a study published today on bmj.com, that over the next ten years, we may experience smaller increases in life expectancy than in the past decade and health inequalities may rise at an even faster rate.
Studies have shown that economic decline is associated with long term negative health impacts and the current climate has raised concerns about this. Between 1999 and 2008 the target (set by the government) for reducing the gap in life ...
2012-12-05
PROVIDENCE, R.I. [Brown University] — Inside the brains of mice and men alike, a relatively big football-shaped region called the thalamus acts like a switchboard, providing the prefrontal cortex, the part that does abstract thinking and decision-making, with most of its information. The thalamus's responsibility even includes helping the prefrontal cortex to maintain consciousness and arousal.
Essential as this "thalamocortical" partnership is, neuroscientists have understood very little about the connections coming from a matrix of cells in the so-called "nonspecific ...
LAST 30 PRESS RELEASES:
[Press-News.org] Bias may exist in rating of medical trainees
