Setting pass scores for assessment of technical performance by surgical trainees. BJS 2016; 103: 300-306.
Published: 10th December 2015
Authors: S. de Montbrun, L. Satterthwaite, T. P. Grantcharov
One of the major challenges of competency‐based training is defining a score representing a competent performance. The objective of this study was to set pass scores for the Objective Structured Assessment of Technical Skill.
Pass scores for the examination were set using three standard setting methods applied to data collected prospectively from first‐year surgical residents (trainees). General surgery residents were then assigned an overall pass–fail status for each method. Using a compensatory model, residents passed the eight station examinations if they met the overall pass score; using a conjunctive model, residents passed if they met the overall pass score and passed at least 50 per cent of the stations. The consistency of the pass–fail decision across the three methods, and between a compensatory and conjunctive model, were compared.
Pass scores were stable across all three methods using data from 513 residents, 133 of whom were general surgeons. Consistency of the pass–fail decision across the three methods was 95·5 and 93·2 per cent using compensatory and conjunctive models respectively. Consistency of the pass–fail status between compensatory and conjunctive models for all three methods was also very high (91·7, 95·5 and 96·2 per cent).
Consistency in pass–fail status between the various methods builds evidence of validity for the set scores. These methods can be applied and studied across a variety of assessment platforms, helping to increase the use of standard setting for competency‐based training.Full text
You may also be interested in
Meta‐analysis of randomized clinical trials of early versus delayed cholecystectomy for mild gallstone pancreatitis.
Authors: N. Moody, A. Adiamah, F. Yanni, D. Gomez
Meta‐analysis of the role of colonoscopy after an episode of left‐sided acute diverticulitis. BJS 2019; 106: 988-997.
Authors: S. J. Rottier, S. T. Dijk, A. A. W. Geloven, W. H. Schreurs, W. A. Draaisma, W. A. Enst et al.
Authors: D. G. Jayne
Authors: M. G. Sarr
Authors: D. Nepogodiev, O. Omar, A. Bhangu
Meta‐analysis of routine calcium/vitamin D3 supplementation versus serum calcium level‐based strategy to prevent postoperative hypocalcaemia after thyroidectomy.
Authors: A. Sanabria, A. Rojas, J. Arevalo
Randomized clinical trial
Randomized clinical trial of open suture repair versus totally extraperitoneal repair for treatment of sportsman’s hernia. BJS 2019; 106: 837-844.
Authors: A. J. Sheen, A. Montgomery, T. Simon, I. Ilves, H. Paajanen
Randomized clinical trial
Randomized clinical trial comparing total extraperitoneal with Lichtenstein inguinal hernia repair (TEPLICH trial). BJS 2019; 106: 845-855.
Authors: N. Gutlic, A. Gutlic, U. Petersson, P. Rogmark, A. Montgomery
Authors: I. R. Daniels, N. J. Smart
Authors: A. J. Fowler, T. E. F. Abbott, J. Prowle, R. M. Pearse