Development and evaluation of the General Surgery Objective Structured Assessment of Technical Skill (GOSATS).
Published: 6th October 2019
Authors: Y. Halwani, A. K. Sachdeva, L. Satterthwaite, S. de Montbrun
Technical skill acquisition is important in surgery specialty training. Despite an emphasis on competency‐based training, few tools are currently available for direct technical skills assessment at the completion of training. The aim of this study was to develop and validate a simulated technical skill examination for graduating (postgraduate year (PGY)5) general surgery trainees.
A simulated eight‐station, procedure‐based general surgery technical skills examination was developed. Board‐certified general surgeons blinded to the level of training rated performance of PGY3 and PGY5 trainees by means of validated scoring. Cronbach's α was used to calculate reliability indices, and a conjunctive model to set a pass score with borderline regression methodology. Subkoviak methodology was employed to assess the reliability of the pass–fail decision. The relationship between passing the examination and PGY level was evaluated using χ2 analysis.
Ten PGY3 and nine PGY5 trainees were included. Interstation reliability was 0·66, and inter‐rater reliability for three stations was 0·92, 0·97 and 0·76. A pass score of 176·8 of 280 (63·1 per cent) was set. The pass rate for PGY5 trainees was 78 per cent (7 of 9), compared with 30 per cent (3 of 10) for PGY3 trainees. Reliability of the pass–fail decision had an agreement coefficient of 0·88. Graduating trainees were significantly more likely to pass the examination than PGY3 trainees (χ2 = 4·34, P = 0·037).
A summative general surgery technical skills examination was developed with reliability indices within the range needed for high‐stakes assessments. Further evaluation is required before the examination can be used in decisions regarding certification.Full text
You may also be interested in
Short‐term medical treatment of hypercalcaemia in primary hyperparathyroidism predicts symptomatic response after parathyroidectomy.
Authors: A. Koman, S. Ohlsson, R. Bränström, Y. Pernow, R. Bränström, I.‐L. Nilsson et al.
Randomized controlled trial of plain English and visual abstracts for disseminating surgical research via social media.
Authors: S. J. Chapman, R. C. Grossman, M. E. B. FitzPatrick, R. R. W. Brady
Authors: H. K. James, A. W. Chapman, G. T. R. Pattison, D. R. Griffin, J. D. Fisher
Network meta‐analysis of urinary retention and mortality after Lichtenstein repair of inguinal hernia under local, regional or general anaesthesia.
Authors: J. H. H. Olsen, S. Öberg, K. Andresen, T. W. Klausen, J. Rosenberg
Effect of donor nephrectomy time during circulatory‐dead donor kidney retrieval on transplant graft failure.
Authors: L. Heylen, J. Pirenne, U. Samuel, I. Tieken, M. Coemans, M. Naesens et al.
Authors: L. Cairncross, H. A. Snow, D. C. Strauss, M. J. F. Smith, O. Sjokvist, C. Messiou et al.
Dysregulation of the actin scavenging system and inhibition of DNase activity following severe thermal injury.
Authors: R. J. Dinsdale, J. Hazeldine, K. Al Tarrah, P. Hampson, A. Devi, C. Ermogenous et al.
Authors: C. A. Sewalt, E. Venema, E. J. A. Wiegers, F. E. Lecky, S. C. E. Schuit, D. den Hartog et al.
Validation of the Norwegian survival prediction model in trauma (NORMIT) in Swedish trauma populations.
Authors: P. Ghorbani, T. Troëng, O. Brattström, K. G. Ringdal, T. Eken, A. Ekbom et al.
Human model of burn injury that quantifies the benefit of cooling as a first aid measure. BJS 2019; 106: 1472-1479.
Authors: E. H. Wright, M. Tyler, B. Vojnovic, J. Pleat, A. Harris, D. Furniss et al.