Document Type : review article
Authors
- Nasser Sanjar Moussavi 1
- Majid Sezavar 2
- Somayeh Akbari Farmad 3
- Mohamadhadi Imanieh 4
- Hamidreza Kianifar 5
- Arezou Farajpour 6
1 Assistant Professor, Department of surgery, Faculty of Medicine, Mashhad Medical Sciences, Islamic Azad University, Mashhad, Iran
2 Department of pediatrics, Mashhad university of medical sciences,mahshhad,iran
3 Department of Medical Education, Mashhad University of Medical Sciences, Mashhad, Iran
4 Full Professor, department of pediatrics, faculty of medicine, Shiraz University of Medical Sciences, Shiraz, Iran. Orcid ID: 0000-0003-4610-0413
5 Associated Professor, department of pediatrics, faculty of medicine, Mashhad university of medical sciences, Mashhad, Iran
6 Department of Education Development Center, Faculty of Medicine, Mashhad Medical Sciences, Islamic Azad University, Mashhad, Iran.
Abstract
Background: Providing high-quality medical services and training future specialists is one of the most vital tasks of the medical education system but there is still no agreement on the best strategy for selecting the most competent candidates in the future. This study aimed to review studies on the currently used criteria.
Methods: In this systematized review, the research question was “What are the criteria for selecting pediatric residents in medical universities?" PubMed, Scopus and ISI databases were searched electronically on March 23, 2022 with the defined strategies, based on which 624 articles were retrieved. After omitting duplicates along with title and abstract screening, 72 remaining full papers were studied and the results were extracted from 17 eligible articles.
Results: Based on the review, 11 criteria and tools were identified; they includes: Structured Interview (SI), Letter of Recommendation (LoR), Multiple Mini-Interview (MMI), P-Mex, Assessment Letter for Pediatrics (ALPs), Situational Judgment Test (SJT), Scholar activities, Global assessment, Competency-based assessment center, University grades, and USMLE scores.
Conclusion: The findings suggested that it is necessary to determine a valid and reliable framework to assess the expected competencies and specific tasks including cognitive and non-cognitive qualities that predict successful future performance.
Keywords
- Selber JC TW, Koshy J, Ibrahim A, Liu J, Butler C. Correlation between trainee candidate selection criteria and subsequent performance. Journal of the American College of Surgeons 2014 219(5):951-7.
- DeZee KJ TM, Mintz M, Durning SJ. Letters of recommendation: rating, writing, and reading by clerkship directors of internal medicine. Teaching and learning in medicine 2009 21(2):153-8.
- Borges NJ SS. Work style preferences among medical specialties. Journal of Vocational Behavior. 2014 84(3):303-6.
- T. P. Can we more wisely choose residents? World Neurosurgery 2014; 82(3-4):e553-4.
- Hoffman BM CM, Kuo PC. Personality differences between surgery residents, nonsurgery residents, and medical students. Surgery. 2010 148(2):187-93.
- Altmaier EM MG, Wood P, Ross RR, Bartley J, Smith W. 1990 Feb 1; 85(2): Defining successful performance among pediatric residents. Pediatrics. 1990; 85(2):139-43.
- Ahmadipour H SE. Investigating Burnout in Medical Residents at Kerman University of Medical Sciences. Health_Based Research 2020; 6(2):129-37.
- Kalani SD AP, Oreyzi HR, Azizkhani R, Adibi P. Prevalence of burnout syndrome among the residents in Isfahan University of Medical Sciences, Isfahan, Iran. Journal of Isfahan Medical School. 2017 35(442):993-9.
- Yaghmaei M HA, Jalali MM. Relationship between residents’ success on the certifying examinations within–Training exam and internal evaluation. Research in Medical Education 2017 9(1):26-18.
- Swanson WS HM, Master C, Gallagher PR, Mauro AE, Ludwig S. The impact of the interview in pediatric residency selection. Ambulatory Pediatrics 2005 5(4):216-20.
- Marcus-Blank B DJ, Braman JP, Borman-Shoap E, Tiryaki E, Chipman J, Andrews JS, Sackett PR, Cullen MJ. Predicting performance of first-year residents: Correlations between structured interview, licensure exam, and competency scores in a multi-institutional study. Academic Medicine. 2019 94(3):378-87.
- Gross C OHC, Winn AS, Lux SE, Michelson CD, Sectish T, Sox CM. Application factors associated with clinical performance during pediatric internship. Academic Pediatrics. 2020 1-6.
- Ackerman AD FL. Should Pediatric Chairs Be Expected to Write Letters of Recommendation for All Students Applying to Pediatric Residency Programs? The Journal of pediatrics. 2019 208:3-4.
- Saudek K SD, Treat R, Bartz P, Weigert R, Weisgerber M. Dear program director: deciphering letters of recommendation. Journal of graduate medical education. 2018 10(3):261-6.
- Saudek K TR, Goldblatt M, Saudek D, Toth H, Weisgerber M. Pediatric, surgery, and internal medicine program director interpretations of letters of recommendation. Academic Medicine 2019 94:S64-8.
- Dore KL KS, Ladhani M, Rolfson D, Kurtz D, Kulasegaram K, Cullimore AJ, Norman GR, Eva KW, Bates S, Reiter HI. The reliability and acceptability of the multiple mini-interview as a selection instrument for postgraduate admissions. Academic Medicine. 2010 85(10):S60-3.
- Bajwa NM NM, Galetto-Lacour A, Posfay-Barbe K, Yudkowsky R, Park YS. Can Professionalism Mini-Evaluation Exercise Scores Predict Medical Residency Performance? Validity Evidence across Five Longitudinal Cohorts. Academic Medicine. 2019 94(11s):S57-63.
- Marcus-Blank B DJ, Braman JP, Borman-Shoap E, Tiryaki E, Chipman J, Andrews JS, Sackett PR, Cullen MJ. Predicting performance of first-year residents: correlations between structured interview, licensure exam, and competency scores in a multi-institutional study. Academic Medicine 2019 94(3):378-87.
- Eva KW RH, Trinh K, Wasi P, Rosenfeld J, Norman GR. Predictive validity of the multiple mini-interview for selecting medical trainees. Med Educ. 2009; 43:767–75.
- Patterson F LF, Kerrin M, Munro N, Irish B. The predictive validity of selection for entry into postgraduate training in general practice: Evidence from three longitudinal studies. Br J Gen Pract. 2013; 63:e734–e41.
- 21. Patterson F, Rowett E, Hale R, Grant M, Roberts C, Cousans F, Martin S. The predictive validity of a situational judgment test and multiple-mini interview for entry into postgraduate training in Australia. BMC Med Educ 2016; 16:87.
- Education. ACfGM. GME Data Resource Book 2017–2018 https://wwwacgmeorg/About-Us/Publications-and-Resources/Graduate-Medical-Education-Data-Resource-Book; Accessed July 12, 2019.
- Bajwa NM, Rachel Yudkowsky, Dominique Belli, Nu Viet Vu, and Yoon Soo Park. "Improving the residency admissions process by integrating a professionalism assessment: a validity and feasibility study". Advances in Health Sciences Education 2017; 22(1):69-89.
- Bajwa NM YR, Belli D, Vu NV, Park YS. Validity evidence for a residency admissions standardized assessment letter for pediatrics. Teaching and Learning in Medicine. 2018 30(2):173-83.
- Cusimano MD YA, Tucker WS. An analysis of attrition from Canadian neurosurgery residency programs. Academic Medicine. 1999 74(8):925-31.
- Lievens L SP. The validity of interpersonal skills assessment via situational judgment tests for predicting academic success and job performance. J Appl Psychol 2012; 97(2):460–8.
- Patterson F LF, Kerrin M, Zibarras L, Carette B. Designing Selection Systems for Medicine: The importance of balancing predictive and political validity in high‐stakes selection contexts. International Journal of Selection and Assessment. 2012 20(4):486-96.
- Cullen MJ ZC, Marcus-Blank B, Braman JP, Tiryaki E, Konia M, Hunt MA, Lee MS, Van Heest A, Englander R, Sackett PR. Improving Our Ability to Predict Resident Applicant Performance: Validity Evidence for a Situational Judgment Test. Teaching and Learning in Medicine. 2020 18:1-14.
- Lukings J BA, Stobbe K, Basha V, Brazier J, Dragomir D, Glibbery M, Kearney H, Knapp A, Levin D, Tucker D. Scholarly activity as a selection criterion in the Canadian Residency Matching Service (CaRMS): A review of published criteria by internal medicine, family medicine, and pediatrics programs. Canadian Medical Education Journal. 2020 11(3):e116–e21.
- PO. O. Predicting residents' performance: A prospective study. BMC Medical Education 2002 2(1):1-4.
- Randall R DH, Patterson F, Farrell K. Selecting doctors for postgraduate training in pediatrics using a competency based assessment center. Archives of disease in childhood. 2006 91(5):444-8.
- Saudek K RA, Treat R, Pilon C, Auble B, Hahn D, Schuh A, Weisgerber M. A 3-Year Longitudinal Study Evaluating Predictors of Overall Resident Performance. Journal of Graduate Medical Education 2020 12(3):357-8.
- Ingram MA PJ, Estrada CA, Zinski A, Williams WL. Are we measuring what matters? How student and clerkship characteristics influence clinical grading. Academic Medicine. 2021 96(2):241-8.
- Wright B SI, Woloschuk W, Brenneis F. 2004 Jun 22; 170(13): Career choice of new medical students at three Canadian universities: family medicine versus specialty medicine. Cmaj. 2004; 170(3):1920-4.
- Villanueva AM, Kaye, D., Abdelhak, S. S., & Morahan, P. S. Comparing selection criteria of residency directors and physicians' employers. Academic Medicine. 1995; 70(4):261–71.
- Roberts C, Khanna P, Rigby L, Bartle E, Llewellyn A, Gustavs J, Newton L, Newcombe JP, Davies M, Thistlethwaite J, Lynam J. Utility of selection methods for specialist medical training: A BEME (best evidence medical education) systematic review: BEME guide no. 45. Med Teach 2018; 40:3–19.
- Lüer S AC. Assessment of residency program outcomes via alumni surveys. Advances in medical education and practice. 2017; 8:307-15.
- Aibana O SJ, FLoRes RJ, Love L. Bridging the gap: holistic review to increase diversity in graduate medical education. Academic Medicine 2019 94(8):1137-41.
- Williams M KE, Pappas K, Uwemedimo O, Marrast L, Pekmezaris R, Martinez J. The impact of the United States Medical Licensing Exam (USMLE) step 1 cutoff scores on recruitment of underrepresented minorities in medicine: A retrospective cross‐sectional study. Health Science Reports 2020 3(2):e2161.
- Borowitz SM SF, Wilson WG. Mar 1; 154(3). Information collected during the residency match process does not predict clinical performance. Archives of pediatrics & adolescent medicine. 2000 154(3): 256-60.
- Brothers TE WS. Importance of the faculty interview during the resident application process. Journal of surgical education 2007; 64(6):378-85.
)