Clinical Trials Logo

Clinical Trial Details — Status: Completed

Administrative data

NCT number NCT05616065
Other study ID # 22-029
Secondary ID
Status Completed
Phase N/A
First received
Last updated
Start date October 12, 2022
Est. completion date February 8, 2023

Study information

Verified date April 2023
Source Community Medical Center, Toms River, NJ
Contact n/a
Is FDA regulated No
Health authority
Study type Interventional

Clinical Trial Summary

The aim of this study is to determine if, with respect to medical students applying for residency in emergency medicine, prior knowledge of an applicant's academic record affects their ranking during their interviews. Attendings interviewing candidates will either be blinded to their prior academic records or be allowed to review them prior to the interview. The interviewer's final score of the applicant will be measured, comparing blinded versus unblinded assessors.


Description:

In residency recruitment and ranking, the most honest admission educators can offer is that there truly is no exact way to identify candidates who will thrive in a given discipline or residency program. Along with applications and letters of reference, the traditional residency interview process has long been thought to be one of the best available tools to evaluate a given candidate as well as assess their 'fit' for the culture of the program they wish to enter. Despite this decades-used tool, little uniformity exists in practice, with various disciplines and programs using various techniques to evaluate potential residents. To wit, prospective resident themselves, in one study, have listed their top three consideration when selecting a residency to be the friendliness of the program and faculty, the overall environment, and the interview day itself. Spending time in the department and hospital and having contact with the faculty and staff has long been seen as the best way to 'get to know' the program. This is among the main reasons why medical students will often schedule 'audition rotations' at hospitals and programs that draw their interest. With respect to the interviews themselves, there has been some evolution of thought, despite the variability. Recently, structured interviews and other techniques have been discussed to reduce bias and increase efficiency in residency recruitment. While this has been discussed in academic circles for some time, severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) has brought these issues to the fore. Forcing interviews to be done remotely has effectively removed the intimacy of an in-person visit or interview, making an assessment of 'fit' for both the applicant and the program more challenging. Many program leaders and resident educators have described 'fit' as among the most important predictors of residency success, sometimes more so than pure academic prowess. Of the many biases in residency interviewing, among the easiest and most seductive is hinging a decision on academic achievement alone. It is well understood by many residency educators that academic success in medical school does not always translate to the same level of performance in residency. With the virtual method of interviews continuing for at least this year (and likely going forward), our study ponders the question if the removal of knowledge of an applicant's academic record changes their interviewer's perception of their potential as a resident in an emergency medicine. This study will examine if blinding interviewers to the academic performance of residency applicants impact the assessor's recommendation for the candidate's match day rank list placement. Candidates will be assigned to have one of three of their interviews performed during the standard interview process, to have a single assessor who is instructed not to look at either medical school transcripts or standardized test scores. Assessors will be permitted to look at letters of recommendation, personal statements, research and work experience, and hobbies. The absolute value of the difference of between blinded and unblinded assessors will be compared and tested for statistical significance by matched student T testing. The study is powered for an absolute difference of 1 point on a ten-point scale, which translates linearly to rank list placement. Additionally, this 1-point difference is considered significant from a standpoint of residency operations. Also, blinded versus unblinded assessors will be compared to the placement by the residency program director, who will remain unblinded and also makes independent recommendations for every candidate. As a subanalysis, a qualitative assessment of candidates who get ranked either substantially higher or lower when blinded compared to unblinded will also be conducted.


Recruitment information / eligibility

Status Completed
Enrollment 212
Est. completion date February 8, 2023
Est. primary completion date February 8, 2023
Accepts healthy volunteers Accepts Healthy Volunteers
Gender All
Age group N/A and older
Eligibility Inclusion Criteria: - All candidates who have or are anticipating completing their medical school education, and have applied for a position in our residency during the 2022-2023 match cycle. Exclusion Criteria: - Candidates our program declined to grant an interview spot or have canceled their interview prior to completing it.

Study Design


Related Conditions & MeSH terms


Intervention

Other:
Blinding to academic performance of candidate
Each candidate applying to our program will be interviewed by three core faculty. One of them will be selected, a priori, to be asked not to view a candidate's academic performance (medical school transcripts, standardized test scores). This will not be randomized. Instead, it shall be set up so that each assessor has two blinded candidates to interview each day scheduled. Given that different faculty will be scheduled each day, it may end up that certain faculty will be blinded more than others.
Usual Interview methodology
Each candidate applying to our program will be interviewed by three core faculty. Two of them will be selected, a priori, to be asked to interview their candidates as they see fit.

Locations

Country Name City State
United States Community Medical Center Toms River New Jersey

Sponsors (1)

Lead Sponsor Collaborator
Community Medical Center, Toms River, NJ

Country where clinical trial is conducted

United States, 

References & Publications (12)

Balhara KS, Weygandt PL, Ehmann MR, Regan L. Navigating Bias on Interview Day: Strategies for Charting an Inclusive and Equitable Course. J Grad Med Educ. 2021 Aug;13(4):466-470. doi: 10.4300/JGME-D-21-00001.1. Epub 2021 Aug 13. No abstract available. — View Citation

DeSantis M, Marco CA. Emergency medicine residency selection: factors influencing candidate decisions. Acad Emerg Med. 2005 Jun;12(6):559-61. doi: 10.1197/j.aem.2005.01.006. — View Citation

Haas MRC, He S, Sternberg K, Jordan J, Deiorio NM, Chan TM, Yarris LM. Reimagining Residency Selection: Part 1-A Practical Guide to Recruitment in the Post-COVID-19 Era. J Grad Med Educ. 2020 Oct;12(5):539-544. doi: 10.4300/JGME-D-20-00907.1. No abstract available. — View Citation

Hughes RH, Kleinschmidt S, Sheng AY. Using structured interviews to reduce bias in emergency medicine residency recruitment: Worth a second look. AEM Educ Train. 2021 Sep 1;5(Suppl 1):S130-S134. doi: 10.1002/aet2.10562. eCollection 2021 Sep. No abstract available. — View Citation

Jordan J, Sternberg K, Haas MRC, He S, Yarris LM, Chan TM, Deiorio NM. Reimagining Residency Selection: Part 3-A Practical Guide to Ranking Applicants in the Post-COVID-19 Era. J Grad Med Educ. 2020 Dec;12(6):666-670. doi: 10.4300/JGME-D-20-01087.1. Epub 2020 Dec 18. No abstract available. — View Citation

Kiraly L, Dewey E, Brasel K. Hawks and Doves: Adjusting for Bias in Residency Interview Scoring. J Surg Educ. 2020 Nov-Dec;77(6):e132-e137. doi: 10.1016/j.jsurg.2020.08.013. Epub 2020 Aug 27. — View Citation

Poon S, Nellans K, Rothman A, Crabb RAL, Wendolowski SF, Kiridly D, Gecelter R, Gorroochurn P, Chahine NO. Underrepresented Minority Applicants Are Competitive for Orthopaedic Surgery Residency Programs, but Enter Residency at Lower Rates. J Am Acad Orthop Surg. 2019 Nov 1;27(21):e957-e968. doi: 10.5435/JAAOS-D-17-00811. — View Citation

Smilen SW, Funai EF, Bianco AT. Residency selection: should interviewers be given applicants' board scores? Am J Obstet Gynecol. 2001 Feb;184(3):508-13. doi: 10.1067/mob.2001.109868. — View Citation

Stephenson-Famy A, Houmard BS, Oberoi S, Manyak A, Chiang S, Kim S. Use of the Interview in Resident Candidate Selection: A Review of the Literature. J Grad Med Educ. 2015 Dec;7(4):539-48. doi: 10.4300/JGME-D-14-00236.1. — View Citation

Sternberg K, Jordan J, Haas MRC, He S, Deiorio NM, Yarris LM, Chan TM. Reimagining Residency Selection: Part 2-A Practical Guide to Interviewing in the Post-COVID-19 Era. J Grad Med Educ. 2020 Oct;12(5):545-549. doi: 10.4300/JGME-D-20-00911.1. No abstract available. — View Citation

Theiss LM, Prather JC, Porterfield JR, Corey B, Chen H, McGwin G, Johnson MD, Theiss SM. Prevalence, Bias, and Rank List Impact of Illegal Questions in Surgical Specialty Residency Interviews. J Surg Educ. 2022 Jan-Feb;79(1):69-76. doi: 10.1016/j.jsurg.2021.07.015. Epub 2021 Aug 13. — View Citation

Williams AL, Blomkalns AL, Gibler WB. Residency training in emergency medicine: the challenges of the 21st century. Keio J Med. 2004 Dec;53(4):203-9. doi: 10.2302/kjm.53.203. — View Citation

* Note: There are 12 references in allClick here to view all references

Outcome

Type Measure Description Time frame Safety issue
Primary Assessor recommendation for match list position Assessors will be asked to score their applicant, 1-10, with 1 corresponding to a Do Not Rank recommendation, 2-4 with lower third of list, 5-7 middle third of list, and 8-10 upper third of list. Immediately after interview
See also
  Status Clinical Trial Phase
Recruiting NCT06106178 - A Novel Serious Game as an Alternative for Teaching Basic Point-of-Care Transthoracic Echocardiography Skills N/A
Recruiting NCT05434221 - Communication Skill Training Program for Occupational Therapy Interns N/A
Not yet recruiting NCT06030466 - Medical Students' Acceptance and Learning Efficacy With Physical and Virtual Standardized Patients N/A
Completed NCT01146691 - Effect of Around the Clock Intensivist Coverage on Intensive Care Unit (ICU) Outcomes N/A
Active, not recruiting NCT03684720 - Using 'Guided-Discovery-Learning' to Optimize and Maximize Transfer of Surgical Simulation N/A
Completed NCT03718481 - Perceptions of the Annual Review of Competence Progression (ARCP) in Surgical Training in the UK and Ireland
Recruiting NCT01972698 - Focused Cardiac and Lung Ultrasound in Anesthesia/Critical Care - The Role of Self-directed Simulation-assisted Training Compared to a Traditional Supervised Approach N/A
Completed NCT02754310 - Repeated Versus Varied Simulation Scenarios to Teach Medical Students the Management of a Pediatric Asthma Exacerbation N/A
Completed NCT03035175 - Using Video Laryngoscopy for Neonatal Intubation N/A
Completed NCT00465361 - Resident Surveillance of Pediatric Patient Developmental Status at the Two Month Preventive Care Visit N/A
Completed NCT00318279 - Evaluation of Surgical Simulator for Practicing a Vascular Anastomosis N/A
Recruiting NCT05817370 - Implementation of Anal Cancer Screening and Treatment in Nigeria N/A
Completed NCT05066204 - Evaluation of Different Teaching- and Learningmethods N/A
Not yet recruiting NCT06409273 - Hybrid Course Assessment and Evaluation N/A
Enrolling by invitation NCT06198491 - Evaluation of Educational Interventions Targeting Beliefs About Human Papillomavirus (HPV) N/A
Recruiting NCT03143699 - The Effect of Immediate Feedback on Long-term Blood Pressure Measurement Skills: a Randomized Controlled Trial N/A
Completed NCT05674500 - Coaching Language to Improve Endoscopy Training Quality N/A
Recruiting NCT04805372 - Video Demonstration and Video Feedback to Reduce Time to Perform Central Vein Cannulation in Junior Residents N/A
Completed NCT03650959 - Optimizing Resource Utilization During Proficiency-based Training of Suturing Skills to Medical Students Phase 3
Completed NCT03186274 - Discussing Death and Dying: An End of Life Curriculum to Empower Residents N/A