Free ticketed event
9:00AM – 10:00AM Introduction to Situational Judgement Tests
20 minutes: welcome and attendees sharing of their local challenges with lapses in personal competenices10 minutes: based on the shared stories, identify the challenges faced in developing assessment tools to measure personal competencies
15 minutes: Overview of the current tools available to assess persona competencies, and where validation of these have been successful
20 minutes: Introduction to SJTs, review implications of different facets of SJTs (selected versus constructed response, video versus written items, skill-centric versus task-centric) on predicting future performance, diversity outcomes, and resource allocation.
10:05 – 10:20 Break 1
10:20AM – 11:00AM Developing a Situational Judgement Test
10 minutes: Facilitate a group discussion to determine the most important competencies for engineering, above and beyond the 2015 Engineering Competency Model
10 minutes: Delve more deeply into the two main types of SJTs: selected-response and constructed response
20 minutes: Provide two examples of selected-response SJT items, and two examples of constructed-response SJT items. Attendees would act as test-takers.
11:00AM – 11:10AM Break 2
11:10AM – 11:40AM Scoring a Situational Judgement Test
10 minutes: How to develop a scoring rubric to evaluate SJT responses. Provide examples for both a selected-response and a constructed-response SJT.
10 minutes: How does the method of scoring impact the psychometric properties of an SJT?
10 minutes: Construct a scoring rubric for the SJT items that were developed before the break.
11:40AM – 12:00PM Wrap-Up and Discussion
Dr. Kelly Dore, is an Assistant Professor and Senior Scientist in the Program for Educational Research and Development and the Departments of Medicine and Obs/Gyn. She also holds an affiliated appointment with the Department of Clinical Epidemiology and Biostatistics. Dr. Dore is the Director, Masters of Health Science Education Program. Dr. Dore completed her PhD in Health Research Methodology with a focus on Health Professions Education Research and Cognitive Psychology. She has held multiple grants from both the Medical Council of Canada and the National Board of Medical Examiners (Stemmler Grant) regarding personal and professional qualities. She is co-creator of CASPer and continues her research program at McMaster University focused on issues of assessment as well as professionalism.
Prof. Harold Reiter Isaiah
Dr. Harold Reiter completed his medical degree at the University of Toronto, his specialty training at Princess Margaret Hospital, and his Masters in Education at Ontario Institute for Studies in Education. Aside from his radiation oncology clinical practice, he was Chair of Admissions to Michael G. DeGroote School of Medicine at McMaster University for nine years, and Assistant Dean, Director of the Program for Educational Research and Development at McMaster for four years. He is a co-creator of the Multiple Mini-Interview as well as CASPer, and continues as an active academic in the research and development of tools measuring personal and professional characteristics.