Free ticketed event
Quality assurance is a key priority for institutions of higher learning, based both on institutional priorities and on external influences from government agencies, accrediting boards, and other stakeholders. This has meant a greater focus on institutional accountability and transparency, and the development of valid learning outcome measures. One approach that is gaining traction is the use of analytic rubrics in courses that have not traditionally used this type of instrument.
The University of Toronto, as part of a provincially funded consortium, has developed a catalog of rubric elements that pertain to some of the key competencies necessary for success in engineering: design, communication, teamwork, problem analysis, and investigation. These rubric elements are being tested for validity and reliability and represent a resource that instructors can use to construct rubrics that align with their own assignments.
Using a presentation and interactive small group activities, the workshop facilitators will provide a step-by-step approach to rubric design and validation. By the end of this workshop you will be able to:
- Explain the basic principles of rubric design
- Select criteria that align with your assessment goals
- Synthesize rubrics using both “off-the-shelf” items and original indicators and descriptors
- Review and analyze sample rubrics
- Apply methods for measuring the reliability and validity of rubrics in your course or program
Workshop material, such as presentation slides and current rubrics developed as part of the LOAC project from the University of Toronto, will be made available to participants upon registration. Participants are asked to bring along sample assignment instructions from their program or course.
This includes an introduction to rubrics: types, uses, basic elements, steps in rubric development
1:15 Identifying Rubric Criteria
Activity: 1) Review indicators that have been developed; 2) Select and create
indicators for your assignment
2:15 Selecting and creating descriptors
Activity: 1) Discuss best practices for writing effective rubric descriptors; 2) Review/analyze rubrics that have been developed; 3) Define descriptors for the indicators selected in previous activity
3:15 Measuring reliability and validity
Activity: Discuss strategies for measuring reliability and validity of rubric criteria (reviewing literature, expert consultation, benchmarking with rubric users etc.)
4:00 Conclude: Participants will leave the workshop with a developed rubric for their assignment and an understanding of how to create rubrics for future assignments.
Acknowledgement: This project is supported by the Higher Education Quality Council of Ontario (HEQCO) as part of the Learning Outcomes Assessment Consortium (LOAC) program.
Prof. Lisa Romkey is a curriculum development expert in the Division of Engineering Science at the University of Toronto.
Gayle Lesmond is a Research Assistant with the Learning Outcomes Assessment Consortium (LOAC) project at the University of Toronto.
Nikita Dawe is currently a Master's Student in Industrial Engineering at the University of Toronto. Her work focuses on the effective assessment of design competencies.
Prof. Susan McCahan is the Vice Provost, Innovations in Undergraduate Education at the University of Toronto, and a professor in the Department of Mechanical and Industrial Engineering.