ARB Suite - Learning Outcomes/Redesigned Competency Pages


Introduction

(Summer 2020)

The goal of this redesign is to add more types of data to the competency pages to support new Competency Committee processes. The pages initially only included data that came from assessments (matrix questions and ratings). The redesign started with a goal of putting all of the data points the competency committee needed when doing a holistic review of a student onto a single page. 

Instructions

Data sources currently included:

Competency Summary

  • These are matrix questions tagged with competencies in Instrument Admin and delivered to assessors via ARB assessments. These are typically a 3pt scale (Area for Development, Appropriate for Level, Notable Strength) though the rubric varies.
  • These are shown in a "heat map" view. Clicking on a number in the heat map shows what assessments contributed to it and can be clicked on to see the details of that assessment.


Domain Scores

  • These are rating questions tagged with Competency Domains in Instrument Admin and delivered to assessors via ARB assessments. These. are typically a 9pt scale. 
  • These are shown in a table. Clicking on a row in the table will open up the details of that assessment.


Exam Scores

  • These are % scores uploaded via Exam Admin and tagged with either competencies or competency domains.
  • These are shown in a table with student's score, mean, std. dev. and can be clicked on to see the details of that score.


SP and CCA Activities

  • SP/CELA staff can tag SP Activities with competencies so that they appear on the correct competency tabs.


Special Views

Scientific Trunk Quiz/Exam Scores

  • Quiz and exam scores which are uploaded in exam admin.
  • This chart is limited to scientific trunk scores (these are quiz and exams for the foundational sequences).
  • It only shows on the Medical Knowledge Competency Domain page for the Scientific Trunk.
  • Hovering over a circle will provide additional information (Course and quiz name, student score, mean, std. dev. students deviation from mean), clicking on it will open up a detail view of the quiz scores.

Required Clerkship Competency Summary

  • Competency Summary scores displayed in a bar chart by required clerkship. 
  • Limited to Required Clerkships and only shown in the Clinical Trunk.
  • Hovering over the bars shows the summary of the information. There is no currently ability to click through to more detailed information, the competency summary section allows drilling into assessment details.