Standardized Patient Outcomes Admin is used by the team in the Standardized Patient office to manage and publish outcomes for medical students. These outcomes are imported from the SimIQ application, and when published are viewed in Learning Outcomes. The SP Outcomes Admin tool is part of the ARB Suite within the SP Encounters tab under the Admin section. 

Users first search for SIMIQ cases, then select one (by clicking on the row) to view, edit, and publish details.

Publishing cases releases the case details to a students Doctoring pages (Learning Outcomes - Doctoring) in the curricular phase selected.
Publishing a case also releases to results to the Competency Pages (Learning Outcomes - Competencies - Curricular Phase) if there are domains for that case that have been tagged with Competencies or Competency Domains.

Top Portion of the Page

Curricular Phase

• This is the only required field on the page
• Selecting the options in this drop down menu tells Learning Outcome on which tab this case should be displayed in both the Doctoring and Competency Sections. 
  
  • Scientific Trunk
  • Clinical Trunk 
  • Branches
• Any Phase is not used by Learning Outcomes and should not be selected

Doctoring PEN Exam

• This associates a Doctoring PEN with an SP (SIM IQ) case so that on the Doctoring Pages in Learning Outcome all aspects of that SP case can be grouped together
• This is not a required field
• If this is not selected and there is a Doctoring PEN exam as part of this case, it will not show on the Learning Outcomes Doctoring page

Important Exercise Information

• This provides a way to add a note to the Outcome Detail for students in Learning Outcomes
• This displays below Overall Scores of the Outcome Detail for all Students in this case

Domains

Any scores for this case that should be reported out to students must be added as a Domain. These scores appear in the Overall Scores section of the Outcomes Detail.

Adding a Domain

• Click Add Domain.
  
  
  
  
• Select the desired Domain from the drop-down menu.
  
  • If a new domain needs to be created
  • Click Add Domain Name
    
    
    
    
  • Enter the Domain Name (cannot match any existing domains)
    
    
    
    
  • Click Add
  • The new Domain will be automatically selected in the drop-down
  • This new Domain will not be available for all cases
• Enter Mean, Std. Dev., Cut Point as desired
  
  • These are displayed in the Outcome Detail in Learning Outcomes
• Select which Categories (pulled from SIM IQ for this case) should be included in this Domain
  
  • You can select one or more categories to include/roll up into that domain
  • For example
    
    • Domain Name - Overall Score
      
      • Select all Categories other than global (this is the typical behavior for cases)
    • Domain Name - Comm Skills Overall 
      
      • Select all Categories with Comm in the name
    • Domain Name - History Taking Skills
      
      • Select any category with Hx in the name
  • What this does is tell the system that all Questions in the selected category/ies for a Domain should be rolled up and calculated as a %. 
    
    • The system respects the weight given a Question in SIM IQ. For example, Questions (items) that are weighted at 0 will be ignored in the roll up. Whereas Questions weighted as one will be counted
• Select Competency
  
  
  
  
  • This is what allows domain scores to be  reported out on the Competency page in Learning Outcomes
  • Both Competency Domains and specific Competency can be selected
• Save

A Domain can be edited by clicking edit and all aspects changed.

A Domain can also be deleted, this will remove it from this case, but the domain will still exist as an option for other cases.

Display SP Activities in Learning Outcomes - Competency Pages

Case and domain show up in a table called Standardized Patient Activities showing the Competency, Date, Score, Class Mean, and Std. Dev.

• Hovering over the competency pops up a description of that competency
• Each row can be clicked on to see that cases outcome detail
  
  
  

Category Breakdown Section

This table shows all Categories that exist in SIM IQ for this case, and allows you to select how it should display to students in Learning Outcomes. The Default is Skill Level.

Skill Level

• This option will display this category as a single row in the Skill Level section of Learning Outcomes, with a text response of the students performance.
  
  • Appropriate for Level will show is the  student's score is at or above the cut point for this category (as set in SIM IQ)
  • Area for Development will show is a student's score is below the cut point for this category (as set in SIM IQ)

Expanded Breakdown (show full checklist)

• This option will show the full checklist in Learning Outcomes in a table for each category
  
  • You can preview what checklist items are included and will be shown that category by clicking on View Checklist
• The response that was selected in SIM IQ is what is shown for that Question/Item in Learning Outcomes. (the raw score for the item is used in calculating the score)

Hide

This will hide this category from being shown in Learning Outcomes. This is typically used for Global and Overall Performance Faculty Assessment.

Previewing a Student's Outcome

This allows you to preview what will be shown in Learning Outcomes for the Outcome Detail before publishing. 

• Enter the first three letters of a student's first or last name and a drop-down will appear where you can select a student.
  
  
  
  
• Only students who are in one of the sessions for this case will be found when searching for a student. 
• Clicking Preview Outcome will open up a modal showing the Outcome Detail with all of the current settings and data entered.
  
  
  

You must save any changes before they will be shown in the preview.

Session Publishing

• Selecting the checkbox will indicate that session should be published (or outcomes released to students), this will not take effect until the case has been saved.
  
  • This is "live time", meaning if you publish it will be available from that time forward on Learning Outcomes, and if you unpublish it will not be visible from that time forward, AFTER saving the case.
• To select all sessions in a case, click the Select All box in the top right about the table.
• Clicking View students included  in session will open a modal dialog box showing the names and uniqnames of students included in that session

Changes to Learning Outcomes with the New Version of SP Outcomes Admin

Oral Case Presentation in the Standardized Patient Table

• In the old version of SP Outcomes Admin (where things were hard coded), on a student's doctoring page Oral Case Presentation shows up in one of two ways based if they have 1 question or 12  
  
  • Cases that used the newer OCP with the 12 questions showed as a % score.
  • Cases that used OCP with the 1 question showed up as Appropriate for Level/Area of Development.
• Going forward only Domains (which have a %score) show up in this table. So older cases that would have shown "Appropriate for Level/Area of Development"  no longer appear in this table
  
  • This will affect historical students, if anyone looks back at their past cases and recalls seeing "Appropriate for Level" shown in this table.
• The data for the students performance in Oral Case Presentation will still show up in the  Outcome Detail as it did before.

Comm Skills in Expanded Breakdown

Historically all Comm skills categories were included in a single Expanded Breakdown table, going forward all Categories are in their own tables, so Comm Basic and Comm Advanced show up in individual tables.

Important Notes

Reminder: a case appears in the admin tool as soon as it's created, even before any assessments have been done. That means it's possible to publish even before assessments have been done. Assuming you don't want immediate publication to Learning Outcomes to happen, remember not to publish until you are ready for students to see assessments.

Once a student has been evaluated for a given case and session and the admin tool has been used to update the publishing/stats/notes for this case, deleting the case or session from SimIQ will have unexpected results when attempting to view the case in the admin tool.

Zero weighted questions are NOT considered when rolling up scores.

Authorization for admin tool: Laurie will be authorizer in App Access. Erik will be set up as well so can be Laurie's backup if she is out. App Access allows authorizers to give access to others.