Exam Management allows for the creation of Post Encounter Notes (PEN) for Doctoring and CCA, as well as Remediation of Non-PEN CCA stations. 

Topics covered in this article and found in the Instructions below:

• Create a Session 
  • Definition and how to
  • Types (PEN, Doctoring, Non-PEN)
• Manage Session
  • Change Session name
  • Release Results to Learning Outcomes
  • Open/Close dates for Exam phase Doctoring Type only
  • Open/Close dates for Grading phase
  • Open/Close dates for Remediation phase
  • Open/Close dates for Remediation Grading phase
• Manage Stations
  • Create/name Stations
  • Associate an Instrument
  • Manage station settings
  • Grading  Types
    • Multi-Grader
    • Group
• Manage Testing Blocks
• Manage Test Takers
• Statistics 
  • Multi-Grader specifics
  • Item Analysis
• Remediation

Create a Session

Allows you to create a new session and select what the Exam Type is. Once you select an Exam Type and create this cannot be changed. The Session name can be changed at any time.

A Session is a group of exams that share a group of test takers (Students) and testing blocks (or other shared scheduling).

Exam Type is what defines how many steps there are to an exam, and in what order those steps happen.

Step is each time the form is presented to the person who needs to complete it, and defines whether it is completed by the test taker or the grader. 

Example: PEN - 4 steps Exam, Grading, Remediation, Remediation Grading. (Exam and Remediation are completed by the test taker, while Grading and Remediation Grading are completed by the Grader)

There are currently 3 configured Types.

PEN

Steps are Exam, Grading, Remediation, and Remediation Grading.

The Exam step is considered a "supervised exam" and is delivered to students in Exam-Delivery. All of the other steps are delivered in ARB in the SP Encounters tab.

Non-PEN Remediation

Steps are Remediation and  Remediation Grading. All of the steps are delivered in ARB in the SP Encounters tab.

Doctoring

Steps are Exam, Grading, Remediation, and Remediation Grading. In this type, the Exam step is considered "unsupervised" and is delivered to students in ARB in the SP Encounter tab, along with all of the other steps. 

Manage Session

Open/Close Dates/Times for all steps of a session not handled by testing blocks of the steps (PEN example: Grading, Remediation, Remediation Grading) are all set on the manage sessions page. 

The Session name can be changed here. 

The Display Due Date can also be managed here. This determines the due date that is shown to students and PEN graders in the PEN hub. However it is the Close date/time, also managed on this page, that determines when a PEN or grade can no longer be submitted. 

Note: Setting the Open/Close dates/times for the exam step is handled in Manage Exam Testing Blocks.

Manage Stations

This is where you can 

• name an Exam/Station 
• Enter a display name for students in Exam Delivery
  • Delivery Name is required for PEN exam types
• Select the instrument/Form
• Set time limit and alert at time
• Set a Cut Point (anything below this will be considered Failed) or Marginal Point (scores between the Cut Point and Marginal Point are considered Marginal)
• Select Grading type
  • Single - This allows a single grader to be assigned to an entire station and they can grade all of the students who have completed that station
  • Multi - This allows multiple graders to be assigned for a station.
    • Graders must be assigned to specific students or no grader is considered assigned
    • A student can be graded by more than 1 grader, however only one can be selected for the Final Outcome.
• Assign graders
  
  
  
  A station is an exam with a form (Instrument) and Grader associated.

Multi Grader

This has been designed to support the need to have an overlap of graders for a station in order to ensure consistency in grading.

Add each Grader to the station by searching for them and selecting them. They will now appear under the Grader heading. At this point these graders are available to be assigned to test takers, however they will not be able to grade any student until they have been assigned to test takers. Click Assign Graders Manually to open the dialog box to assign Graders to Test Takers. Graders can be assigned either individually to test takers or to entire testing blocks.

Once a grader has been assigned to a test taker, if the grading period is open and the test taker has submitted the exam, that test taker will appear on the list the Grader sees on the Grading tab in ARB - SP Encounters.

From this point, here is the multi-grader sequence of events:

• The Manage Test Takers page allows you to review for each test taker what grader has been assigned.
• Once each grader has submitted a grade, that will display next to the grader's name, and clicking on one of them will allow you to view (and print) the exam detail.
• On the statistics page, the status at this point will not show as Grading Submitted, until one of the grades has been selected as the "Score to use".
• To select which graded exam to use, click on the Edit Test Taker button, then under Select Score to Use, select the grader whose score should be the official one for that test taker's exam.
• At this point the Statistics page (and Item Analysis) will reflect that selected grade.

Group Grader

This allows Graders and test takers to be associated without having to manually manage it in the app, but instead using existing groups in Group Admin.

Groups are managed in Group Admin. Roles are assigned as either test taker or grader.

Select which group type should be used, then select which role should be used for the test taker and which role as the grader.

Groups in Group Admin which have the tag "Grader" will appear in the Group Type drop down for selection. This is managed within "Modify Group Type" and can be see on the Group Type Detail Panel on the Group Type List page.

Manage Exam Testing Blocks

Here is where you create the different testing blocks that will allow test takers to view and take the exam at the specific time of the testing block. 

The Name of the testing block as well as the open/close date/time are all required fields.

You can download a report which lists each test taker (name, uniqname, umid), and the testing block(name, open date, close date) that they are associated with for verification or other purposes.

Once a test taker has been associated with a testing block, they will display in the testing block panel for additional information. 

You can also set up testing blocks by uploading a csv

• Headers are as follows: NAME,OPEN DATE,OPEN TIME,CLOSE DATE,CLOSE TIME
• All fields are required
• Date must be on the format M/d/yy. For example: 9/30/19
• Time must be on the format h:mm a. For example: 1:00 pm
• Example file: Sample Testing Block CSV
  
  

Manage Test Takers

Here you can

• Upload test takers via a csv
  • File should have one column for "Uniqname", and one column for "exam testing block"
  • Example file:  samplecsv.csv
• Add test takers individually
• Remove test takers
• For a Test Taker edit the following
  • Testing Block
  • Extra Time Multiplier (this will multiply the time allotted for an exam by the number entered. For example, if an exam is set at a limit of 10 min and a student has a Time Multiplier of 1.5, that student's time limit for the exam would be 15.
  • Extended Remediation 
    • Set a Close date for a specific student that is different than the overall close date, that only applies to this student. This will allow this student to submit remediation at a later date than others.
    • Set a Display Due Date for a specific student that displays on the PEN hub for that student only (but it is the Close date that enforces when the student can no longer submit). 
  • Select/unselect grader (in multi grader grading mode only)
  • Select score to use (in multi grader grading mode only)
    
    
    Test Takers are anyone assigned to an Exam. This can include non-students as well as students.
    

Statistics

Here you can

• View scores and statuses for each test taker in each station
• Click on the Status to view the Outcome of the exam (detail page)
• View exam or station level statistics (mean/std/high/low/cut point/Fail Count)
• See a Student's Total Fail Count
• Download a report of all of the Scores by Student
  
  
  

Multi Grader Specifics

When in multi grader mode, a student's score will not show up here if they have 2 graders until a score has been selected on the Manage Test Takers page.

Item Analysis

Within the station statistics, clicking View Item Analysis, switches the table to a view of that specific Station, showing for each student all of the scores/answers to each Question Item in the Grading state of the Instrument.

Clicking Reset returns the table to the overall Session Statistics view.

In Instrument Admin, there is a field for Report Label. What is entered here will display in this report view (allowing for condensed question headers in the table)

Remediation

This is where you can control which students will be required to remediate. All test takers show up on this page and for each station their score is displayed along with a check box. Checking that box turns remediation on for that student and when the remediation period is open they will see that on the remediation page of the SP Encounters hub. This will also change a test taker's status from Grading - Submitted to Remediation - Not Started. The Remediation check box cannot be selected until grading has been submitted for a test taker. Scores in red are those which fall below the cut point; scores in yellow are those which fall between the cut point and the marginal point.