Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Each OSCE Item (Station) has a specific mark sheet which Examiner uses to mark Candidate performance. As part of the authoring process for an Item you will create this mark sheet according to your needs. This page documents necessary steps which you need to take.

...

Info
titleImportant

Before you start creating your mark sheets you must define Mark sheet Sections and Mark schemes, please refer to the relevant pages in the System setupSettings and system configuration.

Global observation criteria

...

  1. If you haven't already it is a good idea to setup mark sheet sections and mark schemes before defining your global criteria

  2. Access the global criteria from the dashboard, clicking Modify an existing item → Edit global criteria.

    Edit Global Criteria
    Global Criteria

  3. Follow Adding observation criteria steps to add new criteria

...

    1. Select a Section to attach the new criteria to from the first drop down box. This will display everything previously defined in the mark sheet sections.
    2. Type in a name for the criteria in the text box provided.
    3. Select the Type
    4. Select the Scheme from the drop down. This will display everything previously defined in the mark schemes section.
    5. (Global criteria only) Make a selection in the checkbox for whether to define this criteria as a Borderline marker or not.
      1. Borderline marker is the only criteria on the mark sheet Practique use for Borderline group & Borderline regression standard setting methods
      2. You can must define only one criteria as Borderline marker
      3. Criteria should have weight 0.0
    6. Assign a weight value
      1. use 0 to exclude criteria from marking
      2. use 1 to indicate that the criteria is marked according to the mark scheme
      3. use values such as 0.5 or 2.0 to adjust the the weight of the observation criteria
    7. Define whether this should be mandatory or not-mandatory, if ticked then examiners must provide a response in order to be able to submit their mark sheet.
    8. Click Add

  1. Anchor
    apply-if
    apply-if
    (Optional) Click Apply if to link a specific criteria to one or more blueprint categories. This will cause that criteria to only display on the mark sheets for Items that have those specific blueprint categories applied to them.

    Example

    This is useful when you use both Borderline regression and Borderline group standard setting methods for your exams.

    In order to create Items with different Borderline marker criteria (as marking schema will differ) you could create Marking method dimension in the Master blueprint with subcategories Borderline group and Borderline regression. Then, when defining your Global mark sheet criteria, you would create one Borderline marker criteria for each Marking method and use Apply if where you'd select appropriate blueprint category.

     

  2. Anchor
    countas
    countas
    (Optional) Click Count as to map individual feedback responses to a Blueprint dimension. This may be useful to track exactly which feedback relates to a certain curriculum area, for example.

...

Info

Please keep in mind that on the Item Marksheet screen (Defining local observation criteria screenshot) the order of the sections might not be displayed as defined. This is due to the fact that the screen always displays the Global criteria first and Local criteria follows. If you defined Overall section to appear after the Critical section, then the Examiner will see the Critical section first followed by the Overall section despite the screen displays different order.

Observation criteria within the section are in the same order as you add them to the section when defining global or local criteria.

...