How is the CASPer test marked?
Firstly, we should consider how the tests are marked. Each rater will be blinded, and receive only one type of scenario. They then work through anonymised responses, and provide a rating for each on a ‘modified Likert scale of 1-9.’ What exactly constitutes this scale is unknown – a normal Likert scale would be 1-5. The idea behind the anonymised rating, raters only rating one section each, and single system throughout, is that the process be as objective as possible.
Â
Who assesses the CASPer test’s raters?
The raters themselves are assessed as they score the papers. They will be monitored in real-time, every day. The CASPer team will check that the rater is providing scores that use the full breadth of the system (i.e. some scored 1, some scored 9, others around the rest of the extremities, rather than all scoring between 4 and 7). Their average scores should be in line with the expected number. Additionally, they should be reading answers at a rate that seems possible, and should not be flagging responses as being especially poor or worrying unless it is appropriate. Due to their standards for raters, around 60 raters might be removed from the platform in any given year.