How SJT Ranked-Answer Scoring Works

You got solid scores on verbal and numerical, then the results came back and the SJT dragged you down the Order of Merit. On boards.ie, candidate after candidate describes exactly this: top scores on the other components, lower third on the situational judgement test. Not because they were unprepared in general, but because they did not understand how the scoring actually works.

This is not a test where you pick the one correct answer and move on. Understanding the scoring model is half the battle.

What does “ranked-answer scoring” mean in practice?

The publicjobs.ie situational judgement test presents a workplace scenario, typically a paragraph of text describing a situation you might face as an Executive Officer. Under it, you get a list of possible responses. Your job is not to select the single best one - you rate each response on a scale of 1 to 5, where 1 represents a bad or counterproductive action and 5 represents an excellent response that fully meets the need.

That rating scale is what makes this a ranked-answer format. You are not choosing between options; you are ordering them by quality. The scoring system then compares your ratings against the ratings assigned by a panel of subject matter experts, often senior civil servants, who validated the test during development.

The closer your ratings match the expert ratings, the higher you score. If you rated a response as a 4 and the experts rated it a 3, you lose some points but not all. If you rated it a 5 when they rated it a 1, you lose significantly more. This is the core of how partial credit works.

How does partial credit get awarded?

Because the system compares your rating against the expert-validated rating on a scale, every response you rate contributes to your total score. You are not simply right or wrong on each question - you are somewhere on a spectrum of accuracy.

A few practical implications:

Middle ratings hurt more than you might expect. If you are unsure and hedge by rating everything a 3, you will consistently miss partial credit on the responses that genuinely are 1 or 5. Candidates on boards.ie describe this as “fence sitting” - and it scores poorly because it suggests you cannot distinguish between clearly good and clearly poor actions.

Being directionally right still earns you something. If the correct rating is a 5 and you gave it a 4, that is a small deduction. If you gave it a 2, that is a much larger deduction. Being close matters, which means understanding the underlying logic of what a strong civil service response looks like matters more than memorising individual answers.

The spread of your ratings across a scenario is part of your signal. A scenario with five possible responses should produce a spread of ratings - not five scores clustered around 3. If you genuinely think two responses are equally good, that may sometimes be true, but it should be the exception rather than the result of general hesitation.

What logic should guide your ratings?

The publicjobs.ie test advice page notes that the assessment is designed to reflect integrity, honesty, objectivity, and impartiality - the explicitly stated values of the Irish civil service. That is not just boilerplate. It gives you a framework for working through scenarios when two options feel plausible.

Some patterns that come up repeatedly in Irish civil service SJT scenarios:

Escalation timing matters. Waiting to act when a deadline is at risk tends to score poorly. But escalating immediately before trying to resolve something yourself also tends to score poorly. The expert-validated middle ground is usually: take a proportionate first step yourself, keep the relevant person informed, and escalate if the situation does not resolve.

Passing the problem entirely scores poorly. If a scenario asks what you do when a colleague is struggling, routing the problem entirely to your manager without any effort on your part will typically get a low rating. Civil service competency frameworks, including the 2024 Capability Framework that the current EO assessment maps to, expect you to show initiative and collaborative instinct before you look upward.

Following procedure beats clever workarounds. In scenarios where there is a clear process or protocol, following it scores well even if it seems slower. The frameworks value “evidence informed delivery” - making balanced judgements within established procedures, not around them.

This is precisely why generic UK-market SJT practice packs fall short for Irish candidates. The response logic is calibrated to a specific values framework and a specific escalation culture. JobTestPrep and similar providers offer good general practice, but their scenarios are built around UK civil service norms and SHL-style formats. They will not reliably train your instincts for the Irish scoring model.

The publicjobs situational judgement test guide covers the scenario types and competency clusters in more detail. For a deeper look at how the 2024 Capability Framework shapes the answer key, see the Capability Framework behind every SJT scenario.

Does understanding scoring change how you should prepare?

Yes, meaningfully.

Timed practice under the actual format matters more than reading explanations. If you have only read about how SJT scoring works but have not actually rated a set of responses and then seen where your ratings diverged from the correct ones, you have not trained the right muscle. The feedback loop - where did I diverge and why - is what builds calibration over repeated attempts.

The verbal and numerical tests are not where your preparation time should be concentrated if you are already comfortable with them. Candidates repeatedly report that the SJT, not verbal or numerical, is the stage that determines Order of Merit position. Unlike verbal or numerical, where you are either right or wrong, the SJT lets you improve your score through better calibration rather than faster processing.

The format of the practice material also matters. The publicjobs SJT is not the same format as a UK civil service SJT. The rating scale format, the civil service values orientation, and the Irish workplace scenarios all require practice that reflects the actual test.

FAQ

Does the SJT count more than the verbal reasoning test for the Order of Merit?

Both the SJT and verbal reasoning contribute to the Order of Merit ranking. The numerical reasoning test is pass/fail only - it does not add to your OOM score. So while we cannot state exact weightings (PAS does not publish them), the SJT is critically important because it contributes to your ranking score rather than just qualifying you to proceed.

What happens if I get a high score on verbal and numerical but a low SJT score?

This is the most common disappointing outcome in the EO competition. Because numerical is pass/fail and does not affect your OOM position, a strong numerical performance does not offset a weak SJT. Your Order of Merit rank, which determines how quickly you are called for interview under the demand-led batch system, is driven by your SJT and verbal scores. A lower-third SJT score can leave you waiting considerably longer, even if the rest of your results were strong.

Is there a time limit on the SJT?

Publicjobs.ie does not publish a stated time limit for the SJT component specifically, and candidate reports vary. Check the publicjobs.ie test advice page and any instructions in your own competition invitation for the most accurate information on your specific assessment.

How do I know what the right answer is when two options seem equally valid?

This is the most common complaint from candidates - “the answer is often open to interpretation.” Two responses can appear equally reasonable when you do not have a clear framework for the underlying values and escalation logic. Practising with worked explanations, where the rationale for the expert rating is explained, closes that gap faster than completing practice tests alone.

Try before you commit

If you want to experience the rated-response format before your assessment date, the PublicServicePathway free taster gives you a set of Irish civil service scenarios with the full rating scale and immediate feedback. No card required, no commitment. It is the fastest way to find out where your calibration sits right now.

When you are ready to work through a full practice bank before your test date, the monthly plan is €39 (cancel anytime) or €149 for the year - both significantly more affordable than the €199/year workbook courses, and built specifically for the Irish assessment format rather than adapted from UK content.

Written by Maebh Collins, who has been through the publicjobs process first-hand more times than she would care to admit.

How SJT Ranked-Answer Scoring Actually Works