Editorial material-photography illustration for What Does a Standard Score Mean?.

What Does a Standard Score Mean?

A standard score turns raw performance into a common scale so that a result can be interpreted relative to a reference distribution.

A standard score turns raw performance into a common scale so that a result can be interpreted relative to a reference distribution. Suppose you answer 42 items correctly on one test and 27 on another. Which performance is stronger? From the raw numbers alone, we cannot know. The tests may contain different numbers of items, differ in difficulty, measure different things or have been taken by different age groups. A raw score tells us what happened on the test. It does not automatically tell us what that performance means. A standard score solves part of this problem by transforming raw performance onto a defined scale relative to a reference distribution. IQ is one familiar example: many IQ composites are reported on a scale with mean 100 and standard deviation 15.

From raw score to relative position

Imagine a fictional reasoning test with 50 items. A raw score of 32 might be unusually high for one age group and ordinary for another. During standardization, the test developer collects data from a norm sample and determines how raw performances are distributed. The raw score can then be converted according to the scoring system into a standardized value. If the resulting score is 115 on a mean-100, SD-15 scale, it places the performance one standard deviation above the normative mean. The important point is that 115 does not mean 115 correct answers, 115 units of reasoning, or 15 percent more intelligence than a score of 100. The number expresses location on a conventional scale.

What is a z-score doing underneath the idea?

The simplest standard score in statistics is a z-score. It expresses how far a value lies from the mean in standard-deviation units: z = (observed score − mean) / standard deviation. A z of 0 is at the mean. A z of +1 is one standard deviation above it; −1 is one below. An IQ-type scale can be understood as a convenient rescaling. If the mean is set to 100 and the standard deviation to 15, a z of +1 corresponds to 115 and a z of −1 to 85. Actual psychological test scoring can be more complicated than directly applying this formula to an individual’s raw total. Tests may use age-specific conversion tables, scaled subtest scores and composite procedures established during norming. The formula explains the geometry of standardization; it is not a substitute for a test’s scoring manual.

Why create different standard-score scales?

Different testing systems choose different means and standard deviations for practical reasons. Some subtests use scales centered on 10; educational assessments may use other values. The particular numbers are conventions. What matters is knowing the scale. A score of 120 means something very different on a mean-100, SD-15 scale than on a scale centered elsewhere. This is why a naked number is not an interpretation.

Standard scores make comparison possible—but not unlimited comparison

Putting results on a common metric can help compare performances within a properly designed battery. It does not mean any two standardized scores from any two tests are interchangeable. Tests can measure different constructs, use different norm populations, have different reliabilities and cover different score ranges. Two scales can both have mean 100 and SD 15 while answering different questions.

Every standard score has uncertainty

Observed scores contain measurement error. Reliability tells us how consistently a test distinguishes people under specified conditions; the standard error of measurement helps quantify uncertainty around an observed score. That is why responsible reports often provide confidence intervals. A score of 100 should not be imagined as a point known with infinite precision. The underlying estimate is better represented as a plausible range. Small differences between scores can therefore be meaningless. If two composite estimates are 103 and 106, it may be unjustified to build a story around the three-point gap without considering reliability and the statistical procedures appropriate to that instrument.

What a standard score actually gives us

A standard score is a coordinate system for performance. It lets us say where an observed result lies relative to a defined reference distribution using a scale whose center and spread have known meanings. That is enormously useful. It allows raw performances to become interpretable measurements. But the transformation does not make the construct physical, eliminate uncertainty or turn a score into a complete description of the person who earned it. Standardization tells us how to locate the performance. Science still has to tell us what we are justified in inferring from that location.

References

  • AERA, APA, & NCME. (2014). Standards for Educational and Psychological Testing. AERA. Source
  • Crocker, L., & Algina, J. (1986). Introduction to Classical and Modern Test Theory. Holt, Rinehart and Winston. Source
  • Wechsler, D. (2008). WAIS–IV Technical and Interpretive Manual. Pearson. Source