Standard 2.1

Front 1

standard 2.4

Back 1

each method of quantifying the precision or consistency of scores should be described clearly and expressed in terms of statistics appropriate to the method. The sampling procedures used to select examinees for reliability analyses and descriptive statistics on these samples should be reported.

Front 2

standard 2.5

Back 2

A reliability coefficient or standard error of measurement based on one approach should not be interpreted as interchangeable with another derived by a different technique unless their implicit definitions of measurements error are equivalent.

Front 3

standard 2.7

Back 3

When subjects of items within a test are dictated by the test specifications and can be presumed to measure partially independent traits or abilities, reliability estimation procedures should recognize the multifactor character of the instrument.

Front 4

standard 2.8

Back 4

Test users should be informed about the degree to which rate of work may affect examinee performance.

Front 5

standard 2.9

Back 5

When a test is designed to reflect rate of work, reliability should be estimated by the alternate-form or test-retest approach, using separately timed administrations.

Front 6

Standard 2.10

Back 6

When subjective judgement enters into test scoring, evidence should be provided on both inter-rater consistancy in scoring and within-examinee consistency over repeated measurements. A clear distinction should be made among reliability data based on
1- independent panels of raters scoring the same performances
2- single panel scoring successive performances or new products, and
3- independent panels scoring successive performances or new products.

Front 7

Standard 2.11

Back 7

If there are generally accepted theoretical or emperical reasons for expecting that reliability coefficients, standard errors of measurements, or test information functions will differ substantially for various subpopulations, publishers should provide reliability data as soon as feasible for each major population for which the test is recommended.

Front 8

Standard 2.12

Back 8

If a test is proposed for use in several grades or over a range of chronological age groups and if separate norms are provided for each grade or each age group, reliability data should be provided for each age or grade population, not solely for all grades or ages combined.

Front 9

Standard 2.13

Back 9

If local scores are employed to apply general scoring rules and principles specified by the test developer, local reliability data should be gathered and reported by local authorities when adequate size samples are available.

Front 10

Standard 2.17

Back 10

When a test is available in both long and short versions, reliability data should be reported for scores on each version, preferable based on a independent administration of each.

Front 11

standard 2.18

Back 11

When a significant variations are permitted in test administration procesures, separate reliability analyses should be provided for scores produced under each major variation if adequate sample sizes are available.