Validity And Reliability

Front 1

the degree to which data or results of a study are correct or true

Back 1

validity

Front 2

extend to which a question or scale is measuring the concept, attribute or property it says it is

Back 2

validity

Front 3

instrument which established validity that can be used as a standard for assessing other instruments.

Back 3

gold standard

Front 4

the degree to which results of the research study are generalizable

Back 4

external validty

Front 5

2 types of external validity

Back 5

1. ecological validity
2. population validity

Front 6

in order for an experiment to possess this validity, the methods, materials and settings of the experiment must approximate the real-life situation that is under study

Back 6

ecological validity

Front 7

not sufficiently described for others to replicate

Back 7

explicit description of the experimental treatment

Front 8

if the researcher fails to adequately describe how he or she conducted a study, it is difficult to determine whether the results are applicable to other settings

Back 8

explicit description of the experimental treatment

Front 9

catalyst effect

Back 9

multiple-treatment interference

Front 10

if a researcher were to apply several treatments, it is difficult to determine how well each of the treatments would work individually. it might be that only the combination of the treatments is effective

Back 10

multiple-treatment interference

Front 11

attention causes differences

Back 11

hawthorne effect

Front 12

subjects perform differently because they know they are being studied

Back 12

hawthorne effect

Front 13

anything different makes a difference

Back 13

novelty and disruption effect

Front 14

the treatment might have worked bec of the person implementing it. given a different person, the treatment might not work at all

Back 14

experimenter effect

Front 15

to everything there is a time

Back 15

interaction of history and treatment effect

Front 16

not only should researchers be cautious about generalizing to other population, caution should be taken to generalize to a different time period. as time passes, the conditions under which treatments work change

Back 16

interaction of history and treatment effect

Front 17

may only works with M/C tests

Back 17

measurement of the dependent variable

Front 18

a treatment may only be evident with certain types of measurements. a teaching method may produce superior results when its effectiveness is tested with an essay test, but show no differences when the effectiveness is measured with a multiple choice test

Back 18

measurement of the dependent variable

Front 19

it takes a while for the treatment to kick in

Back 19

interaction of time of measurement and treatment effect

Front 20

it may be that the treatment effect does not occur until several weeks after the end of the treatment. in this situation, a posttest at the end of the treatment would show no impact, but a posttest a month later might show an impact

Back 20

interaction of time of measurement and treatment effect

Front 21

a form of experimental validity. an experiment is said to possess this validity if it properly demonstrates a causal relation between two variables and not the result of extraneous factors

Back 21

internal validity

Front 22

threats to internal

Back 22

1. history
2. maturation
3. testing threat
4. instrumentation threat
5. statistical regression
6. selection
7. mortality

Front 23

threat to internal validity in which an outside event or occurrence might have produced effects on the dependent variable

Back 23

history

Front 24

produced by a previous administration of the same test or other measure.

Back 24

testing threat

Front 25

produced by changes in the measurement instrument itself.

Back 25

instrumentation threat

Front 26

threat to internal validity that can occur when subjects are assigned to conditions on the basis of extreme scores on a test

Back 26

statistical regression

Front 27

threat to internal validity that can occur when nonrandom procedures are used to assign subjects to conditions or when random assignment fails to balance out differences among subjects across the different conditions of the experiment

Back 27

selection

Front 28

threat to internal validity produced by differences in dropout rates across the conditions of the experiment

Back 28

mortality

Front 29

types of validity

Back 29

1. face validity
2. construct validity
3. content validity
4. criterion validity

Front 30

it pertains to whether the test looks valid to the examinees who take it, the administrative personnel who decide on its use, and other technically untrained observers

Back 30

face validity

Front 31

the relationship between an instrument and an established theoretical framework

Back 31

construct validity

Front 32

the extend to which the measures are demonstrably related to concrete criteria in the real world

Back 32

criterion validity

Front 33

types of criterion validity

Back 33

1. predictive validity
2. concurrent validity
3. discriminant validity

Front 34

the ability of an instrument to predict the occurrence of a future behavior or event

Back 34

predictive validity

Front 35

the degree to which the measurement being validated agrees with an established measurement standard administered at approximately the same time

Back 35

concurrent validity

Front 36

describes the degree to which the operationalization is not similar to (diverges from) other operationalizations that it theoretically should not be similar to

Back 36

discriminant validity

Front 37

the degree of consistency that a measuring method or device produces.

Back 37

reliability

Front 38

forms of reliability

Back 38

intrarater reliability
interrater reliablity

Front 39

the consistency of repeated measurements of the same observations by the same rater

Back 39

intrarater reliability

Front 40

the consistency of repeated measurements of the same observation by different raters

Back 40

interrater reliablity

Front 41

describes the degree to which the operationalization is not similar to (diverges from) other operationalizations that it theoretically should not be similar to

Back 41

discriminant validity

Front 42

the degree of consistency that a measuring method or device produces.

Back 42

reliability

Front 43

forms of reliability

Back 43

intrarater reliability
interrater reliablity

Front 44

the consistency of repeated measurements of the same observations by the same rater

Back 44

intrarater reliability

Front 45

the consistency of repeated measurements of the same observation by different raters

Back 45

interrater reliability