Research Design

Front 1

3 Scientific Method Steps

Back 1

1. Hypothesis (propose relat bw 2 variables - A effect B)
2. Obj define (specify what should be observed)
3. Collect and analyze data

Front 2

Independent variable

Back 2

Experimental - IV - Input - event or tx manip by researchers
Correl - no manip - Predictor

Front 3

Dependent variable

Back 3

Experimental - DV- Output - What is hypo to change as result of manip to IV
Correl - Criterion

Front 4

Research question

Back 4

What effect does (IV) have on (DV)?

Front 5

Levels of the IV

Back 5

One tx (IV) and 3 levels (drug, psychtx, dru plus psychtx)

Front 6

Multiple IVs - Factorial Design

Back 6

Combine every level of one IV with another IV and its levels - 2 levels of scz with 3 levels of tx (2 x 3 factorial design)

Front 7

Internal Validity

Back 7

Its possible to determine whether a causal relation exist bw the IV and DV (rather than extraneous) - or if a study does NOT have a causal relat

Front 8

One group, pre/post test design

Back 8

Very poor internal validity bc effects are largely due to extraneous variables (AKA confound or study is confounded)

Front 9

Major principle of ensuring validity

Back 9

Equivalence

Front 10

Threats to internal validity: History

Back 10

Any external event that effects scores or status on DV

Front 11

Threats to internal validity: Maturation

Back 11

Internal (bio or psy) change that occurs in subj while the exp is in progress and exerts a systematic effect on DV.
Ex. Fatigue, boredom, hunger, physical or intellectual devel

Front 12

Threats to internal validity: Testing

Back 12

Pre/post test in one group - Experience on pre effects post not IV

Front 13

Threats to internal validity: Instrumentation

Back 13

Change in DV bc of nature of measuring instrument has changed (Asmt ability improved) Use highly reliable meas instru

Front 14

Threats to internal validity: Statistical Regression

Back 14

Tendency of extreme (high/low) scores fall closer to the mean upon re-testing - dep appear less dep after re-testing due to stat regres

Front 15

Threats to internal validity: Selection

Back 15

Pre-existing subj factors (motiv, self-esteem, intell)

Front 16

Threats to internal validity: Differential Mortality

Back 16

2+ groups - drop out differs in systematic ways from people who remain in study

Front 17

Threats to internal validity: Experimental Bias

Back 17

1. Communicate expectations
2. Pygmalion effect (teachers preconceived notions of students ability results in increased grades and IQ)
3. Makes errors in direction to confirm hypoth
- double blind tech - control this problem

Front 18

Equivalence Techniques: Random Assignment

Back 18

Most powerful method
The prob of being assigned to a group is the same for all subj in experiment - all extraneous variable are distributed equally

Front 19

Equivalence Techniques: Matching

Back 19

Id subj who are similar in terms of status on extra variables (pretest) then grouping similar and randomly assign members of matched group to tx groups.

Used when sample size is small and random cannot ensure equiv

Front 20

Equivalence Techniques: Blocking

Back 20

Making an extraneous variable an IV - how they work in combo - interaction and how they work separately

Front 21

Equivalence Techniques: Holding the extraneous variable constant

Back 21

Using only people who are homogenous in the terms of extra variable in control and experimental groups. Therefore diff not attrib to extra
Disadv: cannot be generalized to populations not sampled

Front 22

Equivalence Techniques: ANCOVA (analysis of variance)

Back 22

Statistically adjusting data - post hoc matching - scores are adjusted so that subj are equalized - only controls ID extra variables

Front 23

External Validity

Back 23

Generalizability of results of study - to settings, time, people

Front 24

Threats to external validity: Interaction bw Selection and Tx

Back 24

"Interaction" variable has a effect on one but diff on other - not generalizeable.
Tx would not gen to other pop

Front 25

Threats to external validity: Interaction bw History and Treatment

Back 25

Do not generalize beyond setting, time period which experiment was done

Front 26

Threats to external validity: Testing and treatment

Back 26

Not gen in where pretests not used - Pretest sensitization (sensitize to purpose of research and increase response to tx)

Front 27

Threats to external validity: Demand characteristics

Back 27

Cues in research setting to guess hypoth - behave diff than in real world to prove or disprove hypoth

Front 28

Threats to external validity: Hawthorne Effect

Back 28

Know they are participating and bx diff

Front 29

Threats to external validity: Order Effects

Back 29

Repeated measures design - expose to more than one tx

Front 30

Ways to increase External Validity: Random Selection

Back 30

Ensure can be gen to pop
Stratified Random Sampling: Take random sample from subgroup of target pop
Cluster Sampling: Selecting from natural group of indiv.

Front 31

Ways to increase External Validity: Naturalistic Research

Back 31

Obs and recorded in nat setting or similar to natural - lack internal validity
Analogue research - make analogies about real world phenom from lab -lack external valid

Front 32

Ways to increase External Validity: Single and double blind research

Back 32

Single: Sbj not informed
Double: experimenter and and sbj not informed
- demand and hawthorne effect

Front 33

Ways to increase External Validity: Counterbalancing

Back 33

Controlling order effects - diff sbj or groups receive tx in diff order.
Latin square design each order appears once.

Front 34

True experimental research

Back 34

Random assign and diff levels of IV - Greatest internal validity (experimenter has control over conditions)

Front 35

Quasi-experimental research

Back 35

No random assign - use existing groups - 2nd best internal validity

Front 36

Correlational Research

Back 36

Variables are measured not controlled
Does NOT have internal validity - cannot infer causal relationship - researchers has no control
Association is bw variables is point of interest for the purpose of prediction -status of one variable (predictor) can predict the status of another (criterion

Front 37

Ways to increase External Validity: Single and double blind research

Back 37

Single: Sbj not informed
Double: experimenter and and sbj not informed
- demand and hawthorne effect

Front 38

Ways to increase External Validity: Counterbalancing

Back 38

Controlling order effects - diff sbj or groups receive tx in diff order.
Latin square design each order appears once.

Front 39

True experimental research

Back 39

Random assign and diff levels of IV - Greatest internal validity (experimenter has control over conditions)

Front 40

Quasi-experimental research

Back 40

No random assign - use existing groups - 2nd best internal validity

Front 41

Correlational Research

Back 41

Variables are measured not controlled
Does NOT have internal validity - cannot infer causal relationship - researchers has no control
Association is bw variables is point of interest for the purpose of prediction -status of one variable (predictor) can predict the status of another (criterion)

Front 42

Correlational Research

Back 42

Collect data on variables and apply correlational statistics.

Front 43

Developmental Research: 3 types

Back 43

Longitudinal, cross-sectional, and cross sequential

Front 44

Longitudinal Design

Back 44

Same people studied over long time.
Problems: High cost, drop out, practice effects, low level of age related decline bc those that stay in have higher ability, true age-related declines in perf may be masked.

Front 45

Cross-Sectional Design

Back 45

Diff groups of sbj divided by age are studied at same time.
Problem cohort effects (diff may have to do w/ experience) - overestimate true age-related declines in perf

Front 46

Cross-Sequential Design

Back 46

Combines Longit and cross sect. Diff groups assessed on 2+ occassions.
Control for cohort effect, less time and drop out

Front 47

Time Series Design

Back 47

Taking mult measure over time (diff pre-post test)
Rule out threats to internal valid: maturation, regression and testing
Threat: is history - control using 2 group (control group).

Front 48

Single subject design

Back 48

Bx modif: variability in target bx threat
AB, Reversal, and Multiple baseline designs

Front 49

AB design

Back 49

Single baseline and single tx phase - compounded

Front 50

Reversal (W/D) Design

Back 50

controls extra factor. Tx is w/d to see if return to baseline to be sure if tx works - ABA, ABAB (adv: confirm tx effic, if end in baseline leaving sbj in original condition.

Front 51

Multiple Baseline design

Back 51

Used when reversal is not possible - cant w/d tx
Apply tx sequentially across diff baselines - diff bx, diff settings, diff sbj

Front 52

Qualitative (descriptive) Research

Back 52

Theory devel from data - pilot study
Methods: participant obs, nonparticipant, obs, interview, surveys, case studies

Front 53

Surveys

Back 53

Attitude meas, consumer pref, worker satis.
3 Tech: Personal interview, telephone, mail.
Internal valid: not prob bc not causal relat is hypoth
External valid: random sampling, mail is biased

Front 54

Case Studies

Back 54

Can be viewed as an example of a more general class.
No relation bw variables - lack in/external valid
Useful as pilot

Front 55

Protocol Analysis

Back 55

Collect and analy verbatim reports - based on interp

Front 56

Greatest Threat to Interval Validity when a Mail Survey is conducted?

Back 56

Selection: Self select to reply

Front 57

Regarding the diff types of devel research this is most true

Back 57

Combining the method of cross sect and longit - cross sequent reduce many prob assoc w/ both

Front 58

Defining feature of a true exp design is

Back 58

Random selection of sbj from pop

Front 59

Francis Galton's concept of regression to the mean is best expressed by this statement

Back 59

Short fathers have taller sons - Regress - extreme obs to be less extreme upon re-test or re-obs. Indiv

Front 60

Conclusion of Hawthorne's Study is best described by

Back 60

Any change in the working env that results in increased attention for workers may result in increased productivity

Front 61

Is not true about multiple baseline designs

Back 61

Involve admin and w/d of tx
coorect sequent applic of tx across diff baselines (bx, setting, sbj)

Front 62

Major Threat to Internal Validity in a one group time series design is

Back 62

History - involves admin mult pre/post test - any external event that occurs while tx is admin

Front 63

Major adv of case studies

Back 63

Used to ID variables for future research

Front 64

Major disadv of case studies is

Back 64

Do not permit conclusion to be made about the causal relationship bw variables