Research Methods Exam 3

Front 1

What are three types of research?

Back 1

Experimental, Quasi-experimental (Causal comparative), and nonexperimental.

Front 2

Describe correlational research.

Back 2

Use to examine relationships between 2 variables. It can also be used to predict behavior or performance.

Front 3

Describe descriptive research.

Back 3

Use to describe the characteristics of a phenomenon.

Front 4

T or F: In descriptive research, the experimenter does not manipulate independent variables.

Back 4

TRUE.

Front 5

What are the features of ____? How does ____ happen or contribute to a problem? What can we find out about ___? These are typical questions of ________ research.

Back 5

Descriptive

Front 6

How is data expressed in a descriptive research study?

Back 6

as a summary of information: categories, total number of something, % scores, means, standard deviations, mode, or some type of graphic representation of the data.

Front 7

Survey research, case studies, small group studies, and longitudinal studies are examples of ________ research.

Back 7

Descriptive

Front 8

Which type of research is this describing?: Group assignment and membershjip is pre-determined by classification of participants.

Back 8

Causal comparative (quasi-experimental)

Front 9

T or F: In a causal comparative study, you can randomly assign, but not randomly select.

Back 9

False. Can randomly select, but not assign.

Front 10

T or F: In experiemental research, you can randomly select and assign.

Back 10

True.

Front 11

In which type of research is there "matching"?

Back 11

Causal comparative

Front 12

Describe what experimental research design is...

Back 12

A design which allows for a true test of the difference based on cause/effect relationship. Researcher has complete control over cause.

Front 13

Which type of research uses control groups?

Back 13

Experimental

Front 14

What are some other names for single-subject research designs?

Back 14

N of 1 or Small n

Front 15

What type of research design would you use when you want to see the effect of some type of treatment for 1-3 individuals?

Back 15

Single-Subject

Front 16

Are case studies generally qualitative or quantitative?

Back 16

Qualitative

Front 17

What is a longitudinal study?

Back 17

Same people studied across time (specific).. takes a while

Front 18

What is a cross sectional study?

Back 18

Different people for a particular time frame (ex: 1-3 years). It's a little weaker than longitudinal (and easier).

Front 19

What is the age difference guideline for matching?

Back 19

6-12 months.

Front 20

Why do we "match" in causal comparative studies?

Back 20

To eliminate other variables that could influence the outcome.

Front 21

What is this an example of: What is the relationship between the number of credit hours a college student takes per semester and the amount of time they spend at the gym?

Back 21

Correlational Design

Front 22

What is this an example of: What is the difference between college males and females in the amount of exercise they do?

Back 22

Causal comparative

Front 23

What is this an example of: Is there a difference between the stress level of those who participate in an exercise program three times a week and those who don't exercise weekly?

Back 23

Experimental... one group needs to be forced to do the program and one group forced not to exercise.

Front 24

Single subject designs show us how _________ will respond.

Back 24

Individuals

Front 25

T or F: For single-subject studies... Observations of behaviors must be reliable-operationally defined.

Back 25

True

Front 26

T or F: You don't need any repeated observations for single-subject designs.

Back 26

False. 6-9 observations per segment.

Front 27

T or F: For single-subject studies... Stability in behavior should be established before treatment.

Back 27

True.

Front 28

Multiple baseline designs allow for multiple conditions or behaviors to be charted at once without spending long periods with each one.. T or F?

Back 28

True.

Front 29

Survey research designs tend to collapse data into _______/____ about people who respond to survey's.

Back 29

Percentages/totals

Front 30

What are three threats to internal validity on survey research designs?

Back 30

1) Subject selection
2) Attrition/Mortality
3) Instrumentation

Front 31

If you have less than __% return on a survey study, it could affect the quality of study.

Back 31

50%

Front 32

Generally, how long should it take to complete a survey?

Back 32

5-10 minutes

Front 33

What are two types of questions in a survey study?

Back 33

1) Closed form
2) Open form

Front 34

What is closed form (in survey study)? What are the advantages/disadvantages of using this form?

Back 34

Multiple choice/rating scale
Advantage: quicker/data consistency/easier
Disadvantage: no way to put something that matches perspective/ limits the respondance choice

Front 35

Is closed or open form most common?

Back 35

Closed.

Front 36

What are some advantages and disadvantages of open form survey questions?

Back 36

Advantages: Can tell how they feels bout____ from their words/less ambiguous
Disadvantages: limits # of people that can be surveyed/takes longer/more difficult

Front 37

Likert scale questions have _____ appearing intervals.

Back 37

Equal

Front 38

When asking survey questions, one should avoid asking ______ questions.

Back 38

Jargon

Front 39

There four things that you should emphasize in the cover letter of a survey study.. What are they?

Back 39

1) importance of the study
2) assurance of confidentiality (use code)
3) Offer to send results
4) Emphasize where and when to return the survey

Front 40

Should there be follow-up contact upon the sending of a survey?

Back 40

Yes

Front 41

What does positive correlation mean in correlational research?

Back 41

That the variables change in the same direction.

Front 42

What does negative correlation mean in correlational research?

Back 42

As one variable increases, one decreases.

Front 43

A straight line in a correlational study means...

Back 43

There is a perfect correlation.

Front 44

A circular pattern in a correlational study means...

Back 44

There is no correlation.

Front 45

Correlation is measured by the ____________________

Back 45

Pearson-Moment Correlation

Front 46

What is the Pearson equation?

Back 46

r = Degree x and y variables vary as a pair of scores (covariance)
________________________
degree x and y variables vary separately.

Front 47

T or F: Correlations do not measure cause and effect.

Back 47

True. Cannot imply that x causes Y even with a high correlation.

Front 48

To do the Pearson score, you need a minimum of __ pairs of scores.

Back 48

30

Front 49

What is it called when you square r (r^2)?

Back 49

Index of determination of coefficient of determination.

Front 50

The index of determination tells us...

Back 50

The amount of Y variance that is associated with changes in X variable.

Front 51

The index of determination is usually measured as a _______.

Back 51

Percentage

Front 52

Here is an example of how an index of determination works:

Back 52

r= .60, r2 = .36 or 36% of Y variance can be explained by knowing X.
This means that...
64% of the correlation is not accounted for (index of determination).

Front 53

What is an acceptable substitute for Pearson r?

Back 53

Spearman Rank Order Correlation

Front 54

The Spearman Rank Order Correlation is used for...

Back 54

small number of paired X and Y scores.

Front 55

The research questions must have an _______ basis.

Back 55

Empirical

Front 56

Is it better to look at group or individual performances?

Back 56

Individual differences.

Front 57

The type and number of people you obtain for your study is very important.. it should be representative of the population.. T or F?

Back 57

True.

Front 58

For the most part, would you consider using homogenous or heterogenous groups more often?

Back 58

Hetero because of the variability and randomness.

Front 59

What do the methods of a study typically include?

Back 59

1) participants
2) testing conditions (materials)
3) procedures
4) data analysis and reliabilitiy

Front 60

make sure to review..

Back 60

The charts and handouts in the notes!!!

Front 61

What are the four participant reactive effects called?

Back 61

1) Hawthorne Effect
2) John Henry Effect
3) Pygmalion Effect
4) Rosenthal Effect

Front 62

What is the Hawthorne Effect?

Back 62

If you know someone is watching, you will behave differently.

Front 63

What is the John Henry Effect?

Back 63

Relates to studies where groups are put in competition with one another.

Front 64

What is the Pygmalion Effect?

Back 64

Rosenthal discovered: If you tell someone they're smart, they will begin acting smart and other ppl treat them smart.

Front 65

What is the Rosenthal Effect?

Back 65

If you tell people what you hope to find, it may bias their behavior.

Front 66

T or F: It is the same guidelines for number of participants for each type of study.

Back 66

False. It depends on the type.

Front 67

T or F: Bigger is better when it comes to sample size of a study?

Back 67

True.

Front 68

Simple, Systematic, Stratified, and Cluster are types of what?

Back 68

Random Sampling

Front 69

What is the simple type of random sampling?

Back 69

Taking ppl and drawing names out of a hat/random # list

Front 70

What is systematic random sampling?

Back 70

Take every 3rd person on random # list until you get sample

Front 71

What is stratified random sampling?

Back 71

take sample that represents the different kinds of ppl that makes up population (PROPORTION)

Front 72

What is Cluster random sampling?

Back 72

Look at people in location (some from N, E, S, W, etc. Pieces of population which together represents region as a whole.

Front 73

Convenience, Snowball, Quote, Matched samples are types of what?

Back 73

Nonrandom sampling.

Front 74

What is convenience nonrandom sampling?

Back 74

Who I can get easily.

Front 75

What is Snowball nonrandom sampling?

Back 75

Ask participants to get other people.

Front 76

What is Quote nonrandom sampling?

Back 76

Target: need xx number of ppl (happens a lot in causal comparative).

Front 77

What is Matched samples nonrandom sampling?

Back 77

Need 10 year old in one group and 10 year old in other group.

Front 78

What are the 10 factors that affect the internal validity of a study?

Back 78

1) History
2) Maturation
3) Testing Effects
4) Practice Effects
5) Counterbalancing
6) Instrumentation
7) Statistical Regression
8) Subject Selection
9) Mortality/Attrition
10) Reactive effects: Hawthorne, John Henry, Pygmalion, Rosenthal.

Front 79

Which factor has to do with events that occur during the experiement (outside factors).

Back 79

History

Front 80

What are the two factors that involve multiple testing?

Back 80

History and Maturation

Front 81

What is Maturation?

Back 81

Changes that make the subject respond differently due to increased skills/knowledge that occur naturally (INSIDE FACTOR)-- bigger concern with children due to development.

Front 82

What is Testing Effects?

Back 82

When people take the same test shortly after the first administration, they will tend to remember how they answered previously. Pretest-posttest (teaching to the task).

Front 83

What would be a good way of eliminating the testing effect threat?

Back 83

Test again after some time has expired.

Front 84

What is Practice Effects?

Back 84

Similar to testing effects, but this is related to doing tasks repeatedly that leads to increases or decreases in performance.

Front 85

What does counterbalancing control for?

Back 85

The "order effects"

Front 86

What is counterbalancing?

Back 86

Responses that are affected by all subjects completing items or conditions in the same order. It controls for the "order effects" that could influence data.

Front 87

What is instrumentation with regards to a threat?

Back 87

Effects of the instrumentation that was used to collect the data. Biases and lack of calibration can affect the outcome of a study. There are different types of "instrumentation" that need to be calibrated when doing a study (electronic equipment, rating scales, surveys).

Front 88

What is statistical regression?

Back 88

People who do very well or very poorly on a task or behavior tend to regress toward the mean after a period of time or naturally as time passes. This effect is usually associated with participants with extreme scores/performance and these scores impact the results. Could affect the analysis of the group results.

Front 89

How can subject selection be a threat to internal validity?

Back 89

This is concerned with the way people are selected for the experiment in terms of random or nonrandom sampling. It also relates to how well the sample of people selected represent the population being studied. who and how people are selected for a study can impact the results.

Front 90

What is mortality/attrition?

Back 90

Refers to the loss of subjects or people dropping out of a study such as when it is required to participate in several testing sessions. It is also the effect associated with those who don't respond to a survey. If doing matching, it is often difficult to find a suitable replacement.

Front 91

What are the four reactive effects?

Back 91

1) hawthorne
2) John Henry
3) Pygmalion
4) Rosenthal

Front 92

What are the two factors that affect the external validity of a study?

Back 92

1) reactive effects (hawthorne, john henry, pygmalion, rosenthal)
2) Subject sampling, Size, and Representativeness

Front 93

What is the potential problem?: The researcher wants to measure subjects' anxiety while performing a timed math test. The researcher chooses to use a rating scale for measuring anxiety that he developed on his own for this experiment.

Back 93

Instrumentation

Front 94

What is the potential problem?: A researcher wants to know how children rate violence on TV. The researcher shows all of the children three different videos of three violent acts in the same order. The results show that the third videotape segment was rated the most violent act.

Back 94

Counterbalancing

Front 95

What is the potential problem?: During the experiment, the research encourages a few of the subjects to complete the experiment and says "you are doing fine."

Back 95

Pygmalion effect

Front 96

What is the potential problem?: A study require a subject to rate the duration of a sound as "normal" or "too long" and has 200 samples to listen to. The trial takes an hour to complete.

Back 96

Practice effects.

Front 97

What is the potential problem?: A researcher tells participants that the fitness study they are participating in will be compared to various groups in the company in order for the company to improve the health of employees as a way to cut down on health insurance costs.

Back 97

John Henry Effect

Front 98

What is the potential problem?: A survey is conducted and the researchers notice that the participants wrote comments on the side of the answers that indicate they are having difficulty selecting just one of the multiple choice items listed for several of the questions.

Back 98

Instrumentation-- poor survey that probably wasn't pilot tested.

Front 99

What is the potential problem?: A researcher is conducting some training with a random set of participants and asks the participants to answer a series of questions. The training lasts for 3 weeks. The researcher decides to analyze the participant response data by simply comparing pre-experiment and post-experiment responses to the questions.

Back 99

Testing effects, maturation, history (could practice outside of test environment)

Front 100

What is the potential problem?:
A researcher wants to do a survey of how people in lincoln react to smoking ban in restaurants and bars. What does the researcher need to consider when selecting people to interview?

Back 100

Subject selection- smokers and nonsmokers..
random sampling