Learning And Behavior Exam 3

Front 1

OPERANT CONDITIONING

Back 1

a type of learning in which the future probability of a behavior is affected by its consequences.

Front 2

LAW OF EFFECT

Back 2

the proposition that behaviors that lead to satisfying state of affairs are strengthened or "Stamped In" while behaviors that lead to unsatisfying or annoying state of affairs are weakened or "Stamped Out".

Front 3

OPERANT BEHAVIOR

Back 3

A class of emitted responses that result in certain consequences; these consequences, in turn, affect the future probability or strength of those behaviors.

Front 4

REINFORCER

Back 4

follows a behavior and increases the future probability of that behavior.

Front 5

PUNISHER

Back 5

follows a behavior and decreases the future probability of the behavior.

Front 6

EXTINCTION

Back 6

remove the reinforcer that follows behavior and wait for the behavior to fade.

Front 7

DISCRIMINATIVE STIMULUS

Back 7

a stimulus in the presence of which responses are reinforced and in the absence of which they are not reinforced; that is, a stimulus that signals the availability of reinforcement.

Front 8

THREE-TERM CONTINGENCY

Back 8

the relationship between a discriminative stimulus, an operant behavior and a reinforcer/punisher.

Front 9

POSITIVE REINFORCEMENT

Back 9

Consequence= something added, given or done to the individual.

Because of this consequence, the individual is more likely to repeat the behavior.

Front 10

NEGATIVE REINFORCEMENT

Back 10

Consequence= something being lost, removed or taken away.

Because of this consequence, the individual is more likely to repeat the behavior.

Front 11

POSITIVE PUNISHMENT

Back 11

Consequence= something being added, given, or don to the individual.

Because of this consequence, the individual is less likely to repeat the behavior.

Front 12

NEGATIVE PUNISHMENT

Back 12

Consequences= something lost, removed or taken from the individual.

Because of the consequence, the individual is less likely to repeat the behavior.

Front 13

ESCAPE BEHAVIOR

Back 13

a behavior that results in the termination of an aversive behavior.

Example: if you are getting rained on you open an umbrella.

Front 14

PRIMARY REINFORCER

Back 14

an event that is innately reinforcing.

Example: food, water, temperature etc.

Front 15

SECONDARY REINFORCER

Back 15

an event that is reinforcing because it has been associated with some other reinforcer.

Example: good marks and praise, studying and good grades etc.

Front 16

GENERALIZED REINFORCER

Back 16

a type of secondary reinforcer that has been associated with several other reinforcers.

Example: money is associated with food, entertainment, dating etc.

Front 17

INTRINSIC REINFORCEMENT

Back 17

reinforcement provided by the mere act of performing the behavior; the performance of the behavior is inherently reinforcing.

Example: Running because it gives you energy and is invigorating.

Front 18

EXTRINSIC REINFORCEMENT

Back 18

the reinforcement provided by a consequence that is external to the behavior or external reinforcer. Example: Only reading the textbook because you have an exam. Passing the exam is the extrinsic reinforcer.

Front 19

NATURAL REINFORCER

Back 19

reinforcers that are naturally provided for a certain behavior; that is, they are a typical consequence of the behavior within that setting.

Example: gold metals= training, hard work and good performance.

Front 20

CONTRIVED REINFORCER

Back 20

reinforcers that have been deliberately arranged to modify a behavior; they are not a typical consequence of the behavior in that setting.

Front 21

SHAPING

Back 21

the gradual creation of new operant behavior through reinforcement of successive approximations to that behavior.

Example:Sniffy-click lever when near to receive food, so as a result he stands near the lever more.

Front 22

EDWARD THORNDIKE

Back 22

created the puzzle box

Front 23

PUZZLE BOX

Back 23

put a hungry cat in a box with food outside of the box and in order for the cat to reach the food it has to learn how to escape by stepping on a treadle that opened the gate.

Front 24

FREE OPERANT

Back 24

the rat freely responds with a particular behavior for food, and is able to do so whenever he pleases.

Front 25

CLASS OF RESPONSES

Back 25

rat can press lever: fast or slow, hard or soft, left or right paw etc

Front 26

REINFORCEMENT

Back 26

reinforcing/ changing a behavior (strengthening).

Front 27

PUNISHMENT

Back 27

weakening behavior.

Front 28

SHEDULE OF REINFORCEMENT

Back 28

the response requirement that must be met to obtain reinforcement.

Front 29

CONTINUOUS REINFORCEMENT SCHEDULE

Back 29

a schedule in which each specified response is reinforced. Example: Sniffy gets a treat every time he touches the bar.

Front 30

INTERMITTENT REINFORCEMENT SCHEDULE

Back 30

a schedule in which only some of the responses are reinforced. Example: only some of the bar presses result in Sniffy receiving a food pellet.

Front 31

FIXED RATIO SCHEDULE

Back 31

a schedule in which reinforcement is contingent upon a fixed, predictable number of responses. Example: Sniffy has to press the bar 5 times to receive a treat.

Front 32

VARIABLE RATIO SCHEDULE

Back 32

a schedule in which reinforcement is contingent upon a varying, unpredictable amount of responses. Example: Sniffy has to press the bar an average of 5 times, sometimes it may be more or less.

Front 33

FIXED INTERVAL SCHEDULE

Back 33

a schedule in which reinforcement is contingent upon the first response after a fixed, predictable period of time. Example: The first lever press after a 30 sec period receives food.

Front 34

VARIABLE INTERVAL SCHEDULE

Back 34

a schedule in which reinforcement is contingent upon the first response after a varying, unpredictable period of time. Example: The first lever press after an average of 30 sec receives food, sometimes more or less than 30 sec.

Front 35

RATIO STRAIN

Back 35

a disruption of responding due to an overly demanding response requirement.

Example: Burn out. Heavy workload+use to getting by with minimal work= burnout and drop out of college.

Front 36

FIXED DURATION SCHEDULE

Back 36

a schedule in which reinforcement is contingent upon continuous performance of a behavior for a fixed, predictable period of time.

Example: Sniffy must run for 60 seconds to receive one pellet.

Front 37

VARIABLE DURATION SCHEDULE

Back 37

a schedule in which reinforcement is contingent upon continuous performance of a behavior for a varying, unpredictable amount of time. Example: Sniffy must run for an average 60 seconds to receive food, sometimes it will be more or less than 60 sec.

Front 38

DIFFERENTIAL REINFORCEMENT OF HIGH RATES

Back 38

a schedule in which reinforcement is contingent upon emitting at least a certain number of responses in a certain period of time- or more generally, reinforcement is provided for responding at a fast rate. Example: Sniffy receives a pellet if he hits the bar 30 times in a minute.

Front 39

DIFFERENTIAL REINFORCEMENT OF LOW RATES

Back 39

a schedule in which a minimum amount of time must pass between each response before the reinforcer will be delivered- or more generally, reinforcement is provided for responding at a slower rate. Example: Sniffy receives a pellet if he hits the bar after at least 10 seconds, but doesn't receive anything if he presses it before that time.

Front 40

NONCONTINGENT SCHEDULES

Back 40

response is not required to obtain the reinforcer.

Front 41

DRIVE REDUCTION THEORY

Back 41

an event is reinforcing to the extent that it is associated with a reduction in some type of psychological drive. Example: Food deprivation->hunger drive->seek out food.

Front 42

PREMACK PRINCIPLE

Back 42

the notion that a behavior can be used to reinforce a low-probability behavior.

Example: If Sniffy is hungry eating food is the higher-probability than running on a wheel, so food can be used to reinforce the lower-probability choice of running on the wheel.

Front 43

RESPONSE DEPRIVATION HYPOTHESIS

Back 43

the notion that a behavior can serve as a reinforcer when access to the behavior is restricted and its frequency thereby falls below its preferred level of occurrence.

Example: Sniffy likes to run for 1 hour (preferred level of running), if he is limited to 15 minutes (deprivation) he will be more willing to work for extra time on the wheel.

Front 44

BEHAVIORAL BLISS POINT

Back 44

the theory that an organism with free access to alternative activities will distribute its behavior in such a way as to maximize overall reinforcement. Example: if a rat can run freely between the wheel and the maze it may spend 1 hour running and 2 hours exploring.

Front 45

SCHEDULE EFFECTS

Back 45

the effects on behavior from different response requirements.

Front 46

STRETCHING THE RATIO

Back 46

moving from a low ratio requirement to a high ratio requirement. Example: moving from having to press the bar 2 times then 5 then 10 gradually moving up.

Front 47

DENSE SCHEDULE

Back 47

many more reinforcers.

Front 48

LEAN SCHEDULE

Back 48

less reinforcers

Front 49

EXTINCTION

Back 49

the non-reinforcement of a previously reinforced response, the result of which is a decrease in the strength of that response.

Example: lever press=food ---> lever press=no food over time this will cause extinction.

Front 50

RESISTANCE TO EXTINCTION

Back 50

the extent to which responding persists after an extinction procedure has been implemented.

Front 51

SPONTANEOUS RECOVERY

Back 51

the reappearance of an extinguished response following the rest period after extinction.

Front 52

DIFFERENTIAL REINFORCEMENT

OF OTHER BEHAVIOR

Back 52

reinforcement of any behavior other than a target behavior that is being extinguished.

Example: Child whining in store wanting candy, not only do you reinforce the non-whiney but also manners.

Front 53

STIMULUS GENERALIZATION

Back 53

the more similar the stimulus the stronger the response. Example: If the rat is used to responding to a tone of 2000 htz then it will respond to other tones similar, and stronger to tones closer such as 1800-2200 htz than to 1200 or 2800.

Front 54

SIDE EFFECTS OF EXTINCTION

Back 54

extinction burst

increase in variability

emotional behavior

aggression

resurgence

depression

Front 55

STIMULUS DISCRIMINATION

Back 55

in operant conditioning, the tendency for an operant response to be emitted more in the presence of one stimulus than another.

Example:

Front 56

EXPOSURE AND RESPONSE PREVENTION

Back 56

a method of treating obsessive compulsive behavior that involves prolonged exposure to anxiety-arousing events while not engaging in the compulsive behavior pattern that reduces the anxiety. Example: OCD cleaning- first touch door handles, then trash cans and then dead birds etc.

Front 57

LEARNED HELPLESSNESS

Back 57

a decrement in learning ability that results from repeated exposure to uncontrollable aversive events. Example: learned from inexscapeable shocks that it was pointless to try to get out.

Front 58

RESPONSE COST

Back 58

a form of negative punishment involving the removal of a specific reinforcer following the occurrence of a behavior.

Front 59

TIME-OUT

Back 59

a form of negative punishment involving the loss of access to positive reinforcers for a brief period of time following the occurrence of a problem.

Front 60

CONCURRENT SCHEDULES OF REINFORCEMENT

Back 60

a complex schedule consisting of the simultaneous presentation of two or more independent schedules, each leading to a reinforcer. Example: Pigeon given choice of blue 20 peck or green 50 pecks, and after a series of trials, the pigeon learns to pick the 20 more often.

Front 61

MATCHING LAW

Back 61

the principle that the proportion of responses emitted on a particular schedule matches the proportion of reinforcers obtained on that schedule.

Front 62

UNDERMATCHING

Back 62

a deviation from matching in which the proportion of responses on the richer schedule vs poorer schedule is less different than would be predicted by matching.

Front 63

OVERMATCHING

Back 63

a deviation from matching in which the proportion of responses on the richer schedule vs poorer schedule is more different than would be predicted by matching.

Front 64

BIAS FROM MATCHING

Back 64

higher than expected choice of one alternative despite the consequences. Example: Pigeon picks the blue disc every time because he likes the color blue.

Front 65

SELF-CONTROL

Back 65

with respect to choice between 2 rewards, selecting a larger later reward over a smaller sooner reward.

Front 66

IMPULSIVENESS

Back 66

smaller sooner > larger later.

Front 67

COMMITMENT RESPONSE

Back 67

an action carried out at an early point in time that serves to either eliminate or reduce the value of an upcoming temptation.

Front 68

SMALL BUT CUMULATIVE EFFECTS MODEL

Back 68

each individual choice on a self-control task has only a small but cumulative effect on our likelihood of obtaining the desired long-term outcome.

Front 69

PHYSICAL RESTRAINT

Back 69

physically manipulate the environment to prevent the occurrence of some problem behavior.

Front 70

DEPRIVING AND SATIATION

Back 70

altering the extent to which a certain event can act as a reinforcer. Example: skip lunch to ensure you are hungry at dinner.

Front 71

DOING SOMETHING ELSE

Back 71

to prevent yourself from doing one behavior you do an alternate behavior.

Front 72

SELF-REINFORCEMENT/PUNISHMENT

Back 72

reinforce your own behavior.

Front 73

MISCHEL'S DELAY OF GRATIFICATION PARADIGM

Back 73

given 2 items(food) and tell kid to stay to recieve the preffered item, if they sounded early, they recieved the smaller, less preffered of the two.