Condition And Learning, L:8

Front 1

Classical conditioning forms associations between stimuli, Operant conditioning forms an association between

Back 1

the behavior and the resulting events

Front 2

Thorndike's law of effect

Back 2

Rewarded behavior is likely to occur again

Front 3

Operant Chamber or Skinner Box

Back 3

contains bar or key that an animals manipulates to obtain a reinforcer like food or water

Front 4

What were Skinner's contributions to OC?

Back 4

Contingency effects and reinforcers

Front 5

Contingency

Back 5

Specified relationship between behavior and reinforcer

Front 6

The _____ determines the contingencies (Skinner?)

Back 6

environment

Front 7

Reinforcer

Back 7

An event (or termination of an event) that increase probability of a behavior

Front 8

Reinforcing stimulus

Back 8

An appetitive stimulus that follows a particular behavior and makes the behavior more likely to occur

Front 9

Punishing stimlus

Back 9

An aversive stimulus that follows a particular stimulus and makes the stimulus less likely to occur

Front 10

How do we measure operant conditioning?

Back 10

Evidence of learning is the frequency and consistency of responding

Front 11

Primary Reinforcer

Back 11

An activity whose reinforcing properties are innate (natural reinforcers, i.e food, water, sex, safety, comfort...)

Front 12

Secondary Reinforcer

Back 12

An event that has developed its reinforcing properties through its association with primary reinforcers (classically conditioned to occur with or provide access to primary reinforcers)

Front 13

How do secondary reinforcers gain control over behavior?

Back 13

Through their associations with the primary reinforcers

Front 14

Shaping

Back 14

Is the operant conditioning procedure in which reinforcers guide behavior towards the desired target behavior through successive approximations

Front 15

Immediate Reinforcer

Back 15

A reinforcer that occurs instantly after a behavior. A rat gets a food pellet for a bar press.

Front 16

Delayed Reinforcer

Back 16

A reinforcer that is delayed in time for a certain behavior.

e.g: A paycheck that comes at the end of the week.

Front 17

Continuous Reinforcement

Back 17

Reinforces the desired response each time it occurs.

Front 18

Partial Reinforcement. Effects:

Back 18

Reinforces a response only part of the time. Results in slower acquisition to begin but shows greater resistance to extinction later on.

Front 19

Fixed Ratio Schedule:

Produces what kind of response rate?

Back 19

A specific number of responses is needed to produce reinforcement.

Produces a consistent response rate.

Front 20

Talk about an FR schedule with the number indicating:

Continuous reinforcement is an?

Back 20

How many responses are needed before a reinforcer is given.

FR1

Front 21

Features of a Fixed Ratio schedule?

Back 21

Post-Reinforcement Pause

Front 22

Post-Reinforcement Pause

Back 22

A pause in behavior following reinforcement on a ratio schedule, which is followed by resumption of responding at the intensity characteristic of that ratio schedule

Front 23

What will make a Post-Reinforcement pause morel likely to occur?

Back 23

The higher the number of responses needed to obtain reinforcement

Front 24

For a P-R pause, the higher the ratio schedule,

Back 24

the longer the pause

Front 25

For a P-R pause, the greater the satiation,

Back 25

the longer the pause

Front 26

Example of an FR schedule in real life:

Back 26

Gardener who is paid after each yard done.

Front 27

Variable Ratio Schedule

Back 27

An average number of responses produces reinforcement, but the actual number of responses required to produce reinforcement varies over the course of training

Front 28

Features of a VR schedule:

Back 28

Produces consistent rate of responding

Very hard to extinguish

Post-reinforcement pauses occur only occasionally

Front 29

Between FR and VR schedules, which has the higher rate of responding?

Back 29

VR, but confusing data

Front 30

Real life example of a VR schedule:

Back 30

Fishing

Front 31

Fixed Interval schedule

Back 31

Reinforcement is available only after a specified period of time and the first response done after the interval is reinforced

Front 32

A pattern of behavior characteristic of Fixed Interval schedules, where responding...

Back 32

stops after reinforcement and then slowly increases as the time approaches when reinforcement will be available.

Front 33

Scallop effect occurs under which schedule?

Back 33

FI

Front 34

The length of the pause on an FI schedule is affected by:

Back 34

Experience: the ability to withhold the response until close to the end of the interval increases with experience.

The pause is longer with FI schedules

Front 35

Real life example of FI schedule:

Back 35

Kids who wait until friday to do chores, knowing thats when their mother gets paid and thus they can get paid

Front 36

Variable Interval schedules:

Back 36

An average interval of time between available reinforcers, but the interval varies from one reinforcement to the next contingency

Front 37

Differential Reinforcement of high rates of responding schedule

Back 37

Schedule of reinforcement in which a specified high number of responses must occur within a specified time in order for reinforcement to occur.

Front 38

For DRH schedules there is what kind of limit to responding?

Back 38

Time limit

Front 39

How effective are DRH schedules?

Back 39

Extremely

Front 40

Differential Reinforcement of Low Responding Schedule

Back 40

Schedule of reinforcement in which an interval of time must elapse before a response delivers reinforcement

Front 41

Real life example of DRL schedule:

Does is effectively control behavior?

Back 41

Kid being told if he can be quiet for 20 minutes he can have ice cream.

Effectively controls behavior

Front 42

Differential Reinforcement of Other Behaviors Schedule

Back 42

Schedule of reinforcement in which the absence of a specific response within a specified time leads to reinforcement

Widely used in behavioral modification

Front 43

Real life example of a DRO:

Back 43

Giving a student who obnoxiously interrupts class a piece of candy if they can stay quiet for 5 minutes, then progressively upping it to 10,15,etc...

Front 44

What is the importance of contiguity in operant conditioning>?

Back 44

Lack of delay is important. Reinforcers can lead to the acquisition of an operant response if it immediately follows

Front 45

What could bridge the interval and reduce the impact of delay?

Back 45

Presence of a secondary reinforcer

Front 46

What would make a task be learned faster?

Back 46

Magnitude of reward. Differences in performance may reflect motivational differences

Front 47

Depression effect (also called?)

Back 47

Also called negative contrast. Effect in which a shift from high to low reward magnitude produces a lower level of response than if the reward magnitude had always been low

Front 48

Elation Effect (also called?)

Back 48

Positive contrast. Effect in which a shift from low to high reward magnitude produces a higher level of response.

Front 49

How long do contrast effects last?

Back 49

Short amount of time

Front 50

What seems to play a role in the negative contrast effect?

Back 50

Frustration

Front 51

What may explain the positive contrast effect?

Back 51

Emotional response of elation

Front 52

Premack's Probability-Differential Theory

Back 52

Any activity or behavior that has a higher probability can serve as a reinforcer for an activity or behavior with a lower probability

Front 53

Premack's principle is effective in producing...

Example:

Back 53

behavior changes

Ex: Eating your vegetables in order to eat dessert

Front 54

Response Deprivation Theory

Back 54

When you deprive an organism of its usual responsiveness for something then the organism will want to get it back up to its usual levels

Anything that you deprive an organism of becomes a reinforcer

Front 55

What factors contribute to resistance to extinction?

Back 55

1. Reward magnitude

2. Schedule of reinforcement

Front 56

Influence of reward magnitude on resistance is dependent on

Back 56

the amount of acquisition training

Front 57

What type of reward will produce slower extinction?

Back 57

Small reward during acquisition as the frustration of not obtaining the reward will be smaller

Front 58

Extinction is slower following ______ rather than _____ reinforcement

Back 58

Partial; Continuous

Front 59

Partial Reinforcement Effect

Back 59

Greater resistance to extinction of an operant response following intermittent rather than continuous reinforcement

Front 60

2 theories of they the PRE occurs:

Back 60

1. Frustration Theory

2. Sequential Theory: If reward follows nonreward, the animal will associate the memory of the nonrewarded experience with the operant response