Chapter #5

Front 1

Instrumental Conditioning

Back 1

consequence of behavior determine whether it will be repeated in the future.

the consequences of behavior are important because we LEARN from them.

Front 2

Discrete Trial Procedures

Back 2

each training trial ends with removal of the animal from the apparatus, and the instrumental response is performed only ONCE during each trial.

the animal makes ONE response in a trial.

Front 3

Free Operant Procedures

Back 3

in contrast to discrete trial procedures, this procedure allows for the animal to repeat the instrumental response without constraint over and over again.

we can look at qualitative properties of the stimulus by changing the outcome.

Front 4

Thorndike's Law of Effect

Back 4

this states that if a response in the presence of a stimulus is followed by a satisfying event, the association between the stimulus and the response is strengthened.

if the response is followed by an annoying event, the S-R association is weakened.

*according to the law of effect, what is learned is an association between the response and the stimuli present at the time of the response.

The consequence of the response is not one of the elements in the association.

Front 5

Instrumental Behaviors

Back 5

behaviors that require an organism to do something such as solving a problem, or manipulating events in the environment.

something that can be done to solve a problem.

Front 6

Reinforcement

Back 6

this means that the <u>procedure</u> is reinforcing. The behavior is going to increase.

Front 7

Punishment

Back 7

this means that the <u>procedure</u> is punishing, and the behavior is going to decrease.

Front 8

Positive

Back 8

a stimulus is added.

Front 9

Negative

Back 9

a stimulus is removed.

Front 10

Shaping

Back 10

reinforcement of successive approximations to a desired instrumental response.

Front 11

Instrumental Conditioning Procedures

Back 11

1. Participant makes a response
2. This produces an outcome
3. Response ---> Outcome of Relationship

Front 12

Quality and Quantity

Back 12

both can affect the reinforcing or punishing value of an outcome.

generally more outcome, ---> more effect.

more desirable/aversive outcome ---> more effect

Front 13

Positive Contrast

Back 13

increased activity resulting in an outcome after prior experience with a less attractive outcome.

Front 14

Negative Contrast

Back 14

decreased responding for an unfavorable reward because of prior experience with a better one.

Front 15

Outcome-Belongingness

Back 15

According to this concept, certain responses naturally belong with the reinforcer because of the animal's evolutionary history.

Front 16

Temporal Factors

Back 16

the temporal relation refers to the time between the response and the reinforcer.

the outcome should come shortly after the response for maximal association effect.

Front 17

Secondary or Conditioned Reinforcer

Back 17

a conditioned stimulus that was previously assocated with the reinforcer.

verbal prompts such as "good", or "keep going" are conditioned reinforcers that can provide immediate reinforcement for appropriate behavior.

conditioned reinforcers serve to "bridge" a delay between the instrumental response and delivery of the primary reinforcer.

Front 18

Marking

Back 18

this facilitates learning with delayed reinforcement by marking the target instrumental response. this can be done by introducing a brief light or noise to show that the "correct" response was made.

this serves to allow for a delay of the reinforcement.

Front 19

Response-Reinforcer Contingency

Back 19

We learn about the relationships of response and reinforcers, independent of temporal factors.

Front 20

Learned Helplessness

Back 20

animals can perceive the contingency between their behavior and the delivery of a reinforcer. animals learn that the shocks are independent of their behavior: there is nothing they can do to control the shocks.

this reduces motivation to respond and disrupts subsequent instrumental conditioning.

Front 21

Superstitious Behavior

Back 21

sometimes there is no connection between a response and an outcome.

a random behavior may be reinforced by a random reward.

sometimes we make connections that are not there.