Chapter 6

Front 1

operant beavhior

Back 1

Behaviors that are influenced by their consequences

Front 2

operant conditioning

Back 2

The effects of those consequences upon behavior. called this because the response operates on the environment to produce a conseqence

Front 3

Operant conditioning is aka

Back 3

instrumental conditioning

Front 4

operant behaviors are influenced by their

Back 4

consequences

Front 5

Elicited behavior is a function of what _____ it

Back 5

precedes

Front 6

operant behavior is a function of what ____ it

Back 6

follows

Front 7

Who was the first to experiment in operant conditioning?

Back 7

Thorndike

Front 8

Thorndike was famous for

Back 8

puzzle box

Front 9

law of effect

Back 9

behaviors leading to a satisfying state of affairs are strengthened or "stamped in" Behaviors unsatisfying or annoying are "stamped out"

Front 10

Skinner produced one of the best-known apparatuses in experimental psychology known as the ___________

Back 10

skinner box

Front 11

Skinners procedure is known as the __ because the rat freely responds with a particular behavior

Back 11

"free-operant"

Front 12

Thorndike's cats learned to solve the puzzle box problem ________

Back 12

gradually

Front 13

Based on his research with cats, Thorndike formulated his famous ________ which states that behaviors that lead to a satisfying state of affairs are strengthened, while behaviors that lead to an unsatisfying state of affairs are weakened.

Back 13

law of effect

Front 14

According to Thorndike, behaviors that worked were ________ while behaviors that did not work were __________-

Back 14

stamped in; stamped out

Front 15

The operant conditioning process can be conceptualized as involving three components:

Back 15

1. a response that produces a certain consequence

2. the consequence that serves to either increase or decrease the probability of the response that preceded it

3. a dsicriminative stimulus that precedes the response and signals that a certain consequence is now available.

Front 16

operant behavior

Back 16

is a class of emitted responses that result in a certain consequences; these consequences in turn, affect the future probability or strength of those responses.

Front 17

operant behaviors are technically said to be ______________

Back 17

elicited by the organism

Front 18

operant behaviors appears to have more ________ _________ quality to it compared to elicited behavior, which is generally more reflexive and automatic.

Back 18

voluntary; flexible

Front 19

operant behavior is usually defined as a _____ _____ with all the responses in that _____ capable of producing the consequence.

Back 19

class of responses

Front 20

Skinners definition of operant conditioning differs from Thorndikes law of effect in that it views consequences in terms of their effect upon the strength of behavior rather than whether they are _________ or __________

Back 20

satisfying or annoying

Front 21

Operant conditioning is similar to the principle of natural selection in that an individuals behaviors that are _________ tend to increase in frequency, while behaviors that are ___________ tend to decrease in frequency

Back 21

adaptive;nonadaptive

Front 22

Classically conditioned behaviors are said to be _______ by the stimulus, while operant behaviors are said to be _______ by the organism

Back 22

elicited; emitted

Front 23

The second component of an operant conditioning procedure is the consequence that either ________ or __________ the frequency of a behavior

Back 23

increases( strengthen); decreases (weakens)

Front 24

Consequences that strengthen a behavior are called _______

Back 24

Reinforcer; it follows that behavior and the future probability of that behavior increases

Front 25

punisher

Back 25

it follows a behavior, and the future probability of that behavior decreases

Front 26

Strengthening a roomates tendency toward cleanliness by thanking her when she cleans the bathroom is an example of ______ , while the thanks itself is a ________

Back 26

reinforcement; reinforcer

Front 27

Eliminating a dogs tendency to jump up on visitors by scolding her when she does so is an example of _______, while the scolding itself is a _________

Back 27

punishment; punisher

Front 28

Reinforcers and punishers are defined entirely by their _________ on behavior. For this reason the term reinforcer is often preferred to the term ___ because the latter is too closely associated with events that are commonly regarded as peasant or desirable.

Back 28

effect; reward

Front 29

When Moe stuck his finger in a light socket, he received an electric shock. as the result, he now sticks his finger in the light socket as often as possible. By definition the electric shock was a _______ because the behavior it followed has _______ in frequency

Back 29

Reinforcer; increased

Front 30

Each time Edna talked out in class, her teacher immediately came over and gave her a hug. As a redsult, Edna no longer talks out in class. By definition, the hug is a _________ because the behavior it follows has ______ in frequency

Back 30

punisher, decreased

Front 31

When we give a dog a treat for fetching a toy, are we attempting to reinforce:

(a) the behavior of fetching the toy

(B) the dog that fetched the toy

Back 31

the behavior of fetching the toy

Front 32

Weakening a behavior through the withdrawal of reinforcement for that behavior is known as ___________

Back 32

extinction

Front 33

Clayton stopped plugging in the toaster afer he received an electric shock while doing so. This is an example of __________

Back 33

Punishment

Front 34

Manzar stopped using the toaster after it no longer made good toast. This is an example of __________

Back 34

extinction

Front 35

Three-term contingency

Back 35

The discriminative stimulus, operant behavior, and the reinforcer or punisher

Front 36

discriminative stimulus

Back 36

a stimulus that signals that a response will be punished (S dp)

Front 37

a water bottle signals that meowing will result in being sprayed with water. The water bottle is the _____

Back 37

Discriminative stimulus

Front 38

discriminative stimulus for extinction

Back 38

stimulus that signals the absence of reinforcement.

Front 39

Operant conditioning procedure usually consists of three comonents

Back 39

discrimative stimlus, operant response, conseqence

Front 40

a discriminative stimulus is said to ____________ for the behavior, meaning that its presence makes the response _____- likely to occur

Back 40

set the occasion; more

Front 41

The three-term contingency can also be thought of as the ABC sequence, where

Back 41

A- antecedent event

B- behavior

C- consequence

Front 42

Another way of thinking about the three-term contingency is that you ________ something ___ something, and ______ something

Back 42

notice, do, get

Front 43

A stimulus in the presence of which a response is punished is called a ___________ for __________. it can be given the symbol ____

Back 43

discrimative stimulus; punishment; Sp

Front 44

4 basic types of contingencies

Back 44

1) positive reinforcement

2) negative reinforcement

3) positive punishment

4) negative punishment

Front 45

When combined with the words reinforcement or punishment, the word ______ means only that the behavior is followed by the presentation or addition of something.

Back 45

positive

Front 46

The event of a positive reinforcement or punishment can be either

Back 46

pleasant (receiving compliment) unpleasant (getting yelled at)

Front 47

The word positive, when combined with the words reinforcement or punishment, means only that the behavior is followed by the _________ of something.

Back 47

presentation

Front 48

When combined with the words reinforcement or punishment, the word negative means only that the behavior is followed by the ________ of something.

Back 48

withdrawal

Front 49

The word positive, when combined with the words reinforcement or punishment _______ mean the consequence is good or pleasent

Back 49

does not

Front 50

Within the context of reinforcement and punishment, positive refers to the _____ of something, and negative refers to the _______ of something

Back 50

addition; subtraction

Front 51

Reinforcement is related to a _______ in behavior, whereas punishment is related to a _________ in behavior

Back 51

increase; decrease

Front 52

Positive reinforcement:

Back 52

consists of the presentation of a stimulus following a response, which then leads to an increase in the future strength of that response.

Front 53

Negative reinforcement:

Back 53

is the removal of a stimulus following a response, which then leads to an increase in the future strength of that response

Front 54

Escape behavior:

Back 54

results in the termination (stopping) of an aversive stimulus. (ex: taking asprin stops a headache)

Front 55

avoidance behavior

Back 55

occurs before the aversive stimulus is presented therefore prevents its delivery. ex: umbrella were opened before stepping out into the rain, the person would avoid getting rained on.

Front 56

Negative reinforcement involves two types of behavior:

Back 56

escape behavior; avoidance behavior

Front 57

When you reached toward the dog, he nipped at your hand. You quickly pulled your hand back. as a result, he now nips at your hand whenever you reach toward him. The consequence for the dogs behavior of nipping consisted of the ______- of a stimulus and his behavior of nipping subsequently ___________ this is an example of ______________

Back 57

removal; increased; negative reinforcement

Front 58

when the dog sat at your feet and whined during breakfast one morning, you fed him. As a result, he sat at your feet and whined during breakfast the next morning. The consequence for the dogs whining consisted of the _________- of a stimulus, and his behavior of whining subsequently _______--- this is an example of __________

Back 58

presentation; increased, positive reinforcement

Front 59

positive punishement

Back 59

consists of the presentation of a stimulus following a response, which then leads to a decrease in the future strength of that response.

Front 60

Negative punishement

Back 60

consists of the removal of a stimulus following a response, which then leads to a decrease in the future strength of that response.

Front 61

When sasha was teasing the dog, it bit her. as a result, she no longer teases the dog. The consequence for sashas behavior of teasing the dog was the ________ of a stimulus, and the teasing behavior subsequently _______--- this is an example of:

Back 61

presentation; decreased; positive punishment

Front 62

Whenever Sasha pulled the dogs tail, the dog left and went into another room. as a result, sasha now pulls the dogs tail less often when it is around. the consequence for pulling the dogs tail was the _______- of a stimulus, and the behavior of pulling the dogs tail subsequently _______- in frequency, this is an example of __________

Back 62

removal; decreased; negative punishment

Front 63

in general the more _ _______ the reinforcer, the stronger its effect on the behavior.

Back 63

immediate

Front 64

It is sometimes difficult for students to study in that the reinforcers for studying are _________ and therefore ________, whereas the reinforcers for alternative activities are _______ and therefore ________-

Back 64

delayed; weak

immediate; strong

Front 65

It has been suggested hat delayed reinforcers ______ function in the same manner as immediate reinforcers.

Back 65

do not

Front 66

primary reinforcer

Back 66

aka unconditioned reinforcer: those things we are born to like rather than learn to like. ex: food, water, proper temperature

Front 67

Secondary reinforcer

Back 67

conditioned reinforcer: is an event that is reinforcing because it has been associated with some other reinforcer. events that we have learned to like because they have become associated with other things that we like.

Front 68

generalized reinforcer

Back 68

type of secondary reinforcer that has been associated with several other reinforcers. for example; money is a powerful generalized reinforcer for humans because it is associated with an almost unlimited array of other reinforcers.

Front 69

Events that are innately reinforcing are called ___________

Back 69

primary reinforcers.

Front 70

Events that become reinforcers through their association ith other reinforcers are called _______

Back 70

secondary reinforcers

Front 71

Honey is for most people an example of _____-

Back 71

primary reinforcer

Front 72

a coupon that is used to purchase honey is an example of

Back 72

secondary reinforcer

Front 73

A ___ that has been associated with an appetitive ______ can serve as a secondary reinforcer for an operant response

Back 73

CS; US

Front 74

a generalized reinforcer is a secondary reinforcer that has been associated with

Back 74

many other reinforcers

Front 75

Two generalized secondary reinforcers that have strong effect on human behavior are

Back 75

money; attention

Front 76

intrinsic reinforcement

Back 76

reinforcement provided by the mere act of performing the behavior

Front 77

Extrinsic reinforcement

Back 77

is the reinforcement provided by some consequence that is external to the behavior (example: paid to do so)

Front 78

Shaping:

Back 78

gradual creation of new operant behavior through reinforcement of successive approximations to that behavior

Front 79

a discriminative stimulus is a stimulus that signals that a ______ is available

Back 79

reinforcer