Psych 4 Midterm 2

Front 1

operant conditioning

Back 1

learning from the consequences of ones actions

Front 2

positive/negative reinforcement/punishment

Back 2

positive=added
negative=taken away
reinforcement=more likely to do again

Front 3

negative reinforcement subtypes

Back 3

escape-experience, then action
avoidance-action before experienced anything

Front 4

reinforcer

Back 4

consequence that strengthens behavior

Front 5

primary reinforcer

Back 5

positive: tied to biological need: food water etc.
negative: escape

Front 6

secondary reinforcer

Back 6

reinforcer (sR) with acquired value by being paired with an established reinforcer (sR) or exchanged with an established reinforcer (sR)

ex: money or praise

Front 7

secondary reinforcer subtypes

Back 7

standard: exchange for one type of primary reinforcer

generalized conditioned reinforcer: can be exchanged for multiple reinforcers

Front 8

extrinsic reinforcer

Back 8

getting an external reinforcer for performing a behavior

ex: reading book for good grade

Front 9

intrinsic reinforcer

Back 9

reinforcement simply by performing the behavior

ex: reading book for pleasure

Front 10

shaping

Back 10

using behavior subject already does and shape it into behaviors you want

Front 11

continuous reinforcement (CRF)

Back 11

every response is reinforced

Front 12

ratio schedule

Back 12

reinforcement depends on the number of times a response is repeated

Front 13

interval schedule

Back 13

reinforcement depends on the passage of time plus a response

Front 14

fixed schedule

Back 14

reinforcer is predictable
fixed ratio (FR)= get reinforcer after x responses, graphed steps
fixed interval (FI)= get reinforcer after x seconds plus one response, graphed scallops

Front 15

variable schedule

Back 15

reinforcer is unpredictable
variable ratio (VR):get reinforcer after about every x responses, graphed steep slope
variable interval (VI): get reinforcer after about every x seconds, plus one response, graphed moderate slope

Front 16

skinner's view of reinforcement

Back 16

if something acts to change B, then it is a reinforcer; a reinforcer is a stimulus that reinforces the operant response

Front 17

two types of reinforcement theories

Back 17

reinforcers are stimuli (Hull) or reinforcers are activities (sr not food but is eating the food)

Front 18

Hulls drive reduction theory

Back 18

a reinforcer as stimuli theory
stimuli that reduce a biological need or reduce strong aversive stimuli will become reinforcers
problem was found stimuli with high reinforcement that didnt reduce any drives.

Front 19

premack's principle

Back 19

reinforcement is a contingency between two behaviors, instrumental reinforcer and contingent reinforcer.
getting to do the second behavior is contingent upon first performing the instrumental behavior.
measure using free baseline, what organism does with no input. more probable behaviors reinforce less probable. significant effect is performing the instrumental behavior above baseline level

Front 20

shortfalls of premack's principle

Back 20

assumes activities preformed most are preferred.
make subject perform x longer than it normally would to allow it to perform y as long as it usually does.

Front 21

response deprivation theory

Back 21

a reinforcement effect will occur only when the reinforcement contingency deprives the subject of the contingent activity.
performing baseline amount of instrumental response earns you less than baseline amount of contingent response.
make subject perform instrumental behavior at a higher level than its baseline level of the contingent behavior.
can increase time required for instrumental or decrease time allowed for contingent.

contingent ratio > baseline ratio then contingency should work

Front 22

problem with response deprivation

Back 22

subjects sometimes compromise instead of performing as expected (extreme conditions)

Front 23

bliss point theory

Back 23

baseline= behavioral ideal
any contingency disrupts the 'bliss point' so subject increases frequency of instrumental behavior as a compromise.

Front 24

operant extinction

Back 24

no longer reinforcing the operant behavioral response

Front 25

effects of extinction

Back 25

extinction burst
emotional behaviors (frustration, aggression)
increase behavior variability
resurgence
depression
spontaneous recovery

Front 26

discriminative stimuli

Back 26

stimulus where rewarded when present and when absent not reinforced.

only reinforce a lighted key peck, not dark key.

Front 27

stimulus control

Back 27

presence of a discriminative stimulus reliably affects the probability of the behavior.

more likely to pack a lighted key if that is reinforced.

Front 28

stimulus generalization

Back 28

tendency for an operant response to be emitted in presence of stimulus similar to discriminative stim.

'generalization gradient'

Front 29

stimulus discrimination

Back 29

tendency for an operant response to be emitted more in the presence of one stimulus than another.

'picky pigeons' with steep bell curve

Front 30

discrimination training/ discriminative stimulus for extinction

Back 30

reinforcement of responding in the presence of one stimulus but not in the presence of another

the stimulus that signals the absence of reinforcement

Front 31

intradimensional discriminative training

Back 31

both discrim. stimulus and discrim stim for extinction from the same dimension

Front 32

interdimensional discriminative training

Back 32

discrim. stimulus and discrim stim for extinction from the different dimensions

having a stimulus being on or off counts as this

Front 33

peak shift

Back 33

only occurs with intradimensional training

peak moves away from Sdelta and no longer centered over discriminatory stimulus.

Front 34

signaled avoidance

Back 34

signal stimulus preceded aversive stimulus

Front 35

non signaled avoidance

Back 35

no indication of aversive stimulus

Front 36

two factory theory of avoidance

Back 36

factor one: classical conditioning of fear to a signal for the aversive stimulus

factor two: operant conditioning of the avoidance response which decreases the CR of fear

two factor only works with fixed time intervals, variable time is always afraid

Front 37

one factor theory

Back 37

reduction of aversive stim in long term reinforces behavior

Front 38

one factor/two factor compound

Back 38

two factor = 'molecular', what happens immediately after the behavior. signaled conditions

one factor = 'molar' concentrate on larger time scales. non signaled/variable

Front 39

basic punishment rule

Back 39

punisher must be more intense than positive reinforcer

Front 40

effectiveness of punisher

Back 40

reduces the behavior quickly, reduces the behavior significantly

Front 41

factors influencing effective punishment

Back 41

intensity
method of introduction (ineffective if starts low and builds up)
immediacy
contingency
frequency
discrimination (best if not discriminative stim. signaling the punisher is in effect)

Front 42

problems with punishment

Back 42

aggression
agent delivering punishment becomes aversive
doesnt teach new behavior
encourage unwanted avoidance behavior
negatively reinforce agents behavior (lead to abusive behavior example)

Front 43

ideal punishment combination

Back 43

punish inappropriate b with positive reinforcement of alternate incompatible new behavior