Reading...
Play button
Play button
Use LEFT and RIGHT arrow keys to navigate between flashcards;
Use UP and DOWN arrow keys to flip the card;
H to show hint;
A reads text to speech;
101 Cards in this Set
- Front
- Back
|
A word on Classical Conditioning
|
- describes a reflexive process
- present the stimulus and the response automatically follows |
|
|
Operant Behaviors
|
- behaviors that are influenced by their consequences
- operates on environment to produce a consequence |
|
|
Operant (Instrumental) Conditioning
|
- effects of consequences upon behaviors that are influenced by their consequences (operant behaviors)
- effects of consequences of operant behaviors - response is instrumental in producing the consequence |
|
|
Elicited behavior vs Operant behavior
|
elicit behavior is a function of precedes it vs. operant behavior is a function of what follows it
|
|
|
operating on environment and influenced by consequence
|
- operant behavior
|
|
|
Operant behaviors are influenced by their...
|
- consequences
|
|
|
Edwin Thorndike (1874-1949)
|
- we should not assume that animals behaving in a particular way are doing so for intelligent reasons
- skepticism was driven by a belief that the intellectual ability of animals could be properly assessed only through systematic investigation -cats in a box |
|
|
Cats in the box
|
- no "flash of insight"
- the response that worked (stepping on the treadle) was gradually strengthened, while responses that did not work (clawing at gate) were gradually weakened |
|
|
What considerations did Skinner have in regards to testing his views that were in accord with Thorndike's Law of Effect?
|
- scientific analysis of behavior required finding a procedure that yielded regular patters of behavior
- well controlled environment + procedure that yielded regular patterns of behavior |
|
|
Skinner Box
|
- operant conditioing chamber
- rats/ response lever/ pellets - free operant - rat free to respond; experimenter control contingencies (consequences) rate of behavior controlled by conditions established by Skinner |
|
|
Free Operant Procedure
|
- subject free to respond at any rate
(however rate would be affected by conditions established by experimenter) |
|
|
Operant Condition Chamber for Pigeons
|
- pecks response key ( tranluscent disc illuminated) grain presented in food cup
|
|
|
Skinner's procedures are also known as _______ _______ procedures in that the animal controls the rate in which it earns food.
|
- free operant
|
|
|
Two Categories of Behavior
|
Respondent and Operant
|
|
|
Respondent Behavior
|
- Classical Conditioning
- involuntary, reflexive-type behaviors |
|
|
Operant Behavior
|
- Voluntary behavior
- controlled by consequences rather than by the stimuli that precede them |
|
|
Operant Conditioning
|
- type of learning in which the future probability of a behavior is affected by its consequences
|
|
|
Skinner vs Throndike (description of consequences)
|
- Throrndike --> satisfaction and annoyance --> inferred from animals behavior --> mentalistic description
- Skinner --> effect of consequence --> adaptive (lead to favorable outcomes) and nonadative (do not lead to favorable outcomes) |
|
|
Skinner & Darwin
|
- operant conditioning resemblance to Darwin's natural selection
- (natural selection) adaptive characteristics are more likely to survive and propagate forward in generations - (operant conditioning) behaviors that lead to favorable outcomes are more likely to be repeated than those that do not lead to favorable outcomes |
|
|
Components of Operant Conditioning Process
|
1. a response that produces a certain consequence
2. the consequence that serves to either increase or decrease the probability of the response that preceded it 3. a discriminative stimulus that precedes the response and signals that a certain consequence is now available |
|
|
Operant Behavior
|
- class of emitted responses that result in certain consequences; these consequences, in turn, affect the future probability or strength of those responses
- operants - operant response because it occurrence results in the delivery of a certain consequence --> consequence affects the future probability of the response |
|
|
Classical Conditioning vs Operant Conditioning (behaviors)
|
- elicited by stimuli vs emitted by organism
- involuntary vs voluntary |
|
|
Characteristics of Elicited Behavior vs Operant Behavior
|
- more reflexive and automatic; based around stimulus (food elicits salivation)
vs - more voluntary, flexible; based around organisms volition (rat emits lever pressing) |
|
|
What is the illusion of control?
|
- idea that all behavior is controlled by the contingencies of reinforcement and punishment that follow the behavior therefore voluntariness is an illusion
|
|
|
operant behavior
|
- class of responses
- all responses in that class of producing capable of producing the consequence - defining operants in terms of classes has proven fruitful becuase it is easier to predict the occurence of a class of responses than it is to predict the exact response that will be emitted at a particular point in time |
|
|
What is the advantage of defining operants in terms of class of responses?
|
- allows you to predict what behavior will be emitted without qualifying how it will take place on any particular occasion
ex rat(lever press) vs rat(soft/hard/quick) lever press |
|
|
Second component of operant conditioning procedure is....
|
- the consequence that strengthens or weakens the frequency of a behavior
- increase/decrease probability |
|
|
What do reinforcers and punishers have in common?
|
- both are consequences
- both follow a behavior - both affect the likelihood of future occurrence |
|
|
Reinforcer (S^R)
|
- strengthen behavior
- follow behavior - future probability of that behavior increases |
|
|
Punisher (S^P)
|
- consequences that weaken behavior
- follow behavior - future probability of that behavior decreases |
|
|
Reinforcer and Punisher
|
- actual consequences of the behavior that increase and decrease probability
|
|
|
Reinforcement and Punishment
|
- process or procedure of strengthening or weakening a behavior by instituting those consequences
|
|
|
Reinforcers and punishers are defined entirely by...
|
their effect on behavior and not their relationship to how pleasant or unpleasant they seem
|
|
|
A response can be weakened but punishment as well as...
|
extinction
|
|
|
Extinction
|
- The weakening of a behavior through withdrawal of reinforcement for that behavior
- slower process than punishment |
|
|
Discriminative Stimuli (S^D)
|
- is a stimulus in the presence of which responses are reinforced and in the absence of which they are not reinforced
- discriminative stimulus is a signal that indicates that a response will be followed by a reinforcer - "set the ocassion for" - merely increases the probability that a behavior will occur - indicates that this consequence is now available - person or animal emits the behavior in the presence of the S^D |
|
|
S^D : R --> S^R or S^P
|
discriminative stimulus --> behavior --> consequence (reinforcer or punisher)
|
|
|
Three- term Contingency
|
- consisting the antecedent (S^D), behavior (operant behavior), consequence ( reinforcer/punisher)
|
|
|
Discriminative stimulus for Punishment
|
- stimulus that signals that a response will be punished
|
|
|
Discriminative stimulus for Extinction
(S^Delta) |
- which is a stimulus that signals the absence of reinforcement
|
|
|
Contingency of Reinforcement
|
- describes the behavior
- response is followed by a reinforcer - meaning that the delivery of the reinforcer is contingent upon the response |
|
|
Contingency of Punishment
|
- reponse is followed by a punisher
|
|
|
4 Basic Types of Contingencies
|
response - consequence relationships
pos/neg reinforcement pos/neg punishment |
|
|
Positive
|
- something being added
- behavior is followed by the presentation or addition of something |
|
|
Negative
|
- removal of something
- something subtracted from the situation - response results in the removal of something |
|
|
Two Types of Negative Reinforcement
|
- escape behavior
- avoidance behavior |
|
|
Escape Behavior
|
- termination (stopping) of an aversive stimulus
|
|
|
Avoidance Behavior
|
- similar to escape except occurs before the aversive stimulus is presented and therefore prevents its delivery
|
|
|
Operant conditioning
|
- three term contingency
- antecedent : behavior --> reinforcer - vouluntary behavior (emitted) - consequences strengthened or weaken the liklihood of behaviors -LEARNING in which a VOLUNTARY RESPONSE is strengthened or weakened, depending on it consequences |
|
|
Law of Effect
|
Reponse -->
1 pleasant consequence --> response stamped in 2 unpleasant consequnece --> reponse stamped out |
|
|
Operant (Instrumental) Conditioning
|
Learning in which a voluntary response is strengthened or weakened, depending on its consequences
|
|
|
Unlike in Pavlovian Conditioning: (operant conditioning)
|
- not S-R or S-S learning, more complex
- VOLUNTARY, EMITTED, not elicited - Operant, Not respondent Instrumental in producing consequences |
|
|
Operant
|
intrumental, emitted, voluntary
(Skinner) |
|
|
Respondent
|
elicited, involuntary
(Pavlov) |
|
|
Example of operant and pavlovian conditioning intertwined....
|
- learned helplessness
|
|
|
Three-Term Contingency
|
- Antecedent: Behavior --> Consequence
- SD: R ---> SR or SP |
|
|
Discriminative Stimuli
|
S^D = stimulus in the presence of which a response leads to reinforcement or to punishment
S^Delta = stimulus in the presence of which a response leads to absence of reinforcement |
|
|
A stimulus can act as both an SD and a CS
|
Tone: Lever press --> Food (
SD: R--> SR) Tone: Food --> Salivation (NS: US -->UR) Tone --> Salivation (CS --> CR) |
|
|
Three characteristics of reinforcement
|
- Behavior has a consequence
- Behavior increases in strength - This increase is the result of that consequence |
|
|
Reinforcers
|
- consequences that stregnthen
|
|
|
Immediate vs. Delayed Reinforcement
|
The more immediate the reinforcer, the stronger its effect on the behavior.
|
|
|
Primary Reinforcer
|
- innately reinforcing
- unconditioned |
|
|
Secondary Reinforcer
|
- associated with primary reinforcer(s) or appetetive US
- conditioned |
|
|
Generalized Reinforcer
|
- Associated with many other reinforcers
|
|
|
Natural Reinforcers
|
- typical consequences of certain behaviors
|
|
|
Contrived Reinforcers
|
- have been delibrately arranged to modify a behavior
|
|
|
Intrinsic Reinfrocement
|
- provided bu the mere act of peforming the behavior
- always natural |
|
|
Extrinsic Reinforcement
|
- Reinforcement provided by some consequence that is external to the behavior
- natural or contrived |
|
|
Three Characterisitics of Punishment
|
- Behavior has a consequence
- Behavior decreases in strength - This decrease is the result of the consequence |
|
|
Punishers
|
- consequences that weaken behavior
- must act to lower the frequency of operant response |
|
|
If the more immediate the reinforcer, the stonger its effect on the behavior (even a few seconds delay can often severly influence its effectiveness) how is that delayed reinforcement has any prominence in human society?
|
- behaviors taht appear to be strengthened by long delayed reinforcers are often under the control of rules or instructions that we have received form other or generated outselves
- these rules and instructions bridge teh gap between the behavior and the consequence (rules seem to be dependent on language) |
|
|
Primary Reinforcer
|
- unconditioned reinforcer
- an event that is innately reinforcing - born to like - naturally reinforce are behavior - many associated with physiological needs and their effectiveness tied to a state of deprivation - example of a psychological primary reinforcer is stimutation |
|
|
Secondary Reinforcer
|
- conditioned reinforcer
- event that is reinforcing because it has been associated with some other reinforcer - associated with other things we like - conditioned stimuli that have been associated with appettiive unconditoned stimuli (USs) can also function as secondary reinforcers |
|
|
How do discriminative stimuil become secondary reinforcers?
|
- discriminative stimuli associated with positive reinforcers can likewise function as secondary reinforcers
- a S^D can be a secondary reinforcer for some other behavior |
|
|
what is the difference between a S^D becoming a secondary reinforcer and a CS?
|
- a CS is classiclally conditioned and has been associated with an appetitive unconditional stimulus wheres a S^D only acts to signal that a cosquenceis available
- all that differs are how the secondary reinforcers are caually related to another (primary) reinforcer |
|
|
Generalized Reinforcer (generalized secondary reinforcer)
|
- a type of secondary reinforcer that is associateed with several other reinforcers
example money - used in behavior modification programs (ex token economy) |
|
|
Can an event be both a primary and seondary reinforcer?
|
- yes,
|
|
|
Just as stimuli that are associated with reinforcement can become secondary reinforcers, so also can the _________ that are associated with reinforcement.
|
- behaviors
- "like to help" - hard work |
|
|
the operant behavior itself can be sometimes ...
|
reinforcing; intrinsically reinforcing or motivating
|
|
|
Intrinsic Reinforcement
|
- reinforcement provided by the mere act of performing the behavior
- doing the behavior can increase the chances of the behavior occuring in the future |
|
|
Examples of Intrinsic Reinforcement
|
- hard work
- helping others - partying with friends anything that you might respond with becuase I like too .... |
|
|
Extrinsic Reinforcement
|
- the reinforcement provided by some consequence that is external to the behavior
|
|
|
Candy for the Disobedient
|
- candy to child to be quiet; candy = extrinsic reinforcer
- eating candy; candy = intrinsic reinforcer |
|
|
Lepper, Green, and Nisbett (1973)
|
- intrinsic interest decreased when extrinsic reinforcements were introduced
|
|
|
Lepper, Green and Nisbitt COntested by Cameron and Pierce (1986)
|
- no impact
- extrinsic rewards affected behavior when a. reward was tangible b. expectation c. given for simply performing the activity High performance and Verbal rewards can increase intrinsic motivation |
|
|
Natural Reinforcers
|
- are reinforcers that are naturally provided for a certain behavior
- a typical consequence of behavior within that setting ex money for goods at a shop ex gold medals are a natural consequence of hard training and great performance |
|
|
Contrived Reinforcers
|
- reinforcers that have been deliberately arranged to modify a behavior
- not a typical consequence ex television for studying a certain amount |
|
|
Natural Reinforcers
|
- typical for the setting
- follow naturally for performing an act (when determining whether a reinforcer is natural you have to evaluate the causal relationship... two variables to consider the behavior and the environment... if what follows follows in accord with the setting ) |
|
|
Contrived Reinforcers DeePoP
|
- their is an explicit attempt to modify behavior
- the reinforcer is not naturally occurring in the sense that |
|
|
Intrinsic reinforcers are always...
|
- natural
|
|
|
Extrinsic reinforcers can be
|
- natural or contrived
|
|
|
compliments by customers to a chef are ...
|
- extrinsic and natural
|
|
|
giving a chef a basket of flowers from his boss for high praise a good meal is ...
|
- extrinsic and contrived
|
|
|
Extrinsic can be natural or contrived because
|
- some reinforcers can be natural for the setting as well as not directly associated with the behavior
- some reinforcers can be atypical for the setting and be deliberate in their intention to modify behavior and not be directly associated with the behavior |
|
|
if a reinforcer is natural it can also be ...
|
- extrinsic or intrinsic
- an intrinsic would follow naturally form the behavior - extrinsic would be supplied from an eternal consequence |
|
|
Intrinsic motivations ...
|
seem to be more internal within the organism and their is not rely on the environment
- resides in the act of the behavior |
|
|
the ultimate intention of using contrived reinforcers to modify behaviors is....
|
- let natural contingencies take over
- we hope that natural (and intrinsic) reinforcers associated take over |
|
|
Sorting through definition (intrinsic and extrinsic VS natural and contrived)
|
- former is concerned with the extent to which the behavior itself is reinforcing (does it require external intervention)
- latter is concerned with the extent to which a reinforcer has been artificially imposed so as to manipulate a behavior |
|
|
behavior modification program usually uses ..
|
- contrived, extrinsic reinforcers
|
|
|
What if the behavior you want to strengthen does not occur?
|
Shaping
|
|
|
Shaping
|
- gradual creation of new operant behavior behavior through reinforcement
- step by step - reinforcing successive approximations to the target behavior to teach an entirely new behavior |
