Use LEFT and RIGHT arrow keys to navigate between flashcards;
Use UP and DOWN arrow keys to flip the card;
H to show hint;
A reads text to speech;
29 Cards in this Set
- Front
- Back
|
Schedule of Reinforcement |
program or rule that determines which occurrence of a response is followed by the reinforcer |
|
|
Partial Reinforcement AKA Intermittent Reinforcement |
Situations in which responding is reinforced only some of the time |
|
|
Ratio Schedule |
-Depends on the number of responses the organism must perform. -Requires merely counting the number of responses that occur and delivering reinforcer each time the required number is reached -Ratio schedule produce higherresponse rates than interval schedules |
|
|
Interval Schedules |
A response is reinforced only if the responses occurs after a certain amount of time has passed |
|
|
Continuous Reinforcement Schedule (CR) |
-Every response results in the delivery of the reinforcer |
|
|
Fixed-Ratio Schedule (FR) |
every nth response is reinforced |
|
|
Fixed-Interval Schedule (FI) |
response is reinforced only after a certain time has elapsed |
|
|
Variable Ratio (VR)
|
- response is reinforced after a fixed average number of responses -maintain steady rates of responding without predictable pauses -produces higher response rates than VI schedules |
|
|
Variable Interval (VI) |
-response is reinforced after an average amount of time has elapsed -maintain steady rates of responding without predictable pauses |
|
|
Post-Reinforcement Pause |
zero rate of responding that typically occurs just after reinforcement -can occur in FR & FI |
|
|
What did Reynolds (1975) experiment comparing responses to VR & VI schedules conclude? |
-The frequency of reinforcement was virtually identical for the two pigeons. -Differences in reinforcement rate do not account for differences in response rate |
|
|
why do ratio schedules produce higher rates of responding than interval schedules? |
inter-response time (IRT) –the interval or pause, between responses |
|
|
Inter-Response Time (IRT) |
If a subject is reinforced for a response that occurs shortly after the preceding one, then a short IRT is reinforced,and short IRTs become more likely in the future If a subject is reinforced for a response that ends a long IRT, then a long IRT is reinforced and long IRTs become more likely in the future. |
|
|
Do ratio schedules favor short or long IRTs? Do interval schedules favor short or long IRTs? |
Ratio schedules favor short IRTs Interval schedules favor long IRTs |
|
|
Response-rate schedule |
a procedure that requires that a subject to respond at a particular rate to get reinforced." |
|
|
How do you calculate the relative rate of responding? |
Ex. w/ pigeon pressing L or R button: Button L /(Button L + Button R) |
|
|
Differential Reinforcement of Low Rates of Responding (DRL) |
–DRL 15 s •Responses that are 15 sec. apart will be reinforced •Responses that occur with a lower IRT (< 15 sec) will restart the time. |
|
|
•Differential Reinforcement of High Rates of Responding (DRH) |
–DRH 5 s •Response is reinforced only if it occurs within 5 sec. of the last response •Responses that occur with a higher IRT (> 5 sec) will not be reinforced. |
|
|
Concurrent Schedules |
allow for continuous measurement of choice because the organism is free to change back and forth between the response alternatives at any time. |
|
|
Matching Law |
•The relative frequency of behavior matches the relative frequency of reinforcement |
|
|
Problems for Matching (4) |
-Overmatching -Undermatching -Response Bias -Ratio vs Interval |
|
|
Overmatching (problem for matching) |
–Higher rate of responding for the better of the two schedules than the matching law predicts
–Usually occurs when it is costly for a subject to switch to the less preferred response alternative(ex. when the two levers are far apart) OR (ex. When two FR schedules are used.) |
|
|
Undermatching (problem for matching) |
–Occurs when the subjects responds less than predicted on the advantageous schedule |
|
|
Response Bias (problem for matching) |
–Individual rats/pigeons may have an unconditioned preference of one choice |
|
|
Ratio vs. Interval (problem for matching) |
–Animal do not match when given concurrent ratio schedules (they chose the best one) |
|
|
Theories of Matching (3) & Describe them. |
Molecular Maximizing: Animals choose which ever response alternative is more likely to be reinforced at that time Molar Maximizing: Animals distribute their responses among various alternatives so as to maximize the amount of reinforcement they earn over the “long run” Melioration: Animals are continuously attempting ‘to better’ their current chances of receiving reward by switching to the other choice! |
|
|
Concurrent-Chain Schedule (2 stages) |
2 stages: 1. Choice link: allowed to choose between two schedule alterntives by making 1 of 2 responses 2. Terminal link: after completing the schedule of reinforcement then it will leads to reinforcement Choice w/ commitment: one participant made choice, they are stuck w/ it until trial ends. -This type of schedule has been used to study self control (can they wait for larger reward OR are they impulsive & want it now?) |
|
|
Delay Discounting AKA Value Discounting AKA Temporal Discounting |
The value of the reinforcer is reduced by how long you have to wait to get it (-With concurrent-chain procedures [2 stages],pigeons choose the schedule with the delayed,larger reward) (-With a direct-choice procedure [2 direct choices], animals will almost always choose the immediate reward) |
|
|
Progressive Ratio Schedules |
-Used to study behavioral economics
-How much is the animal willing to do for areward. At some point the rat will giveup. Stop exerting energy because it’snot worth it. -The quality of reinforcer will determine their amount of motivation |
