Use LEFT and RIGHT arrow keys to navigate between flashcards;
Use UP and DOWN arrow keys to flip the card;
H to show hint;
A reads text to speech;
26 Cards in this Set
- Front
- Back
|
Classical Conditioning |
associations are formed between two external stimuli (CS->US). No response is required for the animal to receive the US (e.g., Tone->Food) |
|
|
Instrumental Conditioning aka Operant |
The strength of the associations are strengthened or weakened based on the consequences of the animals goal-directed behavior |
|
|
Thorndike's Puzzle Box |
Put kittens in puzzle box w/ reinforcement outside of box (salmon etc.) & kitten had to figure out how to get out of box & they’d time them to see how long it would take. Results:cat would get faster & faster at getting out of box; trial and error |
|
|
Law of Effect |
•If a response to a stimulus is followed by a satisfying event (reinforcement), the response is strengthened. •If a response to a stimulus is followed by an annoying event (punishment), the response is weakened. |
|
|
Procedures to studying Instrumental Conditioning (2) & Describe them. |
-Discrete Trial Procedure: Instrumental response is performed only once (e.g., maze experiments) -Free-Operant Procedure: Instrumental response can be performed in a continuous manner (many times over again) |
|
|
Necessary training components (2) & Describe them. |
•Magazine training : Stimulus repeatedly paired with the reinforcer to show animal to go get reinforcer when presented •Shaping: Reinforcements of successive approximations |
|
|
Appetitive stimulus vs. Aversive stimulus |
Appetitive: pleasant outcome Aversive: unpleasant outcome |
|
|
Positive Reinforcement Negative Reinforcement |
+: produces an appetitive (pleasant) stimulus; increase in response rate -: eliminates or prevents the occurence of an aversive (unpleasant) stimulus; increase in response rate |
|
|
Positive Punishment Negative Punishment AKA Omission training (DRO) |
+: produces an aversive (unpleasant) stimulus; decrease in response rate -: eliminates or prevents the occurence of an appetitive stimulus (pleasant); decrease in response rate |
|
|
Fundamental elements of Instrumental Conditioning (3) |
•Instrumental Response •Outcome •Contingency between the response and outcome |
|
|
Behavioral Variability vs Stereotypy (in Instrumental response) |
–Sterotyped responses: the same response is required to get the outcome over a number of trials –Variable responses: different responses on each trial are necessary to get the outcome. |
|
|
Yoked |
relating to or being a control organism or group that is subjected to stimuli at the same time or on the same schedule as the subject of an experiment |
|
|
Belongingness |
–Certain responses belong with the reinforcer because of the animal’s evolutionary history. |
|
|
Instinctive Drift |
Response deteriorated and other “instinctive” behaviors would “drift” in and interfere with performance of the operant response |
|
|
Quantity & Quality of Reinforcer |
the quality and quantity of a reinforcer are variables that would be expected to determine the effectiveness of positive reinforcement |
|
|
The Crespi effect |
Behavioral-contrast can occur either because of a shift from a prior reward magnitude or because of an anticipated reward. Ex. In a repeatedly carried out task such as finding food in a maze, the running speed of the rat is proportional to the size of the reward it obtained on the previous trial |
|
|
Two types of Relationships between a response and a reinforcer & Describe them. |
-Temporal Relation: refers to the time between the response & reinforcer -Temporal Contiguity: refers to the delivery of the reinforcer immediately after the response. |
|
|
•Why is responding so sensitive to a delayof reinforcement? |
–Delay makes it difficult to determine which response is reinforced |
|
|
Two ways to overcome delay in reinforcement |
-A secondary reinforcer AKA conditioned reinforcer -Marking procedure |
|
|
A secondary reinforcer |
A conditioned stimulus that was previously associated with the reinforcer E.g., when training your dog, you might yell “good boy” when a desired behavior is done prior to giving your dog a treat. |
|
|
Marking Procedure |
Learning to lever press with a 30sec. delay between the bar press and the delivery of food No Signal: No marker Stimulus was presented Marking: Light was presented for 5 sec. after the bar press. Blocking: Light was presented for 5 sec. right before delivery of food. |
|
|
The Response-Reinforcer Contingency |
Refers to the extent to which the delivery of the reinforcer depends on the prior occurencce of the instrumental response. -effects the controllability of reinforcers |
|
|
The Triadic Design (used in studies of the learned-helplessness effect) |
|
|
|
The Learned Helpless HYPOTHESIS |
-assumes that during exposure to uncontrollable shocks, animals learn that the shocks are independent from their behavior-that there is nothing they could do to control the shocks (lack of control) -there is motivational loss |
|
|
The Learned-Helplessness EFFECT |
pattern of results obtained w/ the triadic design (disruption of instrumental conditioning caused by prior exposure to the inescapable shock[in ex]) |
|
|
Results when challenging to Learned-Helplessness HYPOTHESIS |
So, learning deficit is not due to lack of control, as suggested by the learned-helplessness hypothesis, butrather, it’s due to a lack of predictability. |
