Classical &

1. : forms associations between stimuli (CS and Operant Conditioning and US). Social Learning 2. Operant conditioning, on the other hand, forms an association between Chapter 7 (continued) (responses) and the resulting events

1 (consequences). 2

Response-Consequence Learning Classical & Operant Conditioning

Learning to associate a response . Classical conditioning involves respondent with a consequence. that occurs as an automatic response to a certain stimulus. Operant conditioning involves operant behavior, a behavior that operates on the environment, producing rewarding or punishing stimuli.

3 4

Skinner’s Experiments B.F. Skinner: Master of Pigeons Skinner’s experiments extended Thorndike’s thinking, especially his law of effect. This law states that rewarded behavior is likely to occur again. Yale University Library

5 6

1 Operant Chamber Operant Chamber

Using Thorndike's law of effect as a starting point, The operant chamber, or Skinner developed the Operant chamber, or the Skinner box, comes with

rd Skinner box, to study operant conditioning. 3 a bar or key that an

Walter Dawn/ Photo Researchers, Inc. animal manipulates to obtain a reinforcer like food or water. The bar or key is connected to by Thomson Learning, Wadsworth Division Division Wadsworth Learning, Thomson by

The Essentials of Conditioning and Learning, Conditioning of The Essentials devices that record the From

Edition by Michael P. Domjan, 2005. Used with permission 2005. Usedpermission with Domjan, P. by Michael Edition animal’s (rate of) response.

7 8

Types of Reinforcers Shaping

Any event that strengthens the behavior it follows. A Shaping is the operant conditioning procedure in heat lamp positively reinforces a meerkat’s behavior which reinforcers guide behavior towards the desired in the cold. target behavior through successive approximations. Reuters/ Corbis

A manatee shaped to discriminate 9 objects of different shapes, colors and sizes. 10

Shaping Application - Minesweeping Learning to Bar Press: Shaping through Successive Rats can be trained to detect buried mines via the Approximations scent of TNT.

11 12

2 The Skinner Box: Not Just for Rats Free vs. Earned Food Phenomenon “Lost” episode

http://www.youtube.com/watch?v=PS1KXYpRZbM

13 14

Big Bang Theory: Primary & Secondary Reinforcers Operant Conditioning . Primary Reinforcer: An innately reinforcing stimulus • http://www.youtube.com/watch? like food or drink. v=euINCrDbbD4&feature=related . Conditioned (Secondary) Reinforcer: A learned reinforcer that gets its reinforcing power through association with the primary reinforcer.

15 16

Immediate & Delayed Reinforcers Instant Gratification and Procrastination

. Immediate Reinforcer: A reinforcer that occurs • Immediate Smaller Pay, or Delayed Larger Pay? instantly after a behavior. – Many chose to accept an immediate smaller amount . A rat gets a food pellet for a bar press. after participating in an experiment for money. – Yet, most of those who received the smaller amount . Delayed Reinforcer: A reinforcer that is delayed (in the form of a check) did not cash that check until in time for a certain behavior. after those who chose the larger delayed amount . A paycheck that comes at the end of a week. received their check! – Application to lottery winners We may be inclined to pursue small immediate reinforcers (watching TV) rather than large delayed reinforcers (getting an A in a course) which require consistent study. 17 18

3 Schedules Ratio Schedules

1. Continuous Reinforcement: Reinforces . Fixed-ratio schedule: Reinforces a response only the desired response each time it occurs. after a specified number of responses. . Piecework pay, frequent flyer miles, coffee cards

2. Partial Reinforcement: Reinforces a . Variable-ratio schedule: Reinforces a response response only part of the time. This after an unpredictable number of responses (averaged around some mean). results in slower acquisition than . Fishing, door to door sales continuous reinforcement. But, more resistant to extinction (e.g., Skinner’s pigeon).

19 20

Interval Schedules Schedules of Reinforcement . Fixed-interval schedule: Reinforces a response only after a specified time has elapsed. . Preparing for an exam only when the exam draws close

. Variable-interval schedule: Reinforces a response at unpredictable time intervals (averaged around a mean), which produces slow, steady responses.

. Pop quiz, in-class extra credit 21 22

Where Do We See Variable Question Reinforcement?

• Say I want to instill a behavior that is MOST Gambling Rewards resistant to extinction (that is, the behavior on a Variable Ratio Schedule persists even after the reinforcer is removed). Which schedule of reinforcement should I apply? a) Fixed Ratio b) Fixed Interval c) Variable Ratio Skinner discussing schedules of reinforcement d) Variable Interval http://www.youtube.com/watch?v=AepqpTtKbwo

23 24

4 Punishment

An aversive event that decreases the behavior it Although there may be some justification for occasional follows. punishment (Larzelaere & Baumrind, 2002), it usually leads to negative effects.

1. Results in unwanted fears. 2. Conveys no to the organism as to what to do (just, what not to do). 3. Justifies pain to others. 4. Causes unwanted behaviors to reappear in its absence (e.g. spanking). 5. Causes aggression towards the agent. 6. Causes one unwanted behavior to appear in place of another or 25 in other settings (e.g., modeling aggression). 26

Distinguishing Reinforcement Review of Rewards & from Punishment Something Something Remember that all reinforcers (both positive AND Desirable Aversive negative) are meant to increase the likelihood of a behavior occurring Add or Positive (Positive) Give Reinforcement Punishment On the other hand, all punishments (both positive (strengthens behavior) (weakens behavior) AND negative) are meant to decrease the Take Away Negative Negative likelihood of a behavior occurring or Remove Punishment (i.e., Reinforcement time-out) (strengthens behavior) What is this: “If you don’t keep your grades (weakens behavior) 27 up, I’ll take your car 28 away from you.”

Extending Skinner’s Understanding & Operant Conditioning

Skinner believed in inner thought processes Evidence of cognitive processes during operant learning comes from rats during a maze exploration and biological underpinnings, but did not feel in which they navigate the maze without an obvious it was necessary to consider them seriously in reward. Rats seem to develop cognitive maps, or psychology (because they were mental representations, of the layout of the maze unobservable). (environment).

Many psychologists criticize him for discounting them.

29 30

5 Latent Learning Motivation

Such cognitive maps are based on latent learning, Intrinsic Motivation: The which becomes apparent when an incentive is given desire to perform a (Tolman & Honzik, 1930). behavior for its own sake.

Extrinsic Motivation: The desire to perform a behavior due to promised rewards or threats of punishments.

31 32

Biological Predisposition Skinner’s Legacy

Skinner argued that behaviors were shaped by external Biological constraints influences instead of inner thoughts and feelings. Critics argued predispose organisms to that Skinner dehumanized people by neglecting their free will. learn associations that are naturally adaptive. Breland and Breland (1961) showed that animals drift towards their Photo: Bob Bailey biologically predisposed instinctive behaviors. Falk/ Photo Researchers, Inc

Marian Breland Bailey

33 . 34

Applications of Operant Conditioning Applications of Operant Conditioning

Skinner introduced the concept of teaching machines Reinforcement principles can enhance athletic that shape learning in small steps and provide performance. for correct responses. LWA-JDL/ Corbis

In School 35 In Sports 36

6 Applications of Operant Conditioning Applications of Operant Conditioning

Reinforcers affect productivity. Many companies now In children, reinforcing good behavior increases the occurrence of these behaviors. Ignoring unwanted behavior decreases their allow employees to share profits and participate in occurrence. company ownership.

Still, ignoring has other negative consequences that make it aversive; not just removing positive

At work 37 38

Little Known Fact: Project Operant vs. Classical Conditioning Pigeon

During WW II, Army approached Skinner to determine if pigeons could be used as guidance systems for missiles

http://www.youtube.com/watch?v=lMsSCryLMOg

While Skinner felt that he had some success, the idea quickly became obsolete with the invention of radar 39 40

Learning by Observation: Mirror Neurons Social Learning Higher animals, especially Neuroscientists discovered mirror neurons in the humans, learn through brains of animals and humans that are active during observing and imitating © Herb Terrace observational learning. others.

The monkey on the right imitates the monkey on the

left in touching the ©Herb Terrace pictures in a certain order to obtain a reward. Reprinted with permission from the American American the from permission with Reprinted of Science, Advancement for the Association 407-410 (2004) 305: Science al., et Subiaul AAAS. 2004 ©

41 42

7 Onset Bandura's Experiments

Bandura's Bobo doll Learning by observation study (1961) indicated begins early in life. This that individuals 14-month-old child (children) learn through imitates the adult on TV in imitating others who pulling a toy apart. receive rewards and punishments. Courtesy of , Stanford University University Stanford Bandura, Albert of Courtesy Meltzoff, A.N. (1998). Imitation of televised models by . by infants. models of televised A.N. (1998). Imitation Meltzoff, M. and Hanuk. A.N. Meltzoff 59 1221-1229. Photosof Courtesy Development, Child

43 44

Applications of Observational Learning Positive Observational Learning

Fortunately, prosocial (positive, helpful) models may Unfortunately, Bandura’s have prosocial effects. studies show that antisocial models (family, neighborhood or TV), if reinforced, may have antisocial effects.

45 Works Image The Bob Daemmrich/ 46

Television and Observational Learning Modeling Violence

Research shows that viewing reinforced media violence leads Gentile et al., (2004) to an increased expression of aggression. shows that children in elementary school who are exposed to violent television, videos, and video games express increased aggression. Ron Chapple/ Taxi/ Getty Images Images Getty Taxi/ Ron Chapple/ Bob Daemmrich/ The Image Works Works Image The Bob Daemmrich/ Glassman/ The Image Works Works Image The Glassman/ 47 Children modeling after pro wrestlers 48

8