Professional Documents
Culture Documents
ARTICLE IN PRESS
BEPROC 2990 18
Behavioural Processes
journal homepage: www.elsevier.com/locate/behavproc
Q1
Q2
Q3
6
18
a r t i c l e
i n f o
a b s t r a c t
7
8
9
Article history:
Available online xxx
10
11
12
13
14
15
16
17
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
Keywords:
Competition
Induction
Matching law
Reinforcement
Variable-interval schedule
Variable-ratio schedule
Baum and Davison (2014b) showed that Baums (2012) recasting of reinforcement as induction may be
quantied by assuming that induction follows a power function of reinforcer rate. This power-function
induction is readily integrated with theory based on the matching law. Herrnstein (1970) originally
assumed background activities (BO ) and their associated reinforcers ro to be constant, but ro should
vary with BO . Further, power-function induction implies that BO should vary with reinforcer rate. Baum
(1993) reported performance on a wide range of variable-ratio (VR) and variable-interval (VI) schedules.
Pigeons VR peck rate followed an inverted U-shaped relation, but VI peck rate separated into three
ranges of food rate: low-to-moderate, moderate-to-high, and extremely high. As food rate increases, the
concave downward relation in the low range reaches an inection point and gives way to a concave
upward relation in the higher range. At the extremes of food rate, VI peck rate decreases. A model based
on competition between induced pecking and BO accounted for VI peck rate in the moderate to extreme
range of food rates. Further research will account for all three ranges, either by integrating power-function
induction with matching theory or with a model based on competition between induced activities.
2015 Published by Elsevier B.V.
B=
Kr
r + rO
(3)
36
37
38
39
40
41
42
(1)
(2)
http://dx.doi.org/10.1016/j.beproc.2015.01.006
0376-6357/ 2015 Published by Elsevier B.V.
Please cite this article in press as: Baum, W.M., The role of induction in operant schedule performance. Behav. Process. (2015),
http://dx.doi.org/10.1016/j.beproc.2015.01.006
43
44
45
46
47
48
49
50
51
52
53
54
55
G Model
BEPROC 2990 18
2
56
57
58
59
60
61
ARTICLE IN PRESS
(4)
where, V is the average number of responses required per reinforcer, and the feedback function for a VI schedule is approximately:
1
r=
t + Ba
(5)
64
65
ro = f (BO )
62
63
(6)
69
At least two questions arise: (1) what is BO ? and (2) what is the
feedback function f relating ro to BO ? Baum (1981) and Davison
(1993) suggested that the function should have characteristics of a
ratio schedule (Eq. (4))that is,
70
rO =
66
67
68
71
72
73
74
75
76
77
78
79
80
81
82
83
BO
V
(7)
food rate r. Baum and Davison (2014b) found that BO varied with r
and, through this variation and Eq. (7), that ro varied with r. Thus,
at least part of the other activities represented in Eq. (6) as BO and
implicit in Herrnsteins hyperbola (Eq. (3)) is induced by the food
(r). To be accurate, Baum and Davison (2014b) proposed that Eq. (3)
should be modied to include activities unrelated to the food rate
rwhat Staddon (1977) called facultative activities. They represented these activities as BN and the reinforcers associated with BN
as rN :
B=
Kr
r + r O + rN
(8)
(9)
g(r)
V
BO = co r
85
86
87
88
89
90
91
92
93
94
95
96
97
(10)
To t data from two large data sets (Baum and Davison, 2014a;
Soto, McDowell, & Dallery, 2005), Baum and Davison (2014b)
assumed that induction follows a power function:
so
84
(11)
Fig. 1. Pecks per minute versus food per minute from Baum (1993). Data are from a multiple VR VI schedule in which the VI component was yoked to the VR component.
Please cite this article in press as: Baum, W.M., The role of induction in operant schedule performance. Behav. Process. (2015),
http://dx.doi.org/10.1016/j.beproc.2015.01.006
98
99
100
101
102
103
104
105
106
107
108
109
110
111
G Model
BEPROC 2990 18
ARTICLE IN PRESS
W.M. Baum / Behavioural Processes xxx (2015) xxxxxx
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
equate the intervals and food rates in the two. The VR schedule
varied across conditions, and each condition continued in daily sessions until both performances appeared stable, whereupon a new
condition began. The VR was varied over as large a range as possible,
from a large VR that produced a moderate food rate just sufcient
to maintain responding to FR 1, the endpoint of ratio schedules.
Since ratio schedules exhibit ratio strain when they are relatively
large, no low food rates were possible, but food rate could increase
up to the extreme at the high end with FR 1.
Fig. 1 shows peck rate as a function of food rate for the four
pigeons in the experiment. Most conditions were presented twice,
and Fig. 1 shows the average peck rate across presentations. Performance on the VR schedules was simply a bitonic or upside-down
U-shape, and peck rates were generally higher for the VR than
the yoked VI. Performance on the VI schedules was more complex. Most notably, whereas the VR curve was concave downwards,
the VI curve was concave upwards in the mid-range of food rates,
which differed from pigeon to pigeon. Indeed, at least three of the
pigeons curves show a clear inection point: at about 11 fpm for
B258; at about 5 fpm for B261 and B122; although less pronounced,
at about 6 fpm for B348. These inection points suggest that peck
rate was relatively at in the low range, but because food rates
lower than about 0.4 per minute, equivalent to a VI 150s, could
not be maintainedexcept for B261, which maintained pecking at
0.13 fpm, equivalent to a VI 460s. Previous research supports the
existence of an inection point, because a negatively accelerated
pattern of responding in the lower range of food rates is well documented (e.g., Catania & Reynolds, 1968; de Villiers, 1977), and
the shift from negative acceleration in the lower range to positive
acceleration in the higher range requires an inection point. All four
pigeons peck rates decreased at the highest food rates.
Since the VI performances included a relatively at peck rate
in the low range of food rates, an inection point followed by an
up-turn in peck rate, and a down-turn at the highest food rates, the
147
148
149
150
151
152
153
154
146
(12)
Fig. 2. Pecks per minute versus food per minute in the VI component of Baum (1993). The broken line represents the t of Herrnsteins hyperbola (Eq. (3)) to the low range
of food rates. The inection point between low food rates and high food rates may be seen at the intersection of the broken curve with the solid line.
Please cite this article in press as: Baum, W.M., The role of induction in operant schedule performance. Behav. Process. (2015),
http://dx.doi.org/10.1016/j.beproc.2015.01.006
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
G Model
BEPROC 2990 18
ARTICLE IN PRESS
W.M. Baum / Behavioural Processes xxx (2015) xxxxxx
Fig. 3. Pecks per minute versus food per minute in the VI component of Baum (1993) tted with the induction model assuming power-function induction (Eqs. (11) and
(12)).
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
Bi
Bj
ci r si
s
cj r j
, for all i =
/ j of n operant activities. The power function
1
1
VN
A
BN
(13)
Please cite this article in press as: Baum, W.M., The role of induction in operant schedule performance. Behav. Process. (2015),
http://dx.doi.org/10.1016/j.beproc.2015.01.006
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
G Model
BEPROC 2990 18
ARTICLE IN PRESS
W.M. Baum / Behavioural Processes xxx (2015) xxxxxx
Fig. 4. Pecks per minute versus food per minute in the VR component of Baum (1993) tted with the induction model assuming power-function induction (Eqs. (11) and
(12)).
255
Excels Solver to adjust one or two at a time. The top right graph
shows the t of the induction model to the VR peck rates; it
resembles those in Fig. 4. The top left graph shows the induction
model tted to the mean VI peck rates. The t resembles those in
Fig. 3 in that it is close but leaves the inection point below the
curve. The lower right graph shows the results of applying Eq. (8)
(matching) to the VR peck rates. The t is just as good as to the
induction model. The lower left graph shows the results of applying Eq. (8) to the VI peck rates. It illustrates the failure of Eq. (8)
to account for the mid-range up-turn; it is only able to produce
a bitonic function. Neither matching (Eq. (8)) nor optimality (not
shown) was able to account for the up-turn. Killeen (1994) mathematical principles of reinforcement, with an equation similar to
Eq. (3), likewise can account for the down-turn at high food rates,
but not the up-turn in the mid-range.
256
2. Further development
241
242
243
244
245
246
247
248
249
250
251
252
253
254
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
Fig. 5. Comparison of tting parameters for VI peck rates (Fig. 3) with those for VR
peck rates (Fig. 4).
Please cite this article in press as: Baum, W.M., The role of induction in operant schedule performance. Behav. Process. (2015),
http://dx.doi.org/10.1016/j.beproc.2015.01.006
272
273
274
275
276
277
278
279
280
G Model
ARTICLE IN PRESS
BEPROC 2990 18
Fig. 6. Comparison of the induction model with matching theory applied to mean peck rates from Baum (1993). Top: the induction model tted to VI peck rates (left) and
to VR peck rates (right). Bottom: matching theory tted to the VI peck rates (left) and to VR peck rates (right). Matching theory cannot accommodate the concave-upward
range of peck rates.
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
KM
KS
(14)
KM = BM + uBS + BO + BN
302
303
BM = cM r SM
296
297
298
299
300
301
(15)
305
306
304
Fig. 7. The three ranges of VI peck rates. In the low-to-moderate range of food rates
(solid curve), pecking (BS ) replaces true background activities (BN ), in the moderateto-high range (broken line), icking or swiping the key (BM ) replaces BS , and in
the extremely high range (solid line), other food-induced activities (BO ) replace BM .
Please cite this article in press as: Baum, W.M., The role of induction in operant schedule performance. Behav. Process. (2015),
http://dx.doi.org/10.1016/j.beproc.2015.01.006
307
308
309
310
311
312
313
314
315
316
G Model
ARTICLE IN PRESS
BEPROC 2990 18
Fig. 8. Comparison of Herrnsteins hyperbola (Eq. (3)) with two induction-based models tted to data from Catania and Reynolds (1968). The Partition model applies a
matching-like relation to all food-induced activities (Eq. (16)). The Difference model assumes simply assumes that other food-induced activities interfere with pecking (Eq.
(17)).
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
B, r
r + rO
cr s+1
r + cO r sO
(16)
B = cr cO r
sO
(17)
Please cite this article in press as: Baum, W.M., The role of induction in operant schedule performance. Behav. Process. (2015),
http://dx.doi.org/10.1016/j.beproc.2015.01.006
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
G Model
BEPROC 2990 18
ARTICLE IN PRESS
W.M. Baum / Behavioural Processes xxx (2015) xxxxxx
382
383
References
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
384
385
386
387
388
389
390
391
392
Baum, W.M., 1974. On two types of deviation from the matching law: bias and
undermatching. J. Exp. Anal. Behav. 22, 231242.
Baum, W.M., 1979. Matching, undermatching: and overmatching in studies of
choice. J. Exp. Anal. Behav. 32, 269281.
Baum, W.M., 1981. Optimization and the matching law as accounts of instrumental
behavior. J. Exp. Anal. Behav. 36, 387403.
Baum, W.M., 1992. In search of the feedback function for variable-interval
schedules. J. Exp. Anal. Behav. 57, 365375.
Baum, W.M., 1993. Performances on ratio and interval schedules of reinforcement:
data and theory. J. Exp. Anal. Behav. 59, 245264.
Please cite this article in press as: Baum, W.M., The role of induction in operant schedule performance. Behav. Process. (2015),
http://dx.doi.org/10.1016/j.beproc.2015.01.006
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438