Real, potentially real, and hypothetical monetary rewards in probability discounting.

Although hypothetical rewards have been used almost exclusively in human discounting studies, investigations of their validity are limited. The present experiment compared the discounting of monetary reward value by probability across conditions in which the rewards were real, potentially real, and hypothetical. Twenty-four undergraduates choose between an uncertain large reward and a certain small reward 60 times (trials). In the real and hypothetical reward conditions, the participants made choices with real and hypothetical money, respectively, in every trial. In the potentially real condition, they did so with real money in randomly selected three of the 60 trials and with hypothetical money in the remainder. The log10 -transformed h values of a hyperbolic probability-discount function and the values of the area under the curve with an ordinal transformation of odds against were higher and lower, respectively, in the potentially real and in the hypothetical reward conditions than in the real reward condition, demonstrating that the probability discounting of hypothetical monetary rewards was larger than that of real rewards. These results suggest that future studies are required to identify why the hypothetical reward procedure overestimates the discounting rates of real rewards.

Stimulus control of a social operant.

Three pigeon dyads were exposed to a two-component multiple schedule comprised of two tandem variable-interval 30-s interresponse time (IRT) > 3-s schedules in the presence of different stimuli. Pecks to keys by both pigeons of a dyad occurring within 500 ms of one another were required for reinforcement under one tandem schedule (the coordination component), and such coordinated responses were not required under the other (the control component). The terminal link of each schedule ensured that the reinforced coordination response was an IRT > 3 s. Rates of coordinated IRTs > 3 s and total rates of coordinated responses (composed of IRTs > 3 s and IRTs ≤ 3 s) were higher in the coordination components than in either of two different control components in which coordination was not required for reinforcement. This difference in coordinated responses in the presence and absence of the coordination requirement under stimulus control transitorily deteriorated and then was reestablished when the relation between the stimulus and the coordination contingency or its absence was reversed. The results show coordinated responding to function as a discriminated social operant.

Stimulus generalization of behavioral history: Interspecies generality and persistence of generalization gradients.

Four pigeons were exposed to a tandem variable-interval (VI) fixed-ratio (FR) schedule in the presence of a 50-pixel (about 15 mm) square or an 80-pixel (about 24 mm) square and to a tandem VI differential-reinforcement-of-low-rate (DRL) schedule when a second 80-pixel or 50-pixel square was present. The values of the VI and FR schedules were adjusted to equate reinforcement rates in the two tandem schedules. Following this, a square-size continuum generalization test was administered under a fixed-interval (FI) schedule or extinction. In the first testing session, response frequency was a graded function of the similarity of the test stimuli to the training stimuli for all pigeons. These systematic generalization gradients persisted longer under the FI schedule than under extinction.

Stimulus control and generalization of remote behavioral history.

Two experiments were conducted to assess stimulus control and generalization of remote behavioral history effects with humans. Undergraduates first responded frequently under a fixed-ratio (FR) schedule in the presence of one line length (16 mm or 31 mm) and infrequently on a tandem FR 1 differential-reinforcement-of-low-rate (DRL) schedule when a second line length (31 mm or 16 mm) was present. Next, an FR 1 schedule in effect in the presence of either stimulus produced comparable response rates between the stimuli. Finally, a tandem FR 1 fixed-interval (FI) schedule was in effect under those same stimuli (Experiment 1) or under 12 line lengths ranging from 7 to 40 mm (Experiment 2). In both experiments, responses under the tandem FR 1 FI schedule were frequent in the presence of stimuli previously correlated with the FR schedule and infrequent in the presence of stimuli previously correlated with the tandem FR 1 DRL schedule. Short-lived but systematic generalization gradients were obtained in Experiment 2. These results show that previously established rates of behavior that disappear when the establishing contingencies are changed can subsequently not only reappear when the contingencies change, but are controlled by and generalize across antecedent stimuli.

Some determinants of remote behavioral history effects in humans.

Undergraduates were exposed to a series of reinforcement schedules: first, to a fixed-ratio (FR) schedule in the presence of one stimulus and to a differential-reinforcement-of-low-rate (DRL) schedule in the presence of another (multiple FR DRL training), then to a fixed-interval (FI) schedule in the presence of a third stimulus (FI baseline), next to the FI schedule under the stimuli previously correlated with the FR and DRL schedules (multiple FI FI testing), and, finally, to a single session of the multiple FR DRL schedule again (multiple FR DRL testing). Response rates during the multiple FI FI schedule were higher under the former FR stimulus than under the former DRL stimulus. This effect of remote histories was prolonged when either the number of FI-baseline sessions was small or zero, or the time interval between the multiple FR DRL training and the multiple FI FI testing was short. Response rates under these two stimuli converged with continued exposure to the multiple FI FI schedule in most cases, but quickly differentiated when the schedule returned to the multiple FR DRL.

Response acquisition by humans with delayed reinforcement.

The present experiment examined whether a response class was acquired by humans with delayed reinforcement. Eight white circles were presented on a computer touch screen. If the undergraduates touched two of the eight circles in a specified sequence (i.e., touching first the upper-left circle then the bottom-left circle), then the touches initiated an unsignaled resetting delay culminating in point delivery. Participants experienced one of three different delays (0 s, 10 s, or 30 s). Rates of the target two-response sequence were higher with delayed reinforcement than with no reinforcement. Terminal rates of the target sequence decreased and postreinforcement pauses increased as a function of delay duration. Other undergraduates exposed to yoked schedules of response-independent point deliveries failed to acquire the sequence. The results demonstrate that a response class was acquired with delayed reinforcement, extending the generality of this phenomenon found with nonhuman animals to humans.

[Real and hypothetical rewards in probability discounting].

In Experiment 1, undergraduates first made choices hypothetically between an uncertain large reward and a certain small reward, second they made choices with real money, and finally they again made hypothetical choices. The discounting rates in the first hypothetical reward condition were higher than those in the following conditions of real or hypothetical rewards. A significant difference in the discounting rate across conditions was not found when the real reward condition was replaced by the hypothetical reward condition (Experiment 2) or by the condition with probability contingency and hypothetical reward (Experiment 3). The difference in the discounting rate was replicated between the hypothetical and real reward conditions when the participants invested money when they selected an uncertain-large reward (Experiment 4). Johnson & Bickel (2002) found no difference in the discounting rate between hypothetical and real rewards when the real rewards were delivered to participants not during but after the experiment. The present experiments, by contrast, delivered real money immediately after every choice, and demonstrate that real and hypothetical rewards differ in the values of discounting rates.

An analysis of reinforcement history effects.

Four pigeons were exposed to two tandem variable-interval differential-reinforcement-of-low-rate schedules under different stimulus conditions. The values of the tandem schedules were adjusted so that reinforcement rates in one stimulus condition were higher than those in the other, even though response rates in the two conditions were nearly identical. Following this, a fixed-interval schedule of either shorter or longer values than, or equal to the baseline schedule, was introduced in the two stimulus conditions respectively. Response rates during those fixed-interval schedules typically were higher in the presence of the stimuli previously correlated with the lower reinforcement rates than were those in the presence of the stimuli previously correlated with the higher reinforcement rates. Such effects of the reinforcement history were most prominent when the value of the fixed-interval schedule was shorter. The results are consistent with both incentive contrast and response strength conceptualizations of related effects. They also suggest methods for disentangling the effects of reinforcement rate on subsequent responding, from the response rate with which it is confounded in many conventional schedules of reinforcement.

Stimulus generalization of behavioral history.

Undergraduates responded under a variable-ratio 30 schedule in the presence of a 25-mm long line and on a differential-reinforcement-of-low-rate 6-s schedule when a 13-mm long line was present. Following this, a line-length continuum generalization test was administered under a fixed-interval 6-s schedule (Experiment 1) or extinction (Experiment 2). In both experiments, obtained generalization gradients conformed to typical postdiscrimination gradients. Responses were frequent under stimuli physically similar to the 25-mm line and infrequent under stimuli physically similar to the 13-mm line. The generalization gradients were generally asymmetric with peak response rates occurring at line lengths greater than 25 mm.

Effects of differences in interreinforcer intervals between past and current schedules on fixed-interval responding.

Undergraduates were exposed to a mixed fixed-ratio differential-reinforcement-of-low-rate schedule. Values of the schedule components were adjusted so that interreinforcer intervals in one component were longer than those in another component. Following this, a mixed fixed-interval 5-s fixed-interval 20-s schedule (Experiment 1) or six fixed-interval schedules in which the values ranged from 5 to 40 s (Experiment 2) were in effect. In both experiments, response rates under the fixed-interval schedules were higher when the interreinforcer intervals approximated those produced under the fixed-ratio schedule, whereas the rates were lower when the interreinforcer intervals approximated those produced under the different-reinforcement-of-low-rate schedule. The present results demonstrate that the effects of behavioral history were under control of the interreinforcer intervals as discriminative stimuli.