Behavior dynamics: One perspective.

Behavior dynamics is a field devoted to analytic descriptions of behavior change. A principal source of both models and methods for these descriptions is found in physics. This approach is an extension of a long conceptual association between behavior analysis and physics. A theme common to both is the role of molar versus molecular events in description and prediction. Similarities and differences in how these events are treated are discussed. Two examples are presented that illustrate possible correspondence between mechanical and behavioral systems. The first demonstrates the use of a mechanical model to describe the molar properties of behavior under changing reinforcement conditions. The second, dealing with some features of concurrent schedules, focuses on the possible utility of nonlinear dynamical systems to the description of both molar and molecular behavioral events as the outcome of a deterministic, but chaotic, process.

Some remarks on the quantitative analysis of behavior.

This paper discusses similarities between the mathematization of operant behavior and the early history of the most mathematical of sciences-physics. Galileo explored the properties of motion without dealing with the causes of motion, focusing on changes in motion. Newton's dynamics were concerned with the action of forces as causes of change. Skinner's rationale for using rate to describe behavior derived from an interest in changes in rate. Reinforcement has played the role of force in the dynamics of behavior. Behavioral momentum and maximization have received mathematical formulations in behavior analysis. Yet to be worked out are the relations between molar and molecular formulations of behavioral theory.

Differential effects of cocaine and pentobarbital on fixed-interval and random-interval performance.

Reports have indicated that the behavioral effects of a drug can be related to the nondrug control rate of behavior in the absence of the drug. To investigate the purported relationship between control rate and drug rate, squirrel monkeys were trained under a fixed-interval 300-s schedule of stimulus-shock termination, a procedure that engendered a wide range of response rates. A light illuminated the experimental chamber during the fixed interval, and the first lever press after 300 s had elapsed terminated the light for 30 s and precluded an electrical stimulus to the tail. Following acute intramuscular administration of cocaine (0.03-0.56 mg/kg), overall rate increased and different control rates of responding, during different parts of the fixed interval, converged toward a common rate. Subsequently, the schedule was changed to a multiple fixed-interval 300-s random-interval 300-s schedule; performance during the random-interval component was characterized by steady responding at a uniformly high rate. Analysis of fixed-interval and random-interval performances following acute cocaine administration revealed convergence of response rates toward a common, uniform rate. Pentobarbital (0.3-10.0 mg/kg) only decreased overall rate, and different control rates of responding during the fixed interval did not converge toward a common rate. The results indicate that this type of analysis can be useful in comparing pharmacological agents from different classes and that the rate at which responding becomes uniform can provide a quantitative behavioral end point for characterizing drug effects on behavior.

Similarities in the rate-altering effects of white noise and cocaine.

The effects of white noise and cocaine on squirrel monkeys' fixed-interval responding were compared to determine whether the presentation of an exteroceptive stimulus could produce rate-altering effects of the type typically observed following drug administration. To investigate the relationship between control response rate and response rate in the presence of drug or noise, the monkeys were trained under a fixed-interval 300-s stimulus-shock termination schedule in order to generate a wide range of local response rates. A light illuminated the experimental chamber during the interval and, after 300 s elapsed, a lever press during a 3-s period terminated the light and precluded the occurrence of a harmless electrical stimulus that otherwise was delivered at the end of the 3-s period. Each interval was followed by a 30-s timeout during which the chamber was darkened and responses had no consequences. Following intramuscular administration of cocaine, different rates of responding characteristic of control performance converged toward a common rate and, at an appropriately high dose, response rate during the fixed interval became more uniform. When white noise was presented continuously during a given session, different response rates also converged toward a common rate and, at an appropriate intensity, response rate became more uniform. Interactions were obtained when cocaine and white noise were presented together, indicating the possibility of a common behavioral mechanism of action. The results suggest that rate-altering drug effects may be, in part, a result of the ability of drugs to produce nonspecific stimulus effects similar to those observed for exteroceptive stimuli.

The effects of chlorpromazine and imipramine on rate and stimulus control of matching to sample.

Pigeons were trained to perform simultaneous, two-color matching to sample under a multiple fixed-ratio fixed-interval schedule of food presentation. The sequence terminating with a peck on the matching key (a "match") was treated as a unit, analogous to a single key peck in conventional schedules. Except for intermittent reinforcement of matches, no consequent stimulus distinguished matches from mismatches (sequences terminating with pecks on the nonmatching key). The pattern of matches during nondrug sessions resembled that of simpler operants maintained by similar schedules. Matches increased in rate toward the end of both components; mismatch rates increased more slowly. Imipramine increased the rate of mismatches, disrupted schedule patterning, and lowered accuracy in a dose-dependent fashion. Chlorpromazine lowered the overall rate of matches but affected schedule patterns and accuracy less than imipramine. The types of errors during drug sessions were not systematically related to the types of errors that appeared during nondrug sessions. Stimulus control was evaluated for each of the four possible color configurations and was found to be by the entire configuration of colors, not simply by the color of the sample.

Conceptual approaches and issues.

The experimental analysis of behavior has lagged far behind mainstream psychology, particularly cognitive psychology, in the study of complex behavior-remembering, thinking, imaging, problem solving, and the like. Yet it is the study of these kinds of behavior that will provide the greatest justification of our continued existence in the community of behavioral scientists. Focusing primarily on remembering as a complex performance, aspects of (1) radical behaviorism, (2) the methodology of the experimental analysis of behavior, and (3) the special contributions of B. F. Skinner are assessed as explicitly or implicitly discouraging the experimental treatment of such complex behavior. Although there are encouraging signs of advancement into the present domains of cognitive psychology, future success of the experimental analysis of behavior in this endeavor will require aggressive pursuit by investigators and more effective training of their students.

An interresponse-time analysis of responding maintained by schedules of response-produced electric shock.

The present study investigated ratio contingencies to evaluate factors that may determine the maintenance of responding when electric shock is the consequent event. Initially, squirrel monkeys (Saimiri sciureus) were exposed to a continuous-avoidance schedule to initiate bar pressing. Subsequently, a multiple random-interval variable-ratio yoked schedule of response-produced shock was used to maintain and to compare interval and ratio performance. A microcomputer recorded and stored the number of responses and interresponse times occurring between successive shock presentations during a given random-interval component, and these numbers determined the ratio requirements during the subsequent ratio component. Responding was maintained for more than 80 sessions in two of three monkeys under the multiple schedule with the ratio yoked to the interval component. Responding during the ratio component persisted in only one monkey, however, when the components were no longer yoked. An analysis of the interresponse times immediately preceding shock under the multiple yoked schedule revealed that the terminal interresponse times were longer under the interval schedule than under the ratio contingency. The interresponse-time analysis indicated that differential interresponse-time relationships may be major determinants of the maintenance of behavior controlled by schedules of electric-shock presentation.

Intractable properties of responding under a fixed-interval schedule.

The behavior engendered by the fixed-interval schedule is characterized by its variability within and across intervals. The present experiment was designed to assess further the magnitude of interval-to-interval dynamics and to explore conditions which might enhance control by response number for subsequent output. Pigeons were exposed to three experimental manipulations after responding had stabilized under a fixed-interval five-minute schedule. First, a discrete five-stimulus counter was added so that the key color changed after a fixed number of responses. Then additional grain presentations were made at the end of the interval so that high response output was differentially reinforced in the presence of the counter stimuli. Finally, the counter stimuli were presented as an irregular clock (i.e., independently of responding), but the durations were yoked to performance under the counter condition. The data show that response number can exert influence from one interval to the next, but this source of control is weak and not influenced by the experimental manipulations. Results from the clock arrangement indicate that behavior is controlled largely by the stimulus conditions prevailing at the time of interval onset.

Choice and reinforcement delay.

Previous studies of choice between two delayed reinforcers have indicated that the relative immediacy of the reinforcer is a major determinant of the relative frequency of responding. Parallel studies of choice between two interresponse times have found exceptions to this generality. The present study looked at the choice by pigeons between two delays, one of which was always four times longer than the other, but whose absolute durations were varied across conditions. The results indicated that choice is not uniquely determined by the relative immediacy of reinforcement, but that absolute delays are also involved. Models for concurrent chained schedules appear to be more applicable to the present data than the matching relation; however, these too failed to predict choice for long delays.

Schedules of response-independent conditioned reinforcement.

Rates and patterns of responding of pigeons under response-independent and response-dependent schedules of brief-stimulus presentation were compared by superimposing 3-min brief-stimulus schedules on a 15-min fixed-interval schedule of food presentation. The brief-stimulus schedules were fixed time, fixed interval, variable time, and variable interval. When the brief stimulus was paired with food presentation, its effects depended upon the schedule and ongoing rates. Fixed- and variable-interval brief-stimulus schedules enhanced the low rates normally occurring early in the 15-min interval, whereas fixed- and variable-time schedules suppressed these rates. Although the overall rates later in the interval were not affected to any great extent, the fixed brief-stimulus schedules generated patterns of positively accelerated responding between stimulus presentations. These patterns appeared less frequently under the variable brief-stimulus schedules. Initially, when not paired with food delivery, presentations of the brief stimulus produced relatively little effect on either response rate or patterning. However, once the stimulus had accompanied food presentation, the original performance under the nonpaired condition was not recovered. The effects were more like those occurring when the stimulus was paired with food.

Sequence schedules of reinforcement.

The performance of pigeons was studied under a second-order schedule composed of fixed-interval components, each of which was associated with a different discriminative stimulus, the stimuli occurring in a fixed order. In one condition, food presentation followed the completion of the fourth component. This was designated a fixed-ratio sequence schedule. In another condition, responses in the first component completed after a fixed time were reinforced. This was designated a fixed-interval sequence schedule. Although the stimulus order and maximum reinforcement frequency were identical under the two schedules, considerably more responding occurred under the fixed-interval sequence schedule in all components. Relatively few food presentations occurred after responding during any but the terminal components of the fixed-interval sequence schedule, a feature independent of the parameter values investigated. In addition, while a pattern of increased responding between food presentations prevailed under both schedules, under the fixed-interval sequence schedule the rate in the terminal component was frequently less than in the penultimate component. The fixed-interval sequence schedule appeared to have several properties of simple fixed-interval schedules.

Effects of chlorpromazine in the pigeon under a second-order schedule of food presentation.

Chlorpromazine was studied for its effects on responding under a second-order schedule in which food was presented following a sequence of 20 one-minute fixed-interval components. A brief visual stimulus occurred at the completion of each fixed interval including the one that terminated with food presentation. Chlorpromazine showed rate-dependent effects in that it increased low rates in the early components of the second-order schedule and, to a lesser extent, decreased high rates in the later components. Chlorpromazine also increased rates in the early quarters within the 1-min fixed-internal components and to a smaller extent decreased rates in the final quarter. The alteration in the patterns of responding within 1-min fixed-interval components terminating in a brief stimulus presentation was substantially less than that which occurred throughout the succession of 1-min fixed-interval components terminating in food presentation, thus suggesting that the presentation of the brief stimulus exerted more control over responding within components than did food presentation over the sequence of components. This result and others suggest that studies using drugs may be useful in elucidating the factors controlling patterns of responding in second-order schedules.

Relations between patterns of responding and the presentation of stimuli under second-order schedules.

Key-pecking behavior in the pigeon was maintained under second-order schedules in which food was presented after a variable number of 2-min fixed-interval components were completed. When either the same stimulus (Exp. I) or different stimuli (Exp. II) appeared on the key during consecutive components, and a stimulus that was occasionally paired with food was presented briefly at completion of each component, (1) patterns of positively accelerated responding were maintained during the components, and, (2) mean response rates were generally as high during the initial components of a sequence as during the later components. In both experiments, when the food-paired stimulus was omitted and either no stimulus or a stimulus never paired with food was presented at completion of each component, mean rates of responding increased, but patterns of positively accelerated responding were not maintained during individual components. When a food-paired stimulus was not presented at completion of the components, mean response rates in Exp. I were low during the initial components of a sequence and gradually increased during subsequent components; in Exp. II mean response rates were variable, and pauses and abrupt changes in response rates were typical.