Effects of pre-operant running and sucrose concentration on operant wheel running on a fixed interval schedule of reinforcement.

Prior research proposed that temporal control over the pattern of operant wheel running on a fixed interval (FI) schedule of sucrose reinforcement is a function of automatic reinforcement generated by wheel running and the experimentally arranged sucrose reinforcement. Two experiments were conducted to assess this prediction. In the first experiment, rats ran for different durations (0, 30, 60, and 180 min) prior to a session of operant wheel running on a FI 120-s schedule. In the second experiment, the concentration of sucrose reinforcement on a FI 180-s schedule was varied across values of 0, 5, 15, and 25%. In Experiment 1, as the duration of pre-operant running increased, the postreinforcement pause before initiation of running lengthened while wheel revolutions in the latter part of the FI interval increased. In Experiment 2, wheel revolutions markedly increased then decreased to a plateau early in the FI interval. Neither manipulation increased temporal control of the pattern of wheel running. Instead, results indicate that operant wheel running is regulated by automatic reinforcement generated by wheel activity and an adjunctive pattern of running induced by the temporal presentation of sucrose. Furthermore, the findings question whether the sucrose contingency regulates wheel running as a reinforcing consequence.

Effect of amphetamine dose on wheel-running functioning as reinforcement or operant behavior on a multiple schedule of reinforcement.

Does the effect of amphetamine on behavior (wheel running) differ depending on the functional role (operant, reinforcement) of that behavior? This study addressed this question using a multiple schedule of reinforcement in which wheel running served as reinforcement for lever pressing in one component and as operant behavior for sucrose reinforcement in the other component. Seven female Long-Evans rats were exposed to a multiple schedule in which pressing a lever on a variable ratio 10 schedule produced the opportunity to run for 15 revolutions in one component and running 15 revolutions produced a drop of 15% sucrose solution in the other component. Doses of 0.5, 1.0, and 2.0 mg/kg D-amphetamine were administered by intraperitoneal injection 20 min prior to a session. As amphetamine dose increased, wheel running decreased in both components - showing no evidence that the effect of the drug on wheel running depended on the function of wheel activity. Notably, lever pressing for wheel-running reinforcement also decreased with amphetamine dose. Drug dose increased the initiation of operant lever pressing, but not the initiation of operant wheel running. We propose that amphetamine dose had common effects on wheel running regardless of its function (reinforcement vs. operant) because wheel-running generates automatic reinforcement and the automatic-reinforcement value of wheel activity is modulated by drug dose.

Automatic reinforcement from operant wheel-running undermines temporal control by fixed-interval schedules of reinforcement.

The current study compared the development of response patterns for operant wheel-running and lever-pressing on fixed-interval schedules. Eleven female Long-Evans rats were exposed to fixed-interval (FI) 15-s, 30-s, and 60-s schedules with wheel revolutions as the operant behavior and sucrose solution as reinforcement. Subsequently, a lever was mounted in each wheel and rats responded on an FI-30 s schedule of sucrose reinforcement. Operant lever-pressing on average developed a scalloping pattern of low responding early in the reinforcement interval followed by an increase in pressing to the moment of reinforcement. In contrast, average operant wheel-revolutions peaked early in the reinforcement interval followed by a plateau, a pattern that did not change over sessions. Variation in the FI-schedule value (interval size) with operant wheel-running did not alter the pattern of running throughout the reinforcement interval, but merely parsed this pattern at different points. Cumulative records for the last session showed long postreinforcement pauses (PRP) for lever pressing. Wheel running, however, rose quickly after reinforcement and continued throughout the reinforcement interval. Overall and local wheel-running rates decreased and PRP duration increased as the interval size of the FI schedule increased. We propose that the automatic reinforcement generated by wheel running, but not lever pressing, provides an account of the poor temporal regulation of operant wheel-running in our study.

Evidence for positive, but not negative, behavioral contrast with wheel-running reinforcement on multiple variable-ratio schedules.

Rats responded on a multiple variable-ratio (VR) 10 VR 10 schedule of reinforcement in which lever pressing was reinforced by the opportunity to run in a wheel for 30s in both the changed (manipulated) and unchanged components. To generate positive contrast, the schedule of reinforcement in the changed component was shifted to extinction; to generate negative contrast, the schedule was shifted to VR 3. With the shift to extinction in the changed component, wheel-running and local lever-pressing rates increased in the unchanged component, a result supporting positive contrast; however, the shift to a VR 3 schedule in the changed component showed no evidence of negative contrast in the unaltered setting, only wheel running decreased in the unchanged component. Changes in wheel-running rates across components were consistent in showing a compensation effect, depending on whether the schedule manipulation increased or decreased opportunities for wheel running in the changed component. These findings are the first to demonstrate positive behavioral contrast on a multiple schedule with wheel running as reinforcement in both components.

Mechanisms of Comorbidities Associated With the Metabolic Syndrome: Insights from the JCR:LA-cp Corpulent Rat Strain.

Obesity and its metabolic complications have emerged as the epidemic of the new millennia. The use of obese rodent models continues to be a productive component of efforts to understand the concomitant metabolic complications of this disease. In 1978, the JCR:LA-cp rat model was developed with an autosomal recessive corpulent (cp) trait resulting from a premature stop codon in the extracellular domain of the leptin receptor. Rats that are heterozygous for the cp trait are lean-prone, while those that are homozygous (cp/cp) spontaneously display the pathophysiology of obesity as well as a metabolic syndrome (MetS)-like phenotype. Over the years, there have been formidable scientific contributions that have originated from this rat model, much of which has been reviewed extensively up to 2008. The premise of these earlier studies focused on characterizing the pathophysiology of MetS-like phenotype that was spontaneously apparent in this model. The purpose of this review is to highlight areas of recent advancement made possible by this model including; emerging appreciation of the "thrifty gene" hypothesis in the context of obesity, the concept of how chronic inflammation may drive obesogenesis, the impact of acute forms of inflammation to the brain and periphery during chronic obesity, the role of dysfunctional insulin metabolism on lipid metabolism and vascular damage, and the mechanistic basis for altered vascular function as well as novel parallels between the human condition and the female JCR:LA-cp rat as a model for polycystic ovary disease (PCOS).

Wheel-running reinforcement in free-feeding and food-deprived rats.

Rats experiencing sessions of 30min free access to wheel running were assigned to ad-lib and food-deprived groups, and given additional sessions of free wheel activity. Subsequently, both ad-lib and deprived rats lever pressed for 60s of wheel running on fixed ratio (FR) 1, variable ratio (VR) 3, VR 5, and VR 10 schedules, and on a response-initiated variable interval (VI) 30s schedule. Finally, the ad-lib rats were switched to food deprivation and the food-deprived rats were switched to free food, as rats continued responding on the response-initiated VI 30-s schedule. Wheel running functioned as reinforcement for both ad-lib and food-deprived rats. Food-deprived rats, however, ran faster and had higher overall lever-pressing rates than free-feeding rats. On the VR schedules, wheel-running rates positively correlated with local and overall lever pressing rates for deprived, but not ad-lib rats. On the response-initiated VI 30s schedule, wheel-running rates and lever-pressing rates changed for ad-lib rats switched to food deprivation, but not for food-deprived rats switched to free-feeding. The overall pattern of results suggested different sources of control for wheel running: intrinsic motivation, contingencies of automatic reinforcement, and food-restricted wheel running. An implication is that generalizations about operant responding for wheel running in food-deprived rats may not extend to wheel running and operant responding of free-feeding animals.

Cardiometabolic and reproductive benefits of early dietary energy restriction and voluntary exercise in an obese PCOS-prone rodent model.

Polycystic ovary syndrome (PCOS) is one of the most common endocrine-metabolic disorders in women of reproductive age characterized by ovulatory dysfunction, hyperandrogenism and cardiometabolic risk. The overweight-obese PCOS phenotype appears to have exacerbated reproductive dysfunction and cardiometabolic risk. In overweight-obese adult women with PCOS, exercise and energy restricted diets have shown limited and inconsistent effects on both cardiometabolic indices and reproductive outcomes. We hypothesized that an early lifestyle intervention involving exercise and dietary energy restriction to prevent or reduce the propensity for adiposity would modulate reproductive indices and cardiometabolic risk in an obese PCOS-prone rodent model. Weanling obese PCOS-prone and Lean-Control JCR:LA-cp rodents were given a chow diet ad libitum or an energy-restricted diet combined with or without voluntary exercise (4  h/day) for 8 weeks. Dietary energy restriction and exercise lowered total body weight gain and body fat mass by 30% compared to free-fed sedentary or exercising obese PCOS-prone animals (P<0.01). Energy restriction induced an increase in exercise intensity compared to free-feeding plus exercise conditions. Energy restriction and exercise decreased fasting plasma triglycerides and apoB48 concentrations in obese PCOS-prone animals compared to free-fed and exercise or sedentary groups. The energy restriction and exercise combination in obese PCOS-prone animals significantly increased plasma sex-hormone binding globulin, hypothalamic cocaine-and amphetamine-regulated transcript (CART) and Kisspeptin mRNA expression to levels of the Lean-Control group, and this was further associated with improvements in estrous cyclicity. The combination of exercise and dietary energy restriction when initiated in early life exerts beneficial effects on cardiometabolic and reproductive indices in an obese PCOS-prone rodent model, and this may be associated with normalization of the hypothalamic neuropeptides, Kisspeptin and CART.

Effect of sucrose availability on wheel-running as an operant and as a reinforcing consequence on a multiple schedule: Additive effects of extrinsic and automatic reinforcement.

As a follow up to Belke and Pierce's (2014) study, we assessed the effects of repeated presentation and removal of sucrose solution on the behavior of rats responding on a two-component multiple schedule. Rats completed 15 wheel turns (FR 15) for either 15% or 0% sucrose solution in the manipulated component and lever pressed 10 times on average (VR 10) for an opportunity to complete 15 wheel turns (FR 15) in the other component. In contrast to our earlier study, the components advanced based on time (every 8min) rather than completed responses. Results showed that in the manipulated component wheel-running rates were higher and the latency to initiate running longer when sucrose was present (15%) compared to absent (0% or water); the number of obtained outcomes (sucrose/water), however, did not differ with the presentation and withdrawal of sucrose. For the wheel-running as reinforcement component, rates of wheel turns, overall lever-pressing rates, and obtained wheel-running reinforcements were higher, and postreinforcement pauses shorter, when sucrose was present (15%) than absent (0%) in manipulated component. Overall, our findings suggest that wheel-running rate regardless of its function (operant or reinforcement) is maintained by automatically generated consequences (automatic reinforcement) and is increased as an operant by adding experimentally arranged sucrose reinforcement (extrinsic reinforcement). This additive effect on operant wheel-running generalizes through induction or arousal to the wheel-running as reinforcement component, increasing the rate of responding for opportunities to run and the rate of wheel-running per opportunity.

Interrelationship of CB1R and OBR pathways in regulation of metabolic, neuroendocrine, and behavioral responses to food restriction and voluntary wheel running.

We hypothesized the cannabinoid-1 receptor and leptin receptor (ObR) operate synergistically to modulate metabolic, neuroendocrine, and behavioral responses of animals exposed to a survival challenge (food restriction and wheel running). Obese-prone (OP) JCR:LA-cp rats, lacking functional ObR, and lean-prone (LP) JCR:LA-cp rats (intact ObR) were assigned to OP-C and LP-C (control) or CBR1-antagonized (SR141716, 10 mg/kg body wt in food) OP-A and LP-A groups. After 32 days, all rats were exposed to 1.5-h daily meals without the drug and 22.5-h voluntary wheel running, a survival challenge that normally culminates in activity-based anorexia (ABA). Rats were removed from the ABA protocol when body weight reached 75% of entry weight (starvation criterion) or after 14 days (survival criterion). LP-A rats starved faster (6.44 ± 0.24 days) than LP-C animals (8.00 ± 0.29 days); all OP rats survived the ABA challenge. LP-A rats lost weight faster than animals in all other groups (P < 0.001). Consistent with the starvation results, LP-A rats increased the rate of wheel running more rapidly than LP-C rats (P = 0.001), with no difference in hypothalamic and primary neural reward serotonin levels. In contrast, OP-A rats showed suppression of wheel running compared with the OP-C group (days 6-14 of ABA challenge, P < 0.001) and decreased hypothalamic and neural reward serotonin levels (P < 0.01). Thus there is an interrelationship between cannabinoid-1 receptor and ObR pathways in regulation of energy balance and physical activity. Effective clinical measures to prevent and treat a variety of disorders will require understanding of the mechanisms underlying these effects.

Down-regulation of hypothalamic pro-opiomelanocortin (POMC) expression after weaning is associated with hyperphagia-induced obesity in JCR rats overexpressing neuropeptide Y.

We hypothesised that hypothalamic feeding-related neuropeptides are differentially expressed in obese-prone and lean-prone rats and trigger overeating-induced obesity. To test this hypothesis, in the present study, we measured energy balance and hypothalamic neuropeptide Y (NPY) and pro-opiomelanocortin (POMC) mRNA expressions in male JCR:LA-cp rats. We compared, in independent cohorts, free-feeding obese-prone (Obese-FF) and lean-prone (Lean-FF) rats at pre-weaning (10 d old), weaning (21-25 d old) and early adulthood (8-12 weeks). A group of Obese-pair-feeding (PF) rats pair-fed to the Lean-FF rats was included in the adult cohort. The body weights of 10-d-old Obese-FF and Lean-FF pups were not significantly different. However, when the pups were shifted from dams' milk to solid food (weaning), the obese-prone rats exhibited more energy intake over the days than the lean-prone rats and higher body and fat pad weights and fasting plasma glucose, leptin, insulin and lipid levels. These differences were consistent with higher energy consumption and lower energy expenditure. In the young adult cohort, the differences between the Obese-FF and Lean-FF rats became more pronounced, yielding significant age effects on most of the parameters of the metabolic syndrome, which were reduced in the Obese-PF rats. The obese-prone rats displayed higher NPY expression than the lean-prone rats at pre-weaning and weaning, and the expression levels did not differ by age. In contrast, POMC expression exhibited significant age-by-genotype differences. At pre-weaning, there was no genotype difference in POMC expression, but in the weanling cohort, obese-prone pups exhibited lower POMC expression than the lean-prone rats. This genotype difference became more pronounced at adulthood. Overall, the development of hyperphagia-induced obesity in obese-prone JCR rats is related to POMC expression down-regulation in the presence of established NPY overexpression.

Effect of sucrose availability and pre-running on the intrinsic value of wheel running as an operant and a reinforcing consequence.

The current study investigated the effect of motivational manipulations on operant wheel running for sucrose reinforcement and on wheel running as a behavioral consequence for lever pressing, within the same experimental context. Specifically, rats responded on a two-component multiple schedule of reinforcement in which lever pressing produced the opportunity to run in a wheel in one component of the schedule (reinforcer component) and wheel running produced the opportunity to consume sucrose solution in the other component (operant component). Motivational manipulations involved removal of sucrose contingent on wheel running and providing 1h of pre-session wheel running. Results showed that, in opposition to a response strengthening view, sucrose did not maintain operant wheel running. The motivational operations of withdrawing sucrose or providing pre-session wheel running, however, resulted in different wheel-running rates in the operant and reinforcer components of the multiple schedule; this rate discrepancy revealed the extrinsic reinforcing effects of sucrose on operant wheel running, but also indicated the intrinsic reinforcement value of wheel running across components. Differences in wheel-running rates between components were discussed in terms of arousal, undermining of intrinsic motivation, and behavioral contrast.

Prior caloric restriction increases survival of prepubertal obese- and PCOS-prone rats exposed to a challenge of time-limited feeding and physical activity.

We hypothesized that a polycystic ovary syndrome (PCOS) background associated with obese-prone genotype, coupled with preconditioning by caloric restriction, would confer a survival benefit in genetically prepubertal obese/PCOS (O/PCOS)-prone rats faced with an unpredictable challenge of food shortage. Female, juvenile JCR:LA-cp rats, O/PCOS- and lean-prone, were exposed to 1.5 h of daily meals and 22.5 h of voluntary wheel-running, a procedure that leads to activity anorexia (AA). One week before the AA challenge (AAC), O/PCOS-prone rats were freely fed (O/PCOS-FF) or pair fed (O/PCOS-FR) to lean-prone, free-feeding animals (Lean-FF). O/PCOS-FR and lean-prone, food-restricted (Lean-FR) groups were matched on relative average caloric intake. Animals were removed from protocol at 75% of initial body weight (starvation criterion) or after 14 days (survival criterion). The AAC induced weight loss in all rats, but there were significant effects of both genotype and feeding history on weight loss (lean-prone rats exhibited a higher rate of weight loss than O/PCOS-prone; P < 0.001), and rats with prior caloric restriction retained more weight than those free fed previously (90.68 ± 0.59% vs. 85.47 ± 0.46%; P < 0.001). The daily rate of running was higher in lean-prone rats compared with O/PCOS-prone. This difference in running rate correlated with differences in mean days of survival. All O/PCOS-FR rats survived at day 14. O/PCOS-FF rats survived longer (10.00 ± 0.97 days) than Lean-FR (6.17 ± 1.58 days) and Lean-FF (4.33 ± 0.42 days) rats (P < 0.05). Thus preconditioning by caloric restriction induces a substantial survival advantage, beyond genotype alone, in prepubertal O/PCOS-prone rats.

Bivalent effects of wheel running on taste conditioning.

We replicated the finding of bivalent conditioning of tastes by wheel running by Hughes and Boakes (2008), but without pre-exposure to the wheel. Rats received six days of conditioning with a flavoured solution presented for 10 min before a 40-min placement in a running wheel and another flavoured solution presented for 10 min after. A highly palatable liquid meal replacement was used as a vehicle for the flavours to encourage consumption, allowing us to equate before and after presentation intervals. Relative to a third flavour, we found that the taste preceding wheel running was consumed less, and the taste that followed wheel running was consumed more. Novel wheel running can therefore condition both taste avoidance and taste preference.

Feeding history and obese-prone genotype increase survival of rats exposed to a challenge of food restriction and wheel running.

We hypothesized that obese-prone genotype and history of food restriction confer a survival advantage to genetically obese animals under environmental challenge. Male juvenile JCR:LA-cp rats, obese-prone and lean-prone, were exposed to 1.5 h daily meals and 22.5-h voluntary wheel running, a procedure inducing activity anorexia (AA). One week before the AA challenge, obese-prone rats were freely fed (obese-FF), or pair fed (obese-PF) to lean-prone, free-feeding rats (lean-FF). Animals were removed from protocol at 75% of initial body weight (starvation criterion) or after 14 days (survival criterion). AA challenge induced weight loss in all rats, but percent weight loss was more rapid and sustained in lean-FF rats than in obese-FF or obese-PF animals (P < 0.04). Weight loss was significantly higher in obese-FF rats than obese-PF rats, 62% of which achieved survival criterion and stabilized with zero weight loss. Obese-PF rats survived longer, on average (12.0 ± 1.1 day) than obese-FF (8.2 ± 1.1 day) and lean-FF rats (3.5 ± 0.2 day) (P < 0.02). Wheel running increased linearly in all groups; lean-FF increased more rapidly than obese-FF (P < 0.05); obese-PF increased at an intermediate rate (P < 0.02), and those rats that survived stabilized daily rates of wheel running. Prior food restriction of juvenile obese-prone rats induces a survival benefit beyond genotype, that is related to achievement of homeostasis. This metabolic adaptive process may help explain the development of human obesity in the presence of an unstable food environment which subsequently transitions to an abundant food supply.

Blocking of conditioned taste avoidance induced by wheel running.

In Experiment 1, compared to non-reinforced presentation of a food stimulus (A-->no US), the association of a food stimulus with wheel running (A-->US) blocked subsequent avoidance of a distinctive flavor (X), when both the food and flavor were followed by wheel running (AX-->US). Experiment 2 replicated and extended the blocking effect, demonstrating that the amount of avoidance of X after AX-->wheel training depended on the correlation between A-alone trials and wheel running-the predictiveness of the A stimulus. The present study is the first to demonstrate associative blocking of conditioned taste avoidance (CTA) induced by wheel running and strongly implicates associative learning as the basis for this kind of avoidance.

Body weight manipulation, reinforcement value and choice between sucrose and wheel running: a behavioral economic analysis.

Twelve female Long-Evans rats were exposed to concurrent variable (VR) ratio schedules of sucrose and wheel-running reinforcement (Sucrose VR 10 Wheel VR 10; Sucrose VR 5 Wheel VR 20; Sucrose VR 20 Wheel VR 5) with predetermined budgets (number of responses). The allocation of lever pressing to the sucrose and wheel-running alternatives was assessed at high and low body weights. Results showed that wheel-running rate and lever-pressing rates for sucrose and wheel running increased, but the choice of wheel running decreased at the low body weight. A regression analysis of relative consumption as a function of relative price showed that consumption shifted toward sucrose and interacted with price differences in a manner consistent with increased substitutability. Demand curves showed that demand for sucrose became less elastic while demand for wheel running became more elastic at the low body weight. These findings reflect an increase in the difference in relative value of sucrose and wheel running as body weight decreased. Discussion focuses on the limitations of response rates as measures of reinforcement value. In addition, we address the commonalities between matching and demand curve equations for the analysis of changes in relative reinforcement value.

Overeating by young obesity-prone and lean rats caused by tastes associated with low energy foods.

OBJECTIVE: Childhood obesity is a prominent health problem that may involve early learning about tastes and the energy content of foods. We tested the hypothesis that food tastes predictive of low energy content cause overeating in young animals. RESEARCH METHODS AND PROCEDURES: Juvenile and adolescent (4- and 8-week-old) male JCR:LA-cp lean (+/cp or +/+) and obesity-prone (cp/cp) rats were given sweet (saccharin) and salty (sodium chloride) gelatin cubes made with starch (high caloric) or no starch (low caloric) for 16 days of taste conditioning. After 10 hours of food deprivation, rats received pre-meals with flavors that had been paired or unpaired with high caloric content during taste conditioning, followed immediately by measurement of chow intake at regular meals. RESULTS: Our findings show that both lean (+/cp) and obesity-prone (cp/cp) juvenile rats ate more regular chow after a pre-meal with a flavor associated with low caloric value than after a similar pre-meal with a flavor predictive of high caloric content. This effect occurred with juvenile rats but not with adolescents. DISCUSSION: Data from our study indicate that the subversion of the relationship between taste and caloric content disrupts the normal physiological and behavioral energy balance of juvenile rats, resulting in overeating that is independent of genetic disposition for obesity.

Reinforcement value and substitutability of sucrose and wheel running: implications for activity anorexia.

Choice between sucrose and wheel-running reinforcement was assessed in two experiments. In the first experiment, ten male Wistar rats were exposed to concurrent VI 30 s VI 30 s schedules of wheel-running and sucrose reinforcement. Sucrose concentration varied across concentrations of 2.5, 7.5, and 12.5%. As concentration increased, more behavior was allocated to sucrose and more reinforcements were obtained from that alternative. Allocation of behavior to wheel running decreased, but obtained wheel-running reinforcement did not change. Overall, the results suggested that food-deprived rats were sensitive to qualitative changes in food supply (sucrose concentration) while continuing to defend a level of physical activity (wheel running). In the second study, 15 female Long Evans rats were exposed to concurrent variable ratio schedules of sucrose and wheel-running, wheel-running and wheel-running, and sucrose and sucrose reinforcement. For each pair of reinforcers, substitutability was assessed by the effect of income-compensated price changes on consumption of the two reinforcers. Results showed that, as expected, sucrose substituted for sucrose and wheel running substituted for wheel running. Wheel running, however, did not substitute for sucrose; but sucrose partially substituted for wheel running. We address the implications of the interrelationships of sucrose and wheel running for an understanding of activity anorexia.

Taste avoidance induced by wheel running: effects of backward pairings and robustness of conditioned taste aversion.

Rats repeatedly exposed to a distinctive novel solution (conditioned stimulus, CS) followed by the opportunity to run in a wheel subsequently drink less of this solution. Investigations on this phenomenon indicate that wheel running is an effective unconditioned stimulus (US) for establishing conditioned taste aversion (CTA) when using a forward conditioning procedure (i.e., the US-wheel running follows the CS-taste). However, other studies show that wheel running produces reliable preference for a distinctive place when pairings are backward (i.e., the CS-location follows the US-wheel running). One possibility to account for these results is that rewarding aftereffects of wheel running conditioned preference to the CS. The main objective of the present study was to assess the effects of backward conditioning using wheel running as the US and a distinctive taste as the CS. In a between-groups design, two experimental groups [i.e., forward (FC) and backward conditioning (BC)] and two control groups [CS-taste alone (TA) and CS-US unpaired (UNP)] were compared. Results from this experiment indicated that there is less suppression of drinking when a CS-taste followed a bout of wheel running. In fact, rats in the BC group drank more of the paired solution than all the other groups.