Your browser doesn't support javascript.
loading
Mostrar: 20 | 50 | 100
Resultados 1 - 20 de 37
Filtrar
Mais filtros










Base de dados
Intervalo de ano de publicação
1.
Eur J Neurosci ; 59(6): 1260-1277, 2024 Mar.
Artigo em Inglês | MEDLINE | ID: mdl-38039083

RESUMO

Phasic dopamine activity is believed to both encode reward-prediction errors (RPEs) and to cause the adaptations that these errors engender. If so, a rat working for optogenetic stimulation of dopamine neurons will repeatedly update its policy and/or action values, thus iteratively increasing its work rate. Here, we challenge this view by demonstrating stable, non-maximal work rates in the face of repeated optogenetic stimulation of midbrain dopamine neurons. Furthermore, we show that rats learn to discriminate between world states distinguished only by their history of dopamine activation. Comparison of these results to reinforcement learning simulations suggests that the induced dopamine transients acted more as rewards than RPEs. However, pursuit of dopaminergic stimulation drifted upwards over a time scale of days and weeks, despite its stability within trials. To reconcile the results with prior findings, we consider multiple roles for dopamine signalling.


Assuntos
Dopamina , Aprendizagem , Ratos , Animais , Dopamina/fisiologia , Aprendizagem/fisiologia , Reforço Psicológico , Recompensa , Mesencéfalo , Neurônios Dopaminérgicos/fisiologia
2.
Eur J Neurosci ; 58(8): 3751-3784, 2023 Oct.
Artigo em Inglês | MEDLINE | ID: mdl-37752810

RESUMO

Receipt of an intense reward boosts motivation to work for more of that reward. This phenomenon is called the priming effect of rewards. Using a novel measurement method, we show that the priming effect of rewarding electrical brain stimulation depends on the cost, as well as on the strength, of the anticipated reward. Previous research on the priming effect of electrical brain stimulation utilized a runway paradigm in which running speed serves as the measure of motivation. In the present study, the measure of motivation was the vigour with which rats executed a two-lever response chain, in a standard operant-conditioning chamber, to earn rewarding electrical stimulation of the lateral hypothalamus. In a second experiment, we introduced a modification that entails self-administered priming stimulation and alternating blocks of primed and unprimed trials. Reliable, consistent priming effects of substantial magnitude were obtained in the modified paradigm, which is closely analogous to the runway paradigm. In a third experiment, the modified paradigm served to assess the dependence of the priming effect on dopamine D2-like receptors. The priming effect proved resilient to the effect of eticlopride, a selective D2-like receptor antagonist. These results are discussed within the framework of a new model of brain reward circuitry in which non-dopaminergic medial forebrain bundle fibers and dopamine axons provide parallel inputs to the final common paths for reward and incentive motivation.

3.
Brain Sci ; 12(8)2022 Aug 08.
Artigo em Inglês | MEDLINE | ID: mdl-36009115

RESUMO

Major depressive disorder is a leading cause of disability and suicide worldwide. Consecutive rounds of conventional interventions are ineffective in a significant sub-group of patients whose disorder is classified as treatment-resistant depression. Significant progress in managing this severe form of depression has been achieved through the use of deep brain stimulation of the medial forebrain bundle (MFB). The beneficial effect of such stimulation appears strong, safe, and enduring. The proposed neural substrate for this promising clinical finding includes midbrain dopamine neurons and a subset of their cortical afferents. Here, we aim to broaden the discussion of the candidate circuitry by exploring potential implications of a new "convergence" model of brain reward circuitry in rodents. We chart the evolution of the new model from its predecessors, which held that midbrain dopamine neurons constituted an obligatory stage of the final common path for reward seeking. In contrast, the new model includes a directly activated, non-dopaminergic pathway whose output ultimately converges with that of the dopaminergic neurons. On the basis of the new model and the relative ineffectiveness of dopamine agonists in the treatment of depression, we ask whether non-dopaminergic circuitry may contribute to the clinical efficacy of deep brain stimulation of the MFB.

4.
Front Behav Neurosci ; 16: 851067, 2022.
Artigo em Inglês | MEDLINE | ID: mdl-35431828

RESUMO

Deep-brain stimulation of the medial forebrain bundle (MFB) can provide effective, enduring relief of treatment-resistant depression. Panksepp provided an explanatory framework: the MFB constitutes the core of the neural circuitry subserving the anticipation and pursuit of rewards: the "SEEKING" system. On that view, the SEEKING system is hypoactive in depressed individuals; background electrical stimulation of the MFB alleviates symptoms by normalizing activity. Panksepp attributed intracranial self-stimulation to excitation of the SEEKING system in which the ascending projections of midbrain dopamine neurons are an essential component. In parallel with Panksepp's qualitative work, intracranial self-stimulation has long been studied quantitatively by psychophysical means. That work argues that the predominant directly stimulated substrate for MFB self-stimulation are myelinated, non-dopaminergic fibers, more readily excited by brief electrical current pulses than the thin, unmyelinated axons of the midbrain dopamine neurons. The series-circuit hypothesis reconciles this view with the evidence implicating dopamine in MFB self-stimulation as follows: direct activation of myelinated MFB fibers is rewarding due to their trans-synaptic activation of midbrain dopamine neurons. A recent study in which rats worked for optogenetic stimulation of midbrain dopamine neurons challenges the series-circuit hypothesis and provides a new model of intracranial self-stimulation in which the myelinated non-dopaminergic neurons and the midbrain dopamine projections access the behavioral final common path for reward seeking via separate, converging routes. We explore the potential implications of this convergence model for the interpretation of the antidepressant effect of MFB stimulation. We also discuss the consistent finding that psychomotor stimulants, which boost dopaminergic neurotransmission, fail to provide a monotherapy for depression. We propose that non-dopaminergic MFB components may contribute to the therapeutic effect in parallel to, in synergy with, or even instead of, a dopaminergic component.

5.
Behav Brain Res ; 419: 113702, 2022 02 15.
Artigo em Inglês | MEDLINE | ID: mdl-34864162

RESUMO

Optogenetic experiments reveal functional roles of specific neurons. However, functional inferences have been limited by widespread adoption of a restricted set of stimulation parameters. Broader exploration of the parameter space can deepen insight into the mapping between selective neural activity and behavior. In this way, characteristics of the activated neural circuit, such as temporal integration, can be inferred. Our objective was to determine whether an equal-energy principle accounts for the interaction of pulse duration and optical power in optogenetic excitation. Six male TH::Cre rats worked for optogenetic (ChannelRhodopsin-2) stimulation of VTA dopamine neurons. We used a within-subject design to describe the trade-off between pulse duration and optical power in determining reward seeking. Parameters were customized for each subject based on behavioral effectiveness. Within a useful range of powers (~12.6-31.6 mW) the product of optical power and pulse duration required to produce a given level of reward seeking was roughly constant. Such reciprocity is consistent with Bloch's law, which posits an equal-energy principle of temporal summation over short durations in human vision. The trade-off between pulse duration and power broke down at higher powers. Thus, optical power and duration can be adjusted reciprocally for brief durations and lower powers, and power can be substituted for pulse duration to scale the region of excitation in behavioral optogenetic experiments. The findings demonstrate the utility of within-subject and trade-off designs in optogenetics and of parameter adjustment based on functional endpoints instead of physical properties of the stimulation.


Assuntos
Comportamento Animal/fisiologia , Channelrhodopsins , Neurônios Dopaminérgicos/fisiologia , Recompensa , Área Tegmentar Ventral/fisiologia , Animais , Masculino , Optogenética , Ratos , Ratos Long-Evans , Fatores de Tempo
6.
PLoS One ; 15(6): e0226722, 2020.
Artigo em Inglês | MEDLINE | ID: mdl-32502210

RESUMO

The neurobiological study of reward was launched by the discovery of intracranial self-stimulation (ICSS). Subsequent investigation of this phenomenon provided the initial link between reward-seeking behavior and dopaminergic neurotransmission. We re-evaluated this relationship by psychophysical, pharmacological, optogenetic, and computational means. In rats working for direct, optical activation of midbrain dopamine neurons, we varied the strength and opportunity cost of the stimulation and measured time allocation, the proportion of trial time devoted to reward pursuit. We found that the dependence of time allocation on the strength and cost of stimulation was similar formally to that observed when electrical stimulation of the medial forebrain bundle served as the reward. When the stimulation is strong and cheap, the rats devote almost all their time to reward pursuit; time allocation falls off as stimulation strength is decreased and/or its opportunity cost is increased. A 3D plot of time allocation versus stimulation strength and cost produces a surface resembling the corner of a plateau (the "reward mountain"). We show that dopamine-transporter blockade shifts the mountain along both the strength and cost axes in rats working for optical activation of midbrain dopamine neurons. In contrast, the same drug shifted the mountain uniquely along the opportunity-cost axis when rats worked for electrical MFB stimulation in a prior study. Dopamine neurons are an obligatory stage in the dominant model of ICSS, which positions them at a key nexus in the final common path for reward seeking. This model fails to provide a cogent account for the differential effect of dopamine transporter blockade on the reward mountain. Instead, we propose that midbrain dopamine neurons and neurons with non-dopaminergic, MFB axons constitute parallel limbs of brain-reward circuitry that ultimately converge on the final-common path for the evaluation and pursuit of rewards.


Assuntos
Encéfalo/citologia , Neurônios Dopaminérgicos/citologia , Modelos Neurológicos , Recompensa , Autoestimulação/fisiologia , Encéfalo/fisiologia
7.
Eur J Neurosci ; 50(9): 3416-3427, 2019 11.
Artigo em Inglês | MEDLINE | ID: mdl-31350860

RESUMO

The priming effect of rewards is a boost in the vigor of reward seeking resulting from the previous receipt of a reward. Extensive work has been carried out on the priming effect of electrical brain stimulation, but much less research exists on the priming effect of natural rewards, such as food. While both reinforcement and motivation are linked with dopamine transmission in the brain, the priming effect of rewards does not appear to be dopamine-dependent. In the present study, an operant method was developed to measure the priming effect of food and then applied to investigate whether it is affected by dopamine receptor antagonism. Long-Evans rats were administered saline or one of the three doses (0.01, 0.05, 0.075 mg/kg) of the dopamine D1 receptor family antagonist, SCH23390, or the dopamine D2 receptor family antagonist, eticlopride. Although dopamine receptor antagonism affected pursuit of food, it did not eliminate the priming effect. These data suggest that despite the involvement of dopamine transmission in reinforcement and motivation, the priming effect of food does not depend on dopamine transmission.


Assuntos
Benzazepinas/farmacologia , Alimentos , Priming de Repetição/efeitos dos fármacos , Salicilamidas/farmacologia , Animais , Condicionamento Operante/efeitos dos fármacos , Antagonistas de Dopamina/farmacologia , Masculino , Ratos
8.
PLoS Comput Biol ; 15(6): e1007093, 2019 06.
Artigo em Inglês | MEDLINE | ID: mdl-31233559

RESUMO

Humans and other animals are able to discover underlying statistical structure in their environments and exploit it to achieve efficient and effective performance. However, such structure is often difficult to learn and use because it is obscure, involving long-range temporal dependencies. Here, we analysed behavioural data from an extended experiment with rats, showing that the subjects learned the underlying statistical structure, albeit suffering at times from immediate inferential imperfections as to their current state within it. We accounted for their behaviour using a Hidden Markov Model, in which recent observations are integrated with evidence from the past. We found that over the course of training, subjects came to track their progress through the task more accurately, a change that our model largely attributed to improved integration of past evidence. This learning reflected the structure of the task, decreasing reliance on recent observations, which were potentially misleading.


Assuntos
Modelos Biológicos , Recompensa , Aprendizagem Espacial/fisiologia , Animais , Comportamento Animal/fisiologia , Biologia Computacional , Ratos , Análise e Desempenho de Tarefas
9.
Neurosci Lett ; 665: 29-32, 2018 02 05.
Artigo em Inglês | MEDLINE | ID: mdl-29175028

RESUMO

Studies using in vivo microdialysis have shown that 17ß-estradiol (E2) increases dopamine (DA) transmission in the dorsal striatum. Both systemic administration of E2 and local infusion into the dorsal striatum rapidly enhance amphetamine-induced DA release. However, it is not known to what degree these effects reflect tonic and/or phasic DA release. It was hypothesized that E2 acts directly within the DS to rapidly increase phasic DA transmission. In urethane-anesthetized (1.5mL/kg) female rats, we used fast-scan cyclic voltammetry to study the effects of E2 on phasic, electrically-evoked release of DA in the dorsal striatum. Rats were ovariectomized and implanted with a silastic tube containing 5% E2 in cholesterol, previously shown to mimic low physiological serum concentrations of∼20-25pg/mL. DA release was evoked every 1min by delivering biphasic electrical stimulation in the substantia nigra. Local infusions of E2 (244.8pg/µl) into the dorsal striatum increased the amplitude of the electrically evoked DA transients. Behaviorally significant stimuli and events trigger phasic release of DA. The present findings predict that E2 would boost such signaling in behaving subjects.


Assuntos
Corpo Estriado/efeitos dos fármacos , Dopamina/metabolismo , Estradiol/farmacologia , Substância Negra/efeitos dos fármacos , Anfetamina/farmacologia , Animais , Estimulação Elétrica , Feminino , Microdiálise/métodos , Ratos Long-Evans , Transdução de Sinais/efeitos dos fármacos
10.
PLoS One ; 12(8): e0182120, 2017.
Artigo em Inglês | MEDLINE | ID: mdl-28841663

RESUMO

Pursuit of one goal typically precludes simultaneous pursuit of another. Thus, each exclusive activity entails an "opportunity cost:" the forgone benefits from the next-best activity eschewed. The present experiment estimates, in laboratory rats, the function that maps objective opportunity costs into subjective ones. In an operant chamber, rewarding electrical brain stimulation was delivered when the cumulative time a lever had been depressed reached a criterion duration. The value of the activities forgone during this duration is the opportunity cost of the electrical reward. We determined which of four functions best describes how objective opportunity costs, expressed as the required duration of lever depression, are translated into their subjective equivalents. The simplest account is the identity function, which equates subjective and objective opportunity costs. A variant of this function called the "sigmoidal-slope function," converges on the identity function at longer durations but deviates from it at shorter durations. The sigmoidal-slope function has the form of a hockey stick. The flat "blade" denotes a range over which opportunity costs are subjectively equivalent; these durations are too short to allow substitution of more beneficial activities. The blade extends into an upward-curving portion over which costs become discriminable and finally into the straight "handle," over which objective and subjective costs match. The two remaining functions are based on hyperbolic and exponential temporal discounting, respectively. The results are best described by the sigmoidal-slope function. That this is so suggests that different principles of intertemporal choice are involved in the evaluation of time spent working for a reward or waiting for its delivery. The subjective opportunity-cost function plays a key role in the evaluation and selection of goals. An accurate description of its form and parameters is essential to successful modeling and prediction of instrumental performance and reward-related decision making.


Assuntos
Encéfalo/fisiologia , Estimulação Elétrica , Animais , Ratos
11.
Front Behav Neurosci ; 10: 161, 2016.
Artigo em Inglês | MEDLINE | ID: mdl-27616984

RESUMO

Glutamate stimulates ventral midbrain (VM) N-Methyl-D-Aspartate receptors (NMDAR) to initiate dopamine (DA) burst firing activity, a mode of discharge associated with enhanced DA release and reward. Blockade of VM NMDAR, however, enhances brain stimulation reward (BSR), the results can be explained by a reduction in the inhibitory drive on DA neurons that is also under the control of glutamate. In this study, we used fast-scan cyclic voltammetry (FSCV) in anesthetized animals to determine whether this enhancement is associated with a change in phasic DA release in the nucleus accumbens. Rats were implanted with a stimulation electrode in the dorsal-raphe (DR) and bilateral cannulae above the VM and trained to self-administer trains of electrical stimulation. The curve-shift method was used to evaluate the effect of a single dose (0.825 nmol/0.5 µl/side) of the NMDAR antagonist, (2R,4S)-4-(3-Phosphopropyl)-2-piperidinecarboxylic acid (PPPA), on reward. These animals were then anesthetized and DA release was measured during delivery of electrical stimulation before and after VM microinjection of the vehicle followed by PPPA. As expected, phasic DA release and operant responding depended similarly on the frequency of rewarding electrical stimulation. As anticipated, PPPA produced a significant reward enhancement. Unexpectedly, PPPA produced a decrease in the magnitude of DA transients at all tested frequencies. To test whether this decrease resulted from excessive activation of DA neurons, we injected apomorphine 20 min after PPPA microinjection. At a dose (100 µg s.c.) sufficient to reduce DA firing under control conditions, apomorphine restored electrical stimulation-induced DA transients. These findings show that combined electrical stimulation and VM NMDARs blockade induce DA inactivation, an effect that indirectly demonstrates that VM NMDARs blockade enhances reward by potentiating stimulation-induced excitation in the mesoaccumbens DA pathway.

12.
Behav Brain Res ; 298(Pt A): 27-31, 2016 Feb 01.
Artigo em Inglês | MEDLINE | ID: mdl-26005129

RESUMO

Mesocortical dopamine connectivity continues to mature during adolescence. This protracted development confers increased vulnerability for environmental and genetic factors to disrupt mesocortical wiring and subsequently influence responses to drugs of abuse in adulthood. The netrin-1 receptor, DCC, orchestrates medial prefrontal cortex dopamine input during adolescence and dictates the functional organization of local circuitry. Haploinsufficiency of dcc results in increased dopamine innervation to the medial prefrontal cortex, which in turn leads to resilience against the behavioral activating effects of stimulant drugs. However, whether sensitivity to the rewarding effects of drugs of abuse is also altered in dcc haploinsufficiency remains to be resolved. Here, we used the curve-shift method to measure cocaine-induced facilitation of intracranial self-stimulation (ICSS) in adult dcc haploinsufficient mice and wild-type littermates. We found that dcc haploinsufficient mice acquire ICSS behavior at comparable stimulation parameters to wild-type controls. However, cocaine-induced potentiation of ICSS is significantly blunted in dcc haploinsufficient mice. These results are consistent with decreased sensitivity to the rewarding effects of cocaine and/or decreased proclivity to invest effort in the pursuit of reward in dcc haploinsufficient mice. Moreover, these findings suggest that DCC signaling determines adult susceptibility to drug abuse most likely by controlling prefrontal cortex development in adolescence.


Assuntos
Cocaína/farmacologia , Inibidores da Captação de Dopamina/farmacologia , Haploinsuficiência , Receptores de Superfície Celular/deficiência , Receptores de Superfície Celular/genética , Recompensa , Proteínas Supressoras de Tumor/deficiência , Proteínas Supressoras de Tumor/genética , Animais , Receptor DCC , Relação Dose-Resposta a Droga , Região Hipotalâmica Lateral/efeitos dos fármacos , Região Hipotalâmica Lateral/fisiologia , Neuroestimuladores Implantáveis , Masculino , Camundongos Transgênicos , Autoestimulação/efeitos dos fármacos , Autoestimulação/fisiologia
13.
Front Behav Neurosci ; 9: 331, 2015.
Artigo em Inglês | MEDLINE | ID: mdl-26696851

RESUMO

RATIONALE: Adult rats emit ultrasonic vocalizations (USVs) at around 50-kHz; these commonly occur in contexts that putatively engender positive affect. While several reports indicate that dopaminergic (DAergic) transmission plays a role in the emission of 50-kHz calls, the pharmacological evidence is mixed. Different modes of dopamine (DA) release (i.e., tonic and phasic) could potentially explain this discrepancy. OBJECTIVE: To investigate the potential role of phasic DA release in 50-kHz call emission. METHODS: In Experiment 1, USVs were recorded in adult male rats following unexpected electrical stimulation of the medial forebrain bundle (MFB). In parallel, phasic DA release in the nucleus accumbens (NAcc) was recorded using fast-scan cyclic voltammetry. In Experiment 2, USVs were recorded following response-contingent or non-contingent optogenetic stimulation of midbrain DAergic neurons. Four 20-s schedules of optogenetic stimulation were used: fixed-interval, fixed-time, variable-interval, and variable-time. RESULTS: Brief electrical stimulation of the MFB increased both 50-kHz call rate and phasic DA release in the NAcc. During optogenetic stimulation sessions, rats initially called at a high rate comparable to that observed following reinforcers such as psychostimulants. Although optogenetic stimulation maintained reinforced responding throughout the 2-h session, the call rate declined to near zero within the first 30 min. The trill call subtype predominated following both electrical and optical stimulation. CONCLUSION: The occurrence of electrically-evoked 50-kHz calls, time-locked to phasic DA (Experiment 1), provides correlational evidence supporting a role for phasic DA in USV production. However, in Experiment 2, the temporal dissociation between calling and optogenetic stimulation of midbrain DAergic neurons suggests that phasic mesolimbic DA release is not sufficient to produce 50-kHz calls. The emission of the trill subtype of 50-kHz calls potentially provides a marker distinguishing positive affect from positive reinforcement.

14.
MethodsX ; 2: 263-71, 2015.
Artigo em Inglês | MEDLINE | ID: mdl-26150997

RESUMO

In vivo optogenetic experiments commonly employ long lengths of optical fiber to connect the light source (commonly a laser) to the optical fiber implants in the brain. Commercially available patch cords are expensive and break easily. Researchers have developed methods to build these cables in house for in vivo experiments with rodents [1-4]. However, the half-life of those patch cords is greatly reduced when they are used with behaving rats, which are strong enough to break the delicate cable tip and to bite through the optical fiber and furcation tubing. Based on [3] we have strengthened the patch-cord tip that connects to the optical implant, and we have incorporated multiple layers of shielding to produce more robust and resistant cladding. Here, we illustrate how to build these patch cords with FC or M3 connectors. However, the design can be adapted for use with other common optical-fiber connectors. We have saved time and money by using this design in our optical self-stimulation experiments with rats, which are commonly several months long and last four to eleven hours per session. The main advantages are: •Long half-life.•Resistant to moderate rodent bites.•Suitable for long in vivo optogenetic experiments with large rodents.

15.
PLoS Comput Biol ; 10(12): e1003894, 2014 Dec.
Artigo em Inglês | MEDLINE | ID: mdl-25474151

RESUMO

Given the option, humans and other animals elect to distribute their time between work and leisure, rather than choosing all of one and none of the other. Traditional accounts of partial allocation have characterised behavior on a macroscopic timescale, reporting and studying the mean times spent in work or leisure. However, averaging over the more microscopic processes that govern choices is known to pose tricky theoretical problems, and also eschews any possibility of direct contact with the neural computations involved. We develop a microscopic framework, formalized as a semi-Markov decision process with possibly stochastic choices, in which subjects approximately maximise their expected returns by making momentary commitments to one or other activity. We show macroscopic utilities that arise from microscopic ones, and demonstrate how facets such as imperfect substitutability can arise in a more straightforward microscopic manner.


Assuntos
Tomada de Decisões , Atividades de Lazer , Modelos Biológicos , Trabalho , Algoritmos , Animais , Biologia Computacional , Humanos , Dinâmica não Linear , Processos Estocásticos
16.
Front Behav Neurosci ; 8: 284, 2014.
Artigo em Inglês | MEDLINE | ID: mdl-25202245

RESUMO

Rats will work for electrical stimulation of the medial forebrain bundle. The rewarding effect arises from the volleys of action potentials fired by the stimulation and subsequent spatio-temporal integration of their post-synpatic impact. The proportion of time allocated to self-stimulation depends on the intensity of the rewarding effect as well as on other key determinants of decision-making, such as subjective opportunity costs and reward probability. We have proposed that a 3D model relating time allocation to the intensity and cost of reward can distinguish manipulations acting prior to the output of the spatio-temporal integrator from those acting at or beyond it. Here, we test this proposition by varying reward probability, a variable that influences the computation of payoff in the 3D model downstream from the output of the integrator. On riskless trials, reward was delivered on every occasion that the rat held down the lever for a cumulative duration called the "price," whereas on risky trials, reward was delivered with probability 0.75 or 0.50. According to the model, the 3D structure relating time allocation to reward intensity and price is shifted leftward along the price axis by reductions in reward probability; the magnitude of the shift estimates the change in subjective probability. The predictions were borne out: reducing reward probability shifted the 3D structure systematically along the price axis while producing only small, inconsistent displacements along the pulse-frequency axis. The results confirm that the model can accurately distinguish manipulations acting at or beyond the spatio-temporal integrator and strengthen the conclusions of previous studies showing similar shifts following dopaminergic manipulations. Subjective and objective reward probabilities appeared indistinguishable over the range of 0.5 ≤ p ≤ 1.0.

17.
J R Soc Interface ; 11(91): 20130969, 2014 Feb 06.
Artigo em Inglês | MEDLINE | ID: mdl-24284898

RESUMO

Dividing limited time between work and leisure when both have their attractions is a common everyday decision. We provide a normative control-theoretic treatment of this decision that bridges economic and psychological accounts. We show how our framework applies to free-operant behavioural experiments in which subjects are required to work (depressing a lever) for sufficient total time (called the price) to receive a reward. When the microscopic benefit-of-leisure increases nonlinearly with duration, the model generates behaviour that qualitatively matches various microfeatures of subjects' choices, including the distribution of leisure bout durations as a function of the pay-off. We relate our model to traditional accounts by deriving macroscopic, molar, quantities from microscopic choices.


Assuntos
Comportamento , Reforço Psicológico , Algoritmos , Animais , Encéfalo/fisiologia , Tomada de Decisões , Humanos , Aprendizagem , Atividades de Lazer , Cadeias de Markov , Modelos Teóricos , Probabilidade , Recompensa , Processos Estocásticos , Fatores de Tempo
18.
Front Behav Neurosci ; 7: 125, 2013.
Artigo em Inglês | MEDLINE | ID: mdl-24098275

RESUMO

The reward-mountain model relates the vigor of reward seeking to the strength and cost of reward. Application of this model provides information about the stage of processing at which manipulations such as drug administration, lesions, deprivation states, and optogenetic interventions act to alter reward seeking. The model has been updated by incorporation of new information about frequency following in the directly stimulated neurons responsible for brain stimulation reward and about the function that maps objective opportunity costs into subjective ones. The behavioral methods for applying the model have been updated and improved as well. To assess the impact of these changes, two related predictions of the model that were supported by earlier work have been retested: (1) altering the duration of rewarding brain stimulation should change the pulse frequency required to produce a reward of half-maximal intensity, and (2) this manipulation should not change the opportunity cost at which half-maximal performance is directed at earning a maximally intense reward. Prediction 1 was supported in all six subjects, but prediction 2 was supported in only three. The latter finding is interpreted to reflect recruitment, at some stimulation sites, of a heterogeneous reward substrate comprising dual, parallel circuits that integrate the stimulation-induced neural signals.

19.
J Neurosci ; 32(32): 11032-41, 2012 Aug 08.
Artigo em Inglês | MEDLINE | ID: mdl-22875936

RESUMO

Dopaminergic neurons contribute to intracranial self-stimulation (ICSS) and other reward-seeking behaviors, but it is not yet known where dopaminergic neurons intervene in the neural circuitry underlying reward pursuit or which psychological processes are involved. In rats working for electrical stimulation of the medial forebrain bundle, we assessed the effect of GBR-12909 (1-[2-[bis(4-fluorophenyl)-methoxy]ethyl]-4-[3- phenylpropyl]piperazine), a specific blocker of the dopamine transporter. Operant performance was measured as a function of the strength and cost of electrical stimulation. GBR-12909 increased the opportunity cost most subjects were willing to pay for a reward of a given intensity. However, this effect was smaller than that produced by a regimen of cocaine administration that drove similar increases in nucleus accumbens (NAc) dopamine levels in unstimulated rats. Delivery of rewarding stimulation to drug-treated rats caused an additional increase in dopamine concentration in the NAc shell in cocaine-treated, but not GBR-12909-treated, rats. These behavioral and neurochemical differences may reflect blockade of the norepinephrine transporter by cocaine but not by GBR-12909. Whereas the effect of psychomotor stimulants on ICSS has long been attributed to dopaminergic action at early stages of the reward pathway, the results reported here imply that increased dopamine tone boosts reward pursuit by acting at or beyond the output of the circuitry that temporally and spatially summates the output of the directly stimulated neurons underlying ICSS. The observed enhancement of reward seeking could be attributable to a decrease in the value of competing behaviors, a decrease in subjective effort costs, or an increase in reward-system gain.


Assuntos
Encéfalo/fisiologia , Dopamina/metabolismo , Estimulação Elétrica/métodos , Recompensa , Autoestimulação/fisiologia , Análise de Variância , Animais , Encéfalo/efeitos dos fármacos , Cocaína/administração & dosagem , Condicionamento Operante/fisiologia , Inibidores da Captação de Dopamina/administração & dosagem , Relação Dose-Resposta a Droga , Masculino , Microdiálise , Modelos Biológicos , Piperazinas/administração & dosagem , Ratos , Ratos Long-Evans , Fatores de Tempo
20.
Front Neurosci ; 6: 20, 2012.
Artigo em Inglês | MEDLINE | ID: mdl-22363253

RESUMO

Almost 80 years ago, Lionel Robbins proposed a highly influential definition of the subject matter of economics: the allocation of scarce means that have alternative ends. Robbins confined his definition to human behavior, and he strove to separate economics from the natural sciences in general and from psychology in particular. Nonetheless, I extend his definition to the behavior of non-human animals, rooting my account in psychological processes and their neural underpinnings. Some historical developments are reviewed that render such a view more plausible today than would have been the case in Robbins' time. To illustrate a neuroeconomic perspective on decision making in non-human animals, I discuss research on the rewarding effect of electrical brain stimulation. Central to this discussion is an empirically based, functional/computational model of how the subjective intensity of the electrical reward is computed and combined with subjective costs so as to determine the allocation of time to the pursuit of reward. Some successes achieved by applying the model are discussed, along with limitations, and evidence is presented regarding the roles played by several different neural populations in processes posited by the model. I present a rationale for marshaling convergent experimental methods to ground psychological and computational processes in the activity of identified neural populations, and I discuss the strengths, weaknesses, and complementarity of the individual approaches. I then sketch some recent developments that hold great promise for advancing our understanding of structure-function relationships in neuroscience in general and in the neuroeconomic study of decision making in particular.

SELEÇÃO DE REFERÊNCIAS
DETALHE DA PESQUISA
...