Abstract
Prior exposure to abused drugs leads to long-lasting neuroadaptations culminating in excessive drug intake. Given the comorbidity between substance use and gambling disorders, surprisingly little is known about the effects of exposure to reinforcement contingencies experienced during games of chance. As it is a central feature of these games, we characterized the effects of exposure to uncertainty on biochemical and behavioral effects normally observed in rats exposed to amphetamine. Rats in different groups were trained to nose-poke for saccharin under certain [fixed-ratio (FR)] or uncertain conditions [variable-ratio (VR)] for 55 1-h sessions. Ratios were escalated on successive sessions and rats maintained on the last ratio (FR/VR 20) for 20–25 days. Two to three weeks later, rats were tested for their locomotor or nucleus accumbens dopamine (NAcc DA) response to amphetamine or self-administration of the drug using a lever press operant. NAcc DA overflow was also assessed in additional rats during the saccharin sessions. Rats exposed to uncertainty subsequently showed a higher locomotor and NAcc DA response to amphetamine and self-administered more drug infusions relative to rats exposed to predictable reinforcement. NAcc DA levels during the saccharin sessions tracked the variance of the scheduled ratios (a measure of uncertainty). VR rats showed escalating DA overflow with increasing ratios. Exposure to uncertainty triggered neuroadaptations similar to those produced by exposure to abused drugs. As these were produced in drug naive rats both during and after exposure to uncertainty, they provide a novel common pathway to drug and behavioral addictions.
Similar content being viewed by others
Log in or create a free account to read this content
Gain free access to this article, as well as selected content from this journal and more on nature.com
or
References
World Health Organization (2013). Management of Substance Abuse: The Global Burden. World Health Organization (http://www.who.int/substance_abuse/facts/global_burden/en/).
Yau YHC, Potenza MN. Gambling disorder and other behavioral addictions: Recognition and treatment. Harv Rev Psychiatry. 2015;23:134–46.
Piazza PV, Deminiere J-M, Le Moal M, Simon H. Factors that predict individual vulnerability to amphetamine self-administration. Science. 1989;245:1511–3.
Dalley JW, Everitt BJ, Robbins TW. Impulsivity, compulsivity, and top-down cognitive control. Neuron. 2011;69:680–94.
Belin D, Mar AC, Dalley JW, Robbins TW, Everitt BJ. High impulsivity predicts the switch to compulsive cocaine-taking. Science. 2008;320:1352–5.
Robinson TE, Berridge KC. The incentive sensitization theory of addiction: Some current issues. Philos Trans R Soc Lond B: Biol Sci. 2008;363:3137–46.
Vezina P. Sensitization of midbrain dopamine neuron reactivity and the self-administration of psychostimulant drugs. Neurosci Biobehav Rev. 2004;27:827–39.
Koob GF, Le Moal M. Drug abuse: hedonic homeostatic dysregulation. Science. 1997;278:52–8.
Leyton M, Vezina P. Dopamine ups and downs in vulnerability to addictions: a neurodevelopmental model. Trends Pharmacol Sci. 2014;35:268–76.
Pierre PJ, Vezina P. Predisposition to self-administer amphetamine: the contribution of response to novelty and prior exposure to the drug. Psychopharmacology. 1997;129:277–84.
Kawa AB, Bentzley BS, Robinson TE. Less is more: prolonged intermittent access cocaine self-administration produces incentive-sensitization and addiction-like behavior. Psychopharmacology. 2016;233:3587–602.
Labonte B, McLaughlin RJ, Dominguez-Lopez S, Bambico FR, Lucchino I, Ochoa-Sanchez R, et al. Adolescent amphetamine exposure elicits dose-specific effects on monoaminergic neurotransmission and behaviour in adulthood. Int J Neuropsychopharmacol. 2012;15:1319–30.
Dow-Edwards D, Iijima M, Stephenson S, Jackson A, Weedon J. The effects of prenatal cocaine, post-waning housing and sex on conditioned place preference in adolescent rats. Psychopharmacology. 2015;231:1543–55.
Le Q, Yan B, Yu X, Li Y, Song H, Zhu H, et al. Drug-seeking motivation level in male rats determines offspring susceptibility or resistance to cocaine-seeking behavior. Nat Commun. 2017;8:15527.
Kourrich S, Calu D, Bonci A. Intrinsic plasticity: an emerging player in addiction. Nat Rev Neurosci. 2015;16:173–84.
Luscher C, Malenka RC. Drug-evoked synaptic plasticity in addiction: from molecular changes to circuit remodeling. Neuron. 2011;69:650–63.
Kasanetz F, Deroche-Gamonet V, Berson N, Balado E, Lafourcade M, Manzoni O, et al. Transition to addiction is associated with a persistent impairment in synaptic plasticity. Science. 2010;328:1709–12.
American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders. 5th ed. Arlington, VA: American Psychiatric Association; 2013.
Costikyan G. Uncertainty in games. Cambridge, MA: The MIT Press; 2013.
Grant JE, Chamberlain SR. Gambling disorder and its relationship with substance use disorders: implications for nosological revisions and treatment. Am J Addict. 2015;24:126–31.
Zack M, Poulos CX. Amphetamine primes motivation to gamble and gambling-related semantic networks in problem gamblers. Neuropsychopharmacology. 2004;29:195–207.
Boileau I, Payer D, Chugani B, Lobo DSS, Houle S, Wilson AA, et al. In vivo evidence for greater amphetamine-induced dopamine release in pathological gambling: a positron emission tomography study with [11C]-(+)-PHNO. Mol Psychiatry. 2014;19:1305–13.
Thomsen KR, Fjorback LO, Moller A, Lou HC. Applying incentive sensitization models to behavioral addiction. Neurosci Biobehav Rev. 2014;45:343–9.
Zack M, Poulos CX. Parallel roles for dopamine in pathological gambling and psychostimulant addiction. Curr Drug Abus Rev. 2009;2:11–25.
Singer BF, Scott-Railton J, Vezina P. Unpredictable saccharin reinforcement enhances locomotor responding to amphetamine. Beh Brain Res. 2012;226:340–4.
Zack M, Featherstone RE, Mathewson S, Fletcher PJ. Chronic exposure to a gambling-like schedule of reward predictive stimuli can promote sensitization to amphetamine in rats. Front Behav Neurosci. 2014;8:7–21.
Zeeb FD, Li Z, Fisher DC, Zack MH, Fletcher PJ. Uncertainty exposure causes behavioural sensitization and increases risky decision-making in male rats: toward modeling gambling disorder. J Psychiatry Neurosci. 2017;42:404–13.
Vezina P, McGehee DS, Green WN. Exposure to nicotine and sensitization of nicotine-induced behaviors. Prog Neuro-Psychopharm Biol Psychiatry. 2007;31:1625–38.
Vezina P, Lorrain DS, Arnold GM, Austin JD, Suto N. Sensitization of midbrain dopamine neuron reactivity promotes the pursuit of amphetamine. J Neurosci. 2002;22:4654–62.
Steidl S, O’Sullivan S, Pilat D, Bubula N, Brown J, Vezina P. Operant responding for optogenetic excitation of LDTg inputs to the VTA requires D1 and D2 dopamine receptor activation in the NAcc. Behav Brain Res. 2017;333:161–70.
Richardson NR, Roberts DCS. Progressive ratio schedules in drug self-administration studies in rats: a method to evaluate reinforcing efficacy. J Neurosci Methods. 1996;66:1–11.
Fiorillo CD, Tobler PN, Schultz W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science. 2003;299:1898–902.
Hart AS, Clark JJ, Phillips PEM. Dynamic shaping of dopamine signals during probabilistic Pavlovian conditioning. Neurobiol Learn Memory. 2015;117:84–92.
Wong J-MT, Malec PA, Mabrouk OS, Ro J, Dus M, Kennedy RT. Benzoyl chloride derivatization with liquid chromatography-mass spectrometry for targeted metabolomics of neurochemicals in biological samples. J Chromatogr A. 2016;1446:78–90.
Schultz W, Preuschoff K, Camerer C, Hsu M, Fiorillo CD, Tobler PN, et al. Explicit neural signals reflecting reward uncertainty. Philos Trans R Soc B. 2008;363:3801–11.
Hall GW, Carriero NJ, Takushi RY, Montoya ID, Preston KL, Gorelick DA. Pathological gambling among cocaine-dependent outpatients. Am J Psychiatry. 2000;157:1127–33.
Kim WY, Cho BR, Kwak MJ, Kim J-H. Interaction between trait and housing conditions produces differential decision-making toward risk choice in a rat gambling task. Sci Rep. 2017;7:5718.
Anselme P, Robinson MJF, Berridge KC. Reward uncertainty enhances incentive salience attribution as sign-tracking. Behav Brain Res. 2013;238:53–61.
Robinson MJF, Anselme P, Fishcer AM, Berridge KC. Initial uncertainty in Pavlovian reward prediction persistently elevates incentive salience and extends sign-tracking to normally unattractive cues. Behav Brain Res. 2014;266:119–30.
Robinson MJF, Anselme P, Suchomel K, Berridge KC. Amphetamine-induced sensitization and reward uncertainty similarly enhance incentive salience for conditioned cues. Behav Neurosci. 2015;129:502–11.
Preuschoff K, Bossaerts P, Quartz SR. Neural differentiation of expected reward and risk in human subcortical structures. Neuron. 2006;51:381–90.
Linnet J, Mouridsen K, Peterson E, Moller A, Doudet DJ, Gjedde A. Striatal dopamine release codes uncertainty in pathological gambling. Psychiatry Res. 2012;204:55–60.
Hernandez G, Haines E, Rajabi H, Stewart J, Arvanitogiannis A, Shizgal P. Predictable and unpredictable rewards produce similar changes in dopamine tone. Behav Neurosci. 2007;121:887–95.
Fiorillo CD, Tobler PN, Schultz W. Evidence that the delay-period activity of dopamine neurons corresponds to reward uncertainty rather than backpropagating TD errors. Behav Brain Func. 2005;1:7.
Niv Y, O Duff M, Dayan P. Dopamine, uncertainty and TD learning. Behav Brain Func. 2005;1:6.
Fiorillo CD, Kim JK, Hong SZ. The meaning of spikes from the neuron’s point of view: predictive homeostasis generates the appearance of randomness. Front Comp Neurosci. 2014;8:49.
Floresco SB, West AR, Ash B, Moore H, Grace AA. Afferent modulation of dopamine neuron firing differentially regulates tonic and phasic dopamine transmission. Nat Neurosci. 2003;6:968–73.
Lodge DJ, Grace AA. Amphetamine activation of hippocampal drive of mesolimbic dopamine neurons: a mechanism of behavioral sensitization. J Neurosci. 2008;28:7876–82.
Pierce RC, Kalivas PW. Amphetamine produces sensitized increases in locomotion and extracellular dopamine preferentially in the nucleus accumbens shell of rats administered repeated cocaine. J Pharmacol Exp Ther. 1995;275:1019–29.
St. Onge JR, Ahn S, Phillips AG, Floresco SB. Dynamic fluctuations in dopamine efflux in the prefrontal cortex and nucleus accumbens during risk-based decision making. J Neurosci. 2012;32:16880–91.
Acknowledgements
The authors acknowledge the assistance of George Wu, the John P and Lillian A Gould Professor of Behavioral Science in the Booth School of Business at The University of Chicago for his help conceptualizing the operant uncertainty task used in the present experiments. This work was supported by the National Institutes of Health (NIH) grants to RTK (EB003320) and PV (DA034184, DA09397). Support was also provided by the NIH T32 grants DA007255 (N.M.N.) and DA007268 (K.M.N.).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Rights and permissions
About this article
Cite this article
Mascia, P., Neugebauer, N.M., Brown, J. et al. Exposure to conditions of uncertainty promotes the pursuit of amphetamine. Neuropsychopharmacol 44, 274–280 (2019). https://doi.org/10.1038/s41386-018-0099-4
Received:
Revised:
Accepted:
Published:
Version of record:
Issue date:
DOI: https://doi.org/10.1038/s41386-018-0099-4
This article is cited by
-
Addictive motivational scaffolds and the structure of social media
Synthese (2025)
-
Unpredictable Drug Access and its Relevance for Substance Use Disorders: A Critical Review
Perspectives on Behavior Science (2025)
-
Increased risky choice during forced abstinence from fentanyl on the cued rat gambling task
Psychopharmacology (2025)
-
Choice between food and cocaine or fentanyl reinforcers under fixed and variable schedules in female and male rhesus monkeys
Psychopharmacology (2023)
-
Effects of exposure to chronic uncertainty and a sensitizing regimen of amphetamine injections on locomotion, decision-making, and dopamine receptors in rats
Neuropsychopharmacology (2020)
