Abstract
Strategy switching is a form of cognitive flexibility that requires inhibiting a previously successful strategy and switching to a new strategy of a different categorical modality. It is dependent on dopamine (DA) receptor activation and release in ventral striatum and prefrontal cortex, two primary targets of ventral tegmental area (VTA) DA projections. Although the circuitry that underlies strategy switching early in learning has been studied, few studies have examined it after extended discrimination training. This may be important as DA activity and release patterns change across learning, with several studies demonstrating a critical role for substantia nigra pars compacta (SNc) DA activity and release once behaviors are well-learned. We have demonstrated that medial septum (MS) activation simultaneously increased VTA and decreased SNc DA population activity, as well as improved reversal learning via these actions on DA activity. We hypothesized that MS activation would improve strategy switching both early in learning and after extended training through its ability to increase VTA DA population activity and decrease SNc DA population activity, respectively. We chemogenetically activated the MS of male and female rats and measured their performance on an operant-based strategy switching task following 1, 10, or 15 days of discrimination training. Contrary to our hypothesis, MS activation did not affect strategy switching after 1 day of discrimination training. MS activation improved strategy switching after 10 days of training, but only in females. MS activation improved strategy switching in both sexes after 15 days of training. Infusion of bicuculline into the ventral subiculum (vSub) inhibited the MS-mediated decrease in SNc DA population activity and attenuated the improvement in strategy switching. Intra-vSub infusion of scopolamine inhibited the MS-mediated increase in VTA DA population activity but did not affect the improvement in strategy switching. Intra-vSub infusion of both bicuculline and scopolamine inhibited the MS-mediated effects on DA population activity in both the SNc and VTA and completely prevented the improvement in strategy switching. These data indicate that MS activation improves strategy switching once the original strategy has been sufficiently well-learned, and that this may occur via the MS’s regulation of DA neuron responsivity.
Similar content being viewed by others
Log in or create a free account to read this content
Gain free access to this article, as well as selected content from this journal and more on nature.com
or
References
Diamond A. Executive functions. Annu Rev Psychol. 2013;64:135–68. https://doi.org/10.1146/annurev-psych-113011-143750.
Izquierdo A, Jentsch JD. Reversal learning as a measure of impulsive and compulsive behavior in addictions. Psychopharmacology. 2012;219:607–20. https://doi.org/10.1007/s00213-011-2579-7.
Ersche KD, Roiser JP, Robbins TW, Sahakian BJ. Chronic cocaine but not chronic amphetamine use is associated with perseverative responding in humans. Psychopharmacology. 2008;197:421–31. https://doi.org/10.1007/s00213-007-1051-1.
Figee M, Pattij T, Willuhn I, Luigjes J, van den Brink W, Goudriaan A, et al. Compulsivity in obsessive-compulsive disorder and addictions. Eur Neuropsychopharmacol. 2016;26:856–68. https://doi.org/10.1016/j.euroneuro.2015.12.003.
MacPherson HA, Kudinova AY, Schettini E, Jenkins GA, Gilbert AC, Thomas SA, et al. Relationship between cognitive flexibility and subsequent course of mood symptoms and suicidal ideation in young adults with childhood-onset bipolar disorder. Eur Child Adolesc Psychiatry. 2021. https://doi.org/10.1007/s00787-020-01688-0.
Pantelis C, Barber FZ, Barnes TR, Nelson HE, Owen AM, Robbins TW. Comparison of set-shifting ability in patients with chronic schizophrenia and frontal lobe damage. Schizophr Res. 1999;37:251–70. https://doi.org/10.1016/s0920-9964(98)00156-x.
Mallorquí-Bagué N, Tolosa-Sola I, Fernández-Aranda F, Granero R, Fagundo AB, Lozano-Madrid M, et al. Cognitive deficits in executive functions and decision-making impairments cluster gambling disorder sub-types. J Gambl Stud. 2018;34:209–23. https://doi.org/10.1007/s10899-017-9724-0.
Lundqvist T. Cognitive consequences of cannabis use: comparison with abuse of stimulants and heroin with regard to attention, memory and executive functions. Pharmacol Biochem Behav 2005;81:319–30. https://doi.org/10.1016/j.pbb.2005.02.017.
Liang CS, Ho PS, Yen CH, Chen CY, Kuo SC, Huang CC, et al. The relationship between the striatal dopamine transporter and novelty seeking and cognitive flexibility in opioid dependence. Prog Neuropsychopharmacol Biol Psychiatry. 2017;74:36–42. https://doi.org/10.1016/j.pnpbp.2016.12.001.
Francazio SK, Flessner CA. Cognitive flexibility differentiates young adults exhibiting obsessive-compulsive behaviors from controls. Psychiatry Res. 2015;228:185–90. https://doi.org/10.1016/j.psychres.2015.04.038.
Lima IMM, Peckham AD, Johnson SL. Cognitive deficits in bipolar disorders: implications for emotion. Clin Psychol Rev. 2018;59:126–36. https://doi.org/10.1016/j.cpr.2017.11.006.
Park J, Moghaddam B. Impact of anxiety on prefrontal cortex encoding of cognitive flexibility. Neuroscience. 2017;345:193–202. https://doi.org/10.1016/j.neuroscience.2016.06.013.
Allain P, Etcharry-Bouyx F, Verny C. Executive functions in clinical and preclinical Alzheimer's disease. Rev Neurol. 2013;169:695–708. https://doi.org/10.1016/j.neurol.2013.07.020.
Floresco SB, Block AE, Tse MT. Inactivation of the medial prefrontal cortex of the rat impairs strategy set-shifting, but not reversal learning, using a novel, automated procedure. Behav Brain Res. 2008;190:85–96. https://doi.org/10.1016/j.bbr.2008.02.008.
Floresco SB, Ghods-Sharifi S, Vexelman C, Magyar O. Dissociable roles for the nucleus accumbens core and shell in regulating set shifting. J Neurosci. 2006;26:2449–57. https://doi.org/10.1523/JNEUROSCI.4431-05.2006.
Floresco SB, Magyar O, Ghods-Sharifi S, Vexelman C, Tse MT. Multiple dopamine receptor subtypes in the medial prefrontal cortex of the rat regulate set-shifting. Neuropsychopharmacology. 2006;31:297–309. https://doi.org/10.1038/sj.npp.1300825.
Ghods-Sharifi S, Haluk DM, Floresco SB. Differential effects of inactivation of the orbitofrontal cortex on strategy set-shifting and reversal learning. Neurobiol Learn Mem. 2008;89:567–73. https://doi.org/10.1016/j.nlm.2007.10.007.
Haluk DM, Floresco SB. Ventral striatal dopamine modulation of different forms of behavioral flexibility. Neuropsychopharmacology. 2009;34:2041–52. https://doi.org/10.1038/npp.2009.21.
Birrell JM, Brown VJ. Medial frontal cortex mediates perceptual attentional set shifting in the rat. J Neurosci. 2000;20:4320–4.
Haber SN, Knutson B. The reward circuit: linking primate anatomy and human imaging. Neuropsychopharmacology. 2010;35:4–26. https://doi.org/10.1038/npp.2009.129.
Collins AL, Saunders BT. Heterogeneity in striatal dopamine circuits: form and function in dynamic reward seeking. J Neurosci Res. 2020;98:1046–69. https://doi.org/10.1002/jnr.24587.
Collins AL, Greenfield VY, Bye JK, Linker KE, Wang AS, Wassum KM. Dynamic mesolimbic dopamine signaling during action sequence learning and expectation violation. Sci Rep. 2016;6:20231. https://doi.org/10.1038/srep20231.
Crego A, Štoček F, Marchuk AG, Carmichael JE, van der Meer M, Smith KS. Complementary control over habits and behavioral vigor by phasic activity in the dorsolateral striatum. J Neurosci. 2020;40:2139–53. https://doi.org/10.1523/JNEUROSCI.1313-19.2019.
da Silva JA, Tecuapetla F, Paixao V, Costa RM. Dopamine neuron activity before action initiation gates and invigorates future movements. Nature. 2018;554:244–8. https://doi.org/10.1038/nature25457.
Willuhn I, Burgeno LM, Everitt BJ, Phillips PE. Hierarchical recruitment of phasic dopamine signaling in the striatum during the progression of cocaine use. Proc Natl Acad Sci USA 2012;109:20703–8. https://doi.org/10.1073/pnas.1213460109.
Ostlund SB, Balleine BW. On habits and addiction: an associative analysis of compulsive drug seeking. Drug Disco Today Dis Models. 2008;5:235–45. https://doi.org/10.1016/j.ddmod.2009.07.004.
Lerner TN. Interfacing behavioral and neural circuit models for habit formation. J Neurosci Res. 2020;98:1031–45. https://doi.org/10.1002/jnr.24581.
Everitt BJ, Robbins TW. Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nat Neurosci. 2005;8:1481–9. https://doi.org/10.1038/nn1579.
Pierce RC, Vanderschuren LJ. Kicking the habit: the neural basis of ingrained behaviors in cocaine addiction. Neurosci Biobehav Rev. 2010;35:212–9. https://doi.org/10.1016/j.neubiorev.2010.01.007.
Huh CY, Goutagny R, Williams S. Glutamatergic neurons of the mouse medial septum and diagonal band of Broca synaptically drive hippocampal pyramidal cells: relevance for hippocampal theta rhythm. J Neurosci. 2010;30:15951–61. https://doi.org/10.1523/JNEUROSCI.3663-10.2010.
Yoder RM, Pang KC. Involvement of GABAergic and cholinergic medial septal neurons in hippocampal theta rhythm. Hippocampus. 2005;15:381–92. https://doi.org/10.1002/hipo.20062.
Roland JJ, Stewart AL, Janke KL, Gielow MR, Kostek JA, Savage LM, et al. Medial septum-diagonal band of Broca (MSDB) GABAergic regulation of hippocampal acetylcholine efflux is dependent on cognitive demands. J Neurosci. 2014;34:506–14. https://doi.org/10.1523/JNEUROSCI.2352-13.2014.
Pang KC, Jiao X, Sinha S, Beck KD, Servatius RJ. Damage of GABAergic neurons in the medial septum impairs spatial working memory and extinction of active avoidance: effects on proactive interference. Hippocampus. 2011;21:835–46. https://doi.org/10.1002/hipo.20799.
Lecourtier L, de Vasconcelos AP, Leroux E, Cosquer B, Geiger K, Lithfous S, et al. Septohippocampal pathways contribute to system consolidation of a spatial memory: sequential implication of GABAergic and cholinergic neurons. Hippocampus. 2011;21:1277–89. https://doi.org/10.1002/hipo.20837.
Tsanov M. Speed and oscillations: medial septum integration of attention and navigation. Front Syst Neurosci. 2017;11:67. https://doi.org/10.3389/fnsys.2017.00067.
Bortz DM, Gazo KL, Grace AA. The medial septum enhances reversal learning via opposing actions on ventral tegmental area and substantia nigra dopamine neurons. Neuropsychopharmacology. 2019;44:2186–94. https://doi.org/10.1038/s41386-019-0453-1.
Bortz DM, Grace AA. Medial septum differentially regulates dopamine neuron activity in the rat ventral tegmental area and substantia nigra via distinct pathways. Neuropsychopharmacology. 2018;43:2093–100. https://doi.org/10.1038/s41386-018-0048-2.
Bortz DM, Grace AA. Medial septum activation produces opposite effects on dopamine neuron activity in the ventral tegmental area and substantia nigra in MAM vs. normal rats. NPJ Schizophr. 2018;4:17. https://doi.org/10.1038/s41537-018-0059-3.
Grace AA, Floresco SB, Goto Y, Lodge DJ. Regulation of firing of dopaminergic neurons and control of goal-directed behaviors. Trends Neurosci. 2007;30:220–7. https://doi.org/10.1016/j.tins.2007.03.003.
Bunney BS, Grace AA. Acute and chronic haloperidol treatment: comparison of effects on nigral dopaminergic cell activity. Life Sci. 1978;23:1715–27.
Bortz DM, Grace AA. Medial septum differentially regulates dopamine neuron activity in the rat ventral tegmental area and substantia nigra via distinct pathways. Neuropsychopharmacology. 2018. https://doi.org/10.1038/s41386-018-0048-2.
Grace AA, Bunney BS. Intracellular and extracellular electrophysiology of nigral dopaminergic neurons-1. Identif Charact Neurosci. 1983;10:301–15.
Ungless MA, Grace AA. Are you or aren't you? Challenges associated with physiologically identifying dopamine neurons. Trends Neurosci. 2012;35:422–30. https://doi.org/10.1016/j.tins.2012.02.003.
Grace AA, Bunney BS. The control of firing pattern in nigral dopamine neurons: single spike firing. J Neurosci. 1984;4:2866–76.
Perez SM, Chen L, Lodge DJ. Alterations in dopamine system function across the estrous cycle of the MAM rodent model of schizophrenia. Psychoneuroendocrinology. 2014;47:88–97. https://doi.org/10.1016/j.psyneuen.2014.05.005.
Grace AA. Dopamine system dysregulation by the hippocampus: implications for the pathophysiology and treatment of schizophrenia. Neuropharmacology. 2012;62:1342–8. https://doi.org/10.1016/j.neuropharm.2011.05.011.
Floresco SB, Todd CL, Grace AA. Glutamatergic afferents from the hippocampus to the nucleus accumbens regulate activity of ventral tegmental area dopamine neurons. J Neurosci. 2001;21:4915–22.
Floresco SB, West AR, Ash B, Moore H, Grace AA. Afferent modulation of dopamine neuron firing differentially regulates tonic and phasic dopamine transmission. Nat Neurosci. 2003;6:968–73. https://doi.org/10.1038/nn1103.
Lodge DJ, Grace AA. The hippocampus modulates dopamine neuron responsivity by regulating the intensity of phasic neuron activation. Neuropsychopharmacology. 2006;31:1356–61. https://doi.org/10.1038/sj.npp.1300963.
Chen CS, Ebitz RB, Bindas SR, Redish AD, Hayden BY, Grissom NM. Divergent strategies for learning in males and females. Curr Biol. 2020;31:39–50.e4. https://doi.org/10.1016/j.cub.2020.09.075.
Smith KS, Graybiel AM. Habit formation. Dialogues Clin Neurosci. 2016;18:33–43.
Malvaez M. Neural substrates of habit. J Neurosci Res. 2019. https://doi.org/10.1002/jnr.24552.
Lerner TN. The effortless custody of automatism. Science. 2018;362:169. https://doi.org/10.1126/science.aav1250.
Willuhn I, Burgeno LM, Groblewski PA, Phillips PE. Excessive cocaine use results from decreased phasic dopamine signaling in the striatum. Nat Neurosci. 2014;17:704–9. https://doi.org/10.1038/nn.3694.
Belin D, Everitt BJ. Cocaine seeking habits depend upon dopamine-dependent serial connectivity linking the ventral with the dorsal striatum. Neuron. 2008;57:432–41. https://doi.org/10.1016/j.neuron.2007.12.019.
Haber SN, Fudge JL, McFarland NR. Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum. J Neurosci. 2000;20:2369–82.
Saunders BT, Richard JM, Margolis EB, Janak PH. Dopamine neurons create Pavlovian conditioned stimuli with circuit-defined motivational properties. Nat Neurosci. 2018;21:1072–83. https://doi.org/10.1038/s41593-018-0191-4.
van der Merwe R, Nadel J, Copes-Finke D, Pawelko S, Scott J, Fox M, et al. Characterization of striatal dopamine projections across striatal subregions in behavioral flexibility. bioRxiv. 2021. https://doi.org/10.1101/2021.09.18.460922.
Floresco SB, Zhang Y, Enomoto T. Neural circuits subserving behavioral flexibility and their relevance to schizophrenia. Behav Brain Res. 2009;204:396–409. https://doi.org/10.1016/j.bbr.2008.12.001.
Izquierdo A. Functional heterogeneity within rat orbitofrontal cortex in reward learning and decision making. J Neurosci. 2017;37:10529–40. https://doi.org/10.1523/JNEUROSCI.1678-17.2017.
Radke AK, Kocharian A, Covey DP, Lovinger DM, Cheer JF, Mateo Y, et al. Contributions of nucleus accumbens dopamine to cognitive flexibility. Eur J Neurosci. 2019;50:2023–35. https://doi.org/10.1111/ejn.14152.
Klanker M, Fellinger L, Feenstra M, Willuhn I, Denys D. Regionally distinct phasic dopamine release patterns in the striatum during reversal learning. Neuroscience. 2017;345:110–23. https://doi.org/10.1016/j.neuroscience.2016.05.011.
Gillan CM, Papmeyer M, Morein-Zamir S, Sahakian BJ, Fineberg NA, Robbins TW, et al. Disruption in the balance between goal-directed behavior and habit learning in obsessive-compulsive disorder. Am J Psychiatry. 2011;168:718–26. https://doi.org/10.1176/appi.ajp.2011.10071062.
Gillan CM, Morein-Zamir S, Urcelay GP, Sule A, Voon V, Apergis-Schoute AM, et al. Enhanced avoidance habits in obsessive-compulsive disorder. Biol Psychiatry. 2014;75:631–8. https://doi.org/10.1016/j.biopsych.2013.02.002.
Voon V, Derbyshire K, Rück C, Irvine MA, Worbe Y, Enander J, et al. Disorders of compulsivity: a common bias towards learning habits. Mol Psychiatry. 2015;20:345–52. https://doi.org/10.1038/mp.2014.44.
Hildebrandt BA, Ahmari SE. Breaking it down: investigation of binge eating components in animal models to enhance translation. Front Psychiatry. 2021;12:728535. https://doi.org/10.3389/fpsyt.2021.728535.
Redish AD, Jensen S, Johnson A. A unified framework for addiction: vulnerabilities in the decision process. Behav Brain Sci. 2008;31:415–37. https://doi.org/10.1017/S0140525X0800472X.
Belin D, Jonkman S, Dickinson A, Robbins TW, Everitt BJ. Parallel and interactive learning processes within the basal ganglia: relevance for the understanding of addiction. Behav Brain Res. 2009;199:89–102. https://doi.org/10.1016/j.bbr.2008.09.027.
Acknowledgements
We would like to thank Dr. Stan Floresco for his help in creating the strategy switching task, as well as his continued guidance and support.
Funding
This work was funded by NIMH grants 1F32MH115550 (DMB) and MH057440-11 (AAG).
Author information
Authors and Affiliations
Contributions
DMB and AAG planned all experiments. DMB, CMF, and CCP performed all experiments. All authors participated in manuscript writing and editing.
Corresponding author
Ethics declarations
Competing interests
AAG received funds from the following organizations: Lundbeck, Pfizer, Otsuka, Asubio, Autofony, Janssen, Alkermes, SynAgile, and Newron. DMB, CMF, and CCP declare no competing financial interests.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Bortz, D.M., Feistritzer, C.M., Power, C.C. et al. Medial septum activation improves strategy switching once strategies are well-learned via bidirectional regulation of dopamine neuron population activity. Neuropsychopharmacol. 47, 2090–2100 (2022). https://doi.org/10.1038/s41386-022-01387-1
Received:
Revised:
Accepted:
Published:
Version of record:
Issue date:
DOI: https://doi.org/10.1038/s41386-022-01387-1
This article is cited by
-
A food-sensitive olfactory circuit drives anticipatory satiety
Nature Metabolism (2025)
