<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Neurosci.</journal-id>
<journal-title>Frontiers in Neuroscience</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Neurosci.</abbrev-journal-title>
<issn pub-type="epub">1662-453X</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fnins.2019.00577</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Neuroscience</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Effort Displayed During Appetitive Phase of Feeding Behavior Requires Infralimbic Cortex Activity and Histamine H1 Receptor Signaling</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Riveros</surname> <given-names>Mar&#x00ED;a E.</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/48118/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Forray</surname> <given-names>Mar&#x00ED;a Ines</given-names></name>
<xref ref-type="aff" rid="aff4"><sup>4</sup></xref>
</contrib>
<contrib contrib-type="author">
<name><surname>Torrealba</surname> <given-names>Fernando</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
</contrib>
<contrib contrib-type="author">
<name><surname>Vald&#x00E9;s</surname> <given-names>Jos&#x00E9; L.</given-names></name>
<xref ref-type="aff" rid="aff5"><sup>5</sup></xref>
<xref ref-type="aff" rid="aff6"><sup>6</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/48094/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Departamento de Ciencias Fisiol&#x00F3;gicas, Facultad de Ciencias Biol&#x00F3;gicas, Pontificia Universidad Cat&#x00F3;lica de Chile</institution>, <addr-line>Santiago</addr-line>, <country>Chile</country></aff>
<aff id="aff2"><sup>2</sup><institution>Centro de Fisiolog&#x00ED;a Integrativa, Facultad de Medicina, Cl&#x00ED;nica Alemana Universidad del Desarrollo</institution>, <addr-line>Santiago</addr-line>, <country>Chile</country></aff>
<aff id="aff3"><sup>3</sup><institution>Center of Applied Ecology and Sustainability</institution>, <addr-line>Santiago</addr-line>, <country>Chile</country></aff>
<aff id="aff4"><sup>4</sup><institution>Departamento de Qu&#x00ED;mica, Pontificia Universidad Cat&#x00F3;lica de Chile</institution>, <addr-line>Santiago</addr-line>, <country>Chile</country></aff>
<aff id="aff5"><sup>5</sup><institution>Departamento de Neurociencias, Facultad de Medicina, Universidad de Chile</institution>, <addr-line>Santiago</addr-line>, <country>Chile</country></aff>
<aff id="aff6"><sup>6</sup><institution>Biomedical Neuroscience Institute, Facultad de Medicina, Universidad de Chile</institution>, <addr-line>Santiago</addr-line>, <country>Chile</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Jacob Raber, Oregon Health &#x0026; Science University, United States</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Maria Beatrice Passani, University of Florence, Italy; Pertti Panula, University of Helsinki, Finland</p></fn>
<corresp id="c001">&#x002A;Correspondence: Mar&#x00ED;a E. Riveros, <email>meriveros@udd.cl</email>; <email>merivero@uc.cl</email></corresp>
<fn fn-type="other" id="fn001"><p>This article was submitted to Neuropharmacology, a section of the journal Frontiers in Neuroscience</p></fn></author-notes>
<pub-date pub-type="epub">
<day>28</day>
<month>06</month>
<year>2019</year>
</pub-date>
<pub-date pub-type="collection">
<year>2019</year>
</pub-date>
<volume>13</volume>
<elocation-id>577</elocation-id>
<history>
<date date-type="received">
<day>24</day>
<month>01</month>
<year>2019</year>
</date>
<date date-type="accepted">
<day>21</day>
<month>05</month>
<year>2019</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2019 Riveros, Forray, Torrealba and Vald&#x00E9;s.</copyright-statement>
<copyright-year>2019</copyright-year>
<copyright-holder>Riveros, Forray, Torrealba and Vald&#x00E9;s</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract>
<p>The chances to succeed in goal-directed behaviors, such as food or water-seeking, improve when the subject is in an increased arousal state. The appetitive phase of these motivated behaviors is characterized by high levels of behavioral and vegetative excitation. The key decision of engaging in those particular behaviors depends primarily on prefrontal cortical areas, such as the ventromedial prefrontal cortex. We propose that the infralimbic cortex (ILC) located in the medial prefrontal cortex induces an increase in arousal during the appetitive phase of motivated behavior, and that this increase in arousal is, in turn, mediated by the activation of the brain histaminergic system, resulting in higher motivation for getting food rewards. To test this hypothesis, we conduct a progressive ratio operant conditioning to test the degree of motivation for food, while simultaneously manipulating the histaminergic system through pharmacologic interventions. We found that the behavioral responses to obtain food in hungry rats were disrupted when the ILC was inhibited through muscimol infusion, blocking brain H1 histamine receptors by intracerebroventricular infusion of pyrilamine or by satiety. In contrast, the consummatory behavior was not affected by ILC inhibition. The extracellular histamine levels in the ILC were increased in direct correlation with the degree of motivation measured in the progressive ratio test. ILC inhibition also prevented this increase in histamine levels. The rise in extracellular histamine levels during the progressive ratio test was similar (<italic>ca.</italic> 200%) during the active or the resting period of the day. However, different basal levels are observed for these two periods. Our findings suggest that increased histamine levels during this behavior are not simply explained by the awaked state, but instead, there is a motivation-related release of histamine, suggestive of a specific form of brain activation. Serotonin (another critical component of the ascending arousal system) was also tested. Interestingly, changes in levels of this neuromodulator were not detected during the progressive ratio test. In conclusion, our results suggest that ILC activation and subsequent increase in brain histamine release are both necessary for the normal performance of a motivated behavior such as feeding.</p>
</abstract>
<kwd-group>
<kwd>histmaine</kwd>
<kwd>prefrontal cortex</kwd>
<kwd>infralimbic cortex</kwd>
<kwd>microdialysis</kwd>
<kwd>effort</kwd>
<kwd>motivation</kwd>
</kwd-group>
<counts>
<fig-count count="3"/>
<table-count count="0"/>
<equation-count count="0"/>
<ref-count count="65"/>
<page-count count="10"/>
<word-count count="0"/>
</counts>
</article-meta>
</front>
<body>
<sec><title>Introduction</title>
<p>In order to maximize advantageous actions, higher-order organisms need to display a continuous trade-off analysis of potential benefits and threats coming from the environment, along with development of the ability to balance these benefits with costs of executing actions to obtain positive reinforcers or avoid and prevent potential damage (<xref ref-type="bibr" rid="B6">Batten and Shoemaker</xref>, <xref ref-type="bibr" rid="B6">1961</xref>). The decision to engage in an action directed to a specific goal requires a &#x201C;motivated state.&#x201D; Motivation, thus, increases the probability of performing a particular goal-directed behavior.</p>
<p>Two key aspects of motivation have been proposed by <xref ref-type="bibr" rid="B20">Hebb (1955)</xref>. One is direction, related to the specificity of actions that will be selected, and primarily driven by an internal state of the individual; the second is intensity, related to the vigor and persistence of the actions performed during a motivated state. The motivational intensity of behavior has been consistently linked to an increase in the thalamocortical activity (behavioral arousal) and the autonomic activity (vegetative arousal), implicating a change in the global state of brain activity (<xref ref-type="bibr" rid="B27">Kinomura et al., 1996</xref>; <xref ref-type="bibr" rid="B21">Hirata and Castro-Alamancos, 2010</xref>; <xref ref-type="bibr" rid="B34">Meeusen et al., 2013</xref>; <xref ref-type="bibr" rid="B30">Liu et al., 2015</xref>).</p>
<p>The global state of the mammalian brain changes to accommodate its functioning mode to the individual current needs, alternating among sleep and awake states. During the awake state, the level of arousal variates and is related to the performance in a U-shaped curve (<xref ref-type="bibr" rid="B64">Yerkes and Dodson, 1908</xref>; <xref ref-type="bibr" rid="B31">Mair et al., 2011</xref>). Therefore, increasing arousal increases performance; for example, it has been reported that a moderate increase in arousal induced by exercise is associated with an increase in cognitive performance (<xref ref-type="bibr" rid="B38">Murray and Russoniello, 2012</xref>) However, this relation reaches an optimal arousal state for performance, but beyond this optimal state, further increases in arousal will worsen performance. Thus, adjusting arousal state to performance demands is part of behavioral regulation needed during a motivated behavior. Levels of arousal are adjusted by neuromodulator systems, commonly known altogether as the ascending arousal system (AAS) (<xref ref-type="bibr" rid="B26">Jones, 2003</xref>). Because the nuclei that form part of this system have extensive connections to the entire brain, the AAS is capable of inducing changes in general levels of activity in the brain. In mice, the level of wakefulness is strongly related to the electrical activity of the histaminergic cells of the tuberomamillary nucleus (TMN) (<xref ref-type="bibr" rid="B56">Takahashi et al., 2006</xref>). Dopamine has been consistently shown to be involved in behavioral changes induced by motivation, such as the increase in the vigor of response (<xref ref-type="bibr" rid="B54">Sokolowski and Salamone, 1998</xref>; <xref ref-type="bibr" rid="B1">Aberman and Salamone, 1999</xref>; <xref ref-type="bibr" rid="B52">Salamone et al., 2001</xref>; <xref ref-type="bibr" rid="B14">Correa et al., 2002</xref>; <xref ref-type="bibr" rid="B35">Mingote et al., 2005</xref>; <xref ref-type="bibr" rid="B7">Beierholm et al., 2013</xref>), attribution of salience, and learning of reward value (<xref ref-type="bibr" rid="B8">Berridge and Robinson, 1998</xref>). However, the role of histamine in arousal regulation during motivated behavior has been less explored. We have reported previously that TMN histaminergic neurons are the first component of the AAS to get activated during the appetitive phase of a food-related motivated behavior (<xref ref-type="bibr" rid="B58">Vald&#x00E9;s et al., 2005</xref>) paralleled with an increase in locomotion (behavioral arousal), body core temperatures (vegetative arousal), and the activation of the infralimbic cortex (ILC) (<xref ref-type="bibr" rid="B59">Vald&#x00E9;s et al., 2006</xref>). The ILC is reciprocally connected to the TMN, through projections that connect to the histaminergic neurons of the TMN (<xref ref-type="bibr" rid="B63">Wouterlood et al., 1987</xref>; <xref ref-type="bibr" rid="B61">Vertes, 2004</xref>) constituting the principal excitatory input to the TMN (<xref ref-type="bibr" rid="B15">Ericson et al., 1991</xref>) and, in turn, receiving back projection fibers from the histaminergic neurons (<xref ref-type="bibr" rid="B13">Chauveau et al., 2014</xref>). Also, histamine is released in the hypothalamus and ILC during the appetitive phase of feeding behavior (<xref ref-type="bibr" rid="B60">Vald&#x00E9;s et al., 2010</xref>; <xref ref-type="bibr" rid="B46">Riveros et al., 2014</xref>). ILC pharmacological activation induces histamine release at this same cortical region in agreement with the anatomical reciprocal connection (<xref ref-type="bibr" rid="B45">Riveros et al., 2015</xref>). These findings indicate an essential role of both TMN and ILC in the regulation of behavioral and vegetative arousal during food-related appetitive behavior.</p>
<p>To better quantify the relationship between motivation and brain histaminergic activity, we have evaluated the effort that rats make in order to obtain food rewards (<xref ref-type="bibr" rid="B51">Salamone et al., 2009</xref>, <xref ref-type="bibr" rid="B50">2012</xref>; <xref ref-type="bibr" rid="B43">Pardo et al., 2012</xref>.</p>
<p>Dopamine has shown to be an essential mediator between motivation and effort (<xref ref-type="bibr" rid="B50">Salamone et al., 2012</xref>), as it has been demonstrated by the reduction in willingness to work after treatment with dopamine receptor antagonists such as haloperidol (<xref ref-type="bibr" rid="B43">Pardo et al., 2012</xref>). This effect of haloperidol is reversed by caffeine, an adenosine 2 receptor antagonist (<xref ref-type="bibr" rid="B51">Salamone et al., 2009</xref>; <xref ref-type="bibr" rid="B43">Pardo et al., 2012</xref>). Interestingly, caffeine also activates histaminergic neurons in the TMN and increases histamine release (<xref ref-type="bibr" rid="B25">John et al., 2014</xref>), while an agonist of the adenosine 2 receptor reduces histamine release, inducing sleep (<xref ref-type="bibr" rid="B22">Hong et al., 2005</xref>), suggesting that during goal-directed behavior and downstream of dopaminergic pathways, a histaminergic mechanism could mediate the increase in motivation intensity.</p>
<p>We hypothesized that histamine neurotransmission driven by ILC enables energy mobilization to increase the willingness to make an effort, possibly by reducing effort perception. This interpretation is supported by studies in humans showing that lesions in the ventromedial prefrontal cortex (vmPFC) increase the effort perception (<xref ref-type="bibr" rid="B42">Pardini et al., 2010</xref>). In keeping with these findings, injury of the medial prefrontal cortex in rats shifts the animal decisions toward less effortful and less rewarding choices (<xref ref-type="bibr" rid="B62">Walton et al., 2002</xref>).</p>
<p>To test whether this hypothesis underlies our and others prior observations, we tested whether activation of the histaminergic system during the appetitive phase was related to the willingness to exert effort in exchange for food rewards. We assessed the rate of operational response in the progressive ratio task of motivated animals, when H1 histamine receptors were blocked, when the ILC was pharmacologically inactivated (<xref ref-type="bibr" rid="B46">Riveros et al., 2014</xref>), or when the animals were not motivated (satiated), while levels of histamine release and serotonin were measured simultaneously.</p>
</sec>
<sec id="s1" sec-type="materials|methods">
<title>Materials and Methods</title>
<sec><title>Animals</title>
<p>We used male adult Sprague-Dawley male rats, weighing 270&#x2013;350 g. They were individually housed in a controlled environment at 23&#x00B0;C, with 12 h/12 h lights on/off schedule (lights off at 1900 h), and had permanent access to water and food, except when it was indicated. All experiments were carried out at Pontificia Universidad Cat&#x00F3;lica de Chile Animal Care Facility in concordance to the NIH (United States) <italic>Guide for the Care and Use of Laboratory Animals</italic> (NIH Publications No. 80-23, revised 1996). Our local institutional Bio-Safety and Ethical Committee approved these experimental protocols, which minimized the number of rats used and their suffering.</p>
</sec>
<sec><title>Operant Conditioning to Evaluate the Effort</title>
<p>We used a modified version of the progressive ratio test, where the animals learn to press a lever to get rewards. In our version of the test (in the first step, the motivation test), animals do not get any reward after pressing the lever, preventing the consummatory phase of the behavior and sustaining the appetitive phase. The number of lever presses until the animal gives up was used as an indicator of motivation. The rat operant conditioning apparatus (Med-Associates, Inc., Alpharetta, GA, United States model ENV-008CT) consists of a chamber with a stainless-steel grid floor, ventilated and sound attenuated. Each chamber had a pellet dispenser, a house light that remained turned on during the experiments, a pellet receptacle, and two retractable levers with a light signal over them; one light over the lever was turned on for 10 s when pellets were available. Rats were trained 2 h/day for 3 days to press a lever to obtain a chocolate flavored pellet (45 mg/pellet, product # FO299; Bio-Serv, Flemington, NJ, United States) at a ratio of one pellet per lever press. On the 4th day of training, the ratio increased to 3:1, to 5:1 on the 5th day, to 10:1 on the 6th day, and to 15:1 on the 7th day. On the 10th day (test day), the rats were divided into three groups: one group was fasted for 24 h (<italic>n</italic> = 13) and injected with 1 &#x03BC;l of saline bilaterally in the ILC. A second group was fed <italic>ad libitum</italic> (<italic>n</italic> = 8) and injected with 1 &#x03BC;l of saline bilaterally in the ILC. The third group (<italic>n</italic> = 10) fasted for 24 h, and pretreated with 0.5-&#x03BC;l microinjections of muscimol (Sigma-Aldrich, Co., St. Louis, MO, United States) 100 ng/&#x03BC;l bilaterally in the ILC, 10 min before the test. For a different experiment, three groups (27 animals) were used, two groups received pyrilamine (Cat N: Sigma-Aldrich, Co., St. Louis, MO, United States), a histamine H1 receptor inverse agonist, that was delivered intraperitoneally in doses of 20 mg per kilogram of body weight for one group (<italic>n</italic> = 9) and 30 mg per kilogram of body weight for the second group (<italic>n</italic> = 9), while a third group (<italic>n</italic> = 9) was intraperitoneally injected with saline as control vehicle. All injections were performed 30 min before the test. For this experiment, the two available levers were extended during training and test phases. In this setting, pressing only one of them resulted in the delivery of one pellet, so pressing the non-reward associated lever was registered as an error during the test session. Position of the correct lever remained stable and was counterbalanced between animals, so half of them had left and half had right as the correct lever.</p>
<p>Each rat was tested only once to avoid extinction of the operant behavior. During the 30-min test, the light above the lever was on, signaling food availability, but no pellets were delivered. The number of lever presses indicated how much the rats were willing to work or motivated for obtaining rewards. As previously said, we did not use a conventional progressive ratio protocol to avoid that the animals reach the consummatory phase before proceeding to the next step, where we measured the intake of chocolate pellets. After the test, the rats remained in the apparatus, lights were off and the lever was retracted and then immediately lights were on again and the lever extended, then one pellet was automatically delivered, and for a 30-min period, one chocolate pellet was now delivered per lever press. The number of lever presses in this stage was considered as pellets ingested. We confirmed that all pellets delivered were eaten, and if pellets were left in the cage, they were subtracted from the number of lever presses to calculate ingested pellets and the automatically delivered pellet was added. All the above explained procedures were performed during the light phase of the circadian cycle.</p>
<p>To determine the influence of circadian phase (subjective day or night) on the behavioral performance and histamine release, this procedure was repeated in other groups of rats (<italic>n</italic> = 16), but under an inverted circadian cycle schedule during 2 weeks of housing before testing.</p>
</sec>
<sec><title>Surgery</title>
<p>Rats were anesthetized with 100 mg/kg i.p. of ketamine (Imalgene<sup>TM</sup>, Rhodia Merieux, Santiago) plus 20 mg/kg of xylazine (Rompun<sup>TM</sup>, Bayer, Santiago). The animals were placed in a stereotaxic frame (S1600 model, Stoelting, Co., Wood Dale, IL, United States). The head was fixed and positioned, so that bregma and lambda were in the same horizontal plane. Guide cannulae for microdialysis or microinjection were implanted bilaterally in the ILC of the vmPFC at the following coordinates (<xref ref-type="bibr" rid="B55">Swanson, 1998</xref>): 3.0 mm anterior to bregma, 0.5 mm lateral, and 3.6 mm below the duramater; and in both lateral ventricles at 3.4 mm posterior to bregma, &#x00B1; 1.5 mm lateral, and 4.4 mm below the dura mater, for H1 receptor inverse agonist injection. The microdialysis guide cannulae (MD2251, BASi, Lafayette, IN, United States) consist of a guide head and an occluder, which were fixed to the skull with dental acrylic (Marche<sup>TM</sup>, Santiago, Chile), stainless-steel jewellery screws, and plastic support. One of the cannula guides was implanted in one IL at the above coordinates, and the other was implanted in the contralateral IL using a 24&#x00B0; angle in the anteroposterior axis. After guide cannula implantation, the animals were individually housed for 7 days before brain microdialysis started. Enrofloxacin 5% (19 mg/kg i.p., Bayer Santiago) and Ketophen (0.2 mg/kg i.p., Rhodia Merieux) were administrated at the end of surgery as antibiotic and anti-inflammatory measures, respectively.</p>
</sec>
<sec><title>Histamine Monitoring in the vmPFC of Freely Moving Rats</title>
<p>We performed microdialysis in awake and freely moving animals while they were tested in the operant chamber. We used either a concentric microdialysis probe of 2 mm length, 0.5 mm outer diameter, cutoff 30,000 kDa (BASi, Lafayette, IN, United States), or a combination probe (BASi, MD2262) that allowed muscimol infusion in addition to performing microdialysis. The probe was lowered 2 mm below the cannulae guide tip into the ILC. The probe was continuously perfused at a rate of 2 &#x03BC;l/min with artificial cerebrospinal fluid (ACSF) using a microperfusion pump (KDS100L model from KD Scientific, Inc., Holliston, MA, United States). The composition of the ACSF solution was 147 mM NaCl, 1.2 mM CaCl<sub>2</sub>, 4 mM KCl, 2 mM Na<sub>2</sub>HPO<sub>4</sub>, and 0.2 mM NaH<sub>2</sub> PO<sub>4</sub> (pH 7.4), freshly prepared with sterile distilled water. After a stabilization period of 120 min, three basal samples of 10 min each were collected in separate tubes containing 2.0 &#x03BC;l of 0.2 N perchloric acid, after which samples were collected every 10 min during all experimental protocols.</p>
</sec>
<sec><title>Derivatization for Histamine and Serotonin</title>
<p>Ten microliters of borate buffer 0.5 M and 5 &#x03BC;l of the fresh solution [4 mg ophtalaldehyde (OPA) and 2 &#x03BC;l of &#x03B2;-mercaptoethanol in 1 ml of methanol] were added to 20 &#x03BC;l of the microdialysis sample for derivatization. The mixture was agitated for 30 s and injected after 1 min in the HPLC column (LiChroCART 250-4 Purospher STAR RP-18 endcapped, particle size 5 &#x03BC;m; Merck KGaA, Darmstadt, Germany). The mobile phase contained phosphate buffer (0.1 mol/L KH<sub>2</sub>PO<sub>4</sub>) and an acetonitrile gradient from 25 to 50% and was set at a flux of 1 ml per minute. Acetonitrile and phosphate buffer were automatically mixed by the pump (Elite labChrom L-2130; Hitachi, Chiyoda, Tokyo, Japan). The resultant fluorescent derivatives were analyzed using a fluorometric detector (Elite labChrom L-2480; Hitachi). We used excitation/emission wavelengths of 330/450 nm, respectively. Histamine and serotonin (from Sigma-Aldrich, Co.) standards dissolved in ACSF in a concentration range from 0.06 to 0.25 pmol/20 &#x03BC;l were used to construct calibration curves that produced a linear correlation between neurotransmitter concentration and peak area.</p>
</sec>
<sec><title>Statistical Analysis</title>
<p>Extracellular levels of histamine and serotonin were expressed as the mean &#x00B1; SEM of the percentage of basal levels. The time courses of the effect of IL inactivation (muscimol) on histamine and serotonin extracellular levels were statistically analyzed by a two-way repeated-measures analysis of variance (ANOVA) followed by Bonferroni <italic>post hoc</italic> tests, with drug treatment and time as factors. The number of lever presses and pellets eaten was analyzed using a one-way ANOVA, followed by a Tukey post-test. The number of lever presses was analyzed by one-tailed <italic>t</italic>-test with Welch&#x2019;s correction. The absolute values of histamine and serotonin extracellular levels were analyzed by a two-tailed <italic>t</italic>-test with Welch&#x2019;s correction. The statistical analysis was performed using GraphPad Prism software.</p>
</sec>
</sec>
<sec><title>Results</title>
<sec><title>Decreased ILC-TMN Activity Reduces the Effort to Get a Reinforcer</title>
<p>In order to have a direct assessment of motivation, we evaluated the effort displayed to obtain a reinforcer (that is, during appetitive behavior) in rats trained on an operant chamber. To distinguish the effect of inhibiting the ILC, on appetitive versus consummatory behavior, we compared the ILC inhibition effect on the effort to get the reinforcers with that on food intake. Once the animals learned the task and they had reached a threshold of 45 lever presses to get one pellet as reward, they were subjected to a non-rewarded lever-pressing session, after a 24-h fasting or <italic>ad libitum</italic> feeding schedule.</p>
<p>Histamine levels in dialysates from the ILC of fasted rats were increased during the test session, when availability of reward was signaled (<xref ref-type="fig" rid="F1">Figure 1A</xref>, black symbols, <italic>n</italic> = 9), compared to basal. Otherwise, in rats fed <italic>ad libitum</italic> (<xref ref-type="fig" rid="F1">Figure 1A</xref>, green symbols, <italic>n</italic> = 6), histamine levels remained unchanged, indicating that motivation (hunger) determines how much histamine is released. A two-way ANOVA revealed a significant effect of time (<italic>F</italic><sub>5,90</sub> = 4.99, <italic>P</italic> = 0.0004), treatment (<italic>F</italic><sub>1,90</sub> = 16.56, <italic>P</italic> = 0.0007) and interaction time&#x2013;treatment (<italic>F</italic><sub>5,90</sub> = 7.39, <italic>P</italic> &#x003C; 0.0001). In contrast, serotonin levels in the same groups of rats did not change significantly during the unrewarded test session (one-way ANOVA: <italic>P</italic> = 0.8445), except for the muscimol-treated group, in which serotonin levels are increased after the muscimol injection in the IL (<xref ref-type="fig" rid="F1">Figure 1B</xref>), in agreement with previous reports (<xref ref-type="bibr" rid="B45">Riveros et al., 2015</xref>).</p>
<fig id="F1" position="float">
<label>FIGURE 1</label>
<caption><p>Histamine release in the medial prefrontal cortex is correlated with effort. <bold>(A)</bold> Percentage of extracellular histamine in relation to baseline levels (mean of 3 free samples, from 3 to 30 min) in 24-h food-restricted rats (dark green circles), in food-restricted animals with inactivated IL (inverted red triangles) after a microinjection of muscimol into the IL (signaled with an arrow), and in animals fed <italic>ad libitum</italic> (light green circles). The 30 min in which a light indicated food availability and animals could press a lever for food but received no food reward is indicated as test session. <bold>(B)</bold> Percentage of extracellular serotonin in the same groups and times shown in graph <bold>(A)</bold>. <bold>(C)</bold> Number of lever presses in food-restricted animals with intact IL (dark green bars) and in the <italic>ad libitum</italic> (light green bars) and muscimol (red bars) groups. <bold>(D)</bold> Correlation between histamine release and lever presses. <bold>(E)</bold> Ingestion of pellets after the test session. <bold>(F)</bold> Correlation between the amount of food eaten and the effort, measured as number of lever presses, that each animal made during the test session (<sup>&#x2217;</sup><italic>P</italic> &#x003C; 0.05, <sup>&#x2217;&#x2217;</sup><italic>P</italic> &#x003C; 0.01, <sup>&#x2217;&#x2217;&#x2217;</sup><italic>P</italic> &#x003C; 0.001, and <sup>&#x2217;&#x2217;&#x2217;&#x2217;</sup><italic>P</italic> &#x003C; 0.0001).</p></caption>
<graphic xlink:href="fnins-13-00577-g001.tif"/>
</fig>
<p>Animals from the fasted group made three times more lever presses than the satiated rats (<xref ref-type="fig" rid="F1">Figure 1C</xref>), showing that motivation also determined how much effort was displayed. Bilateral microinjection of muscimol into the ILC of hungry rats decreased the number of unrewarded lever presses compared to control, fasted animals (one-way ANOVA: <italic>F</italic><sub>2,35</sub> <sub>=</sub> 12.11, <italic>P</italic> &#x003C; 0.0001; <xref ref-type="fig" rid="F1">Figure 1C</xref>) to the same level observed in the satiated rats. Therefore, inhibition of ILC decreased the effort displayed to obtain food and prevented the histamine increase observed in the fasted rats during the test (arrow in <xref ref-type="fig" rid="F1">Figure 1A</xref>; red triangles, <italic>n</italic> = 7). Two-way ANOVA revealed a significant treatment (<italic>F</italic><sub>1,90</sub> = 57.64, <italic>P</italic> &#x003C; 0.0001) and treatment&#x2013;time interaction (<italic>F</italic><sub>5,90</sub> = 20.76, <italic>P</italic> &#x003C; 0.0001) effect but no time effect alone (<italic>F</italic><sub>5,90</sub> = 0.947, <italic>P</italic> = 0.454).</p>
<p>Infusion of vehicle into the ILC of fasted rats before the test session did not induce an increase on histamine levels (two-tailed <italic>t</italic>-test, <italic>P</italic> = 0.984) or in the number of unrewarded lever presses observed in the fasted untreated rats (two-tailed <italic>t</italic>-test, <italic>P</italic> = 0.736).</p>
<p>We found a positive and significant correlation between the increase of extracellular histamine level and number of unrewarded lever presses in fasted rats during the test session (Pearson correlation, <italic>r</italic> = 0.755, <italic>P</italic> = 0.0011; <xref ref-type="fig" rid="F1">Figure 1D</xref>), suggesting that the release of histamine may be causally related to motivation extent or the effort that a rat is willing to make to obtain food.</p>
<p>To evaluate if muscimol infusion in the ILC may affect food intake as a proxy of the consummatory phase of motivated behavior, we measured the amount of food intake immediately after the test session; at this point, the rats received one pellet per lever pressing. The fasted rats ate three times as much as the <italic>ad lib</italic> group (<xref ref-type="fig" rid="F1">Figure 1E</xref>), regardless of the treatment received (muscimol, vehicle, or no treatment, one-way ANOVA; <italic>F</italic><sub>2,27</sub> = 12.33, <italic>P</italic> = 0.0002). This finding indicates that infusing muscimol into the ILC did not alter food intake, directly implying that the ILC did not influence the consummatory phase of feeding. Furthermore, we found a positive and significant correlation between the number of lever presses during the test session and the number of pellets ingested by untreated fasted rats and <italic>ad lib</italic> rats (black and green circles, respectively; <xref ref-type="fig" rid="F1">Figure 1F</xref>) (Pearson correlation, &#x03C1; = 0.7909; <italic>P</italic> &#x003C; 0.0001). In contrast, fasted rats treated with muscimol did not show a significant correlation (red triangles; <xref ref-type="fig" rid="F1">Figure 1F</xref>, <italic>P</italic> = 0.4), indicating that the positive correlation between appetite and intake is lost after ILC inactivation induced by muscimol. Microinjection of muscimol into the ILC did not change the number of unrewarded lever presses during the test session in the <italic>ad lib</italic> rats (<italic>t</italic>-test vs. vehicle; <italic>P</italic> = 0.399; data not shown), further supporting that motivation induced by fasting determined how much effort was made by the animal to obtain food.</p>
</sec>
<sec><title>Active Versus Rest Circadian Phase</title>
<p>To evaluate if the phase of the circadian cycle might have influenced the effort made by hungry rats to obtain food during the resting phase, the animals were tested during the active phase.</p>
<p>Animals tested during their active phase (<italic>n</italic> = 8) did not show differences in behavior regarding the total number of lever presses or the temporal pattern in which the lever presses were done, compared to rats tested during the rest phase (<italic>n</italic> = 8). Both groups displayed more lever presses at the beginning of the test and less at the end and, irrespective of the basal levels, both groups had comparable increases in extracellular histamine levels during the 30 min of the unrewarded test (<xref ref-type="fig" rid="F2">Figure 2A</xref>). The two-way ANOVA revealed a significant effect of time (<italic>P</italic> = 0.004) when comparing basal levels with histamine during the 30 min of the test. Animals tested during their dark phase (inverted cycle group) ingested a comparable number of pellets when tested in their light phase (normal cycle group) (<xref ref-type="fig" rid="F2">Figure 2B</xref>, one-way ANOVA; <italic>F</italic> = 0.87548, <italic>P</italic> = 0.431325), regardless of having an inhibited ILC.</p>
<fig id="F2" position="float">
<label>FIGURE 2</label>
<caption><p>Cortical histamine levels increased during goal-directed behavior in the active phase of the day. <bold>(A)</bold> During the test session performed in the active phase of the day (30&#x2013;60 min), the percentage of extracellular histamine in relation to baseline levels increased in 24-h food-restricted rats (white circles), but not when the IL of fasted animals was inactivated (inverted red triangles) with a microinjection of muscimol into the IL. The number of lever presses for food during the test session was higher in IL intact rats (white bars) than in IL-inactivated rats (red bars). <bold>(B)</bold> Number of ingested pellets was similar in three groups of 24-h food-deprived rats: IL muscimol injected and under inverted cycle (red bars), intact inverted cycle (white bars), and normal cycle (gray bars) (<sup>&#x2217;</sup><italic>P</italic> &#x003C; 0.005, <sup>&#x2217;&#x2217;</sup><italic>P</italic> &#x003C; 0.001, <sup>&#x2217;&#x2217;&#x2217;</sup><italic>P</italic> &#x003C; 0.0001).</p></caption>
<graphic xlink:href="fnins-13-00577-g002.tif"/>
</fig>
<p>The basal extracellular neurotransmitter concentrations in the ILC were higher during the active than during the resting phase (<italic>P</italic> = 0.029 for histamine, <italic>P</italic> = 0.0022 for serotonin). Neurotransmitter concentrations were 0.30 &#x00B1; 0.0607 and 0.16 &#x00B1; 0.0206 pmol/20 &#x03BC;l for histamine (<italic>n</italic> = 31, active phase; <italic>n</italic> = 48, rest phase), respectively; for serotonin, the values were 0.41 &#x00B1; 0.0667 and 0.17 &#x00B1; 0.016 pmol/20 &#x03BC;l (<italic>n</italic> = 18, active phase; <italic>n</italic> = 44, rest phase), respectively. The daily variations in extracellular histamine and serotonin levels were similar to those described previously (<xref ref-type="bibr" rid="B36">Mochizuki et al., 1992</xref>; <xref ref-type="bibr" rid="B5">Barassin et al., 2002</xref>). These results indicate that it is the change in brain histamine extracellular level and not the absolute value that is relevant for appetitive behavior.</p>
</sec>
<sec><title>Role of H1 Histamine Receptors on Motivation for Food</title>
<p>To test if the appetitive behavior induced by histamine is mediated through H1 receptors, one of the most abundant histamine receptors in the brain (<xref ref-type="bibr" rid="B19">Haas et al., 2008</xref>), we administered pyrilamine (an inverse agonist of H1 receptors) i.p. before the session of unrewarded lever presses. We found that pyrilamine induced a dose-dependent decrease in unrewarded lever presses (<xref ref-type="fig" rid="F3">Figure 3A</xref>, one-way ANOVA; <italic>F</italic><sub>2,21</sub> = 19.39, <italic>P</italic> &#x003C; 0.0001), but there was no change in the number of pellets ingested immediately after the test (<xref ref-type="fig" rid="F3">Figure 3B</xref>). These results suggest that the H1 histamine receptor is involved in the effort made by fasted rats to obtain food. The number of errors (an error consisted of pressing the no-reward lever) in the test did not differ between the treatments (one-way ANOVA; <italic>F</italic> = 0.4033, <italic>P</italic> = 0.088); this finding points to a mild or absent sedative effect in pyrilamine-treated rats at the dose we used.</p>
<fig id="F3" position="float">
<label>FIGURE 3</label>
<caption><p>H1 antagonist pyrilamine dose-dependently reduced the effort to obtain food. <bold>(A)</bold> Lever presses for food were higher in vehicle (saline)-injected food-deprived rats (white bars) than in rats that received 20 mg/kg pyrilamine injected i.p. (light blue bars): pyrilamine effect was even higher in the rats given a 30 mg/kg dose (gray bars). <bold>(B)</bold> Pyrilamine-treated rats ate comparable amounts of pellets to the vehicle group (<sup>&#x2217;</sup><italic>P</italic> &#x003C; 0.05, <sup>&#x2217;&#x2217;</sup><italic>P</italic> &#x003C; 0.01, <sup>&#x2217;&#x2217;&#x2217;</sup><italic>P</italic> &#x003C; 0.001, and <sup>&#x2217;&#x2217;&#x2217;&#x2217;</sup><italic>P</italic> &#x003C; 0.0001).</p></caption>
<graphic xlink:href="fnins-13-00577-g003.tif"/>
</fig>
</sec>
</sec>
<sec><title>Discussion</title>
<p>In this study, we provide novel evidence of the pivotal role of histaminergic signaling through H1 in the degree of effort displayed during the appetitive phase of motivated behavior. Additionally, we showed that the ILC is necessary to promote an increase in the histamine release during the appetitive phase of motivated behavior. We propose that ILC-TMN conforms to a circuit that is shown to be fundamental in regulating effort investment during goal-directed behaviors.</p>
<p>We evaluated motivation using instrumental responses since these responses are considered a direct assessment of motivation in animals to obtain a reward or avoid punishment (<xref ref-type="bibr" rid="B8">Berridge and Robinson, 1998</xref>; <xref ref-type="bibr" rid="B4">Baldo and Kelley, 2007</xref>). As expected, hungry rats displayed more effort to obtain food rewards than the <italic>ad lib</italic> rats while they also had an increased histamine release during the instrumental conditioning test session. Hungry rats with bilateral ILC inactivation showed a decrease in histamine level and reduced effort to get food rewards compared with the untreated hungry rats. In fact, hungry rats with inactive ILC showed the same diminished motivation for food and histamine levels as the <italic>ad lib</italic> group.</p>
<p>Nevertheless, when fasted rats were allowed to acquire a pellet immediately after the test session easily, they behave accordingly to their internal state: the two fasted groups ate nearly three times more rewards than the <italic>ad lib</italic> rats. Thus, instrumental responses were sufficient to distinguish between the effects of these manipulations on appetitive versus consummatory stages of the behavior. ILC inhibition dissociated food intake from the motivation to obtain food as shown in <xref ref-type="fig" rid="F1">Figure 1F</xref>.</p>
<p>The synchronous increase in the extracellular histamine level and motivation observed in the fasted rats was similar during the resting and active phases, indicating that histamine is not merely a wakefulness signal but rather that its increase is essential for motivation during the day and night.</p>
<p>The results shown here do not focus on pinpointing the specific brain locations where the activation of H1 receptors mediates the increase in behavioral arousal, locomotor activity, or sympathetic activation. However, activation of these receptors in the cortex and thalamus as well as in hypothalamic and brainstem nuclei could mediate behavioral arousal (<xref ref-type="bibr" rid="B41">Panula and Nuutinen, 2013</xref>). Similarly, histamine acting on motor cortices and striatum could mediate the increase in locomotor activity (<xref ref-type="bibr" rid="B24">Inoue et al., 1996</xref>). Histamine could also, directly and indirectly, activate sympathetic nuclei (<xref ref-type="bibr" rid="B60">Vald&#x00E9;s et al., 2010</xref>; <xref ref-type="bibr" rid="B37">Murakami et al., 2015</xref>) and also act on the rest of the AAS promoting the release of other neuromodulators such as dopamine, noradrenaline, or acetylcholine as it has been proposed before (<xref ref-type="bibr" rid="B58">Vald&#x00E9;s et al., 2005</xref>; <xref ref-type="bibr" rid="B57">Torrealba et al., 2012</xref>).</p>
<p>Changes in expected reward can induce frustration that stems from an unexpected omission of an expected reward or a reduction in the reward magnitude (<xref ref-type="bibr" rid="B3">Amsel, 1994</xref>). In turn, the emotional state of frustration may possibly impact on instrumental responses (<xref ref-type="bibr" rid="B3">Amsel, 1994</xref>). Then, it is noteworthy that the test we used to assess motivation (lever pressing for food without reward), as the animal expect a reward that it is not getting, may induce frustration. Therefore, the histamine release we observed during the test may be frustration-related since the rats obtained no reinforcers despite their efforts. However, we found that histamine release was positively correlated with the instrumental response (<xref ref-type="fig" rid="F1">Figure 1D</xref>). If the observed histamine release were indeed related to frustration, we hypothesize that a negative correlation would be more likely, considering the negative emotional impact that a reduction in the expected reward would have in the output of the instrumental behavior observations (<xref ref-type="bibr" rid="B53">Scull et al., 1970</xref>; <xref ref-type="bibr" rid="B17">Flaherty et al., 1983</xref>, <xref ref-type="bibr" rid="B16">1995</xref>). These considerations rather suggest that histamine release is not secondary to frustration. Similarly, we previously reported that the increase in histamine release during unreachable food presentation is not likely to be part of a stress response, because this manipulation is not associated to signs of stress in the brain (<xref ref-type="bibr" rid="B60">Vald&#x00E9;s et al., 2010</xref>), which is in concordance with the notion that in natural conditions, an animal has to work to obtain food. Since we have not used H2 or H3 receptors blockers, we do not have information about participation of these receptors in the histamine-mediated components of food-directed behavior, and it would be interesting to evaluate in a future research how each of the receptors is collaborating in the increase of arousal mediated by histamine.</p>
<p>Motivation, the invigoration of behavior, and the reinforcement of adaptive behaviors, such as instrumental goal-seeking behavior, have been extensively associated with the mesocorticolimbic systems and dopamine (<xref ref-type="bibr" rid="B47">Robbins et al., 1989</xref>; <xref ref-type="bibr" rid="B8">Berridge and Robinson, 1998</xref>). In fact, the relevance of arousal to effort-related functions has been extensively addressed by <xref ref-type="bibr" rid="B49">Salamone et al. (2007)</xref>. A simple way to link the motivational functions of the mesocorticolimbic systems with our hypothesis that the TMN and histamine are also crucial elements in motivation is to consider the IL-TMN circuit as an integral part of the motive circuit with the prefrontal cortex-basal ganglia-thalamus loops involved in goal-directed behavior (<xref ref-type="bibr" rid="B2">Alexander et al., 1986</xref>; <xref ref-type="bibr" rid="B18">Groenewegen et al., 1990</xref>; <xref ref-type="bibr" rid="B44">Pierce and Kalivas, 1997</xref>; <xref ref-type="bibr" rid="B65">Zahm, 2000</xref>; <xref ref-type="bibr" rid="B28">Koob, 2003</xref>). Within this framework, the IL-TMN circuit explicitly contributes to motivation by increasing arousal and sympathetic activity (<xref ref-type="bibr" rid="B59">Vald&#x00E9;s et al., 2006</xref>) to prepare the brain and body for appetitive behavior. However, the anatomical and functional relationship between the histaminergic system and the dopaminergic input to the nucleus accumbens to induce arousal and to modulate effort-based decisions (<xref ref-type="bibr" rid="B49">Salamone et al., 2007</xref>) remains to be explored. Also, there are interactions between histamine and dopamine at the neurochemical level that deserve further investigation (<xref ref-type="bibr" rid="B10">Brabant et al., 2010</xref>).</p>
<p>We measured serotonin levels on the same samples in which histamine was measured. We observed no changes in serotonin release while fasted animals were pressing the lever to obtain food reward, suggesting that serotonin signaling is not mediating the incentive motivation. Furthermore, serotonin was increased in the animals that were injected with muscimol in the ILC. Remarkably, lever pressing or effort to obtain food reward is reduced in these animals, in keeping with the hypothesis of the role of serotonin in the reduction of motivation for food (<xref ref-type="bibr" rid="B23">Hutson et al., 1986</xref>). This reduction in motivation, observed as a reduction in operant responding for food, is mediated by serotonin release in the ventral tegmental area, suggesting that serotonin action opposes to dopamine mediation of motivation at this site (<xref ref-type="bibr" rid="B11">Browne et al., 2019</xref>). In this regard, our work suggests that histaminergic and serotoninergic systems regulate dopaminergic mediation of incentive motivation in an opposite way.</p>
<sec><title>Clinical Implications</title>
<p>IL activation could be promoting the activation of histaminergic TMN neurons leading to histamine release and increased arousal and disposition to work, allowing the optimal unfolding of appetitive behavior. In some conditions such as apathy or fatigue, this optimal unfolding is disrupted because of increased effort perception (<xref ref-type="bibr" rid="B40">Pageaux et al., 2015</xref>).</p>
<p>Apathy can be defined as a reduction of self-generated, voluntary, and purposeful behaviors (<xref ref-type="bibr" rid="B33">Marin, 1996</xref>; <xref ref-type="bibr" rid="B48">Robert et al., 2010</xref>; <xref ref-type="bibr" rid="B12">Chase, 2011</xref>). Dysfunction of the IL-TMN axis may underlie the auto-activation type of apathy observed in individuals with lesions to frontal cortical areas including Brodmann area 25/32 (<xref ref-type="bibr" rid="B29">Levy and Dubois, 2006</xref>), the primate homologous to the rat IL (<xref ref-type="bibr" rid="B39">Ong&#x00FC;r and Price, 2000</xref>).</p>
<p>On the same line, the mental fatigue that people may experience after or during prolonged periods of cognitive activity (<xref ref-type="bibr" rid="B9">Boksem and Tops, 2008</xref>) could be related to an IL-TMN circuit alteration. Aversion to a further investment of effort in task performance is central to mental fatigue. For instance, mental fatigue limits exercise tolerance in humans through the higher perception of effort rather than cardiorespiratory and muscular mechanisms (<xref ref-type="bibr" rid="B32">Marcora et al., 2009</xref>). It is not unlikely that the IL-TMN axis dysfunction plays a role in mental fatigue, possibly by increasing effort perception.</p>
<p>We suggest that devising methods to advantageously modulate IL-TMN axis activity may contribute to the treatment of different conditions that have reduced motivation as a central symptom.</p>
</sec>
</sec>
<sec><title>Conclusion</title>
<p>The amount of effort the rats invest to obtain palatable food reinforcers depends on the activity of the ILC and the release of histamine acting on H1 receptors.</p>
</sec>
<sec><title>Ethics Statement</title>
<p>This study was carried out in accordance with the recommendations of the Guide for the Care and Use of Laboratory Animals; National Research Council, Comit&#x00E9; &#x00C9;tico Cient&#x00ED;fico para el Cuidado de Animales y Ambiente. The protocol was approved by the Comit&#x00E9; &#x00C9;tico Cient&#x00ED;fico para el Cuidado de Animales y Ambiente.</p>
</sec>
<sec><title>Author Contributions</title>
<p>All authors listed had contributed substantially to the work. MR and FT designed the experiments and wrote the first draft. MR conducted the experiments. MF and JV collaborated in data processing and editing of the mansuscript.</p>
</sec>
<sec><title>Conflict of Interest Statement</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</body>
<back>
<fn-group>
<fn fn-type="financial-disclosure">
<p><bold>Funding.</bold> This study was financed by the Fondecyt grant 1130042, Nucleo Milenio P10063F, and Proyecto Anillo ACT-99. MR acknowledges financial support from the Fondo Basal-CONICYT grant FB-0002 (2014).</p>
</fn>
</fn-group>
<ack>
<p>We thank Paulina Arias for help with HPLC procedures.</p>
</ack>
<ref-list>
<title>References</title>
<ref id="B1"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Aberman</surname> <given-names>J. E.</given-names></name> <name><surname>Salamone</surname> <given-names>J. D.</given-names></name></person-group> (<year>1999</year>). <article-title>Nucleus accumbens dopamine depletions make rats more sensitive to high ratio requirements but do not impair primary food reinforcement.</article-title> <source><italic>Neuroscience</italic></source> <volume>92</volume> <fpage>545</fpage>&#x2013;<lpage>552</lpage>.</citation></ref>
<ref id="B2"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Alexander</surname> <given-names>G. E.</given-names></name> <name><surname>DeLong</surname> <given-names>M. R.</given-names></name> <name><surname>Strick</surname> <given-names>P. L.</given-names></name></person-group> (<year>1986</year>). <article-title>Parallel organization of functionally segregated circuits linking basal ganglia and cortex.</article-title> <source><italic>Annu. Rev. Neurosci.</italic></source> <volume>9</volume> <fpage>357</fpage>&#x2013;<lpage>381</lpage>. <pub-id pub-id-type="doi">10.1146/annurev.ne.09.030186.002041</pub-id></citation></ref>
<ref id="B3"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Amsel</surname> <given-names>A.</given-names></name></person-group> (<year>1994</year>). <article-title>Pr&#x00E9;cis of frustration theory: an analysis of dispositional learning and memory.</article-title> <source><italic>Psychon. Bull. Rev.</italic></source> <volume>1</volume> <fpage>280</fpage>&#x2013;<lpage>296</lpage>. <pub-id pub-id-type="doi">10.3758/BF03213968</pub-id> <pub-id pub-id-type="pmid">24203511</pub-id></citation></ref>
<ref id="B4"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Baldo</surname> <given-names>B. A.</given-names></name> <name><surname>Kelley</surname> <given-names>A. E.</given-names></name></person-group> (<year>2007</year>). <article-title>Discrete neurochemical coding of distinguishable motivational processes: insights from nucleus accumbens control of feeding.</article-title> <source><italic>Psychopharmacology</italic></source> <volume>191</volume> <fpage>439</fpage>&#x2013;<lpage>459</lpage>. <pub-id pub-id-type="doi">10.1007/s00213-007-0741-z</pub-id> <pub-id pub-id-type="pmid">17318502</pub-id></citation></ref>
<ref id="B5"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Barassin</surname> <given-names>S.</given-names></name> <name><surname>Raison</surname> <given-names>S.</given-names></name> <name><surname>Saboureau</surname> <given-names>M.</given-names></name> <name><surname>Bienvenu</surname> <given-names>C.</given-names></name> <name><surname>Ma&#x00EE;tre</surname> <given-names>M.</given-names></name> <name><surname>Malan</surname> <given-names>A.</given-names></name><etal/></person-group> (<year>2002</year>). <article-title>Circadian tryptophan hydroxylase levels and serotonin release in the suprachiasmatic nucleus of the rat.</article-title> <source><italic>Eur. J. Neurosci.</italic></source> <volume>15</volume> <fpage>833</fpage>&#x2013;<lpage>840</lpage>.</citation></ref>
<ref id="B6"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Batten</surname> <given-names>D. E.</given-names></name> <name><surname>Shoemaker</surname> <given-names>H. A.</given-names></name></person-group> (<year>1961</year>). <article-title>The effects of deprivation and incentive palatability on a conditioned operant reponse.</article-title> <source><italic>J. Comp. Physiol. Psychol.</italic></source> <volume>54</volume> <fpage>577</fpage>&#x2013;<lpage>579</lpage>. <pub-id pub-id-type="pmid">13865785</pub-id></citation></ref>
<ref id="B7"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Beierholm</surname> <given-names>U.</given-names></name> <name><surname>Guitart-Masip</surname> <given-names>M.</given-names></name> <name><surname>Economides</surname> <given-names>M.</given-names></name> <name><surname>Chowdhury</surname> <given-names>R.</given-names></name> <name><surname>D&#x00FC;zel</surname> <given-names>E.</given-names></name> <name><surname>Dolan</surname> <given-names>R.</given-names></name><etal/></person-group> (<year>2013</year>). <article-title>Dopamine modulates reward-related vigor.</article-title> <source><italic>Neuropsychopharmacology</italic></source> <volume>38</volume> <fpage>1495</fpage>&#x2013;<lpage>1503</lpage>. <pub-id pub-id-type="doi">10.1038/npp.2013.48</pub-id> <pub-id pub-id-type="pmid">23419875</pub-id></citation></ref>
<ref id="B8"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Berridge</surname> <given-names>K. C.</given-names></name> <name><surname>Robinson</surname> <given-names>T. E.</given-names></name></person-group> (<year>1998</year>). <article-title>What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience</article-title> <source><italic>Brain Res. Brain Res. Rev.</italic></source> <volume>28</volume> <fpage>309</fpage>&#x2013;<lpage>369</lpage>.</citation></ref>
<ref id="B9"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Boksem</surname> <given-names>M. A. S.</given-names></name> <name><surname>Tops</surname> <given-names>M.</given-names></name></person-group> (<year>2008</year>). <article-title>Mental fatigue: costs and benefits.</article-title> <source><italic>Brain Res. Rev.</italic></source> <volume>59</volume> <fpage>125</fpage>&#x2013;<lpage>139</lpage>. <pub-id pub-id-type="doi">10.1016/j.brainresrev.2008.07.001</pub-id> <pub-id pub-id-type="pmid">18652844</pub-id></citation></ref>
<ref id="B10"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Brabant</surname> <given-names>C.</given-names></name> <name><surname>Alleva</surname> <given-names>L.</given-names></name> <name><surname>Quertemont</surname> <given-names>E.</given-names></name> <name><surname>Tirelli</surname> <given-names>E.</given-names></name></person-group> (<year>2010</year>). <article-title>Involvement of the brain histaminergic system in addiction and addiction-related behaviors: a comprehensive review with emphasis on the potential therapeutic use of histaminergic compounds in drug dependence.</article-title> <source><italic>Prog. Neurobiol.</italic></source> <volume>92</volume> <fpage>421</fpage>&#x2013;<lpage>441</lpage>. <pub-id pub-id-type="doi">10.1016/j.pneurobio.2010.07.002</pub-id> <pub-id pub-id-type="pmid">20638439</pub-id></citation></ref>
<ref id="B11"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Browne</surname> <given-names>C. J.</given-names></name> <name><surname>Abela</surname> <given-names>A. R.</given-names></name> <name><surname>Chu</surname> <given-names>D.</given-names></name> <name><surname>Li</surname> <given-names>Z.</given-names></name> <name><surname>Ji</surname> <given-names>X.</given-names></name> <name><surname>Lambe</surname> <given-names>E. K.</given-names></name><etal/></person-group> (<year>2019</year>). <article-title>Dorsal raphe serotonin neurons inhibit operant responding for reward via inputs to the ventral tegmental area but not the nucleus accumbens: evidence from studies combining optogenetic stimulation and serotonin reuptake inhibition.</article-title> <source><italic>Neuropsychopharmacology</italic></source> <volume>44</volume> <fpage>793</fpage>&#x2013;<lpage>804</lpage>. <pub-id pub-id-type="doi">10.1038/s41386-018-0271-x</pub-id> <pub-id pub-id-type="pmid">30420603</pub-id></citation></ref>
<ref id="B12"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chase</surname> <given-names>T. N.</given-names></name></person-group> (<year>2011</year>). <article-title>Apathy in neuropsychiatric disease: diagnosis, pathophysiology, and treatment.</article-title> <source><italic>Neurotox. Res.</italic></source> <volume>19</volume> <fpage>266</fpage>&#x2013;<lpage>278</lpage>. <pub-id pub-id-type="doi">10.1007/s12640-010-9196-9</pub-id> <pub-id pub-id-type="pmid">20473601</pub-id></citation></ref>
<ref id="B13"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chauveau</surname> <given-names>F.</given-names></name> <name><surname>Laudereau</surname> <given-names>K.</given-names></name> <name><surname>Libourel</surname> <given-names>P. A.</given-names></name> <name><surname>Gervasoni</surname> <given-names>D.</given-names></name> <name><surname>Thomasson</surname> <given-names>J.</given-names></name> <name><surname>Poly</surname> <given-names>B.</given-names></name><etal/></person-group> (<year>2014</year>). <article-title>Ciproxifan improves working memory through increased prefrontal cortex neural activity in sleep-restricted mice.</article-title> <source><italic>Neuropharmacology</italic></source> <volume>85</volume> <fpage>349</fpage>&#x2013;<lpage>356</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuropharm.2014.04.017</pub-id> <pub-id pub-id-type="pmid">24796256</pub-id></citation></ref>
<ref id="B14"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Correa</surname> <given-names>M.</given-names></name> <name><surname>Carlson</surname> <given-names>B. B.</given-names></name> <name><surname>Wisniecki</surname> <given-names>A.</given-names></name> <name><surname>Salamone</surname> <given-names>J. D.</given-names></name></person-group> (<year>2002</year>). <article-title>Nucleus accumbens dopamine and work requirements on interval schedules.</article-title> <source><italic>Behav. Brain Res.</italic></source> <volume>137</volume> <fpage>179</fpage>&#x2013;<lpage>187</lpage>.</citation></ref>
<ref id="B15"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ericson</surname> <given-names>H.</given-names></name> <name><surname>Blomqvist</surname> <given-names>A.</given-names></name> <name><surname>K&#x00F6;ohler</surname> <given-names>C.</given-names></name></person-group> (<year>1991</year>). <article-title>Origin of neuronal inputs to the region of the tuberomammillary nucleus of the rat brain.</article-title> <source><italic>J. Comp. Neurol.</italic></source> <volume>311</volume> <fpage>45</fpage>&#x2013;<lpage>64</lpage>. <pub-id pub-id-type="doi">10.1002/cne.903110105</pub-id> <pub-id pub-id-type="pmid">1719044</pub-id></citation></ref>
<ref id="B16"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Flaherty</surname> <given-names>C. F.</given-names></name> <name><surname>Coppotelli</surname> <given-names>C.</given-names></name> <name><surname>Grigson</surname> <given-names>P. S.</given-names></name> <name><surname>Mitchell</surname> <given-names>C.</given-names></name> <name><surname>Flaherty</surname> <given-names>J. E.</given-names></name></person-group> (<year>1995</year>). <article-title>Investigation of the devaluation interpretation of anticipatory negative contrast.</article-title> <source><italic>J. Exp. Psychol. Anim. Behav. Process.</italic></source> <volume>21</volume> <fpage>229</fpage>&#x2013;<lpage>247</lpage>. <pub-id pub-id-type="pmid">7602258</pub-id></citation></ref>
<ref id="B17"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Flaherty</surname> <given-names>C. F.</given-names></name> <name><surname>McCurdy</surname> <given-names>M. L.</given-names></name> <name><surname>Becker</surname> <given-names>H. C.</given-names></name> <name><surname>D&#x2019;Alessio</surname> <given-names>J.</given-names></name></person-group> (<year>1983</year>). <article-title>Incentive relativity effects reduced by exogenous insulin.</article-title> <source><italic>Physiol. Behav.</italic></source> <volume>30</volume> <fpage>639</fpage>&#x2013;<lpage>642</lpage>. <pub-id pub-id-type="pmid">6348814</pub-id></citation></ref>
<ref id="B18"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Groenewegen</surname> <given-names>H. J.</given-names></name> <name><surname>Berendse</surname> <given-names>H. W.</given-names></name> <name><surname>Wolters</surname> <given-names>J. G.</given-names></name> <name><surname>Lohman</surname> <given-names>A. H.</given-names></name></person-group> (<year>1990</year>). <article-title>The anatomical relationship of the prefrontal cortex with the striatopallidal system, the thalamus and the amygdala: evidence for a parallel organization.</article-title> <source><italic>Prog. Brain Res.</italic></source> <volume>85</volume> <fpage>95</fpage>&#x2013;<lpage>116</lpage>. <pub-id pub-id-type="pmid">2094917</pub-id></citation></ref>
<ref id="B19"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Haas</surname> <given-names>H. L.</given-names></name> <name><surname>Sergeeva</surname> <given-names>O. A.</given-names></name> <name><surname>Selbach</surname> <given-names>O.</given-names></name></person-group> (<year>2008</year>). <article-title>Histamine in the nervous system.</article-title> <source><italic>Physiol. Rev.</italic></source> <volume>88</volume> <fpage>1183</fpage>&#x2013;<lpage>1241</lpage>. <pub-id pub-id-type="doi">10.1152/physrev.00043.2007</pub-id> <pub-id pub-id-type="pmid">18626069</pub-id></citation></ref>
<ref id="B20"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hebb</surname> <given-names>D. O.</given-names></name></person-group> (<year>1955</year>). <article-title>Drives and the C.N.S. (conceptual nervous system).</article-title> <source><italic>Psychol. Rev.</italic></source> <volume>62</volume> <fpage>243</fpage>&#x2013;<lpage>254</lpage>. <pub-id pub-id-type="pmid">14395368</pub-id></citation></ref>
<ref id="B21"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hirata</surname> <given-names>A.</given-names></name> <name><surname>Castro-Alamancos</surname> <given-names>M. A.</given-names></name></person-group> (<year>2010</year>). <article-title>Neocortex network activation and deactivation states controlled by the thalamus.</article-title> <source><italic>J. Neurophysiol.</italic></source> <volume>103</volume> <fpage>1147</fpage>&#x2013;<lpage>1157</lpage>. <pub-id pub-id-type="doi">10.1152/jn.00955.2009</pub-id> <pub-id pub-id-type="pmid">20053845</pub-id></citation></ref>
<ref id="B22"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hong</surname> <given-names>Z.-Y.</given-names></name> <name><surname>Huang</surname> <given-names>Z.-L.</given-names></name> <name><surname>Qu</surname> <given-names>W.-M.</given-names></name> <name><surname>Eguchi</surname> <given-names>N.</given-names></name> <name><surname>Urade</surname> <given-names>Y.</given-names></name> <name><surname>Hayaishi</surname> <given-names>O.</given-names></name></person-group> (<year>2005</year>). <article-title>An adenosine a receptor agonist induces sleep by increasing GABA release in the tuberomammillary nucleus to inhibit histaminergic systems in rats.</article-title> <source><italic>J. Neurochem.</italic></source> <volume>92</volume> <fpage>1542</fpage>&#x2013;<lpage>1549</lpage>. <pub-id pub-id-type="doi">10.1111/j.1471-4159.2004.02991.x</pub-id> <pub-id pub-id-type="pmid">15748171</pub-id></citation></ref>
<ref id="B23"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hutson</surname> <given-names>P. H.</given-names></name> <name><surname>Dourish</surname> <given-names>C. T.</given-names></name> <name><surname>Curzon</surname> <given-names>G.</given-names></name></person-group> (<year>1986</year>). <article-title>Neurochemical and behavioural evidence for mediation of the hyperphagic action of 8-OH-DPAT by 5-HT cell body autoreceptors.</article-title> <source><italic>Eur. J. Pharmacol.</italic></source> <volume>129</volume> <fpage>347</fpage>&#x2013;<lpage>352</lpage>. <pub-id pub-id-type="pmid">2430815</pub-id></citation></ref>
<ref id="B24"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Inoue</surname> <given-names>I.</given-names></name> <name><surname>Yanai</surname> <given-names>K.</given-names></name> <name><surname>Kitamura</surname> <given-names>D.</given-names></name> <name><surname>Taniuchi</surname> <given-names>I.</given-names></name> <name><surname>Kobayashi</surname> <given-names>T.</given-names></name> <name><surname>Niimura</surname> <given-names>K.</given-names></name><etal/></person-group> (<year>1996</year>). <article-title>Impaired locomotor activity and exploratory behavior in mice lacking histamine H1 receptors.</article-title> <source><italic>Proc. Natl. Acad. Sci. U.S.A.</italic></source> <volume>93</volume> <fpage>13316</fpage>&#x2013;<lpage>13320</lpage>.</citation></ref>
<ref id="B25"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>John</surname> <given-names>J.</given-names></name> <name><surname>Kodama</surname> <given-names>T.</given-names></name> <name><surname>Siegel</surname> <given-names>J. M.</given-names></name></person-group> (<year>2014</year>). <article-title>Caffeine promotes glutamate and histamine release in the posterior hypothalamus.</article-title> <source><italic>Am. J. Physiol. Integr. Comp. Physiol.</italic></source> <volume>307</volume> <fpage>R704</fpage>&#x2013;<lpage>R710</lpage>. <pub-id pub-id-type="doi">10.1152/ajpregu.00114.2014</pub-id> <pub-id pub-id-type="pmid">25031227</pub-id></citation></ref>
<ref id="B26"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jones</surname> <given-names>B. E.</given-names></name></person-group> (<year>2003</year>). <article-title>Arousal systems.</article-title> <source><italic>Front. Biosci.</italic></source> <volume>8</volume> <fpage>s438</fpage>&#x2013;<lpage>s451</lpage>.</citation></ref>
<ref id="B27"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kinomura</surname> <given-names>S.</given-names></name> <name><surname>Larsson</surname> <given-names>J.</given-names></name> <name><surname>Guly&#x00E1;s</surname> <given-names>B.</given-names></name> <name><surname>Roland</surname> <given-names>P. E.</given-names></name></person-group> (<year>1996</year>). <article-title>Activation by attention of the human reticular formation and thalamic intralaminar nuclei.</article-title> <source><italic>Science</italic></source> <volume>271</volume> <fpage>512</fpage>&#x2013;<lpage>515</lpage>. <pub-id pub-id-type="pmid">8560267</pub-id></citation></ref>
<ref id="B28"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Koob</surname> <given-names>G. F.</given-names></name></person-group> (<year>2003</year>). <article-title>Alcoholism: allostasis and beyond.</article-title> <source><italic>Alcohol Clin. Exp. Res.</italic></source> <volume>27</volume> <fpage>232</fpage>&#x2013;<lpage>243</lpage>. <pub-id pub-id-type="doi">10.1097/01.ALC.0000057122.36127.C2</pub-id> <pub-id pub-id-type="pmid">12605072</pub-id></citation></ref>
<ref id="B29"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Levy</surname> <given-names>R.</given-names></name> <name><surname>Dubois</surname> <given-names>B.</given-names></name></person-group> (<year>2006</year>). <article-title>Apathy and the functional anatomy of the prefrontal cortex&#x2013;basal ganglia circuits.</article-title> <source><italic>Cereb. Cortex</italic></source> <volume>16</volume> <fpage>916</fpage>&#x2013;<lpage>928</lpage>. <pub-id pub-id-type="doi">10.1093/cercor/bhj043</pub-id> <pub-id pub-id-type="pmid">16207933</pub-id></citation></ref>
<ref id="B30"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Liu</surname> <given-names>J.</given-names></name> <name><surname>Lee</surname> <given-names>H. J.</given-names></name> <name><surname>Weitz</surname> <given-names>A. J.</given-names></name> <name><surname>Fang</surname> <given-names>Z.</given-names></name> <name><surname>Lin</surname> <given-names>P.</given-names></name> <name><surname>Choy</surname> <given-names>M.</given-names></name><etal/></person-group> (<year>2015</year>). <article-title>Frequency-selective control of cortical and subcortical networks by central thalamus.</article-title> <source><italic>eLife</italic></source> <volume>4</volume>:<issue>e09215</issue>. <pub-id pub-id-type="doi">10.7554/eLife.09215</pub-id> <pub-id pub-id-type="pmid">26652162</pub-id></citation></ref>
<ref id="B31"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mair</surname> <given-names>R. G.</given-names></name> <name><surname>Onos</surname> <given-names>K. D.</given-names></name> <name><surname>Hembrook</surname> <given-names>J. R.</given-names></name></person-group> (<year>2011</year>). <article-title>Cognitive activation by central thalamic stimulation: the yerkes-dodson law revisited.</article-title> <source><italic>Dose Response</italic></source> <volume>9</volume> <fpage>313</fpage>&#x2013;<lpage>331</lpage>. <pub-id pub-id-type="doi">10.2203/dose-response.10-017</pub-id> <pub-id pub-id-type="pmid">22013395</pub-id></citation></ref>
<ref id="B32"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Marcora</surname> <given-names>S. M.</given-names></name> <name><surname>Staiano</surname> <given-names>W.</given-names></name> <name><surname>Manning</surname> <given-names>V.</given-names></name></person-group> (<year>2009</year>). <article-title>Mental fatigue impairs physical performance in humans.</article-title> <source><italic>J. Appl. Physiol.</italic></source> <volume>106</volume> <fpage>857</fpage>&#x2013;<lpage>864</lpage>. <pub-id pub-id-type="doi">10.1152/japplphysiol.91324.2008</pub-id> <pub-id pub-id-type="pmid">19131473</pub-id></citation></ref>
<ref id="B33"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Marin</surname> <given-names>R. S.</given-names></name></person-group> (<year>1996</year>). <article-title>Apathy: concept, syndrome, neural mechanisms, and treatment.</article-title> <source><italic>Semin. Clin. Neuropsychiatry</italic></source> <volume>1</volume> <fpage>304</fpage>&#x2013;<lpage>314</lpage>. <pub-id pub-id-type="doi">10.1053/SCNP00100304</pub-id> <pub-id pub-id-type="pmid">10320433</pub-id></citation></ref>
<ref id="B34"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Meeusen</surname> <given-names>R.</given-names></name> <name><surname>Roelands</surname> <given-names>B.</given-names></name> <name><surname>Spriet</surname> <given-names>L. L.</given-names></name></person-group> (<year>2013</year>). <article-title>Caffeine, exercise and the brain.</article-title> <source><italic>Nestle Nutr. Inst. Workshop Ser.</italic></source> <volume>76</volume> <fpage>1</fpage>&#x2013;<lpage>12</lpage>. <pub-id pub-id-type="doi">10.1159/000350223</pub-id> <pub-id pub-id-type="pmid">23899750</pub-id></citation></ref>
<ref id="B35"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mingote</surname> <given-names>S.</given-names></name> <name><surname>Weber</surname> <given-names>S. M.</given-names></name> <name><surname>Ishiwari</surname> <given-names>K.</given-names></name> <name><surname>Correa</surname> <given-names>M.</given-names></name> <name><surname>Salamone</surname> <given-names>J. D.</given-names></name></person-group> (<year>2005</year>). <article-title>Ratio and time requirements on operant schedules: effort-related effects of nucleus accumbens dopamine depletions.</article-title> <source><italic>Eur. J. Neurosci.</italic></source> <volume>21</volume> <fpage>1749</fpage>&#x2013;<lpage>1757</lpage>. <pub-id pub-id-type="doi">10.1111/j.1460-9568.2005.03972.x</pub-id> <pub-id pub-id-type="pmid">15845103</pub-id></citation></ref>
<ref id="B36"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mochizuki</surname> <given-names>T.</given-names></name> <name><surname>Yamatodani</surname> <given-names>A.</given-names></name> <name><surname>Okakura</surname> <given-names>K.</given-names></name> <name><surname>Horii</surname> <given-names>A.</given-names></name> <name><surname>Inagaki</surname> <given-names>N.</given-names></name> <name><surname>Wada</surname> <given-names>H.</given-names></name></person-group> (<year>1992</year>). <article-title>Circadian rhythm of histamine release from the hypothalamus of freely moving rats.</article-title> <source><italic>Physiol. Behav.</italic></source> <volume>51</volume> <fpage>391</fpage>&#x2013;<lpage>394</lpage>.</citation></ref>
<ref id="B37"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Murakami</surname> <given-names>M.</given-names></name> <name><surname>Yoshikawa</surname> <given-names>T.</given-names></name> <name><surname>Nakamura</surname> <given-names>T.</given-names></name> <name><surname>Ohba</surname> <given-names>T.</given-names></name> <name><surname>Matsuzaki</surname> <given-names>Y.</given-names></name> <name><surname>Sawamura</surname> <given-names>D.</given-names></name><etal/></person-group> (<year>2015</year>). <article-title>Involvement of the histamine H1 receptor in the regulation of sympathetic nerve activity.</article-title> <source><italic>Biochem. Biophys. Res. Commun.</italic></source> <volume>458</volume> <fpage>584</fpage>&#x2013;<lpage>589</lpage>. <pub-id pub-id-type="doi">10.1016/j.bbrc.2015.02.009</pub-id> <pub-id pub-id-type="pmid">25680462</pub-id></citation></ref>
<ref id="B38"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Murray</surname> <given-names>N. P.</given-names></name> <name><surname>Russoniello</surname> <given-names>C.</given-names></name></person-group> (<year>2012</year>). <article-title>Acute physical activity on cognitive function: a heart rate variability examination.</article-title> <source><italic>Appl. Psychophysiol. Biofeedback</italic></source> <volume>37</volume> <fpage>219</fpage>&#x2013;<lpage>227</lpage>. <pub-id pub-id-type="doi">10.1007/s10484-012-9196-z</pub-id> <pub-id pub-id-type="pmid">22543813</pub-id></citation></ref>
<ref id="B39"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ong&#x00FC;r</surname> <given-names>D.</given-names></name> <name><surname>Price</surname> <given-names>J. L.</given-names></name></person-group> (<year>2000</year>). <article-title>The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans.</article-title> <source><italic>Cereb. Cortex</italic></source> <volume>10</volume> <fpage>206</fpage>&#x2013;<lpage>219</lpage>. <pub-id pub-id-type="pmid">10731217</pub-id></citation></ref>
<ref id="B40"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pageaux</surname> <given-names>B.</given-names></name> <name><surname>Marcora</surname> <given-names>S. M.</given-names></name> <name><surname>Rozand</surname> <given-names>V.</given-names></name> <name><surname>Lepers</surname> <given-names>R.</given-names></name></person-group> (<year>2015</year>). <article-title>Mental fatigue induced by prolonged self-regulation does not exacerbate central fatigue during subsequent whole-body endurance exercise.</article-title> <source><italic>Front. Hum. Neurosci.</italic></source> <volume>9</volume>:<issue>67</issue>. <pub-id pub-id-type="doi">10.3389/fnhum.2015.00067</pub-id> <pub-id pub-id-type="pmid">25762914</pub-id></citation></ref>
<ref id="B41"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Panula</surname> <given-names>P.</given-names></name> <name><surname>Nuutinen</surname> <given-names>S.</given-names></name></person-group> (<year>2013</year>). <article-title>The histaminergic network in the brain: basic organization and role in disease.</article-title> <source><italic>Nat. Rev. Neurosci.</italic></source> <volume>14</volume> <fpage>472</fpage>&#x2013;<lpage>487</lpage>. <pub-id pub-id-type="doi">10.1038/nrn3526</pub-id> <pub-id pub-id-type="pmid">23783198</pub-id></citation></ref>
<ref id="B42"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pardini</surname> <given-names>M.</given-names></name> <name><surname>Krueger</surname> <given-names>F.</given-names></name> <name><surname>Raymont</surname> <given-names>V.</given-names></name> <name><surname>Grafman</surname> <given-names>J.</given-names></name></person-group> (<year>2010</year>). <article-title>Ventromedial prefrontal cortex modulates fatigue after penetrating traumatic brain injury.</article-title> <source><italic>Neurology</italic></source> <volume>74</volume> <fpage>749</fpage>&#x2013;<lpage>754</lpage>. <pub-id pub-id-type="doi">10.1212/WNL.0b013e3181d25b6b</pub-id> <pub-id pub-id-type="pmid">20194914</pub-id></citation></ref>
<ref id="B43"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pardo</surname> <given-names>M.</given-names></name> <name><surname>Lopez-Cruz</surname> <given-names>L.</given-names></name> <name><surname>Valverde</surname> <given-names>O.</given-names></name> <name><surname>Ledent</surname> <given-names>C.</given-names></name> <name><surname>Baqi</surname> <given-names>Y.</given-names></name> <name><surname>M&#x00FC;ller</surname> <given-names>C. E.</given-names></name><etal/></person-group> (<year>2012</year>). <article-title>Adenosine A2A receptor antagonism and genetic deletion attenuate the effects of dopamine D2 antagonism on effort-based decision making in mice.</article-title> <source><italic>Neuropharmacology</italic></source> <volume>62</volume> <fpage>2068</fpage>&#x2013;<lpage>2077</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuropharm.2011.12.033</pub-id> <pub-id pub-id-type="pmid">22261384</pub-id></citation></ref>
<ref id="B44"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pierce</surname> <given-names>R. C.</given-names></name> <name><surname>Kalivas</surname> <given-names>P. W.</given-names></name></person-group> (<year>1997</year>). <article-title>A circuitry model of the expression of behavioral sensitization to amphetamine-like psychostimulants.</article-title> <source><italic>Brain Res. Brain Res. Rev.</italic></source> <volume>25</volume> <fpage>192</fpage>&#x2013;<lpage>216</lpage>. <pub-id pub-id-type="pmid">9403138</pub-id></citation></ref>
<ref id="B45"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Riveros</surname> <given-names>M. E.</given-names></name> <name><surname>Forray</surname> <given-names>M. I.</given-names></name> <name><surname>Torrealba</surname> <given-names>F.</given-names></name></person-group> (<year>2015</year>). <article-title>Infralimbic cortex activation and motivated arousal induce histamine release.</article-title> <source><italic>Behav. Pharmacol.</italic></source> <volume>26</volume> <fpage>338</fpage>&#x2013;<lpage>344</lpage>. <pub-id pub-id-type="doi">10.1097/FBP.0000000000000129</pub-id> <pub-id pub-id-type="pmid">25746330</pub-id></citation></ref>
<ref id="B46"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Riveros</surname> <given-names>M. E.</given-names></name> <name><surname>Perdomo</surname> <given-names>G.</given-names></name> <name><surname>Torrealba</surname> <given-names>F.</given-names></name></person-group> (<year>2014</year>). <article-title>Infralimbic cortex controls core body temperature in a histamine dependent manner.</article-title> <source><italic>Physiol. Behav.</italic></source> <volume>128</volume> <fpage>1</fpage>&#x2013;<lpage>8</lpage>. <pub-id pub-id-type="doi">10.1016/j.physbeh.2014.01.011</pub-id> <pub-id pub-id-type="pmid">24480074</pub-id></citation></ref>
<ref id="B47"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Robbins</surname> <given-names>T. W.</given-names></name> <name><surname>Cador</surname> <given-names>M.</given-names></name> <name><surname>Taylor</surname> <given-names>J. R.</given-names></name> <name><surname>Everitt</surname> <given-names>B. J.</given-names></name></person-group> (<year>1989</year>). <article-title>Limbic&#x2013;striatal interactions in reward-related processes.</article-title> <source><italic>Neurosci. Biobehav. Rev.</italic></source> <volume>13</volume> <fpage>155</fpage>&#x2013;<lpage>162</lpage>.</citation></ref>
<ref id="B48"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Robert</surname> <given-names>P. H.</given-names></name> <name><surname>Mulin</surname> <given-names>E.</given-names></name> <name><surname>Mall&#x00E9;a</surname> <given-names>P.</given-names></name> <name><surname>David</surname> <given-names>R.</given-names></name></person-group> (<year>2010</year>). <article-title>Review: apathy diagnosis, assessment, and treatment in Alzheimer&#x2019;s disease.</article-title> <source><italic>CNS Neurosci. Ther.</italic></source> <volume>16</volume> <fpage>263</fpage>&#x2013;<lpage>271</lpage>. <pub-id pub-id-type="doi">10.1111/j.1755-5949.2009.00132.x</pub-id> <pub-id pub-id-type="pmid">20345973</pub-id></citation></ref>
<ref id="B49"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Salamone</surname> <given-names>J. D.</given-names></name> <name><surname>Correa</surname> <given-names>M.</given-names></name> <name><surname>Farrar</surname> <given-names>A.</given-names></name> <name><surname>Mingote</surname> <given-names>S. M.</given-names></name></person-group> (<year>2007</year>). <article-title>Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits.</article-title> <source><italic>Psychopharmacology</italic></source> <volume>191</volume> <fpage>461</fpage>&#x2013;<lpage>482</lpage>. <pub-id pub-id-type="doi">10.1007/s00213-006-0668-9</pub-id> <pub-id pub-id-type="pmid">17225164</pub-id></citation></ref>
<ref id="B50"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Salamone</surname> <given-names>J. D.</given-names></name> <name><surname>Correa</surname> <given-names>M.</given-names></name> <name><surname>Nunes</surname> <given-names>E. J.</given-names></name> <name><surname>Randall</surname> <given-names>P. A.</given-names></name> <name><surname>Pardo</surname> <given-names>M.</given-names></name></person-group> (<year>2012</year>). <article-title>The behavioral pharmacology of effort-related choice behavior: dopamine, adenosine and beyond.</article-title> <source><italic>J. Exp. Anal. Behav.</italic></source> <volume>97</volume> <fpage>125</fpage>&#x2013;<lpage>146</lpage>. <pub-id pub-id-type="doi">10.1901/jeab.2012.97-125</pub-id> <pub-id pub-id-type="pmid">22287808</pub-id></citation></ref>
<ref id="B51"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Salamone</surname> <given-names>J. D.</given-names></name> <name><surname>Farrar</surname> <given-names>A. M.</given-names></name> <name><surname>Font</surname> <given-names>L.</given-names></name> <name><surname>Patel</surname> <given-names>V.</given-names></name> <name><surname>Schlar</surname> <given-names>D. E.</given-names></name> <name><surname>Nunes</surname> <given-names>E. J.</given-names></name><etal/></person-group> (<year>2009</year>). <article-title>Differential actions of adenosine A1 and A2A antagonists on the effort-related effects of dopamine D2 antagonism.</article-title> <source><italic>Behav. Brain Res.</italic></source> <volume>201</volume> <fpage>216</fpage>&#x2013;<lpage>222</lpage>. <pub-id pub-id-type="doi">10.1016/j.bbr.2009.02.021</pub-id> <pub-id pub-id-type="pmid">19428636</pub-id></citation></ref>
<ref id="B52"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Salamone</surname> <given-names>J. D.</given-names></name> <name><surname>Wisniecki</surname> <given-names>A.</given-names></name> <name><surname>Carlson</surname> <given-names>B. B.</given-names></name> <name><surname>Correa</surname> <given-names>M.</given-names></name></person-group> (<year>2001</year>). <article-title>Nucleus accumbens dopamine depletions make animals highly sensitive to high fixed ratio requirements but do not impair primary food reinforcement.</article-title> <source><italic>Neuroscience</italic></source> <volume>105</volume> <fpage>863</fpage>&#x2013;<lpage>870</lpage>. <pub-id pub-id-type="pmid">11530224</pub-id></citation></ref>
<ref id="B53"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Scull</surname> <given-names>J.</given-names></name> <name><surname>Davies</surname> <given-names>K.</given-names></name> <name><surname>Amsel</surname> <given-names>A.</given-names></name></person-group> (<year>1970</year>). <article-title>Behavioral contrast and frustration effect in multiple and mixed fixed-interval schedules in ther rat.</article-title> <source><italic>J. Comp. Physiol. Psychol.</italic></source> <volume>71</volume> <fpage>478</fpage>&#x2013;<lpage>483</lpage>. <pub-id pub-id-type="pmid">5480880</pub-id></citation></ref>
<ref id="B54"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sokolowski</surname> <given-names>J. D.</given-names></name> <name><surname>Salamone</surname> <given-names>J. D.</given-names></name></person-group> (<year>1998</year>). <article-title>The role of accumbens dopamine in lever pressing and response allocation: effects of 6-OHDA injected into core and dorsomedial shell.</article-title> <source><italic>Pharmacol. Biochem. Behav.</italic></source> <volume>59</volume> <fpage>557</fpage>&#x2013;<lpage>566</lpage>. <pub-id pub-id-type="pmid">9512057</pub-id></citation></ref>
<ref id="B55"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Swanson</surname> <given-names>L. W.</given-names></name></person-group> (<year>1998</year>). <source><italic>Brain Maps: Structure of the Rat Brain?: A Laboratory Guide with Printed and Electronic Templates for data, Models, and Schematics</italic>.</source> <publisher-loc>Amsterdam</publisher-loc>: <publisher-name>Elsevier</publisher-name>.</citation></ref>
<ref id="B56"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Takahashi</surname> <given-names>K.</given-names></name> <name><surname>Lin</surname> <given-names>J.-S.</given-names></name> <name><surname>Sakai</surname> <given-names>K.</given-names></name></person-group> (<year>2006</year>). <article-title>Neuronal activity of histaminergic tuberomammillary neurons during wake&#x2013;sleep states in the mouse.</article-title> <source><italic>J. Neurosci.</italic></source> <volume>26</volume> <fpage>10292</fpage>&#x2013;<lpage>10298</lpage>. <pub-id pub-id-type="doi">10.1523/JNEUROSCI.2341-06.2006</pub-id></citation></ref>
<ref id="B57"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Torrealba</surname> <given-names>F.</given-names></name> <name><surname>Riveros</surname> <given-names>M. E.</given-names></name> <name><surname>Contreras</surname> <given-names>M.</given-names></name> <name><surname>Valdes</surname> <given-names>J. L.</given-names></name></person-group> (<year>2012</year>). <article-title>Histamine and motivation.</article-title> <source><italic>Front. Syst. Neurosci.</italic></source> <volume>6</volume>:<issue>51</issue>. <pub-id pub-id-type="doi">10.3389/fnsys.2012.00051</pub-id></citation></ref>
<ref id="B58"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Vald&#x00E9;s</surname> <given-names>J. L.</given-names></name> <name><surname>Far&#x00ED;as</surname> <given-names>P.</given-names></name> <name><surname>Ocampo-Garc&#x00E9;s</surname> <given-names>A.</given-names></name> <name><surname>Cort&#x00E9;s</surname> <given-names>N.</given-names></name> <name><surname>Ser&#x00F3;n-Ferr&#x00E9;</surname> <given-names>M.</given-names></name> <name><surname>Torrealba</surname> <given-names>F.</given-names></name></person-group> (<year>2005</year>). <article-title>Arousal and differential Fos expression in histaminergic neurons of the ascending arousal system during a feeding-related motivated behaviour.</article-title> <source><italic>Eur. J. Neurosci.</italic></source> <volume>21</volume> <fpage>1931</fpage>&#x2013;<lpage>1942</lpage>. <pub-id pub-id-type="doi">10.1111/j.1460-9568.2005.04013.x</pub-id> <pub-id pub-id-type="pmid">15869486</pub-id></citation></ref>
<ref id="B59"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Vald&#x00E9;s</surname> <given-names>J. L.</given-names></name> <name><surname>Maldonado</surname> <given-names>P.</given-names></name> <name><surname>Recabarren</surname> <given-names>M.</given-names></name> <name><surname>Fuentes</surname> <given-names>R.</given-names></name> <name><surname>Torrealba</surname> <given-names>F.</given-names></name></person-group> (<year>2006</year>). <article-title>The infralimbic cortical area commands the behavioral and vegetative arousal during appetitive behavior in the rat.</article-title> <source><italic>Eur. J. Neurosci.</italic></source> <volume>23</volume> <fpage>1352</fpage>&#x2013;<lpage>1364</lpage>. <pub-id pub-id-type="doi">10.1111/j.1460-9568.2006.04659.x</pub-id> <pub-id pub-id-type="pmid">16553796</pub-id></citation></ref>
<ref id="B60"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Vald&#x00E9;s</surname> <given-names>J. L.</given-names></name> <name><surname>S&#x00E1;nchez</surname> <given-names>C.</given-names></name> <name><surname>Riveros</surname> <given-names>M. E.</given-names></name> <name><surname>Blandina</surname> <given-names>P.</given-names></name> <name><surname>Contreras</surname> <given-names>M.</given-names></name> <name><surname>Far&#x00ED;as</surname> <given-names>P.</given-names></name><etal/></person-group> (<year>2010</year>). <article-title>The histaminergic tuberomammillary nucleus is critical for motivated arousal.</article-title> <source><italic>Eur. J. Neurosci.</italic></source> <volume>31</volume> <fpage>2073</fpage>&#x2013;<lpage>2085</lpage>. <pub-id pub-id-type="doi">10.1111/j.1460-9568.2010.07241.x</pub-id> <pub-id pub-id-type="pmid">20529118</pub-id></citation></ref>
<ref id="B61"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Vertes</surname> <given-names>R. P.</given-names></name></person-group> (<year>2004</year>). <article-title>Differential projections of the infralimbic and prelimbic cortex in the rat.</article-title> <source><italic>Synapse</italic></source> <volume>51</volume> <fpage>32</fpage>&#x2013;<lpage>58</lpage>. <pub-id pub-id-type="doi">10.1002/syn.10279</pub-id> <pub-id pub-id-type="pmid">14579424</pub-id></citation></ref>
<ref id="B62"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Walton</surname> <given-names>M. E.</given-names></name> <name><surname>Bannerman</surname> <given-names>D. M.</given-names></name> <name><surname>Rushworth</surname> <given-names>M. F. S.</given-names></name></person-group> (<year>2002</year>). <article-title>The role of rat medial frontal cortex in effort-based decision making.</article-title> <source><italic>J. Neurosci.</italic></source> <volume>22</volume> <fpage>10996</fpage>&#x2013;<lpage>11003</lpage>.</citation></ref>
<ref id="B63"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wouterlood</surname> <given-names>F. G.</given-names></name> <name><surname>Steinbusch</surname> <given-names>H. W.</given-names></name> <name><surname>Luiten</surname> <given-names>P. G.</given-names></name> <name><surname>Bol</surname> <given-names>J. G.</given-names></name></person-group> (<year>1987</year>). <article-title>Projection from the prefrontal cortex to histaminergic cell groups in the posterior hypothalamic region of the rat. Anterograde tracing with Phaseolus vulgaris leucoagglutinin combined with immunocytochemistry of histidine decarboxylase.</article-title> <source><italic>Brain Res.</italic></source> <volume>406</volume> <fpage>330</fpage>&#x2013;<lpage>336</lpage>. <pub-id pub-id-type="pmid">3032360</pub-id></citation></ref>
<ref id="B64"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yerkes</surname> <given-names>R. M.</given-names></name> <name><surname>Dodson</surname> <given-names>J. D.</given-names></name></person-group> (<year>1908</year>). <article-title>The relation of strength of stimulus to rapidity of habit-formation.</article-title> <source><italic>J. Comp. Neurol. Psychol.</italic></source> <volume>18</volume> <fpage>459</fpage>&#x2013;<lpage>482</lpage>. <pub-id pub-id-type="doi">10.1002/cne.920180503</pub-id></citation></ref>
<ref id="B65"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zahm</surname> <given-names>D. S.</given-names></name></person-group> (<year>2000</year>). <article-title>An integrative neuroanatomical perspective on some subcortical substrates of adaptive responding with emphasis on the nucleus accumbens.</article-title> <source><italic>Neurosci. Biobehav. Rev.</italic></source> <volume>24</volume> <fpage>85</fpage>&#x2013;<lpage>105</lpage>. <pub-id pub-id-type="pmid">10654664</pub-id></citation></ref>
</ref-list>
</back>
</article>