<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" article-type="review-article" dtd-version="2.3" xml:lang="EN">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Neurosci.</journal-id>
<journal-title>Frontiers in Neuroscience</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Neurosci.</abbrev-journal-title>
<issn pub-type="epub">1662-453X</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fnins.2024.1517231</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Neuroscience</subject>
<subj-group>
<subject>Review</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>The amygdala and the pursuit of future rewards</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name><surname>Johnson</surname> <given-names>S. Tobias</given-names></name>
<uri xlink:href="https://loop.frontiersin.org/people/2911554/overview"/>
<role content-type="https://credit.niso.org/contributor-roles/conceptualization/"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-original-draft/"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-review-editing/"/>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>Grabenhorst</surname> <given-names>Fabian</given-names></name>
<xref ref-type="corresp" rid="c001"><sup>&#x002A;</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/2878524/overview"/>
<role content-type="https://credit.niso.org/contributor-roles/conceptualization/"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-original-draft/"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-review-editing/"/>
</contrib>
</contrib-group>
<aff><institution>Department of Experimental Psychology, University of Oxford</institution>, <addr-line>Oxford</addr-line>, <country>United Kingdom</country></aff>
<author-notes>
<fn fn-type="edited-by" id="fn0001">
<p>Edited by: Manuela Sellitto, University of Pavia, Italy</p>
</fn>
<fn fn-type="edited-by" id="fn0002">
<p>Reviewed by: Ludise Malkova, Georgetown University, United States</p>
<p>Valeria Gonzalez, Reed College, United States</p>
</fn>
<corresp id="c001">&#x002A;Correspondence: Fabian Grabenhorst, <email>fabian.grabenhorst@psy.ox.ac.uk</email></corresp>
</author-notes>
<pub-date pub-type="epub">
<day>22</day>
<month>01</month>
<year>2025</year>
</pub-date>
<pub-date pub-type="collection">
<year>2024</year>
</pub-date>
<volume>18</volume>
<elocation-id>1517231</elocation-id>
<history>
<date date-type="received">
<day>25</day>
<month>10</month>
<year>2024</year>
</date>
<date date-type="accepted">
<day>27</day>
<month>12</month>
<year>2024</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2025 Johnson and Grabenhorst.</copyright-statement>
<copyright-year>2025</copyright-year>
<copyright-holder>Johnson and Grabenhorst</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p>
</license>
</permissions>
<abstract>
<p>The successful pursuit of future rewards requires forming an internal goal, followed by planning, decision-making, and progress-tracking over multiple steps. The initial step&#x2014;forming goals and the plans for obtaining them&#x2014;involves the subjective valuation of an anticipated reward, considering both the reward&#x2019;s properties and associated delay and physical-effort costs. Recent findings indicate individuals similarly evaluate cognitive effort over time (<xref ref-type="bibr" rid="ref62">Johnson and Most, 2023</xref>). Success and failure in these processes have been linked to differential life outcomes and psychiatric conditions. Here we review evidence from single-neuron recordings and neuroimaging studies that implicate the amygdala&#x2014;a brain structure long associated with cue-reactivity and emotion&#x2014;in decision-making and the planned pursuit of future rewards (<xref ref-type="bibr" rid="ref42">Grabenhorst et al., 2012</xref>, <xref ref-type="bibr" rid="ref43">2016</xref>, <xref ref-type="bibr" rid="ref41">2019</xref>, <xref ref-type="bibr" rid="ref44">2023</xref>;<xref ref-type="bibr" rid="ref53">Hernadi et al., 2015</xref>;<xref ref-type="bibr" rid="ref135">Zangemeister et al., 2016</xref>). The main findings are that, in behavioral tasks in which future rewards can be pursued through planning and stepwise decision-making, amygdala neurons prospectively encode the value of anticipated rewards and related behavioral plans. Moreover, amygdala neurons predict the stepwise choices to pursue these rewards, signal progress toward goals, and distinguish internally generated (i.e., self-determined) choices from externally imposed actions. Importantly, amygdala neurons integrate the subjective value of a future reward with delay and effort costs inherent in pursuing it. This neural evidence identifies three key computations of the primate amygdala that underlie the pursuit of future rewards: (1) forming a self-determined internal goal based on subjective reward-cost valuations, (2) defining a behavioral plan for obtaining the goal, (3) executing this plan through stepwise decision-making and progress-tracking. Based on this framework, we suggest that amygdala neurons constitute vulnerabilities for dysfunction that contribute to maladaptive reward pursuit in psychiatric and behavioral conditions. Consequently, amygdala neurons may also represent potential targets for behavioral-change interventions that aim to improve individual decision-making.</p>
</abstract>
<kwd-group>
<kwd>amygdala</kwd>
<kwd>reward</kwd>
<kwd>temporal discounting</kwd>
<kwd>effort</kwd>
<kwd>depression</kwd>
<kwd>goal pursuit</kwd>
<kwd>planning</kwd>
</kwd-group>
<contract-sponsor id="cn1">Wellcome Trust<named-content content-type="fundref-id">10.13039/100010269</named-content></contract-sponsor>
<contract-sponsor id="cn2">Royal Society<named-content content-type="fundref-id">10.13039/501100000288</named-content></contract-sponsor>
<contract-sponsor id="cn3">Royal Society<named-content content-type="fundref-id">10.13039/501100000288</named-content></contract-sponsor>
<counts>
<fig-count count="6"/>
<table-count count="1"/>
<equation-count count="0"/>
<ref-count count="136"/>
<page-count count="14"/>
<word-count count="12391"/>
</counts>
<custom-meta-wrap>
<custom-meta>
<meta-name>section-at-acceptance</meta-name>
<meta-value>Decision Neuroscience</meta-value>
</custom-meta>
</custom-meta-wrap>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="sec1">
<title>Introduction</title>
<p>The best rewards are often distant and can only be obtained by prospective (i.e., future-oriented) valuation of goals, planning and decision-making over several steps, and the tracking of progress toward a goal. Some future rewards can be obtained over shorter timescales, such as planning a restaurant visit in the evening to consume a desired food. However, many rewards are much more distant and require planning and persistence over longer timescales, including economic saving, achieving physical or mental health outcomes, pursuing an academic degree, or finding one&#x2019;s ideal partner. What neural mechanisms underlie the pursuit of future rewards? What information is encoded by neurons in the brain&#x2019;s reward system when an individual forms a goal and pursues it through planning and decision-making? We argue that investigating these neurophysiological mechanisms can validate or challenge psychological conceptions of goal pursuit and advance understanding of psychiatric and behavioral conditions in which this the pursuit of future rewards is impaired.</p>
<p>Psychological and behavioral-economic theories identify two key principles for planned reward-guided behaviors (<xref ref-type="bibr" rid="ref79">Miller et al., 1960</xref>; <xref ref-type="bibr" rid="ref38">Gollwitzer, 1993</xref>; <xref ref-type="bibr" rid="ref31">Dickinson and Balleine, 1994</xref>; <xref ref-type="bibr" rid="ref125">Sutton and Barto, 1998</xref>; <xref ref-type="bibr" rid="ref16">Benhabib and Bisin, 2005</xref>; <xref ref-type="bibr" rid="ref18">Berkman and Lieberman, 2009</xref>): the initial formation of a goal based on subjective reward and cost valuations, and the pursuit of this goal through planning, decision-making and progress-tracking. The valuation step is complex, as it requires an individual to consider the rewarding properties of a potential goal (e.g., its magnitude, desirable sensory qualities, relevance to one&#x2019;s long-term values) and its associated costs (e.g., the delay, physical and cognitive effort required for obtaining it), and evaluating these factors based on subjective preferences and aversions.</p>
<p>Success and failure in the component process underlying the pursuit of future rewards have been linked to differential health outcomes, well-being, and specific psychiatric and behavioral conditions (<xref ref-type="bibr" rid="ref12">Bechara, 2005</xref>; <xref ref-type="bibr" rid="ref25">Casey et al., 2011</xref>; <xref ref-type="bibr" rid="ref20">Bickel et al., 2012</xref>; <xref ref-type="bibr" rid="ref68">Korn et al., 2014</xref>; <xref ref-type="bibr" rid="ref37">Gillan et al., 2020</xref>). Accordingly, behavioral-change interventions to improve physical and mental health target the formation of resilient internal goals and the commitment to pursuing them (<xref ref-type="bibr" rid="ref39">Gollwitzer and Schaal, 1998</xref>; <xref ref-type="bibr" rid="ref30">Diamond and Lee, 2011</xref>; <xref ref-type="bibr" rid="ref14">Belanger-Gravel et al., 2013</xref>; <xref ref-type="bibr" rid="ref33">Duckworth et al., 2013</xref>; <xref ref-type="bibr" rid="ref78">Michie et al., 2013</xref>; <xref ref-type="bibr" rid="ref114">Sheeran et al., 2013</xref>; <xref ref-type="bibr" rid="ref110">Scholten et al., 2019</xref>). For example, &#x2018;mental contrasting&#x2019; involves imagining both the positive outcomes of a distant goal and possible obstacles to achieving the goal (<xref ref-type="bibr" rid="ref33">Duckworth et al., 2013</xref>). Such interventions are designed to strengthen an individual&#x2019;s capacities for successful pursuit of long-term goals. These capacities are constrained by the effort and delay involved in goal achievement, as well as inconsistencies in evaluating these cost factors (<xref ref-type="bibr" rid="ref4">Ainslie and Herrnstein, 1981</xref>; <xref ref-type="bibr" rid="ref62">Johnson and Most, 2023</xref>).</p>
<p>Here, we review recent advances in understanding the neurophysiological basis for the pursuit of future rewards in one of the key brain areas implicated in reward and decision-making: the primate amygdala. We first summarize the amygdala&#x2019;s anatomical organization and its functions. We then discuss psychological and behavioral-economic conceptions of goal formation and planned behavior, and introduce evidence on delay and effort cost valuation. These considerations identify some of the key processes that might be encoded by neural systems during planned reward-directed behavior. Next, we review findings from single-neuron recordings in the amygdala of monkeys performing a reward-based economic saving task, and from related human neuroimaging studies. These studies show that amygdala neurons encode internally determined goals for future rewards and the decisions and plans for obtaining them. Finally, we discuss how prospective amygdala signals may constitute vulnerabilities for dysfunction in psychiatric and behavioral conditions, and targets for interventions aiming for behavioral change. <xref ref-type="table" rid="tab1">Table 1</xref> summarizes our neuronal framework for the pursuit of future rewards, based on identified neural signals in the primate amygdala, and its implications for understanding related dysfunction and for conceptualizing behavioral interventions in terms of neural mechanisms.</p>
<table-wrap position="float" id="tab1">
<label>Table 1</label>
<caption>
<p>Neuronal framework for the pursuit of future rewards, vulnerabilities for dysfunction, and targets for behavioral interventions affecting neuronal signals.</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left" valign="top">Neuronal signals in primate amygdala</th>
<th align="left" valign="top">Properties of neural signals and proposed functions</th>
<th align="left" valign="top">Potential vulnerability, intervention target</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top">Sequence value (<xref ref-type="bibr" rid="ref53">Hernadi et al., 2015</xref>; <xref ref-type="bibr" rid="ref135">Zangemeister et al., 2016</xref>)</td>
<td align="left" valign="top">Properties: reflects subjective goal valuation based on future reward attributes, delay and effort costs; often specific for self-determined behavior; fluctuates with performance errors<break/>Functions: initial goal selection based on value; guides plan formation and reward expectation, arousal, attention during goal pursuit</td>
<td align="left" valign="top">Vulnerability: failure to integrate reward attributes, delay and effort costs based on subjective value; goals may be unrealistic, low-valued, or overly ambitious<break/>Intervention target: direct attention away from costs of distant goals toward their rewarding components to strengthen resilience of sequence-value signals and reduce likelihood of temporary-preference formation; e.g., enjoyment of cognitive effort may buffer against dynamic inconsistency (<xref ref-type="bibr" rid="ref62">Johnson and Most, 2023</xref>)</td>
</tr>
<tr>
<td align="left" valign="top">Sequence length (<xref ref-type="bibr" rid="ref53">Hernadi et al., 2015</xref>; <xref ref-type="bibr" rid="ref135">Zangemeister et al., 2016</xref>)</td>
<td align="left" valign="top">Properties: reflects length of planned choice sequence; often specific for self-determined behavior; fluctuates with performance errors<break/>Functions: translates goal into behavioral plan to achieve the goal, guides progress-tracking and step-by-step choices</td>
<td align="left" valign="top">Vulnerability: failure to form appropriate behavioral plan to obtain selected goal; breakdown of plan signal during goal pursuit<break/>Intervention target: division of long-term goals into sub-goals, thereby promote sequence-length neurons to encode shorter-term plans to achieve sub-goals; supportive strategies at times of error could stabilize sequence-length encoding</td>
</tr>
<tr>
<td align="left" valign="top">Save-spend choice (<xref ref-type="bibr" rid="ref42">Grabenhorst et al., 2012</xref>)</td>
<td align="left" valign="top">Properties: reflects save-spend choice at choice points within a planned behavioral sequence; often specific for self-determined behavior<break/>Functions: guides current-step choice (immediate vs. distant reward) in accordance with plan and final goal</td>
<td align="left" valign="top">Vulnerability: failure to select single-step choice in alignment with current goal and plan<break/>Intervention target: change single-step choices through support at critical choice points; top-down influences based on more resilient goals, mental contrasting and other goal setting strategies solidify final goals values to bias save-choice neurons, reducing likelihood of premature goal abandonment</td>
</tr>
<tr>
<td align="left" valign="top">Sequence progress (<xref ref-type="bibr" rid="ref43">Grabenhorst et al., 2016</xref>)</td>
<td align="left" valign="top">Properties: reflects current progress in choice sequence toward final goal; adapts to planned final sequence length; often specific for self-determined behavior; fluctuates with performance errors<break/>Functions: monitoring of progress toward goal to guide step-by-step choices</td>
<td align="left" valign="top">Vulnerability: breakdown of progress-tracking could lead to premature goal abandonment<break/>Intervention target: develop methods of tracking progress toward distant goals such as regular performance measurements, or daily trackers to stabilize progress-tracking and ensure progress is scaled to reflect final reward goal to prevent goal abandonment; lower the gain (i.e., slope) of amygdala progress signals to enhance &#x2018;patience&#x2019;; supportive strategies at times of error could stabilize sequence-progress encoding</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="sec2">
<title>The primate amygdala: overview of structure and function</title>
<p>The amygdala, a cell complex located in the anterior-medial temporal lobe (<xref ref-type="fig" rid="fig1">Figure 1A</xref>), has long been associated with mediating emotional reactions to sensory cues (<xref ref-type="bibr" rid="ref102">Rolls, 2000</xref>; <xref ref-type="bibr" rid="ref11">Baxter and Murray, 2002</xref>; <xref ref-type="bibr" rid="ref24">Cardinal et al., 2002</xref>; <xref ref-type="bibr" rid="ref73">Maren and Quirk, 2004</xref>; <xref ref-type="bibr" rid="ref8">Balleine and Killcross, 2006</xref>; <xref ref-type="bibr" rid="ref83">Murray, 2007</xref>; <xref ref-type="bibr" rid="ref36">Ghods-Sharifi et al., 2009</xref>; <xref ref-type="bibr" rid="ref81">Morrison and Salzman, 2010</xref>; <xref ref-type="bibr" rid="ref60">Johansen et al., 2011</xref>; <xref ref-type="bibr" rid="ref58">Janak and Tye, 2015</xref>; <xref ref-type="bibr" rid="ref40">Gothard, 2020</xref>; <xref ref-type="bibr" rid="ref99">Pujara et al., 2022</xref>). However, recent findings also implicate primate amygdala neurons in more complex cognitive functions, including the pursuit of future rewards through economic, value-based decision-making and planning (<xref ref-type="bibr" rid="ref42">Grabenhorst et al., 2012</xref>; <xref ref-type="bibr" rid="ref53">Hernadi et al., 2015</xref>; <xref ref-type="bibr" rid="ref43">Grabenhorst et al., 2016</xref>; <xref ref-type="bibr" rid="ref41">Grabenhorst et al., 2019</xref>; <xref ref-type="bibr" rid="ref48">Grabenhorst and Schultz, 2021</xref>; <xref ref-type="bibr" rid="ref44">Grabenhorst et al., 2023</xref>).</p>
<fig position="float" id="fig1">
<label>Figure 1</label>
<caption>
<p>Primate amygdala anatomy and connectivity. <bold>(A)</bold> Location of the amygdala in the anterior-medial part of the temporal lobe of the primate brain (Macaca mulatta). <bold>(B)</bold> Schematic overlaid on a cresyl-violet stained macaque coronal brain slice illustrating major amygdala nuclear subdivisions considered in this review, and some of their main input/output connections with simplified functional descriptions. Note that the sensory connections are typically bidirectional (<xref ref-type="bibr" rid="ref96">Price, 2003</xref>). Blue: lateral nucleus (LA); orange: basolateral (BL) and basomedial nuclei (BM); magenta: centromedial nucleus (Ce); green: cortical nucleus (Co); yellow: medial nuclei (Me). B: basal nucleus of Meynert; Cl: claustrum; ErC: entorhinal cortex; fSTS: fundus of the superior temporal sulcus; GP: globus pallidus; LV: lateral ventricle; OT: optic tract; PrC: perirhinal cortex. Nomenclature based on <xref ref-type="bibr" rid="ref91">Paxinos et al. (2000)</xref>.</p>
</caption>
<graphic xlink:href="fnins-18-1517231-g001.tif"/>
</fig>
<p>The primate (including human) amygdala is composed of several nuclei that vary in cell types, connections, and functions [for detailed reviews, see (<xref ref-type="bibr" rid="ref98">Price et al., 1987</xref>; <xref ref-type="bibr" rid="ref96">Price, 2003</xref>; <xref ref-type="bibr" rid="ref112">Schumann et al., 2016</xref>)]. In a simplified view (<xref ref-type="fig" rid="fig1">Figure 1B</xref>), the lateral nucleus can be conceptualized as the amygdala&#x2019;s entry point for sensory signals and storage site for stimulus-reinforcer associations: it receives inputs from all sensory systems, including particularly rich visual inputs from the inferior temporal cortex (<xref ref-type="bibr" rid="ref121">Stefanacci and Amaral, 2002</xref>), and its neurons show potentiated responses to sensory stimuli that have been associated with reward or punishment (<xref ref-type="bibr" rid="ref109">Sah et al., 2003</xref>; <xref ref-type="bibr" rid="ref60">Johansen et al., 2011</xref>; <xref ref-type="bibr" rid="ref34">Duvarci and Pare, 2014</xref>). The lateral nucleus projects to the basolateral and basomedial nuclei, which receive additional inputs from the orbitofrontal cortex, medial prefrontal cortex and hippocampus (<xref ref-type="bibr" rid="ref98">Price et al., 1987</xref>) that enrich encoded stimulus-reinforcer associations with contextual information. Recent neurophysiological evidence in primates suggests that lateral-nucleus neurons encode accurate valuations of particular sensory objects whereas basolateral nucleus are more directly implicated in value comparisons between currently attended objects and decision-making (<xref ref-type="bibr" rid="ref41">Grabenhorst et al., 2019</xref>; <xref ref-type="bibr" rid="ref44">Grabenhorst et al., 2023</xref>). The basolateral and basomedial nuclei send direct outputs to the prefrontal cortex and striatum&#x2014;routes by which the amygdala can influence neural systems associated with decision-making and action selection. A second critical output involves the amygdala&#x2019;s centromedial nuclei, which process inputs from other amygdala nuclei to regulate behavioral and autonomic responses to affective stimuli via projections to the hypothalamus, basal forebrain, periaqueductal gray, midbrain and brainstem (<xref ref-type="bibr" rid="ref98">Price et al., 1987</xref>; <xref ref-type="bibr" rid="ref96">Price, 2003</xref>). Complex inhibitory systems modulate information processing in these amygdala circuits (<xref ref-type="bibr" rid="ref34">Duvarci and Pare, 2014</xref>).</p>
<p>Its extrinsic and elaborate intrinsic connections (<xref ref-type="bibr" rid="ref94">Pitkanen et al., 1997</xref>; <xref ref-type="bibr" rid="ref93">Pitkanen and Amaral, 1998</xref>) enable the amygdala to process the value of sensory stimuli based on learned stimulus-reinforcer associations, and integrate this information with current contexts, memories, and internal states to regulate emotion, attention, memory, physiological and behavioral responses (<xref ref-type="bibr" rid="ref102">Rolls, 2000</xref>; <xref ref-type="bibr" rid="ref90">Paton et al., 2006</xref>; <xref ref-type="bibr" rid="ref83">Murray, 2007</xref>; <xref ref-type="bibr" rid="ref60">Johansen et al., 2011</xref>; <xref ref-type="bibr" rid="ref34">Duvarci and Pare, 2014</xref>; <xref ref-type="bibr" rid="ref108">Saez et al., 2015</xref>; <xref ref-type="bibr" rid="ref40">Gothard, 2020</xref>; <xref ref-type="bibr" rid="ref48">Grabenhorst and Schultz, 2021</xref>). The amygdala is a complex structure composed of different subregions with many different cell types. Accordingly, its neurons have been shown to be related to a diversity of functions including not only value-coding and decision-making (<xref ref-type="bibr" rid="ref90">Paton et al., 2006</xref>; <xref ref-type="bibr" rid="ref42">Grabenhorst et al., 2012</xref>; <xref ref-type="bibr" rid="ref26">Chang et al., 2015</xref>; <xref ref-type="bibr" rid="ref53">Hernadi et al., 2015</xref>; <xref ref-type="bibr" rid="ref43">Grabenhorst et al., 2016</xref>; <xref ref-type="bibr" rid="ref27">Costa et al., 2019</xref>; <xref ref-type="bibr" rid="ref41">Grabenhorst et al., 2019</xref>; <xref ref-type="bibr" rid="ref59">Jezzini and Padoa-Schioppa, 2020</xref>; <xref ref-type="bibr" rid="ref44">Grabenhorst et al., 2023</xref>), but also the distinct processing of stimulus intensity, salience, arousal and other processes important in emotion, motivation, and value-guided behavior (<xref ref-type="bibr" rid="ref85">Nishijo et al., 2008</xref>; <xref ref-type="bibr" rid="ref92">Peck et al., 2013</xref>; <xref ref-type="bibr" rid="ref71">Leathers and Olson, 2017</xref>; <xref ref-type="bibr" rid="ref57">Iwaoki and Nakamura, 2022</xref>; <xref ref-type="bibr" rid="ref126">Tang et al., 2024</xref>).</p>
<p>As reviewed in detail below, recent evidence indicates that primate amygdala neurons are involved in the component processes underlying the pursuit of future rewards (<xref ref-type="bibr" rid="ref42">Grabenhorst et al., 2012</xref>; <xref ref-type="bibr" rid="ref53">Hernadi et al., 2015</xref>; <xref ref-type="bibr" rid="ref43">Grabenhorst et al., 2016</xref>; <xref ref-type="bibr" rid="ref135">Zangemeister et al., 2016</xref>). Importantly, the amygdala is also implicated in specific psychiatric conditions and mental-health impairments, including anxiety and depression (<xref ref-type="bibr" rid="ref97">Price and Drevets, 2012</xref>; <xref ref-type="bibr" rid="ref19">Bernardi and Salzman, 2019</xref>; <xref ref-type="bibr" rid="ref6">Andrews et al., 2022</xref>; <xref ref-type="bibr" rid="ref66">Klein-Flugge et al., 2022</xref>; <xref ref-type="bibr" rid="ref35">Fox and Shackman, 2024</xref>). Thus, the same neural mechanisms that support successful reward pursuit may also contribute to impaired cognition and emotion in psychiatric conditions in which these processes are dysfunctional.</p>
</sec>
<sec id="sec3">
<title>Psychological principles underlying the pursuit of future rewards: distinct phases of goal formation and goal pursuit, and the subjective valuation of rewards and costs</title>
<p>Psychological concepts identify component processes underlying the pursuit of future rewards that might be implemented in neural circuits. Goals can be conceptualized as internal representations of desired future states, outcomes or events (<xref ref-type="bibr" rid="ref7">Austin and Vancouver, 1996</xref>; <xref ref-type="bibr" rid="ref21">Brandstatter and Hennecke, 2018</xref>). They serve to direct behavior purposefully toward these desired states, inform the selection of behavioral plans for goal-achievement, and regulate attention, effort, and perseverance during goal pursuit (<xref ref-type="bibr" rid="ref21">Brandstatter and Hennecke, 2018</xref>). Although these concepts stem primarily from human psychology, they can be defined in simple, concrete terms to help operationalization for behavioral and neurophysiological experiments. In the present review, we use the term &#x2018;goal&#x2019; to refer specifically to the representation of a future reward that is selected based on subjective valuation of the reward&#x2019;s attributes and associated costs (i.e., delay, effort). We use the term &#x2018;plan&#x2019; to refer to the behavioral means for pursuing and obtaining a goal, for example through a sequence of choices and the actions that execute these choices.</p>
<p>One key principle in psychological models of planned behavior is the distinction between the initial process of goal formation and subsequent goal pursuit (<xref ref-type="bibr" rid="ref79">Miller et al., 1960</xref>; <xref ref-type="bibr" rid="ref18">Berkman and Lieberman, 2009</xref>; <xref ref-type="bibr" rid="ref9">Bargh et al., 2010</xref>; <xref ref-type="bibr" rid="ref21">Brandstatter and Hennecke, 2018</xref>). For example, economic saving is an elaborate planned behavior that involves forming a self-defined goal for a future reward followed by dynamic, sequential decision-making to achieve the goal (<xref ref-type="bibr" rid="ref95">Prelec and Loewenstein, 1998</xref>; <xref ref-type="bibr" rid="ref16">Benhabib and Bisin, 2005</xref>). As we discuss below, neural data suggest that these component processes are encoded as partly distinct activity patterns in primate amygdala neurons.</p>
<p>A second key principle is the initiation of a valuation process that assigns subjective value to goals based on reward, delay, uncertainty, effort cost, and other factors (<xref ref-type="bibr" rid="ref125">Sutton and Barto, 1998</xref>; <xref ref-type="bibr" rid="ref16">Benhabib and Bisin, 2005</xref>; <xref ref-type="bibr" rid="ref21">Brandstatter and Hennecke, 2018</xref>). According to classical expectancy-value theory (<xref ref-type="bibr" rid="ref130">Vroom, 1964</xref>; <xref ref-type="bibr" rid="ref5">Ajzen, 1991</xref>; <xref ref-type="bibr" rid="ref13">Beckmann and Heckhausen, 2018</xref>) the desirability (value) and feasibility (expectancy) of a goal affect goal selection and the effort invested into pursuing the goal. More abstract determinants of goal selection include achievement motives (<xref ref-type="bibr" rid="ref22">Brunstein and Heckhausen, 2018</xref>), needs for autonomy, competence, and belonging (<xref ref-type="bibr" rid="ref28">Deci and Ryan, 2000</xref>), social influences (<xref ref-type="bibr" rid="ref1">Aarts et al., 2004</xref>; <xref ref-type="bibr" rid="ref131">Weiss et al., 2023</xref>), and external reward (<xref ref-type="bibr" rid="ref130">Vroom, 1964</xref>). In this review, we focus on the simple and most direct cost factors delay and effort, which can be directly manipulated in neurophysiological experiments. Before we review how primate amygdala neurons integrate valuations of reward goals with delay and effort costs, we first consider how delay and effort costs are evaluated psychologically. This discussion leads to the identification of &#x2018;temporary preferences&#x2019; as an important concept that may help explain failures in the pursuit of future rewards.</p>
</sec>
<sec id="sec4">
<title>Time-sensitive valuations of delay and effort costs govern the pursuit of future rewards</title>
<p>The most direct cost factor involved in the pursuit of future rewards is delay. Delay discounting, i.e., the subjective devaluation of a reward as a function of time until the reward can be obtained, has been behaviorally demonstrated in humans, monkeys and other species (<xref ref-type="bibr" rid="ref2">Ainslie, 1974</xref>; <xref ref-type="bibr" rid="ref4">Ainslie and Herrnstein, 1981</xref>; <xref ref-type="bibr" rid="ref74">Mazur, 1998</xref>; <xref ref-type="bibr" rid="ref76">McClure et al., 2004</xref>; <xref ref-type="bibr" rid="ref63">Kable and Glimcher, 2007</xref>; <xref ref-type="bibr" rid="ref67">Kobayashi and Schultz, 2008</xref>). Consistent with the aforementioned relevance of future rewards to health and wellbeing, dysfunctional delay discounting has been proposed as a &#x2018;trans-disease process&#x2019; that may contribute to a range of disorders (<xref ref-type="bibr" rid="ref20">Bickel et al., 2012</xref>). Indeed, higher rates of delay discounting have been linked to behavioral problems such as obesity, smoking, alcoholism, drug abuse, risky sexual behavior, and gambling problems (<xref ref-type="bibr" rid="ref20">Bickel et al., 2012</xref>; <xref ref-type="bibr" rid="ref110">Scholten et al., 2019</xref>).</p>
<p>Delays do not only affect the valuation of future rewards but also the valuation of future costs associated with rewards. For example, in a recent study (<xref ref-type="bibr" rid="ref122">Stillman and Woolley, 2023</xref>), participants chose between future delivery of 24 cookies or a non-food item (a fashionable bag) matched in delay and monetary value when participants were cued to consider either potential long-term costs of eating cookies (e.g., developing diabetes, heart disease, and obesity) or short-term costs (e.g., feeling nauseous or jittery after eating sugar). Despite long-term costs being more severe, participants cued with short-term costs were significantly less likely to choose the cookies compared to those cued with long-term costs. Thus, the delay of future rewards and costs can affect the selection of reward goals, and this process can be influenced by interventions cueing particular cost types.</p>
<p>Humans and other animals can behave in ways that reflect valuations of reward, delay or effort that are time-sensitive, i.e., valuations that depend on when in time these outcomes will occur. In describing how decisions should be made by rational agents, normative decision theory posits that this time-dependence in reward and cost valuation is irrational and violates a principle known as dynamic consistency (<xref ref-type="bibr" rid="ref4">Ainslie and Herrnstein, 1981</xref>; <xref ref-type="bibr" rid="ref10">Barkan and Busemeyer, 1999</xref>). The principle of dynamic consistency states that individuals deciding rationally have consistent preferences throughout time. Therefore, a dynamically consistent decision maker who prefers A to B at a certain point in time will prefer A to B at all other points in time, and their preferences can be modeled with an exponential function that assumes constant rates of discounting, and thus consistent preferences, over time. However, delay discounting has been shown to be modeled more accurately by a nonexponential, hyperbolic function that implements a change in discount rate and can thus accounts for dynamic inconsistency (<xref ref-type="bibr" rid="ref50">Green and Myerson, 1996</xref>). In accounting for dynamic inconsistency, a hyperbolic discounting function predicts that a decision-maker may have temporary preferences for inferior choice options (<xref ref-type="bibr" rid="ref3">Ainslie, 2005</xref>). For example, if delay between rewards is discounted more when a smaller, sooner reward is immediate, then as the rewards draw nearer in time the decision-maker will be more likely to prefer the smaller, sooner reward. Temporary preferences were first observed in animal experiments on delay discounting (<xref ref-type="bibr" rid="ref100">Rachlin and Green, 1972</xref>; <xref ref-type="bibr" rid="ref4">Ainslie and Herrnstein, 1981</xref>; <xref ref-type="bibr" rid="ref74">Mazur, 1998</xref>). In a classical delay discounting paradigm in pigeons (<xref ref-type="bibr" rid="ref2">Ainslie, 1974</xref>), when the delay between smaller, sooner and larger, later rewards was fixed and both rewards were further delayed by equal amounts, the pigeons became less likely to choose the smaller, sooner reward. These reversals of preferences demonstrated that delay-discounting rates can depend on where a delay is placed in time.</p>
<p>Temporary preferences have also been shown in human experiments (<xref ref-type="bibr" rid="ref17">Benzion et al., 1989</xref>; <xref ref-type="bibr" rid="ref49">Green et al., 1994</xref>; <xref ref-type="bibr" rid="ref65">Kirby and Herrnstein, 1995</xref>), which demonstrated how the gap between people&#x2019;s intentions (future preference) and actions (present-moment preference) may lead to inferior choices. One study (<xref ref-type="bibr" rid="ref101">Read and van Leeuwen, 1998</xref>) found that participants were more likely to choose an unhealthy compared to a healthy snack when deciding what they would eat immediately compared to deciding what they would eat in 1&#x202F;week&#x2019;s time. Similarly, meta-analysis (<xref ref-type="bibr" rid="ref113">Sheeran, 2002</xref>) highlights the prevalence of this &#x2018;intention-action gap&#x2019; related to temporary preferences across a range of health-related behaviors including exercise, contraceptive use, and cancer screening. Across six studies, the median percentage of individuals who set an intention to execute these behaviors yet failed to do so was 47%. Evidently, people can have an initial hope to pursue valuable distant rewards instead of immediately gratifying rewards, but as the competing options of these distant rewards draw closer in time, an increase in the discounting rate of cost factors such as effort and delay causes the inferior alternative to become preferable. Accordingly, temporary preferences resulting from dynamic inconsistency can create a gap between intention and action, undermining an original goal.</p>
<p>Dynamic inconsistency occurs not only in regard to delay discounting but also in regard to effort discounting, i.e., the anticipation of exerted physical or mental effort. Exertion of effort in pursuit of future rewards may come in the form of cognitive effort, as in the mental work required to solve computational problems (<xref ref-type="bibr" rid="ref82">Murawski and Bossaerts, 2016</xref>; <xref ref-type="bibr" rid="ref54">Hong and Stauffer, 2023</xref>) or plan a healthy, nutrient-balanced meal, or in the form of physical effort (<xref ref-type="bibr" rid="ref55">Hosokawa et al., 2013</xref>; <xref ref-type="bibr" rid="ref23">Burrell et al., 2023</xref>), as in the completion of strenuous exercise to burn calories. Though humans are often averse to effort when anticipating it in the future, effort that has already been expended on a reward can have the opposite effect, increasing subjective value. For example, in the &#x2018;IKEA effect&#x2019;, having to exert effort assembling a product oneself increases one&#x2019;s subjective valuation of that item (note that this effect is distinct from the sunk cost fallacy, which involves irrational persistence in a previously chosen option without necessarily valuing it more) (<xref ref-type="bibr" rid="ref86">Norton et al., 2012</xref>). Thus, the impact of effort on subjective value may depend on when it occurs in time (<xref ref-type="bibr" rid="ref56">Inzlicht et al., 2018</xref>).</p>
<p><xref ref-type="bibr" rid="ref62">Johnson and Most (2023)</xref> investigated whether discounting cognitive effort to obtain a reward depended on how soon the effort occurred in time. They gave individuals the option to receive a smaller reward for no effort or to perform the effortful task of typing words backwards to receive a larger reward (<xref ref-type="fig" rid="fig2">Figure 2A</xref>). Participants were informed that each choice was potentially real and they may be rewarded with a shopping voucher of an equivalent monetary value to their choice if they were willing to perform the associated backwards-typing task. Immediacy of the effort was varied by asking participants to imagine exerting varying levels of effort either immediately, in a day, or in a month. The authors observed that individuals tended to discount the effort less when they were making the decision for their future self, compared to making decisions that were immediately relevant (<xref ref-type="fig" rid="fig2">Figure 2B</xref>) (<xref ref-type="bibr" rid="ref62">Johnson and Most, 2023</xref>). Thus, people exhibit dynamic inconsistency in making decisions to obtain rewards by exerting effort, such that the degree of effort discounting depends on how soon the effort occurs. Notably, this effect was only found in individuals low in &#x2018;need for cognition&#x2019;, a personality trait describing how much one generally enjoys exerting cognitive effort, which suggests that enjoyment of effort may &#x2018;buffer&#x2019; against the tendency to be dynamically inconsistent.</p>
<fig position="float" id="fig2">
<label>Figure 2</label>
<caption>
<p>Time-sensitive valuation of cognitive effort: Pushing cognitive effort into the future reduces effort discounting. <bold>(A)</bold> Participants were asked to choose between receiving a smaller reward for no effort or performing the effortful task of typing words backwards at varying temporal delays to receive a larger reward. Repeated choices between options of varying reward size resulted in subjective-value estimates from empirically identified indifference points. <bold>(B)</bold> Individuals low in need for cognition (NFC) displayed dynamic inconsistency in effort-related decision-making. Subjective value of the larger, more effortful reward rose as temporal distance to the anticipated effort increased. Mean subjective values (of an objective $20) are displayed. Error bars: standard errors. &#x002A;<italic>p</italic>&#x202F;&#x003C;&#x202F;0.05 Adapted with permission from <xref ref-type="bibr" rid="ref62">Johnson and Most (2023)</xref>.</p>
</caption>
<graphic xlink:href="fnins-18-1517231-g002.tif"/>
</fig>
<p>Identifying instances of dynamic inconsistency could inform strategies that support goal pursuit. In recognizing the possibility of a temporary preference, an individual setting an intention may choose to implement strategies that minimize future temptations (i.e., avoiding smaller, sooner or smaller, easier rewards) and thus reduce the likelihood of the temporary preference. For example, an individual who intends to exercise in the morning may place their phone out of reach before sleeping to reduce the likelihood of being tempted to stay in bed and sleep in. Remarkably, the aforementioned experiment by <xref ref-type="bibr" rid="ref2">Ainslie (1974)</xref> found that even pigeons may use such pre-commitment strategies to maximize reward. In a delay discounting paradigm, three out of 10 pigeons consistently pecked a different colored key that prevented the smaller, sooner reward from being offered to them, thus pre-committing to the larger, later reward before the temporary preference arose.</p>
<p>The above findings show that the dynamic, time-sensitive valuation and re-valuation of reward, delay and (physical and cognitive) effort is a central process underlying the pursuit of future rewards that gives rise to temporary preferences. Accordingly, the neural mechanisms involved in selecting future reward goals and the plans to obtain them should reflect the subjective valuations of reward with associated delay and effort costs and also the updating of this integrated signal to account for temporary preferences. Evidence supporting this proposal is reviewed in the next sections and summarized in see <xref ref-type="table" rid="tab1">Table 1</xref>.</p>
</sec>
<sec id="sec5">
<title>A behavioral paradigm to study the neurophysiology underlying the pursuit of future reward goals: economic reward-saving decisions</title>
<p>Some of the psychological processes reviewed above can be studied in behavioral tasks involving sequential save-spend decisions leading to future rewards. Using this paradigm, neurophysiological studies in monkeys uncovered some of the building blocks underlying the pursuit of future rewards in amygdala neurons (<xref ref-type="bibr" rid="ref42">Grabenhorst et al., 2012</xref>; <xref ref-type="bibr" rid="ref53">Hernadi et al., 2015</xref>; <xref ref-type="bibr" rid="ref43">Grabenhorst et al., 2016</xref>). A subsequent study translated this approach to human functional neuroimaging (<xref ref-type="bibr" rid="ref135">Zangemeister et al., 2016</xref>, <xref ref-type="bibr" rid="ref136">2019</xref>). The behavioral task used in these studies, described next, modeled key aspects of planned, goal-directed behavior: (1) forming a self-determined internal goal based on subjective reward-cost valuations, (2) defining a plan for obtaining the goal, (3) executing the plan by stepwise decision-making and progress-tracking.</p>
<p>In the &#x2018;save-spend task&#x2019; (<xref ref-type="bibr" rid="ref42">Grabenhorst et al., 2012</xref>; <xref ref-type="bibr" rid="ref53">Hernadi et al., 2015</xref>), monkeys made consecutive choices to save (i.e., accumulate) liquid rewards for future trials until they decided to spend (i.e., consume) the saved reward amount (<xref ref-type="fig" rid="fig3">Figure 3A</xref>). Save-spend choice options were cued with pre-trained visual conditioned stimuli on a computer monitor. Different save cues indicated different interest rates that governed differential increases in saved reward amounts over consecutive save choices, with high interest rates leading to exponential reward growths (<xref ref-type="fig" rid="fig3">Figure 3B</xref>, green curves). The behavioral choice-patterns of the monkeys in this task reflected accurate understanding of the task structure: the animals produced longer sequences of save choices when interest rates were high, and shorter sequences when interest rates were low (<xref ref-type="fig" rid="fig3">Figure 3B</xref>, black bars). Control tests confirmed that the monkeys adjusted their behavior even to uncued changes in interest rate and that they tracked saved reward amounts over consecutive trials. The monkeys&#x2019; saving behavior was therefore adaptive and internally controlled rather than reflecting fixed, conditioned responses to pretrained cues. Analysis of reaction times showed that responses early on in saving sequences predicted the final length of the saving sequence and the amount of the final saved reward. Thus, the animals anticipated final reward amounts, as early as on the first trial of a saving sequence, consistent with planned behavior directed at internally set reward goals.</p>
<fig position="float" id="fig3">
<label>Figure 3</label>
<caption>
<p>Economic reward-saving behavior in monkeys. <bold>(A)</bold> Schematic of the save-spend task. Monkeys made sequences of save-spend choices to save (i.e., accumulate) liquid reward for later until deciding to spend (i.e., consume) it. The task allowed the monkeys to form an internal goal to obtain a specific future reward and plan to obtain this goal by making a save-spend choice sequence of a specific length. <bold>(B)</bold> Behavior in the saving task. Monkeys produced longer saving sequences, shown by their choice probability for different sequence lengths (black bars), when reward grew exponentially (green curve; reward growth was governed by a cued interest rate). Magenta curve: Subjective value of a saving sequence of defined length estimated from choice probability incorporating reward amount, delay and effort costs. <bold>(C)</bold> Activity of a single amygdala neuron recorded in the saving task (Imp/s: neuronal response measured in impulses per second; raster plot: each line represents a recorded action potential). The neuron responded more strongly at the time of choice when the monkey was going to make a spend choice compared to a save choice on the current trial (left panel). The choice-predictive activity was specific to the free-choice task and disappeared in the instructed, forced-choice control task (right panel), confirming the activity reflected an internally generated choice rather than reward expectation. Adapted with permission from <xref ref-type="bibr" rid="ref42">Grabenhorst et al. (2012)</xref> and <xref ref-type="bibr" rid="ref53">Hernadi et al. (2015)</xref>.</p>
</caption>
<graphic xlink:href="fnins-18-1517231-g003.tif"/>
</fig>
<p>An important feature of the task was that it allowed the animals to plan their choices multiple steps in advance, to obtain specific reward amounts through saving sequences of defined lengths requiring particular delay (i.e., waiting times) and effort (i.e., number of operand responses). Accordingly, the subjective value of a reward goal depended not only on final reward amounts but also on costs related to sequence length: because larger reward amounts typically required longer saving sequences, their value was diminished by temporal delay and physical effort. These effects on subjective values were modeled by deriving value from observed behavioral choices for different sequence lengths (<xref ref-type="fig" rid="fig3">Figure 3B</xref>, black bars). These &#x2018;sequence value&#x2019; functions typically increased with sequence length up to a peak and then decreased with longer sequences that the animal chose less frequently, likely owing to temporal discounting and physical-effort costs (<xref ref-type="fig" rid="fig3">Figure 3B</xref>, right panel, magenta curve). This nonlinearity in subjective-value functions made it possible to determine whether neuronal activities encoded subjective value or objective sequence length, as described below.</p>
<p>We note that this approach to reward-saving decisions shares features with &#x2018;token economies&#x2019; (<xref ref-type="bibr" rid="ref52">Hackenberg, 2009</xref>), in which animals earn and accumulate conditioned stimuli and exchange them against different food and liquid reward according to a defined schedule. Similar to goal-directed sequences of save-spend choices described above, token schedules can organize an animal&#x2019;s behavior over extended time periods that lead to a final (&#x2018;terminal&#x2019;) primary reward. For example, pigeons&#x2019; produce sequential responses to accumulate tokens before making a different response to exchange them against food or liquid reward (<xref ref-type="bibr" rid="ref134">Yankelevitz et al., 2008</xref>; <xref ref-type="bibr" rid="ref29">DeFulio et al., 2014</xref>). Similarly, monkeys anticipate rewards in instructed sequential reward-schedule tasks with visual cues indicating reward proximity (<xref ref-type="bibr" rid="ref116">Shidara and Richmond, 2002</xref>; <xref ref-type="bibr" rid="ref124">Sugase-Miyamoto and Richmond, 2005</xref>) and make reward-maximizing choices using tokens that signify gain or loss of primary reinforcers (<xref ref-type="bibr" rid="ref133">Yang et al., 2022</xref>; <xref ref-type="bibr" rid="ref126">Tang et al., 2024</xref>).</p>
</sec>
<sec id="sec6">
<title>Primate amygdala neurons encode plans for future rewards: the value of goals, behavioral plans for obtaining them, and adaptive progress during goal pursuit</title>
<p>The primate amygdala has long been implicated in reward-guided behavior (<xref ref-type="bibr" rid="ref102">Rolls, 2000</xref>; <xref ref-type="bibr" rid="ref11">Baxter and Murray, 2002</xref>; <xref ref-type="bibr" rid="ref90">Paton et al., 2006</xref>; <xref ref-type="bibr" rid="ref15">Belova et al., 2007</xref>; <xref ref-type="bibr" rid="ref83">Murray, 2007</xref>) but only recently has been shown to participate in value-based decision-making (<xref ref-type="bibr" rid="ref42">Grabenhorst et al., 2012</xref>; <xref ref-type="bibr" rid="ref106">Rudebeck et al., 2013</xref>; <xref ref-type="bibr" rid="ref107">Rudebeck et al., 2017</xref>; <xref ref-type="bibr" rid="ref27">Costa et al., 2019</xref>; <xref ref-type="bibr" rid="ref41">Grabenhorst et al., 2019</xref>; <xref ref-type="bibr" rid="ref59">Jezzini and Padoa-Schioppa, 2020</xref>; <xref ref-type="bibr" rid="ref44">Grabenhorst et al., 2023</xref>) and the planned pursuit of future reward goals (<xref ref-type="bibr" rid="ref42">Grabenhorst et al., 2012</xref>; <xref ref-type="bibr" rid="ref53">Hernadi et al., 2015</xref>; <xref ref-type="bibr" rid="ref43">Grabenhorst et al., 2016</xref>; <xref ref-type="bibr" rid="ref135">Zangemeister et al., 2016</xref>). During performance of the save-spend task introduced in the previous section, single-cell recordings showed that a significant number of amygdala neurons exhibited activity patterns that predicted the monkeys&#x2019; save-spend choice on individual trials (<xref ref-type="bibr" rid="ref42">Grabenhorst et al., 2012</xref>). These choice-predictive activities (<xref ref-type="fig" rid="fig3">Figure 3C</xref>) were not explained by left&#x2013;right actions, nor did they reflect subjective values of save-spend choices, which were encoded separately. Rather, these amygdala neurons signaled the monkey&#x2019;s economic choice to either spend reward for immediate consumption or save it for the future. Choice-predictive activities were in most cases specific to freely made choices, as they disappeared in a control task involving forced, instructed save-spend choices (<xref ref-type="fig" rid="fig3">Figure 3C</xref>, right panel). Thus, amygdala neurons predicted the monkey&#x2019;s self-determined choices to either pursue a future goal by saving reward for later or to spend the accumulated reward immediately. More recent studies implicated amygdala neurons in choices for different types of reward (<xref ref-type="bibr" rid="ref59">Jezzini and Padoa-Schioppa, 2020</xref>), in explore-exploit decisions (<xref ref-type="bibr" rid="ref27">Costa et al., 2019</xref>), social decisions (<xref ref-type="bibr" rid="ref26">Chang et al., 2015</xref>; <xref ref-type="bibr" rid="ref41">Grabenhorst et al., 2019</xref>), and in decision computations that compare currently viewed and recently viewed choice options (<xref ref-type="bibr" rid="ref44">Grabenhorst et al., 2023</xref>).</p>
<p>Amygdala neurons did not simply encode save-spend choices related to single trials but also showed more complex, prospective activities that were critical for optimal task performance (<xref ref-type="bibr" rid="ref53">Hernadi et al., 2015</xref>; <xref ref-type="bibr" rid="ref43">Grabenhorst et al., 2016</xref>). These &#x2018;planning activities&#x2019; preceded the end of a saving sequence by several steps and encoded information about the final reward goal, which was self-determined by the monkey and existed only internally at the time of saving. Specifically, amygdala planning activities signaled two well-defined features of the animal&#x2019;s internal saving plan (<xref ref-type="bibr" rid="ref53">Hernadi et al., 2015</xref>): some neurons encoded &#x2018;sequence value&#x2019;, defined as the subjective value of the current saving sequence (<xref ref-type="fig" rid="fig4">Figures 4A</xref>,<xref ref-type="fig" rid="fig4">B</xref>, solid magenta curve), while a separate set of neurons encoded the &#x2018;sequence length&#x2019;, defined by the number of planned, forthcoming save choices (<xref ref-type="fig" rid="fig4">Figure 4B</xref>, dashed magenta curve). For example, the neuron in <xref ref-type="fig" rid="fig4">Figure 4A</xref> had recurring phasic responses on each trial that were highest during sequences in which the monkey would eventually spend on the fifth trial and lower for shorter or longer sequences. This activity profile reflected the distribution of subjective values derived from the monkey&#x2019;s choice preferences: five-trial sequences had the highest value under the current interest rate, as the animal chose them most frequently. Importantly, subjective value was a non-monotonic function of sequence length: depending on the current interest rate, subjective value was highest for intermediate sequence lengths (<xref ref-type="fig" rid="fig4">Figure 4B</xref>, black bars) that offered a compromise between large rewards (<xref ref-type="fig" rid="fig4">Figure 4B</xref>, green curve) and moderate delays and effort. These planning activities typically disappeared during instructed trials, despite comparable reward timing and anticipation, and in control analyses were shown to be unrelated to reward proximity and expectation.</p>
<fig position="float" id="fig4">
<label>Figure 4</label>
<caption>
<p>Amygdala neurons encode value and length of monkeys&#x2019; saving plans. <bold>(A)</bold> An amygdala neuron with prospective activity that reflected the subjective value of the monkey&#x2019;s internal saving plan. The neuron&#x2019;s activity depended on the subjective value of the current sequence (&#x2018;sequence value&#x2019;) that would only be completed several moments into the future. Top: Activity at trial start (yellow area) was highest for the sequence in which the monkey would eventually spend on the fifth trial, as this sequence had the highest subjective value. Bottom: activity averages for all sequence lengths (for example, the light pink activation represents the mean trial-start activity for all five-trial sequences, averaged over trials 1 to 5). Activity reflected sequence value (magenta curve), rather than linear sequence length or objective reward amount (green curve). <bold>(B)</bold> Amygdala neurons with prospective activity for future rewards. Neurons signaled the length of the planned choice sequence (dashed magenta curve, population activity, <italic>N</italic>&#x202F;=&#x202F;92 neurons) or its subjective value (solid magenta curve, <italic>N</italic>&#x202F;=&#x202F;93 neurons). Value activity was highest during sequences lasting six trials, which had the highest subjective value (black bars), i.e., these sequences were typically preferred by the animals, because they offered large reward (green curve) for moderate delay and physical effort. Adapted with permission from <xref ref-type="bibr" rid="ref53">Hernadi et al. (2015)</xref>.</p>
</caption>
<graphic xlink:href="fnins-18-1517231-g004.tif"/>
</fig>
<p>Thus, amygdala neurons in the save-spend task encoded two key components of the monkeys&#x2019; internal saving plan: the subjective value of the current reward goal (&#x2018;sequence value&#x2019;) and the behavioral plan to achieve the goal through a choice sequence of defined length (&#x2018;sequence length&#x2019;).</p>
<p>A distinct, third type of amygdala activity signaled the monkeys&#x2019; progress over the course of a saving sequence (<xref ref-type="bibr" rid="ref43">Grabenhorst et al., 2016</xref>). These progress-tracking neurons showed gradually increasing, &#x2018;ramping&#x2019; activity over consecutive save choices until the monkey decided to spend the saved reward (<xref ref-type="fig" rid="fig5">Figure 5A</xref>). Importantly, the responses occurred in the absence of external progress cues and were often specific to internally guided choices. Moreover, the slope of this ramping activity depended on the forthcoming sequence length, with steeper neuronal ramping for shorter sequences (<xref ref-type="fig" rid="fig5">Figure 5B</xref>). These findings suggest that amygdala progress-tracking signals adapt to the monkey&#x2019;s internal plan to execute a specific sequence length. Such continual evaluation of progress by amygdala neurons seems crucial for aligning choices with internal plans and for successful goal pursuit (<xref ref-type="bibr" rid="ref61">Johnson and Busemeyer, 2001</xref>; <xref ref-type="bibr" rid="ref16">Benhabib and Bisin, 2005</xref>; <xref ref-type="bibr" rid="ref18">Berkman and Lieberman, 2009</xref>).</p>
<fig position="float" id="fig5">
<label>Figure 5</label>
<caption>
<p>Progress-tracking in amygdala. <bold>(A)</bold> Ramping activity of an amygdala neuron in a saving sequence lasting six trials. The neuron&#x2019;s responses at the time of choice increased with each consecutive step in the saving sequence. <bold>(B)</bold> The slope of the neuronal ramping activity in amygdala for different sequences (right panel) adapted to the final sequence length (&#x2018;adaptive sequence progress&#x2019;, middle schematic); it did not increase linearly with elapsed time or trial number (left schematic), consistent with progress-tracking rather than time-tracking. Adapted with permission from <xref ref-type="bibr" rid="ref43">Grabenhorst et al. (2016)</xref>.</p>
</caption>
<graphic xlink:href="fnins-18-1517231-g005.tif"/>
</fig>
<p>Taken together, different neurons in the primate amygdala encode important building blocks for the pursuit of future rewards: (1) the subjective value of the current reward goal (&#x2018;sequence value&#x2019;), (2) the behavioral saving plan for achieving the goal (&#x2018;sequence length), (3) the save-spend choices that realized this plan at specific choice points, and (4) the internally tracked progress toward the reward goal. In relation to the psychological concepts of goal pursuit discussed above, it is possible that variation in these amygdala signals within and across individuals might underlie individual differences in the capacity to pursue long-term rewards (see <xref ref-type="table" rid="tab1">Table 1</xref>). For example, fluctuations in the amygdala&#x2019;s coding of current reward goals might lead to dynamic revaluation of the chosen goal and its alternatives at critical choice points, which could provide a neurophysiological mechanism for temporary preferences. Further, the initial goal valuation and goal formation could be impacted by changes in the function of sequence-value neurons: Exaggerated valuation of a goal&#x2019;s rewarding aspects or diminished discounting of delay and effort costs could result in neuronal encoding and behavioral pursuit of unrealistic goals. Conversely, diminished valuation of future rewards and exaggerated delay and effort discounting could result in the absence of neuronally encoded future rewards and behavioral amotivation. Importantly, the neuronal signals for sequence progress, sequence length and sequence value described above fluctuated with behavioral performance: they were diminished on error trials, when the animal failed to complete a trial correctly, and subsequently reinstated, suggesting behavioral relevance of these amygdala signals. Thus, the amygdala signals reported above might be behaviorally relevant during an individual&#x2019;s pursuit of future rewards.</p>
</sec>
<sec id="sec7">
<title>Future reward goals and planning activity in the human amygdala</title>
<p>The monkey single-neuron investigations reviewed above inspired a human functional neuroimaging study that aimed to translate these findings to the human brain (<xref ref-type="bibr" rid="ref135">Zangemeister et al., 2016</xref>, <xref ref-type="bibr" rid="ref136">2019</xref>). Healthy volunteers performed the save-spend task while their brain activity was measured using functional magnetic resonance imaging (fMRI). As in the monkey study, human participants could plan and execute economic choice sequences to drink liquid rewards&#x2014;delivered in the MRI scanner&#x2014;that increased in amount according to the current interest rate. The reward also varied in type, consisting either of a low-fat high-sugar milkshake or a typically preferred high-fat high-sugar milkshake (<xref ref-type="fig" rid="fig6">Figure 6A</xref>, left panel).</p>
<fig position="float" id="fig6">
<label>Figure 6</label>
<caption>
<p>Planning activity for future rewards in the human amygdala. <bold>(A)</bold> Human participants in the MRI scanner performed save-spend choice sequences to obtain liquid rewards (milkshakes) of different sizes under varying interest rates and reward types cued by visual stimuli (left). Participants produced longer saving sequences for higher interest rates and preferred rewards (right). <bold>(B)</bold> The amygdala encoded the subjective value and planned length of the current saving sequence before participants made their first choice. Time-course analyses (right, betas from multiple-regression analysis) confirmed distinct amygdala signals for sequence value and sequence length (blue shading: analysis period). Adapted with permission from <xref ref-type="bibr" rid="ref135">Zangemeister et al. (2016)</xref>.</p>
</caption>
<graphic xlink:href="fnins-18-1517231-g006.tif"/>
</fig>
<p>Similar to the monkeys, the human participants produced longer saving sequences when interest rates were high, but also saved longer for the more preferred high-fat rewards, consistent with the assignment of subjective values to different saving goals (<xref ref-type="fig" rid="fig6">Figure 6A</xref>, right panel). At the start of a saving sequence, before participants made the first choice to save or spend, neural activity in the amygdala reflected the key planning variables identified in the monkey studies: the subjective value of the planned saving sequence and its length (<xref ref-type="fig" rid="fig6">Figure 6B</xref>). Importantly, the degree to which these neural planning activities depended on the current reward type (high vs. low fat) matched individual participants&#x2019; reward preferences. Thus, amygdala planning activities incorporate information about reward amount, reward type, temporal delay and physical effort. Whole-brain imaging identified other brain areas that contributed to planned reward-saving decisions: neural activities in medial and dorsolateral prefrontal cortex areas reflected planned sequence length and functional coupling with each other and with the amygdala. A distinct prospective signal recorded in the ventromedial prefrontal cortex reflected participants&#x2019; reported saving intentions at the beginning of a new saving sequence (<xref ref-type="bibr" rid="ref136">Zangemeister et al., 2019</xref>).</p>
<p>Thus, the human amygdala encodes different aspects of economic saving plans as part of a functionally connected frontal-amygdala network. Importantly, planning signals for internally generated reward goals depended not only on reward amount, delay and effort cost but also on the subjective valuation of different reward types. That aspects of the single-cell activity patterns related to goal pursuit originally identified in the monkey amygdala can be measured in humans using fMRI opens up the possibility to investigate how these activities might be altered in psychiatric conditions, and how they could be affected by behavioral interventions. To stimulate research, we include in <xref ref-type="table" rid="tab1">Table 1</xref> suggestions for how changes in specific amygdala signals could be linked to failures or improvements in the pursuit of long-term goals.</p>
</sec>
<sec id="sec8">
<title>Neurophysiology of planned behavior beyond amygdala</title>
<p>The prospective amygdala signals reviewed above likely contribute to planned behavior together with activity patterns in other brain areas, briefly reviewed here. Planning functions have traditionally been associated with frontal-lobe regions (<xref ref-type="bibr" rid="ref79">Miller et al., 1960</xref>; <xref ref-type="bibr" rid="ref127">Tanji and Hoshi, 2001</xref>; <xref ref-type="bibr" rid="ref123">Stuss and Knight, 2002</xref>; <xref ref-type="bibr" rid="ref89">Passingham and Wise, 2012</xref>). In monkeys, single neurons in specific frontal regions including lateral-prefrontal, premotor, supplementary-motor and presupplementary-motor cortices encode planned action sequences and the execution and updating of motor plans (<xref ref-type="bibr" rid="ref128">Tanji and Shima, 1994</xref>; <xref ref-type="bibr" rid="ref118">Shima et al., 1996</xref>; <xref ref-type="bibr" rid="ref119">Shima and Tanji, 1998</xref>; <xref ref-type="bibr" rid="ref84">Mushiake et al., 2006</xref>; <xref ref-type="bibr" rid="ref120">Sohn and Lee, 2007</xref>). For example, in a remarkable study (<xref ref-type="bibr" rid="ref117">Shima et al., 2007</xref>), monkeys performed action sequences involving different combinations of push, turn, and pull movements with a lever. Before the monkeys executed each sequence, lateral prefrontal neurons encoded planned sequences in abstract &#x2018;categories&#x2019;, i.e., according to whether they required repetition, alternation or pairings of the same action. Complementing the amygdala neurons described above that encode behavioral sequences in terms of their subjective value (<xref ref-type="bibr" rid="ref53">Hernadi et al., 2015</xref>), these prefrontal neurons could help specify the behavioral means by which future rewards can be pursued. Further, single-cell activities in frontal-lobe areas (motor, premotor, supplementary-motor cortices), the putamen and the striatum also precede self-initiated movements (<xref ref-type="bibr" rid="ref88">Okano and Tanji, 1987</xref>; <xref ref-type="bibr" rid="ref105">Romo and Schultz, 1987</xref>; <xref ref-type="bibr" rid="ref70">Kurata and Wise, 1988</xref>; <xref ref-type="bibr" rid="ref111">Schultz and Romo, 1992</xref>; <xref ref-type="bibr" rid="ref72">Lee et al., 2006</xref>), which represent the behavioral means for executing a plan. Further, activities in human medial frontal cortex, monkey striatum and monkey dopamine neurons encode the subjective value of delayed rewards and thereby likely contribute to prospective goal valuations (<xref ref-type="bibr" rid="ref63">Kable and Glimcher, 2007</xref>; <xref ref-type="bibr" rid="ref75">McClure et al., 2007</xref>; <xref ref-type="bibr" rid="ref64">Kim et al., 2008</xref>; <xref ref-type="bibr" rid="ref67">Kobayashi and Schultz, 2008</xref>). In multistep reinforcement learning, prefrontal-striatal systems in human imaging studies encode evaluation of reward outcomes associated with externally defined choice paths (<xref ref-type="bibr" rid="ref132">Wunderlich et al., 2012</xref>; <xref ref-type="bibr" rid="ref32">Doll et al., 2015</xref>). Further, when human decision-makers calibrate their behavioral persistence while waiting for rewards, neural activity in medial prefrontal cortex reflects this context-sensitive subjective valuation (<xref ref-type="bibr" rid="ref77">McGuire and Kable, 2015</xref>).</p>
<p>Thus, beyond amygdala, neural activity in connected brain areas contributes to internally planned, goal-oriented behaviors. Following earlier proposals (<xref ref-type="bibr" rid="ref119">Shima and Tanji, 1998</xref>), we suggest that amygdala neurons signaling the subjective value of reward goals and the plans to obtain them (<xref ref-type="bibr" rid="ref42">Grabenhorst et al., 2012</xref>; <xref ref-type="bibr" rid="ref53">Hernadi et al., 2015</xref>; <xref ref-type="bibr" rid="ref43">Grabenhorst et al., 2016</xref>; <xref ref-type="bibr" rid="ref135">Zangemeister et al., 2016</xref>) could provide value-based inputs to other brain systems to direct planned, self-initiated behavior toward future rewards.</p>
</sec>
<sec id="sec9">
<title>Amygdala neurons and self-determination</title>
<p>One important aspect of the findings in the save-spend task reviewed above is that amygdala activity related to choices, reward goals and progress-tracking was typically specific to self-determined (rather than externally instructed) saving behavior (<xref ref-type="bibr" rid="ref42">Grabenhorst et al., 2012</xref>; <xref ref-type="bibr" rid="ref53">Hernadi et al., 2015</xref>; <xref ref-type="bibr" rid="ref43">Grabenhorst et al., 2016</xref>; <xref ref-type="bibr" rid="ref135">Zangemeister et al., 2016</xref>). This observation links the interpretation of the amygdala&#x2019;s involvement in goal pursuit to psychological theories of self-determined behaviors.</p>
<p>Behaviors generated by oneself differ in important ways from those that are externally imposed, as conceptualized by one of the most influential theories of human motivation: Self-Determination Theory (SDT, <xref ref-type="bibr" rid="ref28">Deci and Ryan, 2000</xref>). In the terminology of SDT, &#x2018;internally motivated&#x2019; behaviors are more likely to be accompanied by experiences of autonomy. In contrast, behaviors driven primarily by social forces are termed &#x2018;externally motivated&#x2019; and typically lack the feelings of agency that accompany internally motivated behaviors. Planning signals in the amygdala were shown to depend on whether the behavior was internally or externally motivated, as these signals tended to disappear when the decision maker was instructed by a visual cue which action to take (<xref ref-type="bibr" rid="ref42">Grabenhorst et al., 2012</xref>; <xref ref-type="bibr" rid="ref53">Hernadi et al., 2015</xref>; <xref ref-type="bibr" rid="ref43">Grabenhorst et al., 2016</xref>). Therefore, amygdala neurons seem sensitive to whether choices are self-determined or externally imposed, which may provide a basis for experiencing decisions as autonomous. In the SDT literature, autonomy creates higher levels of behavioral persistence and satisfaction (<xref ref-type="bibr" rid="ref51">Grolnick and Ryan, 1987</xref>; <xref ref-type="bibr" rid="ref129">Vallerand and Bissonnette, 1992</xref>; <xref ref-type="bibr" rid="ref115">Sheldon and Houser-Marko, 2001</xref>). As the amygdala sends projections to brain areas involved in reward-related subjective experiences, including the medial prefrontal cortex and orbitofrontal cortex (<xref ref-type="bibr" rid="ref69">Kringelbach et al., 2003</xref>; <xref ref-type="bibr" rid="ref104">Rolls et al., 2003</xref>; <xref ref-type="bibr" rid="ref46">Grabenhorst et al., 2007</xref>; <xref ref-type="bibr" rid="ref103">Rolls and Grabenhorst, 2008</xref>; <xref ref-type="bibr" rid="ref47">Grabenhorst et al., 2010</xref>; <xref ref-type="bibr" rid="ref45">Grabenhorst and Rolls, 2011</xref>), it is possible that amygdala signals that reflect whether behavior was performed in an autonomous, self-determined manner may contribute to the subjective experience of autonomy. Future research could therefore examine whether amygdala signals related to self-determined decisions contribute to the positive psychological outcomes associated with self-determined behavior. As past research has suggested that promoting experiences of autonomy could mitigate depressive symptoms (<xref ref-type="bibr" rid="ref80">Moore et al., 2021</xref>), future research could also investigate the role of these amygdala signals in depression and potentially in other psychiatric conditions in which the amygdala is implicated (<xref ref-type="bibr" rid="ref97">Price and Drevets, 2012</xref>; <xref ref-type="bibr" rid="ref19">Bernardi and Salzman, 2019</xref>; <xref ref-type="bibr" rid="ref6">Andrews et al., 2022</xref>; <xref ref-type="bibr" rid="ref66">Klein-Flugge et al., 2022</xref>; <xref ref-type="bibr" rid="ref35">Fox and Shackman, 2024</xref>).</p>
</sec>
<sec id="sec10">
<title>Conclusion and perspective: amygdala neurons as possible targets for behavioral-change interventions</title>
<p>The successful pursuit of future rewards requires the formation of a goal based on subjective reward and cost valuations, the definition of a plan to obtain the goal, and stepwise decision-making and progress-monitoring during goal pursuit. The amygdala signals reviewed above related to the value of internal reward goals and plans for obtaining them seem well-suited to direct the self-determined pursuit of future rewards. As individuals can be inconsistent in their evaluations of cost factors such as effort and delay, they may prefer a distant goal at one point in time but then switch their preference to an inferior but immediately-gratifying reward. These temporary preferences for immediate but inferior rewards are therefore a key concept for explaining impulsive behaviors that reflect time-dependent revaluation of reward goals and cost factors. Thus, future studies could examine whether amygdala neurons encoding the value of distant rewards update their activity to reflect time-dependent revaluations of goals. Such neurons could provide a neurophysiological basis for the emergence of temporary preferences and so-called &#x2018;self-defeating&#x2019; behaviors, i.e., a choice made during goal pursuit that deviates from an initially formed goal and prioritizes an inferior reward over a previously stated preference for a larger but distant reward. As indicated above, successes and failures in the pursuit of future reward are highly relevant to human behavior, well-being, and mental health across life domains. A valuable research program into these questions could combine single-cell recordings in monkeys making complex, primate-typical decisions about future rewards with functional neuroimaging in humans performing the same decision tasks. This translational approach could provide evidence on detailed, single-neuron activity patterns underlying reward-pursuit and temporary preferences, and on the related neural correlates in human brain areas and brain systems, which could be used to investigate neural mechanisms of behavioral-change interventions.</p>
<p>Although confirmation of the behavioral relevance of amygdala neurons will require further experiments, we suggest that the amygdala&#x2019;s activity patterns could represent potential vulnerabilities for dysfunctional reward-guided behavior and related mental-health impairments in conditions in which the amygdala is implicated, including depression, anxiety and addiction (<xref ref-type="bibr" rid="ref97">Price and Drevets, 2012</xref>; <xref ref-type="bibr" rid="ref19">Bernardi and Salzman, 2019</xref>; <xref ref-type="bibr" rid="ref6">Andrews et al., 2022</xref>; <xref ref-type="bibr" rid="ref66">Klein-Flugge et al., 2022</xref>; <xref ref-type="bibr" rid="ref35">Fox and Shackman, 2024</xref>). The same neural signals may also be targets for interventions (<xref ref-type="bibr" rid="ref39">Gollwitzer and Schaal, 1998</xref>; <xref ref-type="bibr" rid="ref30">Diamond and Lee, 2011</xref>; <xref ref-type="bibr" rid="ref14">Belanger-Gravel et al., 2013</xref>; <xref ref-type="bibr" rid="ref78">Michie et al., 2013</xref>; <xref ref-type="bibr" rid="ref114">Sheeran et al., 2013</xref>; <xref ref-type="bibr" rid="ref110">Scholten et al., 2019</xref>), in that the effects of interventions aiming for behavioral change, such as mental contrasting (<xref ref-type="bibr" rid="ref33">Duckworth et al., 2013</xref>), may potentially be mediated by altered activity patterns of these amygdala neurons. In <xref ref-type="table" rid="tab1">Table 1</xref>, we propose some specific ways in which known amygdala signals with particular functions in the pursuit of future rewards could represent vulnerabilities for dysfunction and targets for intervention. These proposals are made with the intention of stimulating further discussion and research, although we acknowledge that these suggestions remain speculative and will await confirmation by behavioral and neurophysiological data. Further to investigating the role of the amygdala in the behavior change strategies described in <xref ref-type="table" rid="tab1">Table 1</xref>, future research could investigate how the complex psychological mechanisms underlying behavioral-change strategies may relate to amygdala function. For example, it has been proposed that one mechanism of mental contrasting is changing how individuals interpret specific situations (<xref ref-type="bibr" rid="ref87">Oettingen and Schworer, 2013</xref>). After mental contrasting, an individual may begin to interpret an opportunity to eat a new flavor of ice cream as an obstacle to their weight loss progress rather than an exciting new experience. Thus, understanding the functions of amygdala neurons in the pursuit of future rewards may not only address basic biological questions concerning the neural basis of motivated behavior but may also lead to mechanistic explanations for successes and failures of behavior-change interventions.</p>
</sec>
</body>
<back>
<sec sec-type="author-contributions" id="sec11">
<title>Author contributions</title>
<p>SJ: Conceptualization, Writing &#x2013; original draft, Writing &#x2013; review &#x0026; editing. FG: Conceptualization, Writing &#x2013; original draft, Writing &#x2013; review &#x0026; editing.</p>
</sec>
<sec sec-type="funding-information" id="sec12">
<title>Funding</title>
<p>The author(s) declare that financial support was received for the research, authorship, and/or publication of this article. This work was funded by the Wellcome Trust and the Royal Society (Wellcome/Royal Society Sir Henry Dale Fellowship grants 206207/Z/17/Z and 206207/Z/17/A to FG). This research was funded in whole, or in part, by the Wellcome Trust. For the purpose of Open Access, the authors have applied a CC BY public copyright license to any Author Accepted Manuscript version arising from this submission.</p>
</sec>
<ack>
<p>We thank S. Most, I. Hern&#x00E1;di, L. Zangemeister, and W. Schultz for collaboration and discussion on some of the experiments discussed in this review.</p>
</ack>
<sec sec-type="COI-statement" id="sec13">
<title>Conflict of interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="ai-statement" id="sec14">
<title>Generative AI statement</title>
<p>The authors declare that no Generative AI was used in the creation of this manuscript.</p>
</sec>
<sec sec-type="disclaimer" id="sec15">
<title>Publisher&#x2019;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<ref-list>
<title>References</title>
<ref id="ref1"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Aarts</surname> <given-names>H.</given-names></name> <name><surname>Gollwitzer</surname> <given-names>P. M.</given-names></name> <name><surname>Hassin</surname> <given-names>R. R.</given-names></name></person-group> (<year>2004</year>). <article-title>Goal contagion: perceiving is for pursuing</article-title>. <source>J Pers Soc Psychol</source> <volume>87</volume>, <fpage>23</fpage>&#x2013;<lpage>37</lpage>. doi: <pub-id pub-id-type="doi">10.1037/0022-3514.87.1.23</pub-id>, PMID: <pub-id pub-id-type="pmid">15250790</pub-id></citation></ref>
<ref id="ref2"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ainslie</surname> <given-names>G. W.</given-names></name></person-group> (<year>1974</year>). <article-title>Impulse control in pigeons</article-title>. <source>J Exp Anal Behav</source> <volume>21</volume>, <fpage>485</fpage>&#x2013;<lpage>489</lpage>. doi: <pub-id pub-id-type="doi">10.1901/jeab.1974.21-485</pub-id>, PMID: <pub-id pub-id-type="pmid">16811760</pub-id></citation></ref>
<ref id="ref3"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ainslie</surname> <given-names>G.</given-names></name></person-group> (<year>2005</year>). <article-title>Precis of breakdown of will</article-title>. <source>Behav Brain Sci</source> <volume>28</volume>, <fpage>635</fpage>&#x2013;<lpage>650</lpage>. doi: <pub-id pub-id-type="doi">10.1017/S0140525X05000117</pub-id>, PMID: <pub-id pub-id-type="pmid">16262913</pub-id></citation></ref>
<ref id="ref4"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ainslie</surname> <given-names>G.</given-names></name> <name><surname>Herrnstein</surname> <given-names>R. J.</given-names></name></person-group> (<year>1981</year>). <article-title>Preference reversal and delayed reinforcement</article-title>. <source>Anim Learn Behav</source> <volume>9</volume>, <fpage>476</fpage>&#x2013;<lpage>482</lpage>. doi: <pub-id pub-id-type="doi">10.3758/BF03209777</pub-id></citation></ref>
<ref id="ref5"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ajzen</surname> <given-names>I.</given-names></name></person-group> (<year>1991</year>). <article-title>The theory of planned behavior</article-title>. <source>Organ Behav Hum Decis Process</source> <volume>50</volume>, <fpage>179</fpage>&#x2013;<lpage>211</lpage>. doi: <pub-id pub-id-type="doi">10.1016/0749-5978(91)90020-T</pub-id></citation></ref>
<ref id="ref6"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Andrews</surname> <given-names>D. S.</given-names></name> <name><surname>Aksman</surname> <given-names>L.</given-names></name> <name><surname>Kerns</surname> <given-names>C. M.</given-names></name> <name><surname>Lee</surname> <given-names>J. K.</given-names></name> <name><surname>Winder-Patel</surname> <given-names>B. M.</given-names></name> <name><surname>Harvey</surname> <given-names>D. J.</given-names></name> <etal/></person-group>. (<year>2022</year>). <article-title>Association of Amygdala Development with Different Forms of anxiety in autism Spectrum disorder</article-title>. <source>Biol Psychiatry</source> <volume>91</volume>, <fpage>977</fpage>&#x2013;<lpage>987</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.biopsych.2022.01.016</pub-id>, PMID: <pub-id pub-id-type="pmid">35341582</pub-id></citation></ref>
<ref id="ref7"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Austin</surname> <given-names>J. T.</given-names></name> <name><surname>Vancouver</surname> <given-names>J. B.</given-names></name></person-group> (<year>1996</year>). <article-title>Goal constructs in psychology: structure, prcess and content</article-title>. <source>Psychol Bull</source> <volume>122</volume>, <fpage>338</fpage>&#x2013;<lpage>375</lpage>.</citation></ref>
<ref id="ref8"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Balleine</surname> <given-names>B. W.</given-names></name> <name><surname>Killcross</surname> <given-names>S.</given-names></name></person-group> (<year>2006</year>). <article-title>Parallel incentive processing: an integrated view of amygdala function</article-title>. <source>Trends Neurosci</source> <volume>29</volume>, <fpage>272</fpage>&#x2013;<lpage>279</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.tins.2006.03.002</pub-id>, PMID: <pub-id pub-id-type="pmid">16545468</pub-id></citation></ref>
<ref id="ref9"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Bargh</surname> <given-names>J. A.</given-names></name> <name><surname>Gollwitzer</surname> <given-names>P. M.</given-names></name> <name><surname>Oettingen</surname> <given-names>G.</given-names></name></person-group> (<year>2010</year>). &#x201C;<article-title>Motivation</article-title>&#x201D; in <source>Handbook of social psychology</source>. eds. <person-group person-group-type="editor"><name><surname>Fiske</surname> <given-names>S.</given-names></name> <name><surname>Gilbert</surname> <given-names>D.</given-names></name> <name><surname>Linszey</surname> <given-names>G.</given-names></name></person-group> (<publisher-loc>New York</publisher-loc>: <publisher-name>Wiley</publisher-name>), <fpage>268</fpage>&#x2013;<lpage>316</lpage>.</citation></ref>
<ref id="ref10"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Barkan</surname> <given-names>R.</given-names></name> <name><surname>Busemeyer</surname> <given-names>J. R.</given-names></name></person-group> (<year>1999</year>). <article-title>Changing plans: dynamic inconsistency and the effect of experience on the reference point</article-title>. <source>Psychon Bull Rev</source> <volume>6</volume>, <fpage>547</fpage>&#x2013;<lpage>554</lpage>. doi: <pub-id pub-id-type="doi">10.3758/BF03212962</pub-id>, PMID: <pub-id pub-id-type="pmid">10682196</pub-id></citation></ref>
<ref id="ref11"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Baxter</surname> <given-names>M. G.</given-names></name> <name><surname>Murray</surname> <given-names>E. A.</given-names></name></person-group> (<year>2002</year>). <article-title>The amygdala and reward</article-title>. <source>Nat Rev Neurosci</source> <volume>3</volume>, <fpage>563</fpage>&#x2013;<lpage>573</lpage>. doi: <pub-id pub-id-type="doi">10.1038/nrn875</pub-id>, PMID: <pub-id pub-id-type="pmid">12094212</pub-id></citation></ref>
<ref id="ref12"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bechara</surname> <given-names>A.</given-names></name></person-group> (<year>2005</year>). <article-title>Decision making, impulse control and loss of willpower to resist drugs: a neurocognitive perspective</article-title>. <source>Nat Neurosci</source> <volume>8</volume>, <fpage>1458</fpage>&#x2013;<lpage>1463</lpage>. doi: <pub-id pub-id-type="doi">10.1038/nn1584</pub-id>, PMID: <pub-id pub-id-type="pmid">16251988</pub-id></citation></ref>
<ref id="ref13"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Beckmann</surname> <given-names>J.</given-names></name> <name><surname>Heckhausen</surname> <given-names>H.</given-names></name></person-group> (<year>2018</year>). &#x201C;<article-title>Motivation as a function of expectancy and incentive</article-title>&#x201D; in <source>Motivation and action</source>. eds. <person-group person-group-type="editor"><name><surname>Heckhausen</surname> <given-names>J.</given-names></name> <name><surname>Heckhausen</surname> <given-names>H.</given-names></name></person-group> (<publisher-name>Cham, Switzerland: Springer</publisher-name>), <fpage>163</fpage>&#x2013;<lpage>220</lpage>.</citation></ref>
<ref id="ref14"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Belanger-Gravel</surname> <given-names>A.</given-names></name> <name><surname>Godin</surname> <given-names>G.</given-names></name> <name><surname>Bilodeau</surname> <given-names>A.</given-names></name> <name><surname>Poirier</surname> <given-names>P.</given-names></name></person-group> (<year>2013</year>). <article-title>The effect of implementation intentions on physical activity among obese older adults: a randomised control study</article-title>. <source>Psychol Health</source> <volume>28</volume>, <fpage>217</fpage>&#x2013;<lpage>233</lpage>. doi: <pub-id pub-id-type="doi">10.1080/08870446.2012.723711</pub-id>, PMID: <pub-id pub-id-type="pmid">23005579</pub-id></citation></ref>
<ref id="ref15"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Belova</surname> <given-names>M. A.</given-names></name> <name><surname>Paton</surname> <given-names>J. J.</given-names></name> <name><surname>Morrison</surname> <given-names>S. E.</given-names></name> <name><surname>Salzman</surname> <given-names>C. D.</given-names></name></person-group> (<year>2007</year>). <article-title>Expectation modulates neural responses to pleasant and aversive stimuli in primate amygdala</article-title>. <source>Neuron</source> <volume>55</volume>, <fpage>970</fpage>&#x2013;<lpage>984</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.neuron.2007.08.004</pub-id>, PMID: <pub-id pub-id-type="pmid">17880899</pub-id></citation></ref>
<ref id="ref16"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Benhabib</surname> <given-names>J.</given-names></name> <name><surname>Bisin</surname> <given-names>A.</given-names></name></person-group> (<year>2005</year>). <article-title>Modeling internal commitment mechanisms and self-control: a neuroeconomics approach to consumption-saving decisions</article-title>. <source>Games Econ Behav</source> <volume>52</volume>, <fpage>460</fpage>&#x2013;<lpage>492</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.geb.2004.10.004</pub-id></citation></ref>
<ref id="ref17"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Benzion</surname> <given-names>U.</given-names></name> <name><surname>Rapoport</surname> <given-names>A.</given-names></name> <name><surname>Yagil</surname> <given-names>J.</given-names></name></person-group> (<year>1989</year>). <article-title>Discount rates inferred from decisions: an experimental study</article-title>. <source>Manag Sci</source> <volume>35</volume>, <fpage>270</fpage>&#x2013;<lpage>284</lpage>. doi: <pub-id pub-id-type="doi">10.1287/mnsc.35.3.270</pub-id>, PMID: <pub-id pub-id-type="pmid">19642375</pub-id></citation></ref>
<ref id="ref18"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Berkman</surname> <given-names>E. T.</given-names></name> <name><surname>Lieberman</surname> <given-names>M. D.</given-names></name></person-group> (<year>2009</year>). &#x201C;<article-title>The neuroscience of goal pursuit</article-title>&#x201D; in <source>The psychology of goals</source>. eds. <person-group person-group-type="editor"><name><surname>Moskowitz</surname> <given-names>G.</given-names></name> <name><surname>Grant</surname> <given-names>H.</given-names></name></person-group> (<publisher-loc>New York</publisher-loc>: <publisher-name>Guilford Press</publisher-name>), <fpage>98</fpage>&#x2013;<lpage>126</lpage>.</citation></ref>
<ref id="ref19"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bernardi</surname> <given-names>S.</given-names></name> <name><surname>Salzman</surname> <given-names>C. D.</given-names></name></person-group> (<year>2019</year>). <article-title>The contribution of nonhuman primate research to the understanding of emotion and cognition and its clinical relevance</article-title>. <source>Proc Natl Acad Sci USA</source> <volume>116</volume>, <fpage>26305</fpage>&#x2013;<lpage>26312</lpage>. doi: <pub-id pub-id-type="doi">10.1073/pnas.1902293116</pub-id>, PMID: <pub-id pub-id-type="pmid">31871162</pub-id></citation></ref>
<ref id="ref20"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bickel</surname> <given-names>W. K.</given-names></name> <name><surname>Jarmolowicz</surname> <given-names>D. P.</given-names></name> <name><surname>Mueller</surname> <given-names>E. T.</given-names></name> <name><surname>Koffarnus</surname> <given-names>M. N.</given-names></name> <name><surname>Gatchalian</surname> <given-names>K. M.</given-names></name></person-group> (<year>2012</year>). <article-title>Excessive discounting of delayed reinforcers as a trans-disease process contributing to addiction and other disease-related vulnerabilities: emerging evidence</article-title>. <source>Pharmacol Ther</source> <volume>134</volume>, <fpage>287</fpage>&#x2013;<lpage>297</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.pharmthera.2012.02.004</pub-id>, PMID: <pub-id pub-id-type="pmid">22387232</pub-id></citation></ref>
<ref id="ref21"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Brandstatter</surname> <given-names>V.</given-names></name> <name><surname>Hennecke</surname> <given-names>M.</given-names></name></person-group> (<year>2018</year>). &#x201C;<article-title>Goals</article-title>&#x201D; in <source>Motivation and action</source>. eds. <person-group person-group-type="editor"><name><surname>Heckhausen</surname> <given-names>J.</given-names></name> <name><surname>Heckhausen</surname> <given-names>H.</given-names></name></person-group>. <edition>Third</edition> ed (Cham, Switzerland: <publisher-name>Springer</publisher-name>), <fpage>485</fpage>&#x2013;<lpage>528</lpage>.</citation></ref>
<ref id="ref22"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Brunstein</surname> <given-names>J. C.</given-names></name> <name><surname>Heckhausen</surname> <given-names>H.</given-names></name></person-group> (<year>2018</year>). &#x201C;<article-title>Achievement motivation</article-title>&#x201D; in <source>Motivation and action</source>. eds. <person-group person-group-type="editor"><name><surname>Heckhausen</surname> <given-names>J.</given-names></name> <name><surname>Heckhausen</surname> <given-names>H.</given-names></name></person-group> (<publisher-name>Cham, Switzerland: Springer</publisher-name>).</citation></ref>
<ref id="ref23"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Burrell</surname> <given-names>M.</given-names></name> <name><surname>Pastor-Bernier</surname> <given-names>A.</given-names></name> <name><surname>Schultz</surname> <given-names>W.</given-names></name></person-group> (<year>2023</year>). <article-title>Worth the work? Monkeys discount rewards by a subjective adapting effort cost</article-title>. <source>J Neurosci</source> <volume>43</volume>, <fpage>6796</fpage>&#x2013;<lpage>6806</lpage>. doi: <pub-id pub-id-type="doi">10.1523/JNEUROSCI.0115-23.2023</pub-id>, PMID: <pub-id pub-id-type="pmid">37625854</pub-id></citation></ref>
<ref id="ref24"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cardinal</surname> <given-names>N.</given-names></name> <name><surname>Parkinson</surname> <given-names>J. A.</given-names></name> <name><surname>Hall</surname> <given-names>J.</given-names></name> <name><surname>Everitt</surname> <given-names>B. J.</given-names></name></person-group> (<year>2002</year>). <article-title>Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex</article-title>. <source>Neurosci Biobehav Rev</source> <volume>26</volume>, <fpage>321</fpage>&#x2013;<lpage>352</lpage>. doi: <pub-id pub-id-type="doi">10.1016/S0149-7634(02)00007-6</pub-id>, PMID: <pub-id pub-id-type="pmid">12034134</pub-id></citation></ref>
<ref id="ref25"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Casey</surname> <given-names>B. J.</given-names></name> <name><surname>Somerville</surname> <given-names>L. H.</given-names></name> <name><surname>Gotlib</surname> <given-names>I. H.</given-names></name> <name><surname>Ayduk</surname> <given-names>O.</given-names></name> <name><surname>Franklin</surname> <given-names>N. T.</given-names></name> <name><surname>Askren</surname> <given-names>M. K.</given-names></name> <etal/></person-group>. (<year>2011</year>). <article-title>Behavioral and neural correlates of delay of gratification 40 years later</article-title>. <source>Proc Natl Acad Sci USA</source> <volume>108</volume>, <fpage>14998</fpage>&#x2013;<lpage>15003</lpage>. doi: <pub-id pub-id-type="doi">10.1073/pnas.1108561108</pub-id>, PMID: <pub-id pub-id-type="pmid">21876169</pub-id></citation></ref>
<ref id="ref26"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chang</surname> <given-names>S. W.</given-names></name> <name><surname>Fagan</surname> <given-names>N. A.</given-names></name> <name><surname>Toda</surname> <given-names>K.</given-names></name> <name><surname>Utevsky</surname> <given-names>A. V.</given-names></name> <name><surname>Pearson</surname> <given-names>J. M.</given-names></name> <name><surname>Platt</surname> <given-names>M. L.</given-names></name></person-group> (<year>2015</year>). <article-title>Neural mechanisms of social decision-making in the primate amygdala</article-title>. <source>Proc Natl Acad Sci USA</source> <volume>112</volume>, <fpage>16012</fpage>&#x2013;<lpage>16017</lpage>. doi: <pub-id pub-id-type="doi">10.1073/pnas.1514761112</pub-id>, PMID: <pub-id pub-id-type="pmid">26668400</pub-id></citation></ref>
<ref id="ref27"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Costa</surname> <given-names>V. D.</given-names></name> <name><surname>Mitz</surname> <given-names>A. R.</given-names></name> <name><surname>Averbeck</surname> <given-names>B. B.</given-names></name></person-group> (<year>2019</year>). <article-title>Subcortical substrates of explore-exploit decisions in Primates</article-title>. <source>Neuron</source> <volume>103</volume>:<fpage>e535</fpage>. doi: <pub-id pub-id-type="doi">10.1016/j.neuron.2019.05.017</pub-id>, PMID: <pub-id pub-id-type="pmid">31196672</pub-id></citation></ref>
<ref id="ref28"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Deci</surname> <given-names>E. L.</given-names></name> <name><surname>Ryan</surname> <given-names>R. M.</given-names></name></person-group> (<year>2000</year>). <article-title>The &#x201C;what&#x201D; and &#x201C;why&#x201D; of goal pursuits: human needs and the self-determination of behavior</article-title>. <source>Psychol Inq</source> <volume>11</volume>, <fpage>227</fpage>&#x2013;<lpage>268</lpage>. doi: <pub-id pub-id-type="doi">10.1207/S15327965PLI1104_01</pub-id></citation></ref>
<ref id="ref29"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>DeFulio</surname> <given-names>A.</given-names></name> <name><surname>Yankelevitz</surname> <given-names>R.</given-names></name> <name><surname>Bullock</surname> <given-names>C.</given-names></name> <name><surname>Hackenberg</surname> <given-names>T. D.</given-names></name></person-group> (<year>2014</year>). <article-title>Generalized conditioned reinforcement with pigeons in a token economy</article-title>. <source>J Exp Anal Behav</source> <volume>102</volume>, <fpage>26</fpage>&#x2013;<lpage>46</lpage>. doi: <pub-id pub-id-type="doi">10.1002/jeab.94</pub-id>, PMID: <pub-id pub-id-type="pmid">24979723</pub-id></citation></ref>
<ref id="ref30"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Diamond</surname> <given-names>A.</given-names></name> <name><surname>Lee</surname> <given-names>K.</given-names></name></person-group> (<year>2011</year>). <article-title>Interventions shown to aid executive function development in children 4 to 12 years old</article-title>. <source>Science</source> <volume>333</volume>, <fpage>959</fpage>&#x2013;<lpage>964</lpage>. doi: <pub-id pub-id-type="doi">10.1126/science.1204529</pub-id>, PMID: <pub-id pub-id-type="pmid">21852486</pub-id></citation></ref>
<ref id="ref31"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dickinson</surname> <given-names>A.</given-names></name> <name><surname>Balleine</surname> <given-names>B.</given-names></name></person-group> (<year>1994</year>). <article-title>Motivational control of goal-directed action</article-title>. <source>Anim Learn Behav</source> <volume>22</volume>, <fpage>1</fpage>&#x2013;<lpage>18</lpage>. doi: <pub-id pub-id-type="doi">10.3758/BF03199951</pub-id></citation></ref>
<ref id="ref32"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Doll</surname> <given-names>B. B.</given-names></name> <name><surname>Duncan</surname> <given-names>K. D.</given-names></name> <name><surname>Simon</surname> <given-names>D. A.</given-names></name> <name><surname>Shohamy</surname> <given-names>D.</given-names></name> <name><surname>Daw</surname> <given-names>N. D.</given-names></name></person-group> (<year>2015</year>). <article-title>Model-based choices involve prospective neural activity</article-title>. <source>Nat Neurosci</source> <volume>18</volume>, <fpage>767</fpage>&#x2013;<lpage>772</lpage>. doi: <pub-id pub-id-type="doi">10.1038/nn.3981</pub-id>, PMID: <pub-id pub-id-type="pmid">25799041</pub-id></citation></ref>
<ref id="ref33"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Duckworth</surname> <given-names>A. L.</given-names></name> <name><surname>Kirby</surname> <given-names>T.</given-names></name> <name><surname>Gollwitzer</surname> <given-names>A.</given-names></name> <name><surname>Oettingen</surname> <given-names>G.</given-names></name></person-group> (<year>2013</year>). <article-title>From fantasy to action: mental contrasting with implementation intentions (MCII) improves academic performance in children</article-title>. <source>Soc Psychol Personal Sci</source> <volume>4</volume>, <fpage>745</fpage>&#x2013;<lpage>753</lpage>. doi: <pub-id pub-id-type="doi">10.1177/1948550613476307</pub-id>, PMID: <pub-id pub-id-type="pmid">25068007</pub-id></citation></ref>
<ref id="ref34"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Duvarci</surname> <given-names>S.</given-names></name> <name><surname>Pare</surname> <given-names>D.</given-names></name></person-group> (<year>2014</year>). <article-title>Amygdala microcircuits controlling learned fear</article-title>. <source>Neuron</source> <volume>82</volume>, <fpage>966</fpage>&#x2013;<lpage>980</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.neuron.2014.04.042</pub-id>, PMID: <pub-id pub-id-type="pmid">24908482</pub-id></citation></ref>
<ref id="ref35"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fox</surname> <given-names>A. S.</given-names></name> <name><surname>Shackman</surname> <given-names>A. J.</given-names></name></person-group> (<year>2024</year>). <article-title>An honest reckoning with the amygdala and mental illness</article-title>. <source>Am J Psychiatry</source> <volume>181</volume>, <fpage>1059</fpage>&#x2013;<lpage>1075</lpage>. doi: <pub-id pub-id-type="doi">10.1176/appi.ajp.20240941</pub-id>, PMID: <pub-id pub-id-type="pmid">39616453</pub-id></citation></ref>
<ref id="ref36"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ghods-Sharifi</surname> <given-names>S.</given-names></name> <name><surname>St Onge</surname> <given-names>J. R.</given-names></name> <name><surname>Floresco</surname> <given-names>S. B.</given-names></name></person-group> (<year>2009</year>). <article-title>Fundamental contribution by the basolateral amygdala to different forms of decision making</article-title>. <source>J Neurosci</source> <volume>29</volume>, <fpage>5251</fpage>&#x2013;<lpage>5259</lpage>. doi: <pub-id pub-id-type="doi">10.1523/JNEUROSCI.0315-09.2009</pub-id>, PMID: <pub-id pub-id-type="pmid">19386921</pub-id></citation></ref>
<ref id="ref37"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gillan</surname> <given-names>C. M.</given-names></name> <name><surname>Kalanthroff</surname> <given-names>E.</given-names></name> <name><surname>Evans</surname> <given-names>M.</given-names></name> <name><surname>Weingarden</surname> <given-names>H. M.</given-names></name> <name><surname>Jacoby</surname> <given-names>R. J.</given-names></name> <name><surname>Gershkovich</surname> <given-names>M.</given-names></name> <etal/></person-group>. (<year>2020</year>). <article-title>Comparison of the association between goal-directed planning and self-reported compulsivity vs obsessive-compulsive disorder diagnosis</article-title>. <source>JAMA Psychiatry</source> <volume>77</volume>, <fpage>77</fpage>&#x2013;<lpage>85</lpage>. doi: <pub-id pub-id-type="doi">10.1001/jamapsychiatry.2019.2998</pub-id>, PMID: <pub-id pub-id-type="pmid">31596434</pub-id></citation></ref>
<ref id="ref38"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gollwitzer</surname> <given-names>P. M.</given-names></name></person-group> (<year>1993</year>). <article-title>Goal achievement: the role of intentions</article-title>. <source>Eur Rev Soc Psychol</source> <volume>4</volume>, <fpage>141</fpage>&#x2013;<lpage>185</lpage>. doi: <pub-id pub-id-type="doi">10.1080/14792779343000059</pub-id></citation></ref>
<ref id="ref39"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gollwitzer</surname> <given-names>P. M.</given-names></name> <name><surname>Schaal</surname> <given-names>B.</given-names></name></person-group> (<year>1998</year>). <article-title>Metacognition in action: the importance of implementation intentions</article-title>. <source>Personal Soc Psychol Rev</source> <volume>2</volume>, <fpage>124</fpage>&#x2013;<lpage>136</lpage>. doi: <pub-id pub-id-type="doi">10.1207/s15327957pspr0202_5</pub-id>, PMID: <pub-id pub-id-type="pmid">15647140</pub-id></citation></ref>
<ref id="ref40"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gothard</surname> <given-names>K. M.</given-names></name></person-group> (<year>2020</year>). <article-title>Multidimensional processing in the amygdala</article-title>. <source>Nat Rev Neurosci</source> <volume>21</volume>, <fpage>565</fpage>&#x2013;<lpage>575</lpage>. doi: <pub-id pub-id-type="doi">10.1038/s41583-020-0350-y</pub-id>, PMID: <pub-id pub-id-type="pmid">32839565</pub-id></citation></ref>
<ref id="ref41"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Grabenhorst</surname> <given-names>F.</given-names></name> <name><surname>Baez-Mendoza</surname> <given-names>R.</given-names></name> <name><surname>Genest</surname> <given-names>W.</given-names></name> <name><surname>Deco</surname> <given-names>G.</given-names></name> <name><surname>Schultz</surname> <given-names>W.</given-names></name></person-group> (<year>2019</year>). <article-title>Primate amygdala neurons simulate decision processes of social partners</article-title>. <source>Cell</source> <volume>177</volume>, <fpage>986</fpage>&#x2013;<lpage>998.e15</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.cell.2019.02.042</pub-id>, PMID: <pub-id pub-id-type="pmid">30982599</pub-id></citation></ref>
<ref id="ref42"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Grabenhorst</surname> <given-names>F.</given-names></name> <name><surname>Hernadi</surname> <given-names>I.</given-names></name> <name><surname>Schultz</surname> <given-names>W.</given-names></name></person-group> (<year>2012</year>). <article-title>Prediction of economic choice by primate amygdala neurons</article-title>. <source>Proc Natl Acad Sci USA</source> <volume>109</volume>, <fpage>18950</fpage>&#x2013;<lpage>18955</lpage>. doi: <pub-id pub-id-type="doi">10.1073/pnas.1212706109</pub-id>, PMID: <pub-id pub-id-type="pmid">23112182</pub-id></citation></ref>
<ref id="ref43"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Grabenhorst</surname> <given-names>F.</given-names></name> <name><surname>Hernadi</surname> <given-names>I.</given-names></name> <name><surname>Schultz</surname> <given-names>W.</given-names></name></person-group> (<year>2016</year>). <article-title>Primate amygdala neurons evaluate the progress of self-defined economic choice sequences</article-title>. <source>eLife</source> <volume>5</volume>:<fpage>5</fpage>. doi: <pub-id pub-id-type="doi">10.7554/eLife.18731</pub-id>, PMID: <pub-id pub-id-type="pmid">27731795</pub-id></citation></ref>
<ref id="ref44"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Grabenhorst</surname> <given-names>F.</given-names></name> <name><surname>Ponce-Alvarez</surname> <given-names>A.</given-names></name> <name><surname>Battaglia-Mayer</surname> <given-names>A.</given-names></name> <name><surname>Deco</surname> <given-names>G.</given-names></name> <name><surname>Schultz</surname> <given-names>W.</given-names></name></person-group> (<year>2023</year>). <article-title>A view-based decision mechanism for rewards in the primate amygdala</article-title>. <source>Neuron</source> <volume>111</volume>:<fpage>e3814</fpage>. doi: <pub-id pub-id-type="doi">10.1016/j.neuron.2023.08.024</pub-id>, PMID: <pub-id pub-id-type="pmid">37725980</pub-id></citation></ref>
<ref id="ref45"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Grabenhorst</surname> <given-names>F.</given-names></name> <name><surname>Rolls</surname> <given-names>E. T.</given-names></name></person-group> (<year>2011</year>). <article-title>Value, pleasure, and choice in the ventral prefrontal cortex</article-title>. <source>Trends Cogn Sci</source> <volume>15</volume>, <fpage>56</fpage>&#x2013;<lpage>67</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.tics.2010.12.004</pub-id>, PMID: <pub-id pub-id-type="pmid">21216655</pub-id></citation></ref>
<ref id="ref46"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Grabenhorst</surname> <given-names>F.</given-names></name> <name><surname>Rolls</surname> <given-names>E. T.</given-names></name> <name><surname>Margot</surname> <given-names>C.</given-names></name> <name><surname>da Silva</surname> <given-names>M. A. A. P.</given-names></name> <name><surname>Velazco</surname> <given-names>M. I.</given-names></name></person-group> (<year>2007</year>). <article-title>How pleasant and unpleasant stimuli combine in different brain regions: odor mixtures</article-title>. <source>J Neurosci</source> <volume>27</volume>, <fpage>13532</fpage>&#x2013;<lpage>13540</lpage>. doi: <pub-id pub-id-type="doi">10.1523/JNEUROSCI.3337-07.2007</pub-id>, PMID: <pub-id pub-id-type="pmid">18057211</pub-id></citation></ref>
<ref id="ref47"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Grabenhorst</surname> <given-names>F.</given-names></name> <name><surname>Rolls</surname> <given-names>E. T.</given-names></name> <name><surname>Parris</surname> <given-names>B. A.</given-names></name> <name><surname>D&#x2019;Souza</surname> <given-names>A.</given-names></name></person-group> (<year>2010</year>). <article-title>How the brain represents the reward value of fat in the mouth</article-title>. <source>Cereb Cortex</source> <volume>20</volume>, <fpage>1082</fpage>&#x2013;<lpage>1091</lpage>. doi: <pub-id pub-id-type="doi">10.1093/cercor/bhp169</pub-id>, PMID: <pub-id pub-id-type="pmid">19684248</pub-id></citation></ref>
<ref id="ref48"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Grabenhorst</surname> <given-names>F.</given-names></name> <name><surname>Schultz</surname> <given-names>W.</given-names></name></person-group> (<year>2021</year>). <article-title>Functions of primate amygdala neurons in economic decisions and social decision simulation</article-title>. <source>Behav Brain Res</source> <volume>409</volume>:<fpage>113318</fpage>. doi: <pub-id pub-id-type="doi">10.1016/j.bbr.2021.113318</pub-id>, PMID: <pub-id pub-id-type="pmid">33901436</pub-id></citation></ref>
<ref id="ref49"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Green</surname> <given-names>L.</given-names></name> <name><surname>Fristoe</surname> <given-names>N.</given-names></name> <name><surname>Myerson</surname> <given-names>J.</given-names></name></person-group> (<year>1994</year>). <article-title>Temporal discounting and preference reversals in choice between delayed outcomes</article-title>. <source>Psychon Bull Rev</source> <volume>1</volume>, <fpage>383</fpage>&#x2013;<lpage>389</lpage>. doi: <pub-id pub-id-type="doi">10.3758/BF03213979</pub-id>, PMID: <pub-id pub-id-type="pmid">24203522</pub-id></citation></ref>
<ref id="ref50"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Green</surname> <given-names>L.</given-names></name> <name><surname>Myerson</surname> <given-names>J.</given-names></name></person-group> (<year>1996</year>). <article-title>Exponential versus hyperbolic discounting of delayed outcomes: risk and waiting time</article-title>. <source>Am Zool</source> <volume>36</volume>, <fpage>496</fpage>&#x2013;<lpage>505</lpage>. doi: <pub-id pub-id-type="doi">10.1093/icb/36.4.496</pub-id></citation></ref>
<ref id="ref51"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Grolnick</surname> <given-names>W. S.</given-names></name> <name><surname>Ryan</surname> <given-names>R. M.</given-names></name></person-group> (<year>1987</year>). <article-title>Autonomy in children's learning: an experimental and individual difference investigation</article-title>. <source>J Pers Soc Psychol</source> <volume>52</volume>, <fpage>890</fpage>&#x2013;<lpage>898</lpage>. doi: <pub-id pub-id-type="doi">10.1037/0022-3514.52.5.890</pub-id>, PMID: <pub-id pub-id-type="pmid">3585701</pub-id></citation></ref>
<ref id="ref52"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hackenberg</surname> <given-names>T. D.</given-names></name></person-group> (<year>2009</year>). <article-title>Token reinforcement: a review and analysis</article-title>. <source>J Exp Anal Behav</source> <volume>91</volume>, <fpage>257</fpage>&#x2013;<lpage>286</lpage>. doi: <pub-id pub-id-type="doi">10.1901/jeab.2009.91-257</pub-id>, PMID: <pub-id pub-id-type="pmid">19794838</pub-id></citation></ref>
<ref id="ref53"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hernadi</surname> <given-names>I.</given-names></name> <name><surname>Grabenhorst</surname> <given-names>F.</given-names></name> <name><surname>Schultz</surname> <given-names>W.</given-names></name></person-group> (<year>2015</year>). <article-title>Planning activity for internally generated reward goals in monkey amygdala neurons</article-title>. <source>Nat Neurosci</source> <volume>18</volume>, <fpage>461</fpage>&#x2013;<lpage>469</lpage>. doi: <pub-id pub-id-type="doi">10.1038/nn.3925</pub-id>, PMID: <pub-id pub-id-type="pmid">25622146</pub-id></citation></ref>
<ref id="ref54"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hong</surname> <given-names>T.</given-names></name> <name><surname>Stauffer</surname> <given-names>W. R.</given-names></name></person-group> (<year>2023</year>). <article-title>Computational complexity drives sustained deliberation</article-title>. <source>Nat Neurosci</source> <volume>26</volume>, <fpage>850</fpage>&#x2013;<lpage>857</lpage>. doi: <pub-id pub-id-type="doi">10.1038/s41593-023-01307-6</pub-id>, PMID: <pub-id pub-id-type="pmid">37095398</pub-id></citation></ref>
<ref id="ref55"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hosokawa</surname> <given-names>T.</given-names></name> <name><surname>Kennerley</surname> <given-names>S. W.</given-names></name> <name><surname>Sloan</surname> <given-names>J.</given-names></name> <name><surname>Wallis</surname> <given-names>J. D.</given-names></name></person-group> (<year>2013</year>). <article-title>Single-neuron mechanisms underlying cost-benefit analysis in frontal cortex</article-title>. <source>J Neurosci</source> <volume>33</volume>, <fpage>17385</fpage>&#x2013;<lpage>17397</lpage>. doi: <pub-id pub-id-type="doi">10.1523/JNEUROSCI.2221-13.2013</pub-id>, PMID: <pub-id pub-id-type="pmid">24174671</pub-id></citation></ref>
<ref id="ref56"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Inzlicht</surname> <given-names>M.</given-names></name> <name><surname>Shenhav</surname> <given-names>A.</given-names></name> <name><surname>Olivola</surname> <given-names>C. Y.</given-names></name></person-group> (<year>2018</year>). <article-title>The effort paradox: effort is both costly and valued</article-title>. <source>Trends Cogn Sci</source> <volume>22</volume>, <fpage>337</fpage>&#x2013;<lpage>349</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.tics.2018.01.007</pub-id>, PMID: <pub-id pub-id-type="pmid">29477776</pub-id></citation></ref>
<ref id="ref57"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Iwaoki</surname> <given-names>H.</given-names></name> <name><surname>Nakamura</surname> <given-names>K.</given-names></name></person-group> (<year>2022</year>). <article-title>Neuronal encoding of emotional valence and intensity in the monkey amygdala</article-title>. <source>J Neurosci</source> <volume>42</volume>, <fpage>7615</fpage>&#x2013;<lpage>7623</lpage>. doi: <pub-id pub-id-type="doi">10.1523/JNEUROSCI.0021-22.2022</pub-id>, PMID: <pub-id pub-id-type="pmid">36658460</pub-id></citation></ref>
<ref id="ref58"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Janak</surname> <given-names>P. H.</given-names></name> <name><surname>Tye</surname> <given-names>K. M.</given-names></name></person-group> (<year>2015</year>). <article-title>From circuits to behaviour in the amygdala</article-title>. <source>Nature</source> <volume>517</volume>, <fpage>284</fpage>&#x2013;<lpage>292</lpage>. doi: <pub-id pub-id-type="doi">10.1038/nature14188</pub-id>, PMID: <pub-id pub-id-type="pmid">25592533</pub-id></citation></ref>
<ref id="ref59"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jezzini</surname> <given-names>A.</given-names></name> <name><surname>Padoa-Schioppa</surname> <given-names>C.</given-names></name></person-group> (<year>2020</year>). <article-title>Neuronal activity in the primate amygdala during economic choice</article-title>. <source>J Neurosci</source> <volume>40</volume>, <fpage>1286</fpage>&#x2013;<lpage>1301</lpage>. doi: <pub-id pub-id-type="doi">10.1523/JNEUROSCI.0961-19.2019</pub-id>, PMID: <pub-id pub-id-type="pmid">31871277</pub-id></citation></ref>
<ref id="ref60"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Johansen</surname> <given-names>J. P.</given-names></name> <name><surname>Cain</surname> <given-names>C. K.</given-names></name> <name><surname>Ostroff</surname> <given-names>L. E.</given-names></name> <name><surname>LeDoux</surname> <given-names>J. E.</given-names></name></person-group> (<year>2011</year>). <article-title>Molecular mechanisms of fear learning and memory</article-title>. <source>Cell</source> <volume>147</volume>, <fpage>509</fpage>&#x2013;<lpage>524</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.cell.2011.10.009</pub-id>, PMID: <pub-id pub-id-type="pmid">22036561</pub-id></citation></ref>
<ref id="ref61"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Johnson</surname> <given-names>J. G.</given-names></name> <name><surname>Busemeyer</surname> <given-names>J. R.</given-names></name></person-group> (<year>2001</year>). <article-title>Multiple-stage decision-making: the effect of planning horizon length on dynamic consistency</article-title>. <source>Theor Decis</source> <volume>51</volume>, <fpage>217</fpage>&#x2013;<lpage>246</lpage>. doi: <pub-id pub-id-type="doi">10.1023/A:1015507110940</pub-id></citation></ref>
<ref id="ref62"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Johnson</surname> <given-names>S. T.</given-names></name> <name><surname>Most</surname> <given-names>S. B.</given-names></name></person-group> (<year>2023</year>). <article-title>Taking the path of least resistance now, but not later: pushing cognitive effort into the future reduces effort discounting</article-title>. <source>Psychon Bull Rev</source> <volume>30</volume>, <fpage>1115</fpage>&#x2013;<lpage>1124</lpage>. doi: <pub-id pub-id-type="doi">10.3758/s13423-022-02198-7</pub-id>, PMID: <pub-id pub-id-type="pmid">36333518</pub-id></citation></ref>
<ref id="ref63"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kable</surname> <given-names>J. W.</given-names></name> <name><surname>Glimcher</surname> <given-names>P. W.</given-names></name></person-group> (<year>2007</year>). <article-title>The neural correlates of subjective value during intertemporal choice</article-title>. <source>Nat Neurosci</source> <volume>10</volume>, <fpage>1625</fpage>&#x2013;<lpage>1633</lpage>. doi: <pub-id pub-id-type="doi">10.1038/nn2007</pub-id>, PMID: <pub-id pub-id-type="pmid">17982449</pub-id></citation></ref>
<ref id="ref64"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kim</surname> <given-names>S.</given-names></name> <name><surname>Hwang</surname> <given-names>J.</given-names></name> <name><surname>Lee</surname> <given-names>D.</given-names></name></person-group> (<year>2008</year>). <article-title>Prefrontal coding of temporally discounted values during intertemporal choice</article-title>. <source>Neuron</source> <volume>59</volume>, <fpage>161</fpage>&#x2013;<lpage>172</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.neuron.2008.05.010</pub-id>, PMID: <pub-id pub-id-type="pmid">18614037</pub-id></citation></ref>
<ref id="ref65"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kirby</surname> <given-names>T.</given-names></name> <name><surname>Herrnstein</surname> <given-names>R. J.</given-names></name></person-group> (<year>1995</year>). <article-title>Preference reversals due to myopic discounting of delayed reward</article-title>. <source>Psychol Sci</source> <volume>6</volume>, <fpage>83</fpage>&#x2013;<lpage>89</lpage>. doi: <pub-id pub-id-type="doi">10.1111/j.1467-9280.1995.tb00311.x</pub-id></citation></ref>
<ref id="ref66"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Klein-Flugge</surname> <given-names>M. C.</given-names></name> <name><surname>Jensen</surname> <given-names>D. E. A.</given-names></name> <name><surname>Takagi</surname> <given-names>Y.</given-names></name> <name><surname>Priestley</surname> <given-names>L.</given-names></name> <name><surname>Verhagen</surname> <given-names>L.</given-names></name> <name><surname>Smith</surname> <given-names>S. M.</given-names></name> <etal/></person-group>. (<year>2022</year>). <article-title>Relationship between nuclei-specific amygdala connectivity and mental health dimensions in humans</article-title>. <source>Nat Hum Behav</source> <volume>6</volume>, <fpage>1705</fpage>&#x2013;<lpage>1722</lpage>. doi: <pub-id pub-id-type="doi">10.1038/s41562-022-01434-3</pub-id>, PMID: <pub-id pub-id-type="pmid">36138220</pub-id></citation></ref>
<ref id="ref67"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kobayashi</surname> <given-names>S.</given-names></name> <name><surname>Schultz</surname> <given-names>W.</given-names></name></person-group> (<year>2008</year>). <article-title>Influence of reward delays on responses of dopamine neurons</article-title>. <source>J Neurosci</source> <volume>28</volume>, <fpage>7837</fpage>&#x2013;<lpage>7846</lpage>. doi: <pub-id pub-id-type="doi">10.1523/JNEUROSCI.1600-08.2008</pub-id>, PMID: <pub-id pub-id-type="pmid">18667616</pub-id></citation></ref>
<ref id="ref68"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Korn</surname> <given-names>C. W.</given-names></name> <name><surname>Sharot</surname> <given-names>T.</given-names></name> <name><surname>Walter</surname> <given-names>H.</given-names></name> <name><surname>Heekeren</surname> <given-names>H. R.</given-names></name> <name><surname>Dolan</surname> <given-names>R. J.</given-names></name></person-group> (<year>2014</year>). <article-title>Depression is related to an absence of optimistically biased belief updating about future life events</article-title>. <source>Psychol Med</source> <volume>44</volume>, <fpage>579</fpage>&#x2013;<lpage>592</lpage>. doi: <pub-id pub-id-type="doi">10.1017/S0033291713001074</pub-id>, PMID: <pub-id pub-id-type="pmid">23672737</pub-id></citation></ref>
<ref id="ref69"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kringelbach</surname> <given-names>M. L.</given-names></name> <name><surname>O'Doherty</surname> <given-names>J.</given-names></name> <name><surname>Rolls</surname> <given-names>E. T.</given-names></name> <name><surname>Andrews</surname> <given-names>C.</given-names></name></person-group> (<year>2003</year>). <article-title>Activation of the human orbitofrontal cortex to a liquid food stimulus is correlated with its subjective pleasantness</article-title>. <source>Cereb Cortex</source> <volume>13</volume>, <fpage>1064</fpage>&#x2013;<lpage>1071</lpage>. doi: <pub-id pub-id-type="doi">10.1093/cercor/13.10.1064</pub-id>, PMID: <pub-id pub-id-type="pmid">12967923</pub-id></citation></ref>
<ref id="ref70"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kurata</surname> <given-names>K.</given-names></name> <name><surname>Wise</surname> <given-names>S. P.</given-names></name></person-group> (<year>1988</year>). <article-title>Premotor and supplementary motor cortex in rhesus monkeys: neuronal activity during externally- and internally-instructed motor tasks</article-title>. <source>Experimental brain research Experimentelle Hirnforschung Experimentation cerebrale</source> <volume>72</volume>, <fpage>237</fpage>&#x2013;<lpage>248</lpage>. doi: <pub-id pub-id-type="doi">10.1007/BF00250247</pub-id>, PMID: <pub-id pub-id-type="pmid">3224641</pub-id></citation></ref>
<ref id="ref71"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Leathers</surname> <given-names>M. L.</given-names></name> <name><surname>Olson</surname> <given-names>C. R.</given-names></name></person-group> (<year>2017</year>). <article-title>In monkeys making value-based decisions, amygdala neurons are sensitive to cue value as distinct from cue salience</article-title>. <source>J Neurophysiol</source> <volume>117</volume>, <fpage>1499</fpage>&#x2013;<lpage>1511</lpage>. doi: <pub-id pub-id-type="doi">10.1152/jn.00564.2016</pub-id>, PMID: <pub-id pub-id-type="pmid">28077664</pub-id></citation></ref>
<ref id="ref72"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lee</surname> <given-names>I. H.</given-names></name> <name><surname>Seitz</surname> <given-names>A. R.</given-names></name> <name><surname>Assad</surname> <given-names>J. A.</given-names></name></person-group> (<year>2006</year>). <article-title>Activity of tonically active neurons in the monkey putamen during initiation and withholding of movement</article-title>. <source>J Neurophysiol</source> <volume>95</volume>, <fpage>2391</fpage>&#x2013;<lpage>2403</lpage>. doi: <pub-id pub-id-type="doi">10.1152/jn.01053.2005</pub-id>, PMID: <pub-id pub-id-type="pmid">16407429</pub-id></citation></ref>
<ref id="ref73"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Maren</surname> <given-names>S.</given-names></name> <name><surname>Quirk</surname> <given-names>G. J.</given-names></name></person-group> (<year>2004</year>). <article-title>Neuronal signalling of fear memory</article-title>. <source>Nat Rev Neurosci</source> <volume>5</volume>, <fpage>844</fpage>&#x2013;<lpage>852</lpage>. doi: <pub-id pub-id-type="doi">10.1038/nrn1535</pub-id></citation></ref>
<ref id="ref74"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Mazur</surname> <given-names>J. E.</given-names></name></person-group> (<year>1998</year>). <source>Learning and behavior</source>. <edition>4th</edition> Edn. <publisher-loc>Upper Saddle River, NJ</publisher-loc>: <publisher-name>Prentice Hall</publisher-name>.</citation></ref>
<ref id="ref75"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>McClure</surname> <given-names>S. M.</given-names></name> <name><surname>Ericson</surname> <given-names>K. M.</given-names></name> <name><surname>Laibson</surname> <given-names>D. I.</given-names></name> <name><surname>Loewenstein</surname> <given-names>G.</given-names></name> <name><surname>Cohen</surname> <given-names>J. D.</given-names></name></person-group> (<year>2007</year>). <article-title>Time discounting for primary rewards</article-title>. <source>J Neurosci</source> <volume>27</volume>, <fpage>5796</fpage>&#x2013;<lpage>5804</lpage>. doi: <pub-id pub-id-type="doi">10.1523/JNEUROSCI.4246-06.2007</pub-id>, PMID: <pub-id pub-id-type="pmid">17522323</pub-id></citation></ref>
<ref id="ref76"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>McClure</surname> <given-names>S. M.</given-names></name> <name><surname>Laibson</surname> <given-names>D. I.</given-names></name> <name><surname>Loewenstein</surname> <given-names>G.</given-names></name> <name><surname>Cohen</surname> <given-names>J. D.</given-names></name></person-group> (<year>2004</year>). <article-title>Separate neural systems value immediate and delayed monetary rewards</article-title>. <source>Science</source> <volume>306</volume>, <fpage>503</fpage>&#x2013;<lpage>507</lpage>. doi: <pub-id pub-id-type="doi">10.1126/science.1100907</pub-id>, PMID: <pub-id pub-id-type="pmid">15486304</pub-id></citation></ref>
<ref id="ref77"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>McGuire</surname> <given-names>J. T.</given-names></name> <name><surname>Kable</surname> <given-names>J. W.</given-names></name></person-group> (<year>2015</year>). <article-title>Medial prefrontal cortical activity reflects dynamic re-evaluation during voluntary persistence</article-title>. <source>Nat Neurosci</source> <volume>18</volume>, <fpage>760</fpage>&#x2013;<lpage>766</lpage>. doi: <pub-id pub-id-type="doi">10.1038/nn.3994</pub-id>, PMID: <pub-id pub-id-type="pmid">25849988</pub-id></citation></ref>
<ref id="ref78"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Michie</surname> <given-names>S.</given-names></name> <name><surname>Richardson</surname> <given-names>M.</given-names></name> <name><surname>Johnston</surname> <given-names>M.</given-names></name> <name><surname>Abraham</surname> <given-names>C.</given-names></name> <name><surname>Francis</surname> <given-names>J.</given-names></name> <name><surname>Hardeman</surname> <given-names>W.</given-names></name> <etal/></person-group>. (<year>2013</year>). <article-title>The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions</article-title>. <source>Ann Behav Med</source> <volume>46</volume>, <fpage>81</fpage>&#x2013;<lpage>95</lpage>. doi: <pub-id pub-id-type="doi">10.1007/s12160-013-9486-6</pub-id>, PMID: <pub-id pub-id-type="pmid">23512568</pub-id></citation></ref>
<ref id="ref79"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Miller</surname> <given-names>G. A.</given-names></name> <name><surname>Galanter</surname> <given-names>E.</given-names></name> <name><surname>Pribram</surname> <given-names>K. H.</given-names></name></person-group> (<year>1960</year>). <source>Plans and the structure of behavior: Holt</source>. <publisher-name>New York: Rinehart and Winston, Inc</publisher-name>.</citation></ref>
<ref id="ref80"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Moore</surname> <given-names>E.</given-names></name> <name><surname>Holding</surname> <given-names>A. C.</given-names></name> <name><surname>Moore</surname> <given-names>A.</given-names></name> <name><surname>Levine</surname> <given-names>S. L.</given-names></name> <name><surname>Powers</surname> <given-names>T. A.</given-names></name> <name><surname>Zuroff</surname> <given-names>D. C.</given-names></name> <etal/></person-group>. (<year>2021</year>). <article-title>The role of goal-related autonomy: a self-determination theory analysis of perfectionism, poor goal progress, and depressive symptoms</article-title>. <source>J Couns Psychol</source> <volume>68</volume>, <fpage>88</fpage>&#x2013;<lpage>97</lpage>. doi: <pub-id pub-id-type="doi">10.1037/cou0000438</pub-id>, PMID: <pub-id pub-id-type="pmid">32352824</pub-id></citation></ref>
<ref id="ref81"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Morrison</surname> <given-names>S. E.</given-names></name> <name><surname>Salzman</surname> <given-names>C. D.</given-names></name></person-group> (<year>2010</year>). <article-title>Re-valuing the amygdala</article-title>. <source>Curr Opin Neurobiol</source> <volume>20</volume>, <fpage>221</fpage>&#x2013;<lpage>230</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.conb.2010.02.007</pub-id>, PMID: <pub-id pub-id-type="pmid">20299204</pub-id></citation></ref>
<ref id="ref82"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Murawski</surname> <given-names>C.</given-names></name> <name><surname>Bossaerts</surname> <given-names>P.</given-names></name></person-group> (<year>2016</year>). <article-title>How humans solve complex problems: the case of the knapsack problem</article-title>. <source>Sci Rep</source> <volume>6</volume>:<fpage>34851</fpage>. doi: <pub-id pub-id-type="doi">10.1038/srep34851</pub-id>, PMID: <pub-id pub-id-type="pmid">27713516</pub-id></citation></ref>
<ref id="ref83"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Murray</surname> <given-names>E. A.</given-names></name></person-group> (<year>2007</year>). <article-title>The amygdala, reward and emotion</article-title>. <source>Trends Cogn Sci</source> <volume>11</volume>, <fpage>489</fpage>&#x2013;<lpage>497</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.tics.2007.08.013</pub-id>, PMID: <pub-id pub-id-type="pmid">17988930</pub-id></citation></ref>
<ref id="ref84"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mushiake</surname> <given-names>H.</given-names></name> <name><surname>Saito</surname> <given-names>N.</given-names></name> <name><surname>Sakamoto</surname> <given-names>K.</given-names></name> <name><surname>Itoyama</surname> <given-names>Y.</given-names></name> <name><surname>Tanji</surname> <given-names>J.</given-names></name></person-group> (<year>2006</year>). <article-title>Activity in the lateral prefrontal cortex reflects multiple steps of future events in action plans</article-title>. <source>Neuron</source> <volume>50</volume>, <fpage>631</fpage>&#x2013;<lpage>641</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.neuron.2006.03.045</pub-id>, PMID: <pub-id pub-id-type="pmid">16701212</pub-id></citation></ref>
<ref id="ref85"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nishijo</surname> <given-names>H.</given-names></name> <name><surname>Hori</surname> <given-names>E.</given-names></name> <name><surname>Tazumi</surname> <given-names>T.</given-names></name> <name><surname>Ono</surname> <given-names>T.</given-names></name></person-group> (<year>2008</year>). <article-title>Neural correlates to both emotion and cognitive functions in the monkey amygdala</article-title>. <source>Behav Brain Res</source> <volume>188</volume>, <fpage>14</fpage>&#x2013;<lpage>23</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.bbr.2007.10.013</pub-id>, PMID: <pub-id pub-id-type="pmid">18035429</pub-id></citation></ref>
<ref id="ref86"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Norton</surname> <given-names>M. I.</given-names></name> <name><surname>Mochon</surname> <given-names>D.</given-names></name> <name><surname>Ariely</surname> <given-names>D.</given-names></name></person-group> (<year>2012</year>). <article-title>The IKEA effect: when labor leads to love</article-title>. <source>J Consum Psychol</source> <volume>22</volume>, <fpage>453</fpage>&#x2013;<lpage>460</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.jcps.2011.08.002</pub-id></citation></ref>
<ref id="ref87"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Oettingen</surname> <given-names>G.</given-names></name> <name><surname>Schworer</surname> <given-names>B.</given-names></name></person-group> (<year>2013</year>). <article-title>Mind wandering via mental contrasting as a tool for behavior change</article-title>. <source>Front Psychol</source> <volume>4</volume>:<fpage>562</fpage>. doi: <pub-id pub-id-type="doi">10.3389/fpsyg.2013.00562</pub-id></citation></ref>
<ref id="ref88"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Okano</surname> <given-names>K.</given-names></name> <name><surname>Tanji</surname> <given-names>J.</given-names></name></person-group> (<year>1987</year>). <article-title>Neuronal activities in the primate motor fields of the agranular frontal cortex preceding visually triggered and self-paced movement</article-title>. <source>Exp Brain Res</source> <volume>66</volume>, <fpage>155</fpage>&#x2013;<lpage>166</lpage>. doi: <pub-id pub-id-type="doi">10.1007/BF00236211</pub-id>, PMID: <pub-id pub-id-type="pmid">3582529</pub-id></citation></ref>
<ref id="ref89"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Passingham</surname> <given-names>R. E.</given-names></name> <name><surname>Wise</surname> <given-names>S. P.</given-names></name></person-group> (<year>2012</year>). <source>The neurobiology of the prefrontal cortex</source>. <publisher-loc>Oxford</publisher-loc>: <publisher-name>Oxford University Press</publisher-name>.</citation></ref>
<ref id="ref90"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Paton</surname> <given-names>J. J.</given-names></name> <name><surname>Belova</surname> <given-names>M. A.</given-names></name> <name><surname>Morrison</surname> <given-names>S. E.</given-names></name> <name><surname>Salzman</surname> <given-names>C. D.</given-names></name></person-group> (<year>2006</year>). <article-title>The primate amygdala represents the positive and negative value of visual stimuli during learning</article-title>. <source>Nature</source> <volume>439</volume>, <fpage>865</fpage>&#x2013;<lpage>870</lpage>. doi: <pub-id pub-id-type="doi">10.1038/nature04490</pub-id>, PMID: <pub-id pub-id-type="pmid">16482160</pub-id></citation></ref>
<ref id="ref91"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Paxinos</surname> <given-names>G.</given-names></name> <name><surname>Huang</surname> <given-names>X.-F.</given-names></name> <name><surname>Toga</surname> <given-names>A. W.</given-names></name></person-group> (<year>2000</year>). <source>The rhesus monkey brain in stereotaxic coordinates</source>. <publisher-loc>San Diego, CA</publisher-loc>: <publisher-name>Academic Press</publisher-name>.</citation></ref>
<ref id="ref92"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Peck</surname> <given-names>C. J.</given-names></name> <name><surname>Lau</surname> <given-names>B.</given-names></name> <name><surname>Salzman</surname> <given-names>C. D.</given-names></name></person-group> (<year>2013</year>). <article-title>The primate amygdala combines information about space and value</article-title>. <source>Nat Neurosci</source> <volume>16</volume>, <fpage>340</fpage>&#x2013;<lpage>348</lpage>. doi: <pub-id pub-id-type="doi">10.1038/nn.3328</pub-id>, PMID: <pub-id pub-id-type="pmid">23377126</pub-id></citation></ref>
<ref id="ref93"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pitkanen</surname> <given-names>A.</given-names></name> <name><surname>Amaral</surname> <given-names>D. G.</given-names></name></person-group> (<year>1998</year>). <article-title>Organization of the intrinsic connections of the monkey amygdaloid complex: projections originating in the lateral nucleus</article-title>. <source>J Comp Neurol</source> <volume>398</volume>, <fpage>431</fpage>&#x2013;<lpage>458</lpage>., PMID: <pub-id pub-id-type="pmid">9714153</pub-id></citation></ref>
<ref id="ref94"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pitkanen</surname> <given-names>A.</given-names></name> <name><surname>Savander</surname> <given-names>V.</given-names></name> <name><surname>LeDoux</surname> <given-names>J. E.</given-names></name></person-group> (<year>1997</year>). <article-title>Organization of intra-amygdaloid circuitries in the rat: an emerging framework for understanding functions of the amygdala</article-title>. <source>Trends Neurosci</source> <volume>20</volume>, <fpage>517</fpage>&#x2013;<lpage>523</lpage>. doi: <pub-id pub-id-type="doi">10.1016/S0166-2236(97)01125-9</pub-id>, PMID: <pub-id pub-id-type="pmid">9364666</pub-id></citation></ref>
<ref id="ref95"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Prelec</surname> <given-names>D.</given-names></name> <name><surname>Loewenstein</surname> <given-names>G.</given-names></name></person-group> (<year>1998</year>). <article-title>The red and the black: mental accounting of savings and debt</article-title>. <source>Mark Sci</source> <volume>17</volume>, <fpage>4</fpage>&#x2013;<lpage>28</lpage>. doi: <pub-id pub-id-type="doi">10.1287/mksc.17.1.4</pub-id>, PMID: <pub-id pub-id-type="pmid">19642375</pub-id></citation></ref>
<ref id="ref96"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Price</surname> <given-names>J. L.</given-names></name></person-group> (<year>2003</year>). <article-title>Comparative aspects of amygdala connectivity</article-title>. <source>Ann N Y Acad Sci</source> <volume>985</volume>, <fpage>50</fpage>&#x2013;<lpage>58</lpage>. doi: <pub-id pub-id-type="doi">10.1111/j.1749-6632.2003.tb07070.x</pub-id>, PMID: <pub-id pub-id-type="pmid">12724147</pub-id></citation></ref>
<ref id="ref97"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Price</surname> <given-names>J. L.</given-names></name> <name><surname>Drevets</surname> <given-names>W. C.</given-names></name></person-group> (<year>2012</year>). <article-title>Neural circuits underlying the pathophysiology of mood disorders</article-title>. <source>Trends Cogn Sci</source> <volume>16</volume>, <fpage>61</fpage>&#x2013;<lpage>71</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.tics.2011.12.011</pub-id>, PMID: <pub-id pub-id-type="pmid">22197477</pub-id></citation></ref>
<ref id="ref98"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Price</surname> <given-names>J. L.</given-names></name> <name><surname>Russchen</surname> <given-names>F. T.</given-names></name> <name><surname>Amaral</surname> <given-names>D. G.</given-names></name></person-group> (<year>1987</year>). &#x201C;<article-title>The amygdaloid complex</article-title>&#x201D; in <source>Handbook of chemical neuroanatomy, Vol. V, integrated systems of the CNS, part I</source>. eds. <person-group person-group-type="editor"><name><surname>Swanson</surname> <given-names>L.</given-names></name> <name><surname>Kohler</surname> <given-names>C.</given-names></name> <name><surname>Bjorklund</surname> <given-names>A.</given-names></name></person-group> (<publisher-loc>Amsterdam</publisher-loc>: <publisher-name>Elsevier</publisher-name>), <fpage>279</fpage>&#x2013;<lpage>388</lpage>.</citation></ref>
<ref id="ref99"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pujara</surname> <given-names>M. S.</given-names></name> <name><surname>Ciesinski</surname> <given-names>N. K.</given-names></name> <name><surname>Reyelts</surname> <given-names>J. F.</given-names></name> <name><surname>Rhodes</surname> <given-names>S. E. V.</given-names></name> <name><surname>Murray</surname> <given-names>E. A.</given-names></name></person-group> (<year>2022</year>). <article-title>Selective prefrontal-amygdala circuit interactions underlie social and nonsocial valuation in Rhesus macaques</article-title>. <source>J Neurosci</source> <volume>42</volume>, <fpage>5593</fpage>&#x2013;<lpage>5604</lpage>. doi: <pub-id pub-id-type="doi">10.1523/JNEUROSCI.0794-21.2022</pub-id>, PMID: <pub-id pub-id-type="pmid">35654604</pub-id></citation></ref>
<ref id="ref100"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rachlin</surname> <given-names>H.</given-names></name> <name><surname>Green</surname> <given-names>L.</given-names></name></person-group> (<year>1972</year>). <article-title>Commitment, choice and self-control</article-title>. <source>J Exp Anal Behav</source> <volume>17</volume>, <fpage>15</fpage>&#x2013;<lpage>22</lpage>. doi: <pub-id pub-id-type="doi">10.1901/jeab.1972.17-15</pub-id>, PMID: <pub-id pub-id-type="pmid">16811561</pub-id></citation></ref>
<ref id="ref101"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Read</surname> <given-names>D.</given-names></name> <name><surname>van Leeuwen</surname> <given-names>B.</given-names></name></person-group> (<year>1998</year>). <article-title>Predicting hunger: the effects of appetite and delay on choice</article-title>. <source>Organ Behav Hum Decis Process</source> <volume>76</volume>, <fpage>189</fpage>&#x2013;<lpage>205</lpage>. doi: <pub-id pub-id-type="doi">10.1006/obhd.1998.2803</pub-id>, PMID: <pub-id pub-id-type="pmid">9831521</pub-id></citation></ref>
<ref id="ref102"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Rolls</surname> <given-names>E. T.</given-names></name></person-group> (<year>2000</year>). &#x201C;<article-title>Neurophysiology and functions of the primate amygdala, and the neural basis of emotion</article-title>&#x201D; in <source>The amygdala: A functional analysis, second</source>. ed. <person-group person-group-type="editor"><name><surname>Aggleton</surname> <given-names>J. P.</given-names></name></person-group>. <edition>Edition</edition> ed (<publisher-loc>Oxford</publisher-loc>: <publisher-name>Oxford University Press</publisher-name>), <fpage>447</fpage>&#x2013;<lpage>478</lpage>.</citation></ref>
<ref id="ref103"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rolls</surname> <given-names>E. T.</given-names></name> <name><surname>Grabenhorst</surname> <given-names>F.</given-names></name></person-group> (<year>2008</year>). <article-title>The orbitofrontal cortex and beyond: from affect to decision-making</article-title>. <source>Prog Neurobiol</source> <volume>86</volume>, <fpage>216</fpage>&#x2013;<lpage>244</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.pneurobio.2008.09.001</pub-id>, PMID: <pub-id pub-id-type="pmid">18824074</pub-id></citation></ref>
<ref id="ref104"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rolls</surname> <given-names>E. T.</given-names></name> <name><surname>O'Doherty</surname> <given-names>J.</given-names></name> <name><surname>Kringelbach</surname> <given-names>M. L.</given-names></name> <name><surname>Francis</surname> <given-names>S.</given-names></name> <name><surname>Bowtell</surname> <given-names>R.</given-names></name> <name><surname>McGlone</surname> <given-names>F.</given-names></name></person-group> (<year>2003</year>). <article-title>Representations of pleasant and painful touch in the human orbitofrontal and cingulate cortices</article-title>. <source>Cereb Cortex</source> <volume>13</volume>, <fpage>308</fpage>&#x2013;<lpage>317</lpage>. doi: <pub-id pub-id-type="doi">10.1093/cercor/13.3.308</pub-id>, PMID: <pub-id pub-id-type="pmid">12571120</pub-id></citation></ref>
<ref id="ref105"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Romo</surname> <given-names>R.</given-names></name> <name><surname>Schultz</surname> <given-names>W.</given-names></name></person-group> (<year>1987</year>). <article-title>Neuronal activity preceding self-initiated or externally timed arm movements in area 6 of monkey cortex</article-title>. <source>Exp Brain Res</source> <volume>67</volume>, <fpage>656</fpage>&#x2013;<lpage>662</lpage>. doi: <pub-id pub-id-type="doi">10.1007/BF00247297</pub-id>, PMID: <pub-id pub-id-type="pmid">3653323</pub-id></citation></ref>
<ref id="ref106"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rudebeck</surname> <given-names>P. H.</given-names></name> <name><surname>Mitz</surname> <given-names>A. R.</given-names></name> <name><surname>Chacko</surname> <given-names>R. V.</given-names></name> <name><surname>Murray</surname> <given-names>E. A.</given-names></name></person-group> (<year>2013</year>). <article-title>Effects of amygdala lesions on reward-value coding in orbital and medial prefrontal cortex</article-title>. <source>Neuron</source> <volume>80</volume>, <fpage>1519</fpage>&#x2013;<lpage>1531</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.neuron.2013.09.036</pub-id>, PMID: <pub-id pub-id-type="pmid">24360550</pub-id></citation></ref>
<ref id="ref107"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rudebeck</surname> <given-names>P. H.</given-names></name> <name><surname>Ripple</surname> <given-names>J. A.</given-names></name> <name><surname>Mitz</surname> <given-names>A. R.</given-names></name> <name><surname>Averbeck</surname> <given-names>B. B.</given-names></name> <name><surname>Murray</surname> <given-names>E. A.</given-names></name></person-group> (<year>2017</year>). <article-title>Amygdala contributions to stimulus-reward encoding in the macaque medial and orbital frontal cortex during learning</article-title>. <source>J Neurosci</source> <volume>37</volume>, <fpage>2186</fpage>&#x2013;<lpage>2202</lpage>. doi: <pub-id pub-id-type="doi">10.1523/JNEUROSCI.0933-16.2017</pub-id>, PMID: <pub-id pub-id-type="pmid">28123082</pub-id></citation></ref>
<ref id="ref108"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Saez</surname> <given-names>A.</given-names></name> <name><surname>Rigotti</surname> <given-names>M.</given-names></name> <name><surname>Ostojic</surname> <given-names>S.</given-names></name> <name><surname>Fusi</surname> <given-names>S.</given-names></name> <name><surname>Salzman</surname> <given-names>C. D.</given-names></name></person-group> (<year>2015</year>). <article-title>Abstract context representations in primate amygdala and prefrontal cortex</article-title>. <source>Neuron</source> <volume>87</volume>, <fpage>869</fpage>&#x2013;<lpage>881</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.neuron.2015.07.024</pub-id>, PMID: <pub-id pub-id-type="pmid">26291167</pub-id></citation></ref>
<ref id="ref109"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sah</surname> <given-names>P.</given-names></name> <name><surname>Faber</surname> <given-names>E. S.</given-names></name> <name><surname>Lopez De Armentia</surname> <given-names>M.</given-names></name> <name><surname>Power</surname> <given-names>J.</given-names></name></person-group> (<year>2003</year>). <article-title>The amygdaloid complex: anatomy and physiology</article-title>. <source>Physiol Rev</source> <volume>83</volume>, <fpage>803</fpage>&#x2013;<lpage>834</lpage>. doi: <pub-id pub-id-type="doi">10.1152/physrev.00002.2003</pub-id>, PMID: <pub-id pub-id-type="pmid">12843409</pub-id></citation></ref>
<ref id="ref110"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Scholten</surname> <given-names>H.</given-names></name> <name><surname>Scheres</surname> <given-names>A.</given-names></name> <name><surname>de Water</surname> <given-names>E.</given-names></name> <name><surname>Graf</surname> <given-names>U.</given-names></name> <name><surname>Granic</surname> <given-names>I.</given-names></name> <name><surname>Luijten</surname> <given-names>M.</given-names></name></person-group> (<year>2019</year>). <article-title>Behavioral trainings and manipulations to reduce delay discounting: a systematic review</article-title>. <source>Psychon Bull Rev</source> <volume>26</volume>, <fpage>1803</fpage>&#x2013;<lpage>1849</lpage>. doi: <pub-id pub-id-type="doi">10.3758/s13423-019-01629-2</pub-id>, PMID: <pub-id pub-id-type="pmid">31270766</pub-id></citation></ref>
<ref id="ref111"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schultz</surname> <given-names>W.</given-names></name> <name><surname>Romo</surname> <given-names>R.</given-names></name></person-group> (<year>1992</year>). <article-title>Role of primate basal ganglia and frontal cortex in the internal generation of movements. I. Preparatory activity in the anterior striatum</article-title>. <source>Exp Brain Res</source> <volume>91</volume>, <fpage>363</fpage>&#x2013;<lpage>384</lpage>. doi: <pub-id pub-id-type="doi">10.1007/BF00227834</pub-id>, PMID: <pub-id pub-id-type="pmid">1483512</pub-id></citation></ref>
<ref id="ref112"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Schumann</surname> <given-names>C. M.</given-names></name> <name><surname>Vargas</surname> <given-names>M. V.</given-names></name> <name><surname>Lee</surname> <given-names>A.</given-names></name></person-group> (<year>2016</year>). &#x201C;<article-title>A synopsis of primate amygdala neuroanatomy</article-title>&#x201D; in <source>Living without an amygdala</source>. eds. <person-group person-group-type="editor"><name><surname>Amaral</surname> <given-names>D. G.</given-names></name> <name><surname>Adolphs</surname> <given-names>R.</given-names></name></person-group> (<publisher-loc>New York</publisher-loc>: <publisher-name>The Guilford Press</publisher-name>), <fpage>39</fpage>&#x2013;<lpage>71</lpage>.</citation></ref>
<ref id="ref113"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sheeran</surname> <given-names>P.</given-names></name></person-group> (<year>2002</year>). <article-title>Intention-behavior relations: a conceptual and empirical review</article-title>. <source>Eur Rev Soc Psychol</source> <volume>12</volume>, <fpage>1</fpage>&#x2013;<lpage>36</lpage>. doi: <pub-id pub-id-type="doi">10.1080/14792772143000003</pub-id></citation></ref>
<ref id="ref114"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sheeran</surname> <given-names>P.</given-names></name> <name><surname>Harris</surname> <given-names>P.</given-names></name> <name><surname>Vaughan</surname> <given-names>J.</given-names></name> <name><surname>Oettingen</surname> <given-names>G.</given-names></name> <name><surname>Gollwitzer</surname> <given-names>P. M.</given-names></name></person-group> (<year>2013</year>). <article-title>Gone exercising: mental contrasting promotes physical activity among overweight, middle-aged, low-SES fishermen</article-title>. <source>Health Psychol</source> <volume>32</volume>, <fpage>802</fpage>&#x2013;<lpage>809</lpage>. doi: <pub-id pub-id-type="doi">10.1037/a0029293</pub-id>, PMID: <pub-id pub-id-type="pmid">22888817</pub-id></citation></ref>
<ref id="ref115"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sheldon</surname> <given-names>K. M.</given-names></name> <name><surname>Houser-Marko</surname> <given-names>L.</given-names></name></person-group> (<year>2001</year>). <article-title>Self-concordance, goal attainment, and the pursuit of happiness: can there be an upward spiral?</article-title> <source>J Pers Soc Psychol</source> <volume>80</volume>, <fpage>152</fpage>&#x2013;<lpage>165</lpage>. doi: <pub-id pub-id-type="doi">10.1037/0022-3514.80.1.152</pub-id>, PMID: <pub-id pub-id-type="pmid">11195887</pub-id></citation></ref>
<ref id="ref116"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shidara</surname> <given-names>M.</given-names></name> <name><surname>Richmond</surname> <given-names>B. J.</given-names></name></person-group> (<year>2002</year>). <article-title>Anterior cingulate: single neuronal signals related to degree of reward expectancy</article-title>. <source>Science</source> <volume>296</volume>, <fpage>1709</fpage>&#x2013;<lpage>1711</lpage>. doi: <pub-id pub-id-type="doi">10.1126/science.1069504</pub-id>, PMID: <pub-id pub-id-type="pmid">12040201</pub-id></citation></ref>
<ref id="ref117"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shima</surname> <given-names>K.</given-names></name> <name><surname>Isoda</surname> <given-names>M.</given-names></name> <name><surname>Mushiake</surname> <given-names>H.</given-names></name> <name><surname>Tanji</surname> <given-names>J.</given-names></name></person-group> (<year>2007</year>). <article-title>Categorization of behavioural sequences in the prefrontal cortex</article-title>. <source>Nature</source> <volume>445</volume>, <fpage>315</fpage>&#x2013;<lpage>318</lpage>. doi: <pub-id pub-id-type="doi">10.1038/nature05470</pub-id>, PMID: <pub-id pub-id-type="pmid">17183266</pub-id></citation></ref>
<ref id="ref118"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shima</surname> <given-names>K.</given-names></name> <name><surname>Mushiake</surname> <given-names>H.</given-names></name> <name><surname>Saito</surname> <given-names>N.</given-names></name> <name><surname>Tanji</surname> <given-names>J.</given-names></name></person-group> (<year>1996</year>). <article-title>Role for cells in the presupplementary motor area in updating motor plans</article-title>. <source>Proc Natl Acad Sci USA</source> <volume>93</volume>, <fpage>8694</fpage>&#x2013;<lpage>8698</lpage>. doi: <pub-id pub-id-type="doi">10.1073/pnas.93.16.8694</pub-id>, PMID: <pub-id pub-id-type="pmid">8710933</pub-id></citation></ref>
<ref id="ref119"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shima</surname> <given-names>K.</given-names></name> <name><surname>Tanji</surname> <given-names>J.</given-names></name></person-group> (<year>1998</year>). <article-title>Role for cingulate motor area cells in voluntary movement selection based on reward</article-title>. <source>Science</source> <volume>282</volume>, <fpage>1335</fpage>&#x2013;<lpage>1338</lpage>. doi: <pub-id pub-id-type="doi">10.1126/science.282.5392.1335</pub-id>, PMID: <pub-id pub-id-type="pmid">9812901</pub-id></citation></ref>
<ref id="ref120"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sohn</surname> <given-names>J. W.</given-names></name> <name><surname>Lee</surname> <given-names>D.</given-names></name></person-group> (<year>2007</year>). <article-title>Order-dependent modulation of directional signals in the supplementary and presupplementary motor areas</article-title>. <source>J Neurosci</source> <volume>27</volume>, <fpage>13655</fpage>&#x2013;<lpage>13666</lpage>. doi: <pub-id pub-id-type="doi">10.1523/JNEUROSCI.2982-07.2007</pub-id>, PMID: <pub-id pub-id-type="pmid">18077677</pub-id></citation></ref>
<ref id="ref121"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Stefanacci</surname> <given-names>L.</given-names></name> <name><surname>Amaral</surname> <given-names>D. G.</given-names></name></person-group> (<year>2002</year>). <article-title>Some observations on cortical inputs to the macaque monkey amygdala: an anterograde tracing study</article-title>. <source>J Comp Neurol</source> <volume>451</volume>, <fpage>301</fpage>&#x2013;<lpage>323</lpage>. doi: <pub-id pub-id-type="doi">10.1002/cne.10339</pub-id></citation></ref>
<ref id="ref122"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Stillman</surname> <given-names>P. E.</given-names></name> <name><surname>Woolley</surname> <given-names>K.</given-names></name></person-group> (<year>2023</year>). <article-title>Undermining desire: reducing unhealthy choices by highlighting short-term (vs. long-term) costs</article-title>. <source>J Consum Res</source> <volume>50</volume>, <fpage>554</fpage>&#x2013;<lpage>575</lpage>. doi: <pub-id pub-id-type="doi">10.1093/jcr/ucad004</pub-id></citation></ref>
<ref id="ref123"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Stuss</surname> <given-names>D. T.</given-names></name> <name><surname>Knight</surname> <given-names>R. T.</given-names></name></person-group> (<year>2002</year>). <source>Principles of frontal lobe function</source>. <publisher-loc>Oxford</publisher-loc>: <publisher-name>Oxford University Press</publisher-name>.</citation></ref>
<ref id="ref124"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sugase-Miyamoto</surname> <given-names>Y.</given-names></name> <name><surname>Richmond</surname> <given-names>B. J.</given-names></name></person-group> (<year>2005</year>). <article-title>Neuronal signals in the monkey basolateral amygdala during reward schedules</article-title>. <source>J Neurosci</source> <volume>25</volume>, <fpage>11071</fpage>&#x2013;<lpage>11083</lpage>. doi: <pub-id pub-id-type="doi">10.1523/JNEUROSCI.1796-05.2005</pub-id>, PMID: <pub-id pub-id-type="pmid">16319307</pub-id></citation></ref>
<ref id="ref125"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Sutton</surname> <given-names>R. S.</given-names></name> <name><surname>Barto</surname> <given-names>A. G.</given-names></name></person-group> (<year>1998</year>). <source>Reinforcement learning</source>, vol. <volume>31</volume>. <publisher-loc>Cambridge, MA</publisher-loc>: <publisher-name>MIT Press</publisher-name>, <fpage>5</fpage>.</citation></ref>
<ref id="ref126"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tang</surname> <given-names>H.</given-names></name> <name><surname>Bartolo</surname> <given-names>R.</given-names></name> <name><surname>Averbeck</surname> <given-names>B. B.</given-names></name></person-group> (<year>2024</year>). <article-title>Ventral frontostriatal circuitry mediates the computation of reinforcement from symbolic gains and losses</article-title>. <source>Neuron</source> <volume>112</volume>:<fpage>e3785</fpage>. doi: <pub-id pub-id-type="doi">10.1016/j.neuron.2024.08.018</pub-id></citation></ref>
<ref id="ref127"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tanji</surname> <given-names>J.</given-names></name> <name><surname>Hoshi</surname> <given-names>E.</given-names></name></person-group> (<year>2001</year>). <article-title>Behavioral planning in the prefrontal cortex</article-title>. <source>Curr Opin Neurobiol</source> <volume>11</volume>, <fpage>164</fpage>&#x2013;<lpage>170</lpage>. doi: <pub-id pub-id-type="doi">10.1016/S0959-4388(00)00192-6</pub-id>, PMID: <pub-id pub-id-type="pmid">11301235</pub-id></citation></ref>
<ref id="ref128"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tanji</surname> <given-names>J.</given-names></name> <name><surname>Shima</surname> <given-names>K.</given-names></name></person-group> (<year>1994</year>). <article-title>Role for supplementary motor area cells in planning several movements ahead</article-title>. <source>Nature</source> <volume>371</volume>, <fpage>413</fpage>&#x2013;<lpage>416</lpage>. doi: <pub-id pub-id-type="doi">10.1038/371413a0</pub-id>, PMID: <pub-id pub-id-type="pmid">8090219</pub-id></citation></ref>
<ref id="ref129"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Vallerand</surname> <given-names>R. J.</given-names></name> <name><surname>Bissonnette</surname> <given-names>R.</given-names></name></person-group> (<year>1992</year>). &#x201C;<article-title>Intrinsic, extrinsic, and amotivational styles as predictors of behavior: a prospective study</article-title>&#x201D; in <source>1997 Human Nature: A Critical Reader</source>. ed. <person-group person-group-type="editor"><name><surname>Betzig</surname> <given-names>L.</given-names></name></person-group>, vol. <volume>60</volume> (<publisher-loc>New York</publisher-loc>: <publisher-name>Oxford University Press</publisher-name>), <fpage>599</fpage>&#x2013;<lpage>620</lpage>.</citation></ref>
<ref id="ref130"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Vroom</surname> <given-names>V. H.</given-names></name></person-group> (<year>1964</year>). <source>Work and motivation</source>. <publisher-loc>New York</publisher-loc>: <publisher-name>Wiley</publisher-name>.</citation></ref>
<ref id="ref131"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Weiss</surname> <given-names>M.</given-names></name> <name><surname>Gollwitzer</surname> <given-names>M.</given-names></name> <name><surname>Hewig</surname> <given-names>J.</given-names></name></person-group> (<year>2023</year>). <article-title>Social influence and external feedback control in humans</article-title>. <source>F1000Res</source> <volume>12</volume>:<fpage>438</fpage>. doi: <pub-id pub-id-type="doi">10.12688/f1000research.133295.1</pub-id></citation></ref>
<ref id="ref132"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wunderlich</surname> <given-names>K.</given-names></name> <name><surname>Dayan</surname> <given-names>P.</given-names></name> <name><surname>Dolan</surname> <given-names>R. J.</given-names></name></person-group> (<year>2012</year>). <article-title>Mapping value based planning and extensively trained choice in the human brain</article-title>. <source>Nat Neurosci</source> <volume>15</volume>, <fpage>786</fpage>&#x2013;<lpage>791</lpage>. doi: <pub-id pub-id-type="doi">10.1038/nn.3068</pub-id>, PMID: <pub-id pub-id-type="pmid">22406551</pub-id></citation></ref>
<ref id="ref133"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yang</surname> <given-names>Y. P.</given-names></name> <name><surname>Li</surname> <given-names>X.</given-names></name> <name><surname>Stuphorn</surname> <given-names>V.</given-names></name></person-group> (<year>2022</year>). <article-title>Primate anterior insular cortex represents economic decision variables proposed by prospect theory</article-title>. <source>Nat Commun</source> <volume>13</volume>:<fpage>717</fpage>. doi: <pub-id pub-id-type="doi">10.1038/s41467-022-28278-9</pub-id>, PMID: <pub-id pub-id-type="pmid">35132070</pub-id></citation></ref>
<ref id="ref134"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yankelevitz</surname> <given-names>R. L.</given-names></name> <name><surname>Bullock</surname> <given-names>C. E.</given-names></name> <name><surname>Hackenberg</surname> <given-names>T. D.</given-names></name></person-group> (<year>2008</year>). <article-title>Reinforcer accumulation in a token-reinforcement context with pigeons</article-title>. <source>J Exp Anal Behav</source> <volume>90</volume>, <fpage>283</fpage>&#x2013;<lpage>299</lpage>. doi: <pub-id pub-id-type="doi">10.1901/jeab.2008.90-283</pub-id>, PMID: <pub-id pub-id-type="pmid">19070337</pub-id></citation></ref>
<ref id="ref135"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zangemeister</surname> <given-names>L.</given-names></name> <name><surname>Grabenhorst</surname> <given-names>F.</given-names></name> <name><surname>Schultz</surname> <given-names>W.</given-names></name></person-group> (<year>2016</year>). <article-title>Neural basis for economic saving strategies in human amygdala-prefrontal reward circuits</article-title>. <source>Curr Biol</source> <volume>26</volume>, <fpage>3004</fpage>&#x2013;<lpage>3013</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.cub.2016.09.016</pub-id>, PMID: <pub-id pub-id-type="pmid">27773572</pub-id></citation></ref>
<ref id="ref136"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zangemeister</surname> <given-names>L.</given-names></name> <name><surname>Grabenhorst</surname> <given-names>F.</given-names></name> <name><surname>Schultz</surname> <given-names>W.</given-names></name></person-group> (<year>2019</year>). <article-title>Neural activity in human ventromedial prefrontal cortex reflecting the intention to save reward</article-title>. <source>Soc Cogn Affect Neurosci</source> <volume>14</volume>, <fpage>1255</fpage>&#x2013;<lpage>1261</lpage>. doi: <pub-id pub-id-type="doi">10.1093/scan/nsaa013</pub-id>, PMID: <pub-id pub-id-type="pmid">31993656</pub-id></citation></ref>
</ref-list>
</back>
</article>