<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="review-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Psychology</journal-id>
<journal-title>Frontiers in Psychology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Psychology</abbrev-journal-title>
<issn pub-type="epub">1664-1078</issn>
<publisher>
<publisher-name>Frontiers Research Foundation</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fpsyg.2011.00390</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Psychology</subject>
<subj-group>
<subject>Opinion Article</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Experience-Based Decisions and Brain Activity: Three New Gaps and Partial Answers</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Yechiam</surname> <given-names>Eldad</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="author-notes" rid="fn001">&#x0002A;</xref>
</contrib>
<contrib contrib-type="author">
<name><surname>Aharon</surname> <given-names>Itzhak</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Max Wertheimer Minerva Center for Cognitive Studies, Technion &#x02013; Israel Institute of Technology</institution> <country>Haifa, Israel</country></aff>
<aff id="aff2"><sup>2</sup><institution>Lauder School of Government, Diplomacy and Strategy, Interdisciplinary Center</institution> <country>Herzliya, Israel</country></aff>
<author-notes>
<fn fn-type="corresp" id="fn001"><p>&#x0002A;Correspondence: <email>yeldad&#x00040;tx.technion.ac.il</email></p></fn>
<fn fn-type="other" id="fn002"><p>This article was submitted to Frontiers in Cognitive Science, a specialty of Frontiers in Psychology.</p></fn>
</author-notes>
<pub-date pub-type="epub">
<day>05</day>
<month>01</month>
<year>2012</year>
</pub-date>
<pub-date pub-type="collection">
<year>2011</year>
</pub-date>
<volume>2</volume>
<elocation-id>390</elocation-id>
<history>
<date date-type="received">
<day>28</day>
<month>11</month>
<year>2011</year>
</date>
<date date-type="accepted">
<day>12</day>
<month>12</month>
<year>2011</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2012 Yechiam and Aharon.</copyright-statement>
<copyright-year>2012</copyright-year>
<license license-type="open-access" xlink:href="http://www.frontiersin.org/licenseagreement"><p>This is an open-access article distributed under the terms of the <uri xlink:href="http://creativecommons.org/licenses/by-nc/3.0/">Creative Commons Attribution Non Commercial License</uri>, which permits non-commercial use, distribution, and reproduction in other forums, provided the original authors and source are credited.</p></license>
</permissions>
<counts>
<fig-count count="1"/>
<table-count count="0"/>
<equation-count count="0"/>
<ref-count count="38"/>
<page-count count="4"/>
<word-count count="3199"/>
</counts>
</article-meta>
</front>
<body>
<p>Experience-based decisions can be defined as decisions emanating from direct or vicarious reinforcements that were received in the past. Typically, in experience-based decision tasks an agent repeatedly makes choices and receives outcomes from the available alternatives, so that choices are based on past experiences, with no explicit description of the payoff distributions from which the outcomes are drawn. The study of experience-based decisions has long roots in the works of mathematical psychologists during the 1950s and 1960s of the last century (e.g., Estes and Burke, <xref ref-type="bibr" rid="B12">1953</xref>; Bush and Mosteller, <xref ref-type="bibr" rid="B6">1955</xref>; Katz, <xref ref-type="bibr" rid="B20">1964</xref>). This type of task has been viewed as a natural continuation of the behaviorist tradition involving animals as subjects, and multiple trials in which feedback is obtained on each trial. During the 1970s and 1980s seminal studies focusing on choices among descriptive gambles began to dominate the field of Judgment and Decision Making, paving the wave for the successful and influential works of Tversky and Kahneman (e.g., Kahneman and Tversky, <xref ref-type="bibr" rid="B18">1979</xref>). Indeed, a review of the decision making literature from 1970 to 1998 conducted by Weber et al. (<xref ref-type="bibr" rid="B32">2004</xref>) shows prominent use of description-based tasks over experience-based tasks.</p>
<p>Yet the study of experience-based decisions has continued to evolve. Some of the workers in this subfield were neuropsychologists who used experience-based tasks as a natural way to evaluate individual differences owing to these tasks having many choice trials (e.g., Bechara et al., <xref ref-type="bibr" rid="B4">1994</xref>). Others were interested in the complex relations between learning and decision making (Erev and Roth, <xref ref-type="bibr" rid="B10">1998</xref>). An interesting finding that has finally defined the importance of contrasting the two types of tasks &#x02013; experience-based decisions and description-based decisions, was obtained by Ido Erev and his colleagues. Kahneman and Tversky (<xref ref-type="bibr" rid="B18">1979</xref>) showed that individuals overweight small probability events in their decisions from description. For instance, in selecting between an alternative producing &#x00024;3 for sure or a gamble producing 10% chance to receive &#x00024;32 (and otherwise zero), most people pick the riskier alternative, behaving as if they give greater weight to the relatively rare event (see Hau et al., <xref ref-type="bibr" rid="B15">2009</xref>). Erev and colleagues have demonstrated a reverse phenomenon in decisions from experience (Barron and Erev, <xref ref-type="bibr" rid="B2">2003</xref>; Hertwig et al., <xref ref-type="bibr" rid="B16">2004</xref>; Yechiam et al., <xref ref-type="bibr" rid="B34">2005</xref>). People tend to experientially select alternatives as if what happens most of the time has more weight than the rare event. Thus, people overweight small probability events in decisions from description while underweighting them in decisions from experience. This has been referred to as the description&#x02013;experience (D&#x02013;E) gap (Hertwig et al., <xref ref-type="bibr" rid="B16">2004</xref>). The studies exploring the D&#x02013;E gap were followed by further investigations examining the divergent and convergent processes in these task types (e.g., Rakow et al., <xref ref-type="bibr" rid="B26">2008</xref>; Barron and Yechiam, <xref ref-type="bibr" rid="B3">2009</xref>; Wu et al., <xref ref-type="bibr" rid="B33">2011</xref>).</p>
<p>In parallel to the recent advancements in experience-based decisions within the field of Judgment and Decision Making, there have been numerous studies of this type of decisions in Neuroscience. For example, the feedback-based error-related negativity (fERN; see below; e.g., Gehring and Willoughby, <xref ref-type="bibr" rid="B13">2002</xref>) and the role of non-declarative knowledge in selecting advantageously (Bechara et al., <xref ref-type="bibr" rid="B5">1997</xref>) were found in experience-based decisions. Several studies have explicitly showed that that experience-based tasks result in higher correlation between studied brain variables and over behavior. For example, in Aharon et al.&#x02019;s (<xref ref-type="bibr" rid="B1">2001</xref>) fMRI study, participant evaluated the attractiveness of face images either descriptively or by making choices and receiving feedback. Brain activation levels in the reward circuitry (particularly, the nucleus accumbens) matched the evaluation patterns only in the experiential condition. Similarly, severe damage to the orbitofrontal cortex was found to lead to decision impairments in experience-based tasks, but not in description-based tasks (Leland and Grafman, <xref ref-type="bibr" rid="B21">2005</xref>). Still, many of the investigations of these neuroscientific aspects have borrowed their theoretical underpinning from the study of decisions from description, and have not been guided by relevant theories of experience-based decisions. At the same time, many of the decision making studies of experience-based tasks have taken place without awareness of the relevant brain studies using this paradigm.</p>
<p>In an attempt to highlight the necessity of integrating the two bodies of research (JDM and neuroscience studies), we present three dissociations (or &#x0201C;gaps&#x0201D;) between brain activation patterns and behavioral choices in these tasks. The majority of this paper is devoted to describing the three gaps in order to encourage further research. Additionally, we also suggest some directions for exploring and explaining these inconsistencies.</p>
<sec>
<title>Three Brain-Behavior Gaps in Experience-Based Decisions</title>
<sec>
<title>Brain activation and behavioral responses to rare events</title>
<p>The very famous &#x0201C;oddball&#x0201D; paradigm examines people&#x00027;s brain responses following low-probability events compared to more frequent events. The typical result is an elevated fronto-central signal approximately 300&#x02009;ms following the rare event, which is known as P300. The original oddball paradigm normally required a response following the rare event, and thus confounded the rarity of the event and its performance requirements (Squires et al., <xref ref-type="bibr" rid="B30">1975</xref>). Yet the same findings were also replicated in task-irrelevant rare events (Debener et al., <xref ref-type="bibr" rid="B7">2005</xref>) and in reward prediction tasks (Karis et al., <xref ref-type="bibr" rid="B19">1983</xref>). The elevated neural activation following the rare event appears to be inconsistent with the tendency to <italic>underweight</italic> rare events in experience-based decisions. One might argue, though, that the dependent variable in decision tasks (i.e., the choice proportion) is also affected by the size of the rare payoff, and this component may be insufficiently integrated upon making choices. Still, this would be inconsistent with the standard way in which the underweighting phenomenon is explained (Hertwig et al., <xref ref-type="bibr" rid="B16">2004</xref>). Moreover, as we shall see below, inconsistency between brain activation and behavior also emerges when the target event (e.g., a loss) is similar in size to the control event (e.g., a gain).</p>
</sec>
<sec id="s1">
<title>Brain activation and behavioral responses to losses</title>
<p>In a seminal EEG study, Gehring and Willoughby (<xref ref-type="bibr" rid="B13">2002</xref>) demonstrated that a large portion of the frontal cortex exhibits greater rapid activation following losses than following equivalent gains. This event-related brain potential (ERP) has been referred to as medial frontal negativity (MFN; Gehring and Willoughby, <xref ref-type="bibr" rid="B13">2002</xref>) or fERN (Yeung and Sanfey, <xref ref-type="bibr" rid="B38">2004</xref>). Gehring and Willoughby (<xref ref-type="bibr" rid="B13">2002</xref>) suggested that the existence of the increased cortical response following losses is consistent with the behavioral principle of &#x0201C;loss aversion,&#x0201D; which denotes an increased subjective weight of losses compared to gains (Kahneman and Tversky, <xref ref-type="bibr" rid="B18">1979</xref>). Furthermore, they argued that the asymmetric fERN response to losses represents the brain mechanism directly contributing to the representation of subjective value, or &#x0201C;instant utility.&#x0201D; However, in Gehring and Willoughby&#x00027;s (<xref ref-type="bibr" rid="B13">2002</xref>) research, as in other studies of experience-based decisions (e.g., Erev et al., <xref ref-type="bibr" rid="B9">2008</xref>; Silberberg et al., <xref ref-type="bibr" rid="B29">2008</xref>; Hochman and Yechiam, <xref ref-type="bibr" rid="B17">2011</xref>; Yechiam and Telpaz, <xref ref-type="bibr" rid="B36">2011</xref>, <xref ref-type="bibr" rid="B37">in press</xref>), participants actually made behavioral choices as if they were loss neutral and not loss-averse. Specifically, the fERN was observed in choices between an alternative producing &#x0002B;5 or &#x02212;5 US cents and a second alternative producing &#x0002B;5 or &#x02212;25 cents. Loss aversion implies that in choice between a pair of alternatives with symmetric gains and losses, individuals should prefer the alternative producing lower losses. However, the two choice alternatives were selected at about the same rate.</p>
<p>This gap was replicated in follow-up ERP studies, some using higher payoffs (e.g., Nieuwenhuis et al., <xref ref-type="bibr" rid="B24">2004</xref>; Yeung and Sanfey, <xref ref-type="bibr" rid="B38">2004</xref>; Masaki et al., <xref ref-type="bibr" rid="B22">2006</xref>). It has also been demonstrated in studies of autonomic arousal: Losses were found to have greater effect on pupil diameter and heart rate, even in the absence of reliable loss aversion (Hochman and Yechiam, <xref ref-type="bibr" rid="B17">2011</xref>; Yechiam and Telpaz, <xref ref-type="bibr" rid="B36">2011</xref>). Interestingly, the ERP studies noted above did not make a big issue out of this discrepancy, and did not consider it as deserving special attention. Yet we feel that it is a critical issue because participants make experiential choices as if they are loss neutral while their brain acts as if it is loss sensitive.</p>
</sec>
<sec>
<title>The effect of experience on risk taking</title>
<p>The third brain&#x02013;behavior gap we would like to draw attention to involves a discrepancy between what is known about the dynamic function of the dopaminergic system and experiential choice behavior. Under current models of the striatum, the dopaminergic system adapts to reinforcement using a &#x0201C;Delta&#x0201D; learning rule (Rumelhart et al., <xref ref-type="bibr" rid="B27">1986</xref>), whereby a new outcome from a given alternative is compared to the expectancy of the alternative prior to the outcomes, and the expectancy is updated as a function of the difference between the new outcome and the old expectancy. Brain areas within the striatum were found to exhibit activation patterns consistent with the implied mechanism of the delta rule (Schultz et al., <xref ref-type="bibr" rid="B28">1997</xref>). This rule axiomatically leads to a clear behavioral prediction involving the effect of experience on risk taking behavior (Niv et al., <xref ref-type="bibr" rid="B25">2002</xref>; Denrell, <xref ref-type="bibr" rid="B8">2007</xref>): Under the Delta rule, decision makers should be more risk averse with experience because they invariably sample the risky alternative in a biased fashion. For example, say that in an experience-based decision you have a choice between getting zero for sure and a risky alternative producing equal chances to win or lose &#x00024;10. In the first 10 trials in which the risky alternative is chosen there is about 40% chance that <italic>in reality</italic> the likelihood of winning &#x00024;10 will be less than 50%. This can lead participants to avoid the risky alternative in future choices. Moreover, as soon as the risky alternative is avoided, there is no mechanism that reduces this bias. The chance of biased sampling from the risky alternative continues in the next trials as well, and under the Delta learning rule, it is expected to slowly lead participants away from the risky alternative. But this is not how participants behave in experiential tasks! In several studies involving such symmetric risky alternative (with equal chance of winning or losing) participants were found to show remarkable flatness in their learning curves (see Figure <xref ref-type="fig" rid="F1">1</xref>). This gap between the mechanism considered to govern learning and actual experiential behavior in tasks involving mixed gains and losses bears some similarity to the issue of loss sensitivity because in both cases the brain activation pattern is in the direction of avoiding risk (and potential losses) while behavior leans toward risk neutrality<xref ref-type="fn" rid="fn1"><sup>1</sup></xref>.</p>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p><bold>Risk taking in two studies of experience-based decisions</bold>. Top: Ert and Yechiam (<xref ref-type="bibr" rid="B11">2010</xref>). Bottom: Yechiam and Telpaz (<xref ref-type="bibr" rid="B37">in press</xref>). Each task involves the selection among a Safe option (S) and a Risky option (R). The results show the mean proportion of selections from the risky alternative in each trial [P(R)] in different conditions. The participants take less risk over time when payoffs are predominantly gains or losses but not in mixed gains and losses.</p></caption>
<graphic xlink:href="fpsyg-02-00390-g001.tif"/>
</fig>
</sec>
</sec>
<sec>
<title>Partial Answers</title>
<p>A technical way out of theses gap involves the typically different temporal resolution of brain activation measures and behavioral choices. The fERN patterns, for instance, were revealed in the first 300&#x02009;ms after the choice outcomes are presented. However, in most studies, decision makers are given much more time to make behavioral decisions. Thus, behavioral loss neutrality might be the product of delayed brain processes implicated in executive control. For instance, some executive functions of verbal working memory have been known to result in activation peaks approximately 600&#x02009;ms after the relevant stimuli (Gunter et al., <xref ref-type="bibr" rid="B14">2000</xref>) and even later (Tu et al., <xref ref-type="bibr" rid="B31">2009</xref>). Still, while this is a possible interpretation for these gaps, it is quite tentative as the relevant delayed processes have not been uncovered.</p>
<p>An alternative suggestion is that the rapid fronto-central activation following monetary outcomes does not represent &#x0201C;instant utility&#x0201D; weighting of these outcomes (as proposed, for instance, by Gehring and Willoughby, <xref ref-type="bibr" rid="B13">2002</xref>). Possibly, it could represent an attentional phenomenon. We (Yechiam and Hochman, <xref ref-type="bibr" rid="B35">2011</xref>; Yechiam and Telpaz, <xref ref-type="bibr" rid="B36">2011</xref>) suggested that an encompassing increase in frontal activation may represent the intensity of the attentional orienting response. Attention may be drawn by losses for instance, and this may increase the overall investment of cognitive resources in the task, in a symmetric fashion to both gains and losses. A related explanation involves the surprise value of incentives (Nevo and Erev, <xref ref-type="bibr" rid="B23">2011</xref>). Under these explanations, the noted gaps are accounted for by the assertion that brain activation to incentives may represent cognitive processes that do not have a direct effect on the subjective valuation of the stimuli that have elicited them.</p>
</sec>
</body>
<back>
<ref-list>
<title>References</title>
<ref id="B1"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Aharon</surname> <given-names>I.</given-names></name> <name><surname>Etcoff</surname> <given-names>N.</given-names></name> <name><surname>Ariely</surname> <given-names>D.</given-names></name> <name><surname>Chabris</surname> <given-names>C. F.</given-names></name> <name><surname>O&#x00027;Donner</surname> <given-names>E.</given-names></name> <name><surname>Breiter</surname> <given-names>H. C.</given-names></name></person-group> (<year>2001</year>). <article-title>Beautiful faces have variable reward value: fMRI and behavioral evidence</article-title>. <source>Neuron</source> <volume>32</volume>, <fpage>537</fpage>&#x02013;<lpage>551</lpage>.<pub-id pub-id-type="doi">10.1016/S0896-6273(01)00491-3</pub-id><pub-id pub-id-type="pmid">11709163</pub-id></citation></ref>
<ref id="B2"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Barron</surname> <given-names>G.</given-names></name> <name><surname>Erev</surname> <given-names>I.</given-names></name></person-group> (<year>2003</year>). <article-title>Small feedback-based decisions and their limited correspondence to description based decisions</article-title>. <source>J. Behav. Desci. Mak.</source> <volume>16</volume>, <fpage>215</fpage>&#x02013;<lpage>233</lpage>.<pub-id pub-id-type="doi">10.1002/bdm.443</pub-id></citation></ref>
<ref id="B3"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Barron</surname> <given-names>G.</given-names></name> <name><surname>Yechiam</surname> <given-names>E.</given-names></name></person-group> (<year>2009</year>). <article-title>The coexistence of overestimation and underweighting of rare events and the contingent recency effect</article-title>. <source>Judgm. Decis. Mak.</source> <volume>4</volume>, <fpage>447</fpage>&#x02013;<lpage>460</lpage>.</citation></ref>
<ref id="B4"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bechara</surname> <given-names>A.</given-names></name> <name><surname>Damasio</surname> <given-names>A. R.</given-names></name> <name><surname>Damasio</surname> <given-names>H.</given-names></name> <name><surname>Anderson</surname> <given-names>S.</given-names></name></person-group> (<year>1994</year>). <article-title>Insensitivity to future consequences following damage to human prefrontal cortex</article-title>. <source>Cognition</source> <volume>50</volume>, <fpage>7</fpage>&#x02013;<lpage>15</lpage>.<pub-id pub-id-type="doi">10.1016/0010-0277(94)90018-3</pub-id><pub-id pub-id-type="pmid">8039375</pub-id></citation></ref>
<ref id="B5"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bechara</surname> <given-names>A.</given-names></name> <name><surname>Damasio</surname> <given-names>H.</given-names></name> <name><surname>Tranel</surname> <given-names>D.</given-names></name> <name><surname>Damasio</surname> <given-names>A. R.</given-names></name></person-group> (<year>1997</year>). <article-title>Deciding advantageously before knowing the advantageous strategy</article-title>. <source>Science</source> <volume>275</volume>, <fpage>1293</fpage>&#x02013;<lpage>1295</lpage>.<pub-id pub-id-type="doi">10.1126/science.275.5304.1293</pub-id><pub-id pub-id-type="pmid">9036851</pub-id></citation></ref>
<ref id="B6"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Bush</surname> <given-names>R. R.</given-names></name> <name><surname>Mosteller</surname> <given-names>F.</given-names></name></person-group> (<year>1955</year>). <source>Stochastic Models for Learning</source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Wiley</publisher-name>.</citation></ref>
<ref id="B7"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Debener</surname> <given-names>S.</given-names></name> <name><surname>Makeig</surname> <given-names>S.</given-names></name> <name><surname>Delorme</surname> <given-names>A.</given-names></name> <name><surname>Engel</surname> <given-names>A. K.</given-names></name></person-group> (<year>2005</year>). <article-title>What is novel in the novelty oddball paradigm? Functional significance of the novelty P3 event-related potential as revealed by independent component analysis</article-title>. <source>Brain Res. Cogn. Brain Res.</source> <volume>22</volume>, <fpage>309</fpage>&#x02013;<lpage>322</lpage>.<pub-id pub-id-type="doi">10.1016/j.cogbrainres.2004.09.006</pub-id><pub-id pub-id-type="pmid">15722203</pub-id></citation></ref>
<ref id="B8"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Denrell</surname> <given-names>J.</given-names></name></person-group> (<year>2007</year>). <article-title>Adaptive learning and risk taking</article-title>. <source>Psychol. Rev.</source> <volume>114</volume>, <fpage>177</fpage>&#x02013;<lpage>187</lpage>.<pub-id pub-id-type="doi">10.1037/0033-295X.114.1.177</pub-id><pub-id pub-id-type="pmid">17227186</pub-id></citation></ref>
<ref id="B9"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Erev</surname> <given-names>I.</given-names></name> <name><surname>Ert</surname> <given-names>E.</given-names></name> <name><surname>Yechiam</surname> <given-names>E.</given-names></name></person-group> (<year>2008</year>). <article-title>Loss aversion, diminishing sensitivity, and the effect of experience on repeated decisions</article-title>. <source>J. Behav. Decis. Mak.</source> <volume>21</volume>, <fpage>575</fpage>&#x02013;<lpage>597</lpage>.<pub-id pub-id-type="doi">10.1002/bdm.602</pub-id></citation></ref>
<ref id="B10"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Erev</surname> <given-names>I.</given-names></name> <name><surname>Roth</surname> <given-names>A. E.</given-names></name></person-group> (<year>1998</year>). <article-title>Predicting how people play games: Reinforcement learning in experimental games with unique, mixed strategy equilibria</article-title>. <source>Am. Econ. Rev.</source> <volume>88</volume>, <fpage>848</fpage>&#x02013;<lpage>881</lpage>.</citation></ref>
<ref id="B11"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ert</surname> <given-names>E.</given-names></name> <name><surname>Yechiam</surname> <given-names>E.</given-names></name></person-group> (<year>2010</year>). <article-title>Consistent constructs in individuals&#x02019; risk taking in decisions from experience</article-title>. <source>Acta Psychol. (Amst.)</source> <volume>134</volume>, <fpage>225</fpage>&#x02013;<lpage>232</lpage>.<pub-id pub-id-type="doi">10.1016/j.actpsy.2010.02.003</pub-id><pub-id pub-id-type="pmid">20223438</pub-id></citation></ref>
<ref id="B12"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Estes</surname> <given-names>W. K.</given-names></name> <name><surname>Burke</surname> <given-names>C. J.</given-names></name></person-group> (<year>1953</year>). <article-title>A theory of stimulus variability in learning</article-title>. <source>Psychol. Rev.</source> <volume>6</volume>, <fpage>276</fpage>&#x02013;<lpage>86</lpage><pub-id pub-id-type="doi">10.1037/h0055775</pub-id></citation></ref>
<ref id="B13"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gehring</surname> <given-names>W. J.</given-names></name> <name><surname>Willoughby</surname> <given-names>A. R.</given-names></name></person-group> (<year>2002</year>). <article-title>The medial frontal cortex and the rapid processing of monetary gains and losses</article-title>. <source>Science</source> <volume>295</volume>, <fpage>2279</fpage>&#x02013;<lpage>2282</lpage>.<pub-id pub-id-type="doi">10.1126/science.1066893</pub-id><pub-id pub-id-type="pmid">11910116</pub-id></citation></ref>
<ref id="B14"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gunter</surname> <given-names>T. C.</given-names></name> <name><surname>Friederici</surname> <given-names>A. D.</given-names></name> <name><surname>Schriefers</surname> <given-names>H.</given-names></name></person-group> (<year>2000</year>). <article-title>Syntactic gender and semantic expectancy: ERPs reveal early autonomy and late interaction</article-title>. <source>J. Cogn. Neurosci.</source> <volume>12</volume>, <fpage>556</fpage>&#x02013;<lpage>568</lpage>.<pub-id pub-id-type="doi">10.1162/089892900562336</pub-id><pub-id pub-id-type="pmid">10936910</pub-id></citation></ref>
<ref id="B15"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hau</surname> <given-names>R.</given-names></name> <name><surname>Pleskac</surname> <given-names>T. J.</given-names></name> <name><surname>Hertwig</surname> <given-names>R.</given-names></name></person-group> (<year>2009</year>). <article-title>Decisions from experience and statistical probabilities: why they trigger different choices than a priori probabilities</article-title>. <source>J. Behav. Decis. Mak.</source> <volume>23</volume>, <fpage>48</fpage>&#x02013;<lpage>68</lpage>.<pub-id pub-id-type="doi">10.1002/bdm.665</pub-id></citation></ref>
<ref id="B16"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hertwig</surname> <given-names>R.</given-names></name> <name><surname>Barron</surname> <given-names>G.</given-names></name> <name><surname>Weber</surname> <given-names>E. U.</given-names></name> <name><surname>Erev</surname> <given-names>I.</given-names></name></person-group> (<year>2004</year>). <article-title>Decisions from experience and the effect of rare events in risky choices</article-title>. <source>Psychol. Sci.</source> <volume>15</volume>, <fpage>534</fpage>&#x02013;<lpage>539</lpage>.<pub-id pub-id-type="doi">10.1111/j.0956-7976.2004.00715.x</pub-id><pub-id pub-id-type="pmid">15270998</pub-id></citation></ref>
<ref id="B17"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hochman</surname> <given-names>G.</given-names></name> <name><surname>Yechiam</surname> <given-names>E.</given-names></name></person-group> (<year>2011</year>). <article-title>Loss aversion in the eye and in the heart: the autonomic nervous system&#x00027;s responses to losses</article-title>. <source>J. Behav. Decis. Mak.</source> <volume>24</volume>, <fpage>140</fpage>&#x02013;<lpage>156</lpage>.<pub-id pub-id-type="doi">10.1002/bdm.692</pub-id></citation></ref>
<ref id="B18"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kahneman</surname> <given-names>D.</given-names></name> <name><surname>Tversky</surname> <given-names>A.</given-names></name></person-group> (<year>1979</year>). <article-title>Prospect theory: an analysis of decision under risk</article-title>. <source>Econometrica</source> <volume>47</volume>, <fpage>263</fpage>&#x02013;<lpage>291</lpage>.<pub-id pub-id-type="doi">10.2307/1914185</pub-id></citation></ref>
<ref id="B19"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Karis</surname> <given-names>D.</given-names></name> <name><surname>Chesney</surname> <given-names>G. L.</given-names></name> <name><surname>Donchin</surname> <given-names>E.</given-names></name></person-group> (<year>1983</year>). <article-title>&#x0201C;Twas ten to one; And yet we ventured&#x02026;&#x0201D;: P300 and decision making</article-title>. <source>Psychophysiology</source> <volume>20</volume>, <fpage>260</fpage>&#x02013;<lpage>268</lpage>.<pub-id pub-id-type="doi">10.1111/j.1469-8986.1983.tb02153.x</pub-id><pub-id pub-id-type="pmid">6867221</pub-id></citation></ref>
<ref id="B20"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Katz</surname> <given-names>L.</given-names></name></person-group> (<year>1964</year>). <article-title>Effects of differential monetary gain and loss on sequential two-choice behavior</article-title>. <source>J. Exp. Psychol.</source> <volume>68</volume>, <fpage>245</fpage>&#x02013;<lpage>249</lpage>.<pub-id pub-id-type="doi">10.1037/h0044150</pub-id><pub-id pub-id-type="pmid">14215422</pub-id></citation></ref>
<ref id="B21"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Leland</surname> <given-names>J. W.</given-names></name> <name><surname>Grafman</surname> <given-names>J.</given-names></name></person-group> (<year>2005</year>). <article-title>Experimental tests of the somatic marker hypothesis</article-title>. <source>Games Econ. Behav.</source> <volume>52</volume>, <fpage>386</fpage>&#x02013;<lpage>409</lpage>.<pub-id pub-id-type="doi">10.1016/j.geb.2004.09.001</pub-id></citation></ref>
<ref id="B22"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Masaki</surname> <given-names>H.</given-names></name> <name><surname>Takeuchi</surname> <given-names>S.</given-names></name> <name><surname>Gehring</surname> <given-names>W.</given-names></name> <name><surname>Takasawa</surname> <given-names>N.</given-names></name> <name><surname>Yamazaki</surname> <given-names>K.</given-names></name></person-group> (<year>2006</year>). <article-title>Affective-motivational influences on feedback-related ERPs in a gambling task</article-title>. <source>Brain Res.</source> <volume>1105</volume>, <fpage>110</fpage>&#x02013;<lpage>121</lpage>.<pub-id pub-id-type="doi">10.1016/j.brainres.2006.01.022</pub-id><pub-id pub-id-type="pmid">16483556</pub-id></citation></ref>
<ref id="B23"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Nevo</surname> <given-names>I.</given-names></name> <name><surname>Erev</surname> <given-names>I.</given-names></name></person-group> (<year>2011</year>). <article-title>On surprise, change, and the effect of recent outcomes</article-title>. [Submitted].</citation></ref>
<ref id="B24"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nieuwenhuis</surname> <given-names>S.</given-names></name> <name><surname>Yeung</surname> <given-names>N.</given-names></name> <name><surname>Holroyd</surname> <given-names>C. B.</given-names></name> <name><surname>Schurger</surname> <given-names>A.</given-names></name> <name><surname>Cohen</surname> <given-names>J. D.</given-names></name></person-group> (<year>2004</year>). <article-title>Sensitivity of electrophysiological activity from medial frontal cortex to utilitarian and performance feedback</article-title>. <source>Cereb. Cortex</source> <volume>14</volume>, <fpage>741</fpage>&#x02013;<lpage>747</lpage>.<pub-id pub-id-type="doi">10.1093/cercor/bhh034</pub-id><pub-id pub-id-type="pmid">15054053</pub-id></citation></ref>
<ref id="B25"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Niv</surname> <given-names>Y.</given-names></name> <name><surname>Joel</surname> <given-names>D.</given-names></name> <name><surname>Meilijson</surname> <given-names>I.</given-names></name> <name><surname>Ruppin</surname> <given-names>E.</given-names></name></person-group> (<year>2002</year>). <article-title>Evolution of reinforcement learning in uncertain environments: a simple explanation for complex foraging behaviors</article-title>. <source>Adapt. Behav.</source> <volume>10</volume>, <fpage>5</fpage>&#x02013;<lpage>24</lpage>.<pub-id pub-id-type="doi">10.1177/10597123020101001</pub-id></citation></ref>
<ref id="B26"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rakow</surname> <given-names>T.</given-names></name> <name><surname>Demes</surname> <given-names>K. A.</given-names></name> <name><surname>Newell</surname> <given-names>B. R.</given-names></name></person-group> (<year>2008</year>). <article-title>Biased samples not mode of presentation: re-examining the apparent underweighting of rare events in experience-based choice</article-title>. <source>Organ. Behav. Hum. Dec. Process.</source> <volume>106</volume>, <fpage>168</fpage>&#x02013;<lpage>179</lpage>.<pub-id pub-id-type="doi">10.1016/j.obhdp.2008.02.001</pub-id></citation></ref>
<ref id="B27"><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Rumelhart</surname> <given-names>D. E.</given-names></name> <name><surname>McClelland</surname> <given-names>J. E.</given-names></name> <collab>The PDP Research Group</collab></person-group>. (<year>1986</year>). <source>Parallel Distributed Processing: Explorations in the Microstructure of Cognition</source>, Vols. <volume>1</volume> and 2. <conf-loc>Cambridge, MA</conf-loc>: <conf-sponsor>MIT Press</conf-sponsor>.</citation></ref>
<ref id="B28"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schultz</surname> <given-names>W.</given-names></name> <name><surname>Dayan</surname> <given-names>P.</given-names></name> <name><surname>Montague</surname> <given-names>R.</given-names></name></person-group> (<year>1997</year>). <article-title>A neural substrate of prediction and reward</article-title>. <source>Science</source> <volume>14</volume>, <fpage>1593</fpage>&#x02013;<lpage>1599</lpage>.<pub-id pub-id-type="doi">10.1126/science.275.5306.1593</pub-id></citation></ref>
<ref id="B29"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Silberberg</surname> <given-names>A.</given-names></name> <name><surname>Roma</surname> <given-names>P. G.</given-names></name> <name><surname>Huntsberry</surname> <given-names>M. E.</given-names></name> <name><surname>Warren-Boulton</surname> <given-names>F. R.</given-names></name> <name><surname>Takayuki</surname> <given-names>S.</given-names></name> <name><surname>Ruggiero</surname> <given-names>A. M.</given-names></name> <name><surname>Suomi</surname> <given-names>S. J.</given-names></name></person-group> (<year>2008</year>). <article-title>On loss aversion in capuchin monkeys</article-title>. <source>J. Exp. Anal. Behav.</source> <volume>89</volume>, <fpage>145</fpage>&#x02013;<lpage>155</lpage>.<pub-id pub-id-type="doi">10.1901/jeab.2008-89-145</pub-id><pub-id pub-id-type="pmid">18422015</pub-id></citation></ref>
<ref id="B30"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Squires</surname> <given-names>N. K.</given-names></name> <name><surname>Squires</surname> <given-names>K. C.</given-names></name> <name><surname>Hillyard</surname> <given-names>S. A.</given-names></name></person-group> (<year>1975</year>). <article-title>Two varieties of long-latency positive waves evoked by unpredictable auditory stimuli in man</article-title>. <source>Electroencephalogr. Clin. Neurophysiol.</source> <volume>38</volume>, <fpage>387</fpage>&#x02013;<lpage>401</lpage>.<pub-id pub-id-type="doi">10.1016/0013-4694(75)90263-1</pub-id><pub-id pub-id-type="pmid">46819</pub-id></citation></ref>
<ref id="B31"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tu</surname> <given-names>S.</given-names></name> <name><surname>Li</surname> <given-names>H.</given-names></name> <name><surname>Jou</surname> <given-names>J.</given-names></name> <name><surname>Zhang</surname> <given-names>Q.</given-names></name> <name><surname>Wang</surname> <given-names>T.</given-names></name> <name><surname>Yu</surname> <given-names>C.</given-names></name> <name><surname>Qiu</surname> <given-names>J.</given-names></name></person-group> (<year>2009</year>). <article-title>An event-related potential study of deception to self preferences</article-title>. <source>Brain Res.</source> <volume>1247</volume>, <fpage>142</fpage>&#x02013;<lpage>148</lpage>.<pub-id pub-id-type="doi">10.1016/j.brainres.2008.09.090</pub-id><pub-id pub-id-type="pmid">18952072</pub-id></citation></ref>
<ref id="B32"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Weber</surname> <given-names>E. U.</given-names></name> <name><surname>Shafir</surname> <given-names>S.</given-names></name> <name><surname>Blais</surname> <given-names>A.-R.</given-names></name></person-group> (<year>2004</year>). <article-title>Predicting risk sensitivity in humans and lower animals: risk as variance or coefficient of variation</article-title>. <source>Psychol. Rev.</source> <volume>111</volume>, <fpage>430</fpage>&#x02013;<lpage>445</lpage>.<pub-id pub-id-type="doi">10.1037/0033-295X.111.2.430</pub-id><pub-id pub-id-type="pmid">15065916</pub-id></citation></ref>
<ref id="B33"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wu</surname> <given-names>S.-W.</given-names></name> <name><surname>Delgado</surname> <given-names>M. R.</given-names></name> <name><surname>Maloney</surname> <given-names>L. T.</given-names></name></person-group> (<year>2011</year>). <article-title>The neural correlates of subjective utility of monetary outcome and probability weight in economic and in motor decision under risk</article-title>. <source>J. Neurosci.</source> <volume>31</volume>, <fpage>8822</fpage>&#x02013;<lpage>8831</lpage>.<pub-id pub-id-type="doi">10.1523/JNEUROSCI.1861-11.2011</pub-id><pub-id pub-id-type="pmid">21677166</pub-id></citation></ref>
<ref id="B34"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yechiam</surname> <given-names>E.</given-names></name> <name><surname>Barron</surname> <given-names>G.</given-names></name> <name><surname>Erev</surname> <given-names>I.</given-names></name></person-group> (<year>2005</year>). <article-title>The role of personal experience in contributing to different patterns of response to rare terrorist attacks</article-title>. <source>J. Conflict Resolut.</source> <volume>49</volume>, <fpage>430</fpage>&#x02013;<lpage>439</lpage>.<pub-id pub-id-type="doi">10.1177/0022002704270847</pub-id></citation></ref>
<ref id="B35"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Yechiam</surname> <given-names>E.</given-names></name> <name><surname>Hochman</surname> <given-names>G.</given-names></name></person-group> (<year>2011</year>). <article-title>Losses as modulators of attention: review and analysis of the unique effects of losses over gains</article-title>. [Submitted].</citation></ref>
<ref id="B36"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yechiam</surname> <given-names>E.</given-names></name> <name><surname>Telpaz</surname> <given-names>A.</given-names></name></person-group> (<year>2011</year>). <article-title>To take risk is to face loss: a tonic pupilometry study</article-title>. <source>Front. Psychol.</source> <volume>2</volume>:<fpage>344</fpage>.<pub-id pub-id-type="doi">10.3389/fpsyg.2011.00344</pub-id><pub-id pub-id-type="pmid">22125546</pub-id></citation></ref>
<ref id="B37"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yechiam</surname> <given-names>E.</given-names></name> <name><surname>Telpaz</surname> <given-names>A.</given-names></name></person-group> (in press). <article-title>Losses induce consistency in risk taking even without loss aversion</article-title>. <source>J. Behav. Decis. Mak.</source><pub-id pub-id-type="doi">10.1002/bdm.758</pub-id><pub-id pub-id-type="pmid">21836771</pub-id></citation></ref>
<ref id="B38"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yeung</surname> <given-names>N.</given-names></name> <name><surname>Sanfey</surname> <given-names>A. G.</given-names></name></person-group> (<year>2004</year>). <article-title>Independent coding of reward magnitude and valence in the human brain</article-title>. <source>J. Neurosci.</source> <volume>24</volume>, <fpage>6258</fpage>&#x02013;<lpage>6264</lpage>.<pub-id pub-id-type="doi">10.1523/JNEUROSCI.4537-03.2004</pub-id><pub-id pub-id-type="pmid">15254080</pub-id></citation></ref>
</ref-list>
<fn-group>
<fn id="fn1"><p><sup>1</sup>Risk neutrality over time is also inconsistent with Kahneman and Tversky&#x00027;s (<xref ref-type="bibr" rid="B18">1979</xref>) &#x0201C;loss aversion&#x0201D; hypothesis. As noted in Section <xref ref-type="sec" rid="s1">&#x0201C;Brain Activation and Behavioral Responses to Losses,&#x0201D;</xref> studies of experience-based decisions (e.g., Erev et al., <xref ref-type="bibr" rid="B9">2008</xref>) typically do not find reliable behavioral manifestations of loss aversion. The studies reported in Figure <xref ref-type="fig" rid="F1">1</xref> replicate this pattern.</p></fn>
</fn-group>
</back>
</article>
