<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article article-type="research-article" dtd-version="2.3" xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Environ. Sci.</journal-id>
<journal-title>Frontiers in Environmental Science</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Environ. Sci.</abbrev-journal-title>
<issn pub-type="epub">2296-665X</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">1074896</article-id>
<article-id pub-id-type="doi">10.3389/fenvs.2023.1074896</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Environmental Science</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Perhaps, perhaps, perhaps: Navigating uncertainty in environmental flow management</article-title>
<alt-title alt-title-type="left-running-head">Judd et al.</alt-title>
<alt-title alt-title-type="right-running-head">
<ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fenvs.2023.1074896">10.3389/fenvs.2023.1074896</ext-link>
</alt-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name>
<surname>Judd</surname>
<given-names>Meegan</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
<xref ref-type="corresp" rid="c001">&#x2a;</xref>
<uri xlink:href="https://loop.frontiersin.org/people/1337347/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Horne</surname>
<given-names>Avril C.</given-names>
</name>
<xref ref-type="aff" rid="aff2">
<sup>2</sup>
</xref>
<uri xlink:href="https://loop.frontiersin.org/people/434627/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Bond</surname>
<given-names>Nick</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
<uri xlink:href="https://loop.frontiersin.org/people/281387/overview"/>
</contrib>
</contrib-group>
<aff id="aff1">
<sup>1</sup>
<institution>Centre for Freshwater Ecosystems</institution>, <institution>La Trobe University</institution>, <addr-line>Wodonga</addr-line>, <addr-line>VIC</addr-line>, <country>Australia</country>
</aff>
<aff id="aff2">
<sup>2</sup>
<institution>Department of Engineering</institution>, <institution>University of Melbourne</institution>, <addr-line>Melbourne</addr-line>, <addr-line>VIC</addr-line>, <country>Australia</country>
</aff>
<author-notes>
<fn fn-type="edited-by">
<p>
<bold>Edited by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/1312850/overview">Ted Grantham</ext-link>, University of California, Berkeley, United States</p>
</fn>
<fn fn-type="edited-by">
<p>
<bold>Reviewed by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/1291648/overview">Daniela Rosero-L&#xf3;pez</ext-link>, Universidad San Francisco de Quito, Ecuador</p>
<p>
<ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/2138812/overview">Gail Cowie</ext-link>, Albany State University, United States</p>
</fn>
<corresp id="c001">&#x2a;Correspondence: Meegan Judd, <email>meegan.judd@latrobe.edu.au</email>
</corresp>
<fn fn-type="other">
<p>This article was submitted to Freshwater Science, a section of the journal Frontiers in Environmental Science</p>
</fn>
</author-notes>
<pub-date pub-type="epub">
<day>21</day>
<month>02</month>
<year>2023</year>
</pub-date>
<pub-date pub-type="collection">
<year>2023</year>
</pub-date>
<volume>11</volume>
<elocation-id>1074896</elocation-id>
<history>
<date date-type="received">
<day>20</day>
<month>10</month>
<year>2022</year>
</date>
<date date-type="accepted">
<day>07</day>
<month>02</month>
<year>2023</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#xa9; 2023 Judd, Horne and Bond.</copyright-statement>
<copyright-year>2023</copyright-year>
<copyright-holder>Judd, Horne and Bond</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p>
</license>
</permissions>
<abstract>
<p>Uncertainty can be an impediment to decision making and result in decision paralysis. In environmental flow management, system complexity and natural variability increase uncertainty. Climate change provides further uncertainty and can hinder decision making altogether. Environmental flow managers express reluctance to include climate change adaptation in planning due to large knowledge gaps in hydro-ecological relationships. We applied a hybrid method of hypothetical scenarios and closed ended questions within a survey to investigate ecological trade off decision making behaviours and cognitive processes of environmental flow managers. The scenarios provided were both similar to participants&#x2019; past experiences, and others were entirely unprecedented and hence unfamiliar. We found managers were more confident making decisions in situations they are familiar with, and most managers show low levels of confidence in making trade off decisions under uncertain circumstances. When given a choice, the most common response to uncertainty was to gather additional information, however information is often unavailable or inaccessible&#x2013;either it does not exist, or uncertainties are so great that decisions are deferred. Given future rainfall is likely to be different from the past, environmental flow managers must work to adopt robust decision making frameworks that will increase confidence in decision making by acknowledging uncertainties. This can be done through tools developed to address decision making under deep uncertainty. Adapting these tools and methods to environmental flow management will ensure managers can begin to consider likely, necessary future trade-offs in a more informed, transparent and robust manner and increase confidence in decision making under uncertainty.</p>
</abstract>
<kwd-group>
<kwd>environmental flow</kwd>
<kwd>uncertainty</kwd>
<kwd>decision making</kwd>
<kwd>climate change</kwd>
<kwd>adaptation</kwd>
</kwd-group>
</article-meta>
</front>
<body>
<sec id="s1">
<title>1 Introduction</title>
<p>&#x201c;If you can&#x2019;t make your mind up, we&#x2019;ll never get started&#x201d;. Doris Day.</p>
<p>Without acknowledging uncertainties of the future, managers of environmental flows are effectively aiming to maintain a museum of the past. Environmental flows are an important tool in river health management, primarily used in regulated river systems (<xref ref-type="bibr" rid="B3">Arthington et al., 2018</xref>). Determination of environmental flows are typically guided by scientifically based flow assessments that develop recommendations for water delivery linked to specific ecological objectives (<xref ref-type="bibr" rid="B80">Tharme, 2003</xref>; <xref ref-type="bibr" rid="B64">Poff et al., 2017</xref>). Flow recommendations may include the magnitude, frequency or timing of water releases required to achieve a specific objective. Environmental water (used to deliver flow recommendations) is defined as all legally available water that can be used in a river system to provide environmental benefit such as protection of specific species, habitat maintenance or ecosystem function (<xref ref-type="bibr" rid="B38">Horne et al., 2017</xref>).</p>
<p>There is clear evidence that anthropogenic climate change is occurring, yet agreement on how to adapt environmental flow management is far from absolute. Environmental flow assessments (and recommendations) typically aim to restore ecosystems to an historic condition or protect them from further change and use historic flow regimes to make recommendations (<xref ref-type="bibr" rid="B12">Capon et al., 2018</xref>; <xref ref-type="bibr" rid="B37">Horne et al., 2022</xref>). However the past is not a good representation of the future and climate adaptation is required when determining flow objectives and recommendations for future environmental water (<xref ref-type="bibr" rid="B42">Judd et al., 2022</xref>). Under climate change, temperature and rainfall patterns are predicted to change along with rainfall run off relationships and streamflows (<xref ref-type="bibr" rid="B70">Saft et al., 2016</xref>). As these hydro-climatic changes occur, some current ecological relationships are unlikely to remain and consequently objectives are also unlikely to be achievable (<xref ref-type="bibr" rid="B42">Judd et al., 2022</xref>). Future water use and flow recommendations need to incorporate climate change adaptation (<xref ref-type="bibr" rid="B40">John et al., 2020</xref>). Yet, there are many known barriers to climate change adaptation, including insufficient staff and funding, lack of political leadership, backward looking legislative requirements, and uncertainty (<xref ref-type="bibr" rid="B1">Abunnasr et al., 2015</xref>; <xref ref-type="bibr" rid="B43">Kiem et al., 2016</xref>; <xref ref-type="bibr" rid="B58">Oberlack and Eisenack, 2018</xref>; <xref ref-type="bibr" rid="B41">Judd et al., 2023</xref>). Uncertainties include future greenhouse gas emissions; the direction, magnitude and intensity of change in response to emissions with large variances in predictions at particular geographic locations (<xref ref-type="bibr" rid="B31">Hallegatte et al., 2012</xref>; <xref ref-type="bibr" rid="B72">Shepherd et al., 2018</xref>). Managers of water for environmental flows (environmental water managers) cite uncertainty of hydrological and ecological systems&#x2019; response to climate change as a major barrier to adaptation (<xref ref-type="bibr" rid="B41">Judd et al., 2023</xref>). Adaptation to climate change also suffers from considerable uncertainties regarding how social, economic and political systems will react (<xref ref-type="bibr" rid="B45">Kundzewicz et al., 2018</xref>).</p>
<p>Part of the role of environmental water managers is to prioritise flow recommendations based on flow assessments and antecedent conditions (<xref ref-type="bibr" rid="B24">Doolan et al., 2017</xref>). This &#x2018;active&#x2019; management of water allows managers to determine how much and when to use water to achieve the desired ecological objectives. Management can include releasing water from dams to restore part of a flow regime or adding water releases to a natural flow to hit flow recommendations. Decisions to manage water are made in real time based on current ecological conditions, water availability and other constraints such as channel capacity or social/recreational requirements. At times flow recommendations for one component of the ecosystem (e.g., vegetation) may conflict with recommendations for another component (e.g. fish) and water managers will be required to make a trade off decision between two ecosystem components within the one system. In times of drought management tends to focus on maintaining drought refuges, avoiding species loss, and providing opportunities for ecosystem recovery once drought breaks (<xref ref-type="bibr" rid="B24">Doolan et al., 2017</xref>). In times of water scarcity, decision making is substantially more difficult as uncertainties in water availability and ecosystem response become more unknown and constrained.</p>
<p>Uncertainty in environmental flow management can be separated into nature and level. The nature of uncertainty relevant to the types of decisions environmental water managers must make are epistemic uncertainty and aleatoric uncertainty. Epistemic uncertainty arises due to a lack of knowledge or information about a phenomenon or process. This type of uncertainty can be reduced by gaining new knowledge or doing more research. Reducing uncertainty with new information can help increase confidence in decisions (<xref ref-type="bibr" rid="B75">Singh et al., 2020</xref>). Aleatoric uncertainty is defined as uncertainty that cannot be reduced by increasing knowledge due to the inherent variability and unpredictability of the phenomenon (<xref ref-type="bibr" rid="B20">Dewulf and Biesbroek, 2018</xref>; <xref ref-type="bibr" rid="B75">Singh et al., 2020</xref>). Both these sources of uncertainty will increase with climate change.</p>
<p>Levels of uncertainty have been defined by <xref ref-type="bibr" rid="B47">Kwakkel et al. (2010)</xref> as the &#x201c;assignment of likelihood to things or events&#x201d; with the likelihood able to be expressed either qualitatively or quantitatively. <xref ref-type="bibr" rid="B47">Kwakkel et al. (2010)</xref> identified four levels of uncertainty ranging from shallow uncertainty (level one) to recognised ignorance (level four). Following their definition environmental water management under climate change would fall into level three uncertainty. Level three is also referred to as &#x2018;deep uncertainty&#x2019;. This is where alternative options can be specified but probability functions for the likelihood of alternatives cannot be determined, and an order ranking of alternatives is unknown or cannot be agreed on by experts or decision makers. <xref ref-type="bibr" rid="B50">Lempert et al. (2003)</xref> defines deep uncertainty as unknown or unagreeable boundaries surrounding the external context of a system, how the system works and where its boundaries lie, and the outcomes of interest from the system or their relative importance.</p>
<p>Both the nature and level of uncertainty impose impediments to making well informed decisions about future management of environmental water. The uncertainty surrounding climate change projections coupled with the natural variability and complexity of ecosystems means there will always be uncertainty in making environmental management decisions. Aleatoric uncertainty will always exist, and epistemic and deep uncertainty provide barriers to timely decision making if the uncertainties cannot be resolved. Herein lies the challenge for environmental water managers: there are uncertainties that will always exist, and others where a decision will need to be made prior to information becoming available. Understanding how water managers respond to such uncertainty will enable development of appropriate tools for planning and policy decisions to be made.</p>
<p>People respond to uncertainty in different ways as detailed by <xref ref-type="bibr" rid="B51">Lipshitz and Strauss (1997)</xref> and <xref ref-type="bibr" rid="B62">Pasquini et al. (2019)</xref>. The three principal response categories to uncertainty are:<list list-type="simple">
<list-item>
<p>&#x2022; Suppress - through complete denial, ignoring or distorting undesirable information, relying on intuition and taking a gamble. Additionally, fear of making the wrong choice can also result in avoidance of making a decision (<xref ref-type="bibr" rid="B68">Retief et al., 2013</xref>). Using traditional rational decision making approaches under climate change could be considered a form of suppression.</p>
</list-item>
<list-item>
<p>&#x2022; Reduce - by collecting more information, deferring decision making, extrapolating from existing data, and shortening the time frames for decisions. However, deciding to collect more information should be an option employed with caution to ensure it will add value, be available in time and change the decision outcome (<xref ref-type="bibr" rid="B21">Dietz, 2013</xref>).</p>
</list-item>
<list-item>
<p>&#x2022; Acknowledge&#x2013;often adopted when reducing uncertainty is not possible. This response involves preparing to confront potential risks under a chosen course of action, and may include incorporating reversible or no regret actions, or making an informed decision of the pros and cons. The use of multiple plausible futures or confidence intervals in data analysis also helps acknowledge uncertainty (<xref ref-type="bibr" rid="B9">Brugnach et al., 2008</xref>).</p>
</list-item>
</list>
</p>
<p>
<xref ref-type="bibr" rid="B51">Lipshitz and Strauss (1997)</xref> undertook an empirical experiment and determined the following response strategies were used most frequently (in order); reduction, forestalling, assumption based reasoning, weighing pros and cons where there was difficulty choosing between alternatives, and suppression. They also note that different strategies were used in different situations e.g., assumption based reasoning was used where there was incomplete information and reduction was adopted where there was a lack of understanding. When people feel uncertain or a decision is difficult, the response can be to delay, avoid and/or be paralysed to make decisions (<xref ref-type="bibr" rid="B88">Weber et al., 2001</xref>; <xref ref-type="bibr" rid="B35">H&#xf6;llermann and Evers, 2017</xref>). In a study by <xref ref-type="bibr" rid="B23">Doerner (1990)</xref> people&#x2019;s decision responses to maintaining or improving a complex and dynamic system were observed. Results showed common faults of people&#x2019;s decisions included failing to establish clear goals, treating a complex system as separate variables rather than an integrated system, and making decisions without checking the effects of these to other parts of the system. <xref ref-type="bibr" rid="B23">Doerner (1990)</xref> found even though participants had enough information they were not very adaptative in their thinking and devoted most of their time to problems they currently faced rather than looking to potential future problems or how their actions today may lead to future issues.</p>
<p>Decision making in water planning and policy has traditionally relied on rational and probabilistic methods to reduce uncertainty and optimise one preferred option (<xref ref-type="bibr" rid="B29">Haasnoot et al., 2013</xref>; <xref ref-type="bibr" rid="B36">Horne et al., 2016</xref>; <xref ref-type="bibr" rid="B74">Siders and Pierce, 2021</xref>). This approach follows a &#x2018;reduce uncertainty&#x2019; principle where a set of possible actions are determined and compared through probability distribution functions, with the best performing option chosen to optimise a desired outcome (<xref ref-type="bibr" rid="B13">Citroen, 2011</xref>; <xref ref-type="bibr" rid="B62">Pasquini et al., 2019</xref>). This requires information such as averaged hydrological parameters, the likelihood of alternate states, how actions will combine to form outcomes and the benefit of one outcome over another (<xref ref-type="bibr" rid="B65">Polasky et al., 2011</xref>). During assessment of options this approach acknowledges uncertainties, but ultimately aims to maximise one particular outcome within the knowledge of some spread in performance (and uncertainty) amongst all options. The approach often employs data intensive mathematical models that follow generalised principles. They do not provide reasons for why or how a decision may deviate from the norm (<xref ref-type="bibr" rid="B62">Pasquini et al., 2019</xref>).</p>
<p>We know that river system dynamics&#x2013;particularly under climate change&#x2013;include significant aleatoric uncertainty, where these traditional approaches of &#x2018;reduction&#x2019; can no longer be applied. Managers of environmental water and other natural resources express reluctance to include climate adaptation due to large knowledge gaps surrounding ecological and hydrological relationships (<xref ref-type="bibr" rid="B78">Stein et al., 2013</xref>, <xref ref-type="bibr" rid="B41">Judd et al., 2023</xref>). Although knowledge is improving, researchers suggest there is a clear need to increase understanding of flow ecology relationships (<xref ref-type="bibr" rid="B82">Thompson et al., 2019</xref>). Many models developed to predict biological responses to climate change ignore fundamental biological functions such as species interactions, demography (births, deaths, phenology etc) and evolutionary potential (<xref ref-type="bibr" rid="B84">Urban et al., 2016</xref>). Even when attempts are made to include this information in ecological models there is limited data due to funding constraints for long term monitoring programs. Further, the translation of global climate scenarios into meaningful and useful localised hydrological and ecological information for water supply remains a barrier (<xref ref-type="bibr" rid="B43">Kiem et al., 2016</xref>). Consequently, probability based decision methods that optimise for one solution will no longer be appropriate (<xref ref-type="bibr" rid="B9">Brugnach et al., 2008</xref>; <xref ref-type="bibr" rid="B32">Hallegatte, 2009</xref>; <xref ref-type="bibr" rid="B65">Polasky et al., 2011</xref>; <xref ref-type="bibr" rid="B53">Maier et al., 2016</xref>; <xref ref-type="bibr" rid="B25">Fletcher et al., 2017</xref>). Future planning needs to be either robust; include objectives or actions that can be achievable over a range of plausible futures, or dynamic; objectives and policies that are flexible and can change over time as new information becomes available. This causes further challenges for a technocratic industry where data and &#x2018;uncertainty reduction&#x2019; for optimisation has always dominated thinking (<xref ref-type="bibr" rid="B61">Pahl-Wostl et al., 2013</xref>; <xref ref-type="bibr" rid="B55">McLoughlin et al., 2020</xref>).</p>
<p>This paper examines the readiness and response of environmental water managers to make ongoing decisions under uncertainty. A survey approach is adopted to challenge environmental water managers to make decisions in situations they are familiar with, and possible future scenarios. The data analysis links decision making in three hypotheses with the human responses of <xref ref-type="bibr" rid="B62">Pasquini et al. (2019)</xref> and <xref ref-type="bibr" rid="B51">Lipshitz and Strauss (1997)</xref>. This study investigates the following three hypotheses:</p>
<p>
<statement content-type="h1" id="H1">
<label>H1</label>
<p>Environmental water staff have a high confidence in making ecological trade off decisions when situations are similar to their past lived experience (reduce)</p>
</statement>
</p>
<p>
<statement content-type="h2" id="H2">
<label>H2</label>
<p>Environmental water staff are unwilling to make ecological trade off decisions when there is insufficient information (supress)</p>
</statement>
</p>
<p>
<statement content-type="h3" id="H3">
<label>H3</label>
<p>Environmental water staff will be confident in making trade off decisions when provided with climate change information they consider to be important (acknowledge)</p>
<p>This study provides the first step in understanding how environmental water managers are making decisions, what type of information they consider important and how confident they feel making these decisions. By framing the managers response to uncertainty around &#x2018;acknowledge, reduce, suppress&#x2019; we will be in a better position to support decision making under uncertainty and provide recommendations for future research, and development of methods or tools that enable increased confidence and ability of managers to make decisions in such situations. Bearing Doris Day&#x2019;s point in mind, we can help environmental water managers to make their mind up and get started despite not knowing with certainty.</p>
</statement>
</p>
</sec>
<sec sec-type="methods" id="s2">
<title>2 Method</title>
<p>This research used a self administered online survey to measure how environmental water managers make decisions when faced with incomplete information (thereby introducing uncertainty). The questions were predominately a mix of behavioural and self assessment style questions including a combination of closed end questions and hypothetical scenarios (see <xref ref-type="sec" rid="s12">Supplementary Material</xref>). Scenarios were presented as descriptive &#x2018;stories&#x2019; which can be useful when decision making is required in uncertain conditions (<xref ref-type="bibr" rid="B63">Peterson et al., 2003</xref>). Scenarios can be based on past events or situations similar to existing conditions, they can be imagined and combined with climate change information, but importantly they should be plausible (<xref ref-type="bibr" rid="B10">Bryman, 2016</xref>; <xref ref-type="bibr" rid="B72">Shepherd et al., 2018</xref>).</p>
<p>The inclusion of imagined, hypothetical scenarios in this research allowed participants to improve their awareness of their decisions, think deeply about the scenarios provided, and demonstrate their current thinking and ideas. The survey scenarios were developed to determine how confident water managers were in situations they were familiar with, and likely future scenarios under a water scarce future to link back to hypotheses one to three.</p>
<p>The first scenario (<xref ref-type="fig" rid="F1">Figure 1</xref>) asked participants to decide how they would use environmental water to support two different species located in different rivers of the same catchment during a drought with limited water. Historically water availability has been such that both species can be supported, but under this scenario there is restricted water availability and hence an ecological trade off decision is required between the two species. A drought scenario was chosen as there is a high likelihood that most participants have managed water during a drought, and it is a likely future scenario under climate change. Participants were asked to make a trade off decision between providing a full fresh, partial fresh or no fresh for one species <italic>versus</italic> the other. A fresh is defined as a short duration flow event greater than median flow and provides functions such as biological triggers for migration and/or spawning and physio chemical changes (<xref ref-type="bibr" rid="B19">DEPI, 2013</xref>). A full fresh was the recommended action for both species and benefits of a partial fresh were uncertain along with water trade and operational rules, broader population status including vulnerability and most recent antecedent conditions. This deliberate omission of certain information relates to hypothesis two; &#x201c;staff are unwilling to make ecological trade off decisions when there is insufficient information&#x201d;. Questions about this scenario also linked to hypothesis one; &#x201c;staff have high confidence in making ecological trade off decisions when situations are similar to their past lived experience&#x201d; by testing whether participants have previously experienced a similar situation and their level of confidence in their water use decision.</p>
<fig id="F1" position="float">
<label>FIGURE 1</label>
<caption>
<p>Hypothetical scenario (one) provided in the online survey for environmental water managers to measure trade off decision making response during a drought and in an uncertain situation.</p>
</caption>
<graphic xlink:href="fenvs-11-1074896-g001.tif"/>
</fig>
<p>In scenario two (<xref ref-type="fig" rid="F2">Figure 2</xref>), participants were given information deemed important for decision making under climate change as identified by <xref ref-type="bibr" rid="B41">Judd et al., 2023</xref>. Information provided included species vulnerability assessments, temperature and water availability changes, drought refuge availability, extreme event frequency and habitat connectivity, species life span, social value and ecological function. The confidence levels of these projections were also provided. Considering the information provided participants were asked if they wanted to continue delivering water and pursuing the objective for the nominated species, despite climate data showing this species had a moderate to high level of vulnerability and survival looked unlikely. This scenario tests hypothesis three; &#x201c;staff will be confident in making trade off decisions when provided with climate change information they consider to be important&#x201d; and adds uncertainty in the moderate confidence levels provided for future conditions. This scenario enabled respondents to think about the types of decisions they will have to make more commonly in the future.</p>
<fig id="F2" position="float">
<label>FIGURE 2</label>
<caption>
<p>Hypothetical scenario (two) provided in the online survey for environmental water managers to measure their willingness to change objectives when provided with relevant climate change information.</p>
</caption>
<graphic xlink:href="fenvs-11-1074896-g002.tif"/>
</fig>
<p>The survey was developed through an iterative process of review and pre-testing with a small number of environmental water managers. The online survey was developed in Question Pro (Inc) survey software and distributed by email to approximately 80&#x2013;100 environmental water staff or researchers identified through purposive sampling (<xref ref-type="bibr" rid="B26">Gideon, 2012</xref>). The survey was distributed to staff working in government water management agencies who are responsible for making decisions on the long term use of riverine environmental water throughout Australia, with a strong focus on the south east. Although researchers are not responsible for making decisions about water use and/or delivery, they are often approached by environmental water staff to help inform decision making. The survey was distributed in late January 2022 and open for approximately 6&#xa0;weeks. This timing was chosen as it was thought staff would be returning to work after summer holidays and likely to have time available to complete the survey. Two reminder emails were sent to everyone on the distribution list at 4 weeks and just before the closing date. There were 25 completed responses and average completion time for the survey was 45&#xa0;min.</p>
<p>The use of scenarios followed by specific survey questions meant data analysis could link to the study hypotheses. Questions in the survey that linked directly to the study hypotheses include &#x201c;how confident are you with your decision&#x201d; and &#x201c;how closely does this reflect your own experience&#x201d;. Other questions used in the data analysis came from questions specifically asking the participants their perception of the amount/type of data provided for decision making, if there were specific pieces on information that assisted with their decision making, and if they found certain decisions difficult to make. Some of these questions were repeated with each scenario and additionally asked in a general manner. Questions asking the same question in different situations were collected and compared to provide results described here.</p>
</sec>
<sec sec-type="results" id="s3">
<title>3 Results</title>
<sec id="s3-1">
<title>3.1 Demographics and general response to uncertainty</title>
<p>There were 25 complete responses to the online survey encompassing a diversity of experience and training, and roles and responsibilities (<xref ref-type="table" rid="T1">Table 1</xref>). There were no partially completed survey responses.</p>
<table-wrap id="T1" position="float">
<label>TABLE 1</label>
<caption>
<p>Participant demographics.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="left"> </th>
<th align="center">
<italic>n</italic> &#x3d; 25</th>
<th align="center">%</th>
<th align="left"> </th>
<th align="center">
<italic>n</italic> &#x3d; 25</th>
<th align="center">%</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td colspan="3" align="left" style="background-color:#BFBFBF">Age</td>
<td align="left" style="background-color:#BFBFBF">Trained as:</td>
<td align="left" style="background-color:#BFBFBF"/>
<td align="left" style="background-color:#BFBFBF"/>
</tr>
<tr>
<td align="left">22&#x2013;32</td>
<td align="center">2</td>
<td align="center">8</td>
<td align="left">Ecologist/biologist</td>
<td align="center">14</td>
<td align="center">56</td>
</tr>
<tr>
<td align="left">33&#x2013;44</td>
<td align="center">12</td>
<td align="center">48</td>
<td align="left">Physical scientist</td>
<td align="center">3</td>
<td align="center">12</td>
</tr>
<tr>
<td align="left">45&#x2013;54</td>
<td align="center">9</td>
<td align="center">36</td>
<td align="left">Engineer</td>
<td align="center">3</td>
<td align="center">12</td>
</tr>
<tr>
<td align="left">55&#x2013;65</td>
<td align="center">2</td>
<td align="center">8</td>
<td align="left">Geographer</td>
<td align="center">1</td>
<td align="center">4</td>
</tr>
<tr>
<td colspan="3" align="left"/>
<td align="left">Other (NRM, land/water manager)</td>
<td align="center">4</td>
<td align="center">16</td>
</tr>
<tr>
<td colspan="3" align="left" style="background-color:#BFBFBF">Years of experience</td>
<td align="left" style="background-color:#BFBFBF">Currently working as:</td>
<td align="left" style="background-color:#BFBFBF"/>
<td align="left" style="background-color:#BFBFBF"/>
</tr>
<tr>
<td align="left">0&#x2013;4</td>
<td align="center">6</td>
<td align="center">24</td>
<td align="left">Operational manager/officer</td>
<td align="center">4</td>
<td align="center">16</td>
</tr>
<tr>
<td align="left">5&#x2013;9</td>
<td align="center">2</td>
<td align="center">8</td>
<td align="left">Strategic manager/officer</td>
<td align="center">6</td>
<td align="center">24</td>
</tr>
<tr>
<td align="left">10&#x2013;15</td>
<td align="center">10</td>
<td align="center">40</td>
<td align="left">Both strategic and operational</td>
<td align="center">10</td>
<td align="center">40</td>
</tr>
<tr>
<td align="left">16&#x2013;20</td>
<td align="center">4</td>
<td align="center">16</td>
<td align="left">Researcher</td>
<td align="center">3</td>
<td align="center">12</td>
</tr>
<tr>
<td align="left">Longer than 20</td>
<td align="center">3</td>
<td align="center">12</td>
<td align="left">Other (community engagement, project officer)</td>
<td align="center">2</td>
<td align="center">8</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>Participants were asked about their general approach to decision making; how confident they are in making a decision with a lack of information and how they would go about making such a decision. Eight of the 25 participants had a very high or high level of confidence, while 14 had a medium level of confidence. Three had low confidence. Responses to how participants go about making a decision with uncertainty are shown in <xref ref-type="fig" rid="F3">Figure 3</xref>. Linking the answers to <xref ref-type="bibr" rid="B51">Lipshitz and Strauss (1997)</xref> the overwhelmingly most common response was to reduce uncertainty by gaining additional information from experts or colleagues or drawing on a previous similar experience. An additional six of the 25 would delay their decision while reducing uncertainty by sourcing more information. Although fewer respondents aimed to acknowledge uncertainty by making reversible decisions a substantial number (14/25) still chose this option while some participants (7/25) chose to suppress uncertainty by relying on intuition.</p>
<fig id="F3" position="float">
<label>FIGURE 3</label>
<caption>
<p>Online survey responses to a question asking how participants generally respond to decision making with uncertainty. Participants were Australian environmental flow managers (<italic>n</italic> &#x3d; 25) responsible for making decisions on water use.</p>
</caption>
<graphic xlink:href="fenvs-11-1074896-g003.tif"/>
</fig>
</sec>
<sec id="s3-2">
<title>3.2 Hypothesis 1&#x2014;Environmental water managers have high confidence in making ecological trade off decisions when situations are similar to past lived experiences</title>
<p>Environmental water managers were found to be most confident in decision making when they feel the situation is similar to what they have previously experienced (<xref ref-type="fig" rid="F4">Figure 4</xref>), however there was some spread in participant levels of confidence. This result is a common human response with much literature showing that personal experience, especially recent experiences, can be the most frequently drawn on source of information in decision making (<xref ref-type="bibr" rid="B27">Giehl et al., 2017</xref>; <xref ref-type="bibr" rid="B4">Ausden and Walsh, 2020</xref>; <xref ref-type="bibr" rid="B60">Page and Dilling, 2020</xref>; <xref ref-type="bibr" rid="B44">Kong et al., 2021</xref>). Two participants showed relatively very high or somewhat high levels of confidence without having been in a similar situation. Both these participants had more than 20&#xa0;years&#x2019; experience working in environmental water management.</p>
<fig id="F4" position="float">
<label>FIGURE 4</label>
<caption>
<p>Participants&#x2019; level of confidence in decision making in situations similar to their own experience and level of confidence for those who have managed water during drought conditions. Darker colours represent higher numbers of participant responses for this category.</p>
</caption>
<graphic xlink:href="fenvs-11-1074896-g004.tif"/>
</fig>
<p>Using drought as a previous experience aligns with the expectation that past droughts may provide a reasonable analogue for more permanent climate shifts in the region under investigation. These results show participants who had previously managed water during a drought were more confident in decision making than participants who had not managed during a drought (<xref ref-type="fig" rid="F4">Figure 4</xref>). In fact four participants who had managed water during a drought indicated that scenario one was almost identical to an experience of their own management situations. This may also link to their level of confidence in similar situations as per the drought scenario one of the online survey, but the separation of managing water in a drought <italic>versus</italic> the total previous experience of these managers was not asked and hence cannot be concluded.</p>
</sec>
<sec id="s3-3">
<title>3.3 Hypothesis 2&#x2014;Environmental water managers are unwilling to make ecological trade off decisions when there is insufficient information</title>
<p>Environmental water managers were found to be willing to make trade off decisions despite incomplete information (contrary to our hypothesis). Sixteen respondents (64%) chose to deliver a partial fresh with no certainty of the benefits this would provide to either species, while eight (32%) made the choice to only deliver water when availability was such that a full fresh (as per recommendations) could be delivered.</p>
<p>Further, the same proportion of respondents decided to favour a higher value species despite the lower certainty of information. When asked how they would use water to support either one of two species or to try and balance water for both species, the shorter lived species with high social and ecological value and moderate, yet uncertain, vulnerability to drought was favoured over the longer lived species that was highly vulnerable and moderately valued. Seven respondents (&#x223c;30%) chose to use water in a balanced way (i.e., alternating target species in alternate years) to aim for survival of both species showing a lack of willingness to &#x2018;give up&#x2019; on a species and citing the lack of information as reason for their decision. The most critical pieces of information for all participants were species life span and water availability. When asked how long they would continue pursuing both these objectives given the information provided, the majority of participants said they would aim to reduce the uncertainty by gathering more information before &#x2018;giving up on one species&#x2019; (<xref ref-type="table" rid="T2">Table 2</xref>).</p>
<table-wrap id="T2" position="float">
<label>TABLE 2</label>
<caption>
<p>Participant responses to uncertainty for future water use.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="left">Action</th>
<th align="left">Count</th>
<th align="left">Response to uncertainty</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">I would not stop delivering freshes for either species and lobby the government for increased environmental water entitlements</td>
<td align="center">4</td>
<td align="left">acknowledge</td>
</tr>
<tr>
<td align="left">I would not stop delivering freshes for either species, however I would revise the relevant flows study</td>
<td align="center">2</td>
<td align="left">reduce</td>
</tr>
<tr>
<td align="left">I would continue for 1&#x2013;2&#xa0;years while I seek expert opinion on issues such as climate change vulnerability and ecological function and then make a decision</td>
<td align="center">17</td>
<td align="left">reduce</td>
</tr>
<tr>
<td align="left">I would continue for 1&#x2013;2&#xa0;years while I conduct a community survey to determine the community value of both species and then make a decision</td>
<td align="center">1</td>
<td align="left">acknowledge</td>
</tr>
<tr>
<td align="left">Other (e.g., investigate complementary measures, prioritise and deliver for fish only)</td>
<td align="center">2</td>
<td align="left">suppress and acknowledge</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>These results show that approximately two thirds of participants are willing to make ecological trade off decisions when there is a lack of information and a level of uncertainty. However, 21 of the 25 participants agreed they found it difficult to make a decision for the following reasons: uncertainty of water availability now and in future years (including baseflows), uncertain benefits of a partial fresh for these specific species and the overall ecosystem, lack of detail on location and connection of other populations and refuges (e.g., how long will they retain water), and a lack of experience in making similar decisions. Results from the open ended question also show some participants were looking for information from contemporary monitoring data indicating the importance of up to date monitoring to some environmental water managers&#x2019; decision making processes.</p>
</sec>
<sec id="s3-4">
<title>3.4 Hypothesis 3&#x2014;Environmental water managers will be confident in making trade off decisions when provided climate change information deemed important</title>
<p>In general terms, the participants acknowledged and supported the need to prioritise sites, make trade offs and allow some sites to transition to a different structure, along with incorporating adaptation actions into environmental watering programs (<xref ref-type="fig" rid="F5">Figure 5</xref>). There is also a large proportion of participants who are wanting to do this and not willing to wait for policy guidance, and as shown above believe the procurement of information will assist in this decision making.</p>
<fig id="F5" position="float">
<label>FIGURE 5</label>
<caption>
<p>Participant agreement with suggested climate change management actions and adaptations. Participants used a Likert scale to select their level of agreement with each action. Darker colours represent higher numbers of responses for this action. All 25 participants provided their level of agreement to each management action.</p>
</caption>
<graphic xlink:href="fenvs-11-1074896-g005.tif"/>
</fig>
<p>However, the results also show that despite being willing to make adaptation decisions, participants are still challenged with how to go about making these decisions without complete information. Despite being provided the information previously deemed important for decision making (see <xref ref-type="bibr" rid="B41">Judd et al., 2023</xref>), a large portion of participants (10 or 40%) thought the information provided in the scenarios was not detailed enough. Another eleven agreed the information was useful with only three participants suggesting there was an overwhelming amount of information. Of the information provided, the most important or trigger pieces of information were species life span and sensitivity to temperature, species social value, the potential benefit this watering event may have on other components of the ecosystem (i.e., flow on effects to other species), frequency of drought and availability of refuges. Contrary to our hypothesis, provision of this information was not enough for managers to confidently change the management objective provided in this scenario. Nineteen of the 25 participants decided to continue to pursue the existing objective.</p>
<p>
<xref ref-type="bibr" rid="B15">Clifford et al. (2020)</xref> found managers were opposed to ecosystem transformation due to a lack of confidence in climate projections, while <xref ref-type="bibr" rid="B5">Azhoni et al. (2018)</xref> concluded a lack of confidence in climate information was as a barrier to adaptation. This also occurred in our study were some participants suggested they did not trust the provided climate change and vulnerability assessment information strongly enough to allow this to influence their decisions. As two participants said:</p>
<disp-quote>
<p>&#x201c;<italic>Some thresholds and tolerance results from lab work are exceeded in natural systems and whilst they do cause impacts - they are not necessarily curtains</italic>&#x201d;</p>
</disp-quote>
<disp-quote>
<p>&#x201c;<italic>Whilst the evidence shows the species cannot survive above 1.8&#xb0;C annual average increase, I would view this with scepticism as similar research fails to take into account the potential for rare, but important genetic traits to influence selection</italic>.&#x201d;</p>
</disp-quote>
<p>Nineteen (19) of the 25 respondents said they would continue pursuing a watering objective even when climate data showed significant vulnerability and unlikely survival. They sought more information in deciding whether to cease pursuing this objective as captured by this response:</p>
<disp-quote>
<p>&#x201c;Due to the uncertainty of the future, doing whatever is possible today to ensure survival of (the) species &#x27;buys&#x27; time and provides motivation to look for ways to protect these species in the long term using alternative options&#x201d;</p>
</disp-quote>
</sec>
</sec>
<sec sec-type="discussion" id="s4">
<title>4 Discussion</title>
<p>The results of the survey support one of the three hypotheses tested. Results show environmental water staff are not very confident in decision making when there is a lack of information with only one participant having greater than 80% confidence. These results show past experiences increase managers confidence in making ecological trade off decisions (hypothesis one). In decision making, past experiences are usually combined with a person&#x2019;s scientific knowledge but can also be subject to strong biases (<xref ref-type="bibr" rid="B16">Cook et al., 2010</xref>; <xref ref-type="bibr" rid="B35">H&#xf6;llermann and Evers, 2017</xref>; <xref ref-type="bibr" rid="B4">Ausden and Walsh, 2020</xref>; <xref ref-type="bibr" rid="B15">Clifford et al., 2020</xref>). Further, the non stationarity of climate and weather experienced under climate change makes the past a poor reference point for the future, and one where past actions may not have the same outcome. As <xref ref-type="bibr" rid="B33">Helmrich and Chester (2020)</xref> emphasise, although a system has been shown to be resilient in the past, does not ensure its resilience in the future.</p>
<p>Using the past to inform future decisions can provide benefit if past decisions were the &#x2018;best&#x2019; possible decisions. However, without clear monitoring each time a decision and action are taken, this will not be known. Adaptive management is one method to acknowledge this uncertainty and improve knowledge through testing hypotheses, implementing and monitoring actions, and adjusting future decisions and actions based on the results. Adaptive management is well acknowledged and included in environmental water management (<xref ref-type="bibr" rid="B83">Tonkin et al., 2020</xref>; <xref ref-type="bibr" rid="B87">Watts et al., 2020</xref>; <xref ref-type="bibr" rid="B37">Horne et al., 2022</xref>), but there can be lagged ecological feedbacks, and thresholds or tipping points may pass before managers are even aware. Other reasons also prohibit widespread adoption of adaptive management such as institutional risk aversion of looking like a &#x2018;failure&#x2019; and insufficient resourcing, amongst others (<xref ref-type="bibr" rid="B2">Allan et al., 2008</xref>; <xref ref-type="bibr" rid="B79">Stults and Larsen, 2020</xref>).</p>
<p>Results from this research do not support hypothesis two which suggests managers would be unwilling to make a decision with insufficient information. In fact the results show environmental water managers are willing to adapt and make trade off decisions with a lack of information, but they find it difficult and would like an extensive list of additional information. The need to reduce uncertainty is a common response by people and organisations and can lead to the believe that improvement in information will be a solution to their decision problem. However, the improvement in information or science may not always be accessible, in a format reachable to practitioners or available in a timely manner. According to <xref ref-type="bibr" rid="B69">Ryder et al. (2010)</xref> providing knowledge from research for decision making is difficult due to misalignment of academic and manager&#x2019;s requirements, including different questions from practitioners and researchers, research timeframes are too slow for practitioners and different personal or organisational goals (<xref ref-type="bibr" rid="B69">Ryder et al., 2010</xref>). There can also be difficulty for practitioners to access research information along with different views on legitimacy of information, while recommendations provided by researchers can be perceived as irrelevant or impractical in practice (<xref ref-type="bibr" rid="B17">Cook et al., 2013</xref>; <xref ref-type="bibr" rid="B22">Dilling et al., 2015</xref>).</p>
<p>These results show even when provided with climate change information, water managers were reluctant to change objectives, rebutting hypothesis three. Under climate change, improvement in currently available science is simply not sufficient. Knowledge of future greenhouse gas emissions, and the direction, timing and severity of changes is unavailable. How this will change soil moisture capacity and rainfall runoff relationships is largely unknown. Human behavioural change and the complexity of ecosystem responses to these changes is also unknown (<xref ref-type="bibr" rid="B79">Stults and Larsen, 2020</xref>). Consequently, consideration of time and money invested in searching for more information needs to be weighed against the benefits extra information will provide. It is pointless to delay a decision if the new knowledge is not available and/or will not improve a decision outcome. This also makes it vitally important to ensure any additional research and/or monitoring is addressing well thought out endpoints to capture information important for long term decision making and the uncertainty of hydro-climatic change and consequent ecological responses.</p>
<p>To assist decision making the use of adaptation decision frameworks such as the expanded &#x201c;resistance-resilience-transformation&#x201d; or &#x201c;resist-accept-direct&#x201d; as per <xref ref-type="bibr" rid="B77">St-Laurent et al. (2021)</xref> and <xref ref-type="bibr" rid="B81">Thompson et al. (2021)</xref> respectively can be useful for environmental water managers. These frameworks aim to assist decision making under climate change by offering options for management actions; namely resisting change, accepting and adapting to change or transforming systems to a new state. These decision frameworks are useful to inform which adaptation path to follow but fail to acknowledge uncertainty. Several methods that do acknowledge uncertainty are already available and should be adopted by environmental water managers. Firstly, scenario planning provides managers with multiple possible future scenarios to consider. For example, the scenarios prepared for this research could be modified based on the results of this study and presented at a workshop of environmental water managers and other stakeholders. The scenarios can highlight parameters and inclusion of information deemed of high importance to managers in their decision making process (<xref ref-type="bibr" rid="B44">Kong et al., 2021</xref>). Each scenario can be as complex or simple as required and incorporate non flow and social or economic related constraints. Scenarios should be supported by real data and include the main concerns and uncertainties, significant driving factors and the plausible changes in those factors (<xref ref-type="bibr" rid="B89">Wodak and Neale, 2015</xref>; <xref ref-type="bibr" rid="B72">Shepherd et al., 2018</xref>; <xref ref-type="bibr" rid="B28">Gray et al., 2020</xref>). Numerous scenarios can be presented in a workshop yet there is no assumption on the likelihood of any particular scenario occurring. The workshops do not require specialist technical skills (other than a facilitator) thereby keeping costs low, with scenarios &#x2018;tested&#x2019; prior to a workshop to ensure their feasibility and realism. Scenario planning workshops can include a large number of stakeholders and allow managers to think about events outside their own experience, and consider what type of policy/strategic decisions are required under a range of possible futures (<xref ref-type="bibr" rid="B89">Wodak and Neale, 2015</xref>; <xref ref-type="bibr" rid="B72">Shepherd et al., 2018</xref>). Fact sheets can be sent out prior to the workshop to ensure all participants have the same base level of information (<xref ref-type="bibr" rid="B71">Serrao-Neumann et al., 2019</xref>). Scenario planning workshops can challenge managers assumptions and improve knowledge of complex and dynamic issues.</p>
<p>Secondly, another option is to adopt robust and adaptive methods that have been developed specifically to deal with deep uncertainty. These are innovative methods for environmental water managers and can assist by providing information on long term policy and strategic direction to inform issues such as setting achievable ecological objectives. All such methods principally test system vulnerabilities across multiple scenarios to determine where the objective, or policy, fails. By testing objectives through a wide range of future conditions and &#x2018;stress testing&#x2019; a system until the point of failure, the method delivers robust decisions rather than optimising for one ideal solution (i.e., robust being where performance is insensitive to which future may occur (<xref ref-type="bibr" rid="B53">Maier et al., 2016</xref>)). These methods aim to achieve a &#x2018;satisfactory&#x2019; outcome under multiple scenarios rather than optimise one preferred option. Other methods aim to ensure performance is flexible enough depending on what future outcome may occur allowing for changes of approach if things &#x2018;fail&#x2019; (<xref ref-type="bibr" rid="B53">Maier et al., 2016</xref>; <xref ref-type="bibr" rid="B48">Lawrence et al., 2018</xref>). Examples of these methods include; Robust Decision Making and Multi Objective Robust Decision Making (<xref ref-type="bibr" rid="B50">Lempert et al., 2003</xref>; <xref ref-type="bibr" rid="B49">Lempert and Groves, 2010</xref>; <xref ref-type="bibr" rid="B34">Herman et al., 2014</xref>), Info-Gap analysis (<xref ref-type="bibr" rid="B7">Ben-Haim, 2006</xref>), Adaptation Pathways and Dynamic Adaptation Policy Pathways (<xref ref-type="bibr" rid="B29">Haasnoot et al., 2013</xref>). There are pros and cons in all these methods and reviews have been provided by <xref ref-type="bibr" rid="B54">Matrosov et al. (2013)</xref>, <xref ref-type="bibr" rid="B46">Kwakkel et al. (2016)</xref>, <xref ref-type="bibr" rid="B8">Bosomworth et al. (2017)</xref> and <xref ref-type="bibr" rid="B6">Bartholomew and Kwakkel (2020)</xref>. One consideration when using, or adapting, these methods to environmental flow management is the requirement of potentially new data (e.g., vulnerability assessments), but the results of this study have shown managers are willing to make decisions in the absence of information/data. Therefore, perhaps the need for additional information is not as important as providing managers with tools and experiences to increase their confidence and ability to make decisions under uncertainty.</p>
<p>We will briefly review Robust Decision Making (RDM) as we consider this a suitable initial method to test vulnerabilities of existing environmental water ecological objectives and policies and can support subsequent implementation of other methods. The results from this study support the trialling of such methods as environmental water managers have shown they are able to make decisions under uncertainty and willing to test new methods of decision making. This method could be used to support long term decision making and objective setting as proposed in scenario two of this study. RDM allows analysts to propose an objective and stress test, or evaluate its vulnerabilities, across a range of plausible futures (<xref ref-type="bibr" rid="B66">Radke et al., 2017</xref>). For environmental water plausible futures may include those such as climate change scenarios (e.g., RCPs), response of species or communities including distribution models and vulnerability assessments, changes in water availability, trade and water quality, occurrence of disturbance events (e.g., drought, hypoxic blackwater) and change in land use. RDM allows managers to determine under what conditions the existing objectives or strategy performs well or fails, and what conditions affect performance. This would be ideal for testing vulnerabilities of existing environmental water goals under a range of possible futures. Alternative combinations of problems and uncertainties allow iterative assessments of scenarios to achieve satisfactory performance over a range of futures. Scenario two provided in this research could be tested in a RDM model to determine if and/or when to cease delivering environmental water to support the species identified by the objective, or in scenario one by running the options through numerous scenarios available in RDM which would indicate when different volumes of water can support both species, or when one will not survive under different water availability scenarios. Using RDM results of the scenarios will provide trade off curves that compare alternate strategies for achieving the goals identified by participants in this research and assist in making informed trade off decisions so environmental water managers can achieve the best bang for their environmental water buck. RDM outputs can also show where system &#x2018;tipping points&#x2019; or vulnerabilities are, which can then be used in other methods such as Adaptation Pathways. While there are a number of academic examples of applying the RDM method to water resource management (<xref ref-type="bibr" rid="B54">Matrosov et al., 2013</xref>; <xref ref-type="bibr" rid="B76">Singh et al., 2015</xref>), RDM is currently not widely used or accepted in testing/setting objectives or policy (<xref ref-type="bibr" rid="B39">Jensen and Wu, 2016</xref>). This may be due to the following downsides of RDM; the model is data intensive, requires large computing capacity, and often needs specialist skills to run, analyse and interpret the results all of which make it expensive to execute (<xref ref-type="bibr" rid="B39">Jensen and Wu, 2016</xref>; <xref ref-type="bibr" rid="B73">Shi et al., 2019</xref>). Despite these challenges testing this method with environmental water use under climate change uncertainty would allow managers to consider future plausible hydrological and ecological changes and assist them in becoming more confident in their future decision making.</p>
<p>This research specifically focused on participants&#x2019; decisions regarding ecological trade offs, and deliberately omitted other factors in environmental water decision making (e.g., recreational use, socio-economic or political influences). The study acknowledges managers&#x2019; decisions may be different for reasons other than those investigated here and people make decisions based on a combination of their personal values and judgement, experience, organisational values, risk perception, political influence, availability of resourcing, and chances of success (<xref ref-type="bibr" rid="B21">Dietz, 2013</xref>; <xref ref-type="bibr" rid="B57">Mukherjee et al., 2018</xref>; <xref ref-type="bibr" rid="B56">Moallemi et al., 2020</xref>). Hence incorporation of climate change adaptations and the ultimate decision to implement adaptations will be affected by all these factors, along with geographic, legacy, economic and political differences, resulting in potentially different choices from managers in similar situations (<xref ref-type="bibr" rid="B59">O&#x2019;Brien, 2009</xref>; <xref ref-type="bibr" rid="B52">Maani, 2013</xref>; <xref ref-type="bibr" rid="B30">Hagerman and Satterfield, 2014</xref>; <xref ref-type="bibr" rid="B14">Clifford et al., 2022</xref>).</p>
<p>It is also acknowledged that the methodology and data collected in this research have limitations. The data was gained from a small, purposive sample and cannot be generalised to the entire population of environmental water managers (<xref ref-type="bibr" rid="B86">Walter, 2019</xref>). Participation was voluntary so it is likely that participants are environmental water staff interested in climate change, and therefore likely to skew results to higher climate change interest than the whole population representing a level of sampling bias (<xref ref-type="bibr" rid="B10">Bryman, 2016</xref>). An additional limitation is the lack of opportunity for participants to request clarifications or explanations, especially when using scenarios, in online surveys (<xref ref-type="bibr" rid="B85">Walliman, 2015</xref>). Despite these limitations, this exploratory study acknowledges existing limitations of addressing uncertainty and provides research into new ways of embracing uncertainty in aquatic ecosystem management.</p>
</sec>
<sec sec-type="conclusion" id="s5">
<title>5 Conclusion</title>
<p>This research has shown that environmental water managers display all three responses to uncertainty (suppression, reduction and acknowledgement) with a large focus on reduction. The results highlight managers&#x2019; hesitancy in making decisions without full information. As climate change becomes embedded into legislative and strategic requirements of businesses and governments, the ability to incorporate adaptations despite these uncertainties becomes fundamental. However, environmental water managers will ultimately need to have conversations about if, or when, they cease managing waterways for certain species or communities, with or without what is deemed sufficient information. To ignore the need for such radical shifts will mean, in some cases, management becomes focused on unachievable ecological goals (<xref ref-type="bibr" rid="B11">Campbell et al., 2021</xref>; <xref ref-type="bibr" rid="B42">Judd et al., 2022</xref>). As well as failing to achieve those goals, such actions would be a poor use of a shared resource, would likely lead to loss of community support for environmental water, and may be maladaptative by reducing the likelihood of achieving other goals (environmental or otherwise). With the range of methods available to support decision making under deep uncertainty, environmental water managers have options to support decisions that can incorporate uncertainty and assist in water planning options and management decisions.</p>
<p>The results of this paper demonstrate that significant effort is still required to adopt decision making frameworks in environmental water management that are robust and well suited to handling the high levels of uncertainty associated with the future. Trialling methods for decision making under deep uncertainty will empower managers to acknowledge uncertainty, increase confidence, inform decision making and support conversations on future ecological objectives. Prior to widespread adoption (if deemed appropriate), less intensive options should be adopted immediately; such as scenario planning, climate change vulnerability assessments, use of adaptation decision frameworks and inclusion of reversible or low regret decisions. We acknowledge that all decision making is contextual, so we encourage managers to determine which method, or ideally range of methods, is best suited for their decision situation and employ the appropriate steps to get started.</p>
</sec>
</body>
<back>
<sec sec-type="data-availability" id="s6">
<title>Data availability statement</title>
<p>The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.</p>
</sec>
<sec id="s7">
<title>Ethics statement</title>
<p>The studies involving human participants were reviewed and approved by La Trobe University Human Ethics Committee. The patients/participants provided their written informed consent to participate in this study.</p>
</sec>
<sec id="s8">
<title>Author contributions</title>
<p>MJ developed methods and performed data collection and analysis and prepared the manuscript. AH and NB reviewed methods and contributed to manuscript revision.</p>
</sec>
<sec id="s9">
<title>Funding</title>
<p>MJ was funded through an industry PhD position with funding from the Department of Environment, Land, Water and Planning, Victoria, Australia and Goulburn Broken Catchment Management Authority. AH was funded through an ARC DECRA award (DE180100550).</p>
</sec>
<ack>
<p>The authors would like the thank the water managers who completed the questionnaire that forms the basis of this research, along with one reviewer who provided comment on an earlier draft of this manuscript.</p>
</ack>
<sec sec-type="COI-statement" id="s10">
<title>Conflict of interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s11">
<title>Publisher&#x2019;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<sec id="s12">
<title>Supplementary material</title>
<p>The Supplementary Material for this article can be found online at: <ext-link ext-link-type="uri" xlink:href="https://www.frontiersin.org/articles/10.3389/fenvs.2023.1074896/full#supplementary-material">https://www.frontiersin.org/articles/10.3389/fenvs.2023.1074896/full&#x23;supplementary-material</ext-link>
</p>
<supplementary-material xlink:href="DataSheet1.docx" id="SM1" mimetype="application/docx" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</sec>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Abunnasr</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Hamin</surname>
<given-names>E. M.</given-names>
</name>
<name>
<surname>Brabec</surname>
<given-names>E.</given-names>
</name>
</person-group> (<year>2015</year>). <article-title>Windows of opportunity: Addressing climate uncertainty through adaptation plan implementation</article-title>. <source>J. Environ. Plan. Manag.</source> <volume>58</volume> (<issue>1</issue>), <fpage>135</fpage>&#x2013;<lpage>155</lpage>. <pub-id pub-id-type="doi">10.1080/09640568.2013.849233</pub-id>
</citation>
</ref>
<ref id="B2">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Allan</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Curtis</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Stankey</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Shindler</surname>
<given-names>B.</given-names>
</name>
</person-group> (<year>2008</year>). <article-title>Adaptive management and watersheds: A social science Perspective1</article-title>. <source>JAWRA J. Am. Water Resour. Assoc.</source> <volume>44</volume>, <fpage>166</fpage>&#x2013;<lpage>174</lpage>. <pub-id pub-id-type="doi">10.1111/j.1752-1688.2007.00145.x</pub-id>
</citation>
</ref>
<ref id="B3">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Arthington</surname>
<given-names>A. H.</given-names>
</name>
<name>
<surname>Bhaduri</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Bunn</surname>
<given-names>S. E.</given-names>
</name>
<name>
<surname>Jackson</surname>
<given-names>S. E.</given-names>
</name>
<name>
<surname>Tharme</surname>
<given-names>R. E.</given-names>
</name>
<name>
<surname>Tickner</surname>
<given-names>D.</given-names>
</name>
<etal/>
</person-group> (<year>2018</year>). <article-title>The Brisbane declaration and global action agenda on environmental flows (2018)</article-title>. <source>Front. Environ. Sci.</source> <volume>6</volume>, <fpage>45</fpage>. <pub-id pub-id-type="doi">10.3389/fenvs.2018.00045</pub-id>
</citation>
</ref>
<ref id="B4">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Ausden</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Walsh</surname>
<given-names>J. C.</given-names>
</name>
</person-group> (<year>2020</year>). &#x201c;<article-title>The use of evidence in decision-making by practitioners</article-title>,&#x201d; in <source>Conservation research, policy and practice</source>. Editors <person-group person-group-type="editor">
<name>
<surname>SUTHERLAND</surname>
<given-names>W. J.</given-names>
</name>
<name>
<surname>BROTHERTON</surname>
<given-names>P. N. M.</given-names>
</name>
<name>
<surname>DAVIES</surname>
<given-names>Z. G.</given-names>
</name>
<name>
<surname>OCKENDON</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>PETTORELLI</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>VICKERY</surname>
<given-names>J. A.</given-names>
</name>
</person-group> (<publisher-name>Cambridge University Press</publisher-name>).</citation>
</ref>
<ref id="B5">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Azhoni</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Jude</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Holman</surname>
<given-names>I.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Adapting to climate change by water management organisations: Enablers and barriers</article-title>. <source>J. Hydrology</source> <volume>559</volume>, <fpage>736</fpage>&#x2013;<lpage>748</lpage>. <pub-id pub-id-type="doi">10.1016/j.jhydrol.2018.02.047</pub-id>
</citation>
</ref>
<ref id="B6">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Bartholomew</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Kwakkel</surname>
<given-names>J. H.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>On considering robustness in the search phase of robust decision making: A comparison of many-objective robust decision making, multi-scenario many-objective robust decision making, and many objective robust optimization</article-title>. <source>Environ. Model. Softw.</source> <volume>127</volume>, <fpage>104699</fpage>. <pub-id pub-id-type="doi">10.1016/j.envsoft.2020.104699</pub-id>
</citation>
</ref>
<ref id="B7">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Ben-Haim</surname>
<given-names>Y.</given-names>
</name>
</person-group> (<year>2006</year>). <source>Info-gap decision theory: Decisions under severe uncertainty</source>. <publisher-name>Elsevier</publisher-name>.</citation>
</ref>
<ref id="B8">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Bosomworth</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Leith</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Harwood</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Wallis</surname>
<given-names>P. J.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>What&#x2019;s the problem in adaptation pathways planning? The potential of a diagnostic problem-structuring approach</article-title>. <source>Environ. Sci. Policy</source> <volume>76</volume>, <fpage>23</fpage>&#x2013;<lpage>28</lpage>. <pub-id pub-id-type="doi">10.1016/j.envsci.2017.06.007</pub-id>
</citation>
</ref>
<ref id="B9">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Brugnach</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Dewulf</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Pahl-Wostl</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Taillieu</surname>
<given-names>T.</given-names>
</name>
</person-group> (<year>2008</year>). <article-title>Toward a relational concept of uncertainty: About knowing too little, knowing too differently, and accepting not to know</article-title>. <source>Ecol. Soc.</source> <volume>13</volume>, <fpage>art30</fpage>. <pub-id pub-id-type="doi">10.5751/es-02616-130230</pub-id>
</citation>
</ref>
<ref id="B10">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Bryman</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2016</year>). <source>Social research methods</source>. <publisher-name>Oxford University Press</publisher-name>.</citation>
</ref>
<ref id="B11">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Campbell</surname>
<given-names>C. J.</given-names>
</name>
<name>
<surname>James</surname>
<given-names>C. S.</given-names>
</name>
<name>
<surname>Morris</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Nicol</surname>
<given-names>J. M.</given-names>
</name>
<name>
<surname>Thomas</surname>
<given-names>R. F.</given-names>
</name>
<name>
<surname>Nielsen</surname>
<given-names>D. L.</given-names>
</name>
<etal/>
</person-group> (<year>2021</year>). <article-title>Blue, green and in-between: Objectives and approaches for evaluating wetland flow regimes based on vegetation outcomes</article-title>. <source>Mar. Freshw. Res.</source> <volume>73</volume>, <fpage>1212</fpage>&#x2013;<lpage>1224</lpage>. <pub-id pub-id-type="doi">10.1071/mf20338</pub-id>
</citation>
</ref>
<ref id="B12">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Capon</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Leigh</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Hadwen</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>George</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Mcmahon</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Linke</surname>
<given-names>S.</given-names>
</name>
<etal/>
</person-group> (<year>2018</year>). <article-title>Transforming environmental water management to adapt to a changing climate</article-title>. <source>Front. Environ. Sci.</source> <volume>6</volume>, <fpage>80</fpage>. <pub-id pub-id-type="doi">10.3389/fenvs.2018.00080</pub-id>
</citation>
</ref>
<ref id="B13">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Citroen</surname>
<given-names>C. L.</given-names>
</name>
</person-group> (<year>2011</year>). <article-title>The role of information in strategic decision-making</article-title>. <source>Int. J. Inf. Manag.</source> <volume>31</volume>, <fpage>493</fpage>&#x2013;<lpage>501</lpage>. <pub-id pub-id-type="doi">10.1016/j.ijinfomgt.2011.02.005</pub-id>
</citation>
</ref>
<ref id="B14">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Clifford</surname>
<given-names>K. R.</given-names>
</name>
<name>
<surname>Cravens</surname>
<given-names>A. E.</given-names>
</name>
<name>
<surname>Knapp</surname>
<given-names>C. N.</given-names>
</name>
</person-group> (<year>2022</year>). <article-title>Responding to ecological transformation: Mental models, external constraints, and manager decision-making</article-title>. <source>BioScience</source> <volume>72</volume>, <fpage>57</fpage>&#x2013;<lpage>70</lpage>. <pub-id pub-id-type="doi">10.1093/biosci/biab086</pub-id>
</citation>
</ref>
<ref id="B15">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Clifford</surname>
<given-names>K. R.</given-names>
</name>
<name>
<surname>Yung</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Travis</surname>
<given-names>W. R.</given-names>
</name>
<name>
<surname>Rondeau</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Neely</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Rangwala</surname>
<given-names>I.</given-names>
</name>
<etal/>
</person-group> (<year>2020</year>). <article-title>Navigating climate adaptation on public lands: How views on ecosystem change and scale interact with management approaches</article-title>. <source>Environ. Manag.</source> <volume>66</volume>, <fpage>614</fpage>&#x2013;<lpage>628</lpage>. <pub-id pub-id-type="doi">10.1007/s00267-020-01336-y</pub-id>
</citation>
</ref>
<ref id="B16">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Cook</surname>
<given-names>C. N.</given-names>
</name>
<name>
<surname>Hockings</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Carter</surname>
<given-names>R.</given-names>
</name>
</person-group> (<year>2010</year>). <article-title>Conservation in the dark? The information used to support management decisions</article-title>. <source>Front. Ecol. Environ.</source> <volume>8</volume>, <fpage>181</fpage>&#x2013;<lpage>186</lpage>. <pub-id pub-id-type="doi">10.1890/090020</pub-id>
</citation>
</ref>
<ref id="B17">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Cook</surname>
<given-names>C. N.</given-names>
</name>
<name>
<surname>Mascia</surname>
<given-names>M. B.</given-names>
</name>
<name>
<surname>Schwartz</surname>
<given-names>M. W.</given-names>
</name>
<name>
<surname>Possingham</surname>
<given-names>H. P.</given-names>
</name>
<name>
<surname>Fuller</surname>
<given-names>R. A.</given-names>
</name>
</person-group> (<year>2013</year>). <article-title>Achieving conservation science that bridges the knowledge&#x2013;action boundary</article-title>. <source>Conserv. Biol.</source> <volume>27</volume>, <fpage>669</fpage>&#x2013;<lpage>678</lpage>. <pub-id pub-id-type="doi">10.1111/cobi.12050</pub-id>
</citation>
</ref>
<ref id="B18">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Courtney</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Kirkland</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Viguerie</surname>
<given-names>P.</given-names>
</name>
</person-group> (<year>1997</year>). <article-title>Strategy under uncertainty</article-title>. <source>Harv. Bus. Rev.</source> <volume>75</volume>, <fpage>67</fpage>&#x2013;<lpage>79</lpage>.</citation>
</ref>
<ref id="B19">
<citation citation-type="book">
<collab>DEPI</collab> (<year>2013</year>). <source>Flows - a method for determining environmental water requirements in Victoria</source>. <publisher-loc>Melbourne, Australia</publisher-loc>: <publisher-name>Department of Environment and Primary Industries</publisher-name>.</citation>
</ref>
<ref id="B20">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Dewulf</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Biesbroek</surname>
<given-names>R.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Nine lives of uncertainty in decision-making: Strategies for dealing with uncertainty in environmental governance</article-title>. <source>Policy Soc.</source> <volume>37</volume>, <fpage>441</fpage>&#x2013;<lpage>458</lpage>. <pub-id pub-id-type="doi">10.1080/14494035.2018.1504484</pub-id>
</citation>
</ref>
<ref id="B21">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Dietz</surname>
<given-names>T.</given-names>
</name>
</person-group> (<year>2013</year>). <article-title>Bringing values and deliberation to science communication</article-title>. <source>Proc. Natl. Acad. Sci.</source> <volume>110</volume>, <fpage>14081</fpage>&#x2013;<lpage>14087</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.1212740110</pub-id>
</citation>
</ref>
<ref id="B22">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Dilling</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Lackstrom</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Haywood</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Dow</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Lemos</surname>
<given-names>M. C.</given-names>
</name>
<name>
<surname>Berggren</surname>
<given-names>J.</given-names>
</name>
<etal/>
</person-group> (<year>2015</year>). <article-title>What stakeholder needs tell us about enabling adaptive capacity: The intersection of context and information provision across regions in the United States</article-title>. <source>Weather, Clim. Soc.</source> <volume>7</volume>, <fpage>5</fpage>&#x2013;<lpage>17</lpage>. <pub-id pub-id-type="doi">10.1175/wcas-d-14-00001.1</pub-id>
</citation>
</ref>
<ref id="B23">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Doerner</surname>
<given-names>D.</given-names>
</name>
</person-group> (<year>1990</year>). <article-title>The logic of failure</article-title>. <source>Philosophical Trans. R. Soc. Lond. B, Biol. Sci.</source> <volume>327</volume>, <fpage>463</fpage>&#x2013;<lpage>473</lpage>.</citation>
</ref>
<ref id="B24">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Doolan</surname>
<given-names>J. M.</given-names>
</name>
<name>
<surname>Ashworth</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Swirepik</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2017</year>). &#x201c;<article-title>Chapter 23 - planning for the active management of environmental water</article-title>,&#x201d; in <source>Water for the environment</source>. Editors <person-group person-group-type="editor">
<name>
<surname>HORNE</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>WEBB</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>STEWARDSON</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>RICHTER</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>ACERMAN</surname>
<given-names>M.</given-names>
</name>
</person-group> (<publisher-loc>Melbourne</publisher-loc>: <publisher-name>Elsevier</publisher-name>).</citation>
</ref>
<ref id="B25">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Fletcher</surname>
<given-names>S. M.</given-names>
</name>
<name>
<surname>Miotti</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Swaminathan</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Klemun</surname>
<given-names>M. M.</given-names>
</name>
<name>
<surname>Strzepek</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Siddiqi</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Water supply infrastructure planning: Decision-making framework to classify multiple uncertainties and evaluate flexible design</article-title>. <source>J. Water Resour. Plan. Manag.</source> <volume>143</volume>, <fpage>04017061</fpage>. <pub-id pub-id-type="doi">10.1061/(asce)wr.1943-5452.0000823</pub-id>
</citation>
</ref>
<ref id="B26">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Gideon</surname>
<given-names>L.</given-names>
</name>
</person-group> (<year>2012</year>). <source>Handbook of survey methodology for the social sciences</source>. <publisher-loc>DordrechtNew York; NY</publisher-loc>: <publisher-name>Springer</publisher-name>.</citation>
</ref>
<ref id="B27">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Giehl</surname>
<given-names>E. L.</given-names>
</name>
<name>
<surname>Moretti</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Walsh</surname>
<given-names>J. C.</given-names>
</name>
<name>
<surname>Batalha</surname>
<given-names>M. A.</given-names>
</name>
<name>
<surname>Cook</surname>
<given-names>C. N.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Scientific evidence and potential barriers in the management of Brazilian protected areas</article-title>. <source>PloS One</source> <volume>12</volume>, <fpage>e0169917</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0169917</pub-id>
</citation>
</ref>
<ref id="B28">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Gray</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>O&#x2019;Mahony</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Hills</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>O&#x2019;Dwyer</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Devoy</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Gault</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Strengthening coastal adaptation planning through scenario analysis: A beneficial but incomplete solution</article-title>. <source>Mar. Policy</source> <volume>111</volume>, <fpage>102391</fpage>. <pub-id pub-id-type="doi">10.1016/j.marpol.2016.04.031</pub-id>
</citation>
</ref>
<ref id="B29">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Haasnoot</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Kwakkel</surname>
<given-names>J. H.</given-names>
</name>
<name>
<surname>Walker</surname>
<given-names>W. E.</given-names>
</name>
<name>
<surname>Ter Maat</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2013</year>). <article-title>Dynamic adaptive policy pathways: A method for crafting robust decisions for a deeply uncertain world</article-title>. <source>Glob. Environ. Change</source> <volume>23</volume>, <fpage>485</fpage>&#x2013;<lpage>498</lpage>. <pub-id pub-id-type="doi">10.1016/j.gloenvcha.2012.12.006</pub-id>
</citation>
</ref>
<ref id="B30">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Hagerman</surname>
<given-names>S. M.</given-names>
</name>
<name>
<surname>Satterfield</surname>
<given-names>T.</given-names>
</name>
</person-group> (<year>2014</year>). <article-title>Agreed but not preferred: Expert views on taboo options for biodiversity conservation, given climate change</article-title>. <source>Ecol. Appl.</source> <volume>24</volume>, <fpage>548</fpage>&#x2013;<lpage>559</lpage>. <pub-id pub-id-type="doi">10.1890/13-0400.1</pub-id>
</citation>
</ref>
<ref id="B31">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Hallegatte</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Shah</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Lempert</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Brown</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Gill</surname>
<given-names>S.</given-names>
</name>
</person-group> (<year>2012</year>). <article-title>Investment decision making under deep uncertainty-application to climate change</article-title>. <source>Policy research working paper for the World Bank</source>.</citation>
</ref>
<ref id="B32">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Hallegatte</surname>
<given-names>S.</given-names>
</name>
</person-group> (<year>2009</year>). <article-title>Strategies to adapt to an uncertain climate change</article-title>. <source>Glob. Environ. Change</source> <volume>19</volume>, <fpage>240</fpage>&#x2013;<lpage>247</lpage>. <pub-id pub-id-type="doi">10.1016/j.gloenvcha.2008.12.003</pub-id>
</citation>
</ref>
<ref id="B33">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Helmrich</surname>
<given-names>A. M.</given-names>
</name>
<name>
<surname>Chester</surname>
<given-names>M. V.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Reconciling complexity and deep uncertainty in infrastructure design for climate adaptation</article-title>. <source>Sustain. Resilient Infrastructure</source>, <fpage>1</fpage>&#x2013;<lpage>17</lpage>.</citation>
</ref>
<ref id="B34">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Herman</surname>
<given-names>J. D.</given-names>
</name>
<name>
<surname>Zeff</surname>
<given-names>H. B.</given-names>
</name>
<name>
<surname>Reed</surname>
<given-names>P. M.</given-names>
</name>
<name>
<surname>Characklis</surname>
<given-names>G. W.</given-names>
</name>
</person-group> (<year>2014</year>). <article-title>Beyond optimality: Multistakeholder robustness tradeoffs for regional water portfolio planning under deep uncertainty</article-title>. <source>Water Resour. Res.</source> <volume>50</volume>, <fpage>7692</fpage>&#x2013;<lpage>7713</lpage>. <pub-id pub-id-type="doi">10.1002/2014wr015338</pub-id>
</citation>
</ref>
<ref id="B35">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>H&#xf6;llermann</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Evers</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Perception and handling of uncertainties in water management&#x2014;a study of practitioners&#x2019; and scientists&#x2019; perspectives on uncertainty in their daily decision-making</article-title>. <source>Environ. Sci. Policy</source> <volume>71</volume>, <fpage>9</fpage>&#x2013;<lpage>18</lpage>. <pub-id pub-id-type="doi">10.1016/j.envsci.2017.02.003</pub-id>
</citation>
</ref>
<ref id="B36">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Horne</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Szemis</surname>
<given-names>J. M.</given-names>
</name>
<name>
<surname>Kaur</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Webb</surname>
<given-names>J. A.</given-names>
</name>
<name>
<surname>Stewardson</surname>
<given-names>M. J.</given-names>
</name>
<name>
<surname>Costa</surname>
<given-names>A.</given-names>
</name>
<etal/>
</person-group> (<year>2016</year>). <article-title>Optimization tools for environmental water decisions: A review of strengths, weaknesses, and opportunities to improve adoption</article-title>. <source>Environ. Model. Softw.</source> <volume>84</volume>, <fpage>326</fpage>&#x2013;<lpage>338</lpage>. <pub-id pub-id-type="doi">10.1016/j.envsoft.2016.06.028</pub-id>
</citation>
</ref>
<ref id="B37">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Horne</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Webb</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Mussehl</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>John</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Rumpff</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Fowler</surname>
<given-names>K.</given-names>
</name>
<etal/>
</person-group> (<year>2022</year>). <article-title>Not just another assessment method: Reimagining environmental flows assessments in the face of uncertainty</article-title>. <source>Front. Environ. Sci.</source> <volume>10</volume>. <pub-id pub-id-type="doi">10.3389/fenvs.2022.808943</pub-id>
</citation>
</ref>
<ref id="B38">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Horne</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Webb</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Stewardson</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Richter</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Acreman</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2017</year>). <source>Water for the environment: From policy and science to implementation and management</source>. <publisher-name>Academic Press</publisher-name>.</citation>
</ref>
<ref id="B39">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Jensen</surname>
<given-names>O.</given-names>
</name>
<name>
<surname>Wu</surname>
<given-names>X.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>Embracing uncertainty in policy-making: The case of the water sector</article-title>. <source>Policy Soc.</source> <volume>35</volume>, <fpage>115</fpage>&#x2013;<lpage>123</lpage>. <pub-id pub-id-type="doi">10.1016/j.polsoc.2016.07.002</pub-id>
</citation>
</ref>
<ref id="B40">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>John</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Nathan</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Horne</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Stewardson</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Webb</surname>
<given-names>J. A.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>How to incorporate climate change into modelling environmental water outcomes: A review</article-title>. <source>J. Water Clim. Change</source> <volume>11</volume> (<issue>2</issue>), <fpage>327</fpage>&#x2013;<lpage>340</lpage>. <pub-id pub-id-type="doi">10.2166/wcc.2020.263</pub-id>
</citation>
</ref>
<ref id="B41">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Judd</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Boese</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Horne</surname>
<given-names>A. C.</given-names>
</name>
<name>
<surname>Bond</surname>
<given-names>N. R.</given-names>
</name>
</person-group> (<year>2023</year>). <article-title>Perceptions of climate change adaptation barriers in environmental water management</article-title>. <source>Ecology and Society</source> <volume>28</volume> (<issue>1</issue>), <fpage>21</fpage>. <pub-id pub-id-type="doi">10.5751/ES-13883-280121</pub-id>
</citation>
</ref>
<ref id="B42">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Judd</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Bond</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Horne</surname>
<given-names>A. C.</given-names>
</name>
</person-group> (<year>2022</year>). <article-title>The challenge of setting &#x201c;climate ready&#x201d; ecological targets for environmental flow planning</article-title>. <source>Front. Environ. Sci.</source> <volume>10</volume>. <pub-id pub-id-type="doi">10.3389/fenvs.2022.714877</pub-id>
</citation>
</ref>
<ref id="B43">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kiem</surname>
<given-names>A. S.</given-names>
</name>
<name>
<surname>Austin</surname>
<given-names>E. K.</given-names>
</name>
<name>
<surname>Verdon-Kidd</surname>
<given-names>D. C.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>Water resource management in a variable and changing climate: Hypothetical case study to explore decision making under uncertainty</article-title>. <source>J. Water Clim. Change</source> <volume>7</volume> (<issue>2</issue>), <fpage>263</fpage>&#x2013;<lpage>279</lpage>. <pub-id pub-id-type="doi">10.2166/wcc.2015.040</pub-id>
</citation>
</ref>
<ref id="B44">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kong</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Castella</surname>
<given-names>J.-C.</given-names>
</name>
<name>
<surname>Suos</surname>
<given-names>V.</given-names>
</name>
<name>
<surname>Leng</surname>
<given-names>V.</given-names>
</name>
<name>
<surname>Pat</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Diepart</surname>
<given-names>J.-C.</given-names>
</name>
<etal/>
</person-group> (<year>2021</year>). <article-title>Investigating farmers&#x2019; decision-making in adoption of conservation agriculture in the Northwestern uplands of Cambodia</article-title>. <source>Land Use Policy</source> <volume>105</volume>, <fpage>105404</fpage>. <pub-id pub-id-type="doi">10.1016/j.landusepol.2021.105404</pub-id>
</citation>
</ref>
<ref id="B45">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kundzewicz</surname>
<given-names>Z. W.</given-names>
</name>
<name>
<surname>Krysanova</surname>
<given-names>V.</given-names>
</name>
<name>
<surname>Benestad</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Hov</surname>
<given-names>&#xd8;.</given-names>
</name>
<name>
<surname>Piniewski</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Otto</surname>
<given-names>I. M.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Uncertainty in climate change impacts on water resources</article-title>. <source>Environ. Sci. Policy</source> <volume>79</volume>, <fpage>1</fpage>&#x2013;<lpage>8</lpage>. <pub-id pub-id-type="doi">10.1016/j.envsci.2017.10.008</pub-id>
</citation>
</ref>
<ref id="B46">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kwakkel</surname>
<given-names>J. H.</given-names>
</name>
<name>
<surname>Haasnoot</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Walker</surname>
<given-names>W. E.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>Comparing robust decision-making and dynamic adaptive policy pathways for model-based decision support under deep uncertainty</article-title>. <source>Environ. Model. Softw.</source> <volume>86</volume>, <fpage>168</fpage>&#x2013;<lpage>183</lpage>. <pub-id pub-id-type="doi">10.1016/j.envsoft.2016.09.017</pub-id>
</citation>
</ref>
<ref id="B47">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kwakkel</surname>
<given-names>J. H.</given-names>
</name>
<name>
<surname>Walker</surname>
<given-names>W. E.</given-names>
</name>
<name>
<surname>Marchau</surname>
<given-names>V. A.</given-names>
</name>
</person-group> (<year>2010</year>). <article-title>Classifying and communicating uncertainties in model-based policy analysis</article-title>. <source>Int. J. Technol. Policy Manag.</source> <volume>10</volume>, <fpage>299</fpage>&#x2013;<lpage>315</lpage>. <pub-id pub-id-type="doi">10.1504/ijtpm.2010.036918</pub-id>
</citation>
</ref>
<ref id="B48">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Lawrence</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Bell</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Blackett</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Stephens</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Allan</surname>
<given-names>S.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>National guidance for adapting to coastal hazards and sea-level rise: Anticipating change, when and how to change pathway</article-title>. <source>Environ. Sci. policy</source> <volume>82</volume>, <fpage>100</fpage>&#x2013;<lpage>107</lpage>. <pub-id pub-id-type="doi">10.1016/j.envsci.2018.01.012</pub-id>
</citation>
</ref>
<ref id="B49">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Lempert</surname>
<given-names>R. J.</given-names>
</name>
<name>
<surname>Groves</surname>
<given-names>D. G.</given-names>
</name>
</person-group> (<year>2010</year>). <article-title>Identifying and evaluating robust adaptive policy responses to climate change for water management agencies in the American west</article-title>. <source>Technol. Forecast. Soc. Change</source> <volume>77</volume>, <fpage>960</fpage>&#x2013;<lpage>974</lpage>. <pub-id pub-id-type="doi">10.1016/j.techfore.2010.04.007</pub-id>
</citation>
</ref>
<ref id="B50">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Lempert</surname>
<given-names>R. J.</given-names>
</name>
<name>
<surname>Popper</surname>
<given-names>S. W.</given-names>
</name>
<name>
<surname>Banks</surname>
<given-names>S.</given-names>
</name>
</person-group> (<year>2003</year>). <source>Shaping the next one hundred years: New methods for quantitative, long-term policy analysis</source>. <publisher-loc>Santa Monica, California</publisher-loc>: <publisher-name>RAND Corporation</publisher-name>.</citation>
</ref>
<ref id="B51">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Lipshitz</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Strauss</surname>
<given-names>O.</given-names>
</name>
</person-group> (<year>1997</year>). <article-title>Coping with uncertainty: A naturalistic decision-making analysis</article-title>. <source>Organ. Behav. Hum. Decis. Process.</source> <volume>69</volume>, <fpage>149</fpage>&#x2013;<lpage>163</lpage>. <pub-id pub-id-type="doi">10.1006/obhd.1997.2679</pub-id>
</citation>
</ref>
<ref id="B52">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Maani</surname>
<given-names>K.</given-names>
</name>
</person-group> (<year>2013</year>). <article-title>Decision-making for climate change adaptation: A systems thinking approach</article-title>. <source>Gold coast: National climate change adaptation research facility</source>.</citation>
</ref>
<ref id="B53">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Maier</surname>
<given-names>H. R.</given-names>
</name>
<name>
<surname>Guillaume</surname>
<given-names>J. H. A.</given-names>
</name>
<name>
<surname>Van Delden</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Riddell</surname>
<given-names>G. A.</given-names>
</name>
<name>
<surname>Haasnoot</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Kwakkel</surname>
<given-names>J. H.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>An uncertain future, deep uncertainty, scenarios, robustness and adaptation: How do they fit together?</article-title> <source>Environ. Model. Softw.</source> <volume>81</volume>, <fpage>154</fpage>&#x2013;<lpage>164</lpage>. <pub-id pub-id-type="doi">10.1016/j.envsoft.2016.03.014</pub-id>
</citation>
</ref>
<ref id="B54">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Matrosov</surname>
<given-names>E. S.</given-names>
</name>
<name>
<surname>Woods</surname>
<given-names>A. M.</given-names>
</name>
<name>
<surname>Harou</surname>
<given-names>J. J.</given-names>
</name>
</person-group> (<year>2013</year>). <article-title>Robust decision making and info-gap decision theory for water resource system planning</article-title>. <source>J. Hydrology</source> <volume>494</volume>, <fpage>43</fpage>&#x2013;<lpage>58</lpage>. <pub-id pub-id-type="doi">10.1016/j.jhydrol.2013.03.006</pub-id>
</citation>
</ref>
<ref id="B55">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Mcloughlin</surname>
<given-names>C. A.</given-names>
</name>
<name>
<surname>Thoms</surname>
<given-names>M. C.</given-names>
</name>
<name>
<surname>Parsons</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Reflexive learning in adaptive management: A case study of environmental water management in the murray darling basin, Australia</article-title>. <source>River Res. Appl.</source> <volume>36</volume>, <fpage>681</fpage>&#x2013;<lpage>694</lpage>. <pub-id pub-id-type="doi">10.1002/rra.3607</pub-id>
</citation>
</ref>
<ref id="B56">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Moallemi</surname>
<given-names>E. A.</given-names>
</name>
<name>
<surname>Zare</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Reed</surname>
<given-names>P. M.</given-names>
</name>
<name>
<surname>Elsawah</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Ryan</surname>
<given-names>M. J.</given-names>
</name>
<name>
<surname>Bryan</surname>
<given-names>B. A.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Structuring and evaluating decision support processes to enhance the robustness of complex human&#x2013;natural systems</article-title>. <source>Environ. Model. Softw.</source> <volume>123</volume>, <fpage>104551</fpage>. <pub-id pub-id-type="doi">10.1016/j.envsoft.2019.104551</pub-id>
</citation>
</ref>
<ref id="B57">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Mukherjee</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Zabala</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Huge</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Nyumba</surname>
<given-names>T. O.</given-names>
</name>
<name>
<surname>Adem Esmail</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Sutherland</surname>
<given-names>W. J.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Comparison of techniques for eliciting views and judgements in decision&#x2010;making</article-title>. <source>Methods Ecol. Evol.</source> <volume>9</volume>, <fpage>54</fpage>&#x2013;<lpage>63</lpage>. <pub-id pub-id-type="doi">10.1111/2041-210x.12940</pub-id>
</citation>
</ref>
<ref id="B58">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Oberlack</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Eisenack</surname>
<given-names>K.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Archetypical barriers to adapting water governance in river basins to climate change</article-title>. <source>J. Institutional Econ.</source> <volume>14</volume>, <fpage>527</fpage>&#x2013;<lpage>555</lpage>. <pub-id pub-id-type="doi">10.1017/s1744137417000509</pub-id>
</citation>
</ref>
<ref id="B59">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>O&#x2019;Brien</surname>
<given-names>K. L.</given-names>
</name>
</person-group> (<year>2009</year>). &#x201c;<article-title>Do values subjectively define the limits to climate change adaptation</article-title>,&#x201d; in <source>Adapting to climate change: Thresholds, values, governance</source>. Editors <person-group person-group-type="editor">
<name>
<surname>LORENZONI</surname>
<given-names>I.</given-names>
</name>
<name>
<surname>O&#x27;BRIEN</surname>
<given-names>K. L.</given-names>
</name>
<name>
<surname>ADGER</surname>
<given-names>W. N.</given-names>
</name>
</person-group> (<publisher-loc>Cambridge</publisher-loc>: <publisher-name>UK Cambridge University Press</publisher-name>).</citation>
</ref>
<ref id="B60">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Page</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Dilling</surname>
<given-names>L.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>How experiences of climate extremes motivate adaptation among water managers</article-title>. <source>Clim. Change</source> <volume>161</volume>, <fpage>499</fpage>&#x2013;<lpage>516</lpage>. <pub-id pub-id-type="doi">10.1007/s10584-020-02712-7</pub-id>
</citation>
</ref>
<ref id="B61">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Pahl-Wostl</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Arthington</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Bogardi</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Bunn</surname>
<given-names>S. E.</given-names>
</name>
<name>
<surname>Hoff</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Lebel</surname>
<given-names>L.</given-names>
</name>
<etal/>
</person-group> (<year>2013</year>). <article-title>Environmental flows and water governance: Managing sustainable water uses</article-title>. <source>Curr. Opin. Environ. Sustain.</source> <volume>5</volume> (<issue>3-4</issue>), <fpage>341</fpage>&#x2013;<lpage>351</lpage>. <pub-id pub-id-type="doi">10.1016/j.cosust.2013.06.009</pub-id>
</citation>
</ref>
<ref id="B62">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Pasquini</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Steynor</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Waagsaether</surname>
<given-names>K.</given-names>
</name>
</person-group> (<year>2019</year>). <source>The psychology of decision making under uncertainty - a literature review</source>. <publisher-loc>South Africa</publisher-loc>.</citation>
</ref>
<ref id="B63">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Peterson</surname>
<given-names>G. D.</given-names>
</name>
<name>
<surname>Cumming</surname>
<given-names>G. S.</given-names>
</name>
<name>
<surname>Carpenter</surname>
<given-names>S. R.</given-names>
</name>
</person-group> (<year>2003</year>). <article-title>Scenario planning: A tool for conservation in an uncertain world</article-title>. <source>Conserv. Biol.</source> <volume>17</volume>, <fpage>358</fpage>&#x2013;<lpage>366</lpage>. <pub-id pub-id-type="doi">10.1046/j.1523-1739.2003.01491.x</pub-id>
</citation>
</ref>
<ref id="B64">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Poff</surname>
<given-names>N. L.</given-names>
</name>
<name>
<surname>Tharme</surname>
<given-names>R. E.</given-names>
</name>
<name>
<surname>Arthington</surname>
<given-names>A. H.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Evolution of environmental flows assessment science, principles, and methodologies</article-title>. <source>Water for the environment</source>. <publisher-name>Elsevier</publisher-name>.</citation>
</ref>
<ref id="B65">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Polasky</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Carpenter</surname>
<given-names>S. R.</given-names>
</name>
<name>
<surname>Folke</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Keeler</surname>
<given-names>B.</given-names>
</name>
</person-group> (<year>2011</year>). <article-title>Decision-making under great uncertainty: Environmental management in an era of global change</article-title>. <source>Trends Ecol. Evol.</source> <volume>26</volume>, <fpage>398</fpage>&#x2013;<lpage>404</lpage>. <pub-id pub-id-type="doi">10.1016/j.tree.2011.04.007</pub-id>
</citation>
</ref>
<ref id="B66">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Radke</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Yousefpour</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Von Detten</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Reifenberg</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Hanewinkel</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Adopting robust decision-making to forest management under climate change</article-title>. <source>Ann. For. Sci.</source> <volume>74</volume>, <fpage>43</fpage>&#x2013;<lpage>16</lpage>. <pub-id pub-id-type="doi">10.1007/s13595-017-0641-2</pub-id>
</citation>
</ref>
<ref id="B67">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Regan</surname>
<given-names>H. M.</given-names>
</name>
<name>
<surname>Colyvan</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Burgman</surname>
<given-names>M. A.</given-names>
</name>
</person-group> (<year>2002</year>). <article-title>A taxonomy and treatment of uncertainty for ecology and conservation biology</article-title>. <source>Ecol. Appl.</source> <volume>12</volume>, <fpage>618</fpage>&#x2013;<lpage>628</lpage>. <pub-id pub-id-type="doi">10.1890/1051-0761(2002)012[0618:atatou]2.0.co;2</pub-id>
</citation>
</ref>
<ref id="B68">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Retief</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Morrison-Saunders</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Geneletti</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Pope</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2013</year>). <article-title>Exploring the psychology of trade-off decision-making in environmental impact assessment</article-title>. <source>Impact Assess. Proj. Apprais.</source> <volume>31</volume>, <fpage>13</fpage>&#x2013;<lpage>23</lpage>. <pub-id pub-id-type="doi">10.1080/14615517.2013.768007</pub-id>
</citation>
</ref>
<ref id="B69">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Ryder</surname>
<given-names>D. S.</given-names>
</name>
<name>
<surname>Tomlinson</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Gawne</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Likens</surname>
<given-names>G. E.</given-names>
</name>
</person-group> (<year>2010</year>). <article-title>Defining and using &#x2018;best available science&#x2019;: A policy conundrum for the management of aquatic ecosystems</article-title>. <source>Mar. Freshw. Res.</source> <volume>61</volume>, <fpage>821</fpage>&#x2013;<lpage>828</lpage>. <pub-id pub-id-type="doi">10.1071/mf10113</pub-id>
</citation>
</ref>
<ref id="B70">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Saft</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Peel</surname>
<given-names>M. C.</given-names>
</name>
<name>
<surname>Western</surname>
<given-names>A. W.</given-names>
</name>
<name>
<surname>Zhang</surname>
<given-names>L.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>Predicting shifts in rainfall-runoff partitioning during multiyear drought: Roles of dry period and catchment characteristics</article-title>. <source>Water Resour. Res.</source> <volume>52</volume> (<issue>12</issue>), <fpage>9290</fpage>&#x2013;<lpage>9305</lpage>. <pub-id pub-id-type="doi">10.1002/2016wr019525</pub-id>
</citation>
</ref>
<ref id="B71">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Serrao-Neumann</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Schuch</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Cox</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Choy</surname>
<given-names>D. L.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Scenario planning for climate change adaptation for natural resource management: Insights from the Australian East Coast Cluster</article-title>. <source>Ecosyst. Serv.</source> <volume>38</volume>, <fpage>100967</fpage>. <pub-id pub-id-type="doi">10.1016/j.ecoser.2019.100967</pub-id>
</citation>
</ref>
<ref id="B72">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Shepherd</surname>
<given-names>T. G.</given-names>
</name>
<name>
<surname>Boyd</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Calel</surname>
<given-names>R. A.</given-names>
</name>
<name>
<surname>Chapman</surname>
<given-names>S. C.</given-names>
</name>
<name>
<surname>Dessai</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Dima-West</surname>
<given-names>I. M.</given-names>
</name>
<etal/>
</person-group> (<year>2018</year>). <article-title>Storylines: An alternative approach to representing uncertainty in physical aspects of climate change</article-title>. <source>Clim. change</source> <volume>151</volume>, <fpage>555</fpage>&#x2013;<lpage>571</lpage>. <pub-id pub-id-type="doi">10.1007/s10584-018-2317-9</pub-id>
</citation>
</ref>
<ref id="B73">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Shi</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Hobbs</surname>
<given-names>B. F.</given-names>
</name>
<name>
<surname>Jiang</surname>
<given-names>H.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>When can decision analysis improve climate adaptation planning? Two procedures to match analysis approaches with adaptation problems</article-title>. <source>Clim. Change</source> <volume>157</volume>, <fpage>611</fpage>&#x2013;<lpage>630</lpage>. <pub-id pub-id-type="doi">10.1007/s10584-019-02579-3</pub-id>
</citation>
</ref>
<ref id="B74">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Siders</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Pierce</surname>
<given-names>A. L.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Deciding how to make climate change adaptation decisions</article-title>. <source>Curr. Opin. Environ. Sustain.</source> <volume>52</volume>, <fpage>1</fpage>&#x2013;<lpage>8</lpage>. <pub-id pub-id-type="doi">10.1016/j.cosust.2021.03.017</pub-id>
</citation>
</ref>
<ref id="B75">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Singh</surname>
<given-names>A. S.</given-names>
</name>
<name>
<surname>Eanes</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Prokopy</surname>
<given-names>L. S.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Climate change uncertainty among American farmers: An examination of multi-dimensional uncertainty and attitudes towards agricultural adaptation to climate change</article-title>. <source>Clim. Change</source> <volume>162</volume>, <fpage>1047</fpage>&#x2013;<lpage>1064</lpage>. <pub-id pub-id-type="doi">10.1007/s10584-020-02860-w</pub-id>
</citation>
</ref>
<ref id="B76">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Singh</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Reed</surname>
<given-names>P. M.</given-names>
</name>
<name>
<surname>Keller</surname>
<given-names>K.</given-names>
</name>
</person-group> (<year>2015</year>). <article-title>Many-objective robust decision making for managing an ecosystem with a deeply uncertain threshold response</article-title>. <source>Ecol. Soc.</source> <volume>20</volume>, <fpage>art12</fpage>. <pub-id pub-id-type="doi">10.5751/es-07687-200312</pub-id>
</citation>
</ref>
<ref id="B77">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>St-Laurent</surname>
<given-names>G. P.</given-names>
</name>
<name>
<surname>Oakes</surname>
<given-names>L. E.</given-names>
</name>
<name>
<surname>Cross</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Hagerman</surname>
<given-names>S.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>R&#x2013;R&#x2013;T (resistance&#x2013;resilience&#x2013;transformation) typology reveals differential conservation approaches across ecosystems and time</article-title>. <source>Commun. Biol.</source> <volume>4</volume>, <fpage>1</fpage>&#x2013;<lpage>9</lpage>.</citation>
</ref>
<ref id="B78">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Stein</surname>
<given-names>B. A.</given-names>
</name>
<name>
<surname>Staudt</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Cross</surname>
<given-names>M. S.</given-names>
</name>
<name>
<surname>Dubois</surname>
<given-names>N. S.</given-names>
</name>
<name>
<surname>Enquist</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Griffis</surname>
<given-names>R.</given-names>
</name>
<etal/>
</person-group> (<year>2013</year>). <article-title>Preparing for and managing change: Climate adaptation for biodiversity and ecosystems</article-title>. <source>Front. Ecol. Environ.</source> <volume>11</volume>, <fpage>502</fpage>&#x2013;<lpage>510</lpage>. <pub-id pub-id-type="doi">10.1890/120277</pub-id>
</citation>
</ref>
<ref id="B79">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Stults</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Larsen</surname>
<given-names>L.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Tackling uncertainty in US local climate adaptation planning</article-title>. <source>J. Plan. Educ. Res.</source> <volume>40</volume>, <fpage>416</fpage>&#x2013;<lpage>431</lpage>. <pub-id pub-id-type="doi">10.1177/0739456x18769134</pub-id>
</citation>
</ref>
<ref id="B80">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Tharme</surname>
<given-names>R. E.</given-names>
</name>
</person-group> (<year>2003</year>). <article-title>A global perspective on environmental flow assessment: Emerging trends in the development and application of environmental flow methodologies for rivers</article-title>. <source>River Res. Appl.</source> <volume>19</volume>, <fpage>397</fpage>&#x2013;<lpage>441</lpage>. <pub-id pub-id-type="doi">10.1002/rra.736</pub-id>
</citation>
</ref>
<ref id="B81">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Thompson</surname>
<given-names>L. M.</given-names>
</name>
<name>
<surname>Lynch</surname>
<given-names>A. J.</given-names>
</name>
<name>
<surname>Beever</surname>
<given-names>E. A.</given-names>
</name>
<name>
<surname>Engman</surname>
<given-names>A. C.</given-names>
</name>
<name>
<surname>Falke</surname>
<given-names>J. A.</given-names>
</name>
<name>
<surname>Jackson</surname>
<given-names>S. T.</given-names>
</name>
<etal/>
</person-group> (<year>2021</year>). <article-title>Responding to ecosystem transformation: Resist, accept, or direct?</article-title> <source>Fisheries</source> <volume>46</volume>, <fpage>8</fpage>&#x2013;<lpage>21</lpage>. <pub-id pub-id-type="doi">10.1002/fsh.10506</pub-id>
</citation>
</ref>
<ref id="B82">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Thompson</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Bond</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Poff</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Byron</surname>
<given-names>N.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Towards a systems approach for river basin management&#x2014;lessons from A ustralia&#x27;s largest river</article-title>. <source>River Res. Appl.</source> <volume>35</volume>, <fpage>466</fpage>&#x2013;<lpage>475</lpage>. <pub-id pub-id-type="doi">10.1002/rra.3242</pub-id>
</citation>
</ref>
<ref id="B83">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Tonkin</surname>
<given-names>Z.</given-names>
</name>
<name>
<surname>Jones</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Clunie</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Amtstaetter</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Jones</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Koster</surname>
<given-names>W.</given-names>
</name>
<etal/>
</person-group> (<year>2020</year>). <source>Victorian environmental flows monitoring and assessment program. Stage 6 synthesis report 2016-2020</source>. <publisher-loc>Land, Water and Planning</publisher-loc>: <publisher-name>Department of Environment</publisher-name>.</citation>
</ref>
<ref id="B84">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Urban</surname>
<given-names>M. C.</given-names>
</name>
<name>
<surname>Bocedi</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Hendry</surname>
<given-names>A. P.</given-names>
</name>
<name>
<surname>Mihoub</surname>
<given-names>J.-B.</given-names>
</name>
<name>
<surname>Pe&#x2019;Er</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Singer</surname>
<given-names>A.</given-names>
</name>
<etal/>
</person-group> (<year>2016</year>). <article-title>Improving the forecast for biodiversity under climate change</article-title>. <source>Science</source> <volume>353</volume>, <fpage>aad8466</fpage>. <pub-id pub-id-type="doi">10.1126/science.aad8466</pub-id>
</citation>
</ref>
<ref id="B85">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Walliman</surname>
<given-names>N.</given-names>
</name>
</person-group> (<year>2015</year>). <source>Social research methods: The essentials</source>. <publisher-loc>London, UK</publisher-loc>: <publisher-name>Sage</publisher-name>.</citation>
</ref>
<ref id="B86">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Walter</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2019</year>). <source>
<italic>Social research methods</italic>, Docklands</source>. <publisher-loc>Victoria</publisher-loc>: <publisher-name>Oxford University Press</publisher-name>.</citation>
</ref>
<ref id="B87">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Watts</surname>
<given-names>R. J.</given-names>
</name>
<name>
<surname>Dyer</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Frazier</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Gawne</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Marsh</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Ryder</surname>
<given-names>D. S.</given-names>
</name>
<etal/>
</person-group> (<year>2020</year>). <article-title>Learning from concurrent adaptive management in multiple catchments within a large environmental flows program in Australia</article-title>. <source>River Res. Appl.</source> <volume>36</volume>, <fpage>668</fpage>&#x2013;<lpage>680</lpage>. <pub-id pub-id-type="doi">10.1002/rra.3620</pub-id>
</citation>
</ref>
<ref id="B88">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Weber</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Baron</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Loomes</surname>
<given-names>G.</given-names>
</name>
</person-group> (<year>2001</year>). <source>Conflict and tradeoffs in decision making</source>. <publisher-name>Cambridge University Press</publisher-name>.</citation>
</ref>
<ref id="B89">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wodak</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Neale</surname>
<given-names>T.</given-names>
</name>
</person-group> (<year>2015</year>). <article-title>A critical review of the application of environmental scenario exercises</article-title>. <source>Futures</source> <volume>73</volume>, <fpage>176</fpage>&#x2013;<lpage>186</lpage>. <pub-id pub-id-type="doi">10.1016/j.futures.2015.09.002</pub-id>
</citation>
</ref>
</ref-list>
</back>
</article>