<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" article-type="research-article" dtd-version="2.3" xml:lang="EN">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Med.</journal-id>
<journal-title>Frontiers in Medicine</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Med.</abbrev-journal-title>
<issn pub-type="epub">2296-858X</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fmed.2023.1230620</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Medicine</subject>
<subj-group>
<subject>Hypothesis and Theory</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Paradigms unfolded &#x2013; developing, validating, and evaluating the Medical Education e-Professionalism framework from a philosophical perspective</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes"><name><surname>Guraya</surname> <given-names>Shaista Salman</given-names></name>
<xref rid="aff1" ref-type="aff"><sup>1</sup></xref>
<xref rid="aff2" ref-type="aff"><sup>2</sup></xref>
<xref rid="c001" ref-type="corresp"><sup>&#x002A;</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/1347593/overview"/>
</contrib>
<contrib contrib-type="author"><name><surname>Harkin</surname> <given-names>Denis W.</given-names></name>
<xref rid="aff3" ref-type="aff"><sup>3</sup></xref>
</contrib>
<contrib contrib-type="author"><name><surname>Yusoff</surname> <given-names>Muhamad Saiful Bahri</given-names></name>
<xref rid="aff2" ref-type="aff"><sup>2</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/1347180/overview"/>
</contrib>
<contrib contrib-type="author"><name><surname>Guraya</surname> <given-names>Salman Yousuf</given-names></name>
<xref rid="aff4" ref-type="aff"><sup>4</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/1406601/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Royal College of Surgeons Ireland</institution>, <addr-line>Medical University of Bahrain, Bahrain</addr-line>, <country>Bahrain</country></aff>
<aff id="aff2"><sup>2</sup><institution>Department of Medical Education, School of Medicine</institution>, <addr-line>University Sains Malaysia, Kelantan</addr-line>, <country>Malaysia</country></aff>
<aff id="aff3"><sup>3</sup><institution>Faculty of Medicine and Health Sciences, Royal College of Surgeons Ireland</institution>, <addr-line>Dublin</addr-line>, <country>Ireland</country></aff>
<aff id="aff4"><sup>4</sup><institution>College of Medicine, University of Sharjah</institution>, <addr-line>Sharjah</addr-line>, <country>United Arab Emirates</country></aff>
<author-notes>
<fn fn-type="edited-by" id="fn0001">
<p>Edited by: Jacqueline G. Bloomfield, The University of Sydney, Australia</p>
</fn>
<fn fn-type="edited-by" id="fn0002">
<p>Reviewed by: Mahbub Sarkar, Monash University, Australia; Gohar Wajid, World Health Organization, EMRO, Egypt</p>
</fn>
<corresp id="c001">&#x002A;Correspondence: Shaista Salman Guraya, <email>ssalman@rcsi.com</email></corresp>
</author-notes>
<pub-date pub-type="epub">
<day>19</day>
<month>10</month>
<year>2023</year>
</pub-date>
<pub-date pub-type="collection">
<year>2023</year>
</pub-date>
<volume>10</volume>
<elocation-id>1230620</elocation-id>
<history>
<date date-type="received">
<day>29</day>
<month>05</month>
<year>2023</year>
</date>
<date date-type="accepted">
<day>07</day>
<month>09</month>
<year>2023</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2023 Guraya, Harkin, Yusoff and Guraya.</copyright-statement>
<copyright-year>2023</copyright-year>
<copyright-holder>Guraya, Harkin, Yusoff and Guraya</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p>
</license>
</permissions>
<abstract>
<p>In order to ensure a strong research design, literature stresses the adoption of a research paradigm that is consistent with the researcher&#x2019;s beliefs about the nature of reality. In this article we provide an overview of research paradigm choices in relation to the creation of a Medical Education e-Professionalism (MEeP) framework discussing the research design, research methods, data collection and analysis to enhance the transparency of our previously published research. The MEeP framework was conceived to help Health Care Professionals (HCPs) safeguard the construct of professionalism in the digital context. This entire process was heavily informed by wider readings and deliberations of published literature on e-professionalism. Although the MEeP framework research journey has been published, the paradigms approach was not discussed in any detail. Considering that one of the duties of medical educator is to balance the service and science by bringing the theoretical underpinnings of one&#x2019;s research to public attention and scrutiny so as to nullify the notion of &#x2018;weak&#x2019; research. We were compelled to unfold this paradigm story of the MEeP framework in a detailed manner. In an effort to make our research both robust and effective, this study portrays a philosophical approach to guide future research designs and methodological choices by detailing our rationale for pragmatism as a choice of paradigm.</p>
</abstract>
<kwd-group>
<kwd>paradigms</kwd>
<kwd>pragmatism</kwd>
<kwd>mixed-methods research</kwd>
<kwd>Medical Education e-Professionalism framework</kwd>
<kwd>e-professionalism</kwd>
</kwd-group>
<counts>
<fig-count count="1"/>
<table-count count="4"/>
<equation-count count="0"/>
<ref-count count="88"/>
<page-count count="10"/>
<word-count count="8580"/>
</counts>
<custom-meta-wrap>
<custom-meta>
<meta-name>section-at-acceptance</meta-name>
<meta-value>Healthcare Professions Education</meta-value>
</custom-meta>
</custom-meta-wrap>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="sec1">
<title>Introduction</title>
<p>In educational research, Mackenzie and Knipe (<xref ref-type="bibr" rid="ref1">1</xref>) and Morgan (<xref ref-type="bibr" rid="ref2">2</xref>) used the term paradigm to express the researcher&#x2019;s &#x2018;<italic>worldview</italic>&#x2019;. Whereas a more elaborative definition of paradigm was introduced by Morgan (<xref ref-type="bibr" rid="ref2">2</xref>) as a &#x201C;<italic>set of assumptions, research strategies and criteria for rigor that are shared by the research community</italic>&#x201D; and &#x201C;<italic>a system of ideas, or world view used by researchers to generate knowledge</italic>.&#x201D; Paradigm represents the &#x2018;<italic>ultimates</italic>&#x2019; encompassing ontological, epistemological, and methodological beliefs of a researcher, which often indicates the researcher&#x2019;s viewpoint (<xref ref-type="bibr" rid="ref3">3</xref>). This highlights the importance of paradigm which yield beliefs and directs the crucial steps in planning and execution of the research process. This step also establishes the researcher&#x2019;s philosophical orientation which has significant bearing on the research process and design (<xref ref-type="bibr" rid="ref4">4</xref>). In order to ensure a strong research design, published literature stresses the adoption of a research paradigm that is consistent with the researcher&#x2019;s beliefs about the nature of reality (<xref ref-type="bibr" rid="ref5">5</xref>). To accomplish this goal, Levers (<xref ref-type="bibr" rid="ref6">6</xref>) explained that selection of paradigm aligns with researcher&#x2019;s perspectives of reality and should be made explicit in the process. Lincoln and Guba (<xref ref-type="bibr" rid="ref7">7</xref>) communicated that a paradigm comprises of four elements, namely, epistemology (our ideas about knowledge), ontology (our existence), methodology (research design and methods) and axiology (the role of values in inquiry) (<xref ref-type="bibr" rid="ref8">8</xref>, <xref ref-type="bibr" rid="ref9">9</xref>). As suggested in the literature, it was paramount to have a close-grained grasp of these elements to identify our position on a particular research paradigm, the underlying guiding assumptions, beliefs, norms, and the values of the chosen paradigm (<xref ref-type="bibr" rid="ref10">10</xref>). This would help establish an understanding of our research while narrating the journey of the development of the MEep framework (<xref ref-type="bibr" rid="ref11">11</xref>).</p>
<p>As our research centred on the ever-evolving field of the digital world and its impact on professionalism of healthcare professionals, it manifested new and evolving professional dilemmas and potential erosion of professionalism perspectives. There was no obvious philosophical paradigm to align with our research due to nature of data (enumeration and explanation) required. In order to conduct a cohesive and valid research study, we explored methodological paradigms along with ontological and epistemological perspectives by blending different knowledge claims and inquiry strategies. Similarly, having to select an appropriate lens for this research placed us at the crossroads of these research paradigms where a sharp division became unnecessary. Both epistemological and ontological aspects were needed for the evaluation of e-professionalism concept and later for the development and understanding of the essential attributes required for an effective digital professional. We adopted a complex multi-stage research design and used data from a systematic review, self-reported survey, and Delphi technique and experts&#x2019; reviews to develop, validate and evaluate the MeEP framework. The results of all stages of the MeEP framework journey have been published recently (<xref ref-type="bibr" rid="ref12 ref13 ref14 ref15">12&#x2013;15</xref>). The MEeP framework&#x2019;s journey sheds light on professional competencies in terms of characters, characteristics and identifies constructs which can be inculcated in future healthcare professionals (HCPs) to become digitally skilled. However, it became evident that a pluralistic framework for HCPs to navigate through the dilemma of thriving in the digital realm was needed. Especially since one of the duties of a medical educator is to balance the service and science by appreciating the theoretical underpinnings behind one&#x2019;s research to public so as to nullify the notion of &#x2018;weak&#x2019; research (<xref ref-type="bibr" rid="ref10">10</xref>, <xref ref-type="bibr" rid="ref16">16</xref>). Therefore, in this research we aim to provide an account of the four elements of the paradigm followed by a structured process of rationalizing the paradigm choice in the journey of the MEeP framework.</p>
<sec id="sec2">
<title>Epistemology</title>
<p>Schwandt (<xref ref-type="bibr" rid="ref17">17</xref>) defined epistemology as the study of the nature of knowledge and justification in line with Crotty&#x2019;s approach (<xref ref-type="bibr" rid="ref18">18</xref>) &#x201C;<italic>a way of understanding and explaining how I know what I know</italic>.&#x201D; Whereas Denzin and Lincoln (<xref ref-type="bibr" rid="ref3">3</xref>) described it as &#x201C;<italic>a relationship between the knower and the knowledge</italic>&#x201D; investigating how the researcher makes meaningful sense of the world. This understanding can oscillate between positivist &#x2013; &#x201C;<italic>knowledge as personal, subjective and unique</italic>&#x201D; to interpretivist &#x2013; &#x201C;<italic>knowledge as hard, objective and tangible</italic>&#x201D; (<xref ref-type="bibr" rid="ref19">19</xref>). Positivists dwelling on the philosophical perspectives base their knowledge on the external existence of reality. By employing quantitative methods (surveys and experiments), they infer using replicable statistical analysis thus dissociating the researcher from the whole process. For positivists, the formulation of hypotheses is crucial for the verification of knowledge. While on the other end of the spectrum, Interpretivists, or social constructivists, view knowledge as complex context-specific socially constructed entity (<xref ref-type="bibr" rid="ref20">20</xref>). Interpretivists acknowledge the significance of history and practical experience in the advancement of knowledge. They believe in the crucial role of research participant and how one&#x2019;s expertise and cognitive base influence the whole research process. They strongly believe in the role of researcher&#x2019;s cognitive maturity that shapes the understandings and discussions with the study participants in each context. On the other hand, realism, which shares similarities with positivism, adopts a scientific approach to developing knowledge. However, realists being on the anti-positivist spectrum rely on triangulation to unveil the truth. Realists highlights the role of interpretations in the context of social environment (<xref ref-type="bibr" rid="ref21">21</xref>). In articulating answers to the above questions, there are further terminologies coined to define subcategories of knowledge, <italic>intuitive knowledge</italic> (knowledge of beliefs, faith, and intuition), <italic>authoritative knowledge</italic> (knowledge gathered from people, books, leaders in organizations), <italic>logical knowledge</italic> (knowledge emphasizing reasoning), and <italic>empirical knowledge</italic> (knowledge of experiences, and demonstrable objective facts) (<xref ref-type="bibr" rid="ref22">22</xref>). This, type of detailed discussion is not within the scope of this article. However during the MEeP journey we used the concept of epistemology lauded by Saunders et al. (<xref ref-type="bibr" rid="ref23">23</xref>) as &#x201C;<italic>the acceptable knowledge in the field of study</italic>,&#x201D; a useful classification of objectivism, constructionism and subjectivism (<xref ref-type="bibr" rid="ref18">18</xref>).</p>
</sec>
<sec id="sec3">
<title>Ontology</title>
<p>Ontology is regarded as &#x201C;<italic>the study of being</italic>&#x201D; as described by Crotty (<xref ref-type="bibr" rid="ref18">18</xref>) and &#x201C;<italic>raises basic questions about the nature of reality and the nature of the human being in the world</italic>&#x201D; (<xref ref-type="bibr" rid="ref3">3</xref>). It focuses on understanding the nature of reality and the assumptions we make about it. In other words, ontology examines the objective or subjective aspects of social entities and unfolds the true dynamics of the things. The ongoing ontological debate is whether social reality is individually constructed from consciousness or is it external and imposed on consciousness. In other words, do things exist independently of our mind, or is our world something constructed from our thoughts (<xref ref-type="bibr" rid="ref19">19</xref>)? This implies that there are two ontological perspectives: realism and idealism. Realists argue the organic nature unrestrained of human discernment. On the other hand, idealists holding the opposing view, confess and endorses the allegory of Plato where human mind constructs its own reality using preconceived notions of shadows. Philosophical assumptions about the nature of reality play a pivotal role in our understanding and on the inferences drawn from the data. These orientate our thoughts about the research problem, its significance and our approach to problem solving. Hence, ontology plays an essential role in our understanding of the things that constitute the world (<xref ref-type="bibr" rid="ref24">24</xref>). In MEeP framework journey the ontological position is clear by using external multiple views to best answer the research question.</p>
</sec>
<sec id="sec4">
<title>Methodology</title>
<p>&#x2018;Methodology&#x2019; refers to &#x201C;<italic>the process, principles and procedures by which a researcher approaches problems and seeks answers</italic>&#x201D; (<xref ref-type="bibr" rid="ref25">25</xref>). While Langdridge (<xref ref-type="bibr" rid="ref26">26</xref>) refers to methodology as a term rather than a process as a &#x201C;<italic>general way to research a topic,&#x201D; while &#x201C;method is the specific technique (s) being employed.</italic>&#x201D; Hence, broadly speaking methodology is about research design and methods describe the approaches, and procedures. This includes data collection, participant sampling techniques, instruments used and data analysis conducted so as to answer the research question ensuring a substantial contribution to knowledge. In summary, methodology narrates the systematic process used in conducting the research including assumptions made, limitations encountered and addressed. Both methodology and methods used in this research are discussed in the latter half of this article.</p>
</sec>
<sec id="sec5">
<title>Axiology</title>
<p>Axiology is defined as &#x201C;<italic>the philosophical approach to making decisions of value or the right decisions</italic>&#x201D; (<xref ref-type="bibr" rid="ref27">27</xref>). Axiology involves the examination of values and the foundation upon which a researcher makes value judgments. A researcher&#x2019;s personal values, beliefs, and experiences can influence their research and may impact their ability to remain unbiased when it comes to the concept of value. There are two axiological positions: positivism, which emphasizes value-neutrality, and interpretivism, which acknowledges the presence of values in research. To achieve this understanding of definition and evaluation of the concept of right and wrong pertinent to the research is essential. Simply stated, it&#x2019;s about the ethical behaviour maintained during participant recruitment, data collection and the dissemination of findings to the wider audience. This understanding of axiology dates back to Mill&#x2019;s utilitarian ethics with an understanding that all humans have dignity and the right to choose, which should be respected (<xref ref-type="bibr" rid="ref28">28</xref>). Keeping this in mind, four principles namely; privacy, accuracy, property and accessibility were upheld while dealing with research participants and data (<xref ref-type="bibr" rid="ref29">29</xref>).</p>
<p>After identifying the four basic elements which form a paradigm, the next step was to designate an epistemology, ontology, and axiology to assist in developing the methodology (<xref ref-type="bibr" rid="ref2">2</xref>). By seeking insights from Tashakkori et al. (<xref ref-type="bibr" rid="ref30">30</xref>) whose advancing work on taxonomies of paradigms from pre-existing research by Candy (<xref ref-type="bibr" rid="ref31">31</xref>) added a new pragmatic paradigm to the original taxonomy set. They borrowed elements from the Positivist, Interpretivist, and Critical paradigms (<xref ref-type="bibr" rid="ref31">31</xref>). They kept &#x201C;the research problem&#x201D; as the central pivot, which we used while focusing on shaping the attitudes, values, beliefs, thoughts, and behaviour of medical students and changes on various levels, while reconciling eclectic views on how e-professionalism is understood, discovered, learned, valued, justified, and verified, thus challenging concrete ideas of science (<xref ref-type="bibr" rid="ref32">32</xref>). For the purpose of this research, we broadly related our approach to &#x2018;pragmatism&#x2019; for interrogating and evaluating ideas and beliefs regarding e-professionalism and their practical utility in maintaining the societal contract of profession. However, before we rationalize the principles of pragmatism in the context of this research, lets describe the evolution of this paradigm.</p>
</sec>
</sec>
<sec id="sec6">
<title>Pragmatism &#x2013; a philosophical paradigm</title>
<p>Dewey (<xref ref-type="bibr" rid="ref33">33</xref>) conceptualized epistemology as the &#x201C;<italic>theory of inquiry</italic>&#x201D; comprising of experiencing, knowing, and acting which demands a dynamic view of social life. Obviously, unravelling of &#x2018;<italic>truth</italic>&#x2019; about this dynamic world cannot be accessed by virtue of single scientific method. Historically, science is an amalgam of various collective truths ranging between objective and subjective assumptions about <italic>ontology</italic> (our existence), <italic>epistemology</italic> (our ideas about knowledge), <italic>research methods</italic>, and <italic>human nature</italic> which forms the basis to challenging the solid foundations of science (<xref ref-type="bibr" rid="ref8">8</xref>, <xref ref-type="bibr" rid="ref9">9</xref>). Many philosophers agree that relational epistemology, non-singular reality ontological viewpoint, a mixed-methods methodology and value-laden axiology were the best way forward in understanding human behaviour (<xref ref-type="bibr" rid="ref34 ref35 ref36">34&#x2013;36</xref>). Drawing on the works of Creswell, Tashakkori, and Teddlie (<xref ref-type="bibr" rid="ref36">36</xref>, <xref ref-type="bibr" rid="ref37">37</xref>) we identified the following characteristics of pragmatic research for MEeP framework journey;</p>
<list list-type="bullet">
<list-item>
<p>Rejection of the positivist notion (facts and measurable entities).</p>
</list-item>
<list-item>
<p>Rejection of absolute post-positivist and constructivist notions (reality and cognition).</p>
</list-item>
<list-item>
<p>An emphasis on workability in research.</p>
</list-item>
<list-item>
<p>Choice of research design and methodologies that work for the research question/s.</p>
</list-item>
<list-item>
<p>Use of the most feasible methodological approaches for knowledge acquisition.</p>
</list-item>
<list-item>
<p>Choice of research methods well aligned with the purpose of research.</p>
</list-item>
<list-item>
<p>Triangulation; identifying useful point of connections within the research and to avoid potential biases to enhance the quality of research.</p>
</list-item>
</list>
<p>It became obvious that pragmatism was an inclusive approach, which simultaneously appreciated the existence of reality (objectivism) and the individualized worldview (subjectivism) bringing multiple explanations and interpretations of science (<xref ref-type="bibr" rid="ref23">23</xref>). <xref rid="tab1" ref-type="table">Table 1</xref> summarizes the nature of pragmatism on the above mentioned four elements of epistemology, ontology, methodology and axiology adopted during the MEeP framework journey.</p>
<table-wrap position="float" id="tab1">
<label>Table 1</label>
<caption>
<p>Summary of four elements of pragmatism for developing the MEeP framework.</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left" valign="top">Elements</th>
<th align="left" valign="top">Pragmatism</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top">Epistemology</td>
<td align="left" valign="top">Depending upon the research question, focusing on the practicality and applicability of the research objectives and subjective and objective approaches can provide admissible knowledge integrating different perspectives in data interpretation</td>
</tr>
<tr>
<td align="left" valign="top">Ontology</td>
<td align="left" valign="top">Integration of multiple external views chosen in answering the research question</td>
</tr>
<tr>
<td align="left" valign="top">Methodology</td>
<td align="left" valign="top">Mixed or multiple method designs, quantitative and qualitative approaches</td>
</tr>
<tr>
<td align="left" valign="top">Axiology</td>
<td align="left" valign="top">Role of values in results interpretation, while the researcher adopts both objective and subjective viewpoints</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>Appreciating that pragmatism was not aligned to any one system of philosophy gave us the freedom of choice for methods, by viewing the social reality from a different lens that yielded transferable context rich findings (<xref ref-type="bibr" rid="ref38">38</xref>). Additionally, the pragmatism &#x2018;<italic>world-view</italic>&#x2019; dissipated the clear divide between methodological choices, logic and epistemology sufficiently to pacify the paradigm wars (<xref ref-type="bibr" rid="ref33">33</xref>, <xref ref-type="bibr" rid="ref39">39</xref>, <xref ref-type="bibr" rid="ref40">40</xref>). In an attempt to safeguard this important societal contract and understanding the phenomenon of e-professionalism viewing this problem through the philosophical lens of &#x2018;<italic>pragmatism</italic>&#x2019; seemed most appropriate.</p>
<p>MEeP framework came into being while keeping in mind how a model can be conceptualized, developed and applied to change professional behaviour of health care professionals about e-professionalism. To achieve this, following questions were probed in a phased manner.</p>
<list list-type="order">
<list-item>
<p>What is the nature, degree, and professional use of social media by the undergraduate (UG) medical students?</p>
</list-item>
<list-item>
<p>What are the definitions of the constructs for the new proposed MEeP framework?</p>
</list-item>
<list-item>
<p>How can the key elements of new MEeP framework be identified?</p>
</list-item>
<list-item>
<p>Does the new MEeP framework have sufficient content and response process validity?</p>
</list-item>
<list-item>
<p>How does the MEeP framework impact on the reaction, learning and behaviour of learners?</p>
</list-item>
</list>
<p>This article provides our philosophical paradigm overview of the materials, methods, and data analysis approaches used while developing, validating, and evaluating Medical Education e-Professionalism (MEeP) framework in a phased manner (<xref rid="tab2" ref-type="table">Table 2</xref>).</p>
<table-wrap position="float" id="tab2">
<label>Table 2</label>
<caption>
<p>Summary of the phases involved in the research study.</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th rowspan="2"/>
<th align="left" valign="top" colspan="2">Phase I &#x2013; Development</th>
<th align="left" valign="top">Phase II &#x2013; Validation</th>
<th align="left" valign="top">Phase III &#x2013; Evaluation</th>
</tr>
<tr>
<th align="left" valign="top">Study 1</th>
<th align="left" valign="top">Study 2</th>
<th align="left" valign="top">Study 3</th>
<th align="left" valign="top">Study 4</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top">Design</td>
<td align="left" valign="top" colspan="2">Convergent parallel</td>
<td align="left" valign="top" colspan="2">Concurrent embedded</td>
</tr>
<tr>
<td align="left" valign="top">Rationale</td>
<td align="left" valign="top">An exploratory step in the development of the MEeP framework</td>
<td align="left" valign="top">A framework for healthcare professionals to help cope with the challenges of medical professionalism in the digital realm</td>
<td align="left" valign="top">To seek reassurance by consulting experts regarding the validity of the MEeP framework</td>
<td align="left" valign="top">To measure the impact of MEeP framework in changing professional behaviours of learners in the digital world</td>
</tr>
<tr>
<td align="left" valign="top">Aim</td>
<td align="left" valign="top">To identify the key concepts and threats to professional identity in the era of e-professionalism</td>
<td align="left" valign="top">To develop the MEeP framework</td>
<td align="left" valign="top">To validate the MEeP framework</td>
<td align="left" valign="top">To evaluate the MEeP framework at the behaviour level of Kirkpatrick&#x2019;s pyramid using Theory of Planned Behaviour</td>
</tr>
<tr>
<td align="left" valign="top">Approach</td>
<td align="left" valign="top">QUAL</td>
<td align="left" valign="top">QUAL-QUAN</td>
<td align="left" valign="top">QUAN-QUAL</td>
<td align="left" valign="top">QUAL-QUAN</td>
</tr>
<tr>
<td align="left" valign="top">Sampling strategy and participants</td>
<td align="left" valign="top">&#x002A;SPIDER (<italic>n</italic>&#x2009;=&#x2009;44 studies)</td>
<td align="left" valign="top">Convenience (SNSME <italic>n</italic>&#x2009;=&#x2009;381) Purposive (Delphi <italic>n</italic>&#x2009;=&#x2009;15)</td>
<td align="left" valign="top">Purposive (<italic>n</italic>&#x2009;=&#x2009;6)</td>
<td align="left" valign="top">Convenience (<italic>n</italic>&#x2009;=&#x2009;59)</td>
</tr>
<tr>
<td align="left" valign="top">Data collection</td>
<td align="left" valign="top">PRISMA technique</td>
<td align="left" valign="top">Online questionnaire and online multi-round iterative approach for Delphi</td>
<td align="left" valign="top">Online meeting with experts and online survey</td>
<td align="left" valign="top">(Online) Pre-post workshop survey and breakout room discussions</td>
</tr>
<tr>
<td align="left" valign="top">Analysis</td>
<td align="left" valign="top">Thematic</td>
<td align="left" valign="top">Descriptive and thematic analysis using grounded theory approach</td>
<td align="left" valign="top">Descriptive and content analysis</td>
<td align="left" valign="top">Descriptive and structural Equation Modelling &#x2013; Thematic analysis</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p>&#x002A;PRISMA, preferred reporting items for systematic reviews and meta-analyses. &#x002A;SPIDER &#x2013; S, sample; PI, phenomenon of interest; D, design; E, evaluation; R, research type.</p>
</table-wrap-foot>
</table-wrap>
</sec>
<sec id="sec7">
<title>Applying the principles of pragmatism in context of MEeP framework</title>
<sec id="sec8">
<title>Research design</title>
<p>Keeping our pragmatist view of the world in mind, a unique literature review in the form of concept analysis (In press) prompted us towards developing a well-framed research objective, a concise research question and a well-aligned methodology. A significant and thorough literature review accomplished by assessing the theoretical published literature enabled us to refine the research objectives. Using the &#x2018;<italic>what works</italic>&#x2019; Pragmatic approach helped us to unpack the &#x2018;truth&#x2019; of the emerging social reality of e-professionalism and avoiding the &#x2018;either-or&#x2019; qualitative-quantitative polemic through the pragmatist and a pluralist research philosophy developed by Bilau (<xref ref-type="bibr" rid="ref41">41</xref>). When making the &#x2018;theory choice&#x2019; decision, a number of concerns in relation to prior conceptualizations of three of the fundamental elements: <italic>ontology</italic>, the perception of being subjective or objective in the real world; <italic>epistemology</italic>, the realm of understanding from reflections; and <italic>axiology</italic>, the researchers&#x2019; persona of opinions and beliefs became evident (<xref ref-type="bibr" rid="ref19">19</xref>).</p>
<p>Pragmatism&#x2019;s inherent focus was on the experience and action of the research question thus prompting us to look for multiple perspectives in developing MEeP framework (<xref ref-type="bibr" rid="ref12">12</xref>, <xref ref-type="bibr" rid="ref13">13</xref>). Thus, revealing distinctions between how different stakeholders (medical staff and students) and published literature enact evaluations regarding e-professionalism. Likewise, the processing of data collection and results analysis revealed the peculiar differences and diversity of views between the different stake holders. Respecting the diversity of understandings, validation of the MEeP framework by panel of experts&#x2019; relevant and relatable facets of our research were highlighted and endorsed (<xref ref-type="bibr" rid="ref14">14</xref>). Building in scope to evaluate the MEep framework by introducing it to those whose professional behaviour had not been consolidated. Using Kirkpatrick&#x2019;s model with a sound theoretical underpinning of Theory of Planned Behaviour (TPB) we measured behavioural changes of digital natives (<xref ref-type="bibr" rid="ref15">15</xref>). Pragmatism framed the appropriate methodology by unpacking the different aspects of this phased research questions at the design stage (<xref rid="tab3" ref-type="table">Table 3</xref>).</p>
<table-wrap position="float" id="tab3">
<label>Table 3</label>
<caption>
<p>Relationship of pragmatic paradigm elements to phased research questions.</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left" valign="top">Research questions</th>
<th align="left" valign="top">Ontology</th>
<th align="left" valign="top">Epistemology</th>
<th align="left" valign="top">Axiology</th>
<th align="left" valign="top">Study</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top" colspan="5">Phase I &#x2013; Framework development &#x2013; To develop a Medical Education e-Professionalism (MEeP) framework which can describe healthcare professionals&#x2019; expected conduct using SNSs. To develop a framework for healthcare professionals coping with the challenges of medical professionalism in the digital realm.</td>
</tr>
<tr>
<td align="left" valign="top">What is there in the published literature related to suggested e-professionalism?</td>
<td align="left" valign="top">Knowledge &#x2013; existing social phenomena. Idealism was applied</td>
<td align="left" valign="top">Qualitative literature review &#x2013; Interpretative approach</td>
<td align="left" valign="top">Value &#x2013; laden</td>
<td align="left" valign="top">Study 1</td>
</tr>
<tr>
<td align="left" valign="top">What is the degree, nature (social or educational) and professional use of SNS?</td>
<td align="left" valign="top">Knowledge &#x2013; existing social phenomena. Idealism was applied</td>
<td align="left" valign="top">Reality &#x2013; a result of the human mind, data from stakeholders&#x2019; opinion &#x2013; interpretivist approach</td>
<td align="left" valign="top">Value &#x2013; laden</td>
<td align="left" valign="top" rowspan="2">Study 2</td>
</tr>
<tr>
<td align="left" valign="top">What are the desired values and behaviours of digital professionalism that are needed for maintaining digital professional identity?</td>
<td align="left" valign="top">Knowledge &#x2013; outside the social phenomena. Realism applied</td>
<td align="left" valign="top">Experts&#x2019; opinions &#x2013; Pragmatist&#x2019;s approach</td>
<td align="left" valign="top">Value &#x2013; free</td>
</tr>
<tr>
<td align="left" valign="top" colspan="5">Phase II &#x2013; Framework validation &#x2013; To perform Content Validity Indexes (CVIs), Face Validity Index (FVI), and inter-rater reliability of the MEeP framework</td>
</tr>
<tr>
<td align="left" valign="top">Does the MEeP framework has sufficient content, face and response process validity?</td>
<td align="left" valign="top">Knowledge &#x2013; outside and inside the social phenomena. Realism applied</td>
<td align="left" valign="top">Experts&#x2019; opinions: rating scales and free text comments &#x2013; Postpositivist approach dominated</td>
<td align="left" valign="top">Value &#x2013; free but the content analysis f free text comments value laden</td>
<td align="left" valign="top">Study 3</td>
</tr>
<tr>
<td align="left" valign="top" colspan="5">Phase III &#x2013; Framework evaluation &#x2013; To determine educational impact of the MEeP framework among medical students</td>
</tr>
<tr>
<td align="left" valign="top">How does the MEeP framework impact the reaction, learning and behaviour of learners?</td>
<td align="left" valign="top">Knowledge &#x2013; outside and inside the social phenomena. Realism applied.</td>
<td align="left" valign="top">Reality &#x2013; a result of the human mind, data from stakeholders&#x2019; opinion using TPB &#x2013; Interpretivist approach. But digital natives&#x2019; perceptions and opinions &#x2013; Pragmatist&#x2019;s approach dominated</td>
<td align="left" valign="top">Value &#x2013; laden with surveys and deductive-inductive thematic analysis</td>
<td align="left" valign="top">Study 4</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="sec9">
<title>Sampling strategy</title>
<p>In our sampling strategy, pragmatism was the key instrument in the selection of the most suitable participants. As narrated earlier, this research aimed to explore the phenomenon of e-professionalism and its impact on the societal contract. Pragmatism guided us into unravelling this abstract concept of e-professionalism as well aiding the development and evaluation of the new MEeP framework. Revisiting the key principle of pragmatism; inquiry as an experiential process we placed an emphasis on actionable research knowledge, by ensuring sampling decisions would be unbiased and adhered to the pragmatism dogma. Our objective was to explore what different attributes were necessary for an individual to be digitally professional and to develop a framework containing those key attributes for other healthcare professionals. Keeping this in mind and using a convenience sampling strategy (<xref ref-type="bibr" rid="ref42">42</xref>), the use of Social Networking Sites (SNSs) by undergraduate medical students was probed (<xref ref-type="bibr" rid="ref13">13</xref>). Convenience or opportunity sampling is often used by researchers as it aids in the selection of a defined population in this case undergraduate medical students (<xref ref-type="bibr" rid="ref43">43</xref>). All registered undergraduate medical students at the Royal College of Surgeons Ireland Bahrain were approached by gatekeeper which also highlighted our axiological stance on this paradigm.</p>
<p>However, the sampling strategy was changed during the Delphi study (<xref ref-type="bibr" rid="ref13">13</xref>) and expert validation (<xref ref-type="bibr" rid="ref14">14</xref>). Pragmatism helped us to develop a more targeted selection of participants to allow for the exposure of a range of perspectives by searching for information rich respondents. Purposive or judgment sampling; is a technique known for the deliberate freedom of choice in selecting participants with peculiar characteristics (<xref ref-type="bibr" rid="ref44">44</xref>). This sampling technique offers a targeted selection of participants aimed to establish macro&#x2013;micro linkages by juxtaposing a diversity of perspectives. Patton (<xref ref-type="bibr" rid="ref45">45</xref>) described these individuals as having a &#x2018;<italic>personal factor</italic>&#x2019; called as &#x201C;<italic>a caring trait about the evaluation and findings it generates</italic>.&#x201D; These individuals included academics, clinicians, executives (deans and vice deans) and professionalism subject experts spanning from various generational archetypes. The evaluation of MEeP framework however utilized a convenience sampling strategy (<xref ref-type="bibr" rid="ref15">15</xref>). Adhering to pragmatism principles aided the mapping, triangulation and sequencing of different steps used to answer our research question.</p>
</sec>
<sec id="sec10">
<title>Data collection</title>
<p>In the choice of methods of data collection, the pragmatic approach gave us the power to exercise researchers&#x2019; subjectivity during the observation process with a very small role for pre-defined theoretical classifications of resultant outcome interpretations, a possible limitation of our research. Focusing on the purpose of research; considering social, historical, and different constructs of professionalism, we integrated multiple realities and verified the assumptions by numerical calculations to create meaningful concepts (<xref ref-type="bibr" rid="ref46">46</xref>). As Creswell (<xref ref-type="bibr" rid="ref47">47</xref>) rightly argued pragmatism tackles problem-centred, pluralistic, real-world practice-orientated phenomenon which highlight the consequences of actions. Using the four key elements of the &#x2018;pragmatism&#x2019; continuum (<xref rid="tab1" ref-type="table">Table 1</xref>) developed by Creswell (<xref ref-type="bibr" rid="ref38">38</xref>), we organized the research methods using both quantitative and qualitative approaches with inductive and deductive considerations using epistemological relativism (<xref ref-type="bibr" rid="ref38">38</xref>).</p>
</sec>
<sec id="sec11">
<title>Mixed-methods approach</title>
<p>We adopted a mixed-methods approach based on our epistemological relativism and the complexity of e-professionalism. The mixed-methods design belongs to a specific set of methods combining enumeration and description and thus creating a synergistic model of understanding and knowledge creation (<xref ref-type="bibr" rid="ref38">38</xref>, <xref ref-type="bibr" rid="ref48">48</xref>). The value of mixed-methods studies has been progressively recognized within the field of medical education as a means to facilitate researchers who want to examine both breadth and depth of a specific issue or phenomenon (<xref ref-type="bibr" rid="ref48">48</xref>). Using the Johnson et al. (<xref ref-type="bibr" rid="ref49">49</xref>) definition of mixed-methods research, we integrated &#x2018;<italic>theory and practice</italic>&#x2019; by blending numerous frame of references, stances, perspectives, standpoints and views using the optics of qualitative and quantitative research, which complemented both our epistemological position and justified the rationale behind MEeP framework journey (<xref ref-type="bibr" rid="ref50">50</xref>). The choice of mixed-methods approach was warranted for several reasons, two of which had resonated with us. First, the results from our first study (<xref ref-type="bibr" rid="ref12">12</xref>) were used to inform and guide the method for the subsequent study. Although there is a plethora of research on the constructs and framework development of medical professionalism, very few studies have reported on e-professionalism and constructs needed to professionally navigate the digital world (<xref ref-type="bibr" rid="ref12">12</xref>). A great number of the studies probed the opinions and perspectives of the participants regarding professionalism in the digital world. Some studies investigated desired online activities, professional online presence, and an understanding into the guidelines on professional use of digital media. Numerous examples from the literature indicated the erosion of professional integrity while in the digital world and have signalled blurred boundaries between professional and unprofessional lives (<xref ref-type="bibr" rid="ref51 ref52 ref53 ref54 ref55">51&#x2013;55</xref>). Despite the extensive epistemological description, the existing body of literature lacked both the realistic and idealistic ontological perspectives. In this context, our two studies made a unique contribution to the field of e-professionalism (<xref ref-type="bibr" rid="ref12">12</xref>, <xref ref-type="bibr" rid="ref13">13</xref>). Second, based on the notion of complementarity, whereby a method was chosen to enhance, expand or clarify existing results using a different strategy (<xref ref-type="bibr" rid="ref56">56</xref>), we used both quantitative and qualitative approaches synchronously to identify and highlight the utility of the MEeP framework and verify these findings from numerical and subjective positions.</p>
<p>Quantitative research does not tend to follow &#x2018;traditions&#x2019; explicitly as clinical researchers consider case series, cross-sectional and case-control and randomized controlled designs as quantitative, while social scientists consider experiments and surveys as quantitative research (<xref ref-type="bibr" rid="ref47">47</xref>, <xref ref-type="bibr" rid="ref57">57</xref>). Relying heavily on reductionism, quantitative methods categorize human dilemmas and experiences into numerical values. While qualitative approach using the psychodynamic lens views human dilemmas as too complex to reduce into numbers or categories (<xref ref-type="bibr" rid="ref58">58</xref>). This approach explores the uncertainty especially of &#x2018;immature&#x2019; concepts, complex human intentions and motivations using &#x2018;case-oriented&#x2019; research (<xref ref-type="bibr" rid="ref59 ref60 ref61">59&#x2013;61</xref>). Creswell (<xref ref-type="bibr" rid="ref47">47</xref>, <xref ref-type="bibr" rid="ref62">62</xref>) outlined five main qualitative traditions of narrative, phenomenology, grounded theory, ethnography, and case studies. To add further confusion, in the field of health research, another set of qualitative subdivisions have been made using the terms field-, action-, or library-based approaches. This dichotomy has led to an unhelpful polarizing of epistemologies between those considered positivists (biomedical orientation) on one side and those considered interpretivism (humanist orientation) on the other. This zealous divide between quantitative and qualitative approaches described by Bergsj&#x00F8; as a &#x2018;<italic>phony war</italic>&#x2019; dates back to the 1800s when extreme polarisation of positivism vs. interpretivism paradigms ensued (<xref ref-type="bibr" rid="ref63">63</xref>). In our research, we explored both literature and ground realities around the topic of e-professionalism, erosion of professionalism in the digital world and the reasons why digital natives are not successful in safeguarding this vital construct.</p>
<p>During this exercise, we combined quantitative and qualitative research techniques and methodological approaches and merging concepts into a single research strategy with an idea of complementarity, timing, point of integration, typological and interactive perspectives (<xref ref-type="bibr" rid="ref64">64</xref>, <xref ref-type="bibr" rid="ref65">65</xref>). In a research program, mixing of methods can span across studies however the strategy of mixing should be explained with firm justifications regarding sequential order. Qualitative and quantitative studies can be undertaken concurrently with the qualitative first, or quantitative first, or convergently when the qualitative and quantitative parts are conducted at the same phase of the research study (<xref ref-type="bibr" rid="ref66">66</xref>, <xref ref-type="bibr" rid="ref67">67</xref>). Priority (equal, or either method prioritised), and the rationale regarding nature and timing of integration (full or partial, during data collection, analysis, or interpretation) (<xref ref-type="bibr" rid="ref61">61</xref>, <xref ref-type="bibr" rid="ref68">68</xref>, <xref ref-type="bibr" rid="ref69">69</xref>). Keeping in view the different paradigmatic origins of qualitative and quantitative methods, caution must be used when conducting mixed-methods by avoiding a sharp dichotomy between their values and methods.</p>
<p>Developing the MEeP framework with a mixed-methods design involved the use of both qualitative and quantitative methods to explore the phenomena of e-professionalism in the context of digital natives&#x2019; degree, extent, and nature of the use of Social Networking Sites and experts&#x2019; opinions about the desired attributes in value, behaviour and identity constructs (<xref ref-type="bibr" rid="ref13">13</xref>). This mixed-methods approach had similarities with the methodology used by some early research on conventional professionalism (<xref ref-type="bibr" rid="ref70 ref71 ref72 ref73 ref74">70&#x2013;74</xref>). However, a seminal work on e-professionalism by Ellaway (<xref ref-type="bibr" rid="ref75">75</xref>) relied heavily on the review of existing literature. The use of both methods in our study design enabled us to generate new inductive knowledge, quantify and describe the phenomena of interest and generate new insights and hypotheses. This was not a linear process, rather findings from each study typically influenced and informed the idea and design of more than one subsequent studies. Furthermore, the point of integration for different studies varied as described by other researchers. In order to achieve a successful integration of tangible relationships at various levels of methodology, the data analysis and interpretation and research rigor were maintained (<xref ref-type="bibr" rid="ref68">68</xref>, <xref ref-type="bibr" rid="ref76">76</xref>, <xref ref-type="bibr" rid="ref77">77</xref>). By using Tashakkori&#x2019;s (<xref ref-type="bibr" rid="ref38">38</xref>) approach, data was collected, analysed, results integrated, and conclusions were made using both quantitative and qualitative approaches in all three phases of our research (<xref rid="fig1" ref-type="fig">Figure 1</xref>).</p>
<fig position="float" id="fig1">
<label>Figure 1</label>
<caption>
<p>A visual illustration of the mixed-methods approach used in this phased research.</p>
</caption>
<graphic xlink:href="fmed-10-1230620-g001.tif"/>
</fig>
<p>As shown in <xref rid="tab4" ref-type="table">Table 4</xref>, the pragmatic approach was contextual and application oriented. These reflections on the current challenges in medical education through a pragmatism lens provided us with an inclusive methodology leading to the production of a comprehensive and elaborative set of solutions to the research question.</p>
<table-wrap position="float" id="tab4">
<label>Table 4</label>
<caption>
<p>Components of pragmatic research and their key features using illustrative examples from the MEeP framework journey.</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left" valign="top">Pragmatic component</th>
<th align="center" valign="top">Key features</th>
<th align="center" valign="top">Purpose</th>
<th align="center" valign="top">Illustrative example from the MEeP journey</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top">Approach</td>
<td align="left" valign="top">Focus on application, context and usefulness</td>
<td align="left" valign="top">To address specific questions and practical needs</td>
<td align="left" valign="top">To understand attitudes, values, beliefs, modes of thought, and behaviour of medical students in digital context (<xref ref-type="bibr" rid="ref12">12</xref>, <xref ref-type="bibr" rid="ref13">13</xref>)</td>
</tr>
<tr>
<td align="left" valign="top">Models and frameworks</td>
<td align="left" valign="top">Focus on key issues for success, important to policy makers and stakeholders</td>
<td align="left" valign="top">Without overly complex theoretical underpinnings keeping contextual relationship in mind</td>
<td align="left" valign="top">The ultimate impact on various levels, while reconciling eclectic views on how e-professionalism is understood, discovered, learned, valued, justified, and verified (<xref ref-type="bibr" rid="ref13">13</xref>)</td>
</tr>
<tr>
<td align="left" valign="top">Designs</td>
<td align="left" valign="top">Focus on resources, context, replication and applicability of results</td>
<td align="left" valign="top">Address issues prevalent in multiple heterogeneous settings in real world with a rigor and relevance having few exclusion criteria</td>
<td align="left" valign="top">Development (e-Delphi) and validation (experts in an online manner) and evaluation (<xref ref-type="bibr" rid="ref13">13</xref>, <xref ref-type="bibr" rid="ref14">14</xref>)</td>
</tr>
<tr>
<td align="left" valign="top">Measures</td>
<td align="left" valign="top">Reliable, valid, feasible, relevant, actionable, brief, broadly applicable, user-friendly and sensitive to change</td>
<td align="left" valign="top">Feasible and actionable in real world settings</td>
<td align="left" valign="top">Detailed and reproducible methodology, validated questionnaires, inductive-deductive-abductive approach to results interpretation (<xref ref-type="bibr" rid="ref13 ref14 ref15">13&#x2013;15</xref>)</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="sec12">
<title>Reflexivity</title>
<p>Reflexivity is defined as a continuous reflective process by the researcher to critically analyse attitudes, values beliefs and behaviours that can affect the interpretation of the study outcomes (<xref ref-type="bibr" rid="ref78">78</xref>). Mixed-methods research goes beyond merely mixing quantitative and qualitative approaches while collecting and analysing data to maintain rigor and relevance, it also demands the researcher&#x2019;s reflexivity. Throughout our research, pragmatism nudged the researchers to adopt a reflexive stance during all stages of data collection. The role of reflexivity is essential in the research process to create a nuanced and context-specific understanding of the e-professionalism concept (<xref ref-type="bibr" rid="ref79">79</xref>). During the systemic review (<xref ref-type="bibr" rid="ref12">12</xref>) the need to develop a link between published literature, quantitative (SNSME) and qualitative (Delphi) (<xref ref-type="bibr" rid="ref13">13</xref>) became clear in bringing new dimensions to the MEeP framework constructs. During the Delphi, reflexivity was undertaken through the circulation of plain language questions and later the interpretation of text generated codes, descriptors, and themes. These were fed back to the respondents to refine and endorse in an iterative manner. During the validation of the MEeP framework (<xref ref-type="bibr" rid="ref14">14</xref>) a real-time online validation process using both rating scales and free text comments was another way to improve reflexivity. Pragmatist inquiry embedding the ethical considerations enabled us to adopt, adapt and involve respondents with different levels of knowledge and experience. The evaluation of the MEeP framework (<xref ref-type="bibr" rid="ref15">15</xref>) was carried out by adhering to the &#x2018;<italic>moral responsibility</italic>&#x2019; principle of pragmatism, we presented the knowledge which has a promising future application in the field of medical education. Keeping the integral element of researcher&#x2019;s subjectivity as part of pragmatism, ambiguities were avoided in data analysis by evaluating the MEeP framework against Kirkpatrick&#x2019;s model using Theory of Planned Behaviour (TPB) (<xref ref-type="bibr" rid="ref80">80</xref>).</p>
</sec>
<sec id="sec13">
<title>Analysis, dissemination, and conclusions</title>
<p>In our work, pragmatism was a guiding force influencing the approaches and techniques while analysing data and drawing conclusions. Using the &#x2018;meta-interface&#x2019; approach where purposeful consideration was given to the evidence obtained about the phenomenon of interest using qualitative and quantitative types of data (<xref ref-type="bibr" rid="ref46">46</xref>). This unique approach identified contradictory and confirmatory elements of evidence and led to a revised understanding of e-professionalism. While developing the MEeP framework (<xref ref-type="bibr" rid="ref13">13</xref>), we focused on the principle of actionable knowledge and avoided theoretical restrictions by using an iterative and pragmatic approach for data analysis (<xref ref-type="bibr" rid="ref81">81</xref>). Rather theoretical underpinnings were used in an exploratory manner to interpret our findings. We integrated the three legacies of category-centred, case-centred and narrative qualitative methods by performing deductive as well as deductive reasoning (<xref ref-type="bibr" rid="ref82">82</xref>, <xref ref-type="bibr" rid="ref83">83</xref>). This data analysis was based on useful knowledge as posed by the respondents, enabled us to connect pre-existing values, behaviour and identity-based constructs into one framework. While evaluating the MEeP framework (<xref ref-type="bibr" rid="ref15">15</xref>), qualitative methods enabled deductive and inductive explorations of complex human phenomena with an emphasis on the theoretical underpinnings of TPB and MEeP framework constructs. Quantitative methods (TPB survey) complemented such explorations by enabling the testing of hypotheses arising from qualitative research.</p>
<p>Mixed-methods research can be framed in the context of multiple paradigms like; pragmatic, transformative, post-positivist, and constructivist (<xref ref-type="bibr" rid="ref1">1</xref>). However, our choice of pragmatic paradigm helped us unpack the dynamic, iterative analytical process by bringing the interconnectedness between experience, knowing, and acting throughout the analysis and write-up phases. Interconnectedness was prominent by keeping the Delphi respondents in the loop and adhering to a prompt timeline of analysis and timely feedback of the findings in various rounds. Keeping the flexibility and adaptability in focus and using an iterative inquiry process allowed the fluidity of abductive, inductive, and deductive reasoning supporting the emergent ideas and data. The same principle was applied to other phased studies in early publications (<xref ref-type="bibr" rid="ref12 ref13 ref14 ref15">12&#x2013;15</xref>). This principle had a significant bearing on our dissemination strategy and the utilization of the research findings. Using the pragmatism inherent focus on practice, we probed new ways of knowing and understanding which showed multiple reverberations for the MEeP framework relevance and utility of our research findings. Using this newly developed and validated MEeP framework, we organized a podcast like panel discussion on e-professionalism where the generational perspective (medical student vs. clinical staff) and utility of the MEeP framework was discussed (Panel discussion can be provided on a reasonable request).</p>
</sec>
<sec id="sec14">
<title>Rigor in mixed-methods research</title>
<p>As in any research paradigm, the goal is to enhance rigor by reducing the researcher&#x2019;s bias and improving trustworthiness using a transparent approach. Rigor in research pertains to open critique, explicit, open accessed, and free of bias conclusions drawn from an explicitly stated, transparent and replicable research design (<xref ref-type="bibr" rid="ref84">84</xref>). Rigor is best achieved fulfilling six criteria starting with a clear purpose, adequate preparation, appropriate methods, significant results with an effective presentation and reflective critique (<xref ref-type="bibr" rid="ref85">85</xref>). Thoughtful and deliberated planning helps the researcher to envision the goal by clarifying the research question and identifying the concepts. While methodological rigor refers to the systematic manner of data collection and analysis while theoretical rigor is the evaluation of theoretical underpinnings leading to relevance (<xref ref-type="bibr" rid="ref86">86</xref>, <xref ref-type="bibr" rid="ref87">87</xref>). These steps introduce explicitness within the research process. Lincoln and Guba outlined four criteria for the trustworthiness of research; transferability (detailed contextual information to ascertain the applications results to one&#x2019;s situation), credibility (actual representation of results with supporting evidence), dependability (detailed study process for replication) and conformability (communication to the wider audience without researchers bias) were key parameters used to evaluate qualitative work while validity and reliability were used to assess the quality of quantitative research (<xref ref-type="bibr" rid="ref88">88</xref>).</p>
</sec>
</sec>
<sec sec-type="conclusions" id="sec15">
<title>Conclusion</title>
<p>To summarize, the pragmatic research design was a major strength of the MEeP framework journey. Using a well-defined methodology and conceptual framework to shape the study design, data collection and analysis, we applied triangulation from multiple sources including digital natives and immigrants, surveys, published literatures, experts&#x2019; opinions, and an educational intervention with a pre-post survey. However, the researchers&#x2019; stance may have contributed to social desirability bias due to the sensitive nature of the topics, even though we emphasized the independence of interpretation and the anonymity of data. Finally, publication of this phased research in the form of scholarly published articles in leading and cited international medical education journals speaks volumes towards the pragmatic nature, uniqueness, and novelty of the MEeP framework.</p>
</sec>
<sec sec-type="data-availability" id="sec16">
<title>Data availability statement</title>
<p>The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author.</p>
</sec>
<sec id="sec17">
<title>Author contributions</title>
<p>SSG conceptualized this study idea. She searched, screened, and synthesized the literature, and drafted and revised the manuscript. SSG, DH, MY, and SYG together refined the idea and agreed on the layout and structure of this synthesis. All authors contributed to the article and approved the submitted version.</p>
</sec>
</body>
<back>
<sec sec-type="COI-statement" id="sec18">
<title>Conflict of interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec id="sec100" sec-type="disclaimer">
<title>Publisher&#x2019;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<ref-list>
<title>References</title>
<ref id="ref1"><label>1.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mackenzie</surname> <given-names>N</given-names></name> <name><surname>Knipe</surname> <given-names>S</given-names></name></person-group>. <article-title>Research dilemmas: paradigms, methods and methodology</article-title>. <source>Issues Educ Res</source>. (<year>2006</year>) <volume>16</volume>:<fpage>193</fpage>&#x2013;<lpage>205</lpage>.</citation></ref>
<ref id="ref2"><label>2.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Morgan</surname> <given-names>DL</given-names></name></person-group>. <article-title>Paradigms lost and pragmatism regained: methodological implications of combining qualitative and quantitative methods</article-title>. <source>J Mixed Methods Res</source>. (<year>2007</year>) <volume>1</volume>:<fpage>48</fpage>&#x2013;<lpage>76</lpage>. doi: <pub-id pub-id-type="doi">10.1177/2345678906292462</pub-id></citation></ref>
<ref id="ref3"><label>3.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Denzin</surname> <given-names>NK</given-names></name> <name><surname>Lincoln</surname> <given-names>Y</given-names></name></person-group>. <source>The landscape of qualitative research</source>. <publisher-loc>Thousand Oaks</publisher-loc>: <publisher-name>Theories and Issues Sage Publications</publisher-name> (<year>1998</year>).</citation></ref>
<ref id="ref4"><label>4.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rees</surname> <given-names>CE</given-names></name> <name><surname>Monrouxe</surname> <given-names>LV</given-names></name></person-group>. <article-title>Theory in medical education research: how do we get there?</article-title> <source>Med Educ</source>. (<year>2010</year>) <volume>44</volume>:<fpage>334</fpage>&#x2013;<lpage>9</lpage>. doi: <pub-id pub-id-type="doi">10.1111/j.1365-2923.2009.03615.x</pub-id></citation></ref>
<ref id="ref5"><label>5.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mills</surname> <given-names>J</given-names></name> <name><surname>Bonner</surname> <given-names>A</given-names></name> <name><surname>Francis</surname> <given-names>K</given-names></name></person-group>. <article-title>The development of constructivist grounded theory</article-title>. <source>Int J Qual Methods</source>. (<year>2006</year>) <volume>5</volume>:<fpage>25</fpage>&#x2013;<lpage>35</lpage>. doi: <pub-id pub-id-type="doi">10.1177/160940690600500103</pub-id></citation></ref>
<ref id="ref6"><label>6.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Levers</surname> <given-names>M-JD</given-names></name></person-group>. <article-title>Philosophical paradigms, grounded theory, and perspectives on emergence</article-title>. <source>SAGE Open</source>. (<year>2013</year>) <volume>3</volume>. doi: <pub-id pub-id-type="doi">10.1177/2158244013517243</pub-id></citation></ref>
<ref id="ref7"><label>7.</label><citation citation-type="other"><person-group person-group-type="author"><name><surname>Lincoln</surname> <given-names>YS</given-names></name> <name><surname>Guba</surname> <given-names>EG</given-names></name></person-group>. <source>Naturalistic inquiry</source>. <publisher-loc>Thousand Oaks</publisher-loc>: <publisher-name>Sage</publisher-name> (<year>1985</year>) <fpage>289</fpage>&#x2013;<lpage>31</lpage>.</citation></ref>
<ref id="ref8"><label>8.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Holden</surname> <given-names>MT</given-names></name> <name><surname>Lynch</surname> <given-names>P</given-names></name></person-group>. <article-title>Choosing the appropriate methodology: understanding research philosophy</article-title>. <source>Mark Rev</source>. (<year>2004</year>) <volume>4</volume>:<fpage>397</fpage>&#x2013;<lpage>409</lpage>. doi: <pub-id pub-id-type="doi">10.1362/1469347042772428</pub-id></citation></ref>
<ref id="ref9"><label>9.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Maudsley</surname> <given-names>G</given-names></name></person-group>. <article-title>Mixing it but not mixed-up: mixed methods research in medical education (a critical narrative review)</article-title>. <source>Med Teach</source>. (<year>2011</year>) <volume>33</volume>:<fpage>e92</fpage>&#x2013;<lpage>e104</lpage>. doi: <pub-id pub-id-type="doi">10.3109/0142159X.2011.542523</pub-id></citation></ref>
<ref id="ref10"><label>10.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bunniss</surname> <given-names>S</given-names></name> <name><surname>Kelly</surname> <given-names>DR</given-names></name></person-group>. <article-title>Research paradigms in medical education research</article-title>. <source>Med Educ</source>. (<year>2010</year>) <volume>44</volume>:<fpage>358</fpage>&#x2013;<lpage>66</lpage>. doi: <pub-id pub-id-type="doi">10.1111/j.1365-2923.2009.03611.x</pub-id></citation></ref>
<ref id="ref11"><label>11.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Cresswell</surname> <given-names>JW</given-names></name></person-group>. <source>Qualitative inquiry and research design: Choosing among five traditions</source>. <publisher-loc>Thousand Oaks, CA</publisher-loc>: <publisher-name>Sage</publisher-name> (<year>1998</year>).</citation></ref>
<ref id="ref12"><label>12.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Guraya</surname> <given-names>SS</given-names></name> <name><surname>Guraya</surname> <given-names>SY</given-names></name> <name><surname>Yusoff</surname> <given-names>MSB</given-names></name></person-group>. <article-title>Preserving professional identities, behaviours, and values in digital professionalism using social networking sites; a systematic review</article-title>. <source>BMC Med Educ</source>. (<year>2021</year>) <volume>21</volume>:<fpage>1</fpage>&#x2013;<lpage>12</lpage>. doi: <pub-id pub-id-type="doi">10.1186/s12909-021-02802-9</pub-id></citation></ref>
<ref id="ref13"><label>13.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Guraya</surname> <given-names>SS</given-names></name> <name><surname>Guraya</surname> <given-names>SY</given-names></name> <name><surname>Harkin</surname> <given-names>DW</given-names></name> <name><surname>Ryan</surname> <given-names>&#x00C1;</given-names></name> <name><surname>MZb</surname> <given-names>MN</given-names></name> <name><surname>MSB</surname> <given-names>Y</given-names></name></person-group>. <article-title>Medical Education e-Professionalism (MEeP) framework; from conception to development</article-title>. <source>Med Educ Online</source>. (<year>2021</year>) <volume>26</volume>:<fpage>1983926</fpage>. doi: <pub-id pub-id-type="doi">10.1080/10872981.2021.1983926</pub-id></citation></ref>
<ref id="ref14"><label>14.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Guraya</surname> <given-names>SS</given-names></name> <name><surname>Yusoff</surname> <given-names>MSB</given-names></name> <name><surname>Nor</surname> <given-names>MZM</given-names></name> <name><surname>Fredericks</surname> <given-names>S</given-names></name> <name><surname>Rashid-Doubell</surname> <given-names>F</given-names></name> <name><surname>Harkin</surname> <given-names>DW</given-names></name> <etal/></person-group>. <article-title>Validating the Medical Education e-Professionalism framework using the content validity index</article-title>. <source>Educ Med J</source>. (<year>2022</year>) <volume>14</volume>:<fpage>31</fpage>&#x2013;<lpage>47</lpage>. doi: <pub-id pub-id-type="doi">10.21315/eimj2022.14.3.3</pub-id></citation></ref>
<ref id="ref15"><label>15.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Guraya</surname> <given-names>SS</given-names></name> <name><surname>Yusoff</surname> <given-names>MSB</given-names></name> <name><surname>Rashid-Doubell</surname> <given-names>F</given-names></name> <name><surname>Harkin</surname> <given-names>DW</given-names></name> <name><surname>Al-Amad</surname> <given-names>SH</given-names></name> <name><surname>Fredericks</surname> <given-names>S</given-names></name> <etal/></person-group>. <article-title>Changing professional behaviours in the digital world using the Medical Education e-Professionalism (MEeP) framework &#x2013; a mixed methods multicentre study</article-title>. <source>Front Med</source>. (<year>2022</year>) <volume>9</volume>:<fpage>795</fpage>. doi: <pub-id pub-id-type="doi">10.3389/fmed.2022.846971</pub-id></citation></ref>
<ref id="ref16"><label>16.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>McKinley</surname> <given-names>RK</given-names></name></person-group>. <article-title>Qualitative and quantitative: the yin and the yang or the light and the dark sides of medical education?</article-title> <source>Persp Med Educ</source>. (<year>2015</year>) <volume>4</volume>:<fpage>1</fpage>&#x2013;<lpage>3</lpage>. doi: <pub-id pub-id-type="doi">10.1007/S40037-015-0162-3</pub-id>, PMID: <pub-id pub-id-type="pmid">25623832</pub-id></citation></ref>
<ref id="ref17"><label>17.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Schwandt</surname> <given-names>TA</given-names></name></person-group>. <source>Qualitative inquiry: A dictionary of terms</source>. <publisher-loc>Thousand Oaks</publisher-loc>: <publisher-name>Sage publications, Inc.</publisher-name> (<year>1997</year>).</citation></ref>
<ref id="ref18"><label>18.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Crotty</surname> <given-names>MJ</given-names></name></person-group>. <article-title>The foundations of social research: meaning and perspective in the research process</article-title>. <source>Found Soc Res</source>. (<year>1998</year>):<fpage>1</fpage>&#x2013;<lpage>256</lpage>. doi: <pub-id pub-id-type="doi">10.4324/9781003115700-1</pub-id></citation></ref>
<ref id="ref19"><label>19.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Burrell</surname> <given-names>G</given-names></name> <name><surname>Morgan</surname> <given-names>G</given-names></name></person-group>. <source>Sociological paradigms and organisational analysis: elements of the sociology of corporate life</source>. <publisher-name>Routledge</publisher-name> (<year>2019</year>).</citation></ref>
<ref id="ref20"><label>20.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Alharahsheh</surname> <given-names>HH</given-names></name> <name><surname>Pius</surname> <given-names>A</given-names></name></person-group>. <article-title>A review of key paradigms: positivism VS interpretivism</article-title>. <source>Global Acad J Human Soc Sci</source>. (<year>2020</year>) <volume>2</volume>:<fpage>39</fpage>&#x2013;<lpage>43</lpage>. doi: <pub-id pub-id-type="doi">10.36348/gajhss.2020.v02i03.001</pub-id></citation></ref>
<ref id="ref21"><label>21.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lin</surname> <given-names>AC</given-names></name></person-group>. <article-title>Bridging positivist and interpretivist approaches to qualitative methods</article-title>. <source>Policy Stud J</source>. (<year>1998</year>) <volume>26</volume>:<fpage>162</fpage>&#x2013;<lpage>80</lpage>. doi: <pub-id pub-id-type="doi">10.1111/j.1541-0072.1998.tb01931.x</pub-id></citation></ref>
<ref id="ref22"><label>22.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Slavin</surname> <given-names>RE</given-names></name></person-group>. <article-title>Meta-analysis in education: how has it been used?</article-title> <source>Educ Res</source>. (<year>1984</year>) <volume>13</volume>:<fpage>6</fpage>&#x2013;<lpage>15</lpage>. doi: <pub-id pub-id-type="doi">10.3102/0013189X013008006</pub-id></citation></ref>
<ref id="ref23"><label>23.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Saunders</surname> <given-names>M</given-names></name> <name><surname>Lewis</surname> <given-names>P</given-names></name> <name><surname>Thornhill</surname> <given-names>A</given-names></name></person-group>. <source>Research methods forbusiness students</source>. <publisher-loc>Pearson education</publisher-loc> (<year>2009</year>).</citation></ref>
<ref id="ref24"><label>24.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rehman</surname> <given-names>AA</given-names></name> <name><surname>Alharthi</surname> <given-names>K</given-names></name></person-group>. <article-title>An introduction to research paradigms</article-title>. <source>Int J Educ Invest</source>. (<year>2016</year>) <volume>3</volume>:<fpage>51</fpage>&#x2013;<lpage>9</lpage>.</citation></ref>
<ref id="ref25"><label>25.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bogdan</surname> <given-names>K</given-names></name> <name><surname>McNaught</surname> <given-names>D</given-names></name></person-group>. <article-title>Selective feeding by Diaptomus and Daphnia: with 4 figures and 3 tables in the text</article-title>. <source>Internationale Vereinigung f&#x00FC;r theoretische und angewandte Limnologie: Verhandlungen</source>. (<year>1975</year>) <volume>19</volume>:<fpage>2935</fpage>&#x2013;<lpage>42</lpage>. doi: <pub-id pub-id-type="doi">10.1080/03680770.1974.11896397</pub-id></citation></ref>
<ref id="ref26"><label>26.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Langdridge</surname> <given-names>D</given-names></name></person-group>. <article-title>Phenomenology and critical social psychology: directions and debates in theory and research</article-title>. <source>Soc Personal Psychol Compass</source>. (<year>2008</year>) <volume>2</volume>:<fpage>1126</fpage>&#x2013;<lpage>42</lpage>. doi: <pub-id pub-id-type="doi">10.1111/j.1751-9004.2008.00114.x</pub-id></citation></ref>
<ref id="ref27"><label>27.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Finnis</surname> <given-names>J</given-names></name></person-group>. <source>Natural law and natural rights</source>. <publisher-loc>Oxford</publisher-loc>: <publisher-name>Clarendon Press</publisher-name> (<year>1980</year>).</citation></ref>
<ref id="ref28"><label>28.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>West</surname> <given-names>HR</given-names></name></person-group>. <source>An introduction to Mill&#x2019;s utilitarian ethics</source>. <publisher-loc>New York, NY, USA</publisher-loc>: <publisher-name>Cambridge University Press</publisher-name> (<year>2004</year>).</citation></ref>
<ref id="ref29"><label>29.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Slote</surname> <given-names>M</given-names></name></person-group>. <article-title>Utilitarianism, moral dilemmas, and moral cost</article-title>. <source>Am Philos Q</source>. (<year>1985</year>) <volume>22</volume>:<fpage>161</fpage>&#x2013;<lpage>8</lpage>.</citation></ref>
<ref id="ref30"><label>30.</label><citation citation-type="other"><person-group person-group-type="author"><name><surname>Tashakkori</surname> <given-names>A</given-names></name> <name><surname>Teddlie</surname> <given-names>C</given-names></name> <name><surname>Teddlie</surname> <given-names>CB</given-names></name></person-group>. <source>Mixed methodology: combining qualitative and quantitative approaches</source>. <publisher-loc>Applied Social Research Methods Series. Thousand Oaks</publisher-loc>: <publisher-name>Sage Publications</publisher-name> (<year>1998</year>).</citation></ref>
<ref id="ref31"><label>31.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Candy</surname> <given-names>PC</given-names></name></person-group>. <article-title>Constructivism and the study of self-direction in adult learning</article-title>. <source>Stud Educ Adults</source>. (<year>1989</year>) <volume>21</volume>:<fpage>95</fpage>&#x2013;<lpage>116</lpage>. doi: <pub-id pub-id-type="doi">10.1080/02660830.1989.11730524</pub-id></citation></ref>
<ref id="ref32"><label>32.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Brendel</surname> <given-names>DH</given-names></name></person-group>. <article-title>Beyond Engel: clinical pragmatism as the foundation of psychiatric practice</article-title>. <source>Phil Psych Psychol</source>. (<year>2007</year>) <volume>14</volume>:<fpage>311</fpage>&#x2013;<lpage>3</lpage>. doi: <pub-id pub-id-type="doi">10.1353/ppp.0.0145</pub-id></citation></ref>
<ref id="ref33"><label>33.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Dewey</surname> <given-names>J</given-names></name></person-group>. <article-title>The essential Dewey: pragmatism, education, democracy Indiana University Press</article-title>. In: <person-group person-group-type="editor"><name><surname>Hickman</surname> <given-names>L.</given-names></name> <name><surname>Alexander</surname> <given-names>T. M.</given-names></name></person-group> editors. Ethics, logic, psychology. Vol.2. Bloomington, IN: Indiana University Press (<year>1998</year>).</citation></ref>
<ref id="ref34"><label>34.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Tashakkori</surname> <given-names>A</given-names></name> <name><surname>Teddlie</surname> <given-names>C</given-names></name></person-group>. <source>Putting the human back in &#x201C;human research methodology&#x201D;: the researcher in mixed methods research</source>. <publisher-name>Sage Publications Sage CA</publisher-name>: <publisher-loc>Los Angeles, CA</publisher-loc>; (<year>2010</year>). <fpage>271</fpage>&#x2013;<lpage>277</lpage>, <volume>4.</volume></citation></ref>
<ref id="ref35"><label>35.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Patton</surname> <given-names>MQ</given-names></name></person-group>. <source>Qualitative evaluation and research methods</source>. 2nd edn. <publisher-loc>Newbury Park, CA</publisher-loc>: <publisher-name>SAGE Publications, Inc.</publisher-name> (<year>1990</year>).</citation></ref>
<ref id="ref36"><label>36.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tashakkori</surname> <given-names>A</given-names></name> <name><surname>Teddlie</surname> <given-names>C</given-names></name></person-group>. <article-title>Issues and dilemmas in teaching research methods courses in social and behavioural sciences: US perspective</article-title>. <source>Int J Soc Res Methodol</source>. (<year>2003</year>) <volume>6</volume>:<fpage>61</fpage>&#x2013;<lpage>77</lpage>. doi: <pub-id pub-id-type="doi">10.1080/13645570305055</pub-id></citation></ref>
<ref id="ref37"><label>37.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Tashakkori</surname> <given-names>A.</given-names></name></person-group> <source>Are we there yet? The state of the mixed methods community</source>. <publisher-name>Sage Publications Sage CA</publisher-name>: <publisher-loc>Los Angeles, CA</publisher-loc>; (<year>2009</year>). <fpage>287</fpage>&#x2013;<lpage>291</lpage>, <volume>3.</volume></citation></ref>
<ref id="ref38"><label>38.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Tashakkori</surname> <given-names>A</given-names></name> <name><surname>Creswell</surname> <given-names>JW</given-names></name></person-group>. <article-title>The new era of mixed methods</article-title>. <source>J. Mix. Methods Res</source>. <publisher-name>Sage Publications</publisher-name>; (<year>2007</year>). <volume>7</volume>:<fpage>3</fpage>&#x2013;<lpage>7</lpage>.</citation></ref>
<ref id="ref39"><label>39.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bergman</surname> <given-names>MM</given-names></name></person-group>. <article-title>On concepts and paradigms in mixed methods research</article-title>. <source>J Mixed Methods Res</source>. (<year>2010</year>) <volume>4</volume>:<fpage>171</fpage>&#x2013;<lpage>5</lpage>. doi: <pub-id pub-id-type="doi">10.1177/1558689810376950</pub-id></citation></ref>
<ref id="ref40"><label>40.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>O&#x2019;Cathain</surname> <given-names>A</given-names></name> <name><surname>Murphy</surname> <given-names>E</given-names></name> <name><surname>Nicholl</surname> <given-names>J</given-names></name></person-group>. <article-title>Why, and how, mixed methods research is undertaken in health services research in England: a mixed methods study</article-title>. <source>BMC Health Serv Res</source>. (<year>2007</year>) <volume>7</volume>:<fpage>1</fpage>&#x2013;<lpage>11</lpage>. doi: <pub-id pub-id-type="doi">10.1186/1472-6963-7-85</pub-id></citation></ref>
<ref id="ref41"><label>41.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bilau</surname> <given-names>AA</given-names></name> <name><surname>Witt</surname> <given-names>E</given-names></name> <name><surname>Lill</surname> <given-names>I</given-names></name></person-group>. <article-title>Research methodology for the development of a framework for managing post-disaster housing reconstruction</article-title>. <source>Proc Eng</source>. (<year>2018</year>) <volume>212</volume>:<fpage>598</fpage>&#x2013;<lpage>605</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.proeng.2018.01.077</pub-id></citation></ref>
<ref id="ref42"><label>42.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Stratton</surname> <given-names>SJ</given-names></name></person-group>. <article-title>Population research: convenience sampling strategies</article-title>. <source>Prehosp Disaster Med</source>. (<year>2021</year>) <volume>36</volume>:<fpage>373</fpage>&#x2013;<lpage>4</lpage>. doi: <pub-id pub-id-type="doi">10.1017/S1049023X21000649</pub-id></citation></ref>
<ref id="ref43"><label>43.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Farrokhi</surname> <given-names>F</given-names></name> <name><surname>Mahmoudi-Hamidabad</surname> <given-names>A</given-names></name></person-group>. <article-title>Rethinking convenience sampling: defining quality criteria</article-title>. <source>Theory Prac Lang Stud</source>. (<year>2012</year>) <volume>2</volume>:<fpage>792</fpage>. doi: <pub-id pub-id-type="doi">10.4304/tpls.2.4.784-792</pub-id></citation></ref>
<ref id="ref44"><label>44.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Etikan</surname> <given-names>I</given-names></name> <name><surname>Musa</surname> <given-names>SA</given-names></name> <name><surname>Alkassim</surname> <given-names>RS</given-names></name></person-group>. <article-title>Comparison of convenience sampling and purposive sampling</article-title>. <source>Am J Theor Appl Stat</source>. (<year>2016</year>) <volume>5</volume>:<fpage>1</fpage>&#x2013;<lpage>4</lpage>. doi: <pub-id pub-id-type="doi">10.11648/j.ajtas.20160501.11</pub-id></citation></ref>
<ref id="ref45"><label>45.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Patton</surname> <given-names>MQ</given-names></name></person-group>. <article-title>Utilization-focused evaluation The new century text</article-title>. 3rd edn. <publisher-loc>Thousand Oaks, CA</publisher-loc>: <publisher-name>Sage publications</publisher-name> (<year>1997</year>).</citation></ref>
<ref id="ref46"><label>46.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Creswell</surname> <given-names>JW</given-names></name></person-group>. <source>Research design: qualitative, quantitative, and mixed methods approaches</source>. 2nd edn <publisher-loc>Thousand Oaks</publisher-loc>: <publisher-name>Sage publications</publisher-name> (<year>2003</year>).</citation></ref>
<ref id="ref47"><label>47.</label><citation citation-type="other"><person-group person-group-type="author"><name><surname>Creswell</surname> <given-names>JW</given-names></name> <name><surname>Plano Clark</surname> <given-names>VL</given-names></name> <name><surname>Gutmann</surname> <given-names>ML</given-names></name> <name><surname>Hanson</surname> <given-names>WE</given-names></name></person-group>. <article-title>Advanced mixed methods research designs</article-title>. In: <person-group person-group-type="editor"><name><surname>Tashakkori</surname> <given-names>A.</given-names></name><name><surname>Teddlie</surname> <given-names>C.</given-names></name></person-group> editors. <source>Handbook of mixed methods in social and behavioural research</source>. <publisher-loc>Thousand Oaks, CA</publisher-loc>: <publisher-name>Sage</publisher-name> (<year>2003</year>). pp. <fpage>209</fpage>&#x2013;<lpage>40</lpage>.</citation></ref>
<ref id="ref48"><label>48.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Johnson</surname> <given-names>RB</given-names></name> <name><surname>Onwuegbuzie</surname> <given-names>AJ</given-names></name></person-group>. <article-title>Mixed methods research: a research paradigm whose time has come</article-title>. <source>Educ Res</source>. (<year>2004</year>) <volume>33</volume>:<fpage>14</fpage>&#x2013;<lpage>26</lpage>. doi: <pub-id pub-id-type="doi">10.3102/0013189X033007014</pub-id></citation></ref>
<ref id="ref49"><label>49.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Johnson</surname> <given-names>RB</given-names></name> <name><surname>Onwuegbuzie</surname> <given-names>AJ</given-names></name> <name><surname>Turner</surname> <given-names>LA</given-names></name></person-group>. <article-title>Toward a definition of mixed methods research</article-title>. <source>J Mixed Methods Res</source>. (<year>2007</year>) <volume>1</volume>:<fpage>112</fpage>&#x2013;<lpage>33</lpage>. doi: <pub-id pub-id-type="doi">10.1177/1558689806298224</pub-id></citation></ref>
<ref id="ref50"><label>50.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Hesse-Biber</surname> <given-names>SN</given-names></name></person-group>. <source>Mixed methods research: merging theory with practice</source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Guilford Press</publisher-name> (<year>2010</year>).</citation></ref>
<ref id="ref51"><label>51.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Guraya</surname> <given-names>SY</given-names></name> <name><surname>Almaramhy</surname> <given-names>H</given-names></name> <name><surname>Al-Qahtani</surname> <given-names>MF</given-names></name> <name><surname>Guraya</surname> <given-names>SS</given-names></name> <name><surname>Bouhaimed</surname> <given-names>M</given-names></name> <name><surname>Bilal</surname> <given-names>B</given-names></name></person-group>. <article-title>Measuring the extent and nature of use of social networking sites in medical education (SNSME) by university students: results of a multi-center study</article-title>. <source>Med Educ Online</source>. (<year>2018</year>) <volume>23</volume>:<fpage>1505400</fpage>. doi: <pub-id pub-id-type="doi">10.1080/10872981.2018.1505400</pub-id>, PMID: <pub-id pub-id-type="pmid">30081773</pub-id></citation></ref>
<ref id="ref52"><label>52.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Marwick</surname> <given-names>AE</given-names></name> <name><surname>Boyd</surname> <given-names>D</given-names></name></person-group>. <article-title>I tweet honestly, I tweet passionately: twitter users, context collapse, and the imagined audience</article-title>. <source>New Media Soc</source>. (<year>2011</year>) <volume>13</volume>:<fpage>114</fpage>&#x2013;<lpage>33</lpage>. doi: <pub-id pub-id-type="doi">10.1177/1461444810365313</pub-id></citation></ref>
<ref id="ref53"><label>53.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Marcia</surname> <given-names>JE</given-names></name></person-group>. <article-title>Development and validation of ego-identity status</article-title>. <source>J Pers Soc Psychol</source>. (<year>1966</year>) <volume>3</volume>:<fpage>551</fpage>&#x2013;<lpage>8</lpage>. doi: <pub-id pub-id-type="doi">10.1037/h0023281</pub-id>, PMID: <pub-id pub-id-type="pmid">5939604</pub-id></citation></ref>
<ref id="ref54"><label>54.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Van der Zwet</surname> <given-names>J</given-names></name> <name><surname>Zwietering</surname> <given-names>P</given-names></name> <name><surname>Teunissen</surname> <given-names>P</given-names></name> <name><surname>Van der Vleuten</surname> <given-names>C</given-names></name> <name><surname>Scherpbier</surname> <given-names>A</given-names></name></person-group>. <article-title>Workplace learning from a socio-cultural perspective: creating developmental space during the general practice clerkship</article-title>. <source>Adv Health Sci Educ</source>. (<year>2011</year>) <volume>16</volume>:<fpage>359</fpage>&#x2013;<lpage>73</lpage>. doi: <pub-id pub-id-type="doi">10.1007/s10459-010-9268-x</pub-id>, PMID: <pub-id pub-id-type="pmid">21188514</pub-id></citation></ref>
<ref id="ref55"><label>55.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lalibert&#x00E9;</surname> <given-names>M</given-names></name> <name><surname>Beaulieu-Poulin</surname> <given-names>C</given-names></name> <name><surname>Campeau Larriv&#x00E9;e</surname> <given-names>A</given-names></name> <name><surname>Charbonneau</surname> <given-names>M</given-names></name> <name><surname>Samson</surname> <given-names>&#x00C9;</given-names></name> <name><surname>Ehrmann</surname> <given-names>FD</given-names></name></person-group>. <article-title>Current uses (and potential misuses) of Facebook: an online survey in physiotherapy</article-title>. <source>Physiother Can</source>. (<year>2016</year>) <volume>68</volume>:<fpage>5</fpage>&#x2013;<lpage>12</lpage>. doi: <pub-id pub-id-type="doi">10.3138/ptc.2014-41</pub-id>, PMID: <pub-id pub-id-type="pmid">27504042</pub-id></citation></ref>
<ref id="ref56"><label>56.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pope</surname> <given-names>C</given-names></name> <name><surname>Mays</surname> <given-names>N</given-names></name></person-group>. <article-title>Qualitative research: reaching the parts other methods cannot reach: an introduction to qualitative methods in health and health services research</article-title>. <source>BMJ</source>. (<year>1995</year>) <volume>311</volume>:<fpage>42</fpage>&#x2013;<lpage>5</lpage>. doi: <pub-id pub-id-type="doi">10.1136/bmj.311.6996.42</pub-id>, PMID: <pub-id pub-id-type="pmid">7613329</pub-id></citation></ref>
<ref id="ref57"><label>57.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Bhopal</surname> <given-names>RS</given-names></name></person-group>. <source>Concepts of epidemiology: integrating the ideas, theories, principles, and methods of epidemiology</source>. <publisher-name>Oxford University Press</publisher-name> (<year>2016</year>).</citation></ref>
<ref id="ref58"><label>58.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Smith</surname> <given-names>JA</given-names></name></person-group>. <article-title>Reflecting on the development of interpretative phenomenological analysis and its contribution to qualitative research in psychology</article-title>. <source>Qual Res Psychol</source>. (<year>2004</year>) <volume>1</volume>:<fpage>39</fpage>&#x2013;<lpage>54</lpage>. doi: <pub-id pub-id-type="doi">10.1191/1478088704qp004oa</pub-id></citation></ref>
<ref id="ref59"><label>59.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lajoie</surname> <given-names>C</given-names></name> <name><surname>Poleksic</surname> <given-names>J</given-names></name> <name><surname>Bracken-Roche</surname> <given-names>D</given-names></name> <name><surname>Mac Donald</surname> <given-names>ME</given-names></name> <name><surname>Racine</surname> <given-names>E</given-names></name></person-group>. <article-title>The concept of vulnerability in mental health research: a mixed methods study on researcher perspectives</article-title>. <source>J Empir Res Hum Res Ethics</source>. (<year>2020</year>) <volume>15</volume>:<fpage>128</fpage>&#x2013;<lpage>42</lpage>. doi: <pub-id pub-id-type="doi">10.1177/1556264620902657</pub-id>, PMID: <pub-id pub-id-type="pmid">32036715</pub-id></citation></ref>
<ref id="ref60"><label>60.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Laws</surname> <given-names>RA</given-names></name> <name><surname>Kirby</surname> <given-names>SE</given-names></name> <name><surname>Davies</surname> <given-names>GPP</given-names></name> <name><surname>Williams</surname> <given-names>AM</given-names></name> <name><surname>Jayasinghe</surname> <given-names>UW</given-names></name> <name><surname>Amoroso</surname> <given-names>CL</given-names></name> <etal/></person-group>. <article-title>&#x201C;should I and can I?&#x201D;: a mixed methods study of clinician beliefs and attitudes in the management of lifestyle risk factors in primary health care</article-title>. <source>BMC Health Serv Res</source>. (<year>2008</year>) <volume>8</volume>:<fpage>1</fpage>&#x2013;<lpage>10</lpage>. doi: <pub-id pub-id-type="doi">10.1186/1472-6963-8-44</pub-id></citation></ref>
<ref id="ref61"><label>61.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Morse</surname> <given-names>JM</given-names></name></person-group>. <article-title>Approaches to qualitative-quantitative methodological triangulation</article-title>. <source>Nurs Res</source>. (<year>1991</year>) <volume>40</volume>:<fpage>120</fpage>&#x2013;<lpage>3</lpage>. doi: <pub-id pub-id-type="doi">10.1097/00006199-199103000-00014</pub-id>, PMID: <pub-id pub-id-type="pmid">2003072</pub-id></citation></ref>
<ref id="ref62"><label>62.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sweet</surname> <given-names>L</given-names></name></person-group>. <article-title>Telephone interviewing: is it compatible with interpretive phenomenological research?</article-title> <source>Contemp Nurse</source>. (<year>2002</year>) <volume>12</volume>:<fpage>58</fpage>&#x2013;<lpage>63</lpage>. doi: <pub-id pub-id-type="doi">10.5172/conu.12.1.58</pub-id>, PMID: <pub-id pub-id-type="pmid">12013519</pub-id></citation></ref>
<ref id="ref63"><label>63.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bergsj&#x00F8;</surname> <given-names>P</given-names></name></person-group>. <article-title>Qualitative and quantitative research, is there a gap, or only verbal disagreement?</article-title> <source>Acta Obstet Gynecol Scand</source>. (<year>1999</year>) <volume>78</volume>:<fpage>559</fpage>&#x2013;<lpage>62</lpage>. PMID: <pub-id pub-id-type="pmid">10422900</pub-id></citation></ref>
<ref id="ref64"><label>64.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schoonenboom</surname> <given-names>J</given-names></name> <name><surname>Johnson</surname> <given-names>RB</given-names></name></person-group>. <article-title>How to construct a mixed methods research design</article-title>. <source>KZfSS K&#x00F6;lner Zeitschrift f&#x00FC;r Soziologie und Sozialpsychologie</source>. (<year>2017</year>) <volume>69</volume>:<fpage>107</fpage>&#x2013;<lpage>31</lpage>. doi: <pub-id pub-id-type="doi">10.1007/s11577-017-0454-1</pub-id>, PMID: <pub-id pub-id-type="pmid">28989188</pub-id></citation></ref>
<ref id="ref65"><label>65.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schifferdecker</surname> <given-names>KE</given-names></name> <name><surname>Reed</surname> <given-names>VA</given-names></name></person-group>. <article-title>Using mixed methods research in medical education: basic guidelines for researchers</article-title>. <source>Med Educ</source>. (<year>2009</year>) <volume>43</volume>:<fpage>637</fpage>&#x2013;<lpage>44</lpage>. doi: <pub-id pub-id-type="doi">10.1111/j.1365-2923.2009.03386.x</pub-id>, PMID: <pub-id pub-id-type="pmid">19573186</pub-id></citation></ref>
<ref id="ref66"><label>66.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Demir</surname> <given-names>SB</given-names></name> <name><surname>Pismek</surname> <given-names>N</given-names></name></person-group>. <article-title>A convergent parallel mixed-methods study of controversial issues in social studies classes: a clash of ideologies</article-title>. <source>Educ Sci Theory Pract</source>. (<year>2018</year>) <volume>18</volume>:<fpage>119</fpage>&#x2013;<lpage>49</lpage>. doi: <pub-id pub-id-type="doi">10.12738/estp.2018.1.0298</pub-id></citation></ref>
<ref id="ref67"><label>67.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Abutabenjeh</surname> <given-names>S</given-names></name> <name><surname>Jaradat</surname> <given-names>R</given-names></name></person-group>. <article-title>Clarification of research design, research methods, and research methodology: a guide for public administration researchers and practitioners</article-title>. <source>Teach Publ Administr</source>. (<year>2018</year>) <volume>36</volume>:<fpage>237</fpage>&#x2013;<lpage>58</lpage>. doi: <pub-id pub-id-type="doi">10.1177/0144739418775787</pub-id></citation></ref>
<ref id="ref68"><label>68.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Guest</surname> <given-names>G</given-names></name></person-group>. <article-title>Describing mixed methods research: an alternative to typologies</article-title>. <source>J Mixed Methods Res</source>. (<year>2013</year>) <volume>7</volume>:<fpage>141</fpage>&#x2013;<lpage>51</lpage>. doi: <pub-id pub-id-type="doi">10.1177/1558689812461179</pub-id></citation></ref>
<ref id="ref69"><label>69.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Johnson</surname> <given-names>RB</given-names></name> <name><surname>Christensen</surname> <given-names>L</given-names></name></person-group>. <source>Educational research: quantitative, qualitative, and mixed approaches</source>. <publisher-loc>Thousand Oaks</publisher-loc>: <publisher-name>Sage publications</publisher-name> (<year>2014</year>).</citation></ref>
<ref id="ref70"><label>70.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Al-Eraky</surname> <given-names>MM</given-names></name> <name><surname>Donkers</surname> <given-names>J</given-names></name> <name><surname>Wajid</surname> <given-names>G</given-names></name> <name><surname>van Merrienboer</surname> <given-names>JJ</given-names></name></person-group>. <article-title>A Delphi study of medical professionalism in Arabian countries: the four-gates model</article-title>. <source>Med Teach</source>. (<year>2014</year>) <volume>36</volume>:<fpage>S8</fpage>&#x2013;<lpage>S16</lpage>. doi: <pub-id pub-id-type="doi">10.3109/0142159X.2014.886013</pub-id>, PMID: <pub-id pub-id-type="pmid">24617789</pub-id></citation></ref>
<ref id="ref71"><label>71.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Al-Eraky</surname> <given-names>MM</given-names></name> <name><surname>Chandratilake</surname> <given-names>M</given-names></name></person-group>. <article-title>How medical professionalism is conceptualized in Arabian context: a validation study</article-title>. <source>Med Teach</source>. (<year>2012</year>) <volume>34</volume>:<fpage>S90</fpage>&#x2013;<lpage>5</lpage>. doi: <pub-id pub-id-type="doi">10.3109/0142159X.2012.656754</pub-id>, PMID: <pub-id pub-id-type="pmid">22409198</pub-id></citation></ref>
<ref id="ref72"><label>72.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ho</surname> <given-names>M-J</given-names></name> <name><surname>Yu</surname> <given-names>K-H</given-names></name> <name><surname>Hirsh</surname> <given-names>D</given-names></name> <name><surname>Huang</surname> <given-names>T-S</given-names></name> <name><surname>Yang</surname> <given-names>P-C</given-names></name></person-group>. <article-title>Does one size fit all? Building a framework for medical professionalism</article-title>. <source>Acad Med</source>. (<year>2011</year>) <volume>86</volume>:<fpage>1407</fpage>&#x2013;<lpage>14</lpage>. doi: <pub-id pub-id-type="doi">10.1097/ACM.0b013e31823059d1</pub-id>, PMID: <pub-id pub-id-type="pmid">21971298</pub-id></citation></ref>
<ref id="ref73"><label>73.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pan</surname> <given-names>H</given-names></name> <name><surname>Norris</surname> <given-names>JL</given-names></name> <name><surname>Liang</surname> <given-names>Y-S</given-names></name> <name><surname>Li</surname> <given-names>J-N</given-names></name> <name><surname>Ho</surname> <given-names>M-J</given-names></name></person-group>. <article-title>Building a professionalism framework for healthcare providers in China: a nominal group technique study</article-title>. <source>Med Teach</source>. (<year>2013</year>) <volume>35</volume>:<fpage>e1531</fpage>&#x2013;<lpage>6</lpage>. doi: <pub-id pub-id-type="doi">10.3109/0142159X.2013.802299</pub-id>, PMID: <pub-id pub-id-type="pmid">23795988</pub-id></citation></ref>
<ref id="ref74"><label>74.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Abdel-Razig</surname> <given-names>S</given-names></name> <name><surname>Ibrahim</surname> <given-names>H</given-names></name> <name><surname>Alameri</surname> <given-names>H</given-names></name> <name><surname>Hamdy</surname> <given-names>H</given-names></name> <name><surname>Haleeqa</surname> <given-names>KA</given-names></name> <name><surname>Qayed</surname> <given-names>KI</given-names></name> <etal/></person-group>. <article-title>Creating a framework for medical professionalism: an initial consensus statement from an Arab nation</article-title>. <source>J Grad Med Educ</source>. (<year>2016</year>) <volume>8</volume>:<fpage>165</fpage>&#x2013;<lpage>72</lpage>. doi: <pub-id pub-id-type="doi">10.4300/JGME-D-15-00310.1</pub-id>, PMID: <pub-id pub-id-type="pmid">27168882</pub-id></citation></ref>
<ref id="ref75"><label>75.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ellaway</surname> <given-names>RH</given-names></name> <name><surname>Coral</surname> <given-names>J</given-names></name> <name><surname>Topps</surname> <given-names>D</given-names></name> <name><surname>Topps</surname> <given-names>M</given-names></name></person-group>. <article-title>Exploring digital professionalism</article-title>. <source>Med Teach</source>. (<year>2015</year>) <volume>37</volume>:<fpage>844</fpage>&#x2013;<lpage>9</lpage>. doi: <pub-id pub-id-type="doi">10.3109/0142159X.2015.1044956</pub-id></citation></ref>
<ref id="ref76"><label>76.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Moran-Ellis</surname> <given-names>J</given-names></name> <name><surname>Alexander</surname> <given-names>VD</given-names></name> <name><surname>Cronin</surname> <given-names>A</given-names></name> <name><surname>Dickinson</surname> <given-names>M</given-names></name> <name><surname>Fielding</surname> <given-names>J</given-names></name> <name><surname>Sleney</surname> <given-names>J</given-names></name> <etal/></person-group>. <article-title>Triangulation and integration: processes, claims and implications</article-title>. <source>Qual Res</source>. (<year>2006</year>) <volume>6</volume>:<fpage>45</fpage>&#x2013;<lpage>59</lpage>. doi: <pub-id pub-id-type="doi">10.1177/1468794106058870</pub-id></citation></ref>
<ref id="ref77"><label>77.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Morse</surname> <given-names>J</given-names></name> <name><surname>Niehaus</surname> <given-names>L</given-names></name></person-group>. <article-title>Mixed method design: Principles and Procedures</article-title>. <publisher-loc>Walnut Creek. CA, USA</publisher-loc>: <publisher-name>Left Coast Press</publisher-name> (<year>2009</year>).</citation></ref>
<ref id="ref78"><label>78.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Walls</surname> <given-names>P</given-names></name> <name><surname>Parahoo</surname> <given-names>K</given-names></name> <name><surname>Fleming</surname> <given-names>P</given-names></name></person-group>. <article-title>The role and place of knowledge and literature in grounded theory</article-title>. <source>Nurse Res</source>. (<year>2010</year>) <volume>17</volume>:<fpage>8</fpage>&#x2013;<lpage>17</lpage>. doi: <pub-id pub-id-type="doi">10.7748/nr2010.07.17.4.8.c7920</pub-id>, PMID: <pub-id pub-id-type="pmid">20712230</pub-id></citation></ref>
<ref id="ref79"><label>79.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Weick</surname> <given-names>KE</given-names></name></person-group>. <article-title>Essai: real-time reflexivity: prods to reflection</article-title>. <source>Organ Stud</source>. (<year>2002</year>) <volume>23</volume>:<fpage>893</fpage>&#x2013;<lpage>8</lpage>. doi: <pub-id pub-id-type="doi">10.1177/0170840602236011</pub-id></citation></ref>
<ref id="ref80"><label>80.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Ajzen</surname> <given-names>I.</given-names></name></person-group> <article-title>The theory of planned behaviour: Reactions and reflections</article-title>. <source>Psychol Health</source>. (<year>2011</year>). <volume>26</volume>:<fpage>1113</fpage>&#x2013;<lpage>27</lpage>.</citation></ref>
<ref id="ref81"><label>81.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gioia</surname> <given-names>DA</given-names></name> <name><surname>Corley</surname> <given-names>KG</given-names></name> <name><surname>Hamilton</surname> <given-names>AL</given-names></name></person-group>. <article-title>Seeking qualitative rigor in inductive research: notes on the Gioia methodology</article-title>. <source>Organ Res Methods</source>. (<year>2013</year>) <volume>16</volume>:<fpage>15</fpage>&#x2013;<lpage>31</lpage>. doi: <pub-id pub-id-type="doi">10.1177/1094428112452151</pub-id></citation></ref>
<ref id="ref82"><label>82.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cresswell</surname> <given-names>KM</given-names></name> <name><surname>Sadler</surname> <given-names>S</given-names></name> <name><surname>Rodgers</surname> <given-names>S</given-names></name> <name><surname>Avery</surname> <given-names>A</given-names></name> <name><surname>Cantrill</surname> <given-names>J</given-names></name> <name><surname>Murray</surname> <given-names>SA</given-names></name> <etal/></person-group>. <article-title>An embedded longitudinal multi-faceted qualitative evaluation of a complex cluster randomized controlled trial aiming to reduce clinically important errors in medicines management in general practice</article-title>. <source>Trials</source>. (<year>2012</year>) <volume>13</volume>:<fpage>1</fpage>&#x2013;<lpage>13</lpage>. doi: <pub-id pub-id-type="doi">10.1186/1745-6215-13-78</pub-id></citation></ref>
<ref id="ref83"><label>83.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Varpio</surname> <given-names>L</given-names></name> <name><surname>Paradis</surname> <given-names>E</given-names></name> <name><surname>Uijtdehaage</surname> <given-names>S</given-names></name> <name><surname>Young</surname> <given-names>M</given-names></name></person-group>. <article-title>The distinctions between theory, theoretical framework, and conceptual framework</article-title>. <source>Acad Med</source>. (<year>2020</year>) <volume>95</volume>:<fpage>989</fpage>&#x2013;<lpage>94</lpage>. doi: <pub-id pub-id-type="doi">10.1097/ACM.0000000000003075</pub-id>, PMID: <pub-id pub-id-type="pmid">31725464</pub-id></citation></ref>
<ref id="ref84"><label>84.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Leung</surname> <given-names>L</given-names></name></person-group>. <article-title>Validity, reliability, and generalizability in qualitative research</article-title>. <source>J Family Med Primary Care</source>. (<year>2015</year>) <volume>4</volume>:<fpage>324</fpage>&#x2013;<lpage>7</lpage>. doi: <pub-id pub-id-type="doi">10.4103/2249-4863.161306</pub-id>, PMID: <pub-id pub-id-type="pmid">26288766</pub-id></citation></ref>
<ref id="ref85"><label>85.</label><citation citation-type="other"><person-group person-group-type="author"><name><surname>Cohen Miller</surname> <given-names>A</given-names></name> <name><surname>Saban</surname> <given-names>GA</given-names></name> <name><surname>Bayeta</surname> <given-names>R</given-names></name></person-group>. <article-title>Rigor in qualitative research in the Asian context</article-title>. In: <person-group person-group-type="editor"><name><surname>Wa-Mbaleka</surname> <given-names>S.</given-names></name><name><surname>Rosales</surname> <given-names>A.</given-names></name><name><surname>Tolich</surname> <given-names>M.</given-names></name></person-group>. <source>The SAGE handbook for qualitative research in the Asian context</source>. SAGE (2022). p. <fpage>327</fpage>&#x2013;<lpage>44</lpage>.</citation></ref>
<ref id="ref86"><label>86.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Palmer</surname> <given-names>D</given-names></name> <name><surname>Dick</surname> <given-names>B</given-names></name> <name><surname>Freiburger</surname> <given-names>N</given-names></name></person-group>. <article-title>Rigor and relevance in organization studies</article-title>. <source>J Manag Inq</source>. (<year>2009</year>) <volume>18</volume>:<fpage>265</fpage>&#x2013;<lpage>72</lpage>. doi: <pub-id pub-id-type="doi">10.1177/1056492609343491</pub-id></citation></ref>
<ref id="ref87"><label>87.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tushman</surname> <given-names>ML</given-names></name> <name><surname>O'Reilly</surname> <given-names>C</given-names></name> <name><surname>Fenollosa</surname> <given-names>A</given-names></name> <name><surname>Kleinbaum</surname> <given-names>AM</given-names></name> <name><surname>McGrath</surname> <given-names>D</given-names></name></person-group>. <article-title>Relevance and rigor: executive education as a lever in shaping practice and research</article-title>. <source>Acad Manag Learn Edu</source>. (<year>2007</year>) <volume>6</volume>:<fpage>345</fpage>&#x2013;<lpage>62</lpage>. doi: <pub-id pub-id-type="doi">10.5465/amle.2007.26361625</pub-id></citation></ref>
<ref id="ref88"><label>88.</label><citation citation-type="other"><person-group person-group-type="author"><name><surname>Guba</surname> <given-names>EG</given-names></name> <name><surname>Lincoln</surname> <given-names>YS</given-names></name></person-group>. <article-title>Competing paradigms in qualitative research</article-title>. <source>Handbook of qualitative research</source>.<publisher-loc> Thousand Oaks, CA</publisher-loc>: <publisher-name>Sage Publications Inc</publisher-name>. (<year>1994</year>); <volume>2</volume>:<fpage>105</fpage>&#x2013;<lpage>17</lpage>.</citation></ref>
</ref-list>
</back>
</article>