<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Neuroinform.</journal-id>
<journal-title>Frontiers in Neuroinformatics</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Neuroinform.</abbrev-journal-title>
<issn pub-type="epub">1662-5196</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fninf.2017.00017</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Neuroscience</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Evaluation of Field Map and Nonlinear Registration Methods for Correction of Susceptibility Artifacts in Diffusion MRI</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Wang</surname> <given-names>Sijia</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<xref ref-type="author-notes" rid="fn001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/387241/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Peterson</surname> <given-names>Daniel J.</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/295623/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Gatenby</surname> <given-names>J. C.</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/415573/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Li</surname> <given-names>Wenbin</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/390414/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Grabowski</surname> <given-names>Thomas J.</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/53065/overview"/>
</contrib> 
<contrib contrib-type="author">
<name><surname>Madhyastha</surname> <given-names>Tara M.</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/120938/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Institute of Diagnostic and Interventional Radiology, Shanghai Jiao Tong University Affiliated Sixth People&#x02019;s Hospital</institution> <country>Shanghai, China</country></aff>
<aff id="aff2"><sup>2</sup><institution>Department of Radiology, University of Washington</institution> <country>Seattle, WA, USA</country></aff>
<aff id="aff3"><sup>3</sup><institution>Department of Neurology, University of Washington</institution> <country>Seattle, WA, USA</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Arjen van Ooyen, VU University Amsterdam, Netherlands</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Andrei Irimia, University of Southern California, USA; Frithjof Kruggel, University of California, Irvine, USA</p></fn>
<fn fn-type="corresp" id="fn001"><p>&#x0002A;Correspondence: Sijia Wang <email>sjwang21&#x00040;126.com</email></p></fn>
</author-notes>
<pub-date pub-type="epub">
<day>21</day>
<month>02</month>
<year>2017</year>
</pub-date>
<pub-date pub-type="collection">
<year>2017</year>
</pub-date>
<volume>11</volume>
<elocation-id>17</elocation-id>
<history>
<date date-type="received">
<day>01</day>
<month>11</month>
<year>2016</year>
</date>
<date date-type="accepted">
<day>09</day>
<month>02</month>
<year>2017</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2017 Wang, Peterson, Gatenby, Li, Grabowski and Madhyastha.</copyright-statement>
<copyright-year>2017</copyright-year>
<copyright-holder>Wang, Peterson, Gatenby, Li, Grabowski and Madhyastha</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution and reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p>
</license>
</permissions>
<abstract><p>Correction of echo planar imaging (EPI)-induced distortions (called &#x0201C;unwarping&#x0201D;) improves anatomical fidelity for diffusion magnetic resonance imaging (MRI) and functional imaging investigations. Commonly used unwarping methods require the acquisition of supplementary images during the scanning session. Alternatively, distortions can be corrected by nonlinear registration to a non-EPI acquired structural image. In this study, we compared reliability using two methods of unwarping: (1) nonlinear registration to a structural image using symmetric normalization (SyN) implemented in Advanced Normalization Tools (ANTs); and (2) unwarping using an acquired field map. We performed this comparison in two different test-retest data sets acquired at differing sites (<italic>N</italic> = 39 and <italic>N</italic> = 32). In both data sets, nonlinear registration provided higher test-retest reliability of the output fractional anisotropy (FA) maps than field map-based unwarping, even when accounting for the effect of interpolation on the smoothness of the images. In general, field map-based unwarping was preferable if and only if the field maps were acquired optimally.</p></abstract>
<kwd-group>
<kwd>EPI distortion correction</kwd>
<kwd>B0 field mapping</kwd>
<kwd>symmetric normalization registration</kwd>
<kwd>diffusion tensor imaging (DTI)</kwd>
<kwd>reliability</kwd>
</kwd-group>
<contract-num rid="cn001">1RC4NS073008-01</contract-num>
<contract-num rid="cn001">P50NS062684</contract-num>
<contract-sponsor id="cn001">National Institutes of Health<named-content content-type="fundref-id">10.13039/100000002</named-content></contract-sponsor>
<counts>
<fig-count count="5"/>
<table-count count="3"/>
<equation-count count="0"/>
<ref-count count="28"/>
<page-count count="9"/>
<word-count count="6442"/>
</counts>
</article-meta>
</front>
<body>
<sec sec-type="introduction" id="s1">
<title>Introduction</title>
<p>Diffusion imaging is a widely-used technique to examine white matter microstructure <italic>in vivo</italic>. Echo planar imaging (EPI), introduced by Mansfield (<xref ref-type="bibr" rid="B20">1977</xref>), has become the dominant method for the acquisition of diffusion-weighted images, which are commonly fit to a tensor model as Diffusion Tensor Imaging (DTI). However, EPI causes geometric distortions (Jones and Cercignani, <xref ref-type="bibr" rid="B16">2010</xref>) that stem from the inhomogeneity of the underlying B0 field, which is in turn due to the varying magnetic susceptibilities of air, bone and tissue. Susceptibility-induced EPI distortions alter anatomical fidelity of the images, making anatomically accurate measurements more difficult, and complicate multimodal investigations that integrate data from EPI and non-EPI images.</p>
<p>B0 Field mapping techniques (Jezzard and Balaban, <xref ref-type="bibr" rid="B15">1995</xref>; Wan et al., <xref ref-type="bibr" rid="B24">1997</xref>) can be used to reduce EPI distortion by &#x0201C;unwarping&#x0201D; the images. Unwarping using field mapping requires that we obtain phase images at two different echo times (Reber et al., <xref ref-type="bibr" rid="B21">1998</xref>). Using these two-phase images, one can calculate the degree of EPI distortion present along the phase-encode direction of the EPI images, and then apply an equal and opposite pixel-shift, thereby unwarping the distortions in the original images.</p>
<p>Another approach to correcting EPI distortions at acquisition is the &#x0201C;blip-up blip-down&#x0201D; method introduced by Chang and Fitzpatrick (<xref ref-type="bibr" rid="B8">1992</xref>), which requires the acquisition of the same image twice, with reversed phase-encoding gradients. The distortions in each image are identical, but in opposite directions. By applying a specialized symmetric registration with transformations only allowed along the phase-encode direction, we can warp these images to each other to &#x0201C;meet in the middle&#x0201D;, and thereby obtain distortion-corrected images with no signal loss. This method is implemented in FSL&#x02019;s &#x0201C;topup&#x0201D; program (Andersson et al., <xref ref-type="bibr" rid="B1">2003</xref>).</p>
<p>These two methods must be implemented at the time of acquisition. However, many valuable data sets have been collected and released to the community that have not been acquired with field maps nor with reversed phase-encoding gradients (Zuo et al., <xref ref-type="bibr" rid="B27">2014</xref>).</p>
<p>For this reason, researchers have been motivated to examine correction of distortions using non-linear registration techniques (Andersson et al., <xref ref-type="bibr" rid="B1">2003</xref>; Wu et al., <xref ref-type="bibr" rid="B25">2008</xref>). Non-linear co-registration with the Advanced Normalization Tools (ANTs; Avants et al., <xref ref-type="bibr" rid="B3">2008</xref>) has been used to correct EPI distortions by calculating a nonlinear warp to a non-EPI acquired structural image. The authors found that nonlinear registration increased measures of functional connectivity in a way that suggested the presence of meaningful signal, but the results were different than correction using a field map.</p>
<p>In this article, we examined the question of how well nonlinear co-registration with ANTs corrects distortions as compared to a field map in two different data sets acquired at different sites. While this investigation was conducted in the context of DTI, the results might generalize to fMRI studies that employ unwarping of EPI distortions.</p>
<p>Accurate unwarping is especially important considering that it is an early processing step that may interact with subsequent analytical steps in unexpected ways that may have a large impact on the results of an investigation (Madhyastha et al., <xref ref-type="bibr" rid="B17">2014</xref>). One way of examining whether the distortion correction is accurate or not is to examine the similarity of the fractional anisotropy (FA) map obtained after tensor fitting (assessed using mutual information (MI)) to the structural T1 image. Another is to quantify within- and between-session scan-rescan reliability of distortion correction methods in the context of a complete analysis pipeline, exploiting the idea that in the ideal acquisition scenario, with no variability due to distortion, we would obtain the same DTI statistics in repeated scans. In this article, we compared the reliability of field map-corrected images to nonlinear registration-corrected images after processing using Tract-Based Spatial Statistics (TBSS; Smith et al., <xref ref-type="bibr" rid="B23">2006</xref>), a popular DTI analysis method. We also visualized the difference between FA values acquired at both time points across the entire brain.</p>
</sec>
<sec sec-type="materials and methods" id="s2">
<title>Materials and Methods</title>
<sec id="s2-1">
<title>Participants</title>
<p>Our study data came from two data sets, which we label Udall and Boekel. <bold>Udall</bold>: DTI data were acquired as part of a larger study of Parkinson&#x02019;s disease (Madhyastha et al., <xref ref-type="bibr" rid="B18">2015</xref>). For this study, 23 Parkinson&#x02019;s patients and 16 controls (mean age = 64.59, SD = 10.53; 16 females) had acceptable quality DTI data for two acquisitions. <bold>Boekel</bold>: The Boekel data set includes data from 32 undergraduate psychology students (mean age = 22.50, SD = 3.22; 17 females) who were recruited from a previous 43-participant magnetic resonance imaging (MRI) study (Boekel et al., <xref ref-type="bibr" rid="B7">2015</xref>). Two subjects from the original data release were omitted from this study because the face shearing used to de-identify subjects caused significant data loss in the T1 and/or field map magnitude images. These data are available for download at NITRC (David, <xref ref-type="bibr" rid="B10">2006</xref>; Boekel et al., <xref ref-type="bibr" rid="B6">2017</xref>). For the Udall data set, the data was collected under a protocol approved by the local University of Washington institutional review board and all participants gave their written informed consent. For the Boekel data set, the data collection protocol was approved by the local ethics committee at the University of Amsterdam (Boekel et al., <xref ref-type="bibr" rid="B7">2015</xref>). All participants gave their written informed consent prior to scanning. The study was approved by the University of Washington review board.</p>
<p>Table <xref ref-type="table" rid="T1">1</xref> shows the demographic data for these subjects. We conducted an independent-sample <italic>t</italic>-test to compare the ages of Udall and Boekel participants. There was a significant difference in the ages for Udall (<italic>M</italic> = 64.59, SD = 10.53) and Boekel participants (<italic>M</italic> = 22.50, SD = 3.22); <italic>t</italic><sub>(69)</sub> = 21.76, <italic>p</italic> &#x0003C; 0.001. Participants in the Udall data set are significantly older than the Boekel participants. We used a Chi-square test to compare the percentage of males in each group. There was no significant difference in the percentage of males in each group (<italic>X<sup>2</sup><sub>(1,N = 71)</sub></italic> = 1.03, <italic>p</italic> = 0.31).</p>
<table-wrap id="T1" position="float">
<label>Table 1</label>
<caption><p><bold>Demographics of Sample</bold>.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th/>
<th align="center">Udall</th>
<th align="center">Boekel</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left">Demographics</td>
</tr>
<tr>
<td align="left"><italic>N</italic></td>
<td align="center">39</td>
<td align="center">32</td>
</tr>
<tr>
<td align="left">Age at Scan</td>
<td align="center">64.59 (10.53)</td>
<td align="center">22.50 (3.22)</td>
</tr>
<tr>
<td align="left">Sex (number males)</td>
<td align="center">23 (59%)</td>
<td align="center">15 (47%)</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="s2-2">
<title>MRI Data Acquisition</title>
<p>In the Udall study, DTI and T1 weighted images were collected on a Philips Achieva 3T scanner at the University of Washington with a 32-channel head coil. The Udall diffusion acquisition was optimized for high angular resolution. The DTI pulse sequence parameters were: 75 2 mm slices acquired with no slice gap and in an ascending temporal slice order, matrix size = 128 &#x000D7; 128, FOV = 256 &#x000D7; 256 &#x000D7; 150 mm, giving a 2 &#x000D7; 2 &#x000D7; 2 mm isotropic voxel size. TR = 10.8 s, TE = 93.5 ms, flip angle = 90&#x000B0;, and a total of 64 <italic>b</italic>-vectors, distributed evenly across a half-sphere, with <italic>b</italic> = 3000 s/mm<sup>2</sup>, and one <italic>b</italic> = 0 s/mm<sup>2</sup> image. The parallel acceleration factor (SENSE) was 2. Total acquisition time was 14.2 min. The <italic>B</italic><sub>0</sub> field map was collected with matching geometry for use in unwarping EPI distortions due to magnetic field inhomogeneity (Jezzard and Balaban, <xref ref-type="bibr" rid="B15">1995</xref>). The field map acquisition was a 3D interleaved dual echo gradient echo pulse sequence, with the following parameters: matrix size = 256 &#x000D7; 256 &#x000D7; 75, FOV = 256 &#x000D7; 256 &#x000D7; 150, TR = 10 ms, TE1 = 2.25 ms, TE2 = 3.25 ms. This bounded the unaliased frequency offsets at &#x000B1;500 Hz. A sagittal T1-weighted 3D MPRAGE was collected to allow for registration of the DTI images, using the following parameters: 176 slices, matrix size = 256 &#x000D7; 256 &#x000D7; 176, FOV = 256 &#x000D7; 256 &#x000D7; 176 mm, TI = 1100 ms, TE = 3.49 ms, <italic>T</italic> = 7.46 ms, Turbo-Field echo (TFE) factor = 225, flip angle = 7&#x000B0;, shot interval = 2530 ms, and a SENSE factor = 2.</p>
<p>The parameters for the Boekel DTI acquisition are described in Boekel et al. (<xref ref-type="bibr" rid="B7">2015</xref>). Briefly, DTI and T1-weighted images were collected on a 3T Philips Achieva XT at the University of Amsterdam with a 32-channel head coil. For each subject, four repetitions of a single shot DTI scan were obtained using the following parameters: 60 2 mm slices acquired with no slice gap and in an ascending temporal slice order, matrix size = 112 &#x000D7; 112, Field of View (FOV) = 224 &#x000D7; 224 &#x000D7; 120, giving a 2 &#x000D7; 2 &#x000D7; 2 mm isotropic voxel size. TR = 7.5 s, TE = 86 ms, flip angle = 90&#x000B0;, and a total of 32 non-colinear b-vectors, distributed evenly across a half-sphere, with <italic>b</italic> = 3000 s/mm<sup>2</sup>, and one <italic>b</italic> = 0 s/mm<sup>2</sup> image. The parallel acceleration factor (SENSE) of 2. The field map acquisition was a 3D interleaved dual echo gradient echo pulse sequence, with the following parameters: matrix size = 128 &#x000D7; 104 &#x000D7; 128, FOV = 256 &#x000D7; 208 &#x000D7; 256 mm, TR = 11 ms, TE1 = 3 ms, &#x00394;TE = 5 ms. This bounded the unaliased frequency offsets at &#x000B1;200 Hz. An axial 3D T1-weighted anatomical scan was also acquired with a 3D gradient echo scan with using the following parameters: matrix size = 240 &#x000D7; 188 &#x000D7; 220, FOV = 240 &#x000D7; 188 &#x000D7; 220 mm, TE = 3.8 ms, TR = 7.46 ms, TFE factor = 154, flip angle = 8&#x000B0;, shot interval = 2375 ms, and SENSE factors = 2.5 LR, 2 FH.</p>
<p>We used only the first of the four repetitions of the DTI scan for each session in this analysis. Because the second T1 measurements were dropped for a subset of the Boekel subjects to optimize the total scan duration, we used the first T1 scan for both time points for the Boekel data set.</p>
<p>In the Udall data set, the time between the two DTI acquisitions was 2&#x02013;3 weeks. In contrast, in the Boekel scanning was completed within a single day; the time between the two scan sessions was 2&#x02013;4 h.</p>
</sec>
<sec id="s2-3">
<title>MRI Processing</title>
<p>Diffusion data were processed using in-house bash scripts written by DP that invoked FMRIB (Oxford Center for Functional MRI of the Brain) Software Library (FSL) version 5.0.9 programs and produced quality assurance images. These scripts are available at <ext-link ext-link-type="uri" xlink:href="https://github.com/danjonpeterson/dti_preproc">https://github.com/danjonpeterson/dti_preproc</ext-link>. The specific version of the scripts used for this article is version 1.0. Detailed descriptions of the parameters used by all processing steps are given in Supplemental Materials.</p>
<p>The first step was to correct the diffusion data for motion and eddy-current induced distortions (Figure <xref ref-type="fig" rid="F1">1</xref>). The unweighted diffusion image was extracted and skull stripped using FSL BET (Brain Extraction Tool) to create a DTI mask. Then, diffusion data were corrected for motion and eddy-current induced distortions using FSL&#x02019;s &#x0201C;eddy&#x0201D;. Motion estimates, produced using FSL&#x02019;s rmsdiff command, were used to compute the mean absolute root mean squared (RMS) displacement and mean relative RMS displacement. We analyzed these motion parameters using paired and unpaired <italic>t</italic>-tests, because motion can have a significant impact on the quality and reliability of diffusion MRI data (Yendiki et al., <xref ref-type="bibr" rid="B26">2014</xref>).</p>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p><bold>Diffusion Tensor Imaging (DTI) preprocessing workflow</bold>.</p></caption>
<graphic xlink:href="fninf-11-00017-g0001.tif"/>
</fig>
<p>We compared two methods of performing DTI unwarping. The first used a B0 field map (Jezzard and Balaban, <xref ref-type="bibr" rid="B15">1995</xref>) to compensate for the distortions (field map unwarping), and the second used nonlinear registration (large deformation diffeomorphic metric mapping) implemented as Symmetric Normalization (SyN) by ANTs (Avants et al., <xref ref-type="bibr" rid="B4">2011</xref>) version 2.1.0 release candidate 3 (nonlinear registration unwarping). Field map unwarping (Figure <xref ref-type="fig" rid="F2">2</xref>) was performed using FMRIB&#x02019;s Utility for Geometrically Unwarping EPIs (FUGUE). First, the B0 field map was converted to radians per second by multiplying by 2<sup>*</sup>&#x003C0;. FUGUE uses the field map values to determine the pixel shift of the motion-corrected diffusion data in the phase-encode direction, correcting for distortion.</p>
<fig id="F2" position="float">
<label>Figure 2</label>
<caption><p><bold>DTI field map unwarping workflow</bold>.</p></caption>
<graphic xlink:href="fninf-11-00017-g0002.tif"/>
</fig>
<p>To evaluate the scenario where no field map was acquired (Figure <xref ref-type="fig" rid="F3">3</xref>) we used ANTs SyN nonlinear registration of the unweighted diffusion image to a bias corrected (using FSL FAST) and skull-stripped (using ROBEX, a robust, machine learning-based brain extraction system (Iglesias et al., <xref ref-type="bibr" rid="B13">2011</xref>)) T1 image. We found that ROBEX worked well across both data sets to create an accurate skull stripped image for registration. We performed this registration using two methods. The first method, modeled after EPI motion correction (Huntenburg et al., <xref ref-type="bibr" rid="B12">2014</xref>) was to invert the contrast on the bias corrected and skull stripped T1 image and use the antsRegistrationSynN.sh script to register the B0 image to the inverted T1 image [Method 1]. The second approach was to use the antsIntermodalityIntrasubject.sh script to register the B0 image to the original bias corrected and skull stripped T1 image [Method 2]. Both ANTs approaches use the MI criterion to align the unweighted diffusion image to the T1 image (Huntenburg, <xref ref-type="bibr" rid="B11">2014</xref>; Huntenburg et al., <xref ref-type="bibr" rid="B12">2014</xref>). Method 1 tunes the underlying registration parameters for images that are from different subjects but with similar contrast characteristics. Method 2 tunes the underlying registration parameters for images collected on the same subject, but across image modalities with different contrast characteristics. See &#x0201C;Supplemental Materials&#x0201D; for more details on this pipeline. After visually checking the registrations, we applied the transformation to all volumes of the DTI images.</p>
<fig id="F3" position="float">
<label>Figure 3</label>
<caption><p><bold>Nonlinear registration unwarping, implemented using Advanced Normalization Tools (ANTs)</bold>.</p></caption>
<graphic xlink:href="fninf-11-00017-g0003.tif"/>
</fig>
<p>After unwarping using either the field map or nonlinear registration implemented by SyN in ANTs, we fit the DTI tensor using FSL&#x02019;s DTIFIT (Basser et al., <xref ref-type="bibr" rid="B5">1994</xref>). We used weighted least-squares fitting to fit the tensor and output DTI scalar images. FA maps obtained using nonlinear registration unwarping were down-sampled to 2 mm.</p>
<p>FA maps obtained using nonlinear registration unwarping were smoother than those obtained using field map unwarping because of resampling in the registration steps. To separate the effects of smoothing from the effects of unwarping technique, we created a smoothed field map unwarped FA data set as follows. We estimated the smoothness of the nonlinear registration unwarped images using the Analysis of Functional Neuroimaging (AFNI; Cox, <xref ref-type="bibr" rid="B9">1996</xref>) 3dFWHMx utility, which estimates smoothness of the image, or the autocorrelation of neighboring voxels. This is measured as the Full Width at Half Maximum (FWHM) of a Gaussian approximation to the spatial autocorrelation function. We next measured the smoothness of the field map unwarped images to that FWHM estimate using AFNI 3dBlurToFWHM, which iteratively re-smooths a data set until it has the given FWHM in the specified dimensions. After unwarping using ANTs, the estimated mean FWHM smoothness across all dimensions was 10.27 mm for the Boekel data set, and 10.48 mm for the Udall data set. Figure <xref ref-type="fig" rid="F4">4</xref> shows an example axial slice of a single subject&#x02019;s FA map using field map unwarping (A), after nonlinear registration unwarping (B), and after matching the smoothing of the field map unwarping to the nonlinear registration unwarping (C).</p>
<fig id="F4" position="float">
<label>Figure 4</label>
<caption><p><bold>Differences in smoothing. (A)</bold> Fractional anisotropy (FA) images unwarped according to an acquired field map (smoothness is 4.64). <bold>(B)</bold> FA images unwarped according to nonlinear registration to a structural image (smoothness is 6.76). <bold>(C)</bold> FA images unwarped according to an acquired field map and smoothed to match the smoothness of the nonlinearly warped image (smoothness is 6.73).</p></caption>
<graphic xlink:href="fninf-11-00017-g0004.tif"/>
</fig>
<p>This processing pipeline was written in GNU Make, using the approach described in Askren et al. (<xref ref-type="bibr" rid="B2">2016</xref>). Makefiles describing the workflow are available from the corresponding author.</p>
</sec>
<sec id="s2-4">
<title>Evaluation of Unwarping</title>
<p>We evaluated unwarping using two different techniques. One way to quantify unwarping is to compare the unwarped image to an undistorted image. To operationalize this approach, we quantified the MI between the computed FA map and the skull-stripped T1 image. MI, or the statistical dependence between the intensities of corresponding voxels in two images, is an important measure of image similarity that is often used to evaluate registration methods. MI should be maximized when images are aligned (Maes et al., <xref ref-type="bibr" rid="B19">1997</xref>). MI is calculated using marginal distributions derived from a joint histograms of the two images (Avants et al., <xref ref-type="bibr" rid="B4">2011</xref>) using the MeasureImageSimilarity program from ANTs. MI is by definition a positive value, but the metric output by ANTs is sign-inverted so that it can be minimized; therefore, the method that has the lowest value of this metric (the highest MI) can be interpreted as having the least distortion in the FA map relative to the T1. We used this metric to choose the ANTs registration that best aligned the FA map to the T1 (of the two methods that we tried shown in Figure <xref ref-type="fig" rid="F3">3</xref>) for each individual. We report the negative of the ANTs reported metric, the MI metric, where higher MI is better.</p>
<p>Another way to evaluate the effect of unwarping methods is to consider how different unwarping techniques affect subsequent analytic power. We operationalize this by evaluating the reliability of DTI scalar statistics in a realistic analysis setting using TBSS. TBSS projects all subjects&#x02019; FA data onto a mean FA tract skeleton that represents the centers of all tracts common to the group. TBSS has gained popularity for its ease of use and improved alignment of white matter as compared to other voxel-wise analysis methods (Jones and Cercignani, <xref ref-type="bibr" rid="B16">2010</xref>). We assessed reliability by running TBSS (using default parameters (Jenkinson, <xref ref-type="bibr" rid="B14">2013</xref>)) on the FA maps at each session computed using no unwarping, field map unwarping and nonlinear registration unwarping. We calculated voxel-wise statistics on the final TBSS skeleton using Pearson&#x02019;s correlation coefficient (<italic>r</italic>) and the Intra class Correlation (ICC) coefficient to assess the reliability of FA statistics across sessions as in prior work (Madhyastha et al., <xref ref-type="bibr" rid="B17">2014</xref>). To compute the ICC, we used a two-way mixed effects model with absolute agreement (McGraw and Wong, <xref ref-type="bibr" rid="B200">1996</xref>). We determined whether there was an overall significant difference in reliability between voxels in a skeleton by using a Mann-Whitney <italic>U</italic>-test, a nonparametric test of the null hypothesis that the distributions of the reliability coefficients in the skeleton are identical using data unwarped using different techniques.</p>
<p>We also examined a measure of reliability across the entire brain, including areas where we expect signal dropout, by calculating the absolute value of the difference in FA maps for each subject at each time point after registering to the structural image obtained at the first-time point using rigid-body registration. We then used ANTs SyN registration to transform the structural image to standard space, and applied this nonlinear transform to the FA difference maps. In this way we computed a &#x0201C;mean FA difference map&#x0201D; for each study and each method. We used random permutation testing to conduct a paired <italic>t</italic>-test to determine where the difference in longitudinal measurements using field map unwarping was smaller or larger than the measurements using ANTs unwarping. We implemented this <italic>t</italic>-test using FSL randomize, with threshold-free cluster enhancement (Smith and Nichols, <xref ref-type="bibr" rid="B22">2009</xref>) to identify clusters without specifying an arbitrary threshold and correction for multiple comparisons by controlling the family-wise error (FWE) rate. This allowed us to partially separate effects of registration from the effects of unwarping to visualize spatial differences in the reproducibility of measures using the two unwarping methods.</p>
</sec>
</sec>
<sec sec-type="results" id="s3">
<title>Results</title>
<p>We compared the mean absolute RMS displacement and mean relative RMS displacement across time points and studies using paired sample <italic>t</italic>-tests. For Udall, the mean absolute RMS displacement was 0.51 mm and the mean relative RMS displacement was 0.89 mm. There was no significant difference between the mean absolute RMS motion (<italic>t</italic><sub>(38)</sub> = 0.20, <italic>p</italic> = 0.84) and mean relative RMS motion (<italic>t</italic><sub>(38)</sub> = 0.82, <italic>p</italic> = 0.42) between the two-time points. For Boekel, the mean absolute RMS displacement was 0.20 mm and the mean relative RMS displacement was 0.55 mm. There was no significant effect for the mean absolute RMS displacement (<italic>t</italic><sub>(31)</sub> = 0.78, <italic>p</italic> = 0.44) and mean relative RMS displacement (<italic>t</italic><sub>(31)</sub> = 0.45, <italic>p</italic> = 0.66) between the two-time points. But the mean absolute RMS displacement and mean relative RMS displacement are both higher in Udall than in Boekel (<italic>t</italic><sub>(140)</sub> = 11.61, <italic>p &#x0003C; 0</italic>.001) and mean relative RMS motion (<italic>t</italic><sub>(140)</sub> = 4.93, <italic>p</italic> &#x0003C; 0.001).</p>
<p>Table <xref ref-type="table" rid="T2">2</xref> shows the MI of the FA maps resulting from field map unwarping and nonlinear registration unwarping to the bias corrected and skull stripped T1. Estimates across different sessions are quite stable (they are the same to within two significant digits, and not shown). For Udall, field map unwarping is the best. No unwarping is better than nonlinear registration unwarping (<italic>t</italic><sub>(77)</sub> = 17.14, <italic>p</italic> &#x0003C; 0.001) and field map unwarping is better than no unwarping (<italic>t</italic><sub>(77)</sub> = &#x02212;4.15, <italic>p</italic> &#x0003C; 0.001) and nonlinear registration unwarping (<italic>t</italic><sub>(77)</sub> = &#x02212;15.89, <italic>p</italic> &#x0003C; 0.001). For Boekel, however, we saw that nonlinear registration unwarping is the best. Nonlinear registration is better than no unwarping (<italic>t</italic><sub>(63)</sub> = &#x02212;25.38, <italic>p</italic> &#x0003C; 0.001) and field map unwarping (<italic>t</italic><sub>(63)</sub> = 26.16, <italic>p</italic> &#x0003C; 0.001). No unwarping is better than field map unwarping (<italic>t</italic><sub>(63)</sub> = 2.88, <italic>p</italic> =<italic> 0</italic>.005).</p>
<table-wrap id="T2" position="float">
<label>Table 2</label>
<caption><p><bold>Mean mutual information (higher is better) of FA and T1 images across all subjects using different unwarping techniques</bold>.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th/>
<th align="center" colspan="2">Udall time 1<sup>1</sup></th>
<th align="center" colspan="2">Boekel time 1</th>
</tr>
<tr>
<th/>
<th align="center"><italic>M</italic></th>
<th align="center"><italic>SD</italic></th>
<th align="center"><italic>M</italic></th>
<th align="center"><italic>SD</italic></th>
</tr>
</thead>
<tbody>
<tr>
<td align="left">No unwarping</td>
<td align="center">0.47</td>
<td align="center">0.03</td>
<td align="center">0.39</td>
<td align="center">0.02</td>
</tr>
<tr>
<td align="left">ANTs (method 1)</td>
<td align="center">0.45</td>
<td align="center">0.03</td>
<td align="center">0.43</td>
<td align="center">0.03</td>
</tr>
<tr>
<td align="left">ANTs (method 2)</td>
<td align="center">0.44</td>
<td align="center">0.03</td>
<td align="center">0.41</td>
<td align="center">0.03</td>
</tr>
<tr>
<td align="left">ANTs (best of method 1 and 2)<sup>2</sup></td>
<td align="center">0.45</td>
<td align="center">0.03</td>
<td align="center">0.43</td>
<td align="center">0.03</td>
</tr>
<tr>
<td align="left">Field map unwarping</td>
<td align="center">0.48</td>
<td align="center">0.04</td>
<td align="center">0.39</td>
<td align="center">0.02</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p><italic>Method 1 uses antsRegistrationSynN.sh and Method 2 uses antsIntermodalityIntrasubject.sh. Note: <sup>1</sup>Results for time 1 are identical to within two significant digits to results from time 2, indicating that methods worked similarly across both samples. <sup>2</sup>The highest MI is computed on a per-subject level, so it is theoretically possible for this value to be larger than the mean for either method</italic>.</p>
</table-wrap-foot>
</table-wrap>
<p>Table <xref ref-type="table" rid="T3">3</xref> shows the Pearson correlation and ICC values calculated without unwarping, using field map unwarping, nonlinear registration unwarping, and field map unwarping after smoothing to match the field map unwarping. In general, nonlinear registration unwarping produced the highest reliability of voxels in the TBSS skeleton. Some form of unwarping improved reliability over no unwarping, despite the fact that TBSS uses nonlinear registration implemented by fnirt and skeleton projection to align white matter. For both Boekel and Udall, there was a significant improvement in reliability from simply smoothing the field map unwarped image. The magnitude of this improvement was, in general, larger than the magnitude of the improvements from unwarping. Consistent with differences in quality of unwarping using the field map for the two acquisitions as measured using MI, nonlinear registration unwarping for Boekel resulted in a similar percentage of voxels with a significant correlation or ICC value, and a higher mean, than field map unwarping with smoothing. In contrast, the Udall results show a somewhat lower percentage of voxels with a significant correlation or ICC value for nonlinear registration unwarping than field map unwarping with smoothing, and a resulting smaller improvement in reliability with nonlinear registration unwarping. Mann-Whitney <italic>U</italic> tests showed that the mean ICC values were significantly different for all methods and data sets at <italic>p</italic> &#x0003C; 0.001.</p>
<table-wrap id="T3" position="float">
<label>Table 3</label>
<caption><p><bold>Reliability of different methods for unwarping (in the TBSS pipeline)</bold>.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th/>
<th/>
<th align="center" colspan="3">Pearson correlation</th>
<th align="center" colspan="3">ICC</th>
</tr>
<tr>
<th/>
<th/>
<th align="center">Mean in the skeleton</th>
<th align="center">Percentage of voxels (<italic>p</italic> &#x0003C; 0.05) in the skeleton</th>
<th align="center">Mean among voxels (<italic>p</italic> &#x0003C; 0.05) in the skeleton</th>
<th align="center">Mean in the skeleton</th>
<th align="center">Percentage of voxels (<italic>p</italic> &#x0003C; 0.05) in the skeleton</th>
<th align="center">Mean among voxels (<italic>p</italic> &#x0003C; 0.05) in the skeleton</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left">Udall</td>
<td align="left">No unwarping</td>
<td align="center">0.66</td>
<td align="center">0.81</td>
<td align="center">0.69</td>
<td align="center">0.66</td>
<td align="center">0.82</td>
<td align="center">0.67</td>
</tr>
<tr>
<td/>
<td align="left">Field map unwarping unsmoothed</td>
<td align="center">0.70</td>
<td align="center">0.79</td>
<td align="center">0.72</td>
<td align="center">0.70</td>
<td align="center">0.80</td>
<td align="center">0.71</td>
</tr>
<tr>
<td/>
<td align="left">Field map unwarping smoothed</td>
<td align="center">0.77</td>
<td align="center">0.82</td>
<td align="center">0.76</td>
<td align="center">0.76</td>
<td align="center">0.82</td>
<td align="center">0.75</td>
</tr>
<tr>
<td/>
<td align="left">Nonlinear registration unwarping</td>
<td align="center">0.80</td>
<td align="center">0.79</td>
<td align="center">0.78</td>
<td align="center">0.80</td>
<td align="center">0.78</td>
<td align="center">0.78</td>
</tr>
<tr>
<td align="left">Boekel</td>
<td align="left">No unwarping</td>
<td align="center">0.62</td>
<td align="center">0.80</td>
<td align="center">0.66</td>
<td align="center">0.61</td>
<td align="center">0.83</td>
<td align="center">0.65</td>
</tr>
<tr>
<td/>
<td align="left">Field map unwarping unsmoothed</td>
<td align="center">0.64</td>
<td align="center">0.82</td>
<td align="center">0.68</td>
<td align="center">0.64</td>
<td align="center">0.85</td>
<td align="center">0.67</td>
</tr>
<tr>
<td/>
<td align="left">Field map unwarping smoothed</td>
<td align="center">0.68</td>
<td align="center">0.86</td>
<td align="center">0.72</td>
<td align="center">0.67</td>
<td align="center">0.88</td>
<td align="center">0.70</td>
</tr>
<tr>
<td/>
<td align="left">Nonlinear registration unwarping</td>
<td align="center">0.77</td>
<td align="center">0.87</td>
<td align="center">0.79</td>
<td align="center">0.77</td>
<td align="center">0.87</td>
<td align="center">0.77</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>Figure <xref ref-type="fig" rid="F5">5</xref> shows the mean difference in FA calculated between time 1 and time 2 for Udall and Boekel. Red-yellow shades show areas where FA maps obtained using registration unwarping are more similar between time points, and blue shades show areas where FA maps obtained using field map unwarping are more similar between time points. All results are FWE-corrected at <italic>p</italic> &#x0003C; 0.05. In most areas of the brain, the registration unwarping shows greater similarity between time points than field map unwarping.</p>
<fig id="F5" position="float">
<label>Figure 5</label>
<caption><p><bold>Difference maps for the (A)</bold> Udall and <bold>(B)</bold> Boekel data sets, as measured by the difference in FA at two time points. Red-yellow voxels show where nonlinear registration to a structural image produces smaller differences between time points, and blue-light blue voxels indicate that the field map-based unwarping produces smaller differences between time points. All highlighted voxels are family-wise error (FWE)-corrected for multiple comparisons (<italic>p</italic> &#x0003C; 0.05).</p></caption>
<graphic xlink:href="fninf-11-00017-g0005.tif"/>
</fig>
</sec>
<sec sec-type="discussion" id="s4">
<title>Discussion</title>
<p>In this study, we found that distortion correction of diffusion data using the SyN algorithm implemented in ANTs resulted in higher reliability, both as measured after processing using TBSS and by examining mean difference scores (Figure <xref ref-type="fig" rid="F5">5</xref>), than using a field map for unwarping. This suggests that unwarping using nonlinear registration may be a reasonable choice, especially when no explicit method of distortion correction is available.</p>
<p>In contrast, results obtained simply by comparing MI scores were equivocal. Using MI scores themselves we would conclude that unwarping using nonlinear registration using ANTs could potentially be worse than doing no unwarping. However, in real analyses MI is not normally an outcome metric, and because the downstream effects of processing steps can be profound, it is important to consider each step in the context of the analysis one plans to conduct.</p>
<p>Specifically, we note that &#x0201C;secondary&#x0201D; processing effects on the data, such as smoothing due to resampling, can have a larger impact on downstream measures than the quality of the correction itself. For example, smoothing increases the reliability of TBSS results, in many cases more than the effect of distortion correction. Although the MI of the structural image and the FA map is larger with field map unwarping than with nonlinear registration unwarping, nonlinear registration unwarping still has the highest reliability in the TBSS pipeline and according to the mean difference in FA statistics across time points. This occurs because the mean FA maps at each time point end up being more similar to each other than to the structural image. Although smoothing increases the reliability of the data and decreases noise, it may also decrease sensitivity to detect important differences. This tradeoff must be considered when developing an analytic pipeline.</p>
<p>The difference in results obtained using the same unwarping pipeline on two different field map and diffusion data acquisitions reminds us that the quality of field map unwarping is only as good as the quality of the field map. The static magnetic field within a scanner can be easily measured using standard pulse sequences. One commonly used sequence acquires two gradient echoes with slightly differing TEs: for any collection of spins within a voxel, its phase difference between the two echoes is linearly proportional to its field offset. However, a certain amount of care is needed when setting up a field-mapping sequence. Firstly, the acquisition volume should be set to be the same FOV in all three directions as the DTI scans. Secondly, the shimming method should be the same for the field-map. These two settings are important as usually a scanner performs a field shimming step as part of its pre-scan procedure, which optimizes the shim over the requested FOV (or a manually defined region). If this region for the field-map is different from the region for the DTI scans, or the shimming method is different, then the actual shim will be different, and hence the field-map will not be measuring the field that exists for the DTI scans. Thus, of course, any subsequent use of this different field-map to correct the distortion in the DTI scans will be invalid.</p>
<p>The differences between the Boekel and Udall field maps are that the Boekel field map has a large &#x00394;TE, and that there is a field of view difference between the diffusion scan and the field map in the Boekel dataset. The parameter difference is a suboptimal design, and this is reflected in the lower reliability after unwarping.</p>
<p>To summarize, our recommendations for best practices for addressing susceptibility artifact correction using field maps are as follows:</p>
<p><underline>At Acquisition</underline>: To obtain a useful field map (i.e., one that measures the same magnetic field that is experienced by the diffusion weighted image, with the highest fidelity):</p>
<list list-type="order">
<list-item><p>The Field of View, number of slices, slice thickness (and slice gap if using a 2D sequence), and angulation must be the same as the diffusion MRI sequence. We prefer a 3D scan for greater signal to noise ratio (SNR), taking care to ensure that the 3D slice thickness is equal to the DTI slice thickness plus any slice gap. This ensures that the shimming process for the field map is over the same volume as the diffusion weighted image.</p></list-item>
<list-item><p>The first echo should be set to the shortest possible time, with the delta TE to 1 ms&#x02014;which allows for a &#x000B1;500 Hz range before phase-wrapping occurs, while still providing sufficient &#x0201C;dynamic range&#x0201D; for the observed frequency offsets.</p></list-item>
<list-item><p>The TR can be set to the shortest available, or lengthened, if a magnitude image with some T1 contrast is desired for use in an image registration pipeline is desired (see point 6).</p></list-item>
<list-item><p>The shimming method should be the same as the diffusion weighted scan(s), and preferably based on a pencil-beam and/or volume shimming method.</p></list-item>
<list-item><p>The field map should ideally be acquired after the diffusion-weighted scan(s), and any pre-scan steps set to a mode in which the shim values are taken from the previous diffusion scan, and not recalculated (points 1 and 4 help assure that no re-shimming is performed for the field map).</p></list-item>
<list-item><p>The acquired matrix should be set to the same resolution as the diffusion-weighted scan, or an integer multiple thereof. We have found that using a 256 &#x000D7; 256 matrix for the field map, compared with 128 &#x000D7; 128 matrix for the diffusion weighted scan, allows for the magnitude images from the field map to be used as a helpful intermediate step in registration from the DTI scans to high-resolution structural scans.</p></list-item>
</list>
<p>For pre-existing data sets:</p>
<list list-type="order">
<list-item><p>If a field map exists and conforms to the specifications above, it can be used to correct distortions. This approach should give the best correspondence of the unwarped diffusion image to anatomical images independent of subsequent processing steps.</p></list-item>
<list-item><p>If there is no field map, or if it is suboptimal, use nonlinear registration with ANTs to correct distortion.</p></list-item>
</list>
<p>Note that other acquisition-based methods for distortion correction, such as blip-up blip-down acquisition methods (Chang and Fitzpatrick, <xref ref-type="bibr" rid="B8">1992</xref>), may be superior to field map unwarping, but this comparison is beyond the scope of this article.</p>
<p>There are some limitations to our study. We used reliability data sets collected for purposes other than for this study. If we were designing a study with the sole purpose of exploring the efficacy of different unwarping techniques, we would subject the same individuals to different acquisition techniques designed to correct EPI distortions. We would also collect non-EPI acquired T2 contrast images to optimize registration. We would ensure that field maps were optimal with respect to the diffusion MRI scan. There are also other pipelines that we could have evaluated for unwarping and other parameters for nonlinear registration unwarping, which may be more effective for different data sets. Our evaluation focused on MI and reliability of FA maps. Different analyses may result in different conclusions.</p>
<p>However, our findings with these two data sets show that there is a clear benefit to distortion correction, and that correction with nonlinear registration using ANTs is a reasonable technique, which can be used with some confidence in the absence of field maps or field-reversed DTI acquisition.</p>
</sec>
<sec id="s6">
<title>Author Contributions</title>
<p>SW, TJG, TMM and WL: study conception and design; SW, DJP, JCG, WL, TJG and TMM: analysis and interpretation of data and drafting of manuscript; DJP, TJG and TMM: critical revision of the manuscript.</p>
</sec>
<sec id="s7">
<title>Conflict of Interest Statement</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</body>
<back>
<ack>
<p>This research was supported by grants from the National Institutes of Health 1RC4NS073008-01 and P50NS062684.</p>
</ack>
<sec sec-type="supplementary material" id="s8">
<title>Supplementary Material</title>
<p>The Supplementary Material for this article can be found online at: <ext-link ext-link-type="uri" xlink:href="http://journal.frontiersin.org/article/10.3389/fninf.2017.00017/full&#x00023;supplementary-material">http://journal.frontiersin.org/article/10.3389/fninf.2017.00017/full&#x00023;supplementary-material</ext-link></p>
<supplementary-material xlink:href="DataSheet_1.pdf" id="SM1" mimetype="application/pdf" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</sec>
<ref-list>
<title>References</title>
<ref id="B1"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Andersson</surname> <given-names>J. L.</given-names></name> <name><surname>Skare</surname> <given-names>S.</given-names></name> <name><surname>Ashburner</surname> <given-names>J.</given-names></name></person-group> (<year>2003</year>). <article-title>How to correct susceptibility distortions in spin-echo echo-planar images: application to diffusion tensor imaging</article-title>. <source>Neuroimage</source> <volume>20</volume>, <fpage>870</fpage>&#x02013;<lpage>888</lpage>. <pub-id pub-id-type="doi">10.1016/s1053-8119(03)00336-7</pub-id><pub-id pub-id-type="pmid">14568458</pub-id></citation></ref>
<ref id="B2"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Askren</surname> <given-names>M. K.</given-names></name> <name><surname>McAllister-Day</surname> <given-names>T. K.</given-names></name> <name><surname>Koh</surname> <given-names>N.</given-names></name> <name><surname>Mestre</surname> <given-names>Z.</given-names></name> <name><surname>Dines</surname> <given-names>J. N.</given-names></name> <name><surname>Korman</surname> <given-names>B. A.</given-names></name> <etal/></person-group>. (<year>2016</year>). <article-title>Using make for reproducible and parallel neuroimaging workflow and quality-assurance</article-title>. <source>Front. Neuroinform.</source> <volume>10</volume>:<fpage>2</fpage>. <pub-id pub-id-type="doi">10.3389/fninf.2016.00002</pub-id><pub-id pub-id-type="pmid">26869916</pub-id></citation></ref>
<ref id="B3"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Avants</surname> <given-names>B. B.</given-names></name> <name><surname>Epstein</surname> <given-names>C. L.</given-names></name> <name><surname>Grossman</surname> <given-names>M.</given-names></name> <name><surname>Gee</surname> <given-names>J. C.</given-names></name></person-group> (<year>2008</year>). <article-title>Symmetric diffeomorphic image registration with cross-correlation: evaluating automated labeling of elderly and neurodegenerative brain</article-title>. <source>Med. Image Anal.</source> <volume>12</volume>, <fpage>26</fpage>&#x02013;<lpage>41</lpage>. <pub-id pub-id-type="doi">10.1016/j.media.2007.06.004</pub-id><pub-id pub-id-type="pmid">17659998</pub-id></citation></ref>
<ref id="B4"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Avants</surname> <given-names>B. B.</given-names></name> <name><surname>Tustison</surname> <given-names>N. J.</given-names></name> <name><surname>Song</surname> <given-names>G.</given-names></name> <name><surname>Cook</surname> <given-names>P. A.</given-names></name> <name><surname>Klein</surname> <given-names>A.</given-names></name> <name><surname>Gee</surname> <given-names>J. C.</given-names></name></person-group> (<year>2011</year>). <article-title>A reproducible evaluation of ANTs similarity metric performance in brain image registration</article-title>. <source>Neuroimage</source> <volume>54</volume>, <fpage>2033</fpage>&#x02013;<lpage>2044</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuroimage.2010.09.025</pub-id><pub-id pub-id-type="pmid">20851191</pub-id></citation></ref>
<ref id="B5"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Basser</surname> <given-names>P. J.</given-names></name> <name><surname>Mattiello</surname> <given-names>J.</given-names></name> <name><surname>LeBihan</surname> <given-names>D.</given-names></name></person-group> (<year>1994</year>). <article-title>Estimation of the effective self-diffusion tensor from the NMR spin echo</article-title>. <source>J. Magn. Reson. B</source> <volume>103</volume>, <fpage>247</fpage>&#x02013;<lpage>254</lpage>. <pub-id pub-id-type="doi">10.1006/jmrb.1994.1037</pub-id><pub-id pub-id-type="pmid">8019776</pub-id></citation></ref>
<ref id="B6"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Boekel</surname> <given-names>W.</given-names></name> <name><surname>Forstmann</surname> <given-names>B. U.</given-names></name> <name><surname>Keuken</surname> <given-names>M. C.</given-names></name></person-group> (<year>2017</year>). <article-title>A test-retest reliability analysis of diffusion measures of white matter tracts relevant for cognitive control</article-title>. <source>Psychophysiology</source> <volume>54</volume>, <fpage>24</fpage>&#x02013;<lpage>33</lpage>. <pub-id pub-id-type="doi">10.1111/psyp.12769</pub-id><pub-id pub-id-type="pmid">28000260</pub-id></citation></ref>
<ref id="B7"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Boekel</surname> <given-names>W.</given-names></name> <name><surname>Wagenmakers</surname> <given-names>E. J.</given-names></name> <name><surname>Belay</surname> <given-names>L.</given-names></name> <name><surname>Verhagen</surname> <given-names>J.</given-names></name> <name><surname>Brown</surname> <given-names>S.</given-names></name> <name><surname>Forstmann</surname> <given-names>B. U.</given-names></name></person-group> (<year>2015</year>). <article-title>A purely confirmatory replication study of structural brain-behavior correlations</article-title>. <source>Cortex</source> <volume>66</volume>, <fpage>115</fpage>&#x02013;<lpage>133</lpage>. <pub-id pub-id-type="doi">10.1016/j.cortex.2014.11.019</pub-id><pub-id pub-id-type="pmid">25684445</pub-id></citation></ref>
<ref id="B8"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chang</surname> <given-names>H.</given-names></name> <name><surname>Fitzpatrick</surname> <given-names>J. M.</given-names></name></person-group> (<year>1992</year>). <article-title>A technique for accurate magnetic-resonance-imaging in the presence of field inhomogeneities</article-title>. <source>IEEE Trans. Med. Imaging</source> <volume>11</volume>, <fpage>319</fpage>&#x02013;<lpage>329</lpage>. <pub-id pub-id-type="doi">10.1109/42.158935</pub-id><pub-id pub-id-type="pmid">18222873</pub-id></citation></ref>
<ref id="B9"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cox</surname> <given-names>R. W.</given-names></name></person-group> (<year>1996</year>). <article-title>AFNI: software for analysis and visualization of functional magnetic resonance neuroimages</article-title>. <source>Comput. Biomed. Res.</source> <volume>29</volume>, <fpage>162</fpage>&#x02013;<lpage>173</lpage>. <pub-id pub-id-type="doi">10.1006/cbmr.1996.0014</pub-id><pub-id pub-id-type="pmid">8812068</pub-id></citation></ref>
<ref id="B10"><citation citation-type="other"><person-group person-group-type="author"><name><surname>David</surname> <given-names>N. K.</given-names></name></person-group> (<year>2006</year>). <source>3T DWI Test-Retest Reliability Dataset.</source> Available online at: <ext-link ext-link-type="uri" xlink:href="https://www.nitrc.org/projects/dwi_test-retest">https://www.nitrc.org/projects/dwi_test-retest</ext-link> </citation></ref>
<ref id="B11"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Huntenburg</surname> <given-names>J. M.</given-names></name></person-group> (<year>2014</year>). <source>Evaluating Nonlinear Coregistration of BOLD EPI and T1w Images.</source> <publisher-loc>Berlin</publisher-loc>: <publisher-name>Master Thesis, Freie Universit&#x000E4;t</publisher-name>.</citation></ref>
<ref id="B12"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Huntenburg</surname> <given-names>J. M.</given-names></name> <name><surname>Gorgolewski</surname> <given-names>K. J.</given-names></name> <name><surname>Anwander</surname> <given-names>A.</given-names></name></person-group> (<year>2014</year>). &#x0201C;<article-title>Evaluating nonlinear coregistration of BOLD EPI and T1 images</article-title>,&#x0201D; in <source>20th Annual Meeting of the Organization for Human Brain Mapping (OHBM)</source> (<conf-loc>Hamburg</conf-loc>).</citation></ref>
<ref id="B13"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Iglesias</surname> <given-names>J. E.</given-names></name> <name><surname>Liu</surname> <given-names>C. Y.</given-names></name> <name><surname>Thompson</surname> <given-names>P. M.</given-names></name> <name><surname>Tu</surname> <given-names>Z.</given-names></name></person-group> (<year>2011</year>). <article-title>Robust brain extraction across datasets and comparison with publicly available methods</article-title>. <source>IEEE Trans. Med. Imaging</source> <volume>30</volume>, <fpage>1617</fpage>&#x02013;<lpage>1634</lpage>. <pub-id pub-id-type="doi">10.1109/tmi.2011.2138152</pub-id><pub-id pub-id-type="pmid">21880566</pub-id></citation></ref>
<ref id="B14"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Jenkinson</surname> <given-names>M.</given-names></name></person-group> (<year>2013</year>). <source>TBSS User Guide.</source> Available online at: <ext-link ext-link-type="uri" xlink:href="http://fsl.fmrib.ox.ac.uk/fsl/fslwiki/TBSS/UserGuide">http://fsl.fmrib.ox.ac.uk/fsl/fslwiki/TBSS/UserGuide</ext-link></citation></ref>
<ref id="B15"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jezzard</surname> <given-names>P.</given-names></name> <name><surname>Balaban</surname> <given-names>R. S.</given-names></name></person-group> (<year>1995</year>). <article-title>Correction for geometric distortion in echo planar images from B0 field variations</article-title>. <source>Magn. Reson. Med.</source> <volume>34</volume>, <fpage>65</fpage>&#x02013;<lpage>73</lpage>. <pub-id pub-id-type="doi">10.1002/mrm.1910340111</pub-id><pub-id pub-id-type="pmid">7674900</pub-id></citation></ref>
<ref id="B16"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jones</surname> <given-names>D. K.</given-names></name> <name><surname>Cercignani</surname> <given-names>M.</given-names></name></person-group> (<year>2010</year>). <article-title>Twenty-five pitfalls in the analysis of diffusion MRI data</article-title>. <source>NMR Biomed.</source> <volume>23</volume>, <fpage>803</fpage>&#x02013;<lpage>820</lpage>. <pub-id pub-id-type="doi">10.1002/nbm.1543</pub-id><pub-id pub-id-type="pmid">20886566</pub-id></citation></ref>
<ref id="B17"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Madhyastha</surname> <given-names>T.</given-names></name> <name><surname>M&#x000E9;rillat</surname> <given-names>S.</given-names></name> <name><surname>Hirsiger</surname> <given-names>S.</given-names></name> <name><surname>Bezzola</surname> <given-names>L.</given-names></name> <name><surname>Liem</surname> <given-names>F.</given-names></name> <name><surname>Grabowski</surname> <given-names>T.</given-names></name> <etal/></person-group>. (<year>2014</year>). <article-title>Longitudinal reliability of tract-based spatial statistics in diffusion tensor imaging</article-title>. <source>Hum. Brain Mapp.</source> <volume>35</volume>, <fpage>4544</fpage>&#x02013;<lpage>4555</lpage>. <pub-id pub-id-type="doi">10.1002/hbm.22493</pub-id><pub-id pub-id-type="pmid">24700773</pub-id></citation></ref>
<ref id="B18"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Madhyastha</surname> <given-names>T. M.</given-names></name> <name><surname>Askren</surname> <given-names>M. K.</given-names></name> <name><surname>Boord</surname> <given-names>P.</given-names></name> <name><surname>Grabowski</surname> <given-names>T. J.</given-names></name></person-group> (<year>2015</year>). <article-title>Dynamic connectivity at rest predicts attention task performance</article-title>. <source>Brain Connect.</source> <volume>5</volume>, <fpage>45</fpage>&#x02013;<lpage>59</lpage>. <pub-id pub-id-type="doi">10.1089/brain.2014.0248</pub-id><pub-id pub-id-type="pmid">25014419</pub-id></citation></ref>
<ref id="B19"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Maes</surname> <given-names>F.</given-names></name> <name><surname>Collignon</surname> <given-names>A.</given-names></name> <name><surname>Vandermeulen</surname> <given-names>D.</given-names></name> <name><surname>Marchal</surname> <given-names>G.</given-names></name> <name><surname>Suetens</surname> <given-names>P.</given-names></name></person-group> (<year>1997</year>). <article-title>Multimodality image registration by maximization of mutual information</article-title>. <source>IEEE Trans. Med. Imaging</source> <volume>16</volume>, <fpage>187</fpage>&#x02013;<lpage>198</lpage>. <pub-id pub-id-type="doi">10.1109/42.563664</pub-id><pub-id pub-id-type="pmid">9101328</pub-id></citation></ref>
<ref id="B20"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mansfield</surname> <given-names>P.</given-names></name></person-group> (<year>1977</year>). <article-title>Multi-planar image-formation using NMR spin echoes</article-title>. <source>J. Phys. C-Solid State Phys.</source> <volume>10</volume>, <fpage>L55</fpage>&#x02013;<lpage>L58</lpage>. <pub-id pub-id-type="doi">10.1088/0022-3719/10/3/004</pub-id></citation></ref>
<ref id="B200"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>McGraw</surname> <given-names>K. O.</given-names></name> <name><surname>Wong</surname> <given-names>S. P.</given-names></name></person-group> (<year>1996</year>). <article-title>Forming inferences about some intraclass correlation coefficients</article-title>. <source>Psychol. Methods</source> <volume>1</volume>, <fpage>30</fpage>&#x02013;<lpage>46</lpage>. <pub-id pub-id-type="doi">10.1037/1082-989X.1.1.30</pub-id></citation></ref>
<ref id="B21"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Reber</surname> <given-names>P. J.</given-names></name> <name><surname>Wong</surname> <given-names>E. C.</given-names></name> <name><surname>Buxton</surname> <given-names>R. B.</given-names></name> <name><surname>Frank</surname> <given-names>L. R.</given-names></name></person-group> (<year>1998</year>). <article-title>Correction of off resonance-related distortion in echo-planar imaging using EPI-based field maps</article-title>. <source>Magn. Reson. Med.</source> <volume>39</volume>, <fpage>328</fpage>&#x02013;<lpage>330</lpage>. <pub-id pub-id-type="doi">10.1002/mrm.1910390223</pub-id><pub-id pub-id-type="pmid">9469719</pub-id></citation></ref>
<ref id="B23"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Smith</surname> <given-names>S. M.</given-names></name> <name><surname>Jenkinson</surname> <given-names>M.</given-names></name> <name><surname>Johansen-Berg</surname> <given-names>H.</given-names></name> <name><surname>Rueckert</surname> <given-names>D.</given-names></name> <name><surname>Nichols</surname> <given-names>T. E.</given-names></name> <name><surname>Mackay</surname> <given-names>C. E.</given-names></name> <etal/></person-group>. (<year>2006</year>). <article-title>Tract-based spatial statistics: voxelwise analysis of multi-subject diffusion data</article-title>. <source>Neuroimage</source> <volume>31</volume>, <fpage>1487</fpage>&#x02013;<lpage>1505</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuroimage.2006.02.024</pub-id><pub-id pub-id-type="pmid">16624579</pub-id></citation></ref>
<ref id="B22"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Smith</surname> <given-names>S. M.</given-names></name> <name><surname>Nichols</surname> <given-names>T. E.</given-names></name></person-group> (<year>2009</year>). <article-title>Threshold-free cluster enhancement: addressing problems of smoothing, threshold dependence and localisation in cluster inference</article-title>. <source>Neuroimage</source> <volume>44</volume>, <fpage>83</fpage>&#x02013;<lpage>98</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuroimage.2008.03.061</pub-id><pub-id pub-id-type="pmid">18501637</pub-id></citation></ref>
<ref id="B24"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wan</surname> <given-names>X.</given-names></name> <name><surname>Gullberg</surname> <given-names>G. T.</given-names></name> <name><surname>Parker</surname> <given-names>D. L.</given-names></name> <name><surname>Zeng</surname> <given-names>G. L.</given-names></name></person-group> (<year>1997</year>). <article-title>Reduction of geometric and intensity distortions in echo-planar imaging using a multireference scan</article-title>. <source>Magn. Reson. Med.</source> <volume>37</volume>, <fpage>932</fpage>&#x02013;<lpage>942</lpage>. <pub-id pub-id-type="doi">10.1002/mrm.1910370619</pub-id><pub-id pub-id-type="pmid">9178246</pub-id></citation></ref>
<ref id="B25"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wu</surname> <given-names>M.</given-names></name> <name><surname>Chang</surname> <given-names>L. C.</given-names></name> <name><surname>Walker</surname> <given-names>L.</given-names></name> <name><surname>Lemaitre</surname> <given-names>H.</given-names></name> <name><surname>Barnett</surname> <given-names>A. S.</given-names></name> <name><surname>Marenco</surname> <given-names>S.</given-names></name> <etal/></person-group>. (<year>2008</year>). <article-title>Comparison of EPI distortion correction methods in diffusion tensor MRI using a novel framework</article-title>. <source>Med. Image Comput. Comput. Assist. Interv.</source> <volume>11</volume>, <fpage>321</fpage>&#x02013;<lpage>329</lpage>. <pub-id pub-id-type="doi">10.1007/978-3-540-85990-1_39</pub-id><pub-id pub-id-type="pmid">18982621</pub-id></citation></ref>
<ref id="B26"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yendiki</surname> <given-names>A.</given-names></name> <name><surname>Koldewyn</surname> <given-names>K.</given-names></name> <name><surname>Kakunoori</surname> <given-names>S.</given-names></name> <name><surname>Kanwisher</surname> <given-names>N.</given-names></name> <name><surname>Fischl</surname> <given-names>B.</given-names></name></person-group> (<year>2014</year>). <article-title>Spurious group differences due to head motion in a diffusion MRI study</article-title>. <source>Neuroimage</source> <volume>88</volume>, <fpage>79</fpage>&#x02013;<lpage>90</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuroimage.2013.11.027</pub-id><pub-id pub-id-type="pmid">24269273</pub-id></citation></ref>
<ref id="B27"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zuo</surname> <given-names>X. N.</given-names></name> <name><surname>Anderson</surname> <given-names>J. S.</given-names></name> <name><surname>Bellec</surname> <given-names>P.</given-names></name> <name><surname>Birn</surname> <given-names>R. M.</given-names></name> <name><surname>Biswal</surname> <given-names>B. B.</given-names></name> <name><surname>Blautzik</surname> <given-names>J.</given-names></name> <etal/></person-group>. (<year>2014</year>). <article-title>An open science resource for establishing reliability and reproducibility in functional connectomics</article-title>. <source>Sci. Data</source> <volume>1</volume>:<fpage>140049</fpage>. <pub-id pub-id-type="doi">10.1360/n972015-01146</pub-id><pub-id pub-id-type="pmid">25977800</pub-id></citation></ref>
</ref-list>
</back>
</article>