<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Neuroinform.</journal-id>
<journal-title>Frontiers in Neuroinformatics</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Neuroinform.</abbrev-journal-title>
<issn pub-type="epub">1662-5196</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fninf.2014.00084</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Neuroscience</subject>
<subj-group>
<subject>Original Research Article</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Application of Parallel Factor Analysis (PARAFAC) to electrophysiological data</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Schmitz</surname> <given-names>S. Katharina</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<xref ref-type="author-notes" rid="fn001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://community.frontiersin.org/people/u/7233"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Hasselbach</surname> <given-names>Philipp P.</given-names></name>
<xref ref-type="aff" rid="aff4"><sup>4</sup></xref>
</contrib>
<contrib contrib-type="author">
<name><surname>Ebisch</surname> <given-names>Boris</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
</contrib>
<contrib contrib-type="author">
<name><surname>Klein</surname> <given-names>Anja</given-names></name>
<xref ref-type="aff" rid="aff4"><sup>4</sup></xref>
</contrib>
<contrib contrib-type="author">
<name><surname>Pipa</surname> <given-names>Gordon</given-names></name>
<xref ref-type="aff" rid="aff5"><sup>5</sup></xref>
<uri xlink:href="http://community.frontiersin.org/people/u/4053"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Galuske</surname> <given-names>Ralf A. W.</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://community.frontiersin.org/people/u/31082"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Systems Neurophysiology, Department of Biology, Technische Universit&#x000E4;t Darmstadt</institution> <country>Darmstadt, Germany</country></aff>
<aff id="aff2"><sup>2</sup><institution>Department of Neurophysiology, Max Planck Institute for Brain Research</institution> <country>Frankfurt, Germany</country></aff>
<aff id="aff3"><sup>3</sup><institution>Frankfurt Institute for Advanced Studies, Johann Wolfgang Goethe University</institution> <country>Frankfurt, Germany</country></aff>
<aff id="aff4"><sup>4</sup><institution>Communications Engineering Lab, Technische Universit&#x000E4;t Darmstadt</institution> <country>Darmstadt, Germany</country></aff>
<aff id="aff5"><sup>5</sup><institution>Department of Neuroinformatics, Institute of Cognitive Science, Universit&#x000E4;t Osnabr&#x000FC;ck</institution> <country>Osnabr&#x000FC;ck, Germany</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Sean L. Hill, International Neuroinformatics Coordinating Facility (INCF), Sweden</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Andrew P. Davison, Centre National de la Recherche Scientifique, France; Christophe Pouzat, Centre National de la Recherche Scientifique and Paris-Descartes University, France</p></fn>
<fn fn-type="corresp" id="fn001"><p>&#x0002A;Correspondence: S. Katharina Schmitz, Systems Neurophysiology, Department of Biology, Technische Universit&#x000E4;t Darmstadt, Schnittspahnstra&#x000DF;e 3, 64287 Darmstadt, Germany e-mail: <email>schmitz&#x00040;bio.tu-darmstadt.de</email></p></fn>
<fn fn-type="other" id="fn002"><p>This article was submitted to the journal Frontiers in Neuroinformatics.</p></fn>
</author-notes>
<pub-date pub-type="epub">
<day>30</day>
<month>01</month>
<year>2015</year>
</pub-date>
<pub-date pub-type="collection">
<year>2014</year>
</pub-date>
<volume>8</volume>
<elocation-id>84</elocation-id>
<history>
<date date-type="received">
<day>11</day>
<month>02</month>
<year>2014</year>
</date>
<date date-type="accepted">
<day>01</day>
<month>12</month>
<year>2014</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2015 Schmitz, Hasselbach, Ebisch, Klein, Pipa and Galuske.</copyright-statement>
<copyright-year>2015</copyright-year>
<license license-type="open-access" xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p>
</license>
</permissions>
<abstract><p>The identification of important features in multi-electrode recordings requires the decomposition of data in order to disclose relevant features and to offer a clear graphical representation. This can be a demanding task. Parallel Factor Analysis (PARAFAC; Hitchcock, 1927; Carrol and Chang, 1970; Harshman, 1970) is a method to decompose multi-dimensional arrays in order to focus on the features of interest, and provides a distinct illustration of the results. We applied PARAFAC to analyse spatio-temporal patterns in the functional connectivity between neurons, as revealed in their spike trains recorded in cat primary visual cortex (area 18). During these recordings we reversibly deactivated feedback connections from higher visual areas in the pMS (posterior middle suprasylvian) cortex in order to study the impact of these top-down signals. Cross correlation was computed for every possible pair of the 16 electrodes in the electrode array. PARAFAC was then used to reveal the effects of time, stimulus, and deactivation condition on the correlation patterns. Our results show that PARAFAC is able to reliably extract changes in correlation strength for different experimental conditions and display the relevant features. Thus, PARAFAC proves to be well-suited for the use in the context of electrophysiological (action potential) recordings.</p></abstract>
<kwd-group>
<kwd>parallel factor analysis</kwd>
<kwd>principal component analysis</kwd>
<kwd>cross correlation</kwd>
<kwd>cat primary visual cortex</kwd>
<kwd>cortical deactivation</kwd>
</kwd-group>
<counts>
<fig-count count="6"/>
<table-count count="0"/>
<equation-count count="5"/>
<ref-count count="31"/>
<page-count count="10"/>
<word-count count="7108"/>
</counts>
</article-meta>
</front>
<body>
<sec sec-type="introduction" id="s1">
<title>1. Introduction</title>
<p>Action potentials are the means of information transmission between neurons. Even though we have a broad knowledge about action potentials on the single-cell level (Bean, <xref ref-type="bibr" rid="B2">2007</xref>), a thorough understanding of the principles of the neuronal code as a whole has not yet been achieved. In order to obtain a better insight into this challenging question, numerous different approaches have been used. Many of them take advantage of the possibility of simultaneous multi-electrode recordings (Buzs&#x000E1;ki, <xref ref-type="bibr" rid="B5">2004</xref>). Synchronous firing of action potentials is believed to be one of the crucial mechanisms of information coding in the brain (for reviews see Singer, <xref ref-type="bibr" rid="B28">1999</xref>; Uhlhaas et al., <xref ref-type="bibr" rid="B31">2009</xref>). Hence, the examination of the temporal structure of spike trains (sequences of action potentials) and the detection of correlations among the signals of multi-electrode recordings can provide fundamental insights into presumptive coding strategies. To this end, the temporal structure in parallel recordings of spike trains has been used to assess the flow of information among neurons (Gr&#x000FC;n et al., <xref ref-type="bibr" rid="B9">2002</xref>; Pipa et al., <xref ref-type="bibr" rid="B24">2008</xref>).</p>
<p>Different phenomena in the spiking activities of different neuron groups can be relevant for analysis. In the present study, we focus on two issues: First, the correlation of the spiking activities of different groups of neurons, which can be identified by a peak in the cross correlogram and is termed <italic>synchrony</italic>, second at periodically appearing correlation in the spiking activities, called <italic>oscillatory synchrony</italic>.</p>
<p>Since analysis of synchronous events becomes more demanding as soon as more than two event sources are considered, techniques that are able to identify synchrony among multiple simultaneously active sources are of great interest. In the present study, we use PARAllel FACtor analysis (PARAFAC) to assess the effects of deactivation of higher visual areas on patterns of spike synchronization in area 18 in cats (see Materials and Methods Section). PARAFAC is a multi-dimensional decomposition method that generalizes the bilinear principal component analysis (PCA) (Jolliffe, <xref ref-type="bibr" rid="B13">2002</xref>) to higher order arrays. The method goes back to Hitchcock (Hitchcock, <xref ref-type="bibr" rid="B12">1927</xref>) and was further developed simultaneously by Harshman Harshman (<xref ref-type="bibr" rid="B11">1970</xref>) and Carrol and Chang (Carroll and Chang, <xref ref-type="bibr" rid="B6">1970</xref>), in the latter case called CANDECOMP (CANonical DECOMPosition). The same method has also been referred to as CPD (Canonical Polyadic Decomposition).</p>
<p>Here, we applied PARAFAC to three-dimensional arrays. A three-dimensional array can be simply viewed as a set of two-dimensional matrices of the same size. An example for a two-dimensional data array could be some measured variable, say the concentration of ozone (<italic>O</italic><sub>3</sub>) in the air, at different times of the day in different geographical locations. Two-way arrays of this kind are often decomposed using (bilinear) Principal Component Analysis (PCA). Imagine you are now interested in the ozone concentration not only at certain times and geographical coordinates, but also at different altitudes. The measurements now become dependent on three variables, and your array three-dimensional. PCA cannot be applied to three-dimensional structures as it is inherently bilinear. If unfolded, the array can be subjected to PCA, but loses its true three-dimensional structure. PARAFAC is able to work directly on the three-dimensional array and thus capture its true composition. An alternative to PARAFAC can be provided by the Tucker3 algorithm, which is essentially a more flexible version of PARAFAC, meaning that any data set that can be modeled with PARAFAC can also be modeled with Tucker3 (Kiers, <xref ref-type="bibr" rid="B14">1991</xref>; Bro, <xref ref-type="bibr" rid="B4">1997</xref>). These methods can also be extended to n-way arrays with <italic>n</italic> &#x0003E; 3.</p>
<p>In general, there is not one best method, but one has to explore, which one is best for a given dataset. We chose PARAFAC as it was able to extract important information from our data and the approach could be validated by the amount of variance explained and a split-half analysis. PARAFAC is constrained to consider only full multiplicative interactions among the different dimensions, leading to simple mathematical models. The solution obtained by application of PARAFAC is unique, in contrast to PCA, where rotational freedom exists, which allows results to be rotated without reducing the quality of the modeling (Bro, <xref ref-type="bibr" rid="B4">1997</xref>). Thus, PARAFAC enables robust multi-dimensional analyses that lead to a simple and clear interpretation. PARAFAC was first developed for application in psycho- and chemometric settings. In neuroscience, the method has been applied in EEG (Miwakeichi et al., <xref ref-type="bibr" rid="B20">2004</xref>; M&#x000F8;rup et al., <xref ref-type="bibr" rid="B19">2006</xref>) and fMRI (Beckmann and Smith, <xref ref-type="bibr" rid="B3">2005</xref>) studies. However, it has so far not been tested on action potential recordings.</p>
</sec>
<sec sec-type="materials and methods" id="s2">
<title>2. Materials and methods</title>
<sec>
<title>2.1. Experimental methods</title>
<p>The analyzed dataset was collected in the course of a series of experiments investigating the role of feedback connections from the posterior middle suprasylvian (pMS) cortex to primary visual areas, in this case area 18 in the cat visual system. To this end, pMS cortex was thermally deactivated using cryoloops (Lomber et al., <xref ref-type="bibr" rid="B17">1999</xref>), while spontaneous or visually evoked activity was recorded in area 18. This procedure is reversible and can therefore be applied numerous times without harming the deactivated brain area. There were four different deactivation conditions: (1) warm, i.e., no deactivation, (2) deactivation of pMS in the ipsilateral hemisphere with respect to the recording, (3) deactivation of pMS in the contralateral hemisphere, and (4) bilateral deactivation of pMS cortex. In the awake behaving animal it has been shown that unilateral deactivation of the pMS cortex results in visual hemineglect (Payne et al., <xref ref-type="bibr" rid="B23">1996</xref>), similar to that described in human patients with a lesion in the parietal cortex (e.g., Rafal, <xref ref-type="bibr" rid="B25">1994</xref>).</p>
<p>Interestingly, and also in accordance to findings in the human, this hemineglect in cats occurs only with unilateral lesions or deactivations of parietal cortex and is reversible once both parietal cortices are deactivated. Thus, this hemineglect phenomenon has to be seen as an attention deficit based on an interhemispheric imbalance rather than a form of blindness.</p>
<p>We applied the analysis methods described below to electrophysiological action potential recordings. For details on the surgical procedures and anesthesia see Galuske et al. (<xref ref-type="bibr" rid="B8">2002</xref>). Data were collected in an anesthetized male cat aged <inline-formula><mml:math id="M6"><mml:mrow><mml:mn>1</mml:mn><mml:mfrac><mml:mn>1</mml:mn><mml:mn>2</mml:mn></mml:mfrac></mml:mrow></mml:math></inline-formula> years, using an Eckhorn multi-electrode matrix (Thomas Recording, Germany). Sixteen electrodes were placed in area 18 of cat visual cortex, with a distance of 500 &#x003BC;m in the x-y-plane, and individually moveable in the z-direction. Spike signals were recorded with a sampling rate of 22 kHz and band-pass filtered (800&#x02013;5000 Hz). Multi-unit spike signals were obtained by thresholding. In addition, cooling loops (Lomber et al., <xref ref-type="bibr" rid="B17">1999</xref>) had been placed over pMS cortex in order to induce a reversible deactivation of this region.</p>
<p>The animal was visually stimulated with a black and white high contrast square wave grating. The grating was presented in four different orientations (0&#x000B0;, 45&#x000B0;, 90&#x000B0;, 135&#x000B0;), which moved in either of the two directions perpendicular to the bars of the grating. Hence, eight different stimulus conditions were possible and the order of occurrence of the stimulus conditions was pseudo-randomized. Visual stimulation started with showing a gray screen for 2 s followed by one of the four differently oriented gratings remaining stationary for 2 s before the grating started moving for 4 s. Thus, one trial lasted for 8 s.</p>
<p>One cycle of the experiment consisted in showing 7 repetitions of each of the 8 stimuli in random order. The whole experiment consisted of 3 cycles baseline condition without deactivation, 3 cycles with thermal deactivation, followed by 3 cycles without deactivation after the affected regions of the brain had rewarmed.</p>
<p>All animal experiments were performed in accordance with the guidelines for the use of animals in research of the Society for Neuroscience and the local authorities and overseen by a local veterinarian (license number F122/08, Regierungspr&#x000E4;sidium Darmstadt).</p>
</sec>
<sec>
<title>2.2. Synchrony and oscillatory synchrony</title>
<p>Two different metrics were established in order to quantify the degree of synchrony and oscillatory synchrony. Since both phenomena are identified using the correlogram, both metrics are based on the correlogram.</p>
<p>Spike trains were stored as binary vectors with sampling frequency resolution. Ones occurred where a sample value exceeded the chosen threshold and the sample before did not. For the calculation of cross correlations, a binning of 2 ms was introduced.</p>
<p>For the synchrony measure, the cross correlogram &#x003BB;<sup>raw</sup><sub><italic>xy</italic></sub> of the spike trains <bold>x</bold> and <bold>y</bold> of two multi-units in the analysis window <italic>T</italic> was computed:</p>
<disp-formula id="E1"><label>(1)</label><mml:math id="M1"><mml:mrow><mml:msubsup><mml:mi>&#x003BB;</mml:mi><mml:mrow><mml:mi>x</mml:mi><mml:mi>y</mml:mi></mml:mrow><mml:mrow><mml:mtext>raw</mml:mtext></mml:mrow></mml:msubsup><mml:mrow><mml:mo>(</mml:mo><mml:mi>&#x003C4;</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mo>:</mml:mo><mml:mo>=</mml:mo><mml:mstyle displaystyle='true'><mml:munder><mml:mo>&#x02211;</mml:mo><mml:mrow><mml:mi>t</mml:mi><mml:mo>&#x02208;</mml:mo><mml:mi>T</mml:mi></mml:mrow></mml:munder><mml:mi>x</mml:mi></mml:mstyle><mml:mo stretchy='false'>(</mml:mo><mml:mi>t</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:mi>y</mml:mi><mml:mo stretchy='false'>(</mml:mo><mml:mi>t</mml:mi><mml:mo>+</mml:mo><mml:mi>&#x003C4;</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:mo>.</mml:mo></mml:mrow></mml:math></disp-formula>
<p>To correct for rate induced chance coincidences, we normalized the correlograms to the firing rate. To this end, the spikes in the spike trains were convolved with a &#x0201C;jitter kernel&#x0201D; and the resulting cross correlogram was subtracted from the raw correlogram &#x003BB;<sup>raw</sup><sub><italic>xy</italic></sub>. To implement a computationally efficient jitter correction, we rely on convolution with a homogeneous filter with entries <inline-formula><mml:math id="M7"><mml:mrow><mml:mfrac><mml:mrow><mml:msub><mml:mi>T</mml:mi><mml:mrow><mml:mtext>sample</mml:mtext></mml:mrow></mml:msub></mml:mrow><mml:mrow><mml:msub><mml:mi>T</mml:mi><mml:mrow><mml:mtext>jitter</mml:mtext></mml:mrow></mml:msub></mml:mrow></mml:mfrac></mml:mrow></mml:math></inline-formula>, with <italic>T</italic><sub>sample</sub> the time interval between two samples, which corresponds to jittering the spike train randomly within a time interval of <italic>T</italic><sub>jitter</sub> &#x0003D; 6 ms. The jittered spike train <inline-formula><mml:math id="M8"><mml:mover accent='true'><mml:mi>x</mml:mi><mml:mo>&#x002DC;</mml:mo></mml:mover></mml:math></inline-formula> was thus obtained from spike train <italic>x</italic> according to <inline-formula><mml:math id="M10"><mml:mover accent='true'><mml:mi>x</mml:mi><mml:mo>&#x002DC;</mml:mo></mml:mover></mml:math></inline-formula>:&#x0003D; <italic>K</italic> &#x0002A; <italic>x</italic>, where &#x0002A; denotes the convolution. A correlogram was then computed from the two convolved spike trains and subtracted from the original correlogram, to obtain the normalized correlogram &#x003BB;<sub><italic>xy</italic></sub>:&#x0003D; &#x003BB;<sup>raw</sup><sub><italic>xy</italic></sub> &#x02212; &#x003BB;<sup>jitter</sup><sub><italic>xy</italic></sub>. The convolution approach is equivalent to the random drawing of jitter times from a uniform distribution (following the Wiener-Khinchin theorem, see also Pipa et al., <xref ref-type="bibr" rid="B24">2008</xref>).</p>
<p>The degree of synchrony was measured by the largest positive peak in the normalized correlogram within a window of size <italic>T</italic><sub>sync</sub> &#x0003D; 5 ms around a lag of zero. The synchrony metric &#x003BA;<sub>sync</sub> is thus defined as follows. Let <inline-formula><mml:math id="M9"><mml:mrow><mml:mi>&#x003BA;</mml:mi><mml:mo>=</mml:mo><mml:munder><mml:mrow><mml:mi>max</mml:mi></mml:mrow><mml:mrow><mml:mi>l</mml:mi><mml:mo>,</mml:mo><mml:mi>l</mml:mi><mml:mo>&#x02208;</mml:mo><mml:mo stretchy='false'>[</mml:mo><mml:mo>&#x02212;</mml:mo><mml:mn>5</mml:mn><mml:mo>&#x000A0;</mml:mo><mml:mtext>ms</mml:mtext><mml:mo>,</mml:mo><mml:mn>5</mml:mn><mml:mo>&#x000A0;</mml:mo><mml:mtext>ms</mml:mtext><mml:mo stretchy='false'>]</mml:mo></mml:mrow></mml:munder><mml:msub><mml:mi>&#x003BB;</mml:mi><mml:mrow><mml:mi>x</mml:mi><mml:mi>y</mml:mi></mml:mrow></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mi>l</mml:mi><mml:mo stretchy='false'>)</mml:mo></mml:mrow></mml:math></inline-formula>. Then,</p>
<disp-formula id="E2"><label>(2)</label><mml:math id="M2"><mml:mrow><mml:msub><mml:mi>&#x003BA;</mml:mi><mml:mrow><mml:mtext>sync</mml:mtext></mml:mrow></mml:msub><mml:mo>:</mml:mo><mml:mo>=</mml:mo><mml:mrow><mml:mo>{</mml:mo><mml:mrow><mml:mtable columnalign='left'><mml:mtr columnalign='left'><mml:mtd columnalign='left'><mml:mrow><mml:mi>&#x003BA;</mml:mi><mml:mo>,</mml:mo></mml:mrow></mml:mtd><mml:mtd columnalign='left'><mml:mrow><mml:mtext>&#x000A0;if&#x000A0;</mml:mtext><mml:mi>&#x003BA;</mml:mi><mml:mo>&#x02265;</mml:mo><mml:mn>0</mml:mn></mml:mrow></mml:mtd></mml:mtr><mml:mtr columnalign='left'><mml:mtd columnalign='left'><mml:mn>0</mml:mn></mml:mtd><mml:mtd columnalign='left'><mml:mrow><mml:mtext>&#x000A0;else</mml:mtext><mml:mo>.</mml:mo><mml:mtext>&#x000A0;</mml:mtext></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:mrow></mml:mrow></mml:mrow></mml:math></disp-formula>
<p>In addition to the synchrony measure, we looked at the oscillatory synchrony between the spike trains. The degree of oscillatory synchrony can be determined by considering how much energy is contained in the oscillations of the correlogram in a chosen frequency range. To this end, the correlogram &#x003BB;<sub><italic>xy</italic></sub> was subjected to an N-point Discrete Fourier Transform (DFT) (Oppenheim et al., <xref ref-type="bibr" rid="B21">1996</xref>), in order to extract the frequencies of interest.</p>
<p>The oscillatory synchrony &#x003BA;<sub>oscsync</sub> was then set as the relative power of the signal in a chosen frequency range between <italic>f</italic><sub>min</sub> and <italic>f</italic><sub>max</sub>:</p>
<disp-formula id="E3"><label>(3)</label><mml:math id="M3"><mml:mrow><mml:msub><mml:mi>&#x003BA;</mml:mi><mml:mrow><mml:mtext>oscsync</mml:mtext></mml:mrow></mml:msub><mml:mo>:</mml:mo><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mstyle displaystyle='true'><mml:msubsup><mml:mo>&#x02211;</mml:mo><mml:mrow><mml:mi>m</mml:mi><mml:mo>=</mml:mo><mml:msub><mml:mi>f</mml:mi><mml:mrow><mml:mtext>min</mml:mtext></mml:mrow></mml:msub></mml:mrow><mml:mrow><mml:msub><mml:mi>f</mml:mi><mml:mrow><mml:mtext>max</mml:mtext></mml:mrow></mml:msub></mml:mrow></mml:msubsup><mml:mi>D</mml:mi></mml:mstyle><mml:mi>F</mml:mi><mml:msubsup><mml:mi>T</mml:mi><mml:mrow><mml:msub><mml:mi>&#x003BB;</mml:mi><mml:mrow><mml:mi>x</mml:mi><mml:mi>y</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mn>2</mml:mn></mml:msubsup><mml:mo stretchy='false'>(</mml:mo><mml:mi>m</mml:mi><mml:mo stretchy='false'>)</mml:mo></mml:mrow><mml:mrow><mml:mstyle displaystyle='true'><mml:msubsup><mml:mo>&#x02211;</mml:mo><mml:mrow><mml:mi>n</mml:mi><mml:mo>=</mml:mo><mml:mn>0</mml:mn></mml:mrow><mml:mrow><mml:mi>N</mml:mi><mml:mo>&#x02212;</mml:mo><mml:mn>1</mml:mn></mml:mrow></mml:msubsup><mml:mi>D</mml:mi></mml:mstyle><mml:mi>F</mml:mi><mml:msubsup><mml:mi>T</mml:mi><mml:mrow><mml:msub><mml:mi>&#x003BB;</mml:mi><mml:mrow><mml:mi>x</mml:mi><mml:mi>y</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mn>2</mml:mn></mml:msubsup><mml:mo stretchy='false'>(</mml:mo><mml:mi>n</mml:mi><mml:mo stretchy='false'>)</mml:mo></mml:mrow></mml:mfrac><mml:mo>.</mml:mo></mml:mrow></mml:math></disp-formula>
<sec>
<title>2.2.1. The PARAFAC model</title>
<p>PARAFAC is based on a mathematical model that represents the interactions of the dimensions in which the input data is to be analyzed. In order to carry out PARAFAC, the analysis dimensions have to be defined first. Each input value can then be related to an index for each of the dimensions. Assuming <italic>N</italic> &#x0003D; 3 dimensions, for example, <italic>x<sub>ijk</sub></italic> identifies the measured value for index i in the first dimension, j in the second dimension and k in the third dimension. In our case, the three dimensions are constituted by three experimental variables: electrode pair, stimulus, and repetition/trial. The correlation values &#x003BA;<sub>sync</sub> are obtained by the procedure explained above and used as an input into the three-dimensional array. They are placed at the location corresponding to the experimental condition they were obtained for (electrode pair &#x000D7; stimulus &#x000D7; repetition/trial).</p>
<p>PARAFAC is now used to model this input array. Let F denote the number of so-called components and define so-called loading matrices A, B, and C of dimensions <italic>I</italic> &#x000D7; <italic>F</italic>, <italic>J</italic> &#x000D7; <italic>F</italic>, and <italic>K</italic> &#x000D7; <italic>F</italic> and with elements <italic>a<sub>if</sub></italic>, <italic>b<sub>jf</sub></italic>, and <italic>c<sub>kf</sub></italic>, respectively, and the modeling error &#x003B5;<sub><italic>ijk</italic></sub>. The general model used by PARAFAC to represent the input data is then given by (Bro, <xref ref-type="bibr" rid="B4">1997</xref>)</p>
<disp-formula id="E4"><label>(4)</label><mml:math id="M4"><mml:mrow><mml:msub><mml:mi>x</mml:mi><mml:mrow><mml:mi>i</mml:mi><mml:mi>j</mml:mi><mml:mi>k</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mstyle displaystyle='true'><mml:munderover><mml:mo>&#x02211;</mml:mo><mml:mrow><mml:mi>f</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>F</mml:mi></mml:munderover><mml:mrow><mml:msub><mml:mi>a</mml:mi><mml:mrow><mml:mi>i</mml:mi><mml:mi>f</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:mstyle><mml:msub><mml:mi>b</mml:mi><mml:mrow><mml:mi>j</mml:mi><mml:mi>f</mml:mi></mml:mrow></mml:msub><mml:msub><mml:mi>c</mml:mi><mml:mrow><mml:mi>k</mml:mi><mml:mi>f</mml:mi></mml:mrow></mml:msub><mml:mo>+</mml:mo><mml:msub><mml:mi>&#x003B5;</mml:mi><mml:mrow><mml:mi>i</mml:mi><mml:mi>j</mml:mi><mml:mi>k</mml:mi></mml:mrow></mml:msub><mml:mo>.</mml:mo></mml:mrow></mml:math></disp-formula>
<p>A graphical illustration of the model is given in Figure <xref ref-type="fig" rid="F1">1</xref>.</p>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p><bold>Illustration of the PARAFAC model</bold>. The three-dimensional array containing the cross correlation information for each electrode pair, stimulus, and repetition, is decomposed into a sum of products of three factors, called <italic>loadings</italic>, which build up the <italic>loading matrices</italic> A, B, and C. Modified with permission from Miwakeichi et al. (<xref ref-type="bibr" rid="B20">2004</xref>).</p></caption>
<graphic xlink:href="fninf-08-00084-g0001.tif"/>
</fig>
<p>PARAFAC thus constrains the interactions between the different dimensions to the complete multiplicative interaction. The loading vectors are determined by minimizing the modeling error &#x003B5;<sub><italic>ijk</italic></sub>. This minimization can be carried out using the alternating least squares (ALS) approach, for example. ALS iteratively determines the loading matrices A, B, and C by the following algorithm (Bro, <xref ref-type="bibr" rid="B4">1997</xref>):
<list list-type="order">
<list-item><p>Choose the number of components, F (on the choice of F see next paragraph)</p></list-item>
<list-item><p>Initialize B and C</p></list-item>
<list-item><p>Estimate A from X, B, and C by least squares regression to minimize the square of the model error</p></list-item>
<list-item><p>Estimate B likewise</p></list-item>
<list-item><p>Estimate C likewise</p></list-item>
<list-item><p>Repeat from (3) until the algorithm converges (indicated by only little changes in fit or loadings)</p></list-item>
</list></p>
<p>The choice of the number <italic>F</italic> of components is difficult and no technique giving clear values has been identified yet. If <italic>F</italic> is chosen too small, not all effects in the input data can be identified. If <italic>F</italic> is chosen too large, however, noise is modeled increasingly and the existing effects in the data will be modeled by correlated components. Different approaches for estimation of the best value for <italic>F</italic> exist (Bro, <xref ref-type="bibr" rid="B4">1997</xref>). The approach taken in this work was to increase the number <italic>F</italic> of components until the decrease in the residual error decayed significantly. The model with the optimal number of components was then determined to be the one which was able to explain the highest amount of variance without any of the components being correlated. The quality of the analysis results of multilinear variation strongly depends on the preprocessing of the input data. Possible preprocessing strategies are centering and scaling (see Bro, <xref ref-type="bibr" rid="B4">1997</xref>): centering removes a non-zero mean from the data. A complete centering of the input data in all dimensions can be achieved by taking the result of the previous centering and center it in the next dimension. Scaling adjusts the variations in each of the dimensions to comparable magnitudes. Note that in contrast to centering, subsequent scaling of several modes is problematic since scaling one mode affects the scaling of other modes as well as the centering of the same mode. For this reason, centering should be carried out after scaling. Iterative approaches that can achieve a scaling of all modes are available (Bro, <xref ref-type="bibr" rid="B4">1997</xref>). In this study, the data were centered in all dimensions. No scaling of the data was carried out.</p>
</sec>
</sec>
<sec>
<title>2.3. Validation</title>
<p>The verification of the results obtained with the PARAFAC model of (5) was achieved by carrying out so-called split-half experiments (Harshman and Lundy, <xref ref-type="bibr" rid="B10">1994</xref>). To this end, the set of input data is split into two halves and PARAFAC is carried out for both halves independently. The model is considered to be applicable if the results gained from both halves are similar. In this work, several split-half experiments were carried out, splitting the input data set into odd and even trials.</p>
</sec>
<sec>
<title>2.4. PCA</title>
<p>We use the trilinear PARAFAC model because we assume the data to be (at least) trilinear. To show that a bilinear model, such as principal component analysis (PCA), is not adequate in this context, we also decomposed the correlation matrices using PCA and compared the results. PCA is a widely used technique. An introduction can be found in Jolliffe (<xref ref-type="bibr" rid="B13">2002</xref>). In order to make the data array accessible for PCA, it was unfolded into a two-dimensional structure.</p>
</sec>
</sec>
<sec sec-type="results" id="s3">
<title>3. Results</title>
<p>To demonstrate the application of PARAFAC to multiunit spiking data, we applied the algorithm to an example dataset obtained in the experiment described above. PARAFAC was carried out in MATLAB (The Mathworks, Inc., Natick, MA) using the N-way toolbox developed by Andersson and Bro (Andersson and Bro, <xref ref-type="bibr" rid="B1">2000</xref>, available at <ext-link ext-link-type="uri" xlink:href="http://www.models.life.ku.dk/nwaytoolbox/">http://www.models.life.ku.dk/nwaytoolbox/</ext-link>). The customized program code is available as Supplementary Material on the article website. Figure <xref ref-type="fig" rid="F2">2A</xref> illustrates the synchrony measure, &#x003BA;<sub><italic>sync</italic></sub>, for one experimental session (three stimulus directions are shown).</p>
<fig id="F2" position="float">
<label>Figure 2</label>
<caption><p><bold>PARAFAC visualization</bold>. <bold>(A)</bold> Depicts the &#x003BA;<sub><italic>sync</italic></sub> measure for the three stimuli with the highest correlated activity. For each stimulus, seven repetitions are shown. &#x003BA;<sub><italic>sync</italic></sub>, expressing correlation strength, is color-coded, see color bar. The correlations correspond to repetitions 43&#x02013;49 (rewarm phase) in <bold>(B)</bold> and <bold>(C)</bold> (see gray shaded areas). The values &#x003BA;<sub><italic>sync</italic></sub> (electrode pair, stimulus, repetition) are subject to the PARAFAC analysis. <bold>(B)</bold> Shows the results of a 3D PARAFAC analysis for the choice of the dimensions electrode pairs, stimulus directions, and repetitions of the stimulus in a session with bilateral pMS deactivation. The algorithm was carried out with four factors. <bold>(C)</bold> shows the PARAFAC result for a calculation with six factors for the same dataset as in <bold>(B)</bold>. Note that for each factor, a new aspect of the correlation structure becomes visible, as contributions of new electrode pairs and stimuli emerge. The plots are to be interpreted in the following way: Values from the original array containing the values of &#x003BA;<sub><italic>sync</italic></sub> for the three conditions electrode pair, stimulus, and repetition are factorized into loadings for a number of factors that is chosen beforehand. To obtain the original values (but for a small error), the loadings for one factor are multiplied and then added over all factors. Loadings belonging to the same factor are marked in the same color. The dark blue factor in the third panel of <bold>(B)</bold> has the highest loading values for this phase. The electrode pairs and stimuli for which this finding holds are the ones whose dark blue factor also takes high loading values. This points to the fact that stimulus 5 (vertical grating, movement to the left) leads to the highest correlation values during this phase of the experiment, mostly for electrode pairs 45 and 72 (upper panel). The pairs emphasized by the PARAFAC loadings are the same ones that repeatedly show high correlation values in <bold>(A)</bold>, but their contribution is much more easily accessible using the PARAFAC visualization. To help with reading the plot, let us consider another example, concentrating on the light blue curve: As written in the top left corner of the plot, this panel depicts the influence of the electrode pair. Hence, correlation is high for e.g., electrode pair no. 15 (but also no. 21, for example). In order to find out if this is true for a specific stimulus, one should check the middle panel: here, it is shown that the effect is most prominent for the grating moving upwards. To get an idea of the time course of this effect, examine the lower panel of stimulus repetitions. This indicates that the high correlations were mainly observed in the middle of the warm and rewarm conditions (here, the loading values are high), e.g., especially for the 10 repetition. This procedure can be applied for the other factors as well, there is no order of importance.</p></caption>
<graphic xlink:href="fninf-08-00084-g0002.tif"/>
</fig>
<p>The first 21 repetitions of each stimulus were thus recorded without deactivation, repetitions 22&#x02013;42 correspond to the phases of thermal deactivation of pMS and repetitions 43&#x02013;63 show the results for the rewarm condition. In each of the subplots of Figure <xref ref-type="fig" rid="F2">2A</xref>, the 15 recording channels are shown on x-and y-axis (one channel in the 4 &#x000D7; 4 grid was not working and was not included in the analysis). Each square in the subplots represents the strength of correlation (&#x003BA;<sub><italic>sync</italic></sub>) for the respective pair of recording channels. The figure provides an illustrative representation of the synchrony effects in the spiking data. It clearly shows that the signals of certain groups of neurons are correlated only for the presentation of certain stimuli. Furthermore, it can be observed that this structure is maintained over time. After examination of the correlation plots, we chose a 3D PARAFAC with the dimensions electrode pair, stimulus and repetition. The input data was centered in all dimensions. No scaling of the data was carried out. The measures based on normalized cross correlation data for all possible pairs of electrodes in the array were fed into the PARAFAC algorithm to obtain the multidimensional analysis results.</p>
<sec>
<title>3.1. Synchrony</title>
<p>The PARAFAC algorithm revealed the influence of electrode pairs and stimuli on the correlations and showed its behavior over time, since the stimulus repetitions were considered in an extra dimension. Figure <xref ref-type="fig" rid="F2">2</xref> shows the result of the PARAFAC analysis. The optimal number of factors was chosen as the highest number of factors with no correlated ones and resulted in numbers of 4&#x02013;6.</p>
<p>The loadings can be interpreted as the strength of influence on the correlation for the respective electrode pair, stimulus condition, and time point: The higher the loading value, the stronger the influence of the respective feature on the correlation.</p>
<p>The correlation values in Figure <xref ref-type="fig" rid="F2">2A</xref> correspond to repetitions 43&#x02013;49 in Figures <xref ref-type="fig" rid="F2">2B,C</xref>. A comparison of these corresponding parts shows that the same effects can be observed in both ways of presentation. This becomes especially clear when the focus is put on the dark blue PARAFAC component in Figures <xref ref-type="fig" rid="F2">2B</xref> for repetitions 43&#x02013;49. The component clearly reflects the strong peaks in Figure <xref ref-type="fig" rid="F2">2A</xref> for the respective stimulus.</p>
<p>Separate analyses were carried out taking into account the distance between the electrodes. For this purpose, the electrodes in a homogenously spaced 4 &#x000D7; 4 grid with grid size <italic>d<sub>grid</sub></italic> were divided into two sets, the set of neighboring pairs and the set of remote pairs. With (<italic>x<sub>i</sub></italic>,<italic>y<sub>i</sub></italic>) the position of electrode <italic>i</italic>, two electrodes are called neighboring nodes if
<disp-formula id="E5"><label>(5)</label><mml:math id="M5"><mml:mrow><mml:msqrt><mml:mrow><mml:msup><mml:mrow><mml:mo stretchy='false'>(</mml:mo><mml:msub><mml:mi>x</mml:mi><mml:mn>1</mml:mn></mml:msub><mml:mo>&#x02212;</mml:mo><mml:msub><mml:mi>x</mml:mi><mml:mn>2</mml:mn></mml:msub><mml:mo stretchy='false'>)</mml:mo></mml:mrow><mml:mn>2</mml:mn></mml:msup><mml:mo>+</mml:mo><mml:msup><mml:mrow><mml:mo stretchy='false'>(</mml:mo><mml:msub><mml:mi>y</mml:mi><mml:mn>1</mml:mn></mml:msub><mml:mo>&#x02212;</mml:mo><mml:msub><mml:mi>y</mml:mi><mml:mn>2</mml:mn></mml:msub><mml:mo stretchy='false'>)</mml:mo></mml:mrow><mml:mn>2</mml:mn></mml:msup></mml:mrow></mml:msqrt><mml:mo>&#x02264;</mml:mo><mml:msqrt><mml:mn>2</mml:mn></mml:msqrt><mml:msub><mml:mi>d</mml:mi><mml:mrow><mml:mi>g</mml:mi><mml:mi>r</mml:mi><mml:mi>i</mml:mi><mml:mi>d</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:math></disp-formula>
holds. Any two electrodes fulfilling this constraint are referred to as neighboring pairs, all other electrode pairs are termed remote pairs. In the case of a 4 &#x000D7; 4 grid of electrodes, this results in 42 neighboring pairs and 78 remote pairs.</p>
<p>We found a strong influence of pMS deactivation on the strength of correlations for both ipsi- and bilateral deactivation (see Figure <xref ref-type="fig" rid="F3">3</xref>). For these conditions, loading values for the deactivation phase were considerably lower than for the warm phases. Also, the variation in the warm phases was higher, indicating a more dynamic correlation pattern. This effect could already be observed in the spontaneous activity before stimulus onset (results not shown).</p>
<fig id="F3" position="float">
<label>Figure 3</label>
<caption><p><bold>Results of PARAFAC for local and remote connections</bold>. The figure shows the results of a PARAFAC analysis for all deactivation conditions. The electrode pairs were split into neighboring and remote pairs according to the neighborhood condition defined in Equation (5). If one looks at the loading values for the repetitions, illustrating the time course of the observed correlations, the deactivation effect is visible for ipsilateral deactivation and even more pronounced during bilateral deactivation, depicted by a decrease in the PARAFAC loading value. During ipsi-and bilateral deactivation the variance for the PARAFAC loading values also decreases, indicating a network behavior which is less dynamic. During contralateral deactivation the course of the correlations does not seem to change substantially.</p></caption>
<graphic xlink:href="fninf-08-00084-g0003.tif"/>
</fig>
<p>During contralateral deactivation of pMS (see Figure <xref ref-type="fig" rid="F3">3</xref>), the effect was much weaker, showing that the activity in area 18 was almost not affected by the deactivation of contralateral pMS.</p>
</sec>
<sec>
<title>3.2. Oscillatory synchrony</title>
<p>In order to analyze the measured data with respect to its oscillatory synchrony properties, the oscillatory synchrony measure &#x003BA;<sub><italic>oscsync</italic></sub> was used as input data for the PARAFAC algorithm (Figure <xref ref-type="fig" rid="F4">4</xref>). For this measure the deactivation effects were most prominent during spontaneous activity. For frequencies between 1 and 10 Hz the deactivation effect could only be observed for bilateral deactivation. Here, it leads to a severe decrease of correlations. The correlations return to initial values in the rewarm phase. For the low gamma frequency range (30&#x02013;50 Hz), the deactivation effect can also be seen during ipsilateral deactivation of pMS, and it is most pronounced during bilateral deactivation. In both frequency ranges, PARAFAC very soon developed correlated factors. For the oscillatory synchrony, the highest value for the variance explained by the model reached levels of 50% (for the results shown in Figure <xref ref-type="fig" rid="F4">4</xref>). This value increases when the number of factors F is increased. However, as already mentioned above, the factors become correlated under these conditions.</p>
<fig id="F4" position="float">
<label>Figure 4</label>
<caption><p><bold>Results of PARAFAC for the Oscillatory Synchrony measure</bold>. Results of a PARAFAC analysis using the oscillatory synchrony measure is shown for a phase of spontaneous activity. Only neighboring electrode pairs are shown. The bilateral deactivation of the pMS cortex has a strong effect on the correlations, which can be clearly observed when looking at the deactivation phase in the lower panel.</p></caption>
<graphic xlink:href="fninf-08-00084-g0004.tif"/>
</fig>
</sec>
<sec>
<title>3.3. Validation</title>
<p>As a control for the appropriateness of PARAFAC for our data, we performed split-half experiments in which the data set was divided into odd and even trials. Figure <xref ref-type="fig" rid="F5">5</xref> shows an example of the results for the data shown in Figure <xref ref-type="fig" rid="F5">5</xref>. The results show that the method works equally well on both newly created data sets: The loadings are similar and also the variation explained by the model was similar in both cases (71.26 and 70.17%, respectively). Consequently, the PARAFAC model of (5) was considered to be applicable.</p>
<fig id="F5" position="float">
<label>Figure 5</label>
<caption><p><bold>Example for split half validation</bold>. The figure shows the results of PARAFAC analysis of the bilateral deactivation data shown in Figure <xref ref-type="fig" rid="F2">2</xref>, split into two halves. <bold>(A)</bold> shows the results for all odd trial labels, <bold>(B)</bold> for the even-numbered trials. The similarity of the plots indicates that it is justifiable to use PARAFAC in this context.</p></caption>
<graphic xlink:href="fninf-08-00084-g0005.tif"/>
</fig>
</sec>
<sec>
<title>3.4. PCA</title>
<p>The results of the PCA showed two distinct features: (1) The phases of pMS deactivation are not very prominent (see Figure <xref ref-type="fig" rid="F6">6</xref>) A high number of principal components is needed until a reasonable proportion of the total variance is explained. We showed that, for our example data set, with four and six PARAFAC components, the model is able to explain 70.07%, respectively 76.26% of the variance in the data. In comparison, 17 PCA components were needed to reach 70% of cumulated variance.</p>
<fig id="F6" position="float">
<label>Figure 6</label>
<caption><p><bold>Results of PCA</bold>. Here we show the results of a PCA for the same dataset as previously analyzed with PARAFAC (see Figure <xref ref-type="fig" rid="F6">6</xref>). All 105 electrode pairs are shown. It can be observed that PCA is able to extract the same correlated pairs as PARAFAC, but the changes in correlations over time are not captured. Hence, the deactivation effect is not apparent in any of the panels.</p></caption>
<graphic xlink:href="fninf-08-00084-g0006.tif"/>
</fig>
</sec>
</sec>
<sec sec-type="discussion" id="s4">
<title>4. Discussion</title>
<p>Since PARAFAC applies a truly multilinear model (Bro, <xref ref-type="bibr" rid="B4">1997</xref>), it is a well-suited decomposition technique for data that can be factorized. In our experiments, stimulus condition and repetition can be assumed to be independent, such that they can be factorized. Thus, PARAFAC can be expected to be suitable for data analysis in the scope of our study. The results of the analysis of correlation effects in action potential data, as shown in Figures <xref ref-type="fig" rid="F2">2B,C</xref>, support this reasoning. They show that PARAFAC allows to easily assess the correlation effects in the data and to represent the relevant dependencies much more compact than more elementary analysis techniques, such as the evaluation of plain spike rates or correlations as shown in Figure <xref ref-type="fig" rid="F2">2A</xref>. Thus, PARAFAC proves to be a good choice to reveal the structure contained in the experimental data and to enable the assessment of the functional relation between the recorded groups of neurons as well as the influence of different stimulus conditions and time structure.</p>
<p>In contrast to PARAFAC, PCA is not a multilinear but a bilinear decomposition (Smilde and Doornbos, <xref ref-type="bibr" rid="B29">1991</xref>). If applied to multi-dimensional data, PCA requires unfolding of the multidimensional data array to a two-dimensional matrix. Unfolding easily causes overfitting since the two-dimensional structure of the model does not correspond to the underlying structure of the data. Furthermore, PARAFAC applies a less complex model (as compared to PCA), which features easier and clearer interpretation. In particular, the uniqueness of the solutions of PARAFAC has to be emphasized in this context, since this is in strong contrast to the solutions obtained with PCA, which provide rotation invariance (Bro, <xref ref-type="bibr" rid="B4">1997</xref>). The choice of PARAFAC as the decomposition technique is also supported by the principle of parsimony (Seasholtz and Kowalski, <xref ref-type="bibr" rid="B26">1993</xref>; also &#x0201C;Occams razor&#x0201D;), which recommends to use the least complex model that is capable of capturing the desired information.</p>
<p>Concerning the determination of the solutions, more effort has to be spent when using PARAFAC instead of PCA. This is mainly due to two reasons. First, the determination of the number of components required for the PARAFAC is not trivial and requires effort prior to the actual determination of the solution. Second, obtaining the solution of the PARAFAC using the alternating least squares (ALS) algorithm is computationally more complex than the projection applied in PCA. In addition, it has to be kept in mind that with PARAFAC, the solutions obtained for different number of components are independent, such that changing the number of components requires the recalculation of the complete solution.</p>
<p>One prerequisite for the use of the ALS algorithm is a normal distribution of the model error &#x003B5;<sub><italic>ijk</italic></sub>. However, this could not be held for our dataset, therefore the validity of our analysis has to be tested. To this end, split-half experiments were carried out. The results are shown in Figure <xref ref-type="fig" rid="F2">2</xref>. The results show that despite an error distribution that deviates from the normal distribution, the PARAFAC results obtained with the ALS algorithm are stable and meaningful. For further analysis of the sensitivity of the PARAFAC solution with respect to the error distribution, a bootstrapping procedure (Efron and Tibshirani, <xref ref-type="bibr" rid="B7">1993</xref>) that works with two different sets of errors is suggested: One set is obtained by randomly drawing error values from the empirical distribution of errors as they actually occurred in the PARAFAC analysis. The second set of errors is obtained from a Gaussian distribution that is fitted to the empirical distribution of the empirical errors. The errors from both sets are added to the original data and a PARAFAC analysis is carried out for the two data sets. The sensitivity of the PARAFAC algorithm to the distribution of the error can then be determined by comparing the solutions of PARAFAC obtained from the two data sets.</p>
<p>To summarize, PARAFAC is proposed in this work as a technique to analyze action potential recordings. The proposal is made based on the properties of PARAFAC and the properties of the data. The application of PARAFAC for the proposed purpose is verified in this work and the analysis results support the reasoning. A comparison with other relevant approaches is drawn and the differences between PARAFAC and other approaches are discussed. Furthermore, the specific requirement of PARAFAC concerning the normal distribution of the analysis error is discussed and the effect of an error distribution that deviates from the normal distribution on the analysis performance is evaluated. It is shown that the proposed analysis approach is valid also for a non-normal distribution of the analysis error. For a more detailed analysis of the sensitivity of the analysis, a bootstrapping approach is proposed.</p>
<sec>
<title>4.1. Discussion of results</title>
<p>Even though this is a very methodological contribution we would like to illustrate how far this unique combination of different methodological approaches may help to reveal the neuronal basis of brain states. It should be emphasized that we only analyzed a randomly selected set of data from these experiments in order to examine to what extent the application of PARAFAC could help to better describe brain states and their transition. Unilateral deactivation of pMS cortex is linked to the neurological syndrome of visual neglect, an attentional deficit with impairment in motion, spatial, and attentional processing in one half of the visual field (Lomber, <xref ref-type="bibr" rid="B18">2001</xref>). Bilateral pMS deactivation, by contrast, leads to a remarkable restitution of behavior (Lomber and Payne, <xref ref-type="bibr" rid="B15">1996</xref>). Our PARAFAC analysis is able to reveal distinct effects of the deactivation of the pMS cortex on correlated activity in area 18 (see Figure <xref ref-type="fig" rid="F3">3</xref>, left and right columns, middle parts of bottom panels): during ipsi-, and even more during bilateral pMS deactivation, the strength of correlated activity in area 18 decreases. This is in accordance with our expectations, as unilateral deactivation of the pMS cortex eliminates the strong feedback input from pMS to the ipsilateral area 18 (Symonds and Rosenquist, <xref ref-type="bibr" rid="B30">1984</xref>). However, while the feedback input from the ipsilateral pMS is missing, the affected primary visual area still gets feedforward input from LGN and also lateral input from its non-affected contralateral homotopic area and the contralateral pMS (Segraves and Innocenti, <xref ref-type="bibr" rid="B27">1985</xref>).</p>
<p>When the middle panels of Figures <xref ref-type="fig" rid="F2">2B,C</xref> are examined, the analysis seems to allocate the factors in such a way that each factor depicts the situation for one distinct stimulus condition. For each of the stimuli, a certain pattern of correlated electrode pairs emerges, i.e., a different network is observed. In Figure <xref ref-type="fig" rid="F2">2C</xref>, with the 6th factor (shown in magenta), another set of correlated electrode pairs that is present when a diagonally left/downwards moving stimulus is presented, becomes visible. The same electrode pairs are also correlated for the stimulus moving in the opposite direction, and a slight anticorrelation can be observed for the perpendicular stimulus. The bottom panels show the time course of effects, indicating a larger trial-to-trial variability during the warm phases as compared to the ipsi- and bilateral cooling sequences and similar variability for the warm condition and contralateral cooling (see Figure <xref ref-type="fig" rid="F3">3</xref>). Hence, each stimulus produces a distinct network activity, but all of those networks become less variable during the ipsi- and bilateral deactivation phases.</p>
<p>The neuronal correlate of visual neglect has been proposed to be based on an imbalance of activity between hemispheres, which, presumably among other effects, leads to a disinhibition of areas in the non-affected hemisphere, which in turn leads to further inhibition of the already attenuated area (Payne and Rushmore, <xref ref-type="bibr" rid="B22">2004</xref>). This is in accordance with the low level of correlated activity in ipsilateral area 18 (relative to the deactivation) and the observed correlation level in the contralateral area 18, which resembles the warm condition. When both pMS cortices are deactivated, as in the bilateral deactivation condition, the input from the contralateral areas is also reduced. Hence, the degree of correlated activity in area 18 is further lowered. In addition to the strength of correlation, the trial-to-trial variability is also diminished (see Figure <xref ref-type="fig" rid="F3">3</xref>, right column). This could indicate a less dynamic neuronal network, operating on a lower activity level, which is less able to adapt to and process new stimulus inputs than the normally functioning visual network. However, the lower but balanced correlation level seems to enable at least some functions that are impaired by unilateral deactivation: Behavioral studies indicate that during bilateral deactivation of pMS cortex, the animal is still able to complete simple orienting tasks, while it encounters problems with more abstract tasks, such as the so-called landmark-discrimination task, in which the cat is asked to choose between two wells, one of which contains food, the correct side of the well-being cued by one of six equally spaced landmarks, three left and three right of the midline (Lomber and Payne, <xref ref-type="bibr" rid="B16">2000</xref>). Thus, although the animal is able to successfully complete some tasks, which may be owed to the restored equilibrium of activity levels in both hemispheres, there is an impairment of cognitive functions. Figure <xref ref-type="fig" rid="F4">4</xref> shows that a strong decrease in the variation of correlated activity is even present in the spontaneous activity before stimulus onset, indicating a different processing mode of the respective neuronal network (see bottom panel, deactivation phase). As these are only speculations based on a very preliminary analysis of only a part of the dataset, these findings and conclusions have to be validated on the full database from these experiments. Also, further analyses should be conducted to examine the detected effects in greater detail. Nevertheless, PARAFAC proved to be a highly sensitive and helpful tool to identify relevant changes in neuronal processing modes on a multi-dimensional scale which open the window for a more targeted analysis of brain states linked to perceptual (and other) performance.</p>
</sec>
</sec>
<sec>
<title>Funding</title>
<p>This work was partially supported by the EU-project PHOCUS (FET-Open 240763) (Gordon Pipa, S. Katharina Schmitz).</p>
<sec>
<title>Conflict of interest statement</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</sec>
</body>
<back>
<ack>
<p>The authors would like to thank Marcelo Nakano Daniel and Stephan Wirsing for their contribution in preparing the program code.</p>
</ack>
<sec sec-type="supplementary-material" id="s5">
<title>Supplementary material</title>
<p>The Supplementary Material for this article can be found online at: <ext-link ext-link-type="uri" xlink:href="http://www.frontiersin.org/journal/10.3389/fninf.2014.00084/abstract">http://www.frontiersin.org/journal/10.3389/fninf.2014.00084/abstract</ext-link></p>
<supplementary-material xlink:href="DataSheet1.ZIP" mimetype="application/zip" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</sec>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Andersson</surname> <given-names>C. A.</given-names></name> <name><surname>Bro</surname> <given-names>R.</given-names></name></person-group> (<year>2000</year>). <article-title>The n-way toolbox for MATLAB</article-title>. <source>Chemometr. Intell. Lab. Syst</source>. <volume>52</volume>, <fpage>1</fpage>&#x02013;<lpage>4</lpage>. <pub-id pub-id-type="doi">10.1016/S0169-7439(00)00071-X</pub-id></citation>
</ref>
<ref id="B2">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bean</surname> <given-names>B.</given-names></name></person-group> (<year>2007</year>). <article-title>The action potential in mammalian central neurons</article-title>. <source>Nat. Rev. Neurosci</source>. <volume>8</volume>, <fpage>451</fpage>&#x02013;<lpage>465</lpage>. <pub-id pub-id-type="doi">10.1038/nrn2148</pub-id><pub-id pub-id-type="pmid">17514198</pub-id></citation>
</ref>
<ref id="B3">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Beckmann</surname> <given-names>C. F.</given-names></name> <name><surname>Smith</surname> <given-names>S. M.</given-names></name></person-group> (<year>2005</year>). <article-title>Tensorial extensions of independent component analysis for multisubject FMRI analysis</article-title>. <source>Neuroimage</source> <volume>25</volume>, <fpage>294</fpage>&#x02013;<lpage>311</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuroimage.2004.10.043</pub-id><pub-id pub-id-type="pmid">15734364</pub-id></citation>
</ref>
<ref id="B4">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bro</surname> <given-names>R.</given-names></name></person-group> (<year>1997</year>). <article-title>Parafac. tutorial and applications</article-title>. <source>Chemometr. Intell. Lab. Syst</source>. <volume>38</volume>, <fpage>149</fpage>&#x02013;<lpage>171</lpage>. <pub-id pub-id-type="doi">10.1016/S0169-7439(97)00032-4</pub-id></citation>
</ref>
<ref id="B5">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Buzs&#x000E1;ki</surname> <given-names>G.</given-names></name></person-group> (<year>2004</year>). <article-title>Large-scale recording of neuronal ensembles</article-title>. <source>Nat. Neurosci</source>. <volume>7</volume>, <fpage>446</fpage>&#x02013;<lpage>451</lpage>. <pub-id pub-id-type="doi">10.1038/nn1233</pub-id><pub-id pub-id-type="pmid">15114356</pub-id></citation>
</ref>
<ref id="B6">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Carroll</surname> <given-names>J. D.</given-names></name> <name><surname>Chang</surname> <given-names>J.</given-names></name></person-group> (<year>1970</year>). <article-title>Analysis of individual differences in multidimensional scaling via an N-way generalization of an &#x02018;Eckart-Young&#x02019; decomposition</article-title>. <source>Psychometrika</source> <volume>35</volume>, <fpage>283</fpage>&#x02013;<lpage>319</lpage>. <pub-id pub-id-type="doi">10.1007/BF02310791</pub-id></citation>
</ref>
<ref id="B7">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Efron</surname> <given-names>B.</given-names></name> <name><surname>Tibshirani</surname> <given-names>R. J.</given-names></name></person-group> (<year>1993</year>). <source>An Introduction to the Bootstrap</source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Chapman &#x00026; Hall</publisher-name>. <pub-id pub-id-type="doi">10.1007/978-1-4899-4541-9</pub-id></citation>
</ref>
<ref id="B8">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Galuske</surname> <given-names>R. A. W.</given-names></name> <name><surname>Schmidt</surname> <given-names>K. E.</given-names></name> <name><surname>Goebel</surname> <given-names>R.</given-names></name> <name><surname>Lomber</surname> <given-names>S. G.</given-names></name> <name><surname>Payne</surname> <given-names>B.</given-names></name></person-group> (<year>2002</year>). <article-title>The role of feedback in shaping neural representations in cat visual cortex</article-title>. <source>Proc. Natl. Acad. Sci. U.S.A</source>. <volume>99</volume>, <fpage>17083</fpage>&#x02013;<lpage>17088</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.242399199</pub-id><pub-id pub-id-type="pmid">12477930</pub-id></citation>
</ref>
<ref id="B9">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gr&#x000FC;n</surname> <given-names>S.</given-names></name> <name><surname>Diesmann</surname> <given-names>M.</given-names></name> <name><surname>Aertsen</surname> <given-names>A.</given-names></name></person-group> (<year>2002</year>). <article-title>Unitary events in multiple single-neuron spiking activity: I. detection and significance</article-title>. <source>Neural Comput</source>. <volume>14</volume>, <fpage>43</fpage>&#x02013;<lpage>80</lpage>. <pub-id pub-id-type="doi">10.1162/089976602753284455</pub-id><pub-id pub-id-type="pmid">11747534</pub-id></citation>
</ref>
<ref id="B10">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Harshman</surname> <given-names>R. A.</given-names></name> <name><surname>Lundy</surname> <given-names>M. E.</given-names></name></person-group> (<year>1994</year>). <article-title>Parafac: Parallel factor analysis</article-title>. <source>Comput. Stat. Data Anal</source>. <volume>18</volume>, <fpage>39</fpage>&#x02013;<lpage>72</lpage>. <pub-id pub-id-type="doi">10.1016/0167-9473(94)90132-5</pub-id></citation>
</ref>
<ref id="B11">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Harshman</surname> <given-names>R. A.</given-names></name></person-group> (<year>1970</year>). <article-title>Foundations of the parafac procedure: model and conditions for an &#x02018;explanatory&#x02019; multi-mode factor analysis</article-title>. <source>UCLA Work. Pap. Phon</source>. <volume>16</volume>, <fpage>1</fpage>&#x02013;<lpage>84</lpage>.</citation>
</ref>
<ref id="B12">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hitchcock</surname> <given-names>F. L.</given-names></name></person-group> (<year>1927</year>). <article-title>The expression of a tensor or a polyadic as a sum of products</article-title>. <source>J. Math. Phys</source>. <volume>6</volume>, <fpage>164189</fpage>.</citation>
</ref>
<ref id="B13">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Jolliffe</surname> <given-names>I.</given-names></name></person-group> (<year>2002</year>). <source>Principal Component Analysis</source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Springer</publisher-name>.</citation>
</ref>
<ref id="B14">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kiers</surname> <given-names>H. A. L.</given-names></name></person-group> (<year>1991</year>). <article-title>Hierarchical relations among three-way methods</article-title>. <source>Psychometrika</source> <volume>56</volume>, <fpage>449</fpage>&#x02013;<lpage>470</lpage>. <pub-id pub-id-type="doi">10.1007/BF02294485</pub-id><pub-id pub-id-type="pmid">18004189</pub-id></citation>
</ref>
<ref id="B15">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lomber</surname> <given-names>S. G.</given-names></name> <name><surname>Payne</surname> <given-names>B. R.</given-names></name></person-group> (<year>1996</year>). <article-title>Removal of two halves restores the whole: reversal of visual hemineglect during bilateral cortical or collicular inactivation in the cat</article-title>. <source>Vis. Neurosci</source>. <volume>13</volume>, <fpage>1143</fpage>&#x02013;<lpage>1156</lpage>. <pub-id pub-id-type="doi">10.1017/S0952523800007781</pub-id><pub-id pub-id-type="pmid">8961543</pub-id></citation>
</ref>
<ref id="B16">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lomber</surname> <given-names>S. G.</given-names></name> <name><surname>Payne</surname> <given-names>B. R.</given-names></name></person-group> (<year>2000</year>). <article-title>Contributions of cat posterior parietal cortex to visuospatial discrimination</article-title>. <source>Vis. Neurosci</source>. <volume>17</volume>, <fpage>701</fpage>&#x02013;<lpage>709</lpage>. <pub-id pub-id-type="doi">10.1017/S0952523800175042</pub-id><pub-id pub-id-type="pmid">11153650</pub-id></citation>
</ref>
<ref id="B17">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lomber</surname> <given-names>S. G.</given-names></name> <name><surname>Payne</surname> <given-names>B. R.</given-names></name> <name><surname>Horel</surname> <given-names>J. A.</given-names></name></person-group> (<year>1999</year>). <article-title>The cryoloop: an adaptable reversible cooling deactivation method for behavioral or electrophysiological assessment of neural function</article-title>. <source>J. Neurosci. Methods</source> <volume>86</volume>, <fpage>179</fpage>&#x02013;<lpage>194</lpage>. <pub-id pub-id-type="doi">10.1016/S0165-0270(98)00165-4</pub-id><pub-id pub-id-type="pmid">10065985</pub-id></citation>
</ref>
<ref id="B18">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lomber</surname> <given-names>S. G.</given-names></name></person-group> (<year>2001</year>). <article-title>Behavioral cartography of visual functions in cat parietal cortex: areal and laminar dissociations</article-title>. <source>Prog. Brain Res</source>. <volume>134</volume>, <fpage>265</fpage>&#x02013;<lpage>284</lpage>. <pub-id pub-id-type="pmid">11702548</pub-id></citation>
</ref>
<ref id="B19">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>M&#x000F8;rup</surname> <given-names>M.</given-names></name> <name><surname>Hansen</surname> <given-names>L. K.</given-names></name> <name><surname>Herrmann</surname> <given-names>C. S.</given-names></name> <name><surname>Parnas</surname> <given-names>J.</given-names></name> <name><surname>Arnfred</surname> <given-names>S. M.</given-names></name></person-group> (<year>2006</year>). <article-title>Parallel factor analysis as an exploratory tool for wavelet transformed event-related EEG</article-title>. <source>Neuroimage</source> <volume>29</volume>, <fpage>938</fpage>&#x02013;<lpage>947</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuroimage.2005.08.005</pub-id><pub-id pub-id-type="pmid">16185898</pub-id></citation>
</ref>
<ref id="B20">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Miwakeichi</surname> <given-names>F.</given-names></name> <name><surname>Mart&#x000ED;nez-Montes</surname> <given-names>E.</given-names></name> <name><surname>Vald&#x000E9;s-Sosa</surname> <given-names>P. A.</given-names></name> <name><surname>Nishiyama</surname> <given-names>N.</given-names></name> <name><surname>Mizuhara</surname> <given-names>H.</given-names></name> <name><surname>Yamaguchi</surname> <given-names>Y.</given-names></name></person-group> (<year>2004</year>). <article-title>Decomposing EEG data into space-time-frequency components using parallel factor analysis</article-title>. <source>Neuroimage</source> <volume>22</volume>, <fpage>1035</fpage>&#x02013;<lpage>1045</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuroimage.2004.03.039</pub-id><pub-id pub-id-type="pmid">15219576</pub-id></citation>
</ref>
<ref id="B21">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Oppenheim</surname> <given-names>A. V.</given-names></name> <name><surname>Willsky</surname> <given-names>A. S.</given-names></name> <name><surname>Nawab</surname> <given-names>S. H.</given-names></name></person-group> (<year>1996</year>). <source>Signals &#x00026; Systems</source>. <publisher-loc>Upper Saddle River, NJ</publisher-loc>: <publisher-name>Prentice-Hall, Inc</publisher-name>.</citation>
</ref>
<ref id="B22">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Payne</surname> <given-names>B. R.</given-names></name> <name><surname>Rushmore</surname> <given-names>R. J.</given-names></name></person-group> (<year>2004</year>). <article-title>Functional circuitry underlying natural and interventional cancellation of visual neglect</article-title>. <source>Exp. Brain Res</source>. <volume>154</volume>, <fpage>127</fpage>&#x02013;<lpage>153</lpage>. <pub-id pub-id-type="doi">10.1007/s00221-003-1660-9</pub-id><pub-id pub-id-type="pmid">14625667</pub-id></citation>
</ref>
<ref id="B23">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Payne</surname> <given-names>B. R.</given-names></name> <name><surname>Lomber</surname> <given-names>S. G.</given-names></name> <name><surname>Geerarts</surname> <given-names>S.</given-names></name> <name><surname>van der Gucht</surname> <given-names>E.</given-names></name> <name><surname>Vandenbussche</surname> <given-names>E.</given-names></name></person-group> (<year>1996</year>). <article-title>Reversible visual hemineglect</article-title>. <source>Proc. Natl. Acad. Sci. U.S.A</source>. <volume>93</volume>, <fpage>290</fpage>&#x02013;<lpage>294</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.93.1.290</pub-id><pub-id pub-id-type="pmid">8552624</pub-id></citation>
</ref>
<ref id="B24">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pipa</surname> <given-names>G.</given-names></name> <name><surname>Wheeler</surname> <given-names>D.</given-names></name> <name><surname>Singer</surname> <given-names>W.</given-names></name> <name><surname>Nikolic</surname> <given-names>D.</given-names></name></person-group> (<year>2008</year>). <article-title>Neuroxidence: reliable and efficient analysis of an excess or deficiency of joint-spike events</article-title>. <source>J. Comput. Neurosci</source>. <volume>25</volume>, <fpage>64</fpage>&#x02013;<lpage>88</lpage>. <pub-id pub-id-type="doi">10.1007/s10827-007-0065-3</pub-id><pub-id pub-id-type="pmid">18219568</pub-id></citation>
</ref>
<ref id="B25">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rafal</surname> <given-names>R. D.</given-names></name></person-group> (<year>1994</year>). <article-title>Neglect</article-title>. <source>Curr. Opin. Neurobiol</source>. <volume>4</volume>, <fpage>231</fpage>&#x02013;<lpage>236</lpage>. <pub-id pub-id-type="doi">10.1016/0959-4388(94)90078-7</pub-id><pub-id pub-id-type="pmid">8038582</pub-id></citation>
</ref>
<ref id="B26">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Seasholtz</surname> <given-names>M. B.</given-names></name> <name><surname>Kowalski</surname> <given-names>B.</given-names></name></person-group> (<year>1993</year>). <article-title>The parsimony principle applied to multivariate calibration</article-title>. <source>Anal. Chim. Acta</source> <volume>277</volume>, <fpage>165</fpage>&#x02013;<lpage>177</lpage>. <pub-id pub-id-type="doi">10.1016/0003-2670(93)80430-S</pub-id></citation>
</ref>
<ref id="B27">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Segraves</surname> <given-names>M. A.</given-names></name> <name><surname>Innocenti</surname> <given-names>G. M.</given-names></name></person-group> (<year>1985</year>). <article-title>Comparison of the distributions of ipsilaterally and contralaterally projecting corticocortical neruons in cat visual cortex using two flourescent tracers</article-title>. <source>J. Neurosci</source>. <volume>5</volume>, <fpage>2107</fpage>&#x02013;<lpage>2118</lpage>. <pub-id pub-id-type="pmid">3839523</pub-id></citation>
</ref>
<ref id="B28">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Singer</surname> <given-names>W.</given-names></name></person-group> (<year>1999</year>). <article-title>Neuronal synchrony: a versatile code for the definition of relations?</article-title> <source>Neuron</source> <volume>24</volume>, <fpage>49</fpage>&#x02013;<lpage>65</lpage>. <pub-id pub-id-type="doi">10.1016/S0896-6273(00)80821-1</pub-id><pub-id pub-id-type="pmid">10677026</pub-id></citation>
</ref>
<ref id="B29">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Smilde</surname> <given-names>A. K.</given-names></name> <name><surname>Doornbos</surname> <given-names>D. A.</given-names></name></person-group> (<year>1991</year>). <article-title>Three-way methods for the calibration of chromatographic systems: comparing parafac and three-way pls</article-title>. <source>J. Chemometr</source>. <volume>5</volume>, <fpage>345</fpage>&#x02013;<lpage>360</lpage>. <pub-id pub-id-type="doi">10.1002/cem.1180050404</pub-id></citation>
</ref>
<ref id="B30">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Symonds</surname> <given-names>L. L.</given-names></name> <name><surname>Rosenquist</surname> <given-names>A. C.</given-names></name></person-group> (<year>1984</year>). <article-title>Corticocortical connections among visual areas in the cat</article-title>. <source>J. Comp. Neurol</source>. <volume>229</volume>, <fpage>1</fpage>&#x02013;<lpage>38</lpage>. <pub-id pub-id-type="doi">10.1002/cne.902290103</pub-id><pub-id pub-id-type="pmid">6490972</pub-id></citation>
</ref>
<ref id="B31">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Uhlhaas</surname> <given-names>P.</given-names></name> <name><surname>Pipa</surname> <given-names>G.</given-names></name> <name><surname>Lima</surname> <given-names>B.</given-names></name> <name><surname>Melloni</surname> <given-names>L.</given-names></name> <name><surname>Neuenschwander</surname> <given-names>S.</given-names></name> <name><surname>Nikolic</surname> <given-names>D.</given-names></name> <etal/></person-group>. (<year>2009</year>). <article-title>Neural synchrony in cortical networks: history, concept and current status</article-title>. <source>Front. Integr. Neurosci</source>. <volume>3</volume>:<fpage>17</fpage>. <pub-id pub-id-type="doi">10.3389/neuro.07.017.2009</pub-id><pub-id pub-id-type="pmid">19668703</pub-id></citation>
</ref>
</ref-list>
</back>
</article>
