 Research
 Open Access
 Published:
CrossCorrelations and Joint Gaussianity in Multivariate Level Crossing Models
The Journal of Mathematical Neuroscience volume 4, Article number: 22 (2014)
Abstract
A variety of phenomena in physical and biological sciences can be mathematically understood by considering the statistical properties of level crossings of random Gaussian processes. Notably, a growing number of these phenomena demand a consideration of correlated level crossings emerging from multiple correlated processes. While many theoretical results have been obtained in the last decades for individual Gaussian levelcrossing processes, few results are available for multivariate, jointly correlated threshold crossings. Here, we address bivariate upward crossing processes and derive the corresponding bivariate Central Limit Theorem as well as provide closedform expressions for their joint levelcrossing correlations.
1 Introduction
Various phenomena in the biological or physical sciences are amenable to the description by level crossings of random Gaussian processes [1, 2]. Examples of these phenomena are spike coordination of neurons in the brain [3], insurance risk assessment [4] and stress levels generated by ocean waves [5]. Therefore a number of mathematical studies in recent decades have focused on the statistical properties of level crossings arising from stationary Gaussian processes [2]. However, largely this literature addresses the properties of one levelcrossing process and rarely deals with the coordinated level crossings of multivariate Gaussian processes. A prominent application where correlated level crossings are of particular importance is neuroscience. Recent work has shown that the spikes of a cortical neuron can be approximated by a Gaussian levelcrossing process [3, 6]. The assumption of Gaussianity is prompted by the experimental observation that cortical neurons are on average connected to ∼10000 neurons and therefore receive a barrage of inputs that together lead to a nearGaussian fluctuation at the cell body of any given cortical neuron [7]. The spikes of two neurons are then modeled as upward levelcrossing times of two crosscorrelated fluctuating Gaussian potentials.
In this article we aim to address two features of level crossings of multiple correlated Gaussian processes. First, we want to clarify whether levelcrossing counts derived from multiple correlated processes are jointly Gaussian. Second, we want to understand how many more coincident level crossings in a given time instance are expected if the underlying Gaussian random processes are correlated. Let us provide an intuitive reason for these questions. Starting with the first question, we recognize that if levelcrossing counts of two neurons were jointly Gaussian, then a simple measure of dependence is the covariance or the Pearson correlation coefficient. Measuring a vanishing correlation coefficient or vanishing covariance between two neuronal spike counts would in this case imply true statistical independence, because only in the case of multivariate Gaussian distribution is it permissible to conclude independence from vanishing count correlations. This implication is not permissible if the marginal distributions are not Gaussian or are Gaussian but the joint distribution is not a multivariate Gaussian distribution. While marginal Gaussianity has been shown for levelcrossing counts in [2] for large bin sizes, joint Gaussianity is still an open question. It might seem natural to imply joint Gaussianity from marginal Gaussianity for multivariate levelcrossing processes, however, numerous counter examples exist to prove this intuition wrong, see Sect. 5 in [8]. Here, we use a modified Breuer–Major Theorem to prove joint Gaussianity and show that any linear combination of levelcrossing counts of the two processes is also Gaussian.
The second question we address in this article deals with the conditional probabilities of two levelcrossing processes. We are interested in how the level crossings of one Gaussian process can be used to predict the levelcrossing probability of the partner process in a specific time interval relative to the observed level crossing in one process. In neuroscience, coordinated neuronal firing drives changes in synaptic connectivity and calculating the spike count dependencies across neurons is therefore a topic of current research efforts (e.g. Chap. 8 in [9]). The available mathematical results for conditional upward crossings in Gaussian processes currently comprise mostly variance and moments for one levelcrossing process (see Chaps. 3–5 in [2]) as well as the low and high correlation limit in pairs of processes [3, 10]. As yet, a comprehensive closedform solution covering the complete levelcrossing crosscorrelation function is currently lacking. Here, we use a regression approach to derive, for all correlation strengths, the conditional levelcrossing correlation functions in two continuous Gaussian processes. We hypothesize that the levelcrossing correlations we provide in this article could also be valuable in other fields outside of neuroscience for example in risk assessment calculations to predict the risk of joint default for insurance purposes.
The article is structured as follows. In Sect. 2 we define the mathematical model setting and introduce the concept of level crossings and specifically the upward crossings. In Sect. 3 we use a regression approach to obtain a general closedform solution for crosscorrelations of level crossings in two correlated Gaussian processes. In Sect. 4 we prove the joint Gaussianity (Central Limit Theorem) for the correlated joint upward crossings for two correlated Gaussian processes. In the section on materials and methods (Sect. 6) we provide detailed derivations of the reported results. We assume throughout this article that both levelcrossing processes arise from crossings of the same threshold level by two Gaussian processes with different variances. This is permissible because the number of level crossings, the Rice rate [11], depends only on the variancetothreshold ratio, but not on these quantities individually. We therefore work with a pair of levelcrossing processes where each process has a unique voltage variance and therefore the rate of crossings in the two neurons being considered are, unless stated otherwise, not the same. Let us note that this assumption is prompted by the observation that in a living brain typically no two neurons are identical in all their properties and differ at least in their firing rate.
2 Mathematical Definitions of Multivariate Level Crossings
Here we address the statistics of coincident level crossings arising from two Gaussian processes that share a common latent source. This situation is illustrated in Fig. 1(a). We choose to illustrate the situation using a neuroscience perspective. Neurons in a mammalian brain receive synaptic inputs, both excitatory and inhibitory, from thousands of other neurons. Particularly in the visual cortex, the excitatory and inhibitory inputs largely cancel each other and lead to a net fluctuating residual current at the cell body of each neuron. These residual fluctuations drive the spikes of individual neurons. These voltage fluctuations arise from largely independent inputs so they are well approximated by a random Gaussian process with temporal correlations determined by the temporal structure of synaptic currents [7].
2.1 Definitions of Multivariate Voltage Distributions
We begin by defining the random, temporally correlated Gaussian zero mean process ${V}_{j}(t)$ which represents the voltage of a neuron j
where ${f}_{V}$ is a combination of filters ${f}_{V}(\lambda )=\gamma (\lambda )g(\lambda )$, where γ represents the membrane filter and g the synaptic filter. Both of these filters can be chosen freely, but their combination should guarantee a continuously differentiable voltage trajectory. ${W}_{j}$ with $j=\{1,2\}$ and ${W}_{c}$ are complex random measures with independent increments, such that for all Borelian sets $A\in \mathcal{B}(\mathbb{R})$ we have $\mathbb{E}{W(A)}^{2}=m(A)$, the Lebesgue measure of A. By ${W}_{c}$ we denote the common noise component. Moreover if $A\cap B=\mathrm{\varnothing}$ then $W(A)$ and $W(B)$ are independent Gaussian random variables. The correlation strength r, $r=[0,1)$, denotes the presynaptic overlap of neurons 1 and 2 generated in a neuronal network, and it is illustrated in Fig. 1. If $r=0$ the voltages ${V}_{1}$ and ${V}_{2}$ are independent if $r=1$ the voltages ${V}_{1}$ and ${V}_{2}$ are identical. The auto and crosscorrelation functions between ${V}_{i}$ and ${V}_{j}$ are, respectively
where $c(\tau )={\int}_{\mathrm{\infty}}^{\mathrm{\infty}}{e}^{i\tau \lambda}{f}_{V}(\lambda )\mathrm{d}\lambda $, and τ is the considered delay. The vector $({V}_{1}(0),{V}_{1}^{\prime}(0),{V}_{2}(\tau ),{V}_{2}^{\prime}(\tau ))$ comprising the voltages and their derivatives is Gaussian and has the covariance matrix
where the variances are ${\sigma}_{{V}_{j}}^{2}={C}_{{V}_{j}}(0)$, ${\sigma}_{{V}_{j}^{\prime}}^{2}={C}_{{V}_{j}}^{\u2033}(0)$ and covariance functions are given by
We use the correlation time ${\tau}_{s}$ to quantify the width of the correlation function $c(\tau )$:
If the filters $\gamma (\lambda )$ and $g(\lambda )$ are classic lowpass filters, then the correlated voltage processes of Eq. (1) can be written in a differential form for each neuron j:
where ${I}_{j}(t)$ is the residual Gaussian current fluctuation with variance σ, ${\tau}_{M}$ the membrane time constant of the neuron, e.g. [12–15]. The synaptic drive ${I}_{j}(t)$ can be separated into two parts: a common and an individual noise component
where ${C}_{\xi}(\lambda )$ is the synaptic noise spectral density. Using Eq. (6) we obtain the following spectral representation for the stationary solutions:
In this form the spectral density of each ${V}_{j}$ is given by ${f}_{V}(\lambda )={C}_{\xi}(\lambda )/(1+{\tau}_{M}^{2}{\lambda}^{2})$. Analogously to Eq. (3), we obtain
2.2 Upward Crossing Definitions
Neurons communicate using brief pulses, the so called spikes, which are emitted whenever a voltage threshold is crossed [9]. The integrateandfiretype neuron models that are frequently used in computational neuroscience [12–15] generate a spike in neuron j any time a voltage ${V}_{j}(t)$ crosses a fixed threshold ψ and subsequently reset the voltage to a reset potential. Recently, it has been shown that in many physiologically relevant cases the leaky integrateandfire model can be equivalent to a levelcrossing model without reset, where spikes are modeled as positive threshold crossings and are not followed by a reset [3, 6, 16]. Here, we therefore identify the spikes of a neuron j with the positive level crossings of its voltage ${V}_{j}(t)$ and quantify the crosscorrelation between level crossings in neurons 1 and 2 by the following level functional:
where $Q(\epsilon )={I}_{1}\times {I}_{2}$ is a bounded and finite rectangle in ${\mathbb{R}}^{2}$, ψ denotes the voltage threshold in both neurons (see Fig. 1). Here δ is introduced to quantify the infinitesimal interval around the threshold ψ where a spike takes place. We choose the same threshold for both neurons and two different variances (${\sigma}_{{V}_{1}}\ne {\sigma}_{{V}_{2}}$) and keep all other parameters the same. ${\sigma}_{{V}_{1}}\ne {\sigma}_{{V}_{2}}$ represents the biological situation in which two neurons of the same neuronal type could have differences in the strength of their synaptic input and thresholdtovariance ratio but are exposed to the same temporal background statistics. We will consider the following random field $Z:{\mathbb{R}}^{2}\times \Omega \to {\mathbb{R}}^{2}$, defined as $({s}_{1},{s}_{2})\to Z({s}_{1},{s}_{2})=({V}_{1}({s}_{1}),{V}_{2}({s}_{1}+{s}_{2}))$. Ω denotes the probability space; here Ω is the Gaussian probability space. The field Z is Gaussian and $Z({s}_{1},{s}_{2})$ and $Z(0,{s}_{2}{s}_{1})$ are equal in distribution. We denoted by ${p}_{{s}_{2}{s}_{1}}(\cdot ,\cdot )$ the bivariate Gaussian density of vector $({V}_{1}({s}_{1}),{V}_{2}({s}_{2}))$. If $Q(\epsilon )=[t,t+\epsilon ]\times [\tau ,\tau +\epsilon ]$ and the prerequisites of Theorem 6.2 in [2] are fulfilled we can write
where the expectation value is denoted by , and $det(Z({s}_{1},{s}_{2}))$ is the determinant of the correlation matrix for the vector field $Z({s}_{1},{s}_{2})$. Now, we are left to prove the conditions of Theorem 6.2 in [2]. First, we find that conditions (i) and (ii) of Theorem 6.2 are satisfied by definition. Condition (iii) holds because ${p}_{{s}_{2}}(\psi ,\psi )$ is not degenerate. If we let ${I}_{1}$ and ${I}_{2}$ be two finite and bounded intervals in ℝ, condition (iv) is satisfied because
Here ℙ denotes the probability measure. We can define the correlation of two spike trains as
where ${p}_{\tau}(\psi ,{\dot{v}}_{1},\psi ,{\dot{v}}_{2})$ is the joint Gaussian density of the vector $({V}_{1}(0),{V}_{1}^{\prime}(0),{V}_{2}(\tau ),{V}_{2}^{\prime}(\tau ))$. The conditional firing rate ${\nu}_{\mathrm{cond}}(\tau )$ then is
where ${\nu}_{j}=\frac{{\sigma}_{{V}_{j}^{\prime}}}{2\pi {\sigma}_{{V}_{j}}}exp(\frac{{\psi}^{2}}{2{\sigma}_{{V}_{j}}^{2}})$ is the firing rate of a neuron j, for $j=1,2$. In the next sections we provide closedform expressions for $\u3008{s}_{1}(t){s}_{2}(t+\tau )\u3009$ and ${\nu}_{\mathrm{cond}}(\tau )$.
3 CrossCorrelations of Two Upward Level Crossings
Here, we address $\u3008{s}_{1}(t){s}_{2}(t+\tau )\u3009$ and provide a closedform solution that is valid for any crosscorrelation strength r between two levelcrossing processes and any time delay τ.
Proposition 3.1 Following the steps outlined in the methods section, Sect. 6.1, we can apply a regression model and Mehler’s Formula (see Lemma 10.7 in [2]) to prove that
where ${p}_{\tau}(\cdot ,\cdot )$ is a joint Gaussian distribution for voltages ${V}_{j}$ as defined in Sect. 2.2 and ${\mathcal{C}}_{(a,b)}(\tau )$ is the series given by
where
and
with
ϕ and Φ are the standard Gaussian density and distribution, respectively, and $\overline{\Phi}=1\Phi $. ${H}_{n}(z)={(1)}^{n}\frac{{\mathrm{d}}^{n}}{\mathrm{d}{z}^{n}}({e}^{{z}^{2}/2}){e}^{{z}^{2}/2}$ are the Hermite polynomials. Note that the first two terms in Eq. (18) correspond to truncation orders $n=0$ and $n=1$, respectively.
To aid the explicit evaluation of ${\mathcal{C}}_{(a,b)}(\tau )$ in Eq. (18) we provide code for a computer algebra system. ^{Footnote 1} Figure 2(a), (b) demonstrate ${\nu}_{\mathrm{cond}}(\tau )$ obtained using Eq. (17) for progressively large truncation orders n. Notably, we find close correspondence between the first truncation order $n=1$ and the large n limit ($n=10$). Figure 2(c), (d) show ${\nu}_{\mathrm{cond}}(\tau )$ vs. τ as in Eq. (17) for varying correlation strength r. For simplicity, we chose $c(\tau )=cosh{(\tau /{\tau}_{s})}^{1}$ and $r\in [0,1)$. We note that ${\nu}_{\mathrm{cond}}(\tau )$ for two identical neurons (${\sigma}_{{V}_{1}}={\sigma}_{{V}_{2}}$) is a symmetric function while for a pair of neurons with different rates (${\sigma}_{{V}_{1}}\ne {\sigma}_{{V}_{2}}$), ${\nu}_{\mathrm{cond}}(\tau )$ is asymmetric.
Let us now briefly discuss the result we obtained in Eq. (17) within the context of previous levelcrossing literature. One of the closely related results is the variance of level crossings and maxima provided in Proposition 4.4 in [2]. However, this result is derived for one levelcrossing process, while we addressed a pair of levelcrossing processes. For multiple crosscorrelated processes orthant probabilities that describe expressions of the form $\mathbb{P}({V}_{1}(t)>{\psi}_{1},{V}_{2}(t)>{\psi}_{2})$ have been obtained, e.g. Lemma 4.3 on p. 78 in [2]. However, specific results for the crosscorrelations of upward crossings are sparse. For two correlated upward levelcrossing processes previous studies have addressed the limiting cases of weak ($r\approx 0$) or strong ($r\approx 1$, $r<1$) crosscorrelations [3, 10]. However, to address upcrossing correlations in the intermediate regimes where neither $r\approx 0$ nor $r\approx 1$ no analytical methods are available. Therefore, it was previously necessary to numerically evaluate the associated Gaussian probability densities in Eq. (15). The direct numerical evaluation of multidimensional Gaussian integrals can be computationally and algorithmically demanding, requires adaptive grid procedures and its accuracy can be hard to evaluate [17]. For the specific case of $\tau =0$ we show in the materials and methods section on ‘Zero time lag correlations’, Sect. 6.2, that a direct evaluation of the Gaussian double integral is possible via a variable substitution. The key to this variable substitution method was a manageable unity correlation matrix. For any other finite $\tau >0$ and a given finite correlation strength $0\ll r<1$ we could not identify a transformation that leads to a tractable integral and we therefore derived the series expansion in Eq. (17). This solution is explicit such that each series term of order n can be evaluated and studied separately. Furthermore, Eq. (17) consists of analytical functions with a wellstudied parameter dependence. This makes it possible to predict the influence of a specific parameter, such as time scale ${\tau}_{s}$, firing rate ${\nu}_{i}$ or correlation strength r on the upward levelcross correlations. As an example, we evaluate Eq. (18) for an identical pair of neurons up to the third order in r via a Taylor expansion. We obtain
We recognize that the linear and quadratic expressions are equivalent to the first and second order rexpansion reported in [3, 10]. The cubic term has not been reported before, to the best of our knowledge. This demonstrates consistency with previous results and illustrates that expansions of any order can be obtained via Eq. (18). In this context, it is desirable to have an exact reference point for deciding how many n orders are necessary for Eq. (17) to be sufficiently accurate. Such a reference point can be the zero lag value which we calculate exactly. Deviation of Eq. (17) for a specific n from this reference point can serve as an accuracy benchmark. Following the calculations in the methods Sect. 6.2, we derive
Figure 2(a), (b) demonstrates ${\nu}_{\mathrm{cond}}(\tau )$ obtained using Eq. (17) for different truncation orders n alongside the zero lag correlation ${\nu}_{\mathrm{cond}}(0)$. Figure 2(c), (d) demonstrates ${\nu}_{\mathrm{cond}}(\tau )$ obtained using Eq. (17) as a function of the correlation strength r alongside the zero lag correlation ${\nu}_{\mathrm{cond}}(0)$. As previously, we chose $c(\tau )=cosh{(\tau /{\tau}_{s})}^{1}$ and $r\in [0,1)$. We note that for two identical neurons (${\sigma}_{{V}_{1}}={\sigma}_{{V}_{2}}$) ${\nu}_{\mathrm{cond}}(\tau )$ is a symmetric function. Yet, for a pair of neurons with different rates (${\sigma}_{{V}_{1}}\ne {\sigma}_{{V}_{2}}$) the spike correlation function ${\nu}_{\mathrm{cond}}(\tau )$ is asymmetric, indicating that the lower rate neuron spikes on average after the higher rate neuron.
3.1 Relation to the Leaky IntegrateandFire Model
Here, we address the relation between spike statistics and spike correlations in the levelcrossing setting in our article and previous results in the leaky integrateandfire framework [12–15]. In a currentbased leaky integrateandfire model driven by fluctuating noise the voltage of a neuron ${V}_{j}(t)$ is given by
where ${I}_{j}(t)$ is the input current of a neuron, $\xi (t)$ a white noise, unit variance drive. The voltage power spectrum for this model is a combination of lowpass filters ${f}_{V}(\lambda )\sim {[(1+{\tau}_{M}^{2}{\lambda}^{2})(1+{\tau}_{I}^{2}{\lambda}^{2})]}^{1}$ and its correlation function can be determined according to Eqs. (8). If the voltage ${V}_{j}$ reaches the threshold ϕ the neuron j emits a spike and the voltage is subsequently reset to a reset value ${V}_{r}$. The integrateandfire model differs only in one important detail from the levelcrossing approach—the presence of a reset after a spike. A recent article by Laurent Badel systematically compared the validity of upward levelcrossing approximation for the firing rate, spike correlations and frequency response of a leaky integrateandfire neuron [16]. This study reached the conclusion that the upward levelcrossing approach accurately represents the leaky integrateandfire model if two conditions are fulfilled: (1) the firing rate is much lower than the typical relaxation time of the voltage, (2) the synaptic filtering time constants remain of the same order of magnitude as the membrane time constant (${\tau}_{I}/{\tau}_{M}\approx 1$). Numerically, the validity of the approximation remained highly accurate even for synaptic time constants $0.4\lesssim {\tau}_{I}/{\tau}_{M}\lesssim 2.6$.
A number of spike correlation results have been derived in the leaky integrateandfire model for the limit of weak correlations [18–20]. They include the observation that the spike correlation coefficient increases with firing rate [18, 19]. The equivalent firing rate dependent increase in spike correlations and correlation coefficients for low correlation strengths has been reported for the levelcrossing model, see [3] and Fig. 3(A) (right) and Fig. 2(A) (top) in [10]. Furthermore, leaky integrateandfire model exhibits a sublinear dependence of correlation coefficients on input strength r [18, 21], which we see confirmed in Fig. 4.
4 Joint Gaussianity of Upcrossing Counts
Spike count cross correlations and correlation coefficient measurements in pairs of neurons are ubiquitous in neuroscience and are often used to measure the strength of interdependencies in a pair of neurons, e.g. in cortical neurons [18, 19, 22], in model neurons [23] and in theoretical and experimental studies of net correlations emerging in recurrent networks [23–28]. Spike counts and their cross correlations in neuroscience are often computed for a variety of bin sizes varying from $T=0.1\text{\u2013}1\text{ms}$ [22] to $T=2\text{s}$ [29]. Here, we are interested in the question when spike count correlations of two neurons computed in a bin size T are jointly Gaussian such that their cross correlations are unbiased measures of statistical dependence or independence.
In this section we will prove that the spike counts of two neurons, approximated by up crossings of a Gaussian process, approach a joint multivariate Gaussian distribution for large bin sizes T. We start by considering the marginal distributions of upcrossing counts. From the onedimensional Central Limit Theorem proven in [2] we know that $\frac{1}{\sqrt{T}}({U}_{[0,T]}^{{V}_{j}}(\psi )\mathbb{E}[{U}_{[0,T]}^{{V}_{j}}(\psi )])$ converges for $T\to \mathrm{\infty}$ to a onedimensional centered normal variable with finite variance. We provide a direct illustration of this classical univariate result in Fig. 3(a). Now, it is tempting to conclude that because the distribution of counts in each neuron is Gaussian, the joint distribution for the vector $({U}_{[0,T]}^{{V}_{1}}(\psi ),{U}_{[0,T]}^{{V}_{2}}(\psi ))$ is also a multivariate Gaussian distribution. Yet, this conclusion is mathematically forbidden. While a joint Gaussian distribution implies marginal Gaussianity it is general not possible to inverse this relation [8]. The joint Gaussianity of spike counts is a highly desired property. If two counts are jointly Gaussian zero count correlation directly implies statistical independence. If count correlations between neuron 1 and neuron 2 are zero such that ${U}_{[0,T]}^{{V}_{1}}(\psi )$ and ${U}_{[0,T]}^{{V}_{2}}(\psi )$ are uncorrelated, then only if the vector $({U}_{[0,T]}^{{V}_{1}}(\psi ),{U}_{[0,T]}^{{V}_{2}}(\psi ))$ is from a multivariate Gaussian distribution is it possible to infer independence of neuron 1 and neuron 2. Let us consider a teaching counter example where vanishing correlation between the variables X and Y does not imply independence: $X\in \mathcal{N}(0,1)$ and $Y={X}^{2}$. We obtain $Cov(X,Y)=0$, but the two random variables are strongly linked. Contrasting examples of where X and Y variables are both marginally but not jointly Gaussian, have a zero correlation but are not independent can be found in Sect. 5 in [8]. To benefit from joint Gaussianity and be able to infer true statistical independence from vanishing correlations, we prove here the joint Gaussianity of upward level crossings/spike counts for large T. In the following we derive the Central Limit Theorem for the spike counts of two neurons, using two steps. First, we use the onedimensional Central Limit Theorem proven in [2]. Second, we apply a version of the Breuer–Major Theorem adapted to our upward crossing setting which we present in Sect. 6.4.
Theorem 4.1 Let ${V}_{i}(t)$, $i\in \{1,2\}$ be two processes satisfying Eq. (1), with covariance ${C}_{{V}_{ij}}(\tau )=\mathbb{E}[{V}_{i}(0){V}_{j}(\tau )]$ where $i,j=1,2$ and a common spiking threshold ψ. To take advantage of the available Gaussianity proofs that are typically derived for unit variance processes, we rescale the voltages ${V}_{i}(t)$ and the threshold ψ to obtain processes ${X}_{i}(t)$ with unit variance and unit variance of the derivatives. ${X}_{i}=\frac{{V}_{i}(\sqrt{{C}_{{V}_{ii}}(0)/{C}_{{V}_{ii}}^{\u2033}(0)}t)}{\sqrt{{C}_{{V}_{ii}}(0)}}$ then has the correlation function $c(\tau )=\frac{{C}_{{V}_{ii}}(\sqrt{{C}_{{V}_{ii}}(0)/{C}_{{V}_{ii}}^{\u2033}(0)}\tau )}{{C}_{{V}_{ii}}(0)}$ and the spiking thresholds are ${\psi}_{i}=\psi /\sqrt{{C}_{{V}_{ii}}(0)}$. The number of ${\psi}_{i}$level upcrossings in a time interval T for process ${X}_{i}$ is given by ${U}_{[0,T]}^{{X}_{i}}({\psi}_{i})$. We assume that the following necessary and sufficient conditions hold. First, $\mathbb{E}\{{({U}_{[0,T]}^{{X}_{i}}(\psi ))}^{2}\}<\mathrm{\infty}$. This holds if and only if $c(\tau )$ satisfies Geman’s Condition (see, e.g., Theorem 3 in [30]). Second, ${\int}_{0}^{\mathrm{\infty}}{c}^{(n)}(\tau )\mathrm{d}\tau <\mathrm{\infty}$ where $n\in \{0,1,2\}$ is the order of derivation. Then
where the count covariances ${a}_{ij}$ with $i,j\in \{1,2\}$ are three convergent series. Each is then given by $0<{a}_{ii}={\sum}_{q=1}^{\mathrm{\infty}}{\sigma}_{{X}_{i}}^{2}(q)$ and $0<{a}_{12}={\sum}_{q=1}^{\mathrm{\infty}}{\sigma}_{{X}_{1},{X}_{2}}(q)$, both of which are finite. The first two terms in these series for $\psi ={\psi}_{i}$, ${C}_{{V}_{11}}(0)={C}_{{V}_{22}}(0)$ are
and the first and second order covariances are
We note that only for $r=1$ we obtain ${\sigma}_{{X}_{1},{X}_{2}}(j)={\sigma}_{{X}_{1}}^{2}(j)$. The asymptotic Pearson correlation coefficient ${\rho}_{T}$, defined by
will also converge to the respective ratio of the asymptotic covariances and variances.
4.1 Numerical Confirmation of Joint Gaussianity and Limit Covariances ${a}_{ij}$
In the last section we showed that spike counts of two neurons in large bins approach a bivariate Gaussian distribution with finite variances. Here, we illustrate this theoretical result in simulations of levelcrossing processes. We choose two methods based on linear combinations and the Mahalanobis distance to numerically confirm joint Gaussianity. First, we numerically confirm the joint Gaussianity by showing that all linear combinations of two simulated spike counts for a large bin are Gaussian. We consider a vector
where ${U}_{[0,T]}^{{X}_{1}}(\psi )$, ${U}_{[0,T]}^{{X}_{2}}(\psi )$ and $\mathbb{E}[{U}_{[0,T]}^{{X}_{1}}(\psi )]$, $\mathbb{E}[{U}_{[0,T]}^{{X}_{2}}(\psi )]$ are the spike counts and their average in neuron 1 and 2, respectively. X consists of N × twodimensional samples. N denotes the number of sample realizations and $i\in [1,N]$ the consecutive sample number. We project each twodimensional element ${\mathbf{\text{X}}}_{i}$ in all directions $(cos(\theta ),sin(\theta ))$ by calculating the scalar product $A={X}_{i}^{T}\cdot (cos(\theta ),sin(\theta ))$, with $\theta \in [0,2\pi )$. Subsequently, we apply a Shapiro test on A to verify Gaussianity for all univariate projections. The pvalue of this Shapiro test conveys the certainty with which the Gaussian hypothesis cannot be rejected. As a second numerical test of joint Gaussianity we use the Mahalanobis distance. This test is based on the fact that if $\mathbf{\text{X}}\sim {\mathcal{N}}_{d}(\mu ,\Sigma )$, where d is the dimensionality, μ is the mean and Σ the standard deviation, then the Mahalanobis distance ${D}^{2}$ with entries ${D}_{i}^{2}$
is distributed according to a ${\chi}_{d}^{2}$distribution with d degrees of freedom (see, e.g., Sect. 3.1.4 and Eq. (3.16) in [4]). By numerically estimating the count sample average μ and Σ we calculate in our case ${D}_{i}^{2}$ and compare it with a ${\chi}_{2}^{2}$distribution, using the QQplot method (see Fig. 3(c)).
Figure 3 demonstrates the results of the joint Gaussianity tests for a bin size $T=25{\tau}_{s}$, where ${\tau}_{s}=1\text{ms}$. Figure 3(a) shows the empirical univariate distribution of spike counts in one levelcrossing process derived from $N=10000$ independent count realizations. Figure 3(b) demonstrates that in $N=10000$ independent count realizations of X pvalues for all θ are above the 10 % significance level. Figure 3(c) (left) illustrates that the Mahalanobis distance ${D}^{2}$ of a twodimensional spike count variable X are well approximated by the ${\chi}_{2}^{2}$distribution (solid line). Figure 3(c) (right) demonstrates in a QQplot of the empirically measured ${D}^{2}$quantiles and the theoretical ${\chi}_{2}^{2}$quantiles that they are linearly related. This is an indication that both distributions are equal.
Figure 4 addresses the numerical confirmation of the constant asymptotic covariances ${a}_{ij}$ introduced in Theorem 4.1 in Eq. (26). We choose $\psi =0.3$, ${\tau}_{s}=1$, for $N=5000$ independent count realizations. To numerically compute the covariances ${a}_{ij}$ from spike count simulations we used the covariancematrix estimator proposed by [31]. Figure 4(a) demonstrates the convergence of covariance ${a}_{12}$ to a finite value that is predicted by Theorem 4.1. The asymptotic large T limit is denoted by a brief colored horizontal line. Figure 4(b) demonstrates the dependence of this asymptotic limit on the correlation strength r. As expected, we find that the asymptotic estimated covariance ${a}_{12}$ is close to zero for $r=0$ and it is close to the variance for $r=1$. Figure 4(c) demonstrates that the interplay between covariances ${a}_{12}$ and variances ${a}_{11}$ and ${a}_{22}$ leads to a sublinear dependence of the asymptotic correlation coefficient ${\rho}_{T}={a}_{12}/(\sqrt{{a}_{11}{a}_{22}})$ (Eq. (33)) in the large time bin limit, $T=25{\tau}_{s}$.
5 Conclusions
Levelcrossing phenomena occur in a variety of physical and biological sciences. In many of these situations coordination between level crossings of multiple crosscorrelated Gaussian processes is of interest. Here, we focused on neuroscience and modeled the spikes of two crosscorrelated neurons by two crosscorrelated levelcrossing processes. While crossings and extrema of one levelcrossing process have been the focus of mathematical research, results describing the coordination of multiple levelcrossing processes are sparse and typically available only in specific and limited cases. Limits where levelcrossing crosscorrelations have been previously calculated are the weak and strong input correlation limit [3]. Here, we studied the case of two crosscorrelated upward crossing processes and derived closedform expressions for their joint levelcrossing coordination as well their joint count Gaussianity. Importantly, the results we present in this article are consistent with previously reported limits but we now extended and generalized them. The two main results of our article are (1) closedform explicit solution of the levelcrossing crosscorrelations and (2) the joint Gaussian limit of levelcrossing counts. Our first result provides an explicit solution to ${\nu}_{\mathrm{cond}}(\tau )=\u3008{s}_{1}(t){s}_{2}(t+\tau )\u3009/\sqrt{{\nu}_{1}{\nu}_{2}}$ that is valid for all correlation strengths and which comprises previously obtained limits, see discussion in Sect. 3. The rate of level crossings by a onedimensional Gaussian process is given by the prominent Rice’s equation derived by Rice in the 1950s [11]. The solution we obtained for the levelcrossing crosscorrelation ${\nu}_{\mathrm{cond}}(\tau )$ extends the Rice rate to the joint rate of two correlated processes. Our second result proves the joint Gaussianity of level crossings for large bin sizes. The joint Gaussianity of spike counts is a highly desired property because if and only if two levelcrossing counts are jointly Gaussian can zero count crosscorrelation imply statistical independence. Notably, marginal Gaussianity of spike counts in each neuron combined with zero count crosscorrelation is not sufficient to imply independence. Contrasting examples of where X and Y variables are both marginally but not jointly Gaussian, have a zero crosscorrelation but are not independent can be found in Sect. 5 in [8]. Count covariance and measures derived from it, such as the Pearson correlation coefficient, are computationally inexpensive and widely used as measures of statistical interdependencies [8]. Therefore, it is highly desirable to investigate the joint Gaussianity of level counts and thereby delimit the parameter space and mathematical conditions ensuring that independence can be implied from zero correlation coefficient. Notably, the joint Gaussianity of spike counts in bins of size T where T is much larger than the intrinsic time constant ${\tau}_{s}$ ($T\gg {\tau}_{s}$) also implies that models of multineuronal dynamics only need to consider the mean and variance of spike counts because all higher cumulants are zero.
6 Materials and Methods
6.1 Proof of Proposition 3.1
For simplicity of notation we adopt the following convention: $({X}_{1},{Y}_{1},{X}_{2},{Y}_{2})$ denotes the vector $({V}_{1}(0),{V}_{1}^{\prime}(0),{V}_{2}(\tau ),{V}_{2}^{\prime}(\tau ))$. In order to calculate $\u3008{s}_{1}(t){s}_{2}(t+\tau )\u3009$, defined in (14), we use the following regression model:
where $({\u03f5}_{1},{\u03f5}_{2})$ and $({X}_{1},{X}_{2})$ are independent. We use the covariance matrix in (4) and obtain
The conditional distribution $\mathcal{L}({Y}_{1},{Y}_{2}{X}_{1}=\psi ,{X}_{2}=\psi )$ is a bivariate Gaussian distribution
Using the regression system above, we write the conditional expectation
where ${Z}_{1}=\frac{{\u03f5}_{1}}{{\sigma}_{{\u03f5}_{1}}(\tau )}$, ${Z}_{2}=\frac{{\u03f5}_{2}}{{\sigma}_{{\u03f5}_{2}}(\tau )}$, $a=\frac{(\psi ({\alpha}_{1}+{\alpha}_{2}))}{{\sigma}_{{\u03f5}_{1}}(\tau )}$, $b=\frac{(\psi ({\beta}_{1}+{\beta}_{2}))}{{\sigma}_{{\u03f5}_{2}}(\tau )}$. Now, we calculate the four different expectations in Eq. (37) using Mehler’s Formula (Lemma 10.7 in [2]). First, we write
where ${c}_{n}(a)$ and ${c}_{n}(b)$ are the Hermite coefficients associated with the expectation $\mathbb{E}[{Z}_{1}{1}_{\{{Z}_{1}\in [a,\mathrm{\infty})\}}{Z}_{2}{1}_{\{{Z}_{2}\in [b,\mathrm{\infty})\}}]$. Then these Hermite coefficients are given by
In particular,

for $n=0$, ${c}_{0}(a)=\frac{{e}^{{a}^{2}/2}}{\sqrt{2\pi}}=\varphi (a)$, ${c}_{0}(b)=\varphi (b)$,

for $n=1$, ${c}_{1}(a)=a\varphi (a)\Phi (a)+1$, ${c}_{1}(b)=b\varphi (b)\Phi (b)+1$,

for $n\ge 2$, ${c}_{n}(a)=\frac{\varphi (a)}{n!}(a{H}_{n1}(a)+{H}_{n2}(a))$, ${c}_{n}(b)=\frac{\varphi (b)}{n!}(b{H}_{n1}(b)+{H}_{n2}(b))$.
Analogously we obtain
with
In particular,

for $n=0$, ${c}_{0}(a)=1\Phi (a)=\overline{\Phi}(a)$, ${c}_{0}(b)=\overline{\Phi}(b)$,

for $n=1$, ${c}_{1}(a)=\varphi (a)$, ${c}_{1}(b)=\varphi (b)$,

for $n\ge 2$, ${c}_{n}(a)=\frac{\varphi (a)}{n!}{H}_{n1}(a)$, ${c}_{n}(b)=\frac{\varphi (b)}{n!}{H}_{n1}(b)$.
We also have
with
In particular,

for $n=0$, ${c}_{0}(a)=\overline{\Phi}(a)$, ${c}_{0}(b)=\varphi (b)$,

for $n=1$, ${c}_{1}(a)=\varphi (a)$, ${c}_{1}(b)=b\varphi (b)\Phi (b)+1$,

for $n\ge 2$, ${c}_{n}(a)=\frac{\varphi (a)}{n!}{H}_{n1}(a)$, ${c}_{n}(b)=\frac{\varphi (b)}{n!}(b{H}_{n1}(b)+{H}_{n2}(b))$.
Finally,
with
In particular,

for $n=0$, ${c}_{0}(a)=\varphi (a)$, ${c}_{0}(b)=\overline{\Phi}(b)$,

for $n=1$, ${c}_{1}(a)=a\varphi (a)\Phi (a)+1$, ${c}_{1}(b)=\varphi (b)$,

for $n\ge 2$, ${c}_{n}(a)=\frac{\varphi (a)}{n!}(a{H}_{n1}(a)+{H}_{n2}(a))$, ${c}_{n}(b)=\frac{\varphi (b)}{n!}{H}_{n1}(b)$.
Then, combining the four expectations (38)–(41), the associated Hermite coefficients, and Eq. (37), we obtain
Note that the first two terms in Eq. (42) correspond to orders $n=0$ and $n=1$, respectively. Denoting $\mathbb{E}[{Y}_{1}{1}_{\{{Y}_{1}\in [0,\mathrm{\infty})\}}{Y}_{2}{1}_{\{{Y}_{2}\in [0,\mathrm{\infty})\}}{X}_{1}=\psi ,{X}_{2}=\psi ]={\mathcal{C}}_{(a,b)}(\tau )$ we find $\u3008{s}_{1}(t){s}_{2}(t+\tau )\u3009={\mathcal{C}}_{(a,b)}(\tau ){p}_{\tau}(\psi ,\psi )$. Here, ${\mathcal{C}}_{(a,b)}(\tau )$ is a uniformly convergent series. □
6.2 Zero Time Lag Correlations
In this section we derive the zero lag spike correlation using the Gaussian probability integrals in Eq. (15). Following the previously introduced notation the spiking threshold level in a neurons is ψ and variance ${\sigma}_{{V}_{i}}$ we can write
Now, we substitute the variables:
The correlation matrix ${C}_{\Sigma ,\dot{\Delta},\dot{\Sigma},\Delta}$ for $\tau =0$ is a fourdimensional identity matrix.
Solving this integral we obtain Eq. (23).
6.3 Proof of Theorem 4.1
To prove joint Gaussianity, it is instructive to briefly recapitulate the onedimensional Central Limit Theorem. We start by writing
with ${d}_{j}^{(i)}({\psi}_{i})=\frac{1}{j!}\varphi ({\psi}_{i}){H}_{j}({\psi}_{i})$ and ${a}_{k}=\frac{1}{k!}{\int}_{0}^{\mathrm{\infty}}x{H}_{k}(x)\varphi (x)\mathrm{d}x$. Defining the level count deviation for neuron i by ${S}^{i}(T)$ we obtain
where ${G}_{q}^{i}({x}_{1},{x}_{2})={\sum}_{k+j=q}{d}_{j}^{(i)}({\psi}_{i}){a}_{k}{H}_{j}({x}_{1}){H}_{k}({x}_{2})$. A Gaussian distribution is a stable limit distribution for a sum of independent finite variance variables. Therefore, all that is left to prove is that contributions $q\ne {q}^{\prime}$ are independent and have finite variance. From Mehler’s Formula we recognize that the contributions for $q\ne {q}^{\prime}$ are independent. The finite variance follows from the observation that for all q the variance of ${G}_{q}^{i}({X}_{i}(s),{X}_{i}^{\prime}(s))$ is proportional to the expectation of a product of four Hermite polynomials, which has been proven to be finite (Theorem 10.10 in [2]) if the conditions of Theorem 4.1 are satisfied.
Now, we address the joint Gaussianity. A random vector is jointly Gaussian if and only if any linear combination of its components has a univariate normal distribution (see [4, 32, 33]). Thus, we need to prove that the sequence ${\alpha}_{1}{S}^{1}(T)+{\alpha}_{2}{S}^{2}(T)$ is asymptotically Gaussian and satisfies a Central Limit Theorem, for all ${\alpha}_{1},{\alpha}_{2}\in \mathbb{R}$. We start from Eq. (45) and consider a truncated series for ${S}_{Q}^{i}(T)={\sum}_{q=1}^{Q}{J}_{q}^{1}(T,{X}_{1},{X}_{1}^{\prime})$ consisting of the first Q terms and denote by $\parallel \cdot \parallel $ the norm in ${L}^{2}(\Omega )$. First, we show that the remainder is bounded
As Q grows, this difference diminishes such that if ${\alpha}_{1}{S}_{Q}^{1}(T)+{\alpha}_{2}{S}_{Q}^{2}(T)$ is Gaussian for large Q then this will imply that ${\alpha}_{1}{S}^{1}(T)+{\alpha}_{2}{S}^{2}(T)$ is Gaussian, too. Now, we only need to show Gaussianity of ${\alpha}_{1}{S}_{Q}^{1}(T)+{\alpha}_{2}{S}_{Q}^{2}(T)$. Using a modified version of the Breuer–Major Theorem (Sect. 6.4), we know that for each q
where ${\sigma}_{{\tilde{G}}_{q}}^{2}$ is given in Eq. (51). The same theorem implies that ${\alpha}_{1}{J}_{q}^{1}(T,{X}_{1},{X}_{1}^{\prime})+{\alpha}_{2}{J}_{q}^{2}(T,{X}_{2},{X}_{2}^{\prime})$ and ${\alpha}_{1}{J}_{{q}^{\prime}}^{1}(T,{X}_{1},{X}_{1}^{\prime})+{\alpha}_{2}{J}_{{q}^{\prime}}^{2}(T,{X}_{2},{X}_{2}^{\prime})$ are asymptotically independent if $q\ne {q}^{\prime}$. Thus we obtain for any $Q\ge 1$
To calculate the count covariances in Eq. (26) we use Lemma 10.7 in [2] and obtain
Applying the Mehler Formula to a fourdimensional Gaussian random vector (Lemma 10.7 in [2]) we find
Here, ${\delta}_{ij}$ is the Kronecker delta, Z is the set of ${d}_{i}$’s satisfying: ${d}_{i}\ge 0$, ${d}_{1}+{d}_{2}=qk$, ${d}_{3}+{d}_{4}=k$, ${d}_{1}+{d}_{3}=q{k}^{\prime}$, and ${d}_{2}+{d}_{4}={k}^{\prime}$. We thus can express the covariances of the spike counts as
This is the result reported in Theorem 4.1. □
6.4 Modified Breuer–Major Theorem
Here, we adapt the Breuer–Major Theorem [34] to show that the bivariate vector $({J}_{q}^{1}(T,{X}_{1},{X}_{1}^{\prime}),{J}_{q}^{2}(T,{X}_{2},{X}_{2}^{\prime}))$ is Gaussian.
Theorem 6.1 We consider two zero mean and unit variance Gaussian processes ${X}_{i}(t)$, which are described by the properties in Sect. 2 and a correlation function $\mathbb{E}[{X}_{i}(0){X}_{j}(t)]={c}_{ij}(t)$, where $i,j\in \{1,2\}$. For all functions ${G}_{i}(\cdot ,\cdot )$ that fulfill $\mathbb{E}[{G}_{i}({X}_{i}(0),{X}_{i}^{\prime}(0))]=0$ and $\mathbb{E}[{G}_{i}^{2}({X}_{i}(0),{X}_{i}^{\prime}(0))]<\mathrm{\infty}$ and two real constants ${\alpha}_{i}$ the following integral is Gaussian and we have
where
Proof We start by considering the Hermite expansion of the functions ${G}_{i}(\cdot ,\cdot )$ and write
where ${G}_{i}^{Q}$ denotes the sum over q in Eq. (52) truncated at Q, and the convergence is in ${L}^{2}(\Omega )$. We write
Now, to prove the Gaussianity of Eq. (54) it is sufficient to prove the asymptotic Gaussianity of $({\alpha}_{1}{G}_{1}^{Q}({X}_{1}(t),{X}_{1}^{\prime}(t))+{\alpha}_{2}{G}_{2}^{Q}({X}_{2}(t),{X}_{2}^{\prime}(t)))$. This is sufficient because
where $\parallel \cdot \parallel $ is the norm in ${L}^{2}(\Omega )$. Each of the terms is bounded,
where $\psi (t)=max({c}_{11}(t)+{c}_{12}(t),{c}_{21}(t)+{c}_{22}(t))$ and a is a positive real number such that $\psi (t)<1$ whenever $t>a$. Since Eq. (60) is a vanishing series, ${lim}_{Q\to \mathrm{\infty}}{lim}_{T\to \mathrm{\infty}}{K}_{Q}(T)=0$. Now, we address the Gaussianity of $({\alpha}_{1}{G}_{1}^{Q}({X}_{1}(t),{X}_{1}^{\prime}(t))+{\alpha}_{2}{G}_{2}^{Q}({X}_{2}(t),{X}_{2}^{\prime}(t)))$. A result of Kratz and León, Lemma 3, p. 653 in [35], implies that
can be approached in ${L}^{2}(\Omega )$ by the sequence of ϵdependent processes ${X}_{i}^{\epsilon}(t)$ ${L}^{i,\epsilon}(T)=\frac{1}{\sqrt{T}}{\int}_{0}^{T}{G}_{i}^{Q}({X}_{i}^{\epsilon}(t),{({X}_{i}^{\epsilon})}^{\prime}(t))\mathrm{d}t$. The $\frac{1}{\epsilon}$dependent processes for $i=1,2$, are defined as
where ∗ denotes a convolution, ${\beta}_{\epsilon}$ is ${\beta}_{\epsilon}(t)=\frac{1}{\epsilon}\beta (\frac{t}{\epsilon})$, β being a positive function with ${\int}_{\mathrm{\infty}}^{\mathrm{\infty}}{\lambda }^{j}\beta (\lambda )\mathrm{d}\lambda <\mathrm{\infty}$, $j=1,2$ and such that its Fourier transform has support in $[1,1]$, where $\mathbb{E}[{X}_{i}^{\epsilon}(0){X}_{i}^{\epsilon}(\tau )]={c}_{jj}(\tau )\stackrel{\u02c6}{\beta}(\epsilon \tau )$ these processes are $\frac{1}{\epsilon}$dependent. Then
This follows from the Central Limit Theorem for $\frac{1}{\epsilon}$dependent random vectors and concludes the proof. □
Notes
 1.
We provide the MATHEMATICA 8 (Wolfram Research) code to iteratively calculate ${\nu}_{\mathrm{cond}}(\tau )$. The code can be found at: http://www.tchumatchenko.de/CodeNuCond_Fig2.nb.
References
 1.
Blake IF, Lindsey WC: Levelcrossing problems for random processes. IEEE Trans Inf Theory 1973, 19: 295–315. 10.1109/TIT.1973.1055016
 2.
Azaïs JM, Wschebor M: Level Sets and Extrema of Random Processes and Fields. Wiley, New York; 2009.
 3.
Tchumatchenko T, Malyshev A, Geisel T, Volgushev M, Wolf F: Correlations and synchrony in threshold neuron models. Phys Rev Lett 2010., 104(5): Article ID 058102 Article ID 058102
 4.
McNeil AJ, Frey R, Embrechts P Princeton Series in Finance. In Quantitative Risk Management: Concepts, Techniques, and Tools. Princeton University Press, Princeton; 2005.
 5.
Ehrenfeld S, Goodman NR, Kaplan S, Mehr E, Pierson WJ, Stevens R, Tick LJ: Theoretical and observed results for the zero and ordinate crossing problems of stationary Gaussian noise with application to pressure records of ocean waves. Technical report. New York University, College of Engineering; 1958.
 6.
Burak Y, Lewallen S, Sompolinsky H: Stimulusdependent correlations in thresholdcrossing spiking neurons. Neural Comput 2009, 21(8):2269–2308. 10.1162/neco.2009.0708830
 7.
Destexhe A, Rudolph M, Pare D: The highconductance state of neocortical neurons in vivo . Nat Rev Neurosci 2003, 4: 739–751. 10.1038/nrn1198
 8.
Embrechts P, McNeil A, Straumann D: Correlation and dependence in risk management: properties and pitfalls. In Risk Management: Value at Risk and Beyond. Cambridge University Press, Cambridge; 2000:176–223.
 9.
Dayan P, Abbott LF: Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems. MIT Press, Cambridge; 2001.
 10.
Tchumatchenko T, Geisel T, Volgushev M, Wolf F: Signatures of synchrony in pairwise count correlations. Front Comput Neurosci 2010. 10.3389/neuro.10.001.2010
 11.
Rice SO: Mathematical analysis of random noise. In Selected Papers on Noise and Stochastic Processes. Edited by: Wax N. Dover, New York; 1954.
 12.
Brunel N, van Rossum M: Lapicque’s 1907 paper: from frogs to integrateandfire. Biol Cybern 2007, 97(5):337–339.
 13.
Burkitt A: A review of the integrateandfire neuron model: I. Homogeneous synaptic input. Biol Cybern 2006, 95: 1–19. 10.1007/s0042200600686
 14.
Burkitt A: A review of the integrateandfire neuron model: II. Inhomogeneous synaptic input and network properties. Biol Cybern 2006, 95: 97–112. 10.1007/s0042200600828
 15.
Fourcaud N, Brunel N: Dynamics of the firing probability of noisy integrateandfire neurons. Neural Comput 2002, 14: 2057–2110. 10.1162/089976602320264015
 16.
Badel L: Firing statistics and correlations in spiking neurons: a levelcrossing approach. Phys Rev E 2011., 84: Article ID 041919 Article ID 041919
 17.
Genz A, Bretz F: Computation of Multivariate Normal and t Probabilities. Springer, Berlin; 2009.
 18.
de la Rocha J, Doiron B, SheaBrown E, Josic K, Reyes A: Correlation between neural spike trains increases with firing rate. Nature 2007, 448(16):802–807.
 19.
SheaBrown E, Josić K, de la Rocha J, Doiron B: Correlation and synchrony transfer in integrateandfire neurons: basic properties and consequences for coding. Phys Rev Lett 2008., 100(10): Article ID 108102 Article ID 108102
 20.
Ostojic S, Brunel N, Hakim V: How connectivity, background activity, and synaptic properties shape the crosscorrelation between spike trains. J Neurosci 2009, 29(33):10234–10253. 10.1523/JNEUROSCI.127509.2009
 21.
Binder MD, Powers RK: Relationship between simulated common synaptic input and discharge synchrony in cat spinal motoneurons. J Neurophysiol 2001, 86(5):2266–2275.
 22.
Lampl I, Reichova I, Ferster D: Synchronous membrane potential fluctuations in neurons of the cat visual cortex. Neuron 1999, 22: 361–374. 10.1016/S08966273(00)81096X
 23.
Vilela RD, Lindner B: Comparative study of different integrateandfire neurons: spontaneous activity, dynamical response, and stimulusinduced correlation. Phys Rev E 2009., 80(3): Article ID 031909 Article ID 031909
 24.
Greenberg DS, Houweling AR, Kerr JND: Population imaging of ongoing neuronal activity in the visual cortex of awake rats. Nat Neurosci 2008, 11(7):749–751. 10.1038/nn.2140
 25.
Tetzlaff T, Rotter S, Stark E, Abeles M, Aertsen A, Diesmann M: Dependence of neuronal correlations on filter characteristics and marginal spike train statistics. Neural Comput 2008, 20: 2133–2184. 10.1162/neco.2008.0507525
 26.
Renart A, de la Rocha J, Bartho P, Hollender L, Parga N, Reyes A, Harris K: The asynchronous state in cortical circuits. Science 2010, 327: 587–590. 10.1126/science.1179850
 27.
Ecker AS, Berens P, Keliris GA, Bethge M, Logothetis NM, Tolias AS: Decorrelated neuronal firing in cortical micro circuits. Science 2010, 327(584):584–587.
 28.
Pernice V, Staude B, Cardanobile S, Rotter S: How structure determines correlations in neuronal networks. PLoS Comput Biol 2011., 7(5): Article ID e1002059 Article ID e1002059 10.1371/journal.pcbi.1002059
 29.
Zohary E, Shadlen MN, Newsome WT: Correlated neuronal discharge rate and its implications for psychophysical performance. Nature 1994, 370: 140–143. 10.1038/370140a0
 30.
Kratz M, León J: Level curves crossings and applications for Gaussian models. Extremes 2010, 13: 315–351. 10.1007/s106870090090x
 31.
Doukhan P, Jakubowicz J, León JR: Variance estimation with applications. In Dependence in Probability, Analysis and Number Theory. Kendrick Press, Heber City; 2010:203–231.
 32.
Feller W 2. In An Introduction to Probability Theory and Its Applications. 2nd edition. Wiley, New York; 1971.
 33.
Hamedani GG, Tata MN: On the determination of the bivariate normal distribution from distributions of linear combinations of the variables. Am Math Mon 1975, 82(9):913–915.
 34.
Breuer P, Major P: Central limit theorems for nonlinear functionals of Gaussian fields. J Multivar Anal 1983, 13(3):425–441. 10.1016/0047259X(83)900192
 35.
Kratz M, León JR: Central limit theorems for level functionals of stationary Gaussian processes and fields. J Theor Probab 2001, 14(3):639–672. 10.1023/A:1017588905727
Acknowledgements
The authors thank the two anonymous referees, and Sabrina Münzberg, Amadeus Dettner, and Laurent Badel for constructive comments on a previous version of the paper, Sabrina Münzberg for help with Hermite polynomial calculations and associated problem solving and Sara Gil Mast for English corrections. EDB and JRL are supported by a ECOSNord project under the reference V12M01. TT is funded by the Volkswagen foundation and the Max Planck Society and is thankful for the support of the Center for Theoretical Neuroscience at Columbia University during her stay there.
Author information
Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
The main idea of this paper was proposed jointly by EB, JL and TT. All authors contributed equally to the writing of this paper performed all the steps of the proofs in this research. All authors read and approved the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
About this article
Cite this article
Di Bernardino, E., León, J. & Tchumatchenko, T. CrossCorrelations and Joint Gaussianity in Multivariate Level Crossing Models. J. Math. Neurosc. 4, 22 (2014). https://doi.org/10.1186/21908567422
Received:
Accepted:
Published:
Keywords
 Joint Gaussian
 Crosslevel Processes
 Upward Crossings
 Bivariate Central Limit Theorem
 Spike Count