 Research
 Open Access
 Published:
Analytical Insights on ThetaGamma Coupled Neural Oscillators
The Journal of Mathematical Neuroscience volume 3, Article number: 16 (2013)
Abstract
In this paper, we study the dynamics of a quadratic integrateandfire neuron, spiking in the gamma (30–100 Hz) range, coupled to a delta/theta frequency (1–8 Hz) neural oscillator. Using analytical and semianalytical methods, we were able to derive characteristic spiking times for the system in two distinct regimes (depending on parameter values): one regime where the gamma neuron is intrinsically oscillating in the absence of theta input, and a second one in which gamma spiking is directly gated by theta input, i.e., windows of gamma activity alternate with silence periods depending on the underlying theta phase. In the former case, we transform the equations such that the system becomes analogous to the Mathieu differential equation. By solving this equation, we can compute numerically the time to the first gamma spike, and then use singular perturbation theory to find successive spike times. On the other hand, in the excitable condition, we make direct use of singular perturbation theory to obtain an approximation of the time to first gamma spike, and then extend the result to calculate ensuing gamma spikes in a recursive fashion. We thereby give explicit formulas for the onset and offset of gamma spike burst during a theta cycle, and provide an estimation of the total number of spikes per theta cycle both for excitable and oscillator regimes.
1 Introduction
Oscillations of neural activity are ubiquitous in the brain in many frequency bands [1], and it has been often argued that they play a functional role in cortical processing [2–4]. Physiological experiments and computational models have shown that ongoing brain oscillations are involved in sensorymotor functions [5], synaptic plasticity [6], memory formation and maintenance [7], among many other cognitive tasks. Indeed, it has been reported [2] that intrinsic brain rhythms can bias input selection, temporally link neurons into assemblies, and facilitate mechanisms that cooperatively support temporal representation and longterm consolidation of information. Notably gamma oscillations (>30 Hz) are prominent in neocortex during attention [8], sensory processing [9, 10], or motor control tasks [11], together with slower rhythms in the theta (3–8 Hz) or delta (1–3 Hz) range that have also been linked to various aspects of cognitive processes like working memory or the transmission of sensory and motor signals.
Many recent contributions point to nontrivial interactions among different frequency bands [12–14], such as phaseamplitude [15, 16] or phasephase coupling [17, 18] that can facilitate the simultaneous integration of multiple layers of information [19]. The hippocampus is a privileged site for observing such interactions [11, 20], since theta and gamma waves are particularly strong and reliable in that region [21]. Another particular case is represented by perception of speech signal performed by auditory cortex. In fact, to capture the many different relevant features of speech (i.e., syllables, vowels, consonants, etc.), the brain must be able to parse the speech signal over these many timescales at the same time. A number of recent works introduced the hypothesis that a network of nested theta (3–8 Hz) and gamma (30–100 Hz) rhythms could accomplish this task [22–24], given their matching in frequency with syllabic and phonemic timescale, respectively. Since there is no external onset signaling the presence of an incoming syllabic content, the phase of the gamma rhythm needs to be reset by some intrinsic mechanism, e.g., by theta input [23]. It becomes therefore important to know the time to first spike, which would be a measure of the speed of gamma phase resetting, as well as the time to last spike and the spiking frequency during excitable period.
There is a large literature on mathematical analysis of single frequency oscillators in networks of cortical circuits [25–31], and much work has been done in computational modeling of neural oscillations [2, 32, 33]. There is also a significant number of mathematical studies on crossfrequency interactions, however, most of that analysis is limited to the cases of weak coupling [34–37]. Strong coupling case has been analyzed either with pulsatile coupling [25, 38, 39] or with semianalytical and computational techniques [40–42]. Importantly, the question of how strong continuous coupling between slow and fast oscillations influences frequency and time of fast spikes has not been treated analytically, at least to the best of our knowledge. Yet experimental data suggest that phaseamplitude coupling in the brain is continuous (i.e., lowfrequency phase is conveyed through local field potential, a continuous signal) and strong [15, 39, 41], so this will be the regime we aim to study in the present work.
In this article, we provide analytical insights on the precise spiking times of a simplified Pyramidal Interneuron Network Gamma (PING) [41] during theta modulation. Two separate cases are studied: In the first setting, which we will refer to as oscillatory regime, the gamma network behaves as an intrinsic oscillator whose spike frequency is modulated by the theta phase; in the second, named excitable regime, gamma spikes are only evoked when input coming from the theta oscillator is strong enough. In the latter case, the system is in an “excitable” regime, where theta pushes gamma back and forth across a SaddleNode on Invariant Circle (SNIC) bifurcation. The analysis can be generalized beyond thetagamma nested oscillations; indeed it describes any coupling between low and a high frequency rhythms [43], provided that the latter is produced through feedback inhibition to the excitatory cell. To compute the time to the first gamma spike, we used different approaches for the two regimes: In the oscillatory case, we reduce the system in order to describe its dynamics with the Mathieu equation [44], and in the excitable case we apply an extension of geometric singular perturbation theory [45–47]. We then use a combination of the two to get successive spike times and an estimation of the total number of spikes per theta cycle.
The paper is organized as follows:

1.
In Sect. 1, we introduce the system to be studied.

2.
In Sect. 2, we consider the system in the oscillatory regime and compute time to first gamma spike using Mathieu functions. We found that spike time is mainly determined by the magnitude of thetagamma coupling (λ) and of theta frequency.

3.
In Sect. 3, we turn our attention to the excitable regime where theta phase determines the magnitude of input, thereby causing the gamma circuit to spike.

4.
Finally, we show that our approach gives results in agreement with direct numerical simulations of the system of interest.
In our analysis, we use tools from geometric singular perturbation theory. This approach normally fails in proximity of nonhyperbolic points, as it would be the case for the system considered in the present paper, but the blowup method extension provided in [48] allows us to compute approximations of the passage time to the first spike in the excitable case, and it is used both in the oscillator and excitable cases to estimate the duration of inhibition and the passage time of subsequent spikes. The latter estimates are based on the idea that inhibition puts the system in a state of quasi equilibrium; consequently, they work well if inhibition is strong and excitation not too high.
2 ThetaGamma Coupled Oscillator
We consider a minimal formulation of a theta modulated gamma spiking network. One single Excitatory Gamma (EG) neuron (${\theta}_{E}$), modeled as a θneuron [49] receives an excitatory input coming from an oscillator (Θ) whose natural frequency lies in the theta band. The canonical θneuron model is described by a phase variable lying on a onedimensional circle in the range ${\theta}_{E}\in [\pi ,\pi )$, a spike is produced when ${\theta}_{E}=\pi $. The EG neuron participates in a PING rhythm, although in our case the inhibitory gamma neuron is instantaneously enslaved to the excitatory cell, meaning that every excitatory spike would immediately prompt a simultaneous inhibitory spike [32]. This allows us to suppress the explicit dynamics of the inhibitory gamma neuron and focus on inhibitory synaptic dynamics only. Our system can be described by the following equations:
where $\Theta \in [\pi ,\pi )$ is the instantaneous phase of the slow rhythm variable (delta/theta frequency band, i.e., 1–8 Hz), which provides the sinusoidal modulatory input to the EG cell; ${s}_{I}$ is the variable representing the activation of the inhibitory synapse; ${I}_{E}$ represents constant driving input to excitatory gamma neuron; λ is the strength of thetagamma coupling; ${g}_{EI}$ is the inhibitory synaptic strength; ω has been chosen so that frequency ${\epsilon}_{\Theta}\omega $ falls into the theta range; ${\epsilon}_{I}$ is a scaling parameter that scales inversely with the time constant of synaptic inhibition; ${\epsilon}_{\Theta}$ is a second, slower, scaling parameter that has been chosen such that ${\epsilon}_{\Theta}\sim {\epsilon}_{I}^{2}$, an assumption that is motivated by biophysical considerations and, in addition, keeps the three time scales (theta rhythm, synaptic inhibition, and excitatory membrane potential) well separate.
We will consider two cases: the oscillator case, defined by ${I}_{E}>0$, and the excitable case, defined by ${I}_{E}<0$. The characterizing feature of the oscillator setting is that ${\theta}_{E}$–${s}_{I}$ subsystem in (1) is an intrinsic oscillator at every stage of a Θcycle, i.e., the total current input to EG neuron is always positive. In the excitable case, on the other hand, part of theta oscillation period is such that ${\theta}_{E}$ subsystem of (1) has an attracting quasisteady state, i.e., the total input to the EG neuron is negative or positive depending on Θoscillator phase. If ${I}_{E}<2\lambda $, the net input to EG neuron is always negative and the gamma circuit is always silent.
3 Time to First Spike, Oscillator Case
Let us consider the case in which constant driving term ${I}_{E}$ in system (1) is positive and such that, in absence of theta modulation, the EG neuron would fire periodically with a spiking frequency in the gamma range (30–150 Hz). We assume that the dynamics of the theta oscillator is at least one order of magnitude slower than synaptic decay, so that almost no residual inhibition is present at the beginning of a new theta cycle. In order to obtain an equation in the form of Mathieu equation, we first perform a change of variables in system (1) ${V}_{E}=tan\frac{{\theta}_{E}}{2}$, going from θvariable to membrane voltage ${V}_{E}$. As it is known [40], θneuron is formally equivalent to the Quadratic Integrate and Fire (QIF) neuron:
The two neural models are formally equivalent if we define the reset conditions as
where ${t}^{\ast}$ the time of spike. We have omitted the synaptic input dynamics since we assume that inhibition is directly enslaved to spikes coming from EG neuron, hence the inhibitory synapse ${s}_{I}$ stays inactive up to the first EG spike. We restate the system in (2) as a single equation, assuming by convention that $\Theta =\pi $ at $t=0$ (or at the beginning of a new theta cycle):
For ${I}_{E}>0$, this equation has an exact solution in terms of Mathieu functions. This can be found by imposing one more change of variable:
where the prime mark denotes the time derivative (a similar transformation is used in [50] where the cosinusoidal forcing term was replaced by exponential decay, leading to a different solution of the corresponding differential equation). Hence, we write (3) as a secondorder differential equation:
If parameters a, q, z are rescaled as following:
then Eq. (5) has the form of a Mathieu equation:
To interpret Eq. (7), we need temporal rescaling from t to z, and as a consequence the period of cosinusoidal term, which in Eqs. (1) and (2) was $T=\frac{2\pi}{{\epsilon}_{\Theta}\omega}$, becomes ${T}^{\ast}=\pi $. The solutions to Eq. (7) are linear combinations of the even and odd Mathieu functions [44], $\mathit{Ce}(a,q,z)$ and $\mathit{Se}(a,q,z)$, respectively. The solution
obeys the desired initial conditions, where the dot indicates the derivative with respect to z. Because of the change of variable in (4), the spiking times in the absence of inhibition correspond to the zeros of the solution of (7) $u(z)$ (Fig. 1). Hence, by scaling back to the original variables and looking at the first zero of $u(z)$ we obtain the time to the very first spike ${T}_{1}$. We numerically compute the time to the first spike as a function of parameters a and q, i.e., ${I}_{E}$ and λ. The subsequent spikes, on the other hand, depend on inhibition, and thus cannot be described by (3) alone. We looked for solutions of (2) with initial condition ${V}_{E}(0)=\mathrm{\infty}$ and $\Theta (0)=\pi $. Figure 2 shows the time to first spike ${T}_{1}$ as a function of λ with ${I}_{E}$ fixed at three values, ${I}_{E}=0.01$, ${I}_{E}=0.05$, and ${I}_{E}=0.1$. Note that for ${I}_{E}=0.01$ the dependence on λ is strong, but for larger values of ${I}_{E}$ the sensitivity of ${T}_{1}$ with respect to λ is smaller, since ${I}_{E}$ becomes the dominant input term. In the next section, we will consider the case when inhibition is strong and fully controls the gamma spikes.
4 Time to First Spike, Excitable Case
The excitable case implies that ${I}_{E}<0$, and $2\lambda +{I}_{E}>0$. Under these assumptions, the gamma spikes are only possible when Θ lies in a proper subinterval of $[\pi ,\pi )$, which corresponds to the values of Θ for which $\lambda (1+cos(\Theta ))+{I}_{E}>0$. This ensures that the dynamics of (1) cross the SNIC bifurcation for a certain value of $cos(\Theta )$. We carry out the computation with the initial conditions
where $\pi <{\theta}_{0}<0$ is defined by the condition $(1{I}_{E})cos{\theta}_{0}=1+{I}_{E}$, i.e. ${\theta}_{0}$ is a stationary fixed point in the absence of Θ positive input. The gamma neuron relaxes to ${\theta}_{0}$ when theta modulation is turned off. Note that ${\theta}_{E}={\theta}_{0}$ is not required for our solution to be applicable, since, for any initial value ${\theta}_{\mathrm{in}}<{\theta}_{0}$, ${\theta}_{E}$ quickly converges to ${\theta}_{0}$. At the end of every theta cycle ${s}_{I}$ goes back to zero, since its decay constant ${\epsilon}_{I}$ is one order of magnitude bigger than ${\epsilon}_{\Theta}$, and the EG cell has stopped firing once inhibition pushed it below the SNIC bifurcation. We start by computing an estimate of the time to the first gamma spike. System (1) involves two time scales, one that controls the intrinsic dynamics of the EG neuron and the other comes from Θ modulation. In the excitable case, rather than using the approach based on Mathieu functions, we use geometric singular perturbation theory. This approach leads to explicit estimates of the onset and duration of the gamma burst, it gives some geometric insights and can be applied in a more general setting. In order to compute the time at which the fast and the slow dynamics intersect, we need the value of Θ corresponding to ${I}_{E}+\lambda (1+cos(\Theta ))=0$, i.e., where the SNIC bifurcation takes place. Simple algebra shows that this occurs when
To ensure that (9) has solutions, we verify that the RHS of (9) is in the interval $(1,1)$. For the upper bound, we have
The lower bound is obtained as follows:
given that $\frac{{I}_{E}}{\lambda}>0$. Let now ${\Theta}_{0}$ be a solution of (9) satisfying $\pi <{\Theta}_{0}<0$ and let us consider system (1) with initial conditions (8): it is clear that any trajectory of the system can roughly be divided into two separate chunks (see Fig. 3). Starting from point $({\theta}_{0},\pi )$, the system immediately enters the slow motion part of the trajectory, which is adjacent to the nullcline $\frac{d{\theta}_{E}}{dt}=\phi ({\theta}_{E},\Theta )=0$. The slowest region of motion lies in the vicinity of the singular point $(0,{\Theta}_{0})$, where both $\phi ({\theta}_{E},\Theta )$ and its derivative with respect to ${\theta}_{E}$ are zero. Once the trajectory has gone beyond the singular point, φ turns positive again and grows quadratically in magnitude. This way ${\theta}_{E}$ quickly reaches the value ${\theta}_{E}=\pi $, since it is well known that any unbounded solution of the theta neuron for positive net input explodes in finite time. At the same time Θ increase is of order $\backsim O({\epsilon}_{\Theta})$. Now let us start by computing the time spent along the fiber which is close to the nullcline, and then direct our attention to the motion in the neighborhood of the singular point. The time needed for Θ to grow from −π to ${\Theta}_{0}$ equals
When Θ reaches ${\Theta}_{0}$, ${\theta}_{E}$ is $O({\epsilon}_{\Theta})$ (recall that this is also $O({\epsilon}^{2})$) close to the threshold value of ${\theta}_{E}=0$. In order to estimate the time that EG neuron needs to produce the first spike, i.e., to reach ${\theta}_{E}=\pi $, we need to examine the behavior when close to point $(0,{\Theta}_{0})$. We first translate the variable Θ, introducing $\tilde{\Theta}=\Theta {\Theta}_{0}$. Using Taylor expansion around ${\theta}_{E}\approx 0$ and $\Theta \approx {\Theta}_{0}$, we can write
We transform (1) to the coordinates $({\theta}_{E},\tilde{\Theta})$, taking into the account the expansion (11) and ignoring ${s}_{I}$ which remains zero until the first gamma spike (we omit the tilde for the simplicity of notation). The resulting system is
with $a=2\sqrt{{I}_{E}(2\lambda +{I}_{E})}$.
We then rescale the variables of (12) as follows:
In terms of the rescaled variables, with the tilde omitted, system (12) becomes
This means that the nullcline of system (13) for $\epsilon =0$, defined by the parabola $f(x,y)=0$, is a good approximation for the nullcline of system (1) in the neighborhood of the singular point $(0,{\Theta}_{0})$, or equivalently, in coordinates $(x,y)$, the point $(0,0)$. Thus system (13) has the same form as system (2.5) in [48] and can be restated as a Riccati equation:
By performing a change of variable, it can be shown that (14) is equivalent to a secondorder Bessel equation. The following function is a general solution of (14):
where ${J}_{\nu}$ are Bessel functions of the first kind of order ν. The only solution approaching the left branch of the nullcline parabola for $y<0$ is the one obtained by choosing $c=1$, thus we pick this value of c. The inverse of function $\zeta (y)$, namely $\xi (x)={\zeta}^{1}(y)$, defines the trajectory of x as a function of y (Fig. 3). Unfortunately, due to its highly nonlinear form, it is impossible to compute directly.
We use these results together with Theorem 2.1 and Remark 2.11 in [48] in order to derive the following estimate (the result dates back to much earlier, see for example [51]).
Proposition 1 Let ${y}_{0}>0$ and ${x}_{0}<0$ satisfy $f({x}_{0},{y}_{0})=0$. Also fix $\delta >0$. Consider a family of solutions of (13) with initial conditions $x(0)={x}_{0}+O(\epsilon )$ and $y(0)={y}_{0}$. Let $(\delta ,h(\epsilon ))$ be the intersection point of this trajectory with the line $x=\delta $. Then, for sufficiently small δ,
where ${\Omega}_{0}$ stands for the smallest positive zero of the denominator in (15):
From now on, we will use the numerical approximation
Note that the solution with initial conditions (8), transformed to the coordinates $(x,y)$, satisfies the assumptions of Proposition 1. Therefore, estimate (17) holds.
Now let ${T}_{1}$ be the time the of the first gamma spike, i.e., when ${\theta}_{E}=\pi $. From (16), it is easy to see that, after scaling back to the original variables (${\theta}_{E}$, Θ, ${\epsilon}_{\Theta}$), ${T}_{1}$ can be written as
with
The $O(ln{\epsilon}_{\Theta})$ term in (17) and the following one, of order $O(1)$ in ${\epsilon}_{\Theta}$, happen to be zero in the theta neuron model (as well as in the QIF model) when there is no excitatory feedback from the EG cell to the theta band oscillator (see the Appendix). The next nonzero term in (17) is then of order $O({\epsilon}_{\Theta}^{1/3})$, which represents the error with respect to the time at which the true trajectory of the system reaches ${\theta}_{E}=2\delta $. The value of δ does not have to be small, on the contrary our approximation works better when δ is such that the trajectory of the system is close to the asymptote $\Theta ={C}_{0}\omega {\epsilon}_{\Theta}^{2/3}$, as it is the case for the EG cell spike threshold $\delta =\frac{\pi}{2}$.
Predictions of Proposition 1 are illustrated in Figs. 3 and 4.
5 Subsequent Gamma Spikes, Oscillator Case
In the oscillator case, we assume that inhibition is strong enough to push the system below the SNIC bifurcation, regardless of the value of Θ, i.e.,
If the opposite is true, the system does not encounter the bifurcation, since $\frac{d{\theta}_{E}}{dt}$ is always greater than zero, and our analysis cannot be applied to subsequent spikes. We wish to derive an estimate on the number of EG spikes occurring along one Θ period, which is given by the time needed for Θ to grow from −π to π, thus equal to $2\pi /({\epsilon}_{\Theta}\omega )$. Let ${T}_{2},\dots ,{T}_{L}$ be the subsequent gamma spikes and ${\Theta}_{2},\dots ,{\Theta}_{L}$, the corresponding values of Θ. Let ${T}_{j}^{\ast}$ be the relative time after ${T}_{j1}$ at which the total driving input to the EG neuron reaches zero from negative values:
From now on, we use the fact that ${\epsilon}_{\Theta}\approx {\epsilon}_{I}^{2}$, and relabel ${\epsilon}_{I}\equiv \epsilon $. Hence, we can write
We expect ${T}_{j}^{\ast}$ to be of order $O({\epsilon}^{1})$ from (20), $cos({\Theta}_{j1})$ is then large compared to $sin({\Theta}_{j1}){\epsilon}^{2}\omega {T}_{j}^{\ast}$. We can thus replace (20) by a simpler formula:
Now
We denote the time interval between two successive gamma spikes by $\mathrm{\Delta}{T}_{j}$ and use the following estimate:
where
Estimate (24) is obtained analogously as (17). We can write the modulated instantaneous Interspike Interval (ISI), i.e., the instantaneous period, as
We derive the intrinsic period of PING in absence of any modulation:
After some algebra and performing a secondorder Taylor expansion around ${\Theta}_{j1}\approx \pi $, i.e., when theta excitation is minimal, the ISI becomes
The smallest ISI is obtained by expanding around ${\Theta}_{j1}\approx 0$, i.e., when theta excitation is maximal:
from (27) and (28) we can estimate respectively the lowest and highest gamma frequencies attained during theta modulation. We then derive an expression for the interval of time ΔT between the first to the last gamma spike within half a Θperiod:
where ${M}_{0}$ is the number of gamma spikes as Θ varies between −π and 0. Writing
and
we obtain
As ${M}_{0}$ provides an estimate for the number of gamma spikes as Θ grows from −π to 0, the total number of gamma spikes M is the largest integer such that
This formula works well, especially when inhibition is sufficiently strong. Figure 5 shows two cases where the formula gives the exact prediction of the number of gamma spikes and a good approximation of spike times. It is worth to mention that in the oscillatory case there is no phase reset at the end of a theta cycle, meaning that the initial conditions are never the same at the beginning of a theta oscillation. As a consequence, the result in (31) does not hold as a rigorous solution but as an average estimate, and the exact number of spikes can still vary over different trials. In Fig. 6, we show the direct comparison between the predictions of the formula and the simulation, as a function of λ. Note that for λ very small the estimate of the formula is too big. There we would need to include more terms in the ε expansion to get a more accurate prediction. When λ is large, for fixed ${g}_{IE}$, the positive input is such that inhibition is not sufficient to periodically time the spikes. As a consequence, the estimate of formula (31) becomes too small.
6 Subsequent Gamma Spikes, Excitable Case
6.1 Second Gamma Spike
Let ${T}_{2}^{\ast}$, be defined by
Note that
but, similarly to the oscillator case, we expect ${T}_{2}^{\ast}$ to be of order $O({\epsilon}^{1})$ from (32). This allows us to neglect the last two terms on the RHS of (33). Hence, by (32) and (33), we have
Further, we write
and substitute into (34) getting
It then follows from (35) that keeping only the leading terms:
6.2 Subsequent Gamma Spikes
We can write a variant of estimate (31) for the excitable case:
where now the extremes in the integrals are chosen to be the times of the first and last gamma spikes (i.e., the times when the EG neuron crosses the SNIC bifurcation respectively from below and above), assuming that these would be approximately symmetric with respect to the Θ cycle.
This formula works adequately for large inhibition and relatively small (negative) ${I}_{E}$. Otherwise, due to the intricate interplay between the growth of Θ and the decay of s almost to 0 (witnessed in the computation of ${T}_{2}$), it is not sufficient to have just the lowest terms of the ε expansion of $\mathrm{\Delta}{T}_{j}$. Figure 7 shows two cases where the formula gives the exact prediction of the number of gamma spikes. In Fig. 8, we show the direct comparison between the predictions of the formula and the simulation, as a function of λ. For λ large inhibition is too weak to time the spikes and the estimate of the formula becomes too small.
7 Conclusions and Future Directions
In this paper, we investigated how a continuous, strong, low frequency (1–10 Hz) modulation determines the spiking properties of a simplified PING oscillator. This work has been particularly motivated by recent investigation on the role of thetagamma interactions in processing speech signals [52]. Syllabic input are in fact known to possess a quasiperiodic structure matching theta frequency [24]. Within this framework, thetamodulated gamma spikes need to be aligned to the onset and the offset of linguistically relevant chunks [23]. It is then crucial to understand the timing of gamma spikes and the way they are influenced by theta input, since theta is supposed to detect the presence of long timescale syllabic content. It remains to be unveiled whether the scaling we analytically determined here is produced in more realistic models for speech processing [52] currently under development. Indeed, this result could also be used for other purposes: investigating how theta fluctuations modulate gamma firing in the hippocampus; determining the impact of alpha oscillations on higher frequencies (including gamma), which are thought to carry bottomup information in visual perception. Indeed timing of first spike is assumed to be particularly relevant in visual cortex, since it is has been shown that it would facilitate the neural encoding of stimuli [53].
To explore the dynamics of the system, we split the problem into two parameter regimes: In the first, the frequency of gamma spikes is only modulated by theta phase, while in the second the gamma cell would only fire if forced by theta input. In the former regime, by restating the problem in form of a Mathieu differential equation and looking at the first zero of the Mathieu function solving the initial value problem, we were able to find the time to first gamma spike. In the latter, we separate the dynamics into three time scales, one characterizing EG neuron dynamics in absence of any external input, one for theta dynamics, and one for synaptic inhibition, and we approximate the time to first spike by using an extension of the geometric singular perturbation theory based on the application of the blowup method [46, 48].
Computations align with the intuition (arising from the fact that ${\theta}_{E}$ is a type I neuron) that time to first spike decreases in both cases with coupling strength λ and constant driving current ${I}_{E}$. Interestingly, in the excitable case, we found that time to first spike depends approximately on ${\lambda}^{1/6}$, which implies that it saturates rapidly as λ grows. As a second notable result, ${T}_{1}$ scales as ${c}_{0}/{\epsilon}_{\Theta}+{c}_{1}/{\epsilon}_{\Theta}^{1/3}+O(ln({\epsilon}_{\Theta}))$, ${\epsilon}_{\Theta}$ being the speed of theta cycle. Building on these results, we subsequently computed the time to successive spikes in both regimes, where inhibitory synaptic decay time becomes an important factor. For both regimes were able to compute approximate spike times and predict the exact number of spikes per theta cycle (and instantaneous frequency of firing as a direct consequence) in a range of parameter values that leads to firing within the gamma frequency band.
In the present work, we analyzed a simple system in which coupling was limited to a feedforward thetagamma connection. It would be a natural next step to extend the analysis to bidirectional coupling by including a feedback from gamma spikes to the Θ oscillator. A second assumption we made in constructing our system stated that the gamma circuit internal delay between excitatory and inhibitory spikes was negligible, meaning that both cells would fire at exactly the same time. To make the model more biologically appealing, one could relax this hypothesis by introducing a synaptic delay after an excitatory spike and study the correspondent system (i.e., a full PING). For relatively short delays, we would expect the results obtained in this paper to hold at least qualitatively. Throughout this paper, we considered gamma to be a simplified PING generator, on the other hand it still remains an open question whether the same characteristics of thetagamma modulation we explored here would still be found in a different gamma generator, e.g., an Interneuron Network Gamma (ING) network [54] that can still be implement with Type I neurons as in the case of this work.
Appendix
We show that the term of order $O(ln{\epsilon}_{\Theta})$ in expansion (17) is zero in our model. The subsequent term, of order $O(1)$ is also zero, but we do not include the result here since computations are long and heavy. The interested reader could derive this result from [51].
In the absence of any synaptic input from the inhibitory neuron, we restate system (1) to reduce the complexity of notation:
Then, following [51], we write the expansion
which approximates the time to the first spike in the excitable case.
Coefficient ${D}_{0}$ in (41) might be written as
where S stands for the coordinates of the singular point $S=(0,{\Theta}_{0})$ and subscripts indicate the derivatives, i.e., ${\phi}_{x}(S)$ is the first derivative of φ with respect to x, taken at $(0,{\Theta}_{0})$. It is easy to verify that any derivative of φ with respect to x of order n, for n odd, is equal to zero at S. Furthermore, since $\psi (x,y)$ is constant in system (40), ${\psi}_{x}(S)$ is clearly zero. Hence, ${D}_{0}=0$.
References
 1.
Buzsaki G, Draguhn A: Neuronal oscillations in cortical networks. Science 2004, 304: 1926–1929. 10.1126/science.1099745
 2.
Wang XJ: Neurophysiological and computational principles of cortical rhythms in cognition. Physiol Rev 2010, 90: 1195–1268. 10.1152/physrev.00035.2008
 3.
Womelsdorf T, Schoffelen J, Oostenveld R, Singer W, Desimone R, Engel AK, Fries P: Modulation of neuronal interactions through neuronal synchronization. Science 2007, 316: 1609–1612. 10.1126/science.1139597
 4.
Young CK, Eggermont JJ: Coupling of mesoscopic brain oscillations: recent advances in analytical and theoretical perspectives. Prog Neurobiol 2009, 89(1):61–78. 10.1016/j.pneurobio.2009.06.002
 5.
Schoffelen J, Oostenveld R, Fries P: Neuronal coherence as a mechanism of effective corticospinal interaction. Sci Signal Transduct Knowl Environ 2005, 308(5718):111.
 6.
Huerta PT, Lisman JE: Bidirectional synaptic plasticity induced by a single burst during cholinergic theta oscillation in CA1 in vitro. Neuron 1995, 15(5):1053–1063. 10.1016/08966273(95)900942
 7.
Fell J, Klaver P, Lehnertz K, Grunwald T, Schaller C, Elger C, Fernández G: Human memory formation is accompanied by rhinalhippocampal coupling and decoupling. Nat Neurosci 2001, 4: 1259–1264. 10.1038/nn759
 8.
Jensen O, Kaiser J, Lachaux JP: Human gammafrequency oscillations associated with attention and memory. Trends Neurosci 2007, 30(7):317–324. 10.1016/j.tins.2007.05.001
 9.
Fries P, Reynolds J, Rorie A, Desimone R: Modulation of oscillatory neuronal synchronization by selective visual attention. Science 2001, 291(5508):1560–1563. 10.1126/science.1055465
 10.
Gray CM, König P, Engel A, Singer W: Oscillatory responses in cat visual cortex exhibit intercolumnar synchronization which reflects global stimulus properties. Nature 1989, 338(6213):334–337. 10.1038/338334a0
 11.
Bragin A, Jandó G, Nádasdy Z, Hetke J, Wise K, Buzsáki G: Gamma (40–100 Hz) oscillation in the hippocampus of the behaving rat. J Neurosci 1995, 15: 47–60.
 12.
Jensen O, Colgin LL: Crossfrequency coupling between neuronal oscillations. Trends Cogn Sci 2007, 11(7):267–269. 10.1016/j.tics.2007.05.003
 13.
Arnal LH, Morillon B, Kell CA, Giraud AL: Dual neural routing of visual facilitation in speech processing. J Neurosci 2009, 29(43):13445–13453. 10.1523/JNEUROSCI.319409.2009
 14.
Lakatos P, Shah AS, Knuth KH, Ulbert I, Karmos G, Schroeder CE: An oscillatory hierarchy controlling neuronal excitability and stimulus processing in the auditory cortex. J Neurophysiol 2005, 94(3):1904–1911. 10.1152/jn.00263.2005
 15.
Canolty RT, Edwards E, Dalal SS, Soltani M, Nagarajan SS, Kirsch HE, Berger MS, Barbaro NM, Knight RT: High gamma power is phaselocked to theta oscillations in human neocortex. Science 2006, 313(5793):1626. 10.1126/science.1128115
 16.
Morillon B, LiégeoisChauvel C, Arnal LH, Bénar CG, Giraud AL: Asymmetric function of theta and gamma activity in syllable processing: an intracortical study. Front Psychol 2012., 3: Article ID 248 Article ID 248
 17.
Belluscio MA, Mizuseki K, Schmidt R, Kempter R, Buzsaki G: Crossfrequency phasephase coupling between θ and γ oscillations in the hippocampus. J Neurosci 2012, 32(2):423–435. 10.1523/JNEUROSCI.412211.2012
 18.
Palva S, Palva JM: The functional roles of alphaband phase synchronization in local and largescale cortical networks. Front Psychol 2011., 2: Article ID 204 Article ID 204
 19.
SchefferTeixeira R, Belchior H, Caixeta FV, Souza BC, Ribeiro S, Tort ABL: Theta phase modulates multiple layerspecific oscillations in the CA1 region. Cereb Cortex 2012, 22(10):2404–2414. 10.1093/cercor/bhr319
 20.
Wulff P, Ponomarenko AA, Bartos M, Korotkova TM, Fuchs EC, Bähner F, Both M, Tort ABL, Kopell NJ, Wisden W, Monyer H: Hippocampal theta rhythm and its coupling with gamma oscillations require fast inhibition onto parvalbuminpositive interneurons. Proc Natl Acad Sci USA 2009, 106(9):3561–3566. 10.1073/pnas.0813176106
 21.
Buzsaki G, Buhl DL, Harris KD, Csicsvari J, Czéh B, Morozov A: Hippocampal network patterns of activity in the mouse. Math Eng Ind 2003, 116: 201–211.
 22.
Ghitza O: Linking speech perception and neurophysiology: speech decoding guided by cascaded oscillators locked to the input rhythm. Front Psychol 2011., 2: Article ID 130 Article ID 130
 23.
Giraud AL, Poeppel D: Cortical oscillations and speech processing: emerging computational principles and operations. Nat Neurosci 2012, 15(4):511–517. 10.1038/nn.3063
 24.
Shamir M, Ghitza O, Epstein S, Kopell NJ: Representation of timevarying stimuli by a network exhibiting oscillations on a faster time scale. PLoS Comput Biol 2009., 5(5): Article ID e1000370 Article ID e1000370
 25.
Bressloff PC, Coombes S: Dynamics of stronglycoupled spiking neurons. Neural Comput 2000, 12: 91–129. 10.1162/089976600300015907
 26.
Brunel N, Hakim V: Fast global oscillations in networks of integrateandfire neurons with low firing rates. Neural Comput 1999, 11(7):1621–1671. 10.1162/089976699300016179
 27.
Ermentrout GB, Chow CC: Modeling neural oscillations. Physiol Behav 2002, 77(4–5):629–633.
 28.
Ko TW, Ermentrout G: Phaseresponse curves of coupled oscillators. Phys Rev E 2009, 79: 1–6.
 29.
Kopell N, Ermentrout G: Mechanisms of phaselocking and frequency control in pairs of coupled neural oscillators. 2. In Handbook of Dynamical Systems. Elsevier, Amsterdam; 2002:3–54.
 30.
Ostojic S, Brunel N, Hakim V: Synchronization properties of networks of electrically coupled neurons in the presence of noise and heterogeneities. J Comput Neurosci 2009, 26(3):369–392. 10.1007/s1082700801173
 31.
Tiesinga PH, Sejnowski TJ: Mechanisms for phase shifting in cortical networks and their role in communication through coherence. Front Human Neurosci 2010, 4: 196.
 32.
Kilpatrick ZP, Ermentrout B: Sparse gamma rhythms arising through clustering in adapting neuronal networks. PLoS Comput Biol 2011., 7(11): Article ID e1002281 Article ID e1002281
 33.
Tiesinga P, Sejnowski TJ: Cortical enlightenment: are attentional gamma oscillations driven by ING or PING? Neuron 2009, 63(6):727–732. 10.1016/j.neuron.2009.09.009
 34.
Ermentrout G, Kopell N: Parabolic bursting in an excitable system coupled with a slow oscillation. SIAM J Appl Math 1986, 46(2):233–253. 10.1137/0146017
 35.
Lewis TJ, Rinzel J: Dynamics of spiking neurons connected by both inhibitory and electrical coupling. SIAM J Appl Math 2003, 14: 283–309.
 36.
Yu N, Kuske R, Li YX: Stochastic phase dynamics and noiseinduced mixedmode oscillations in coupled oscillators. Chaos 2008., 18: Article ID 015112 Article ID 015112
 37.
Ledoux E, Brunel N: Dynamics of networks of excitatory and inhibitory neurons in response to timedependent inputs. Front Comput Neurosci 2011., 5: Article ID 25 Article ID 25
 38.
VierlingClaassen D, Kopell N: The dynamics of a periodically forced cortical microcircuit, with an application to schizophrenia. SIAM J Appl Dyn Syst 2009, 8(2):710. 10.1137/080738052
 39.
Tort ABL, Rotstein HG, Dugladze T, Gloveli T, Kopell NJ: On the formation of gammacoherent cell assemblies by oriens lacunosummoleculare interneurons in the hippocampus. Proc Natl Acad Sci USA 2007, 104(33):13490–13495. 10.1073/pnas.0705708104
 40.
Börgers C, Kopell NJ: Effects of noisy drive on rhythms in networks of excitatory and inhibitory neurons. Neural Comput 2005, 17(3):557–608. 10.1162/0899766053019908
 41.
Kopell NJ, Börgers C, Pervouchine D, Malerba P, Tort ABL: Gamma and theta rhythms in biophysical models of hippocampal circuits. In Hippocampal Microcircuits. Springer, New York; 2010:423–457.
 42.
Roopun AK, Kramer M, Carracedo LM, Kaiser M, Davies CH, Traub RD, Kopell NJ, Whittington M: Temporal interactions between cortical rhythms. Front Neurosci 2008, 2(2):145–154. 10.3389/neuro.01.034.2008
 43.
Schroeder CE, Lakatos P: Lowfrequency neuronal oscillations as instruments of sensory selection. Trends Neurosci 2009, 32: 9–18. 10.1016/j.tins.2008.09.012
 44.
Ruby L: Applications of the Mathieu equation. Am J Phys 1996, 64: 39. 10.1119/1.18290
 45.
Fenichel N: Geometric singular perturbation theory. J Differ Equ 1979, 31: 53–98. 10.1016/00220396(79)901529
 46.
van Gils SA, Krupa M, Szmolyan P: Asymptotic expansions using blowup. Z Angew Math Phys 2005, 56(3):369–397. 10.1007/s000330041021y
 47.
Krupa M, Szmolyan P: Relaxation oscillations and canard explosion. J Differ Equ 2001, 174: 312–368. 10.1006/jdeq.2000.3929
 48.
Krupa M, Szmolyan P: Extending geometric singular perturbation theory to nonhyperbolic points—fold and canard points in two dimensions. SIAM J Math Anal 2001, 33: 286–314. 10.1137/S0036141099360919
 49.
Ermentrout B: Type I membranes, phase resetting curves, and synchrony. Neural Comput 1996, 8: 979–1001. 10.1162/neco.1996.8.5.979
 50.
Tonnelier A, Belmabrouk H, Martinez D: Eventdriven simulations of nonlinear integrateandfire neurons. Neural Comput 2007, 19(12):3226–3238. 10.1162/neco.2007.19.12.3226
 51.
Mishchenko EF, Rozov NK: Differential Equations with Small Parameters and Relaxation Oscillations. Plenum Press, New York; 1980.
 52.
Hyafil A, Gutkin B, Giraud AL: A theoretical exploration of speech/neural oscillation alignment for speech parsing. Front. Hum. Neurosci. Conference Abstract: XI International Conference on Cognitive Neuroscience (ICON XI) 2011.
 53.
Thorpe S, Delorme A, Van Rullen R: Spikebased strategies for rapid processing. Neural Netw 2001, 14(6–7):715–725.
 54.
Wang XJ, Buzsaki G: Gamma oscillation by synaptic inhibition in a hippocampal interneuronal network model. J Neurosci 1996, 16: 6402–6413.
Acknowledgements
LF, AH are supported by the European Research Council; AH and BG are partially supported by ANR “Neurobot” and “Dopanic”; BG is supported by CNRS and INSERM and LABEX “IEC”; MK supported by INRIA.
Author information
Additional information
Competing Interests
The authors declare that they have no competing interests.
Authors’ Contributions
LF, MK, AH, BG designed research; LF, MK performed research; LF, MK, AH, BG wrote the manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Received
Accepted
Published
DOI
Keywords
 Oscillations
 PING
 Dynamical systems
 Geometric singular perturbation theory
 Blowup method
 Spike times
 Thetagamma rhythms
 Type I neuron
 SNIC bifurcation