- Open Access
Approximate, not Perfect Synchrony Maximizes the Downstream Effectiveness of Excitatory Neuronal Ensembles
The Journal of Mathematical Neuroscience volume 4, Article number: 10 (2014)
The most basic functional role commonly ascribed to synchrony in the brain is that of amplifying excitatory neuronal signals. The reasoning is straightforward: When positive charge is injected into a leaky target neuron over a time window of positive duration, some of it will have time to leak back out before an action potential is triggered in the target, and it will in that sense be wasted. If the goal is to elicit a firing response in the target using as little charge as possible, it seems best to deliver the charge all at once, i.e., in perfect synchrony. In this article, we show that this reasoning is correct only if one assumes that the input ceases when the target crosses the firing threshold, but before it actually fires. If the input ceases later—for instance, in response to a feedback signal triggered by the firing of the target—the “most economical” way of delivering input (the way that requires the least total amount of input) is no longer precisely synchronous, but merely approximately so. If the target is a heterogeneous network, as it always is in the brain, then ceasing the input “when the target crosses the firing threshold” is not an option, because there is no single moment when the firing threshold is crossed. In this sense, precise synchrony is never optimal in the brain.
Synchronization of neuronal firing is widely thought to be important in brain function. Synchrony and rhythms have been hypothesized to play roles, for instance, in directing information flow [1–3], binding the activity of different neuronal assemblies , protecting signals from distractors , enhancing input sensitivity [6, 7], and enhancing the downstream effectiveness of neuronal signals [8–10].
The case is simplest and strongest for the last of these hypothesized functional roles of synchrony: By synchronizing, an ensemble of excitatory neurons can amplify its downstream effect. In fact, when positive charge is injected into a leaky target neuron over a time window of positive duration, some of it will have time to leak back out before an action potential is triggered in the target, and it will in that sense be wasted. If the goal is to elicit a firing response in the target using as little charge as possible, it seems best to deliver the charge all at once, i.e., in perfect synchrony. Leaky neurons are often said to be coincidence detectors for this reason. This reasoning is commonplace and widely accepted in neuroscience. However, we show that whether or not it is actually correct depends on how one makes it precise; with one formalization that seems particularly natural to us, it is incorrect.
Network simulations of the kind shown in Fig. 1 have motivated this study. The figure shows spike rastergrams of networks of excitatory and inhibitory neurons (E- and I-cells); see Sect. 2.6 for the complete details. There are 200 E-cells (above the dashed line in the figure) and 50 I-cells (below the dashed line). The E-cells receive a strong external drive, linearly graded in strength; cells with greater neuronal index receive a greater drive. The I-cells are driven weakly, and they fire in response to the E-cells only. The synaptic interaction of the E- and I-cells with each other creates a rhythm in the gamma frequency range (30–80 Hz). The frequency comes from the decay time constant of inhibition, which is assumed here to be 9 ms, reminiscent of GABAA-receptor-mediated inhibitory synapses . The period of a 40-Hz rhythm, for example, is 25 ms, approximately the time it takes the inhibition to decay by a factor of 10 if the decay time constant is 9 ms. Rhythms of this sort are called PING (Pyramidal-Interneuronal Network Gamma) rhythms . In the right panel of the figure, tonic inhibition, i.e., synaptic inhibition with a constant conductance, has been added to the E-cells. The result is a slower rhythm, with looser synchronization among the E-cells, and participation of fewer E-cells. Notice that fewer E-cells are needed to prompt the I-cell response, in spite of the fact that the E-cells are less tightly synchronized than in the left panel. In this sense, the less tightly synchronized E-cells in the right panel seem to be more effective than the more tightly synchronized ones in the left panel, which appears to contradict the idea that for excitatory synaptic transmission, greater synchrony results in greater effectiveness.
We emphasize that this paper is not about rhythms; Fig. 1 is merely a motivating example. Here we focus on a single excitatory spike volley, and we study how it triggers a firing response in a target neuron. In the examples in Fig. 1, the target neurons are the I-cells. Specifically, we study the effect of tighter or looser synchrony within a single excitatory spike volley.
The resolution of the puzzle raised by Fig. 1 lies in the observation that there are (at least) two fundamentally different ways of asking the question “Does synchrony maximize the effectiveness of ensembles of excitatory neurons?”, and they lead to different answers. Simplifying a bit, we can state the following two principles.
If the excitatory input is allowed to have the “foresight” of turning off as soon as the target crosses the firing threshold, i.e., as soon as firing becomes inevitable even without further input, then precise synchrony is indeed optimal, as the commonplace reasoning would suggest.
On the other hand, if the excitatory input lasts until the target actually fires (perhaps terminated by a feedback signal), then approximate, often quite imperfect synchrony is optimal.
Both principles can be made precise, proved, and computationally supported in numerous different ways. We will give examples of that in this article. However, intuitively the reasoning is very simple: When the input is made more synchronous, it becomes more effective at eliciting a firing response in the target, but more of it is wasted because it arrives between the time when the firing threshold is reached in the target and the time when the input turns off.
The central distinction that we draw in this paper is between maintaining the input until the target reaches its firing threshold, and maintaining the input until the target actually fires. Assuming that the input continues until the target reaches threshold, greater synchrony is more economical. However, assuming that the input continues until the target fires, or even longer, for instance until a feedback signal from the target arrives, there is an “optimally economical” degree of synchrony that is not perfect, and that can be quite far from perfect.
The E-to-I interaction in PING is an example of an excitatory signal terminated by a feedback signal from the target: The E-cells stop firing when the I-cells respond, and thereby they shut them off. In PING, therefore, approximate synchrony of the E-cells is “optimal” in the sense that the rhythm is maintained with the smallest number of E-cells firing.
There is little evidence of perfect synchrony in the brain. If synchrony is really functionally important, this begs the question why evolution did such a poor job perfecting it. Perhaps the arguments given in this article point towards an answer: Making our terms precise in one possible and, we think, very natural way, we find that imperfect synchrony is more “economical” than perfect synchrony.
In this section we introduce the model target neurons that we will use throughout the paper. For completeness, we also specify the details of the network of Fig. 1.
We frequently use linear integrate-and-fire neurons in this paper, since analysis is easiest for them. For greater biophysical realism, we also use simple (single-compartment) Hodgkin–Huxley-like model neurons, for which we report numerical results, but no analysis. The theta neuron is in between: It is still simple enough for the sort of analysis that we are interested in here, but it is more realistic than the linear integrate-and-fire neuron.
2.1 Linear Integrate-and-Fire Model
In the linear integrate-and-fire (LIF) neuron, we take the membrane potential, v, to be scaled and shifted so that the firing threshold is 1, and the reset voltage is 0. The model then becomes
where and denote left- and right-sided limits, respectively, is the membrane time constant, and I is normalized external drive. Although the normalized membrane potential v is non-dimensional, we find it convenient to think of t and τ as quantities with the physical dimension of time, measured in ms. As a result, I is a reciprocal time.
Among other things, we will study how a brief positive input pulse elicits an action potential. In this context, I will be a continuous function of t, about which we assume
We interpret q as the (normalized) total charge injected into the neuron. We assume that is of significant size for , but not for . (For numerical illustrations, we will use , with .) Thus the “duration” of the input pulse I is on the order of 1 ms.
We will discuss in what sense there is coincidence detection, i.e., in what sense more rapid delivery of excitatory input is more effective. For this purpose, we consider
For all , the total amount of charge injected is
Note that is of significant size for , but not for . Thus the duration of the input pulse is on the order of ε (time measured in ms). For smaller ε, the same amount of charge is delivered in a briefer time period; this is why we think of smaller ε as modeling greater synchrony of inputs. As , converges to , where δ denotes the Dirac delta function at . In this limit, the effect of the input pulse becomes an instantaneous increase in the membrane potential by q.
To clarify in which sense smaller ε corresponds to more synchronous input, think of as being approximated by a sum of δ-functions:
where is small. Physically, this amounts to approximating the input current I by a sequence of weak instantaneous charge injections, arriving at times , . These instantaneous charge injections can be understood as models of very fast, i.e., very rapidly decaying excitatory synaptic inputs. (Technically, the right-hand side of (3) converges to as in the distributional sense.) The input pulse can be approximated by
with the same weights . (Again, technically the right-hand side converges to the left-hand side in the distributional sense as .) Thus is approximated by the same sequence of weak input pulses as I, but the time between subsequent input pulse arrivals is ε Δ instead of Δ; that is, the input pulses arrive more synchronously when ε is smaller.
To better understand coincidence detection, we will examine how the solution of
depends on ε. When , we write v instead of . To make the dependence on τ explicit, we sometimes write or ; even when using this notation, however, we usually denote the derivative with respect to t by , not . Since , it is guaranteed that for all , , and . We use the notation
An action potential is elicited by the input if and only if .
2.2 Theta Model
The theta neuron, first proposed by Ermentrout and Kopell , is equivalent to a specific form of the quadratic integrate-and-fire (QIF) model. The equation governing the membrane potential v is now
For , Eq. (8) has two fixed points, and , with
The fixed point is stable and is unstable. The two fixed points collide and annihilate each other in a saddle-node bifurcation as I rises above .
The quadratic nature of the right-hand side of (8) has the effect that v rises from 1 to +∞ and from −∞ to 0 in a finite (and brief) amount of time. One obtains a simplified model by moving the firing threshold to +∞, and the reset voltage to −∞:
With the change of coordinates
the model then becomes
When , there are two fixed points, corresponding to the two fixed points of the QIF neuron given in (9):
The fixed point is stable and is unstable. When we refer to the theta model, we mean (12) or, equivalently, (8) and (10). To fire means to reach , or equivalently, . Ermentrout and Kopell  used .
We will study how a brief positive input pulse into a theta neuron elicits an action potential, using the same setup as in Sect. 2.1. Equation (6) becomes
(Note that is the stable equilibrium of Eq. (8) when .) As in Sect. 2.1, we sometimes write to make the dependence on τ explicit, and we skip the subscript ε when . Also as in Sect. 2.1, we note that for all , , and .
The definition of (compare Eq. (7)) must be modified slightly here:
An action potential is elicited by the input pulse if and only if . We note that is equivalent to , since will reach ∞ in finite time as soon as it exceeds 1.
2.3 Wang–Buzsáki Model
The well-known Wang–Buzsáki (WB) neuron  is patterned after fast-firing interneurons in rat hippocampus. The ionic currents are those of the classical Hodgkin–Huxley neuron, i.e., spike-generating sodium, delayed rectifier potassium, and leak currents; we refer to  or [, Appendix 1] for all details.
2.4 A Rapid Volley of Excitatory Synaptic Inputs into a Single Target Neuron
Throughout most of this paper, we will think about a single target neuron driven by input. This input may be a current pulse, for instance of the form described earlier, or more realistically, a sequence of weak excitatory synaptic input pulses, modeled by a term of the form
on the right-hand side of the equation governing the evolution of v. Here is the synaptic reversal potential. For the WB model, we use , following [, Appendix 1]. For the LIF and theta models, we use . As in a real neuron, this is the threshold voltage () plus several times (namely, four times) the difference between threshold () and reset (). The synaptic gating variable will be assumed to jump upwards periodically with period (time measured in ms):
The variable s should be thought of as the sum of gating variables associated with multiple different weak synapses, with an accumulating effect far from saturation; this is why s is not assumed to be bounded by 1. For simplicity, the time Δ between the arrival of input pulses is assumed to be constant. The factor in (16) represents the maximal conductance (or conductance density) of one of the weak synapses, and it will be taken to be small. Between jumps, we assume s to decay with time constant 3 ms:
The decay time constant of 3 ms is chosen to mimic AMPA-receptor-mediated synapses .
2.5 Reduced Traub–Miles Model
In our network model, the inhibitory cells are WB neurons, and the excitatory ones reduced Traub–Miles (RTM) neurons. The RTM model is due to Ermentrout and Kopell , patterned after a more complicated, multi-compartment model of Traub and Miles , and it is used here in the form stated in detail in [, Appendix 1]. It is a single-compartment model of a pyramidal (excitatory) cell in rat hippocampus. As for the WB neuron, the ionic currents are those of the classical Hodgkin–Huxley neuron, i.e., spike-generating sodium, delayed rectifier potassium, and leak currents.
2.6 Network Model
The only network simulation in this paper is the motivating example shown in Fig. 1. The model network consists of 200 RTM neurons (E-cells) and 50 WB neurons (I-cells). There is all-to-all synaptic connectivity, modeled as described in [, Appendix 1], with no gap junctions. The following parameter values specify the network in the left panel of the figure completely (see [, Appendix 1]):
The drive to the j th E-cell (strictly speaking, drive density, measured in μA/cm2) is , . (The j th E-cell is labeled in Fig. 1, because the 50 I-cells are labeled first.) The drives to the I-cells are zero. There is no stochastic drive here.
The total synaptic conductances (strictly speaking, conductance densities, measured in mS/cm2) are , , , and . The conductance associated with a single -synapse, for instance, is .
The reversal potentials (measured in mV) of the excitatory and inhibitory synapses are and .
The rise and decay time constants of synaptic inhibition (measured in ms) are , , , and .
In the right panel of the figure, the extra term is added to the right-hand side of the equation governing the membrane potential of the j th E-cell, , to model tonic inhibition affecting the E-cells.
2.7 Computer Codes
Each figure in this paper is generated by a single, stand-alone Matlab program. All of these programs can be obtained by e-mail from the first author.
3 If the Excitatory Signal Ceases when the Target Crosses the Firing Threshold, Synchrony Is Optimally Efficient
We will give several settings in which the above statement can be made rigorous. Here the target is always a single neuron, not a network. In Fig. 1, the target of the excitatory input volleys is a network, namely the ensemble of I-cells. However, they are synchronized so tightly that we might as well assume a single I-cell. For a comment on the case when the target is itself a network that is not perfectly synchronous, see the Discussion.
3.1 Constant Current Input Driving a LIF Neuron
This is the most commonplace version of the argument. Consider a LIF neuron driven by a constant input , with :
We think of Δ as the time between the individual pulses of a rapid input volley, as in Sect. 2.4. In (18) we simplify by equating the frequency of input pulses within the volley, , with the strength of a constant input current. Smaller Δ, i.e., larger input, should be thought of as modeling more synchronous input from multiple sources.
An action potential occurs if and only if , and in that case it occurs at time
Note that the time of firing is, in this model, the same as the time at which the firing threshold is reached. An action potential occurs instantly (by definition) when v reaches 1. If the input ceased before v reaches 1, no action potential would occur. The total charge needed to elicit an action potential is
Using (19), we find
Figure 2 shows the graph of the function φ. It is strictly decreasing, so is a strictly increasing function of Δ. More synchronous input (smaller Δ) produces an action potential in the target more efficiently (smaller ). The fact that is a function of (not of Δ alone) reflects that leakiness is what matters here.
3.2 Current Input Pulse of General Shape Driving a LIF Neuron
We turn to a second way of making precise the notion that excitatory current input becomes more effective when delivered more synchronously. Consider a linear integrate-and-fire neuron subject to a positive current pulse, as described in Sect. 2.1, where the notation used here was introduced. The issue of coincidence detection is linked to leakiness, and we therefore first think about how v depends on τ.
Lemma 1 (a) Let . Then for all , . Furthermore, if , then . (b) .
Proof (a) By standard theory of ordinary differential equations, for all because the right-hand side of the differential equation (1) is an increasing function of τ. We will show now that the inequality is strict if . Suppose that on the contrary, with . Then
and therefore for , sufficiently small. However, we already know that this is impossible. (b) Using variation of the constant, we find
This implies part (b) of the lemma. □
Lemma 2 is a strictly decreasing function of with and .
Proof We will first show that
To verify (21), we first note that both sides of (21) are zero at . We next carry out a brief calculation to show that the right-hand side solves the differential equation in (6), which the left-hand side solves by definition. In this calculation, we will use the notation for the partial derivative of with respect to t. With this notation,
by the chain rule,
because v satisfies (1) (the “τ” in (1) is replaced by here, and the time at which we evaluate both sides of (1) is ), and
by the definition of . This concludes the derivation of (21).
Equation (21) implies
Part (a) of Lemma 1 now implies that is a strictly decreasing function of ε.
We pointed out in Sect. 2.1 that in the limit as , approaches . Thus in this limit, jumps from 0 to q at time , then decays. This implies as . Part (b) of Lemma 1, combined with (22), implies as . □
Figure 3 illustrates the statement of Lemma 2 by showing the graph of , as a function of ε, for , .
Theorem 1 If , there exists an such that elicits an action potential for , but not for . If , then does not elicit an action potential for any .
Proof This immediately follows from Lemma 2. □
The theorem shows that input becomes more effective when delivered more rapidly: If a given pulse succeeds at eliciting an action potential, then the same pulse, delivered faster, will succeed as well.
3.3 Current Input Pulse of General Shape Driving a Theta Neuron
We repeat the analysis of the preceding section for a target modeled as a theta neuron. So we now consider a theta neuron, written in terms of v, subject to a positive current pulse; see Sect. 2.2. As in Sect. 3.2, we begin by analyzing the effect of leakiness on the membrane potential.
Lemma 3 (a) Let . Let be chosen so that for . Then for all , . Furthermore, if , then . (b) .
Proof (a) Same as proof of Lemma 1. (b) Let , and assume that τ is so small that . Then
Note that (23) implies
Consequently the solution v of
cannot exceed . This bound converges to 0 as , implying (b). □
Lemma 4 As long as is less than 1, it is a strictly decreasing function of , and as .
Proof Same as proof of Lemma 2. □
Figure 4 illustrates the statement of Lemma 4 by showing the graph of , as a function of ε, for , .
Theorem 2 If , there exists an such that for , , and for . If , then for all .
Proof This follows immediately from Lemma 4. □
Again we see that input becomes more effective when delivered more rapidly: If a given pulse succeeds at eliciting an action potential, then the same pulse, delivered faster, will succeed as well.
We conclude this subsection with a tangential comment. When , stays below 1 for all times, and converges to 0 as . When , rises above 1 at a finite time. What is the behavior of ? It can be shown that as ; we omit the proof of this result because it is not central to what this article is about. The result sounds surprising at first, since as and 1 is a repelling fixed point of the equation
However, the repulsion is overcome by the positive input. Figure 5 illustrates this point for , .
3.4 Sequence of Weak Instantaneous Positive Charge Injections Driving a LIF Neuron
The analyses given so far assume continuous current inputs. Of course, in the brain, inputs come as synaptic pulses. The simplest model involving a sequence of weak input pulses, not a continuous current input, is
where δ denotes, as before, the Dirac delta function, , and . It is straightforward to verify that v will reach the threshold 1 eventually if and only if
and that the number of input pulses required to make v reach 1 decreases as Δ decreases. We omit the derivation of this unsurprising result.
3.5 Sequence of Weak Excitatory Synaptic Pulses Driving a WB Neuron
We now give our final and most realistic illustration of the principle that synchrony makes excitatory input into a target neuron optimally efficient, provided that the input is allowed to cease when the target crosses the firing threshold.
We examine a WB neuron with zero external drive, resting at its stable fixed point at time zero, and then subject to weak excitatory synaptic pulses at times k Δ, , with . The synaptic pulses are modeled as described in Sect. 2.4. For a given , we determine numerically the number of input pulses that are needed to generate an action potential in the target. It is important here to emphasize that the input ceases not when the target neuron actually fires, but when it is going to fire without further input pulses, in other words, when it crosses the firing threshold. Although it is hard to imagine how an actual neuronal network sending input to a target should know this number without a feedback signal from the target, we can of course compute it easily in our model. Figure 6 shows the result of this computation. The maximum conductance of an individual input pulse (see Sect. 2.4) was 10−3 here. We see that is an increasing function of Δ, so perfect synchrony is most efficient (namely, generates firing in the target at the expense of the smallest number of input pulses).
This result is in agreement with the standard reasoning about synchronization and leakiness. For a target neuron with voltage-activated currents, such as the WB neuron, it certainly is not a priori clear that this reasoning leads to a correct conclusion. However, Fig. 6 suggests that it probably does, at least for the WB neuron.
4 If the Excitatory Signal Continues Until the Target Fires, Approximate Synchrony Is Optimally Efficient
Again we present several settings in which the statement in the title can be made rigorous. However, first we discuss some results concerning the firing time of a target neuron driven by a current pulse (as in Sect. 2.1). This is useful in later subsections, and in particular it clarifies what is the essential source of the non-monotonicity found in later subsections.
4.1 The Time It Takes to Elicit an Action Potential with a Current Pulse
For , we denote by the time at which the action potential occurs in response to the input pulse (as in Sect. 2.1). This definition requires several clarifications. If elicits several action potentials, we let be the time of the earliest one. If elicits no action potential at all, we let . By “time at which the action potential occurs”, we mean the time when v reaches 1 for the LIF neuron, the time when v reaches ∞ (i.e., θ reaches ) for the theta neuron, or the time when v rises above 0 for the WB neuron.
We also examine the ratio
which measures how long it takes to elicit an action potential in comparison with input duration. We note, in particular, that implies that the input pulse is essentially over long before the target fires.
As an example, we consider the LIF neuron with , and . Figure 7a shows as a function of ε, and Fig. 7c shows as a function of ε. We will prove that qualitatively, the graphs of and are always similar to those in Fig. 7 for the LIF neuron. In particular, there is no non-monotonicity here, and as , as shown in Fig. 7b, which is a blow-up of Fig. 7a.
Theorem 3 Consider the LIF neuron given by (6), with and as described in Theorem 1. Then
and is strictly increasing for .
Proof To emphasize the dependence of on τ, we write . When , we write instead of . Recall now Eq. (21):
Setting , we find
So the time at which becomes 1 is ; but by definition that time is . We conclude
This implies that is a strictly increasing function of , by Lemma 1. In the limit as , becomes . An input pulse of the form , with , makes v jump above threshold instantaneously; so as . The limit of as is the finite time at which reaches 1. □
That fact that as in Fig. 7a is a bit unrealistic from a biological point of view. In a real neuron, an instantaneous charge injection (if there were such a thing in reality) would have to be of gigantic strength to push the membrane potential above 0 mV instantly, and thereby—by our definitions—trigger an instant action potential. We next give numerical results for the theta neuron with and . Figures 8a and 8c show and as functions of ε; Fig. 8b is a blow-up of Fig. 8a near . We will show that, for the theta neuron, the graphs of and always share important features of the examples shown in Fig. 8. In particular, the limit of as is positive, and depends on ε non-monotonically.
Theorem 4 For the theta neuron with a positive input pulse , with and defined as described in Theorem 2, the firing time satisfies
The function is non-monotonic, with
Proof In the limit as , becomes , and therefore converges to the positive, finite time that it takes for the solution of
to rise from to ∞. This proves . Because (see discussion at the end of Sect. 3.3, and in particular Fig. 5), follows from the continuous dependence of on ε. Finally, (25) follows immediately from (24). □
Next we present numerical simulations suggesting that the behavior of and for the WB neuron is similar to that for the theta neuron. For illustration, we consider the example . We start, at time , with v, h, and n at the equilibrium values corresponding to zero external drive. Figures 9a and 9c show and as functions of ε; Fig. 9b is a blow-up of Fig. 9a near .
4.2 If Input Current Ceases when the Target Fires, How Much Charge Is Injected?
is the total amount of charge needed to elicit the action potential. We note that
Thus depends on ε monotonically if and only if does. For the LIF, theta, and WB neurons, we show in Fig. 10 the dependence of on ε. In accordance with the preceding reasoning and with the results of Sect. 4.1, increases with ε for the LIF neuron, but not for the QIF and WB neurons.
The variation of as a function of ε is relevant only if is not large, i.e., if the input pulse is so strong that the target fires while the input is still ongoing. When , then the input pulse is essentially complete by the time the target fires, and therefore is simply (very close to) q. To illustrate this, we show in Fig. 11 the same figure as in the right-most panel of Fig. 10, but with replaced by . Here , and is very close to independent of ε.
4.3 If Synaptic Input Pulses Cease when the Target Fires, How Many Pulses Are Needed?
Arguably, this is the version of our question that is biologically most interesting. We consider trains of weak excitatory synaptic inputs as described in Sect. 2.4. Recall, in particular, from Sect. 2.4 that we denote by the time between input arrivals. We denote by the number of input pulses that will arrive before the target fires. We emphasize that is not the same as the “” of Sect. 3.5; is the number of input pulses needed to take the target above the firing threshold, while is the number of input pulses that will have arrived by the time the target actually fires. Figure 12 shows as a function of Δ, for the LIF, theta (QIF), and WB models, using . The figure confirms the insight from Fig. 1: When the input pulses are less synchronous (that is, when Δ is larger), fewer of them may have to arrive before the target fires. The figure shows that this effect can be quite significant.
4.4 Linearly Rising Current Input Driving a LIF Neuron
When Δ, the time between input pulses, is small in comparison with the synaptic decay time constant, taken to be 3 ms here (see Eq. (17)), the input currents in Fig. 12 rise approximately linearly, since the synaptic gating variable builds up with each input pulse, and it decays only little between pulses. Figure 13 illustrates this, by plotting, for three of the simulations underlying the left panel of Fig. 12, namely the ones for , 0.025, and 0.0125, the current .
The slope of the linear build-up of is approximately proportional to . We therefore think about the following model problem:
where . We compute the time at which v reaches 1, then define to be the number of pulses arriving in time , i.e.,
and plot as a function of Δ. For , , the result is shown in Fig. 14. We see that the model problem (27) captures the central fact that (approximated here by ) is a decreasing function of Δ for small Δ (and thus perfect synchrony is not optimal), but not the fact that it is an increasing function of Δ for large Δ (see Fig. 12). This is not surprising: In the left-most panel of Fig. 12, in the range when is an increasing function of Δ, the duration of the input spike volley, , is much greater than 3, the decay time constant of the excitatory synaptic input pulses. In this regime, the assumption of a linearly building input current is not valid.
In spite of the simplicity of (27), it is not possible to write down a formula for . To see this, note first that the solution of (27) is
solves the equation , i.e.,
One cannot solve this equation explicitly, but for small-enough Δ, , and (29) is then well approximated by
i.e., , and . It is easy to argue that this approximate calculation rigorously describes the asymptotic behavior of , calculated from the model problem (27), as .
Theorem 5 The quantity , defined in (28) based on the model problem (27), satisfies the asymptotic relation
in the limit as .
In fact, the blow-up in the limit as in Fig. 12 can be verified numerically to be proportional to as well, in all three cases shown in the figure.
We return to Fig. 1. The figure shows that with greater tonic inhibition of the E-cells (right panel), the degree of synchrony among the E-cells is reduced, yet the number of participating E-cells is reduced as well. In the notation that we have used throughout this article, for larger Δ (right panel), the number of input pulses to the I-cells required to elicit firing is smaller. Section 4 explains how this comes about.
In general, in PING, the E-cells synchronize approximately, but not perfectly, when different E-cells receive different drives, or there is heterogeneity in synaptic strengths. The I-cells are therefore driven to firing by a sequence of nearly, but not perfectly synchronous input pulses. Our results show that there is an optimal level of looseness in the synchronization of the E-cells, that is, a level of looseness that allows operating the PING rhythm with the minimal number of E-cell action potentials.
In reality, when a feedback signal terminates the input, that feedback signal would not likely come at the moment when the target fires. A delay in the feedback signal amplifies our point: During the delay time, input is “wasted”, and the more synchronous the input stream, the more input is wasted.
We have concluded that perfect synchrony is optimal if the input stream is allowed to have the “foresight” of ceasing when the firing threshold is reached in the target. Note, however, that there is no well-defined “time at which the firing threshold is reached” when the target is not a single neuron, but a heterogeneous network. We therefore hypothesize that of the two principles stated in the Introduction, the second is the more relevant from the point of view of biology.
An interesting question for future study is how noise affects our conclusions. The answer depends almost certainly on how the question is made precise. The simplest formalization of the question, in the LIF framework, might be as follows. Consider
where dW denotes normalized Gaussian white noise, so that , without the extra input pulse , would be an Ornstein–Uhlenbeck process. Assume that has Gaussian distribution with mean 0 and variance , the equilibrium distribution of the Ornstein–Uhlenbeck process. Define , where is of moderate size, perhaps . If F is a strictly decreasing function of ε, then synchrony is, in this sense, “optimal”, whereas it isn’t if F has a local maximum at a positive value of ε. More realistic variations on this formalization are of course possible, using noise-driven Hodgkin–Huxley-like neurons with conductance-based inputs. We would not be surprised if F turned out to be strictly decreasing, i.e., perfect synchrony turned out to be “optimal” in this sense, but will leave the study of this issue to future work.
We summarize our surprising conclusion: The commonplace and widely accepted argument suggesting that synchrony makes excitatory inputs more effective is, at least in one very natural formalization (namely, that of Sect. 4), wrong. It is not just “slightly wrong”, but significantly so; see for instance the right-most panel in Fig. 10, which shows that, for the WB neuron, the “optimal” (in the sense of Sect. 4) duration of an input spike volley is on the order of 10 ms.
Salinas E, Sejnowski TJ: Correlated neuronal activity and the flow of neural information. Nat Rev Neurosci 2001, 2: 539–544. 10.1038/35086012
Fries P: A mechanism for cognitive dynamics: neuronal communication through neuronal coherence. Trends Cogn Sci 2005, 9: 474–480. 10.1016/j.tics.2005.08.011
Fries P: Neuronal gamma-band synchronization as a fundamental process in cortical computation. Annu Rev Neurosci 2009, 32: 209–224. 10.1146/annurev.neuro.051508.135603
Gray CM: The temporal correlation hypothesis of visual feature integration: still alive and well. Neuron 1999, 24(1):31–47. 10.1016/S0896-6273(00)80820-X
Börgers C, Kopell N: Gamma oscillations and stimulus selection. Neural Comput 2008, 20(2):383–414. 10.1162/neco.2007.07-06-289
Börgers C, Epstein S, Kopell N: Background gamma rhythmicity and attention in cortical local circuits: a computational study. Proc Natl Acad Sci USA 2005, 102(19):7002–7007. 10.1073/pnas.0502366102
Chen Y, Zhang H, Wang H, Yu L, Chen Y: The role of coincidence-detector neurons in the reliability and precision of subthreshold signal detection in noise. PLoS ONE 2013., 8(2): Article ID 56822 Article ID 56822
König P, Engel AK, Singer W: Integrator or coincidence detector? The role of the cortical neuron revisited. Trends Neurosci 1996, 19(4):130–137. 10.1016/S0166-2236(96)80019-1
Roy SA, Alloway KD: Coincidence detection or temporal integration? What the neurons in somatosensory cortex are doing. J Neurosci 2001, 21(7):2462–2473.
Azouz R, Gray CM: Adaptive coincidence detection and dynamic gain control in visual cortical neurons in vivo. Neuron 2003, 37(3):513–523. 10.1016/S0896-6273(02)01186-8
Kopell N, Börgers C, Pervouchine D, Malerba P, Tort ABL: Gamma and theta rhythms in biophysical models of hippocampal circuits. In Hippocampal Microcircuits: A Computational Modeler’s Resource Book. Edited by: Cutsuridis V, Graham B, Cobb S, Vida I. Springer, New York; 2010. [http://math.bu.edu/people/nk/papers.html] [http://math.bu.edu/people/nk/papers.html]
Whittington MA, Traub RD, Kopell N, Ermentrout B, Buhl EH: Inhibition-based rhythms: experimental and mathematical observations on network dynamics. Int J Psychophysiol 2000, 38: 315–336. 10.1016/S0167-8760(00)00173-2
Ermentrout GB, Kopell N: Parabolic bursting in an excitable system coupled with a slow oscillation. SIAM J Appl Math 1986, 46: 233–253. 10.1137/0146017
Wang X-J, Buzsáki G: Gamma oscillation by synaptic inhibition in a hippocampal interneuronal network model. J Neurosci 1996, 16: 6402–6413.
Ermentrout GB, Kopell N: Fine structure of neural spiking and synchronization in the presence of conduction delay. Proc Natl Acad Sci USA 1998, 95: 1259–1264. 10.1073/pnas.95.3.1259
Traub RD, Miles R: Neuronal Networks of the Hippocampus. Cambridge University Press, Cambridge; 1991.
The authors were supported in part by the Collaborative Research in Computational Neuroscience (CRCNS) program through NIH grant 1R01 NS067199.
The authors declare that they have no competing interests.
JL made the crucial observation explaining Fig. 1, and performed initial computations. CB performed most of the computations, and developed the mathematical reasoning. NK participated in the writing of the paper, and in discussing and clarifying the ideas throughout. All authors read and approved the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.