Information Technology Reference
In-Depth Information
2.6.2
The Activation Output
You should observe a reasonably close fit between
the final values of act_eq for SPIKE with that of
NOISY_XX1 . However, with smaller g_bar_e val-
ues (e.g., .38), the NOISY_XX1 is somewhat below the
spiking act_eq . Achieving a much closer fit between
spiking and rate coded activations such as that displayed
in figure 2.15 requires different parameter values that
are not otherwise appropriate for this exploration. This
is due to the aliasing effects of discrete-time updat-
ing (i.e., coarse-grained digitization effects, like when
trying to display a photograph on a low-resolution dis-
play), which the spiking model is very sensitive to.
In this section, we explore the way in which the unit
computes its activation output. The main objective is
to understand the relationship between the spiking and
rate-code activation functions.
We will use the same
project as the previous section.
Press Defaults to start out with default parame-
ters.
From the previous section, we know that changing
the level of excitatory input will affect the membrane
potential, and the resulting rate coded activation value.
Now let's explore this relationship in the spiking activa-
tion function.
Change g_bar_e back to its default value of .4.,
and make sure act_fun is set to SPIKE .
An important aspect of spiking in real neurons is that
the timing and intervals between spikes can be quite
random, although the overall rate of firing remains pre-
dictable. This is obviously not evident with the single
constant input used so far, which results in regular fir-
ing. However, if we introduce noise by adding small
randomly generated values to the membrane potential,
then we can see some of this kind of effect, although
it is still not as dramatic as it would be with multiple
spiking inputs coming into the cell. Note that this ad-
ditional noise plays a similar role as the convolution of
noise with the XX1 function in the noisy XX1 function,
but in the case of the noisy XX1 we have a deterministic
function that incorporates the averaged effects of noise,
while here we are actually adding in the random values
themselves, making the behavior stochastic.
Set act_fun to SPIKE , and press Apply and then
Run .
Instead of the steady values during the input pre-
sentation period, you now see the oscillations caused
by the spiking mechanism (as we saw previously in
figure 2.12). Thus, as soon as the membrane poten-
tial crosses the threshold, the activation spikes, and the
membrane potential is reset (to a sub-resting potential of
0, reflecting the overshoot of the spiking mechanism).
Then, the potential climbs back up, and the process re-
peats itself.
The spacing between the spikes is inversely propor-
tional to the firing rate, but it can be hard to eyeball this
from the graph. Let's look at act_eq , the rate-code
equivalent spike-rate value as a function of the spike
train (see equation 2.18).
Click on the act_eq graph line (plotted in blue).
Change the variance of the noise generator
( noise_var in the control panel) from 0 to .005, and
press Apply and then Run .
It can be difficult to tell from a single run whether the
spike timing is random — the unit still fires with some
regularity.
Next, observe the effects of changing g_bar_e from
.4, first to .38 and then to .42.
Question 2.6 Describe and explain the effects on the
spike rate of decreasing g_bar_e to .38, and of in-
creasing it to .42.
Do many Run s on top of each other in the graph log.
Now you should see that the spike timing was actu-
ally so random that there is essentially a uniform dis-
tribution of spike times across these different runs (i.e.,
a spike could occur at any time step), but the rate code
equivalent activation ( act_eq ) nevertheless remained
relatively constant (i.e., it had only a few different val-
ues at the end of a run). This happens because the
precise time at which a spike fires depends greatly on
The empirically-measured rate-code equivalent for
the spiking activation function ( act_eq ) compares
fairly closely with the rate-code value computed di-
rectly as a function of the membrane potential (act for
NOISY_XX1 ), as we saw in figure 2.15.
To explore this relationship in the simulation, you
can switch between SPIKE and NOISY_XX1 for different
values of g_bar_e .
Search WWH ::




Custom Search