Information Technology Reference
In-Depth Information
result of this accommodation, as we saw before, the unit
does not then get activated immediately by the second
input.
function, and can help to make sense of their underlying
biological properties.
Now, you can play with the hyst parameters and
see what they do to the unit's response properties.
In summary, you can see that there is considerable
potential for complex dynamics to emerge from the in-
teractions of these different channels. The fact that ac-
tual neurons have many such channels with even more
complex dynamics suggests that our basic point neu-
ron model is probably a lot simpler than the real thing.
Due to pragmatic constraints, we typically ignore much
of this complexity. As the simulations later in the
text demonstrate, such simplifications do not make that
much of a difference in the core aspects of behavior that
we are modeling.
Biology of the Neuron
The neuron is an electrophysiological entity that can be
understood using the principles of electricity and diffu-
sion. Inputs come into the neuron primarily through
channels located in synapses , allowing charged atoms
or ions into and out of the neuron. Different ions have
different concentrations on the inside and outside of
a neuron, and this leads to the generation of electri-
cal current when channels open and allow ions to flow
along their concentration gradients (because of diffu-
sion ) into or out of the cell. Thus, neurons become ex-
cited when positively charged sodium ions (Na + )en-
ter the cell through synaptic channels in their receiv-
ing areas called dendrites . These synaptic channels are
opened by the neurotransmitter known as glutamate ,
which is released by the sending or presynaptic neu-
ron. Different inputs can provide different amounts of
activation depending on both how much neurotransmit-
ter is released by the sender and how many channels on
the postsynaptic (receiving) neuron open as a result.
These different synaptic efficacies for different inputs,
which we refer to as weights , are critical for determin-
ing what it is that a neuron detects. Neurons become
inhibited when negatively charged chloride ions (Cl ￿ )
enter the neuron through channels that are opened by
the neurotransmitter GABA , which is released by in-
hibitory interneurons . They also have a basic neg-
ative current caused by positive ions (potassium, K + )
leaving the neuron via leak channels that are always
open. A simple equation describes the way in which
the overall electrical voltage of the cell, known as its
membrane potential , integrates all these currents into
one real-valued number.
The membrane potential that results from integrating
neural inputs in turn determines whether a given neuron
will produce an action potential or spike , which causes
neurotransmitter to be released at the ends of a neuron's
sending projection or axon , which then forms synapses
onto other neuron's dendrites (see above). The action
potential is thresholded , meaning that it only occurs
when the membrane potential (at the start of the axon,
To stop now, quit by selecting Object/Quit in the
PDP++Root window.
2.10
Summary
Neuron as Detector
The biological and functional properties of a neuron are
consistent with it being a detector , which constantly
evaluates the information available to it looking for con-
ditions that match those that it has become specialized
to detect. Whereas standard serial computers are rela-
tively general purpose computational devices, a neuron
is relatively specialized or dedicated to detecting some
particular set of things. We emphasize that it is typi-
cally difficult to describe exactly what a neuron detects
with simple verbal terms (e.g., unlike “smoke” for the
smoke detector), and that there is an important dynamic
component to its behavior. Neurons exist in huge num-
bers and operate in parallel with one another, whereas
a standard computer operates in serial performing one
operation at a time. There are good reasons to think
that neurons perform a relatively simple computation.
A mathematical description of a neuron as a detector
can be given using the framework of Bayesian statisti-
cal hypothesis testing, which produces the same form
of mathematical activation function as the point neu-
ron activation function. In sum, the detector model of
the neuron provides a good intuitive model of how they
Search WWH ::




Custom Search