Artificial Neural Network Algorithms

Artificial neural networks are parallel computational models (unlike our computers, which have
a single processor to collect and display information). These networks are commonly made up of
multiple simple processors which are able to act in parallel alongside one another to model
changing systems. This parallel computing process also enables faster processing and
computation of solutions. Neural networks follow a dynamic computational structure, and do
not abide by a simple process to derive a desired output.

Looking at an analogy may be useful in understanding the mechanisms of a neural network.

Learning in a neural network is closely related to how we learn in our regular lives and activities
– we perform an action and are either accepted or corrected by a trainer or coach to understand
how to get better at a certain task. Similarly, neural networks require a trainer in order to
describe what should have been produced as a response to the input. Based on the difference
between the actual value and the value that was outputted by the network, an error value is
computed and sent back through the system. For each layer of the network, the error value is
analyzed and used to adjust the threshold and weights for the next input. In this way, the error
keeps becoming marginally lesser each run as the network learns how to analyze values.

The procedure described above is known as backpropogation, and is applied continuously

through a network until the error value is kept at a minimum. At this point, the neural network
no longer requires such a training process and is allowed to run without adjustments. The
network may then finally be applied, using the adjusted weights and thresholds as guidelines.

When a neural network is actively running, no backpropogation takes place as there is no way to
directly verify the expected response. Instead, the validity of output statements are corrected
during a new training session or are left as is for the network to run. Many adjustments may
need to be made as the network consists of a great amount of variables that must be precise for
the artificial neural network to function.

A basic example of such a process can be examined by teaching a neural network to convert text
to speech. One could pick multiple different articles and paragraphs and use them as inputs for
the network and predetermine a desired input before running the test. The training phase would
then consist of going through the multiple layers of the network and using backpropogation to
adjust the parameters and threshold value of the network in order to minimize the error value
for all input examples. The network may then be tested on new articles to determine if it could
truly convert text to proper speech.