Robust design of Artificial Neural Networks applying the Taguchi

methodology and DoE

Ortiz-Rodríguez, J.M.1, 2, Martínez-Blanco, M.R.2, Vega-Carrillo, H.R.1, 2

Universidad Autónoma de Zacatecas
Unidades Académicas: (1)-Estudios Nucleares, (2)-Ingeniería Eléctrica
Av. R. López Velarde #801, Zacatecas, Zacatecas, C.P. 980000, Tel.: 014929239407, Ext. 1515
morvymm@yahoo.com.mx, mrosariomb@yahoo.com.mx, fermineutron@yahoo.com

Abstract neural networks. The Taguchi method and the DoE

The integration of Artificial Neural Networks and
optimization provides a tool for designing robust
network parameters and improving their performance.
The Taguchi method offers considerable benefits in time
and accuracy when is compared with the conventional
trial and error neural network design approach. This
work is concerned with the robust design of multilayer
feedforward neural networks trained by
backpropagation algorithm and develops a systematic
and experimental strategy which emphasizes
simultaneous optimization artificial neural network’s
parameters optimization under various noise conditions.
Here, we make a comparison among this method and
conventional training methods. The attention is drawing
on the advantages on Taguchi methods which offer
potential benefits in evaluating the network behavior.
1. Introduction
Although a lot of research of Artificial Neural
Networks (ANNs) is been concentrated in developing
ANN´s models and training algorithms to improve the
accuracy and convergence of the models, there still a
conventional problem in ANNs design, determining a
suitable set of structural and learning parameters
values for an ANN still remains a difficult task, users
have to choose the architecture and determine many of
the parameters in a selected network [1], [2], [3] and
[4]. The integration of neural networks and
optimization provides a tool for designing neural
network parameters and improving the network
performance. The process optimization methods
known as Taguchi methods and Design of Experiments
(DoE) may be applied to the design and training of
ANN [5], [6], [7], [8], [9] and [10]. In this study, a
systematic, methodological and experimental approach
is introduced to obtain the optimum design of artificial
technique are the main techniques used. Unlike
previous studies in the design of ANNs, the Taguchi
method is used here to simplify the optimization
problem.
1.1. Current and Proposed Methods for
Optimizing Neural Networks
The size and training parameters of ANNs have a
critical effect on their performance, the Taguchi
method and DoE methodology is applied in the
optimization of the design parameters of ANNs. Being
a “parallel” approach, the method offers considerable
benefits in time and accuracy when is compared with
the conventional serial approach of trial and error [1]
and [5]. The current practice of selecting the levels for
neural networks design parameters is based on trial and
error, which is similar to the one-factor-at-a-time
experiment [5]. If changing the level of one particular
design parameter has no effect on the performance of
the neural network then a different design parameter is
varied, and the experiment is repeated in a series
approach. In contrast, Taguchi method and DoE
methodology is a very powerful method based on the
parallel process, where all the experiments are planed a
priori and the results are analyzed after all the
experiments are completed [11] and [12]. There are
three types of DoE: One-factor-at-a-time, full factorial
and fractional factorial.
There are several ways to design a Multilayered
Feedforward Neural Network (MFFN) by using DoE:
the full factorial experiment methodology is the most
frequently used approach, where the experiments have
2f possible combinations that most be tested (f = the
number of factors each at two levels). Therefore, it is
very time-consuming when there are many factors. In
order to minimize the number of tests required,
fractional factorial experiments (FFEs) were

Proceedings of the Electronics, Robotics and Automotive Mechanics Conference (CERMA'06)

0-7695-2569-5/06 $20.00 © 2006
Authorized licensed use limited to: NATIONAL INSTITUTE OF TECHNOLOGY WARANGAL. Downloaded on March 05,2010 at 23:54:02 EST from IEEE Xplore. Restrictions apply.
 developed. FFEs use only a portion of the total
possible combinations to estimate the effects of main
factors and the effects of the some of the interactions.
Taguchi developed a family of FFE matrixes, known
as Orthogonal Arrays (OAs), which could be utilized
in various situations. These matrixes reduce the
experimental number but still obtain reasonably rich
information [5], [6], [7], [8], [9] and [10].
In ANN design using Taguchi methodology the
engineer must recognize the application problem well
and choose a suitable ANN model. In the selected
model, the design parameters (factors) which need to
be optimized have to be determined (Planning stage).
Using orthogonal arrays, simulations can be executed
in a systematic way (experimentation stage). From
simulation results, the responses can be analyzed by
level average analysis and signal-to-noise (S/N) ratio
in the Taguchi method (Analysis stage). And finally,
Conduct a confirmation experiment at the optimal
design condition an check if the robustness measure is
close to the predicted value (Confirmation stage) [6],
[7], [8], [9], [10], [11] and [12].
2. Materials and methods
MFFN is one of the main classes of neural networks
and it plays an important roll in many types of
problems in science and engineering such as system
identification, control, medicine, pattern recognition
and recently in nuclear sciences in neutron
spectrometry and dosimetry. As a tool for scientific
computing and engineering applications, the
morphology of MFFNs consists of many
interconnected signal processing elements called
neurons. These neurons form layered network
configurations through only feedforward interlayered
synaptic connections in terms of the neural signal flow
[1], [2], [3] and [4]. In a MFFN the neurons are
organized into layers with no feedback or cross
connections. The lowest layer of the MFNN is the
input layer in which the processing elements have
received all the weighted neural inputs, and provide
their outputs to the processing elements of the first
hidden layer. The highest layer of the MFFN is the
output layer. The outputs from a given layer are
transmitted only to the higher layers. A basic structure
of the MFFN is shown in figure 1.
Proceedings of the Electronics, Robotics and Automotive Mechanics Conference (CERMA'06)
0-7695-2569-5/06 $20.00 © 2006
Authorized licensed use limited to: NATIONAL INSTITUTE OF TECHNOLOGY WARANGAL. Downloaded on March 05,2010 at 23:54:02 EST from IEEE Xplore. Restrictions apply.
Figure 1. AMFFN with input layer, output layer and (M-2)
hidden layers
The key distinguishing characteristic of a MFFN
with the backpropagation learning algorithm is that it
forms a nonlinear mapping from a set of input stimuli
to a set of outputs using features extracted form the
input patterns. The neural network can be designed and
trained to accomplish a wide variety of nonlinear
mappings, some of which are very complex. This is
because the neural units in the neural network learn to
respond to features found in the input. In the MFFMs
design process trained by means of backpropagation
learning algorithm, users have to choose the
architecture and determine many of the parameters in a
selected network, several learning factors such as the
initial weights, the learning rate, the number of the
hidden neural layers and the number of neurons in each
layer may be reselected if the iterative learning process
does not converge quickly to the desired point. The
trial-and-error technique is the usual way to get a better
combination of network architecture and parameters;
however, it does not use systematic methodologies for
the identification of the “best” values. The process is
treated very much as a serial “trial and error” exercise,
consuming much time, and does not systematically
target a near optimal solution.
2.1. Robust design of ANN of the type MFFN
with backpropagation learning algorithm
Robust design problems are broadly classified into
the static and dynamic ones. The objective of robust
design for a static problem is to achieve the smallest
variation of the performance characteristic around t
under various noise conditions. On the other hand,
dynamic problems are classified into Continuous-
Input-Continuous-Output (CICO), Continuous-Input-
Digital-Output (CIDO) Digital-Input-Continuous-
Output (DICO) and Digital-Input-Digital-Output
(DIDO) cases. The objective of robust design for a
dynamic problem is to achieve the smallest variation of
the performance characteristic around its target values
 over the range of the signal parameters under various
noise conditions. In the robust design of ANNs of this
work, the target is not fixed but variable, and then, the
target variable for training a neural network is
considered as a signal parameter and the robust design
of an ANN trained by BP learning algorithm is treated
as a dynamic problem.
Among the four cases of dynamic problem only
CICO and DIDO (the DIDO problems considered,
have a binary input and a binary output BIBO) cases
can appear in the ANN training since the output of a
backpropagation network must be of the same type as
the target variable. In the context of a neural network,
the CICO case corresponds to the prediction (or
regression-type) problem while the BIBO case
corresponds to the binary classification problem.
In order to design a MFFN of high performance, the
parameters related to the training (learning rate,
momentum) as well as the network structure (number
of hidden layers and neurons) must be considered
simultaneously, together with their interaction effects.
In addition, there exist nuisance parameters in training.
They include initial set of weights, division of the
whole data set into the training and testing data sets,
sizes of the training and testing data sets. It is also
desired that the performance of a MFFN be robust to
The networks designed by means of the
methodological, systematical and experimental
methodology can be either in the continuous or discrete
domain. This methodology was implemented within
Matlab programming environment and using the JMP
statistical program [13] and [14], and is composed by
the planning, experimentation, analysis and
confirmation stages.
Robust Design of Artificial Neural Networks
(RDANN) methodology was applied in nuclear
sciences to design several neural networks in order to
solve problems in neutron spectrometry and dosimetry
field [11], [15], [16], and [17]. The steps followed to
obtain the optimum design of the artificial neural
networks in consideration are as follow:
3.1. Stage I: Planning Stage.
In the planning stage it is necessary to identify the
objective function and the design and noise variables.
The objective function of the unfolding neutron spectra
problem is the performance or mean square error (mse)
output of the ANN) as shows equation 1.
1 N 2
(1)
MSE
N
¦ )
i
E ( E )iANN  ) E ( E )ORIGINAL
i 
these nuisance parameters.

3. Results Where: N is the number of trials, ) E ( E )ORIGINAL

i

is the original spectra and ) E ( E )iANN is the spectra

In basis to the Taguchi method and DoE
methodology it was developed a systematic and
methodological strategy to design robust ANNs trained
by means of backpropagation learning algorithm as
shown in figure 2.
unfolded with the ANN.
Among the various parameters that affect the ANN
performance, where selected four design variables each
at three levels as shown in table I. Where A and B are
the number of neurons in the first and second hidden
layers respectively, C is the momentum and D is the
learning rate.

Table I. Design Variables and their levels

Design
Level 1 Level 2 level 3
variables
A N/2 N 2N
B 0 N 2N
C 0.001 0.1 0.3
D 0.1 0.3 0.5

Noise variables each at two levels, shown in table

II, in most cases are not controlled by the user. The
initial set of weights (U) and the size of training and
testing sets (V) are selected usually randomly. Once V
is determined, which data of the whole data set to
include in the training or testing data set (W) is
randomly determined, and not controlled by the user.
Figure 2. Methodological and systematic strategy for robust
design of MFFN

Proceedings of the Electronics, Robotics and Automotive Mechanics Conference (CERMA'06)

0-7695-2569-5/06 $20.00 © 2006
Authorized licensed use limited to: NATIONAL INSTITUTE OF TECHNOLOGY WARANGAL. Downloaded on March 05,2010 at 23:54:02 EST from IEEE Xplore. Restrictions apply.
 Table II. Noise variables and their levels
Noise
Level 1 Level 2
variables
U Set 1 Set 2
V 6:4 8:2
W Training1/Test1 Training2/Test2
3.2. Stage II: Experimentation
After the factors and levels are determined, a
suitable Orthogonal Array (OA) can be selected for
training process. For a robust experimental design,
Taguchi suggests to use two OAs crossed. The Taguchi
OAs are denoted by Lr(Sc) where r is the number of
rows, c is the number of columns and S is the number
of levels in each column. A design variable is assigned
to a column of the OA. Then, each row of the design
OA represents a specific design of an ANN. Similarly,
a noise variable is assigned to a column of the noise
OA, each row of which then corresponds to a noise
condition. In RDANN methodology, was designed a
tool in Matlab® which automate the analysis,
processing and presentation of the information; this
tool reduce significantly the time employed in training,
testing and processing all the information generated in
the network design process. In the experimentation
stage was used the RDANN Matlab® tool.
3.3. Stage III: Analysis
The signal-to-noise ratio (S/N) is a measure of both
the location and the dispersion of the measured
responses. It transforms the row data to allow
quantitative evaluation of the design parameters
considering their mean and variation. It is measured in
decibels using the formula:
S/N 10 log10 ( MSD )
Where MSD is a measure of the mean square
deviation in performance, since in every design, more
signal and less noise is desired, the best design will
have the highest S/N ratio. In the analysis stage was
used the JMP statistical program to select the best
values of the ANN being designed.
3.4. Stage IV: Confirmation
In this stage is predicted the value of the robustness
measure at the optimal design condition, conducted a
confirmation at the optimal design condition,
calculated the robustness measure for the performance
characteristic, and checked if the robustness measure is
“close” to the predicted value. In the confirmation
Proceedings of the Electronics, Robotics and Automotive Mechanics Conference (CERMA'06)
0-7695-2569-5/06 $20.00 © 2006
Authorized licensed use limited to: NATIONAL INSTITUTE OF TECHNOLOGY WARANGAL. Downloaded on March 05,2010 at 23:54:02 EST from IEEE Xplore. Restrictions apply.
stage was used the RDANN tool and JPM to select the
best values of the final ANNs being designed.
RDANN methodology was utilized to design two
ANNs capable to solve the unfolding neutron
spectrometry problem by using 187 neutron spectra
data set compiled by IAEA [18] and the neutron
spectrometry unfolding with simultaneous dose
calculus problem respectively, using A 187 neutron
spectra data set compiled by IAEA [18] and 13
different equivalent doses per spectra. In the
application of the RDANN methodology was used a
crossed OA whit the L9(34) and L4(23) for the neutron
spectra unfolding case and the L9(34) and L4(22)
configuration for the neutron unfolding and dose
calculus case, obtaining the following results.
In the ANNs design where made conformation
experiments selecting the parameters with the optimal
levels proposed in the analysis stage, with these, where
trained and tested the different ANN architectures to
determine the optimum ANN topologies. Table III
shows the best learning and architectural parameters
obtained after carrying out the RDANN methodology
in the problems considered which were calculated by
using the JMP statistical program and confirmed by
means of confirmation tests.
Table III. Best values in the conformation stage of the
neutron unfolding problem
A B C D
Neutron spectra unfolding 14 0 0.1 0.1
Neutron unfolding and dose 26 39 0.1 0.1
Once the best ANN topologies were determined, a
final training and testing was made in order to solve
the two problems considered in this work. In the final
ANN validation was performed the correlation and Chi
square statistical tests to the spectra used in the testing
stage (37 from 187) to evaluate and validate the data
(2) obtained, making a comparison between the target
neutron spectra and the spectra obtained with the
designed ANN.
Tables IV and V shown that all neutron spectra and
dose calculus pass the Chi square statistical test, which
demonstrates that statistically there is not difference
among the doses and neutron spectra reconstructed by
the designed ANNs and the target neutron spectra.
Similarly tables VI and VII shown the correlation
statistical test applied to the 37 neutron spectra and
doses, where can be seen that the whole data set is near
of the optimum value equal to one. Where SP is the
number of spectra, Ȥ2 is the chi square test and R is the
correlation statistical test.
 Table IV. Chi square test applied to the neutron spectra
unfolding problem
SP F2 SP F2 SP
1 0.1428 0.4494 11 21 18.0694 0.0248 31
2 0.1226 0.0253 12 22 0.2441 0.0262 32
3 0.1539 0.0339 13 23 0.0526 0.0555 33
4 0.2983 0.0915 14 24 0.2196 0.0666 34
5 0.0498 0.1029 15 25 0.0611 0.1474 35
6 0.0292 0.5833 16 26 0.8350 0.0780 36
7 0.6707 0.0424 17 27 0.2429 0.1825 37
8 0.0338 0.3581 18 28 0.1664
9 0.1028 0.1883 19 29 0.0132
10 0.0558 0.1191 20 30 0.0195

Table V. Chi square test applied to the neutron spectra Figure 3. Spectrum 10/37 (187 spectra and 13 equivalent doses)
unfolding and dose calculus problem
SP F2 SP F2 SP
1 0.0810 0.1014 11 21 0.1079 6.0629 31
2 0.2307 0.3108 12 22 0.0745 0.0519 32
3 0.1085 0.0247 13 23 0.0770 0.2579 33
4 0.0293 0.1194 14 24 1.9519 0.2180 34
5 0.0224 0.0229 15 25 0.3212 0.6124 35
6 0.2411 0.0743 16 26 0.2405 0.2727 36
7 0.0625 0.3636 17 27 0.1057 0.0410 37
8 1.0789 0.2422 18 28 1.8461
9 0.3996 0.2108 19 29 0.0293
10 0.0116 0.1226 20 30 0.0570

Table VI. Correlation test applied to the neutron spectra

unfolding problem
Figure 4. Dose 4/37 (187 spectra and 13 equivalent doses)
SP R SP R SP
1 0.9944 0.9343 11 21 0.9904 0.9984 31
2 0.8651 0.9832 12 22 0.9734 0.9969 32
3 0.9814 0.9633 13 23 0.9768 0.9909 33
4 0.9788 0.8935 14 24 0.9857 0.9053 34
5 0.9840 0.9567 15 25 0.9889 0.8622 35
6 0.9992 0.8502 16 26 0.9957 0.9767 36
7 0.9358 0.9995 17 27 0.9995 0.8065 37
8 0.9883 0.9925 18 28 0.9703
9 0.9880 0.9839 19 29 0.9946
10 0.9942 0.8904 20 30 0.9925

Table VII. Correlation test applied to the neutron spectra

unfolding and dose calculus problem
SP R SP R SP
1 0.9986 0.9990 11 21 0.9748 0.2423 31 Figure 5. Spectrum 29/37 (187 spectra)
2 0.9989 0.9468 12 22 0.9963 0.9976 32
3 0.9664 0.9965 13 23 0.9924 0.9686 33
4 0.9953 0.9781 14 24 0.7328 0.9955 34
5 0.9985 0.9910 15 25 0.9627 0.9863 35
6 0.9791 0.9988 16 26 0.9984 0.9964 36
7 0.9983 0.9993 17 27 0.9428 0.9847 37
8 0.8896 0.9698 18 28 0.9426
9 0.9825 0.9560 19 29 0.9917
10 0.9975 0.9988 20 30 0.9974

Figures 3 to 6 shown the best neutron spectra

unfolded and the neutron spectra and dose calculus
obtained at final testing stage of the designed ANNs
compared with the target ones applying the RDANN.
Figure 6. Correlation test of spectrum 29/37 (187 spectra)

Proceedings of the Electronics, Robotics and Automotive Mechanics Conference (CERMA'06)

0-7695-2569-5/06 $20.00 © 2006
Authorized licensed use limited to: NATIONAL INSTITUTE OF TECHNOLOGY WARANGAL. Downloaded on March 05,2010 at 23:54:02 EST from IEEE Xplore. Restrictions apply.
 4. Conclusions
A systematic and experimental strategy is
developed for the robust design of ANN. In the
proposed strategy, learning and structural parameters
are simultaneously optimized under various noise
conditions, and the robust design problem is
formulated as a dynamic one, together chi square and
correlation statistical analyses of the ANN output to
validate the results obtained.
The proposed method reduces significantly the time
required to prepare, to process and to present the
information in an appropriate way to de designer, and
in consequence, it reduces significantly the time spent
in the search of the optimal topology of the neural
network being designed, letting to the researcher time
to solve the problem in with he is working and not
spent a log time in determining the parameters
involved with the network same.
The developed approach is proposed like a general
method to design ANNs of the type MFFN trained by
means of backpropagation learning algorithm to
determine the optimum parameters of the ANN being
designed and it is useful to problems with data of the
type continuous o digital.
The proposed systematic and experimental
approach is a useful alternative for the robust design of
ANNs. It offers a convenient way of simultaneously
considering design and noise variables, and for
incorporating the concept of robustness in the ANN
design process. The RDANN was applied with success
in nuclear sciences to solve neutron unfold spectrum
and dose calculus problems, designing robust ANNs in
short time.
5. References
[1] Gupta M.M., Lin J., and Homma N., “Static and
Dynamic Neural Networks”, From Fundamentals to
Advanced Theory, John Wiley & Sons, 2003.
[2] Haykin S., “Neural networks: A Comprehensive
Foundation”, Prentice Hall, 1999.
[3] Jain, A.K., Mao J., and Mohuiddin, K.M., “Artificial
Neural Networks”: a tutorial, IEEE, 1996.
[4] Lippmann R.P., “An Introduction to Computing with
Neural Networks”, IEEE ASSP MAGAZINE, 4(2), 1987.
[5] Packianather M.S. and Drake P.R., “Modelling Neural
Network Performance Through Response Surface
Methodology for Classifying Wood Veneer Defects”, IMechE
(Proc. Instn. Mech. Engrs.), 218, Parte B, 2004.
Proceedings of the Electronics, Robotics and Automotive Mechanics Conference (CERMA'06)
0-7695-2569-5/06 $20.00 © 2006
Authorized licensed use limited to: NATIONAL INSTITUTE OF TECHNOLOGY WARANGAL. Downloaded on March 05,2010 at 23:54:02 EST from IEEE Xplore. Restrictions apply.
[6] Shyam M.N., “Robust Design”, Departament of
aerospace engineering, Indian institute of technology,
Bombay, 2002.
[7] Lin, TY, and Tseng, CH., “Optimum Design for
Artificial Neural Networks: an Example in a Bycicle
Derailleur System”, Eng. Appl. Artificial Intelligence, 2000.
[8] Peterson G.E., St. Clair D.C., Aylward S., and Bond W.,
“Using Taguchi´s Method of Experimental Design to Control
Errors in Layered Perceptrons”, IEEE transactions on neural
networks, 6, 1995.
[9] Chen Y., Tam S.C., Chen W.L., Zheng H.Y.,
“Application of Taguchi Method in the Optimization of Laser
Micro-Engraving of Photomasks”, Intern. J. Materials and
Product Tech., 11(3-4), 1996.
[10] Jiju A. and Jiju Frenie A., “Teaching the Taguchi
Method to Industrial Engineers”, MCB University press,
50(4), 2001.
[11] Ortiz-Rodríguez, J.M, “Diseño Robusto de Redes
Neuronales Aplicadas en la Espectrometría de Neutrones”,
tesis de maestría, Unidad Académica de Estudios Nucleares,
Universidad Autónoma de Zacatecas, 2005.
[12] Ortiz-Rodríguez J.M., Martínez-Blanco M.R., Vega-
Carrillo H.R., “Diseño Robusto de Redes Neuronales
Artificiales”, Encuentro de Investigación en Ingeniería
Eléctrica (ENINVIE) 2006, UAZ, 2006.
[13] Matlab 7.0, Help Neural Network Toolbox, 2006.
[14] JMP, [on line]. “The Statistical Discovery Software”. <
http://www.jmp.com/support/jmpsoftwareupdates.shtml >
[Consult Mayo de 2005].
[15] Ortiz-Rodríguez J.M., Martinez- Blanco M.R., Arteaga-
Arteaga T., Vega-Carrillo H.R., Hernández Dávila V.M.,
Manzanares-Acuña E., “Reconstrucción de Espectros de
Neutrones a Partir del Sistema Espectrométrico de Esferas de
Bonner”, XVIII Conferencia Internacional y VIII Congreso
Nacional de dosimetría de estado sólido, Zacatecas,
Zac., 2005.
[16] Martínez - Blanco M.R., “Espectrometría de Neutrones
y Calculo de Dosis Equivalentes Empleando la Metodología
de Diseño Robusto de Redes Neuronales Artificiales”, Tesis
de licenciatura, Unidad Académica de Ingeniería Eléctrica,
Universidad Autónoma de Zacatecas, 2006.
[17] Martínez-Blanco M.R., Ortiz-Rodríguez J.M., Vega-
Carrillo H.R., “Espectrometría de Neutrones y Cálculo de
Dosis Equivalentes, Aplicando la Metodología de Diseño
Robusto de Redes Neuronales Artificiales”, ENINVIE 2006,
UAZ, 2006.
[18] H.R.Vega-Carrillo, M.P. Íñiguez, “Catalogue to Select
the Initial Guess Spectrum During Unfolding”, 2002 Nucl.
Instrum. Meth. Phys. Res. A.