Professional Documents
Culture Documents
Atmospheric Research
journal homepage: www.elsevier.com/locate/atmos
Laboratory of Climatology & Atmospheric Environment, Faculty of Geology & Geoenvironment, University of Athens, Greece
Department of Mathematics, Technological & Education Institute of Piraeus, Greece
Laboratory of Environmental Technology, Department of Electronic Computer Systems, Technological & Education Institute of Piraeus, Greece
Department of Mechanical Engineering, Technological & Education Institute of Piraeus, Greece
a r t i c l e
i n f o
Article history:
Received 31 December 2012
Received in revised form 12 November 2013
Accepted 17 November 2013
Available online 27 November 2013
Keywords:
Artificial neural networks
Maximum daily precipitation
Athens
a b s t r a c t
Extreme daily precipitation events are involved in significant environmental damages, even in
life loss, because of causing adverse impacts, such as flash floods, in urban and sometimes in
rural areas. Thus, long-term forecast of such events is of great importance for the preparation
of local authorities in order to confront and mitigate the adverse consequences. The objective
of this study is to estimate the possibility of forecasting the maximum daily precipitation for
the next coming year. For this reason, appropriate prognostic models, such as Artificial Neural
Networks (ANNs) were developed and applied. The data used for the analysis concern annual
maximum daily precipitation totals, which have been recorded at the National Observatory of
Athens (NOA), during the long term period 18912009. To evaluate the potential of daily
extreme precipitation forecast by the applied ANNs, a different period for validation was
considered than the one used for the ANNs training. Thus, the datasets of the period 1891
1980 were used as training datasets, while the datasets of the period 19812009 as validation
datasets. Appropriate statistical indices, such as the coefficient of determination (R2), the index
of agreement (IA), the Root Mean Square Error (RMSE) and the Mean Bias Error (MBE), were
applied to test the reliability of the models. The findings of the analysis showed that, a quite
satisfactory relationship (R2 = 0.482, IA = 0.817, RMSE = 16.4 mm and MBE = +5.2 mm)
appears between the forecasted and the respective observed maximum daily precipitation
totals one year ahead. The developed ANN seems to overestimate the maximum daily
precipitation totals appeared in 1988 while underestimate the maximum in 1999, which could
be attributed to the relatively low frequency of occurrence of these extreme events within GAA
having impact on the optimum training of ANN.
2013 Elsevier B.V. All rights reserved.
1. Introduction
Extreme precipitation events, which are heavily affected by
the local scale, have adverse impacts on ecosystems, agriculture, infrastructure and even loss of life, while these events are
142
143
Fig. 1. Typical artificial neural network architecture (Caudill and Butler, 1922).
time structure. Besides, most ANNs are purely static classifiers. TLRNs are the state of the art in nonlinear time series
forecasting, system identification and temporal pattern classification (Wang and Traore, 2009).
The training algorithm used with TLRNs is more advanced
even than the standard back-propagation. The TLRNs topology is found to be very suitable to deal with flood forecasting
problem (Xue and Dibike, 2001). The performance of TLRNs
over the standard back-propagation algorithm for time series
data forecasting is evident in the recent studies of Badjate
and Dudul (2009) and Kale and Dudul (2009). Fig. 2 shows
144
f x
ex ex
e2x 1
:
x
x 2x
e e
e 1
All the above have been chosen after a trial and error
method. The numbers of nodes, so-called processing elements (PEs) in the hidden layer, the step size, as well as the
momentum rate were determined by the use of genetic
32
n
X
Oi Oave P i P ave
6
7
6
7
2
i1
s7
R 6
6s
7
n
n
X
4 X
2
25
Oi Oave
P i P ave
i1
i1
IA 1
n
X
P i Oi
i1
i1
n
1X
2
P Oi
n i1 i
!1
:
n
1X
P Oi :
n i1 i
The MBE provides information in the long term performance of the correlations by allowing a comparison of the
actual deviation between predicted and measured values
term by term. The MBE is used to describe whether a model
over-(positive value) or under-(negative value) predicts the
observation and has the same units as the measured variableparameter, which is forecasted by the model. The ideal value
of MBE is zero (Moustris et al., 2010).
3. Results and discussion
Two factors, which explain 87% of the total variance, were
extracted (Table 1). Thus, for each year the seven maximum
daily precipitation totals in decreasing order were replaced
by two factors (F1 and F2), and this new matrix (119 2) is
used for training and validation of the developed ANN.
Table 2 presents the input and the output data used/
extracted in the developed ANN. The data were divided into
two subsets. The first subset concerns the training data (training
set) and includes the years 18911980. The 80% of the first
subset of data was used for the ANN training and the rest 20% for
the ANN cross validation test during the phase of training. The
validation data (20% of the years 18911980) were randomly
chosen by the model during the phase of training and were used
in order to check the progress of the ANN training, optimizing
its parameters (Moustris et al., 2010). The second subset
(testing set) includes the years 19812009 and was used to
evaluate the forecasting ability of the developed ANN model. It
should be noted here that the testing set is completely unknown
to the ANN and has not been presented-disclosed at any stage
during its training. The shape of training data-input data file
(Table 2) was chosen after a trial-and-error method. This shape
Table 1
Results of the applied factor analysis.
1.
2.
Table 2
Input and output data for the ANN training.
Input data (input layer)
145
Eigenvalue
Total
variance
(%)
Cumulative
eigenvalue
Cumulative
total variance
(%)
5.018502
1.051178
71.69289
15.01683
5.018502
6.069681
71.69289
86.70972
y 49:452x
;1 x 7
146
Fig. 3. Box & Whiskers plots. Mean maximum daily precipitation totals (middle point), standard deviation of the mean (box) and the absolute maximum and
minimum value of precipitation (whiskers) vs. ranking order at National Observatory of Athens, Greece, within the period 18912009.
55
50
45
y = 49.452x -0.562
40
R2 = 0.999
35
30
25
20
15
10
5
0
0
Ranking order
Fig. 4. Mean maximum daily precipitation totals vs. ranking order at National Observatory of Athens, Greece, within the period 18912009.
147
200
180
160
140
120
100
80
60
40
20
18
90
18
95
19
00
19
05
19
10
19
15
19
20
19
25
19
30
19
35
19
40
19
45
19
50
19
55
19
60
19
65
19
70
19
75
19
80
19
85
19
90
19
95
20
00
20
05
20
10
Year
Fig. 5. Five year moving average of the maximum daily total precipitation totals at National Observatory of Athens, Greece, within the period 18912009.
Table 3
Values of statistical indices for the evaluation of ANN forecasting ability.
MBE (mm)
RMSE (mm)
R2
IA
+5.2
16.4
0.482
0.817
148
140
OBSERVED VALUES (mm)
120
100
80
60
40
20
19
8
19 1
8
19 2
8
19 3
8
19 4
8
19 5
86
19
8
19 7
8
19 8
8
19 9
9
19 0
91
19
9
19 2
9
19 3
9
19 4
9
19 5
9
19 6
9
19 7
9
19 8
99
20
0
20 0
0
20 1
0
20 2
0
20 3
0
20 4
0
20 5
0
20 6
07
20
0
20 8
09
Year
Fig. 6. Time series of observed (blue line) and forecasted (red line) maximum daily precipitation totals at National Observatory of Athens for the forecasting
period 19812009.
140
120
100
80
60
y = 0.673x + 21.089
R2 = 0.482
40
20
0
0
20
40
60
80
100
120
140
References
Alpert, P., Ben-Gai, T., Baharad, A., Benjamini, Y., Yekutieli, D., Colacino, M.,
Diodato, L., Homar, V., Ramis, C., Romero, R., Michaelides, S., Manes, A.,
2002. The paradoxical increase of Mediterranean extreme daily rainfall
in spite of decrease in total values. Geophys. Res. Lett. 29 (11), 31-131-4.
http://dx.doi.org/10.1029/2001GL013554.
Badjate, S.L., Dudul, S.V., 2009. Multi step ahead prediction of north and south
hemisphere sun spots chaotic time series using focused time lagged
recurrent neural network model. WSEAS Trans. Inf. Sci. Appl. 6 (4),
684693.
Barlow, M., 2011. Influence of hurricane-related activity on North American
extreme precipitation. Geophys. Res. Lett. 38, L04705. http://dx.doi.org/
10.1029/2010GL046258 (5 pp.).
Bartzokas, A., Lolis, C.J., Metaxas, D.A., 2003. The 850 hPa relative vorticity
centres of action for winter precipitation in the Greek area. Int. J. Climatol.
23, 813828.
Beniston, M., Stephenson, D.B., Christensen, O.B., Ferro, C.A.T., Frei, C.,
Goyette, S., Halsnaes, K., Holt, T., Jylh, K., Koffi, B., Palutikof, J., Schll, R.,
Semmler, T., Woth, K., 2007. Future extreme events in European climate:
an exploration of regional climate model projections. Clim. Chang. 81,
7195.
Bodri, L., Cermak, V., 2000. Prediction of extreme precipitation using a neural
network: application to summer flood occurrence in Moravia. Adv. Eng.
Softw. 31, 211221.
Bornstein, R., Lin, Q., 2000. Urban heat islands and summertime convective
thunderstorms in Atlanta: three cases studies. Atmos. Environ. 34,
507516.
Brunetti, M., Maugeri, M., Nanni, T., 2001. Changes in total precipitation,
rainy days and extreme events in northeastern Italy. Int. J. Climatol. 21,
861871.
Caudill, M., Butler, C., 1922. Understanding Neural Networks. MIT Press.
Cicek, I., Turkoglu, N., 2005. Urban effects on precipitation in Ankara.
Atmoosfera 18 (3), 173187.
Cigizoglou, H.K., Alp, M., 2004. Rainfall-runoff modelling using three neural
network methods. Artificial Intelligence and Soft Computing-ICAISC
2004 Lecture Notes in artificial Intelligence, 3070, pp. 166171.
Diodato, N., Bellocchi, G., 2008. Drought stress patterns in Italy using agroclimatic indicators. Clim. Res. 36 (1), 5363.
Easterling, D.R., Evans, J.L., Groisman, P.Ya., Karl, T.R., Kunkel, K.E., Ambenje,
P., 2000. Observed variability and trends in extreme climate events: a
brief review. Bull. Am. Meteorol. Soc. 81, 417425.
Freiwan, M., Cigizoglu, H.K., 2005. Prediction of total monthly rainfall in
Jordan using feed forward back propagation method. Fresenius Environ.
Bull. 14 (2), 142151.
Furrer, E.M., Katz, R.W., 2008. Improving the simulation of extreme precipitation events by stochastic weather generators. Water Resour. Res. 44,
W12439. http://dx.doi.org/10.1029/2008WR007316.
Goldberg, D.E., 1989. Genetic Algorithms in Search, Optimization, and
Machine Learning. Addison-Wesley Pub. Co.
Goldreich, Y., Manes, A., 1979. Urban effects on precipitation patterns in the
greater Tel-Aviv area. Archiv fr Meteorologie, Geophysik und
Bioklimatologie, Serie B 27 (23), 213224.
Goswami, P., Shivappa, H., Goud, B.S., 2010. Impact of urbanization on
tropical mesoscale events: investigation of three heavy rainfall events.
Meteorol. Z. 19 (4), 385397.
Groisman, P.Ya., Knight, R.W., Easterling, D.R., Karl, T.R., Hegerl, G.C., 2005.
Trends in intense precipitation in the climate record. J. Clim. 18 (9),
13261350.
Gunhan, T., Demir, V., Hancioglu, E., Hepbasli, A., 2005. Mathematical
modelling of drying of bay leaves. Energy Convers. Manag. 46, 16671679.
Guo, X., Fu, D., Wang, J., 2006. Mesoscale convective precipitation system
modifiedd by urbanization in Beijing City. Atmos. Res. 82, 112126.
Hect-Nielsen, R., 1990. Neurocomputing. Addison-Wesley, Reading, M.A.
IPCC, 2001. Climate Change 2001: The Scientific Basis. Contribution of
Working Group 1 to the Third IPCC Scientific Assessment, Chapter 8,
Model Evaluation.
IPCC, 2007. Summary for policymakers. In: Solomon, S., Qin, D., Manning, M.,
Chen, Z., Marquis, M., Averyt, K.B., Tignor, M., Miller, H.L. (Eds.), Climate
Change 2007: The Physical Science Basis. Contribution of Working
Group I to the Fourth Assessment Report of the Intergovernmental Panel
on Climate Change. Cambridge University Press, Cambridge, United
Kingdom/New York, NY, USA.
Iwashima, T., Yamamoto, R., 1993. A statistical analysis of the extreme
events: long-term trend of heavy daily precipitation. J. Meteorol. Soc.
Jpn. 71, 637640.
Jauregui, E., Romales, E., 1996. Urban effects on convective precipitation in
Mexico City. Atmos. Environ. 30 (20), 33833389.
Jolliffe, I.T., 1986. Principal Component Analysis. Springer-Verlag, New York.
149
Kale, S.N., Dudul, S.V., 2009. Intelligent noise removal from EMG signal using
focused time-lagged recurrent neural network. Applied Computational
Intelligence and Soft Computing Article ID 129761, p. 12. http://
dx.doi.org/10.1155/2009/129761.
Kambezidis, H.D., Larissi, I.K., Nastos, P.T., Paliatsos, A.G., 2010. Spatial
variability and trends of the rain intensity over Greece. Adv. Geosci. 26,
6569.
Kamp, R.G., Savenije, H.H.G., 2006. Optimising training data for ANNs with
genetic algorithms. Hydrol. Earth Syst. Sci. Discuss. 3, 285297.
Karl, T.R., Knight, R.W., 1998. Secular trends of precipitation amount frequency
and intensity in the United States. Bull. Am. Meteorol. Soc. 79, 231241.
Karl, T.R., Knight, R.W., Plummer, N., 1995. Trends in high-frequency climate
variability in the twentieth century. Nature 377, 217220.
Kolehmainen, M., Martikainen, H., Ruuskanen, J., 2001. Neural networks and
periodic components used in air quality forecasting. Atmos. Environ. 35,
815825.
Kostopoulou, E., Jones, P.D., 2005. Assessment of climate extremes in the
Eastern Mediterranean. Meteorol. Atmos. Phys. 89, 6985.
Koutsoyiannis, D., 2004. Statistics of extremes and estimation of extreme
rainfall: I. Theoretical investigation. Hydrol. Sci. J. 49 (4), 575590.
Krause, P., Boyle, D.P., Bsel, F., 2005. Comparison of different efficiency
criteria for hydrological model assessment. Adv. Geosci. 5, 8997.
Kundzewicz, Z.W., Radziejewski, M., Pinskwar, I., 2006. Precipitation
extremes in the changing climate of Europe. Clim. Res. 31 (1), 5158.
Lehner, B., Dll, P., Alcamo, J., Henrichs, T., Kaspar, F., 2006. Estimating the
impact of global change on flood and drought risks in Europe: a
continental, integrated analysis. Clim. Chang. 75 (3), 273299.
Luck, K.C., Ball, J.E., Sharma, A., 2000. A study of optimal model lag and
spatial inputs to artificial neural networks for rainfall forecasting.
J. Hydrol. 227 (14), 5665.
Manly, B.F.J., 1986. Multivatiate Statistical Methods: A Primer. Chapman &
Hall, London.
Manzat, ., 2007. Sounding-derived indices for neural network based shortterm thunderstorm and rainfall forecasts. Atmos. Res. 83, 349365.
Mar, K.W., Naing, T.T., 2008. Optimum neural network architecture for
precipitation prediction of Myanmar. World Acad. Sci. Eng. Technol. 48,
130134.
Marzano, F.S., Fionda, E., Ciotti, P., 2006. Neural-network approach to
ground-based passive microwave estimation of precipitation intensity
and extinction. J. Hydrol. 328, 121131.
Min, S.-K., Zhang, X., Zwiers, F.W., Hegerl, G.C., 2011. Human contribution
to more-intense precipitation extremes. Nature 470, 378381. http://
dx.doi.org/10.1038/nature09763.
Moustris, K.P., Ziomas, I.C., Paliatsos, A.G., 2010. 3-day-ahead forecasting of
regional pollution index for the pollutants NO2, CO, SO2 and O3 using
artificial neural networks in Athens, Greece. Water Air Soil Pollut. 209,
2943.
Moustris, K.P., Larissi, I.K., Nastos, P.T., Paliatsos, A.G., 2011. Precipitation
forecast using artificial neural networks in specific regions of Greece.
Water Resour. Manag. 25, 19791993.
Nastos, P.T., Zerefos, C.S., 2007. On extreme daily precipitation totals at
Athens, Greece. Adv. Geosci. 10, 5966.
Nastos, P.T., Zerefos, C.S., 2008. Decadal changes in extreme daily precipitation
in Greece. Adv. Geosci. 16, 5562.
Nastos, P.T., Zerefos, C.S., 2009. Spatial and temporal variability of consecutive
dry and wet days in Greece. Atmos. Res. 94, 616628.
Nastos, P.T., Philandras, C.M., Repapis, C.C., 2002. Application of canonical
analysis to air temperature and precipitation regimes over Greece.
Fresenius Environ. Bull. 11 (8), 488493.
Paliatsos, A.G., Nastos, P.T., Tzavelas, G., Panagiotakos, D.B., 2005. Characteristics of precipitation in urban Athens area, from 1891 to 2000. Fresenius
Environ. Bull. 14, 422428.
Pall, P., Aina, T., Stone, D.A., Stott, P.A., Nozawa, T., Hilberts, A.G.J., Lohmann,
D., Allen, M.R., 2011. Anthropogenic greenhouse gas contribution to
flood risk in England and Wales in autumn 2000. Nature 470, 382385.
Philandras, C.M., Metaxas, D.A., Nastos, P.T., 1999. Climate variability and
urbanization in Athens. Theor. Appl. Climatol. 63 (12), 6572.
Philandras, C.M., Nastos, P.T., Paliatsos, A.G., Repapis, C.C., 2010. Study of the
rain intensity in Athens and Thessaloniki, Greece. Adv. Geosci. 23, 3745.
Richman, M.B., 1986. Rotation of principal components. J. Climatol. 6,
293335.
Rumelhart, D.E., Hinton, G.E., Williams, R.J., 1986. In: Rumelhart, D.E.,
McClelland, J.L. (Eds.), Parallel Distributed Processing Explorations in the
Microstructure of Cognition, 1. MIT Press, Bradfords Books, Cambridge,
MA, pp. 318362.
Sahai, A.K., Soman, M.K., Satyan, V., 2000. All India summer monsoon rainfall
prediction using an artificial neural network. Clim. Dyn. 16, 291302.
Sakellariou, N.K., Kambezidis, H.D., 2004. Prediction of the total rainfall
amount during August and November in the Athens area, Greece.
Fresenius Environ. Bull. 13 (3), 289292.
150
Sheffield, J., Wood, E.F., 2007. Characteristics of global and regional drought,
19502000: analysis of soil moisture data from off-line simulation of the
terrestrial hydrologic cycle. J. Geophys. Res. D Atmos. 112 (17) (No
D17115).
Silverman, D., Dracup, J.A., 2000. Artificial neural networks and long-range
precipitation predictions in California. J. Appl. Meteorol. 39 (1), 5766.
Suppiah, R., Hennessy, K.J., 1998. Trends in total rainfall events and number
of dry events in Australia. 19101990. Int. J. Climatol. 18, 11411164.
Walker, S.-E., Slordal, H.L., Guerreiro, C., Gram, F., Grnskei, E.K., 1999. Air
pollution exposure monitoring and estimation Part II. Model evaluation
and population exposure. J. Environ. Monit. 1, 321326.
Wang, Yu.-M., Traore, S., 2009. Time-lagged recurrent network for forecasting
episodic event suspended sediment load in typhoon prone area. Int.
J. Phys. Sci. 4 (9), 519528.
Wardah, T., Abu Bakar, S.H., Bardossy, A., Maznorizan, M., 2008. Use of
geostationary meteorological satellite images in convective rain estimation for flash-flood forecasting. J. Hydrol. 356, 283298.
Willmott, C.J., 1982. Some comments on the evaluation of model performance. Bull. Am. Meteorol. Soc. 63 (11), 13091313.
Willmott, C.J., Ackleson, S.G., Davis, R.E., Feddema, J.J., Klink, K.M., Legates,
D.R., O'Donnell, J., Rowe, C., 1985. Statistics for the evaluation and
comparison of models. J. Geophys. Res. 90, 89959005.
Xue, Y., Dibike, Y.B., 2001. Flood forecasting mode for Huai River in China using
time delay neural network. Proceedings of the XXIX IAHR congress,
Beijing, China, Theme C, pp. 5966.
Yonetani, T., 1982. Increase in Number of Days with Heavy Precipitation in
Tokyo Urban Area. J. Appl. Meteor. 21, 14661471. http://dx.doi.org/
10.1175/1520-0450(1982)021 b1466:IINODWN2.0.CO;2.