Integration of Particle Swarm Optimization in Bidirectional Memory Networks for Improved Daily Climate Forecasting Accuracy

Authors

  • Ardi Susanto Universitas Islam Negeri Siber Syekh Nurjati Cirebon Author
  • Heru Purnomo Kurniawan Universitas Islam Negeri Siber Syekh Nurjati Cirebon Author
  • Lia Farhatuaini Universitas Islam Negeri Siber Syekh Nurjati Cirebon Author
  • Muhammad Iszul Wilsa UniversitasIslam Negeri Siber Syekh Nurjati Cirebon Author
  • Gina Khayatun Nufus Universitas Islam Negeri Siber Syekh Nurjati Cirebon Author
  • Ananda Sathria Maulana Amri Universitas Islam Negeri Siber Syekh Nurjati Cirebon Author

DOI:

https://doi.org/10.65897/jais.v1.i2.85

Keywords:

Deep Learning, Long Short-Term Memory, Particle Swarm Optimization, Rainfall Prediction, Multivariate Time Series

Abstract

Global climate change has caused rainfall patterns to become increasingly fluctuating and difficult to predict using conventional weather forecasting methods. Accurate daily rainfall prediction is crucial for hydrometeorological disaster mitigation and agricultural sector planning. Although Deep Learning models such as Long Short-Term Memory (LSTM) and Bidirectional LSTM (BiLSTM) are capable of handling complex time-series data, the manual determination of hyperparameters often results in suboptimal models and entrapment in local optima. This study proposes the integration of the Particle Swarm Optimization (PSO) algorithm to automatically optimize hyperparameters (number of hidden neurons, dropout rate, and learning rate) in LSTM and BiLSTM architectures. The models were evaluated using a multivariate daily climate observation dataset encompassing temperature, humidity, wind speed, and actual rainfall. Experimental results indicate that PSO-based optimization significantly enhances prediction performance compared to baseline models. The PSO-LSTM approach successfully reduced the Root Mean Square Error (RMSE) to 17.59 mm and Mean Absolute Error (MAE) to 9.07 mm, comparable to the performance of PSO-BiLSTM, which achieved an RMSE of 17.59 mm and an MAE of 9.20 mm. These findings prove that automatic parameter tuning using swarm intelligence algorithms can highly optimize sequential neural network architectures in capturing rainfall pattern volatility, making it highly recommended as a foundation for a more accurate early warning system.

References

[1] S. P. Intergovernmental Panel on Climate Change (IPCC), "Climate Change 2021: The Physical Science Basis," Contribution of Working Group I to the Sixth Assessment Report of the IPCC, Cambridge University Press, 2021.

[2] K. E. Trenberth, "Changes in precipitation with climate change," Climate Research, vol. 47, no. 1, pp. 123-138, 2011.

[3] H. A. P. de Andrade et al., "Machine learning applied to rainfall forecasting: A systematic review," Journal of Hydrology, vol. 598, p. 126231, 2021.

[4] S. K. Jain and A. Kumar, "An overview of applications of artificial neural networks in hydrology," Hydrological Sciences Journal, vol. 52, no. 3, pp. 379-405, 2007.

[5] G. E. P. Box, G. M. Jenkins, G. C. Reinsel, and G. M. Ljung, Time series analysis: forecasting and control. John Wiley & Sons, 2015.

[6] P. Nayak, K. Sudheer, D. Rangan, and K. Ramasastri, "A neuro-fuzzy computing technique for modeling hydrological time series," Journal of Hydrology, vol. 291, no. 1-2, pp. 52-66, 2004.

[7] V. Vapnik, The nature of statistical learning theory. Springer science & business media, 1999.

[8] S. Hochreiter and J. Schmidhuber, "Long short-term memory," Neural computation, vol. 9, no. 8, pp. 1735-1780, 1997.

[9] Y. LeCun, Y. Bengio, and G. Hinton, "Deep learning," Nature, vol. 521, no. 7553, pp. 436-444, 2015.

[10] S. Qiao, F. Jin, X. Zheng, and B. Jin, "A deep learning framework for accurate forecasting of daily rainfall," Atmospheric Research, vol. 248, p. 105193, 2021.

[11] M. Schuster and K. K. Paliwal, "Bidirectional recurrent neural networks," IEEE transactions on Signal Processing, vol. 45, no. 11, pp. 2673-2681, 1997.

[12] I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning. MIT press, 2016.

[13] J. Bergstra and Y. Bengio, "Random search for hyper-parameter optimization," Journal of machine learning research, vol. 13, no. 2, pp. 281-305, 2012.

[14] L. Yang and A. Shami, "On hyperparameter optimization of machine learning algorithms: Theory and practice," Neurocomputing, vol. 415, pp. 295-316, 2020.

[15] J. Kennedy and R. Eberhart, "Particle swarm optimization," in Proceedings of ICNN'95-international conference on neural networks, vol. 4. IEEE, 1995, pp. 1942-1948.

[16] Y. Shi and R. Eberhart, "A modified particle swarm optimizer," in 1998 IEEE international conference on evolutionary computation proceedings, IEEE, 1998, pp. 69-73.

[17] A. W. Reza et al., "Particle swarm optimization (PSO)-based hyperparameters selection for deep neural networks," Journal of Intelligent Systems, vol. 28, no. 3, pp. 455-471, 2019.

[18] S. Meira, E. C. P. de Lima, and F. de Paula Oliveira, "Rainfall prediction using LSTM integrated with Particle Swarm Optimization," Environmental Modelling & Software, vol. 132, p. 104803, 2020.

[19] T. Zhang, Q. Yin, C. Yang, and Z. Liu, "A hybrid PSO-BiLSTM approach for short-term weather forecasting," IEEE Access, vol. 8, pp. 154687-154699, 2020.

[20] S. G. K. Patro and K. K. Sahu, "Normalization: A preprocessing stage," IAIRJ, vol. 3, no. 3, pp. 20-22, 2015.

Downloads

Published

2026-01-01

Issue

Section

Articles

How to Cite

[1]
A. Susanto, H. P. Kurniawan, L. . Farhatuaini, M. I. . Wilsa, G. K. . Nufus, and A. S. M. . Amri, “Integration of Particle Swarm Optimization in Bidirectional Memory Networks for Improved Daily Climate Forecasting Accuracy”, J. Appl. Inf. Sci., vol. 1, no. 2, pp. 44–48, Jan. 2026, doi: 10.65897/jais.v1.i2.85.

Statistics

124 Views 197 Downloads