Enhancing Weather Pattern Recognition through Multi-Stage Sensor Data Fusion and Smoothing Regression

Main Article Content

Fuangfar Pensiri
Surapong Wiriya
Keun Ho Ryu
Porawat Visutsak

Abstract

It is often harder to make accurate predictions with large, various intelligent sensor systems because of data noise and the high cost of traditional modeling methods like Numerical Weather Prediction (NWP). This paper presents a comprehensive framework that integrates multi-stage sensor data fusion and preprocessing with machine-learning-based pattern recognition to produce highly precise, computationally efficient analog weather forecasts. Our method uses a strict three-stage pipeline to clean up and combine raw sensor inputs. It uses historical data from a distributed network of 79 NOAA weather stations. There are three phases: filling in missing values, addressing outliers, and smoothing moving averages. Subsequently, a decision tree model is used to identify similar weather patterns and predict critical weather variables. Our method is effective because it makes predictions that are much more likely to be accurate than incorrect. The Root Mean Squared Error (RMSE) declined by over 99%, from 0.1715 to an amazing 0.0011014. The results show that combining targeted sensor data preprocessing with complex pattern recognition is a suitable methodology for making smart weather forecasting systems work. Rather than serving as a replacement for physics-based NWP models, the proposed approach should be regarded as a lightweight complementary tool for localized, short-term analog weather pattern recognition.

Article Details

Section
Research Articles

References

Bauer, P.; Thorpe, A.; Brunet, G. The Quiet Revolution of Numerical Weather Prediction. Nature 2015, 525, 47–55. https://doi.org/10.1038/nature14956

Chen, L.; Han, B.; Zhao, X.; Zhao, J.; Yang, W.; Yang, Z. Machine Learning Methods in Weather and Climate Applications: A Survey. Appl. Sci. 2023, 13(21), 12019. https://doi.org/10.3390/app132112019

Shen, B.-W.; Pielke, R. A.; Zeng, X.; Zeng, X. Lorenz's View on the Predictability Limit of the Atmosphere. Encyclopedia 2023, 3(3), 887–899. https://doi.org/10.3390/encyclopedia3030063

Jeworrek, J.; West, G.; Stull, R. Optimizing Analog Ensembles for Sub-Daily Precipitation Forecasts. Atmosphere 2022, 13(10), 1662. https://doi.org/10.3390/atmos13101662

Hu, W.; Cervone, G.; Young, G.; Monache, L. D. Machine Learning Weather Analogs for Near-Surface Variables. Boundary-Layer Meteorol. 2023, 186, 711–735. https://doi.org/10.1007/s10546-022-00779-6

Chattopadhyay, A.; Nabizadeh, E.; Hassanzadeh, P. Analog Forecasting of Extreme-Causing Weather Patterns Using Deep Learning. J. Adv. Model. Earth Syst. 2020, 12, e2019MS001958. https://doi.org/10.1029/2019MS001958

Skrynyk, O.; et al. Data Quality Control and Homogenization of Daily Precipitation and Air Temperature (Mean, Max, and Min) Time Series of Ukraine. Int. J. Climatol. 2023, 43(9). https://doi.org/10.1002/joc.8080

Mohammed, R.; Scholz, M. Quality Control and Homogeneity Analysis of Precipitation Time Series. Atmosphere 2023, 14(2), 197. https://doi.org/10.3390/atmos14020197

Fan, C.; Xiao, F.; Zhao, Y.; Wang, J. A Review on Data Preprocessing Techniques Toward Efficient and Reliable Knowledge Discovery from Building Operational Data. Front. Energy Res. 2021, 9, 652801. https://doi.org/10.3389/fenrg.2021.652801

Li, C.; Wang, K.; Zhang, F.; et al. Machine-Learning-Based Imputation Method for Filling Missing Values in Ground Meteorological Observation Data. Algorithms 2023, 16(9), 422. https://doi.org/10.3390/a16090422

Afrifa-Yamoah, E.; Birt, J.; Toohey, D. Missing Data Imputation of High-Resolution Temporal Climate Time Series Data. Meteorol. Appl. 2020, 27(1), e1873. https://doi.org/10.1002/met.1873

Šuljug, J.; Smajlović, S.; Pudar, M.; Kovačević, A.; Alić, B.; Beširević, N. A Comparative Study of Machine Learning Models for Predicting Meteorological Data in Agricultural Applications. Electronics 2024, 13(16), 3284. https://doi.org/10.3390/electronics13163284

Hasan, R. A.; Hashim, H.; Abed, A. M.; Sulaiman, M. H. Comparative Study: Using Machine Learning Techniques for Daily Rainfall Prediction in Australia. AIP Conf. Proc. 2023, 2523, 030002. https://doi.org/10.1063/5.0148472

Berliana, E. V.; Budiono, A. M.; Mahardika, M.; Purnomo, S. D. Comparative Analysis of Naïve Bayes, Support Vector Machine, and Decision Tree in Rainfall Classification Using Confusion Matrix. Int. J. Adv. Comput. Sci. Appl. 2024, 15(7), 92–98. https://doi.org/10.14569/IJACSA.2024.0150755

Thompson, V.; Philip, S.; Kew, S.; Pinto, I.; Vautard, R. Using Analogue Methods to Identify Trends in Circulation Patterns of Midlatitude Heatwaves. Weather Clim. Extrem. 2026, 52, 100898. https://doi.org/10.1016/j.wace.2026.100898

Alimisis, V.; Dimas, C.; Sotiriadis, P. P. A Low-Power Analog Integrated Euclidean Distance Radial Basis Function Classifier. Electronics 2024, 13(5), 921. https://doi.org/10.3390/electronics13050921

Al-Saeedi, K.; Zhou, D.; Fish, A.; Tsakiri, K.; Marsellos, A. A Methodological Comparison of Forecasting Models Using KZ Decomposition and Walk-Forward Validation. Mathematics 2025, 13, 3410. https://doi.org/10.3390/math13213410

Wahyuddin, E. P.; Caraka, R. E.; Kurniawan, R.; Caesarendra, W.; Gio, P. U.; Pardamean, B. Improved LSTM Hyperparameters alongside Sentiment Walk-Forward Validation for Time Series Prediction. J. Open Innov.: Technol., Mark., Complex. 2025, 11, 100458. https://doi.org/10.1016/j.joitmc.2024.100458

Dash, C. S. K.; Behera, A. K.; Dehuri, S.; Ghosh, A. An Outliers Detection and Elimination Framework in Classification Task of Data Mining. Decision Analytics Journal 2023, 6, 100164. https://doi.org/10.1016/j.dajour.2023.100164

Mohammed, A. R.; Hassan, K. S.; Abdel-Aal, M. A. M. Moving Average Smoothing for Gregory-Newton Interpolation: A Novel Approach for Short-Term Demand Forecasting. IFAC-PapersOnLine 2022, 55(10), 749–754. https://doi.org/10.1016/j.ifacol.2022.09.499

Bag, A. A Comparative Study of Regression Algorithms for Predicting Graduate Admission to a University. J. Network Commun. Emerg. Technol. 2018, 8(10).

Yang, X.; Li, J.; Jiang, X. Research on Information Leakage in Time Series Prediction Based on Empirical Mode Decomposition. Sci. Rep. 2024, 14, 28362. https://doi.org/10.1038/s41598-024-80018-9