The proliferation of IoT-based environmental monitoring networks has led to an exponential increase in air quality data, creating a significant challenge for effective and timely risk assessment. Traditional analysis methods often struggle to convert this vast volume of raw data into actionable insights for decision-makers. This paper introduces a novel big data framework designed to automate the process of environmental risk assessment through a two-stage analytical approach. First, we propose a Composite Hazard Index (CHI), a quantitative metric that normalizes and aggregates data from disparate pollutants into a single, interpretable risk score for each monitoring location, incorporating expert-defined weights to reflect the relative toxicity of different substances. Second, this index, along with normalized pollutant profiles, is used as input for an unsupervised clustering algorithm (K-Means) to automatically stratify locations into distinct risk tiers (e.g., Low, Medium, High). A key novelty of our approach is a descriptive analysis method that identifies the primary pollutants, or "key risk drivers," responsible for the elevated hazard levels in high-risk clusters. The framework was validated using a real-world dataset from a public air quality monitoring network. The results demonstrate the system's ability to successfully identify high-risk "hotspots," quantify their danger level, and pinpoint the specific pollutants contributing to the threat, thereby providing a powerful, data-driven tool for proactive environmental management.
Keywords
Big DataEnvironmental Risk AssessmentComposite Hazard IndexUnsupervised ClusteringDecision Support System.
References
M. N. A. Ramadan, M. A. H. Ali, S. Y. Khoo, M. Alkhedher, and M. Alherbawi, “Real-time IoT-powered AI system for monitoring and forecasting of air pollution in industrial environment,” Ecotoxicol. Environ. Saf., vol. 283, p. 116856, 2024. https://doi.org/10.1016/j.ecoenv.2024.116856.
Q. A. Tran, Q. H. Dang, T. Le, H. T. Nguyen, and T. D. Le, “Air quality monitoring and forecasting system using IoT and machine learning techniques,” in Proc. 6th Int. Conf. Green Technol. Sustain. Dev. (GTSD), Danang, Vietnam, Jul. 2022. https://doi.org/10.1109/GTSD54989.2022.9988756.
R. Kozłowski, M. Szwed, A. Kozłowska, J. Przybylska, and T. Mach, “Quality management system in air quality measurements for sustainable development,” Sustainability, vol. 16, no. 17, Art. no. 7537, 2024. https://doi.org/10.3390/su16177537.
A. Rahman and M. T. Khatun, “Multivariate analysis of urban air pollution: Clustering and patterns across major Asian cities,” in Proc. IEEE Int. Conf. Future Mach. Learn. Data Sci. (FMLDS), Nov. 2024. https://doi.org/10.1109/FMLDS63805.2024.00087.
Z. Hu, Z.Liu, J.Tian, Y.Liu, H.Pan, Sh.Liu, B.Yang, L.Yin, and W.Zheng “Classification of urban pollution levels based on clustering and spatial statistics,” Atmosphere, vol. 13, no. 3, p. 494, 2022. https://doi.org/10.3390/atmos13030494.
C. Bouveyron, J. Jacques, A. Schmutz, F. Simões, and S. Bottini, “Co-clustering of multivariate functional data for the analysis of air pollution in the South of France,” Ann. Appl. Stat., vol. 15, no. 4, 2020.: https://doi.org/10.1214/21-AOAS1547
H. Jorquera and A. M. Villalobos, “Combining cluster analysis of air pollution and meteorological data with receptor model results for ambient PM2.5 and PM10,” Int. J. Environ. Res. Public Health, vol. 17, no. 22, p. 8455, 2020. [Online]. Available: https://doi.org/10.3390/ijerph17228455
I. Savchenko, A. Shapoval, and I. Kuziev, “Modeling of high module power sources systems safety processes,” Mater. Sci. Forum, vol. 1052, pp. 399–404, 2022. https://doi.org/10.4028/p-24y9ae
K. Vadurin, A. Perekrest, V. Bakharev, V. Shendryk, Y. Parfenenko, and S. Shendryk, “Towards Digitalization for Air Pollution Detection: Forecasting Information System of the Environmental Monitoring,” Sustainability, vol. 17, no. 9, Art. no. 3760, 2025. [Online]. Available: https://doi.org/10.3390/su17093760.
K. Akshara, K. Shamita, G. Prashant, K. Neelesh, N. Dev. (2022). “SmartAirQ: A Big Data Governance Framework for Urban Air Quality Management in Smart Cities,” Frontiers in Environmental Science, 10, Article no. 7537. https://doi.org/10.3389/fenvs.2022.785129.
V. Mokin, “Air Quality Monitoring from EcoCity,” Kaggle, 2023. [Online]. Available: https://www.kaggle.com/datasets/vbmokin/air-quality-monitoring-from-ecocity
Z. Allam and Z. A. Dhunny, “On Big Data, Artificial Intelligence and Smart Cities,” Cities, vol. 89, pp. 80–91, 2019. https://doi.org/10.1016/j.cities.2019.01.032
O. Alvear, C. T. Calafate, J.-C. Cano, and P. Manzoni, “Crowdsensing in Smart Cities: Overview, Platforms, and Environment Sensing Issues,” Sensors 18, no. 2, p. 460, 2018. https://doi.org/10.3390/s18020460
M. Asgari, M. Farnaghi, and Z. Ghaemi, “Predictive Mapping of Urban Air Pollution Using Apache Spark on a Hadoop Cluster,” in Proceedings of the 2017 International Conference on Cloud and Big Data Computing (London, UK: Association for Computing Machinery), pp. 89–93, 2017. https://doi.org/10.1145/3141128.3141131