Proceedings of International Conference on Applied Innovation in IT  ·  2026/06/12  ·  Vol. 14  ·  Issue 4  ·  pp. 93–104
An Intelligent Multi-Stage Approach for Cyberbullying Detection Based on Hybrid Deep Learning, Cross-Attention, and Ensemble Techniques
Shahad Ghazi Abd, Bashar Talib Hameed, Ali Hussein Fadel and Hussain Mahdi
The use of social media and online communication has made cyberbullying a serious issue. The large amount of user-generated content makes manual monitoring difficult, creating the need for accurate automatic detection systems. Nevertheless, most of the current approaches are limited to binary classification and fail to integrate semantic and linguistic data. This paper suggests a multi-step model of cyberbullying detection using machine learning and deep learning methods. The suggested framework integrates sentence embeddings produced by the Sentence-BERT model with manually designed linguistic features of aggression, threats, punctuation, and writing style. Three successive stages are investigated. The initial step uses classical machine learning models, such as Support Vector Machine, Random Forest, and Logistic Regression. The second phase presents hybrid deep learning models that are founded on dense and convolutional neural networks. The third phase builds upon the framework with a cross-attention mechanism and a stacking meta-ensemble classifier to enhance feature interaction and prediction accuracy. The experiments were performed on the Cyberbullying Tweets dataset with binary and multi-class labels. The binary setting is used to differentiate between cyberbullying and non-cyberbullying, whereas the multi-class setting is used to distinguish between various types of cyberbullying. The proposed Stage 3 framework achieved the best performance, reaching 91.0% accuracy and 0.90 F1-score in binary classification, and 88.0% accuracy and 0.875 F1-score in multi-class classification. The results demonstrate that combining semantic representations, linguistic features, attention mechanisms, and ensemble learning provides a more effective and reliable solution for cyberbullying detection than traditional approaches.
Cyberbullying Detection Deep Learning Natural Language Processing Hybrid Models Explainable AI
References
  1. V. Balakrishnan and M. Kaity, “Cyberbullying detection and machine learning: A systematic literature review,” Artif. Intell. Rev., vol. 56, 2023, [Online]. Available: https://doi.org/10.1007/s10462-023-10553-w.
  2. S. Unnava and S. R. Parasana, “A Study of Cyberbullying Detection and Classification Techniques: A Machine Learning Approach,” Eng. Technol. Appl. Sci. Res., vol. 14, no. 4, pp. 15607-15613, Aug. 2024, [Online]. Available: https://doi.org/10.48084/etasr.7621.
  3. S. Sihab-Us-Sakib, et al., “Cyberbullying detection of resource-constrained languages using machine learning and deep learning models,” 2024.
  4. A. Perera and P. Fernando, “Cyberbullying detection system on social media using machine learning,” Procedia Comput. Sci., vol. 239, pp. 506-516, 2024, [Online]. Available: https://doi.org/10.1016/j.procs.2024.06.200.
  5. C. Kumari, et al., “Towards enhanced cyberbullying detection: A unified machine learning and deep learning approach,” Systems, 2025.
  6. A. Cuzzocrea, et al., “A trustable LSTM-autoencoder network for cyberbullying detection on social media,” 2025.
  7. F. R. Sayed, et al., “Cyberbullying detection in social media using natural language processing and machine learning,” 2025.
  8. M. Menaka, et al., “Cyberbullying detection on social media using machine learning,” Int. J. Sci. Res. Comput. Sci. Eng. Inf. Technol., vol. 11, no. 3, 2025, [Online]. Available: https://doi.org/10.32628/CSEIT25113323.
  9. A. Akter, et al., “A trustable LSTM-autoencoder network for cyberbullying detection using synthetic data,” 2023, [Online]. Available: https://doi.org/10.48550/arXiv.2308.09722.
  10. T. Mahmud, et al., “Cyberbullying detection for low-resource languages: A review of the state of the art,” Inf. Process. Manag., vol. 60, no. 5, Art. no. 103454, Sep. 2023, [Online]. Available: https://doi.org/10.1016/j.ipm.2023.103454.
  11. P. Yi and A. Zubiaga, “Session-based cyberbullying detection in social media: A survey,” arXiv, 2022.
  12. K. Maity, S. Saha, and P. Bhattacharyya, “Cyberbullying Detection in Code-Mixed Languages: Dataset and Techniques,” in 2022 26th Int. Conf. Pattern Recognit. (ICPR), Montreal, QC, Canada, 2022, [Online]. Available: https://doi.org/10.1109/ICPR56361.2022.9956390.
  13. K. Maity, et al., “Explain Thyself Bully: Sentiment Aided Cyberbullying Detection with Explanation,” 2024, [Online]. Available: https://doi.org/10.48550/arXiv.2401.09023.
  14. M. Menaka, B. Harini Sri, N. Divya, and A. Kanimozhi, “Cyberbullying Detection on Social Media using Machine Learning,” Int. J. Sci. Res. Comput. Sci. Eng. Inf. Technol., vol. 11, no. 3, pp. 661-666, May 2025, [Online]. Available: https://doi.org/10.32628/CSEIT25113323.
  15. F. Akter, et al., “Cyberbullying Detection on Social Media Platforms Utilizing Different Machine Learning Approaches,” Int. J. Comput. Appl., vol. 186, no. 61, Jan. 2025.
  16. A. Perera, et al., “Automatic cyberbullying detection using supervised machine learning,” Procedia Comput. Sci., vol. 239, pp. 506-516, 2024, [Online]. Available: https://doi.org/10.1016/j.procs.2024.06.200.
  17. S. R. Fenny, et al., “Leveraging A Hybrid Machine Learning Model for Enhanced Cyberbullying Detection,” Aptisi Trans. Technopreneurship, vol. 7, no. 2, Apr. 2025, [Online]. Available: https://doi.org/10.34306/att.v7i2.536.
  18. C. Iwendi, et al., “Cyberbullying detection solutions based on deep learning architectures,” Multimed. Syst., 2023.
  19. M. Barhate, et al., “Comparative analysis of machine learning techniques for cyberbullying detection,” 2025, [Online]. Available: https://doi.org/10.64189/ict.25307.
  20. A. Cuzzocrea, et al., “Cyberbullying Detection, Prevention, and Analysis on Social Media via Trustable LSTM-Autoencoder Networks over Synthetic Data: The TLA-NET Approach,” Future Internet, vol. 17, no. 2, 2025, [Online]. Available: https://doi.org/10.3390/fi17020084.
  21. D. H. Wolpert, “Stacked generalization,” Neural Netw., vol. 5, no. 2, pp. 241-259, 1992, [Online]. Available: https://doi.org/10.1016/S0893-6080(05)80023-1.
  22. I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning. Cambridge, MA, USA: MIT Press, 2016.
  23. A. Joulin, E. Grave, P. Bojanowski, and T. Mikolov, “Bag of Tricks for Efficient Text Classification,” in Proc. 15th Conf. Eur. Chapter Assoc. Comput. Linguistics (EACL), Valencia, Spain, 2017, pp. 427-431.
  24. A. Ahmed, T. Hasan, F. A. Abdullatif, M. S. T., and M. S. M. Rahim, “A Digital Signature System Based on Real Time Face Recognition,” in 2019 IEEE 9th Int. Conf. Syst. Eng. Technol. (ICSET), Shah Alam, Malaysia, 2019, pp. 298-302, [Online]. Available: https://doi.org/10.1109/ICSEngT.2019.8906410.
  25. N. Reimers and I. Gurevych, “Sentence-BERT: Sentence Embeddings Using Siamese BERT-Networks,” in Proc. Conf. Empirical Methods Natural Language Processing and 9th Int. Joint Conf. Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China, 2019, pp. 3982-3992.
  26. A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, “Attention Is All You Need,” in Adv. Neural Inf. Process. Syst. (NeurIPS), vol. 30, 2017.
  27. R. Zhao, A. Zhou, and K. Mao, “Automatic Detection of Cyberbullying on Social Networks Based on Bullying Features,” in Proc. 17th Int. Conf. Distributed Comput. Netw. (ICDCN), Singapore, 2016, pp. 43:1-43:6.
  28. N. Chatzakou, I. Leontiadis, J. Blackburn, G. Stringhini, A. Vakali, L. Sirivianos, and N. Kourtellis, “Mean Birds: Detecting Aggression and Bullying on Twitter,” in Proc. ACM Web Sci. Conf. (WebSci), Troy, NY, USA, 2017, pp. 13-22.
  29. J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding,” in Proc. Conf. North Am. Chapter Assoc. Comput. Linguistics: Hum. Lang. Technol. (NAACL-HLT), Minneapolis, MN, USA, 2019, pp. 4171-4186.


Proceedings of the International Conference on Applied Innovations in IT by Anhalt University of Applied Sciences is licensed under CC BY-SA 4.0
 ·  This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License

ICAIIT 2026
International Conference on Applied Innovation in IT
Navigation
Publisher
ISSN2199-8876
Location Anhalt University of Applied Sciences
Phone +49 (0) 3496 67 5611
Address Building 01, Room 425
Bernburger Str. 55
D-06366 Köthen, Germany
Open Access License

All works are licensed under the Creative Commons Attribution-ShareAlike 4.0 International License (CC BY-SA 4.0), unless otherwise noted.

Published by ICAIIT in cooperation with Anhalt University of Applied Sciences.

© 2026 ICAIIT — International Conference on Applied Innovations in IT. Anhalt University of Applied Sciences, Köthen, Germany.
Visitors: site traffic counter