The use of social media and online communication has made cyberbullying a serious issue. The large amount of user-generated content makes manual monitoring difficult, creating the need for accurate automatic detection systems. Nevertheless, most of the current approaches are limited to binary classification and fail to integrate semantic and linguistic data. This paper suggests a multi-step model of cyberbullying detection using machine learning and deep learning methods. The suggested framework integrates sentence embeddings produced by the Sentence-BERT model with manually designed linguistic features of aggression, threats, punctuation, and writing style. Three successive stages are investigated. The initial step uses classical machine learning models, such as Support Vector Machine, Random Forest, and Logistic Regression. The second phase presents hybrid deep learning models that are founded on dense and convolutional neural networks. The third phase builds upon the framework with a cross-attention mechanism and a stacking meta-ensemble classifier to enhance feature interaction and prediction accuracy. The experiments were performed on the Cyberbullying Tweets dataset with binary and multi-class labels. The binary setting is used to differentiate between cyberbullying and non-cyberbullying, whereas the multi-class setting is used to distinguish between various types of cyberbullying. The proposed Stage 3 framework achieved the best performance, reaching 91.0% accuracy and 0.90 F1-score in binary classification, and 88.0% accuracy and 0.875 F1-score in multi-class classification. The results demonstrate that combining semantic representations, linguistic features, attention mechanisms, and ensemble learning provides a more effective and reliable solution for cyberbullying detection than traditional approaches.
Keywords
Cyberbullying DetectionDeep LearningNatural Language Processing Hybrid ModelsExplainable AI
References
V. Balakrishnan and M. Kaity, “Cyberbullying detection and machine learning: A systematic literature review,” Artif. Intell. Rev., vol. 56, 2023, [Online]. Available: https://doi.org/10.1007/s10462-023-10553-w.
S. Unnava and S. R. Parasana, “A Study of Cyberbullying Detection and Classification Techniques: A Machine Learning Approach,” Eng. Technol. Appl. Sci. Res., vol. 14, no. 4, pp. 15607-15613, Aug. 2024, [Online]. Available: https://doi.org/10.48084/etasr.7621.
S. Sihab-Us-Sakib, et al., “Cyberbullying detection of resource-constrained languages using machine learning and deep learning models,” 2024.
A. Perera and P. Fernando, “Cyberbullying detection system on social media using machine learning,” Procedia Comput. Sci., vol. 239, pp. 506-516, 2024, [Online]. Available: https://doi.org/10.1016/j.procs.2024.06.200.
C. Kumari, et al., “Towards enhanced cyberbullying detection: A unified machine learning and deep learning approach,” Systems, 2025.
A. Cuzzocrea, et al., “A trustable LSTM-autoencoder network for cyberbullying detection on social media,” 2025.
F. R. Sayed, et al., “Cyberbullying detection in social media using natural language processing and machine learning,” 2025.
M. Menaka, et al., “Cyberbullying detection on social media using machine learning,” Int. J. Sci. Res. Comput. Sci. Eng. Inf. Technol., vol. 11, no. 3, 2025, [Online]. Available: https://doi.org/10.32628/CSEIT25113323.
A. Akter, et al., “A trustable LSTM-autoencoder network for cyberbullying detection using synthetic data,” 2023, [Online]. Available: https://doi.org/10.48550/arXiv.2308.09722.
T. Mahmud, et al., “Cyberbullying detection for low-resource languages: A review of the state of the art,” Inf. Process. Manag., vol. 60, no. 5, Art. no. 103454, Sep. 2023, [Online]. Available: https://doi.org/10.1016/j.ipm.2023.103454.
P. Yi and A. Zubiaga, “Session-based cyberbullying detection in social media: A survey,” arXiv, 2022.
K. Maity, S. Saha, and P. Bhattacharyya, “Cyberbullying Detection in Code-Mixed Languages: Dataset and Techniques,” in 2022 26th Int. Conf. Pattern Recognit. (ICPR), Montreal, QC, Canada, 2022, [Online]. Available: https://doi.org/10.1109/ICPR56361.2022.9956390.
K. Maity, et al., “Explain Thyself Bully: Sentiment Aided Cyberbullying Detection with Explanation,” 2024, [Online]. Available: https://doi.org/10.48550/arXiv.2401.09023.
M. Menaka, B. Harini Sri, N. Divya, and A. Kanimozhi, “Cyberbullying Detection on Social Media using Machine Learning,” Int. J. Sci. Res. Comput. Sci. Eng. Inf. Technol., vol. 11, no. 3, pp. 661-666, May 2025, [Online]. Available: https://doi.org/10.32628/CSEIT25113323.
F. Akter, et al., “Cyberbullying Detection on Social Media Platforms Utilizing Different Machine Learning Approaches,” Int. J. Comput. Appl., vol. 186, no. 61, Jan. 2025.
A. Perera, et al., “Automatic cyberbullying detection using supervised machine learning,” Procedia Comput. Sci., vol. 239, pp. 506-516, 2024, [Online]. Available: https://doi.org/10.1016/j.procs.2024.06.200.
S. R. Fenny, et al., “Leveraging A Hybrid Machine Learning Model for Enhanced Cyberbullying Detection,” Aptisi Trans. Technopreneurship, vol. 7, no. 2, Apr. 2025, [Online]. Available: https://doi.org/10.34306/att.v7i2.536.
C. Iwendi, et al., “Cyberbullying detection solutions based on deep learning architectures,” Multimed. Syst., 2023.
M. Barhate, et al., “Comparative analysis of machine learning techniques for cyberbullying detection,” 2025, [Online]. Available: https://doi.org/10.64189/ict.25307.
A. Cuzzocrea, et al., “Cyberbullying Detection, Prevention, and Analysis on Social Media via Trustable LSTM-Autoencoder Networks over Synthetic Data: The TLA-NET Approach,” Future Internet, vol. 17, no. 2, 2025, [Online]. Available: https://doi.org/10.3390/fi17020084.
D. H. Wolpert, “Stacked generalization,” Neural Netw., vol. 5, no. 2, pp. 241-259, 1992, [Online]. Available: https://doi.org/10.1016/S0893-6080(05)80023-1.
I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning. Cambridge, MA, USA: MIT Press, 2016.
A. Joulin, E. Grave, P. Bojanowski, and T. Mikolov, “Bag of Tricks for Efficient Text Classification,” in Proc. 15th Conf. Eur. Chapter Assoc. Comput. Linguistics (EACL), Valencia, Spain, 2017, pp. 427-431.
A. Ahmed, T. Hasan, F. A. Abdullatif, M. S. T., and M. S. M. Rahim, “A Digital Signature System Based on Real Time Face Recognition,” in 2019 IEEE 9th Int. Conf. Syst. Eng. Technol. (ICSET), Shah Alam, Malaysia, 2019, pp. 298-302, [Online]. Available: https://doi.org/10.1109/ICSEngT.2019.8906410.
N. Reimers and I. Gurevych, “Sentence-BERT: Sentence Embeddings Using Siamese BERT-Networks,” in Proc. Conf. Empirical Methods Natural Language Processing and 9th Int. Joint Conf. Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China, 2019, pp. 3982-3992.
A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, “Attention Is All You Need,” in Adv. Neural Inf. Process. Syst. (NeurIPS), vol. 30, 2017.
R. Zhao, A. Zhou, and K. Mao, “Automatic Detection of Cyberbullying on Social Networks Based on Bullying Features,” in Proc. 17th Int. Conf. Distributed Comput. Netw. (ICDCN), Singapore, 2016, pp. 43:1-43:6.
N. Chatzakou, I. Leontiadis, J. Blackburn, G. Stringhini, A. Vakali, L. Sirivianos, and N. Kourtellis, “Mean Birds: Detecting Aggression and Bullying on Twitter,” in Proc. ACM Web Sci. Conf. (WebSci), Troy, NY, USA, 2017, pp. 13-22.
J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding,” in Proc. Conf. North Am. Chapter Assoc. Comput. Linguistics: Hum. Lang. Technol. (NAACL-HLT), Minneapolis, MN, USA, 2019, pp. 4171-4186.