10.25673/122854">


Proceedings of International Conference on Applied Innovation in IT
2025/12/22, Volume 13, Issue 5, pp.201-209

News Recommendation System Based on Deep Learning on Large and Small MIND Datasets


Dhyaa-Al Rahman Lateef and Ahmed J. Obaid


Abstract: The rapid growth of online news platforms has intensified the need for intelligent, personalized recommendation systems capable of efficiently filtering and delivering relevant content. In response, this paper presents a novel deep learning-based news recommendation framework that effectively captures both user behavior dynamics and semantic richness of news articles. Built upon a hybrid architecture integrating pre-trained news encoders, user modeling via multi-head self-attention, and transformer-based sequential modeling, the proposed system leverages both the full and small versions of the MIND dataset to ensure robust evaluation across data scales. Our key contributions include: (1) a lightweight yet powerful hierarchical attention mechanism that improves user interest representation by selectively focusing on historically relevant news; (2) an optimized model design that reduces computational cost by 28% in inference time compared to baseline transformer models, enabling deployment in resource-constrained environments; and (3) a comprehensive analysis of the impact of training data size on model convergence and recommendation accuracy, revealing that even with 40% less data, the model retains over 95% of its nDCG performance, demonstrating strong data efficiency. Experimental results show that the proposed model achieves a classification accuracy of 92.22%, AUC of 77.62%, MRR of 52.44, and nDCG@5 of 0.618 and nDCG@10 of 0.583, outperforming state-of-the-art methods by +5.8% in nDCG@5 and +6.3% in nDCG@10. These results, validated across multiple dataset configurations, confirm the model’s accuracy, scalability, and adaptability to dynamic user preferences. By balancing model complexity and performance, this work advances the development of efficient, real-world deployable news recommendation systems that enhance user engagement and satisfaction through timely and personalized content delivery.

Keywords: News Recommendation System, Deep Learning, Personalized Recommendations, Deep Neural Networks, User Behavior Modeling, MIND Dataset, N-Gram, Word Encoding, Impressions.

DOI: 10.25673/122854

Download: PDF

References:

  1. H. Wang, F. Zhang, X. Xie and M. Guo, “DKN: Deep knowledge-aware network for news recommendation,” in Proceedings of the 2018 World Wide Web Conference on World Wide Web, WWW 2018, Lyon, France, April 23-27, 2018, pp. 1835-1844, ACM.
  2. C. Wu, F. Wu, M. An, J. Huang, Y. Huang and X. Xie, “Neural news recommendation with attentive multi-view learning,” in Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, IJCAI 2019, Macao, China, August 10-16, 2019, pp. 3863-3869, [Online]. Available: https://www.ijcai.org.
  3. H. Wang, F. Wu, Z. Liu and X. Xie, “Fine-grained interest matching for neural news recommendation,” in Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 836-845, [Online]. Available: https://www.aclweb.org.
  4. C. Wu, F. Wu, M. An, J. Huang, Y. Huang and X. Xie, “NPA: Neural news recommendation with personalized attention,” in Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD 2019, Anchorage, AK, USA, August 4-8, 2019, pp. 2576-2584, ACM.
  5. M. An, F. Wu, C. Wu, K. Zhang, Z. Liu and X. Xie, “Neural news recommendation with long- and short-term user representations,” in Proceedings of the 57th Conference of the Association for Computational Linguistics, ACL 2019, Florence, Italy, July 28-August 2, 2019, Volume 1: Long Papers, pp. 336-345, Association for Computational Linguistics.
  6. C. Wu, F. Wu, S. Ge, T. Qi, Y. Huang and X. Xie, “Neural news recommendation with multi-head self-attention,” in Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, EMNLP-IJCNLP, pp. 6389-6394, Hong Kong, China, Association for Computational Linguistics.
  7. J. Devlin, M.-W. Chang, K. Lee and K. Toutanova, “BERT: Pre-training of deep bidirectional transformers for language understanding,” in Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pp. 4171-4186, Minneapolis, Minnesota, Association for Computational Linguistics.
  8. Y. Liu, M. Ott, N. Goyal, J. Du, M. Joshi, D. Chen, O. Levy, M. Lewis, L. Zettlemoyer and V. Stoyanov, “RoBERTa: A robustly optimized BERT pretraining approach,” arXiv preprint arXiv:1907.11692, 2019.
  9. L. Dong, N. Yang, W. Wang, F. Wei, X. Liu, Y. Wang, J. Gao, M. Zhou and H.-W. Hon, “Unified language model pre-training for natural language understanding and generation,” in Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019, December 8-14, 2019, Vancouver, BC, Canada, pp. 13042-13054.
  10. C. Wu, F. Wu, T. Qi and Y. Huang, “Empowering news recommendation with pre-trained language models,” in Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR ’21, pp. 1652-1656, New York, NY, USA, Association for Computing Machinery.
  11. Q. Zhang, J. Li, Q. Jia, C. Wang, J. Zhu, Z. Wang and X. He, “UNBERT: User-news matching BERT for news recommendation,” in Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, IJCAI 2021, Virtual Event / Montreal, Canada, August 19-27, 2021, pp. 3356-3362, [Online]. Available: https://www.ijcai.org.
  12. Q. Zhang, Q. Jia, C. Wang, J. Li, Z. Wang and X. He, “AMM: Attentive multi-field matching for news recommendation,” in SIGIR ’21: The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event, Canada, July 11-15, 2021, pp. 1588-1592, ACM.
  13. G. Ma, H. Liu, X. Wu, W. Qian, Z. Lv, Q. Yang and S. Hu, “PUNR: Pre-training with user behavior modeling for news recommendation,” Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China, [Online]. Available: https://doi.org/10.18653/v1/2023.findings-emnlp.559.
  14. F. Wu, Y. Qiao, J. H. Chen, C. Wu, T. Qi, J. Lian and M. Wang, “MIND: A large-scale dataset for news recommendation,” in Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 3597-3606.
  15. S. Rendle, “Factorization machines with libfm,” ACM Transactions on Intelligent Systems and Technology, vol. 3, no. 3, pp. 1-22, 2012.
  16. H. Guo, R. Tang, Y. Ye, Z. Li and X. He, “DeepFM: A factorization-machine based neural network for CTR prediction,” in Proceedings of the 26th International Joint Conference on Artificial Intelligence, IJCAI 2017, Melbourne, Australia, August 19-25, 2017, pp. 1725-1731, [Online]. Available: https://www.ijcai.org.


    HOME

       - Conference
       - Journal
       - Paper Submission to Conference
       - Paper Submission to Journal
       - Fee Payment
       - For Authors
       - For Reviewers
       - Important Dates
       - Conference Committee
       - Editorial Board
       - Reviewers
       - Last Proceeding


    PROCEEDINGS

       - Volume 13, Issue 5 (ICAIIT 2025)
       - Volume 13, Issue 4 (ICAIIT 2025)
       - Volume 13, Issue 3 (ICAIIT 2025)
       - Volume 13, Issue 2 (ICAIIT 2025)
       - Volume 13, Issue 1 (ICAIIT 2025)
       - Volume 12, Issue 2 (ICAIIT 2024)
       - Volume 12, Issue 1 (ICAIIT 2024)
       - Volume 11, Issue 2 (ICAIIT 2023)
       - Volume 11, Issue 1 (ICAIIT 2023)
       - Volume 10, Issue 1 (ICAIIT 2022)
       - Volume 9, Issue 1 (ICAIIT 2021)
       - Volume 8, Issue 1 (ICAIIT 2020)
       - Volume 7, Issue 1 (ICAIIT 2019)
       - Volume 7, Issue 2 (ICAIIT 2019)
       - Volume 6, Issue 1 (ICAIIT 2018)
       - Volume 5, Issue 1 (ICAIIT 2017)
       - Volume 4, Issue 1 (ICAIIT 2016)
       - Volume 3, Issue 1 (ICAIIT 2015)
       - Volume 2, Issue 1 (ICAIIT 2014)
       - Volume 1, Issue 1 (ICAIIT 2013)


    LAST CONFERENCE

       ICAIIT 2026
         - Photos
         - Reports

    PAST CONFERENCES

    ETHICS IN PUBLICATIONS

    ACCOMODATION

    CONTACT US

 

        

         Proceedings of the International Conference on Applied Innovations in IT by Anhalt University of Applied Sciences is licensed under CC BY-SA 4.0


                                                   This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License


           ISSN 2199-8876
           Publisher: Edition Hochschule Anhalt
           Location: Anhalt University of Applied Sciences
           Email: leiterin.hsb@hs-anhalt.de
           Phone: +49 (0) 3496 67 5611
           Address: Building 01 - Red Building, Top floor, Room 425, Bernburger Str. 55, D-06366 Köthen, Germany

        site traffic counter

Creative Commons License
Except where otherwise noted, all works and proceedings on this site is licensed under Creative Commons Attribution-ShareAlike 4.0 International License.