Proceedings of International Conference on Applied Innovation in IT  ·  2026/04/22  ·  Vol. 14  ·  Issue 2  ·  pp. 319–326
Transforming Peer Assessment in Higher Education: An AI-Supported Approach Using the Peerscholar Platform
Svitlana Skvortsova, Tetiana Symonenko, Kira Hnezdilova, Kateryna Niedialkova and Nataliia Andrusiak
This study is devoted to a comprehensive analysis of peer assessment platforms with the support of artificial intelligence (AI) and empirical substantiation of the effectiveness of implementing the PeerScholar system in the process of professional training of future mathematics teachers. In the theoretical part of the work, a systematic comparison of nine leading intellectual platforms (RiPPLE, EduPCR, Peerceptiv, Kritik, PeerScholar, EvaluMate, Gradescope, Peergrade, ALEKS) was carried out, which allowed to identify the most relevant and economically affordable solutions for Ukrainian higher education institutions in conditions of limited resources. The empirical component of the study included 56 third-year students of the specialty "Secondary Education (Mathematics)", of which 53 respondents (n=53) participated in the final assessment, having completed five full cycles of peer evaluation of methodological developments in geometry during the semester. The use of a mixed-methods research design made it possible to combine quantitative data analysis of the questionnaire structure (32 points on the Likert scale, α=0.89) with qualitative thematic analysis of open-ended responses and in-depth interviews. Statistical results demonstrated a high level of overall satisfaction with the platform (M=4.28, SD=0.62), with the methodological aspect of using the system receiving the highest priority in the perception of students (M=4.36, SD=0.61). It was found that future teachers showed a significantly higher interest in constructive feedback (M=4.81, SD=0.42) than in receiving grades (M=4.42, SD=0.52). A significant increase in inter-rater reliability of assessments from rs=0.51 to rs=0.71 over the semester was found, which indicates a progressive development of the assessment competence of future teachers. The study proves that the integration of AI frameworks not only optimizes the workload of the teacher, but also acts as a catalyst for deep methodological reflection, allowing students to effectively identify their own gaps in knowledge through the prism of critical analysis of the work of their classmates.
Peer Assessment Artificial Intelligence Higher Education Mathematics Teacher Training Peerscholar Methodological Competence.
References
  1. K. J. Topping, E. F. Gehringer, H. Khosravi, S. Gudipati, K. Jadhav and S. Susarla, “Enhancing peer assessment with artificial intelligence,” International Journal of Educational Technology in Higher Education, vol. 22, no. 1, art. 3, 2025, [Online]. Available: https://doi.org/10.1186/s41239-024-00501-1.
  2. D. Babik, E. Gehringer, J. Kidd, K. Sunday, D. Tinapple and S. Gilbert, “A systematic review of educational online peer-review and assessment systems: Charting the landscape,” Educational Technology Research and Development, vol. 72, no. 3, pp. 1653-1689, 2024, [Online]. Available: https://doi.org/10.1007/s11423-024-10349-x.
  3. K. V. Nedialkova, “Using artificial intelligence technologies for assessment and peer assessment of students,” Problems of Modern Transformations. Series: Pedagogy and Psychology, vol. 9, pp. 1-12, 2025.
  4. D. E. Pare and S. Joordens, “Peering into large lectures: Examining peer and expert mark agreement using peerScholar, an online peer assessment tool,” Journal of Computer Assisted Learning, vol. 24, no. 6, pp. 526-540, 2008, [Online]. Available: https://doi.org/10.1111/j.1365-2729.2008.00290.x.
  5. K. Guo, “EvaluMate: Using AI to support students’ feedback provision in peer assessment for writing,” Assessing Writing, vol. 61, art. 100864, 2024, [Online]. Available: https://doi.org/10.1016/j.asw.2024.100864.
  6. C. Liu, J. Cui, R. Shang, Q. Jia, P. Rashud and E. Gehringer, “Generative AI for peer assessment helpfulness evaluation,” in Proceedings of the 17th International Conference on Educational Data Mining (EDM), 2024, pp. 412-419.
  7. A. W. Li, “Using Peerceptiv to support AI-based online writing assessment across the disciplines,” Assessing Writing, vol. 57, art. 100746, 2023, [Online]. Available: https://doi.org/10.1016/j.asw.2023.100746.
  8. Wei et al., “Chain of thought prompting elicits reasoning in large language models,” arXiv preprint arXiv:2201.11903, 2022.
  9. W. Xiong, D. Litman and C. D. Schunn, “Natural language processing techniques for researching and improving peer feedback,” Journal of Writing Research, vol. 4, no. 2, pp. 155-176, 2012, [Online]. Available: https://doi.org/10.17239/jowr-2012.04.02.3.
  10. D. E. Paré, “The peerScholar process: Using formative peer and self-assessment to enhance and quantify critical thinking skills, metacognitive awareness, and sense of community,” Ph.D. dissertation, University of Toronto, Toronto, Canada, 2020.
ICAIIT 2026
International Conference on Applied Innovation in IT
Bringing together researchers, engineers and practitioners to share advances in applied information technology.
Submission deadline
September 29, 2026
Paper acceptance
November 2, 2026
Journal publication
November 30, 2026
Next conference
March 11, 2027 · Köthen, Germany
© 2026 ICAIIT · Anhalt University of Applied Sciences ISSN 2198-8005 (online)

Proceedings of the International Conference on Applied Innovations in IT by Anhalt University of Applied Sciences is licensed under CC BY-SA 4.0  ·  This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License