The rapid integration of artificial intelligence (AI) in education necessitates the development of effective strategies for optimizing routine teaching tasks. This study explores the relevance of prompt engineering as a tool for enhancing AI-generated responses, reducing educators' workload, and improving the efficiency of lesson planning, content creation, and assessment design. The primary objective of this research is to develop and evaluate a structured methodology for designing prompts that maximize the relevance, completeness, and applicability of AI-generated outputs. To achieve this goal, a three-phase methodology was employed: (1) a preparatory phase involving a literature review and the development of standardized educational prompts, (2) an experimental phase testing these prompts across multiple AI chatbot models (Claude, GPT, and Copilot), and (3) an analytical phase assessing chatbot responses based on predefined criteria, including relevance, accuracy, completeness, practicality, and structuredness. The results indicate significant differences in chatbot performance. Claude demonstrated superior contextual understanding, GPT provided well-balanced and structured responses, while Copilot exhibited high factual accuracy but required improvements in contextual adaptation. Statistical analysis using the Kruskal-Wallis H test confirmed these variations, highlighting the necessity of model-specific prompt optimization. The study’s findings have both practical and theoretical significance. Practically, they provide educators with a structured approach to prompt engineering, enabling more effective use of AI tools in teaching. Theoretically, the research contributes to the growing field of AI- assisted education by offering insights into optimizing human-AI interaction. The conclusions emphasize the need for continued refinement of AI models and further exploration of prompt engineering techniques. Future research should focus on expanding testing across various disciplines and integrating AI-driven tools into digital learning environments to enhance personalized education.
Keywords
AI in EducationPrompt EngineeringChatbot EvaluationLesson Planning AutomationAI-Assisted Teaching.
References
D. Baidoo-Anu and L. Owusu Ansah, "Education in the era of generative artificial intelligence (AI): Understanding the potential benefits of ChatGPT in promoting teaching and learning," SSRN, 2023. [Online]. Available: https://dx.doi.org/10.2139/ssrn.4337484.
A. Bozkurt, "Tell me your prompts and I will make them true: The alchemy of prompt engineering and generative AI," Open Praxis, vol. 16, no. 2, pp. 111–118, 2024. [Online]. Available: https://doi.org/10.55982/openpraxis.16.2.661
A. Bozkurt and R. C. Sharma, "Generative AI and prompt engineering: The art of whispering to let the genie out of the algorithmic world," Asian Journal of Distance Education, vol. 18, no. 2, pp. i–vii, 2023. [Online]. Available: https://doi.org/10.5281/zenodo.8174941.
W. Cain, "Prompting Change: Exploring Prompt Engineering in Large Language Model AI and Its Potential to Transform Education," TechTrends, vol. 68, no. 1, pp. 47–57, 2024. [Online]. Available: https://doi.org/10.1007/s11528-023-00896-0.
G. Cooper, "Examining science education in ChatGPT: An exploratory study of generative artificial intelligence," Journal of Science Education and Technology, vol. 32, no. 3, pp. 444–452, 2023. [Online]. Available: https://doi.org/10.1007/s10956-023-10039-y.
Y. Li, J. Shi, and Z. Zhang, "An approach for rapid source code development based on ChatGPT and prompt engineering," IEEE Access, vol. 12, 2024. [Online]. Available: https://doi.org/10.1109/ACCESS.2024.3385682.
S. Schulhoff, M. Ilie, N. Balepur, K. Kahadze, A. Liu, C. Si, ... and P. Resnik, "The prompt report: A systematic survey of prompting techniques," arXiv preprint, arXiv:2406.06608, 2024. [Online]. Available: https://doi.org/10.48550/arXiv.2406.06608.
S. Skvortsova, T. Symonenko, T. Britskan, O. Onopriienko, and R. Romanyshyn, "Artificial intelligence in the professional activity of a university lecturer in Ukraine: Realities and prospects," Proceedings of the Second International Workshop on Artificial Intelligent Systems in Education, co-located with 23rd International Conference of the Italian Association for Artificial Intelligence (AIxIA 2024), vol. 3879, 2024. [Online]. Available: https://ceur-ws.org/Vol-3879/AIxEDU2024_paper_14.pdf.
J. Wei, X. Wang, D. Schuurmans, M. Bosma, E. Chi, Q. Le, and D. Zhou, "Chain of thought prompting elicits reasoning in large language models," arXiv preprint, arXiv:2201.11903, 2022. [Online]. Available: https://arxiv.org/pdf/2201.11903.
I. Y. Yurchak, O. O. Kychuk, V. M. Oksentyuk, and A. O. Khich, "Capabilities and limitations of large language models," Computer Systems and Networks, vol. 6, no. 2, pp. 286–300, 2024. [Online]. Available: https://doi.org/10.23939/csn2024.02.286.