ANALYSIS OF DIFFERENCES IN THE RESULTS OF MATHEMATICS COGNITIVE TEST OF GRADE XI STUDENTS USING CHAT-GPT AND OPEN BOOK AT SMAN 7 KEDIRI

Faradila Ramadhani, Almas Ardhia Pramisti, Arafah Husna, Ence Surahman

Abstract


This study aims to determine the effect of using ChatGPT as an aid in solving mathematics problems on the cognitive test results of eleventh-grade students on Trigonometry material at SMAN 7 Kediri City. The study used a quasi-experimental method with a static non-equivalent group design. The study sample consisted of two classes, namely the control class (using the open book method) and the test class (using ChatGPT). Data were obtained through cognitive tests, observations, and questionnaires. The results of the Mann-Whitney test showed a significant difference between the two classes (p < 0.05), with the average score of the test class being higher (98.57) than the control class (58.50). Effectiveness analysis using Cohen's d showed a large effect (d = 2.14). Qualitative results also supported this finding, where students showed positive perceptions of the use of ChatGPT. Thus, ChatGPT was proven to have a positive effect on students' cognitive mathematics learning outcomes

Full Text:

PDF

References


Afsari, S., Safitri, I., Harahap, S. K., & Munthe, L. S. (2021). Systematic literature review: Efektivitas pendekatan pendidikan matematika realistik pada pembelajaran matematika. Indonesian Journal of Intellectual Publication, 1(3), 189–197.

Auna, H. S. A., & Hamzah, N. (2024). Studi perspektif siswa terhadap efektivitas pembelajaran matematika dengan penerapan chatgpt. HINEF: Jurnal Rumpun Ilmu Pendidikan, 3(1), 13–25.

Bekdemir, Y. (2024). The Urgency of AI Integration in Teacher Training: Shaping the Future of Education. Journal of Research in Didactical Sciences, 3(1), 3. https://doi.org/10.51853/jorids/15485

Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa

Cohen, L., Manion, L., & Morrison, K. (2017). Research Methods in Education (8th ed.). Routledge. https://doi.org/10.4324/9781315456539

Fosnot, C. T. (2013). Constructivism: Theory, perspectives, and practice. Teachers College Press. https://books.google.com/books?hl=en&lr=&id=-pIbAgAAQBAJ&oi=fnd&pg=PA1926&dq=Fosnot,+C.+T.+(2013).+Constructivism:+Theory,+perspectives,+and+practice.+Teachers+College+Press.

Güner, H., & Er, E. (2025). AI in the classroom: Exploring students’ interaction with ChatGPT in programming learning. Education and Information Technologies, 30(9), 12681–12707. https://doi.org/10.1007/s10639-025-13337-7

Halimah, L., & jamilah, weti sri nuryani. (2024). INNOVATIVE LEARNING STRATEGIES FOR SOCIAL STUDIES IN THE ERA OF ARTIFICIAL INTELLIGENCE. International Conference on Aplied Social Sciences in Education, 1(1), 181–187. https://doi.org/10.31316/icasse.v1i1.6842

Halimah, N., Degeng, M. D. K., & Soepriyanto, Y. (2024). Peranan Tingkat Penerimaan Learning Management System Terhadap Kemampuan Self Regulated Learning. JKTP: Jurnal Kajian Teknologi Pendidikan, 7(3), 118–128.

Harjono, A., gunawan, gunawan, Nisyah, M., Kusdiastuti, M., & Herayanti, L. (2020). Improving Students’ Problem-Solving Skills Using Inquiry Learning Model Combined with Advance Organizer. International Journal of Instruction, 13(4), 427–442. https://doi.org/10.29333/iji.2020.13427a

Lo, C. K. (2023). What is the impact of ChatGPT on education? A rapid review of the literature. Education Sciences, 13(4), 410.

Lynd-Balta, E. (2020). Using Literature and Innovative Assessments to Ignite Interest and Cultivate Critical Thinking Skills in an Undergraduate Neuroscience Course. CBE—Life Sciences Education, 5(2), 167–174. https://doi.org/10.1187/cbe.05-08-0108

Ma’amor, H., Achim, N., Ahmad, N. L., Roszaman, N. S., Kamarul Anuar, N. N., Khairul Azwa, N. C. A., Abd Rahman, S. N., & Aqilah Hamjah, N. A. (2024). The Effect of Artificial Intelligence (AI) on Students’ Learning. Information Management and Business Review, 16(3S(I)a), 856–867. https://doi.org/10.22610/imbr.v16i3S(I)a.4178

Masluha, M., & Zainudin, Z. (2024). Pengaruh Penerapan Model Pembelajaran Flipped Classroom Berbantuan Chat GPT Terhadap Hasil Belajar Matematika Siswa di MTS Darul Ulum. Jurnal Cendekia : Jurnal Pendidikan Matematika, 8(3), 2149–2157. https://doi.org/10.31004/cendekia.v8i3.3294

Nguyen, A., Ngo, H. N., Hong, Y., Dang, B., & Nguyen, B.-P. T. (2023). Ethical principles for artificial intelligence in education. Education and Information Technologies, 28(4), 4221–4241. https://doi.org/10.1007/s10639-022-11316-w

Nugraha, C. A., & Harsono, R. J. (2024). Chemistry Storytelling with AI: A Descriptive Research of Ebook Creation for Grade 10 Students. JKTP: Jurnal Kajian Teknologi Pendidikan, 7(3), 149–160.

OECD. (2024). Transforming education in Indonesia: Examining the landscape of current reforms (OECD Education Policy Perspectives 88; OECD Education Policy Perspectives, Vol. 88). https://doi.org/10.1787/9ff8d407-en

Parmiti, D. P., Rediani, N. N., Antara, I. G. W. S., & Jayadiningrat, M. G. (2021). The Effectiveness of Local Culture-Integrated Science Learning through Project-Based Assessment on Scientific Attitudes and Science Process Skills of Elementary School Students. Jurnal Pendidikan IPA Indonesia, 10(3), 439–446. https://doi.org/10.15294/jpii.v10i3.31301

Rahayu, A. P., Hidayati, D., Susilowati, S., & Jannah, F. B. F. (2022). Pembelajaran Interaktif Melalui Hybrid Learning Dengan Metode Demonstrasi. JKTP: Jurnal Kajian Teknologi Pendidikan, 5(3), 326–336.

Subiyantoro, S., Degeng, I. N. S., Kuswandi, D., & Ulfa, S. (2023). Exploring the impact of ai-powered chatbots (chat gpt) on education: A qualitative study on benefits and drawbacks. Jurnal Pekommas, 8(2), 157–168.

Wardat, Y., Tashtoush, M. A., AlAli, R., & Jarrah, A. M. (2023). ChatGPT: A revolutionary tool for teaching and learning mathematics. Eurasia Journal of Mathematics, Science and Technology Education, 19(7), em2286.

Widarti, H. R., Hakim, M. I., & Rokhim, D. A. (2022). The Development of a Virtual Laboratory on Qualitative Chemical Practicum Analysis. Jurnal Ilmiah Peuradeun, 10(3), 783. https://doi.org/10.26811/peuradeun.v10i3.760

Woo, D. J., Deliang Wang, Yung, T., & Guo, K. (2024). Effects of a Prompt Engineering Intervention on Undergraduate Students’ AI Self-Efficacy, AI Knowledge, and Prompt Engineering Ability: A Mixed Methods Study. https://doi.org/10.13140/RG.2.2.32577.36968

Yuntaro, I. S., & Yudhanegara, M. R. (2024). Analisis Klaster Pengaruh Hasil Belajar Matematika dan Bahasa Indonesia Terhadap Pengerjaan Soal Matematika Dibantu ChatGPT. Didactical Mathematics, 6(2), 141–150.

Zein, S., Yaniawati, P., & Mudrikah, A. (2024). The Role and Evaluation of ChatGPT as a Virtual Tutor in Improving Students’ Creative and Critical Abilities Reviewed from Probing-Prompting Abilities. Kreano, Jurnal Matematika Kreatif-Inovatif, 15(2), 501–517. https://doi.org/10.15294/a2g5x690


Refbacks

  • There are currently no refbacks.


This proceeding series is indexed by:

ipiii.pnggoogle.png

ISSN: 2987-2448