Intervensi Aplikasi ChatGPT dalam Proses Pembelajaran Pemrograman Komputer di Sekolah Kejuruan

Admaja Dwi Herlambang, Okta Purnawirawan, Ghasa Faraasyatul Alam

Abstract


Penelitian ini mengkaji integrasi ChatGPT dalam pembelajaran pemrograman komputer melalui rancangan penelitian eksperimental di lima sekolah menengah kejuruan di Malang, Indonesia. Penelitian menggunakan rancangan jenis static group pretest-posttest dengan 142 peserta didik pada jurusan rekayasa perangkat lunak dan jaringan komputer. Penelitian ini membuktikan seperti apa pengaruh ChatGPT terhadap performa kognitif, kolaborasi tim, dan pemecahan masalah kreatif dalam pembelajaran pemrograman komputer. Hasil penelitian menunjukkan perbedaan signifikan dalam performa kognitif antara kelompok eksperimen dan kontrol (Cohen’s d = 0,94, p < 0,01), dengan tim menunjukkan peningkatan 52,00% dalam efisiensi kegiatan kolaboratif (Cohen’s d = 0,85, p < 0,01). Tim yang menggunakan ChatGPT menunjukkan peningkatan 41,00% dalam pemecahan masalah kreatif (Cohen’s d = 0,82, p < 0,01), khususnya dalam pemikiran algoritmik dan optimasi kode. Namun, 34,00% subjek penelitian menunjukkan penurunan kemampuan pengkodean praktis meskipun pemahaman teoretis meningkat. Temuan ini berkontribusi pada diskursus integrasi teknologi kecerdasan buatan dalam pembelajaran pemrograman, dan menyoroti pentingnya keseimbangan antara bantuan teknologi dan pengembangan kompetensi yang otentik. Implikasinya dapat diberlakukan pada konteks perancangan kurikulum, strategi pedagogis, serta integrasi kecerdasan buatan yang lebih terstruktur untuk mendorong kreativitas dan kompetensi kolaboratif yang esensial bagi industri teknologi informasi.

Full Text:

PDF

References


Ahme, Z., Shanto, S. S., & Jony, A. I. (2024). Potentiality of generative AI tools in higher education: Evaluating ChatGPT’s viability as a teaching assistant for introductory programming courses. STEM Education, 4(3), 165–182. https://doi.org/10.3934/steme.2024011

Aiken, L. R. (1985). Three coefficients for analyzing the reliability and validity of ratings. Educational and Psychological Measurement, 45(1), 131–142. https://doi.org/10.1177/0013164485451012

Andersen, R., Mørch, A. I., & Litherland, K. T. (2022). Collaborative learning with block-based programming: investigating human-centered artificial intelligence in education. Behaviour and Information Technology, 41(9), 1830–1847. https://doi.org/10.1080/0144929X.2022.2083981

Bakar, M. A., Mukhtar, M., & Khalid, F. (2019). The development of a visual output approach for programming via the application of cognitive load theory and constructivism. International Journal of Advanced Computer Science and Applications, 10(11), 305–312. https://doi.org/10.14569/IJACSA.2019.0101142

Banic, B., Konecki, M., & Konecki, M. (2023). Pair Programming Education Aided by ChatGPT. In 2023 46th ICT and Electronics Convention, MIPRO 2023 - Proceedings (pp. 911–915). https://doi.org/10.23919/MIPRO57284.2023.10159727

Banić, B., Konecki, M., & Konecki, M. (2023). Pair programming education aided by ChatGPT. 2023 46th MIPRO ICT and XYZ. https://ieeexplore.ieee.org/abstract/document/10159727/

Bernabei, M., Colabianchi, S., Falegnami, A., & Costantino, F. (2023). Students’ use of large language models in engineering education: A case study on technology acceptance, perceptions, efficacy, and detection chances. Computers and Education: Artificial Intelligence, 5. https://doi.org/10.1016/j.caeai.2023.100172

Bird, C., Ford, D., Zimmermann, T., Forsgren, N., & ... (2022). Taking Flight with Copilot: Early insights and opportunities of AI-powered pair-programming tools. Queue. https://doi.org/10.1145/3582083

Braithwaite, D. W., & Sprague, L. (2021). Conceptual Knowledge, Procedural Knowledge, and Metacognition in Routine and Nonroutine Problem Solving. Cognitive Science, 45(10). https://doi.org/10.1111/cogs.13048

Çakiroğlu, Ü., & Bilgi, Ş. (2022). Exploring intrinsic cognitive load in the programming process: a two dimensional approach based on element interactivity. Interactive Learning Environments. https://doi.org/10.1080/10494820.2022.2137527

Chopra, A., Patel, G., & Sahoo, C. K. (2022). A critical assessment of employer branding to retain knowledgeable workforce: study on current employees of the information technology firms. VINE Journal of Information and Knowledge Management Systems. https://doi.org/10.1108/VJIKMS-02-2022-0036

Cohen, L., Manion, L., & Morrison, K. (2018). Research Methods in Education. Routledge.

Dahlkemper, M. N., Lahme, S. Z., & Klein, P. (2023). How do physics students evaluate artificial intelligence responses on comprehension questions A study on the perceived scientific accuracy and linguistic quality of ChatGPT. Physical Review Physics Education Research, 19(1). https://doi.org/10.1103/PhysRevPhysEducRes.19.010142

Deguchi, A., Akashi, Y., Hato, E., Ohkata, J., Nakano, T., & Warisawa, S. (2020). Solving social issues through industry-academia collaboration. In Society 5.0: A People-centric Super-smart Society (pp. 85–115). Springer Open. https://doi.org/10.1007/978-981-15-2989-4_5

Dehghanzadeh, S., & Jafaraghaee, F. (2018). Comparing the effects of traditional lecture and flipped classroom on nursing students’ critical thinking disposition: A quasi-experimental study. Nurse Education Today, 71, 151–156. https://doi.org/10.1016/j.nedt.2018.09.027

Deriba, F. G., Sanusi, I. T., & Sunday, A. O. (2023). Enhancing Computer Programming Education using ChatGPT: A Mini Review. In ACM International Conference Proceeding Series. https://doi.org/10.1145/3631802.3631848

Divayana, D. G. H., Suyasa, P. W. A., & Widiartini, N. K. (2021). An innovative model as evaluation model for information technology-based learning at ICT vocational schools. Heliyon, 7(2). https://doi.org/10.1016/j.heliyon.2021.e06347

Doan, D. T. (2021). Academia-industry partnerships to develop cloud computing skills for students: A case study from aws academy. International Journal of Entrepreneurship, 25(Special Issue 1), 1–10. https://api.elsevier.com/content/abstract/scopus_id/85114382650

Dormann, M., Hinz, S., & Wittmann, E. (2019). Improving school administration through information technology? How digitalisation changes the bureaucratic features of public school administration. Educational Management Administration and Leadership, 47(2), 275–290. https://doi.org/10.1177/1741143217732793

Durak, H. Y. (2020a). The Effects of Using Different Tools in Programming Teaching of Secondary School Students on Engagement, Computational Thinking and Reflective Thinking Skills for Problem Solving. Technology, Knowledge and Learning, 25(1), 179–195. https://doi.org/10.1007/s10758-018-9391-y

Durak, H. Y. (2020b). The Effects of Using Different Tools in Programming Teaching of Secondary School Students on Engagement, Computational Thinking and Reflective Thinking Skills for Problem Solving. Technology, Knowledge and Learning, 25(1), 179–195. https://doi.org/10.1007/s10758-018-9391-y

Essel, H. B., Vlachopoulos, D., Essuman, A. B., & Amankwa, J. O. (2024). ChatGPT effects on cognitive skills of undergraduate students: Receiving instant responses from AI-based conversational large language models (LLMs). Computers and Education: Artificial Intelligence, 6. https://doi.org/10.1016/j.caeai.2023.100198

Fraenkel, J. R., Wallen, N. E., & Hyun, H. H. (2022). How to Design and Evaluate Research in Education. McGraw Hill LLC. https://www.mheducation.com/highered/product/how-design-evaluate-research-education-fraenkel-wallen/M9781259913839.html

Ghimire, A., & Edwards, J. (2024). Coding with AI: How Are Tools Like ChatGPT Being Used by Students in Foundational Programming Courses. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics): Vol. 14830 LNAI (pp. 259–267). https://doi.org/10.1007/978-3-031-64299-9_20

Gökoğlu, S., & Kilic, S. (2022). Programming learning and teaching of pre-service computer science teachers: Challenges, concerns, and solutions. E-Learning and Digital Media. https://doi.org/10.1177/20427530221117331

Guo, Y. (2024). Vocational Education and Industry Integration and Symbiosis of Subjects and Digital Drivers. Applied Mathematics and Nonlinear Sciences, 9(1). https://doi.org/10.2478/amns.2023.2.01456

Haindl, P., & Weinberger, G. (2024). Students’ Experiences of Using ChatGPT in an Undergraduate Programming Course. IEEE Access, 12, 43519–43529. https://doi.org/10.1109/ACCESS.2024.3380909

Hartley, K., Hayak, M., & Ko, U. H. (2024). Artificial Intelligence Supporting Independent Student Learning: An Evaluative Case Study of ChatGPT and Learning to Code. Education Sciences, 14(2). https://doi.org/10.3390/educsci14020120

Herlambang, A. D., Budiman, B., & Wardhono, W. S. (2022). Interactive Procedural Knowledge Learning Resources Development in The Context of Competency-Based Training Instructional Approach and Interactive Media Design Subjects for Information Technology Vocational High School. Elinvo (Electronics, Informatics, and Vocational Education); Vol 7, No 1 (2022): Mei 2022DO - 10.21831/Elinvo.V7i1.48215 . https://doi.org/https://doi.org/10.21831/elinvo.v7i1.48215

Herlambang, A. D., Fransisca, O. D., & Afirianto, T. (2023). The Flipped-Classroom Instructional Procedure Development and Its Implementation Effectiveness in Improving Procedural Knowledge Learning Outcomes at Vocational High Schools. Elinvo (Electronics, Informatics, and Vocational Education), 8(2), 2477–2399.

Herlambang, A. D., Rachmadi, A., & Wijoyo, S. H. (2023). Git and GitHub Application Training Program to Support Vocational High School Students in Collaborative Computer Programming Learning. JPPM (Jurnal Pendidikan Dan Pemberdayaan Masyarakat), 10(1), 13–24. https://doi.org/10.21831/jppm.v10i1.58550

Huang, R., Spector, J. M., & Yang, J. (2019). Educational Technology: A Primer for the 21st Century. Springer Nature Singapore Pte Ltd.

Ismail, M. N., Ngah, N. A., & Umar, I. N. (2010). The effects of mind mapping with cooperative learning on programming performance, problem solving skill and metacognitive knowledge among computer science students. Journal of Educational Computing Research, 42(1), 35–61. https://doi.org/10.2190/EC.42.1.b

Istiyowati, L. S., Syahrial, Z., & Muslim, S. (2020). Programmer’s competencies between industry and education. Universal Journal of Educational Research, 8(9 A), 10–15. https://doi.org/10.13189/ujer.2020.082002

Jamil, M. G., & Isiaq, S. O. (2019). Teaching technology with technology: approaches to bridging learning and teaching gaps in simulation-based programming education. International Journal of Educational Technology in Higher Education, 16(1). https://doi.org/10.1186/s41239-019-0159-9

Jiang, X., Xu, J., & Xu, X. (2024). An overview of domestic and international applications of digital technology in teaching in vocational education: Systematic literature mapping. Education and Information Technologies. https://doi.org/10.1007/s10639-024-12528-y

Jung, J., Shin, Y., Chung, H. J., & Fanguy, M. (2024). The effects of pre-training types on cognitive load, self-efficacy, and problem-solving in computer programming. Journal of Computing in Higher Education. https://doi.org/10.1007/s12528-024-09407-3

Kadar, R., Mahlan, S. B., Shamsuddin, M., Othman, J., & Wahab, N. A. (2022). Analysis of Factors Contributing to the Difficulties in Learning Computer Programming among Non-Computer Science Students. In 2022 12th IEEE Symposium on Computer Applications and Industrial Electronics, ISCAIE 2022 (pp. 89–94). https://doi.org/10.1109/ISCAIE54458.2022.9794546

Kim, T. W. (2023). Application of artificial intelligence chatbots, including ChatGPT, in education, scholarly work, programming, and content generation and its prospects: a narrative review. In Journal of Educational Evaluation for Health Professions (Vol. 20). https://doi.org/10.3352/jeehp.2023.20.38

Koltovskaia, S., Rahmati, P., & Saeli, H. (2024). Graduate students’ use of ChatGPT for academic text revision: Behavioral, cognitive, and affective engagement. Journal of Second Language Writing, 65. https://doi.org/10.1016/j.jslw.2024.101130

Kong, S. C., & Wang, Y. Q. (2020). Formation of computational identity through computational thinking perspectives development in programming learning: A mediation analysis among primary school students. Computers in Human Behavior, 106. https://doi.org/10.1016/j.chb.2019.106230

Kuna, P., Haskova, A., & Arras, P. (2021). International interinstitutional coordination of vocational education and training of programmers for industry 4.0 needs. In 2021 IEEE European Technology and Engineering Management Summit, E-TEMS 2021 - Conference Proceedings (pp. 93–98). https://doi.org/10.1109/E-TEMS51171.2021.9524888

Lacave, C., & Molina, A. I. (2021). The impact of covid-19 in collaborative programming. Understanding the needs of undergraduate computer science students. Electronics (Switzerland), 10(14). https://doi.org/10.3390/electronics10141728

Lai, C. Y., Cheung, K. Y., Chan, C. S., & Law, K. K. (2024). Integrating the adapted UTAUT model with moral obligation, trust and perceived risk to predict ChatGPT adoption for assessment support: A survey with students. Computers and Education: Artificial Intelligence, 6. https://doi.org/10.1016/j.caeai.2024.100246

Lai, R. P. Y. (2022). Beyond Programming: A Computer-Based Assessment of Computational Thinking Competency. ACM Transactions on Computing Education, 22(2), 27 Pages. https://doi.org/10.1145/3486598

Lenhard, W., & Lenhard, A. (2016). Computation of Effect Sizes. Psychometrica. https://doi.org/10.13140/RG.2.2.17823.92329

Lin, Y., & Yu, Z. (2023). A bibliometric analysis of artificial intelligence chatbots in educational contexts. Interactive Technology and Smart Education. https://doi.org/10.1108/ITSE-12-2022-0165

Lloyd, G. A., Dean, B. A., Eady, M. J., West, C., Yanamandram, V., Moroney, T., Glover-Chambers, T., & O’Donnell, N. (2022). Academic’s perceptions of work-integrated learning in non-vocational disciplines. Higher Education, Skills and Work-Based Learning, 12(5), 809–820. https://doi.org/10.1108/HESWBL-09-2021-0181

Lo, C. K., Hew, K. F., & Jong, M. S. yung. (2024). The influence of ChatGPT on student engagement: A systematic review and future research agenda. Computers and Education, 219. https://doi.org/10.1016/j.compedu.2024.105100

Lu, Q., Yao, Y., Xiao, L., Yuan, M., Wang, J., & Zhu, X. (2024). Can ChatGPT effectively complement teacher assessment of undergraduate students’ academic writing? Assessment and Evaluation in Higher Education, 49(5), 616–633. https://doi.org/10.1080/02602938.2024.2301722

Luxton-Reilly, A., Simon, Albluwi, I., Becker, B. A., Giannakos, M., Kumar, A. N., Ott, L., Paterson, J., Scott, M. J., Sheard, J., & Szabo, C. (2018). Introductory programming: A systematic literature review. Annual Conference on Innovation and Technology in Computer Science Education, ITiCSE, 55–106. https://doi.org/10.1145/3293881.3295779

Ma, B., Chen, L., & Konomi, S. (2024). Enhancing Programming Education with ChatGPT: A Case Study on Student Perceptions and Interactions in a Python Course. In Communications in Computer and Information Science: Vol. 2150 CCIS (pp. 113–126). https://doi.org/10.1007/978-3-031-64315-6_9

Ma, Q., Wu, T., & Koedinger, K. (2023). Is ai the better programming partner? human-human pair programming vs. human-ai pair programming. ArXiv Preprint ArXiv:2306.05153. https://arxiv.org/abs/2306.05153

Mangaroska, K., Sharma, K., Gašević, D., & Giannakos, M. (2022). Exploring students’ cognitive and affective states during problem solving through multimodal data: Lessons learned from a programming activity. Journal of Computer Assisted Learning, 38(1), 40–59. https://doi.org/10.1111/jcal.12590

Ouyang, F., Guo, M., Zhang, N., Bai, X., & Jiao, P. (2024). Comparing the effects of instructor manual feedback and ChatGPT intelligent feedback on collaborative programming in China’s higher education. IEEE Transactions on Learning Technologies, 17, 2227–2239. https://doi.org/10.1109/TLT.2024.3486749

Pala, F. K., & Mıhcı Türker, P. (2021). The effects of different programming trainings on the computational thinking skills. Interactive Learning Environments, 29(7), 1090–1100. https://doi.org/10.1080/10494820.2019.1635495

Ramabu, T., & Malebane, T. (2024). Guidelines for Effective Use of ChatGPT in Introductory Programming Education. In 2024 IST-Africa Conference, IST-Africa 2024. https://doi.org/10.23919/IST-Africa63983.2024.10569684

Rienties, B., Køhler Simonsen, H., & Herodotou, C. (2020). Defining the Boundaries Between Artificial Intelligence in Education, Computer-Supported Collaborative Learning, Educational Data Mining, and Learning Analytics: A Need for Coherence. Frontiers in Education, 5. https://doi.org/10.3389/feduc.2020.00128

Schmid, R., & Petko, D. (2019). Does the use of educational technology in personalized learning environments correlate with self-reported digital skills and beliefs of secondary-school students? Computers and Education, 136, 75–86. https://doi.org/10.1016/j.compedu.2019.03.006

Silva, C. A. G. da, Ramos, F. N., de Moraes, R. V., & Santos, E. L. dos. (2024). ChatGPT: Challenges and Benefits in Software Programming for Higher Education. Sustainability (Switzerland), 16(3). https://doi.org/10.3390/su16031245

Silva, L., Mendes, A. J., & Gomes, A. (2020). Computer-supported Collaborative Learning in Programming Education: A Systematic Literature Review. 2020 IEEE Global Engineering Education Conference (EDUCON), 1086–1095.

Sun, D., Boudouaia, A., Zhu, C., & Li, Y. (2024). Would ChatGPT-facilitated programming mode impact college students’ programming behaviors, performances, and perceptions? An empirical study. International Journal of Educational Technology in Higher Education, 21(1). https://doi.org/10.1186/s41239-024-00446-5

Thi Nguyen, T. N., Van Lai, N., & Thi Nguyen, Q. (2024). Artificial Intelligence (AI) in Education: A Case Study on ChatGPT’s Influence on Student Learning Behaviors. Educational Process: International Journal, 13(2), 105–121. https://doi.org/10.22521/edupij.2024.132.7

Unal, A., & Topu, F. B. (2021). Effects of teaching a computer programming language via hybrid interface on anxiety, cognitive load level and achievement of high school students. Education and Information Technologies, 26(5), 5291–5309. https://doi.org/10.1007/s10639-021-10536-w

Urban, M., Děchtěrenko, F., Lukavský, J., Hrabalová, V., Svacha, F., Brom, C., & Urban, K. (2024). ChatGPT improves creative problem-solving performance in university students: An experimental study. Computers and Education, 215. https://doi.org/10.1016/j.compedu.2024.105031

Wang, L., Chen, X., Wang, C., Xu, L., Shadiev, R., & Li, Y. (2024). ChatGPT’s capabilities in providing feedback on undergraduate students’ argumentation: A case study. Thinking Skills and Creativity, 51. https://doi.org/10.1016/j.tsc.2023.101440

Wati, C. W., Sugandi, R. M., & Isnandar. (2019). Analysis of job competency requirements in the construction services industry for vocational high school of construction and property engineering expertise programs. International Journal of Innovation, Creativity and Change, 8(1), 29–38. https://api.elsevier.com/content/abstract/scopus_id/85077874206

Yang, A. C. M., Lin, J. Y., Lin, C. Y., & Ogata, H. (2024). Enhancing python learning with PyTutor: Efficacy of a ChatGPT-Based intelligent tutoring system in programming education. Computers and Education: Artificial Intelligence, 7. https://doi.org/10.1016/j.caeai.2024.100309


Refbacks

  • There are currently no refbacks.


This proceeding series is indexed by:

ipiii.pnggoogle.png

ISSN: 2987-2448