INTEGRATION OF SPEECH AND SIGN LANGUAGE TRAINING USING THE QUBRAIN PLATFORM FOR DEAF STUDENTS

I Kadek Deva Sancitta Aiswarya, Finanda Rihanika Putri, Natasya Putri Femy Gosoemolo, Dimas Arif Dewantoro

Abstract


Communication skills are an important foundation for learning, social interaction, and independence among deaf and hard-of-hearing students. This article describes the implementation of QuBrain, a snakes-and-ladders board game equipped with speech and sign-language challenge cards, to support communication practice in a special school in Malang, Indonesia. A descriptive qualitative approach was used through direct observation, an interview with the accompanying teacher, field notes, and visual documentation. The activity was conducted on 10 November 2025 with two ninth-grade students with hearing impairment. The implementation began with introductory practice in pronunciation and simple signs, followed by a game session in which students responded to speech and sign-language challenges. The observed results indicated increased enthusiasm, participation, willingness to attempt verbal vocabulary, and willingness to demonstrate signs. Peer interaction also appeared when students helped or corrected one another. Nevertheless, the students initially had difficulty with SIBI and required repeated demonstrations and facilitator support. The findings suggest that QuBrain has potential as an interactive and visually accessible learning aid for communication practice. Because the activity involved only two students and lacked pre-post measurement, the findings should be interpreted as descriptive evidence of engagement and participation rather than experimental evidence of effectiveness.

Full Text:

PDF

References


Albash, N. I. A., & Turkestani, M. H. O. (2024). Educational interventions for deaf and hard-of-hearing children in preschool: a systematic review. Early Years, 44(3–4), 570–584. https://doi.org/10.1080/09575146.2023.2192437

Bouzid, Y., Khenissi, M. A., Essalmi, F., & Jemni, M. (2016). Using educational games for sign language learning - A signwriting learning game: Case study. Educational Technology and Society, 19(1), 129–141.

Cano, S. P., Collazos, C. A., Manresa-Yee, C. S., & Peñeñory, V. M. (2016). Principles of design for serious games to teaching of literacy for children with hearing disabilities. ACM International Conference Proceeding Series. https://doi.org/10.1145/2998626.2998650

Costa, C. E., & Marcelino, L. (n.d.). Games user research with deaf students-research design and preliminary results. 2020September, 106–115. https://doi.org/10.34190/GBL.20.108

Jarollahi, F., Fallahnezhad, T., & Aslibeigi, F. (2025). The Effect of Sign Language on the Language Development of Deaf and Hard-of-Hearing Children: A Systematic Review. Journal of Modern Rehabilitation, 19(4), 346–357. https://doi.org/10.18502/jmr.v19i4.19770

Kamnardsiri, T., Hongsit, L. O., & Wongta, N. (n.d.). Designing a sign language intelligent game-based learning framework with kinect. 2016-January, 64–73.

Li, R., Miao, B., Jiang, M., & Fan, M. (2024). Designing a Serious Game with Natural Interaction to Support the Learning of Chinese Sign Language and Deaf Social Etiquette: 14688 LNCS (51–66). https://doi.org/10.1007/978-3-031-60449-2_4

Mich, O., Armellini, E., Fastelli, A., & Arfé, B. (2019). Design, implementation and evaluation of SELEDE. A collection of serious games for training sequence learning skills in deaf children. ACM International Conference Proceeding Series. https://doi.org/10.1145/3351995.3352048

Noda, S., Shirotsuki, K., & Nakao, M. (2019). The effectiveness of intervention with board games: A systematic review. BioPsychoSocial Medicine, 13(1). https://doi.org/10.1186/s13030-019-0164-1

Paatsch, L. E., & Toe, D. M. (2020). The impact of pragmatic delays for deaf and hard of hearing students in mainstream classrooms. Pediatrics, 146. https://doi.org/10.1542/peds.2020-0242I

Papanastasiou, G. P., Drigas, A. S., Skianis, C. A., & Lytras, M. D. (2017). Serious games in K-12 education: Benefits and impacts on students with attention, memory and developmental disabilities. Program, 51(4), 424–440. https://doi.org/10.1108/PROG-02-2016-0020

Piştav-Akmeşe, P., Kayhan, N., & Isikdogan Ugurlu, N. (2023). Written Language Characteristics of Deaf and Hard of Hearing Students in Terms of the Components of the Language. Journal of Psycholinguistic Research, 52(6), 2093–2117. https://doi.org/10.1007/s10936-023-09990-z

Shelton, B. E., & Parlin, M. A. (2016). Teaching Math to Deaf/Hard-of-Hearing (DHH) Children Using Mobile Games: Outcomes with Student and Teacher Perspectives. International Journal of Mobile and Blended Learning, 8(1), 1–17. https://doi.org/10.4018/IJMBL.2016010101

Tlili, A., Denden, M., Duan, A., Sun, T., & Burgos, D. (2022). Game-Based Learning for Learners With Disabilities—What Is Next? A Systematic Literature Review From the Activity Theory Perspective. Frontiers in Psychology, 12. https://doi.org/10.3389/fpsyg.2021.814691

Westin, T., Neves, J. C., Mozelius, P., Sousa, C., & Mantovan, L. (n.d.). Inclusive AR-games for Education of Deaf Children: Challenges and Opportunities. 2022-October, 597–604.


Refbacks

  • There are currently no refbacks.


This proceeding series is indexed by:

ipiii.pnggoogle.png

ISSN: 2987-2448