PENDAMPINGAN PENGGUNAAN APLIKASI DETEKSI BISINDO BERBASIS DEEP LEARNING UNTUK MENINGKATKAN LITERASI NUMERASI ANAK BERKEBUTUHAN KHUSUS

Tito Sugiharto; Munir Munir; Iwan Lesmana; Rio Priantama; Bagas Cahyawiguna; Muhammad Faisal Yusuf

doi:10.31764/jmm.v10i3.39442

PENDAMPINGAN PENGGUNAAN APLIKASI DETEKSI BISINDO BERBASIS DEEP LEARNING UNTUK MENINGKATKAN LITERASI NUMERASI ANAK BERKEBUTUHAN KHUSUS

Tito Sugiharto, Munir Munir, Iwan Lesmana, Rio Priantama, Bagas Cahyawiguna, Muhammad Faisal Yusuf

Abstract

Abstrak: Anak Berkebutuhan Khusus (ABK) dengan gangguan pendengaran menghadapi tantangan signifikan dalam pembelajaran literasi numerasi karena keterbatasan komunikasi verbal. Bahasa Isyarat Indonesia (BISINDO) merupakan media komunikasi utama yang digunakan komunitas Tuli di Indonesia. Rendahnya kemampuan literasi numerasi siswa tunarungu di Sekolah Luar Biasa (SLB) menjadi permasalahan mendasar yang memerlukan solusi inovatif berbasis teknologi. Kegiatan pengabdian kepada masyarakat ini bertujuan meningkatkan kemampuan literasi numerasi siswa tunarungu dan kompetensi guru dalam memanfaatkan aplikasi deteksi BISINDO berbasis Deep Learning di SLBN Taruna Mandiri, Kabupaten Kuningan. Metode yang digunakan meliputi sosialisasi, workshop, praktik langsung, dan pendampingan berkelanjutan kepada 25 guru dan 20 siswa tunarungu. Evaluasi dilakukan melalui angket pra dan pasca kegiatan serta observasi langsung selama pendampingan. Hasil kegiatan menunjukkan peningkatan kompetensi guru dalam mengoperasikan aplikasi sebesar 39,4%, dengan rata-rata skor penguasaan meningkat dari 47,3 menjadi 86,7. Kemampuan literasi numerasi siswa meningkat rata-rata 38,6% berdasarkan hasil pre test dan post test. Sebanyak 88,0% guru (22 dari 25 orang) mampu mengintegrasikan aplikasi dalam pembelajaran secara mandiri.

Abstract: Children with special needs who have hearing impairments face significant challenges in learning numeracy due to limitations in verbal communication. Indonesian Sign Language (BISINDO) is the primary means of communication used by the Deaf community in Indonesia. The low level of numeracy skills among deaf students at Special Education Schools (SLB) is a fundamental problem that requires innovative, technology-based solutions. This community service activity aims to improve the numeracy skills of deaf students and the competence of teachers in utilizing a Deep Learning based BISINDO detection application at SLBN Taruna Mandiri, Kuningan Regency. The methods used included outreach, workshops, hands-on practice, and ongoing mentoring for 25 teachers and 20 deaf students. Evaluation was conducted through pre- and post-activity questionnaires as well as direct observation during the mentoring sessions. The results of the program showed an 39.4% increase in teachers’ proficiency in using the application, with the average proficiency score rising from 47.3 to 86.7. Students’ numeracy skills improved by an average of 38.6% based on the results of the pre-test and post-test. A total of 88.0% of teachers (22 out of 25) were able to independently integrate the application into their teaching.

Keywords

BISINDO; Deep Learning; Numeracy Literacy; Children With Special Needs; Deaf.

Full Text:

DOWNLOAD [PDF]

References

Arnumukti, M. L., Yunus, A. P., & Babale, A. S. (2025). Improve Exercise Movement: Detecting Mistakes on Yoga with Mediapipe and MLP. International Journal on Robotics, Automation and Sciences, 7(1), 64–71. https://doi.org/10.33093/ijoras.2025.7.1.8

Awang Zainal, A. Z., Md Yasir, A. S. H., Basri, A. Q., Latif, K., Nelfiyanti, N., Mohd Yusoof, M. Y., & Ishak, M. R. (2026). Exploring the use of assistive technology in special education: Issues and trends for student visual impairments: A systematic literature review. Assistive Technology, 1, 1–16. https://doi.org/10.1080/10400435.2026.2636752

Bhandari, A., Prasad, P. W. C., Alsadoon, A., & Maag, A. (2021). Object detection and recognition: using deep learning to assist the visually impaired. In Disability and Rehabilitation: Assistive Technology (Vol. 16, Number 3, pp. 280–288). Taylor and Francis Ltd. https://doi.org/10.1080/17483107.2019.1673834

Ferdiansyah, V., Sugiharto, T., & Priantama, R. (2024). Implementasi Augmented Reality Pada Materi Pembelajaran Fotosintesis Menggunakan Metode Kirsch Untuk Deteksi Marker. Buffer Informatika, 10(1), 11-19.

Garcia-Garcia, J. M., Penichet, V. M. R., Lozano, M. D., & Fernando, A. (2022). Using emotion recognition technologies to teach children with autism spectrum disorder how to identify and express emotions. Universal Access in the Information Society, 21(4), 809–825. https://doi.org/10.1007/s10209-021-00818-y

Ghasemi, Y., Jeong, H., Choi, S. H., Park, K. B., & Lee, J. Y. (2022). Deep learning-based object detection in augmented reality: A systematic review. In Computers in Industry (Vol. 139). Elsevier B.V. https://doi.org/10.1016/j.compind.2022.103661

Guillén-Martínez, D., Alcázar-Espinoza, J. A., Rámirez-Sánchez, I., Samaniego-Cobo, T., & Villacís-Macias, C. (2025). Policies, assistive technologies, and barriers in inclusive education: A global systematic review (2019-2024). Journal of Posthumanism, 5(2), 208-218.https://doi.org/10.63332/joph.v5i2.418

Høyland, A. L., Nærland, T., Engstrøm, M., Lydersen, S., & Andreassen, O. A. (2017). The relation between face-emotion recognition and social function in adolescents with autism spectrum disorders: A case control study. PLoS One, 12(10), e0186124. https://doi.org/10.1371/journal.pone.0186124

Katuk, N., Vergallo, R., & Sugiharto, T. (2024). The Future of Human-Computer Integration (1st ed.). CRC Press.

Lestari Giza Pudrianisa, S., Wening Astari, D., & Pela Agustina, D. (2024). CHANNEL: Jurnal Komunikasi Inclusive Disability Empowerment: Utilization of Digital Applications in Accessing Information for People With Disabilities. CHANNEL: Jurnal Komunikasi, 12(2), 143–151. https://doi.org/10.12928/channel

Mutia, F., & Cahyani, I. R. (2021). Assistive Technology to Enhance Access to Information for Student with Disabilities: A Case Study in Surabaya. Khizanah Al-Hikmah : Jurnal Ilmu Perpustakaan, Informasi, Dan Kearsipan, 9(1), 16. https://doi.org/10.24252/v9i1a3

Novantara, P., Sugiharto, T., & Nursyamsu, R. (2024). Pemanfaatan AI Ads untuk digital marketing produk UMKM di Desa Cimaranten Kuningan. Journal of Innovation and Sustainable Empowerment, 3(1), 56-62. https://doi.org/10.25134/jise.v1i2.96

Pieriboni, G., Buzzi, M., & Leporini, B. (2026). Stem education and ICT-enhanced tools for students with disabilities: a five-year review. Universal Access in the Information Society, 25(1), 3. https://doi.org/10.1007/s10209-025-01282-8

Syaharuddin, S., Pramita, D., & Sirajuddin, S. (2019). Pengenalan operasi tambah kurang melalui permainan congklak bagi siswa sekolah dasar. Jurnal Masyarakat Mandiri, 3(1), 01-06. http://journal.ummat.ac.id/index.php/jmm

Saabi, N., Chlioui, I., & Radgui, M. (2025). A review of assistive technology in special education. Engineering Proceedings, 112(1), 45. https://doi.org/10.3390/engproc2025112045

Simoes, W., Reis, L., Araujo, C., & Maia, J. (2024). Accuracy Assessment of 2D Pose Estimation with MediaPipe for Physiotherapy Exercises. Procedia Computer Science, 251, 446–453. https://doi.org/10.1016/j.procs.2024.11.132

Sugiharto, T., Jaelani, A. J., & Somantri, M. I. (2021). Pengenalan Dan Pemanfaatan Teknologi Informasi Berbasis Web Bagi Masyarakat Desa Cibinuang, Kuningan Provinsi Jawa Barat. Empowerment: Jurnal Pengabdian Masyarakat, 4(01), 104-110.

Sugiharto, T., Kom, S., & Eng, M. (2021). Pengolahan Citra Digital Menggunakan Proses Konvolusi. www.penerbitlitnus.co.id

Sugiharto, T., Kom, S., Eng, M., Drs, I., Saparudin, M. T., Wikky Fawwaz, E. I., & Maki, A. (2025). Pengolahan Citra Digital dan Deteksi Objek. PT Literasi Nusantara Abadi Grup. www.penerbitlitnus.co.id

Sugiharto, T., Priantama, R., Lesmana, I., Cahyawiguna, B., Apriah, L., & Yusuf, M. F. (2026). Pemberdayaan dan Penerapan Teknologi Pengenalan Emosi Anak Autisme Berbasis Deep Learning di SLBN Taruna Mandiri Kuningan. Abdimas Galuh, 8(1), 976-984.

DOI: https://doi.org/10.31764/jmm.v10i3.39442