IMPLEMENTASI ARTIFICIAL INTELLIGENCE MELALUI SPEECH-TO-TEXT SEBAGAI ALAT BANTU TUNARUNGU BERKOMUNIKASI

Efrans Firdaus

Abstract


As a reason for research based on the author's interview with one of the Special Assistant Teachers (GPK) of SLB B Tunas Harapan Karawang on Friday, November 10 2023, it was said that Deaf students experienced several obstacles in the areas of socialization, social interaction, communication and cooperation because they were still minimal in vocabulary, Difficulty interpreting words or sentences that contain figurative meaning, and Difficulty interpreting abstract words. The aim of the research is to make things easier when individuals experience limitations in communication, in this case they have problems with hearing abilities or are deaf, which creates their own obstacles to carrying out the social interaction process. The research method or approach based on previous researchers carried out on the ASL language translation system is that it is able to display letters resulting from data processing in the system onto an LCD contained in the 1Sheeld application. The research results are to find out the implementation of Speech-to-Text Software, how to initialize and record sound, testing variations in speaking speed, configuring the Speech-to-Text program with Raspberry Pi, testing the Speech-to-Text system, and implementing hardware in the Speech-to-Text subsystem. The conclusion of this research is to answer the problems faced by Deaf students at SLB B Tunas Harapan Karawang in communicating with normal people.

Keywords


ASL, Artificial Intelligence, NLP, Speech-to-Text, STT, Raspberry Pi.

Full Text:

PDF

References


Chen, Y., Li, Y., Liu, J., & Tan, C. W. (2020). Enhancing Speech-to-Text Technology for Deaf and Hard-of-Hearing People: A Field Study. *IEEE Access, 8*, 183918-183930. https://doi.org/10.1109/ACCESS.2020.3029836

Chmielewski, D., De-la-Torre, M., & Perez-Pinar, M. (2019). Improving Communication for the Deaf and Hard of Hearing with Automatic Speech Recognition. *Proceedings of the 2019 IEEE Global Humanitarian Technology Conference (GHTC)*, 1-6. https://doi.org/10.1109/GHTC46095.2019.9033013

Fellinger, J., Holzinger, D., & Pollard, R. (2012). Mental Health of Deaf People. *The Lancet, 379*(9820), 1037-1044. https://doi.org/10.1016/S0140-6736(11)61143-4

Geiger, L., & Bergmann, P. (2018). A Real-Time Speech-to-Text System for Deaf and Hard of Hearing Students. *Proceedings of the 2018 ACM Conference on Human Factors in Computing Systems (CHI)*, 1-6. https://doi.org/10.1145/3173574.3173768

Harris, M., & Mohay, H. (1997). Learning to Look in the Right Place: A Comparison of Attentional Behavior in Deaf and Hearing Children. *Journal of Deaf Studies and Deaf Education, 2*(2), 95-103. https://doi.org/10.1093/oxfordjournals.deafed.a014314

Juhola, M., & Pyykkö, I. (2005). Speech-to-Text Systems in Schools and the Quality of Their Transcriptions. *Computer Speech & Language, 19*(1), 41-60. https://doi.org/10.1016/j.csl.2004.02.002

Karam, M., & Russo, F. (2009). Speech-to-Text Communication System for the Deaf and Hard of Hearing. *Journal of Deaf Studies and Deaf Education, 14*(3), 401-411. https://doi.org/10.1093/deafed/enp006

Mehta, K., & Parikh, D. (2021). Artificial Intelligence in Education: Enhancing Communication for the Hearing Impaired. *International Journal of Educational Technology in Higher Education, 18*(1), 1-17. https://doi.org/10.1186/s41239-021-00274-8

Morris, M. R., & Paepcke, A. (2006). Designing a Speech-to-Text Interface for the Deaf: A Study of User Preferences. *Proceedings of the 2006 ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)*, 239-246. https://doi.org/10.1145/1168987.1169026

Rojas, D., & Capurro, M. (2015). Real-Time Speech-to-Text for Enhancing Communication in Classrooms for the Deaf. *Proceedings of the 2015 International Conference on Universal Access in Human-Computer Interaction (UAHCI)*, 129-137. https://doi.org/10.1007/978-3-319-20684-4_13

Scherer, M. J., & Federici, S. (2015). Why People Use and Don’t Use Technologies: Introduction to the Special Issue on Assistive Technologies for Cognition/Cognitive Support Technologies. *NeuroRehabilitation, 37*(3), 315-319. https://doi.org/10.3233/NRE-151264

Stinson, M. S., & Liu, Y. (1999). Deaf College Students' Perceptions of Communication in Mainstream Classes. *Journal of Deaf Studies and Deaf Education, 4*(4), 272-283. https://doi.org/10.1093/deafed/4.4.272

Williams, S. J., & Drigas, A. S. (2020). Speech-to-Text Technology and the Development of Communication Skills in Deaf Students. *International Journal of Emerging Technologies in Learning, 15*(11), 197-212. https://doi.org/10.3991/ijet.v15i11.13257

Zeng, F., & Galvin, J. J. (1999). Amplitude Mapping and Phoneme Recognition in Cochlear Implant Users. *Hearing Research, 139*(1-2), 56-64. https://doi.org/10.1016/S0378-5955(99)00128-8

Zhao, Y., & Chai, C. S. (2019). Exploring the Effectiveness of Speech-to-Text Recognition in Assisting Deaf Students’ Learning. *Journal of Computer Assisted Learning, 35*(1), 47-58. https://doi.org/10.1111/jcal.12311.




DOI: https://doi.org/10.31932/jutech.v5i2.3675

Article Metrics

Abstract view : 247 times
PDF - 716 times

Refbacks

  • There are currently no refbacks.


Copyright (c) 2024 JUTECH : Journal Education and Technology



Creative Commons License
JUTECH: Journal Education and Technology is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.