Journal of Research in Rehabilitation Sciences

Designing a Serious Game for Speech Rehabilitation in Children with Speech Sound Disorder: A Feasibility Study

Document Type : Original Articles

Authors

1 MSc Student in Computer Arts (Computer Game Design), Department of Computer Science, School of Multimedia, Tabriz Islamic Art University, Tabriz, Iran

2 MSc in Speech Therapy, School of Rehabilitation, Zahedan University of Medical Sciences, Zahedan, Iran

3 Associate Professor, Department of Computer Science, School of Multimedia, Tabriz Islamic Art University, Tabriz, Iran

10.48305/jrrs.2023.41171.1010

Abstract

Introduction: This paper presents a serious game (SG) that helps children with speech disorders overcome their challenges in a fun and engaging way. The game utilizes speech recognition and speech-to-text technology, along with visual feedback, to provide a comfortable and interesting experience for the child. Additionally, the game can be used both in therapy sessions with a therapist and at home under supervision, with game results being recorded and sent to the therapist for analysis.
Materials and Methods: The game was developed using Unity 3D game engine. The game character and environment were designed using Agisoft Software and Autodesk 3D Max. Then, 10 game experts from the Faculty of Multimedia, including university professors and game design masters’ students, were asked to play the primary prototype of the game and complete a questionnaire. Based on our experts' opinions, we modified certain aspects of the game, such as improving visual feedback and smoothing out character movement.
Results: Of the 10 participants who played the game, 80% played flawlessly. The game was effective, but 20% of experts encountered technical issues with in-game functions. The problem was due to incompatibility with their system, so an alternative method was recommended and the issue was resolved.
Conclusion: According to the experts, the game has a promising future for use in clinics and the system may provide a beneficial rehabilitation platform for children with speech disorders. Further evaluations are required to achieve better results and confirm its efficiency.

Keywords

Main Subjects

  1. Dodd B. Differential diagnosis of pediatric speech sound disorder. Curr Dev Disord Rep 2014; 1(3): 189-96.
  2. Bernthal JE, Bankson NW, Flipsen P. Articulation and phonological disorders: Speech sound disorders in children. New York, NY: Pearson; 2017.
  3. Bonnechère B, Omelina L, Van Sint JS. Rehabilitation of neurologic patient using serious games, from theory to practice. Physiotherapy 2015; 101(1): e162-e163.
  4. Wilkinson P. A brief history of serious games. In: Dorner R, Gobel S, Kickmeier-Rust M, Masuch M, Zweig K, editors. Entertainment Computing and Serious Games: International GI-Dagstuhl Seminar 15283, Dagstuhl Castle, Germany, July 5-10, 2015, Revised Selected Papers. Cham, Switzerland: Springer International Publishing; 2016. p. 17-41.
  5. Dorner R, Gobel S, Effelsberg W, Wiemeyer J. Serious games: Foundations, concepts and practice. Cham, Switzerland: Springer International Publishing; 2016.
  6. Bonnechere B, Jansen B, Omelina L, Van Sint JS. The use of commercial video games in rehabilitation: A systematic review. Int J Rehabil Res 2016; 39(4): 277-90.
  7. Caserman P, Hoffmann K, Muller P, Schaub M, Strassburg K, Wiemeyer J, et al. Quality criteria for serious games: Serious part, game part, and balance. JMIR Serious Games 2020; 8(3): e19037.
  8. Nasiri N, Shirmohammadi S, Rashed A. A serious game for children with speech disorders and hearing problems. Proceedings of the 2017 IEEE 5th International Conference on Serious Games and Applications for Health (SeGAH); 2017 Apr 2-4; Perth WA, Australia.
  9. Shtern M, Haworth MB, Yunusova Y, Baljko M, Faloutsos P. A game system for speech rehabilitation. In: Kallmann M, Bekris K, editors. Motion in Games: 5th International Conference, MIG 2012, Rennes, France, November 15-17, 2012, Proceedings. Berlin, Heidelberg: Springer Berlin Heidelberg; 2012 p. 43-54.
  10. Haworth B, Kearney E, Baljko M, Faloutsos P, Yunusova Y. Electromagnetic articulography in the development of "serious games" for speech rehabilitation. Proceedings of the 2nd International Workshop on Biomechanical and Parametric Modeling of Human Anatomy (PMHA 2014); 2014 Aug 22-23; Vancouver, BC, Canada.
  11. Bernardini S, Porayska-Pomsta K, Smith T. ECHOES: An intelligent serious game for fostering social communication in children with autism. Inf Sci 2014; 264: 41-60.
  12. Boothroyd A, Hanin L, Yeung E, Qi-Yu C. Video-game for speech perception testing and training of young hearing-impaired children. Proceedings of the Johns Hopkins National Search for Computing Applications to Assist Persons with Disabilities; 1992 Feb 1-5; Laurel, MD, USA. p. 25-8.
  13. Ali Farshbaf Akbari N, Sekhavat YA, Azadedhfar M, Roohi S. Saray: A Solfege Learning Computer Game Based on Voice Analysis. J Res Rehabil Sci 2019; 15(4): 211-8. [In Persian].
  14. Frutos M, Bustos I, Zapirain BG, Zorrilla AM. Computer game to learn and enhance speech problems for children with autism. Proceedings of the 16th International Conference on Computer Games (CGAMES); 2011 July 27-30; Louisville, KY, USA.
  15. Navarro-Newball AA, Loaiza D, Oviedo C, Castillo A, Portilla A, Linares D, et al. Talking to Teo: Video game supported speech therapy. Entertain Comput 2014; 5(4): 401-12.
  16. Hair A, Monroe P, Ahmed B, Ballard K, Gutierrez-Osuna R. Apraxia world: A speech therapy game for children with speech sound disorders. Proceedings of the 17th ACM Conference on Interaction Design and Children (IDC '18); 2018 June 19-22; Trondheim Norway.
  17. Ahmed B, Monroe P, Hair A, Tan CT, Gutierrez-Osuna R, Ballard KJ. Speech-driven mobile games for speech therapy: User experiences and feasibility. Int J Speech Lang Pathol 2018; 20(6): 644-58.
  18. Little Bee Speech. Articulation Station [Game] [Online]. [cited 2023]; Available from: URL: http://littlebeespeech.com/articulation_station.php
  19. The Speech Bubble SLP. Pocket SLP’s Artic App [Online]. [cited 2022]; Available from: URL: https://www.thespeechbubbleslp.com/2012/12/pocket-slps-artic-app.html
  20. Smarty Ears [Online]. Available from: URL: https://www.smartyearsapps.com/smarty-ears-apps/
  21. Tactica Interactive. Tiga Talk Speech Therapy Games [Online]. [cited 2011]; Available from: URL: https://tactica.ca/project/tiga-talk-speech-therapy-games/
  22. Fujii S, Wan CY. The role of rhythm in speech and language rehabilitation: The SEP hypothesis. Front Hum Neurosci 2014; 8: 777.
  23. Calderon A, Ruiz M. A systematic literature review on serious games evaluation: An application to software project management. Comput Educ 2015; 87: 396-422.
  24. Abran A, Khelifi A, Suryn W, Seffah A. usability meanings and interpretations in ISO standards. Softw Qual J 2003; 11: 325-38.
  25. Garris R, Ahlers R, Driskell J. Games, Motivation, and learning: A research and practice model. Simul Gaming 2002; 33(4): 441-67.
  26. Yang X, Sadika E, Pratama G, Choi Y, Kim YK, Lee JY, et al. An analysis on serious games and stakeholders' needs for vocal training game development. Commun Sci Disord 2019; 24(3): 800-13.
  27. Mekler E, Bopp J, Tuch A, Opwis K. A systematic review of quantitative studies on the enjoyment of digital entertainment games. Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsApril 2014 Apr 26-May 1; Toronto, Canada.
Journal of Research in Rehabilitation Sciences
Volume 18, Issue 1
2022
Pages 84-91