Use of a Haptic Glove-Gaming Interface to Stimulate Kinaesthetic and Auditory Coordination in Blind Children
Keywords:
Gaming Interface, Blind, Haptic Feedback Glove, Deep Reinforcement Learning, 3D-Sound System, Data analysisAbstract
Gaming develops coordination,
problem-solving skills, quick movement and
manipulation making the youth more alert, swift in
reaction, for real-time decision making skills.
These are skills to be honed by the visually
impaired as they need them for survival. With 1.4
million blind children in the world, accounting for
70 million „blind-years‟, this platform aims at
improving their Hand-Sound coordination along
with all other tactile decision-making reflexes. This
platform, “Beyond Vision”, is a fast-paced brain
training environment that demands coordination of
motor skills, through a haptic-feedback glove, with
the sound dynamics in the virtual environment, to
enable coordinated decision making, use of
strategies, thus effectively increasing their
sensitivity to sound and touch. The blind are
extremely sensitive to interaural differences and
this has been utilised to create a computersimulated environment that helps them to orient
themselves to their surroundings. The primary
aspects of this application are the gaming interface
with a 3D sound system (for skill development) ,
the training-analysis system ( that lays focus on the
user‟s sensory ability) and the haptic glove, that
communicates with the game software, thus
creating an intuitive experience through tactile
feedback. To further serve the purpose of seamless
interaction between the digital and real world, the
game implements a combination of Reinforcement
and Imitation Learning, along with
a simple data analyser that tracks the individual‟s
progress, guiding him through the „levels‟. Once
implemented on a larger scale, even real-life
locations can be virtually modelled to emulate
specific situations.
References
World Health Organization (2020, 8
October). Blindness and Vision Impairment
https://www.who.int/news-room/factsheets/detail/blindness-and-visual-impairment
Bourne R, Steinmetz J, Flaxman S, et al.,
Trends in prevalence of blindness and distance and
near vision impairment over 30 years: an analysis
for the Global Burden of Disease Study. Lancet
Glob Health. 2020.
https://www.iapb.org/learn/visionatlas/#:~:text=1.1%20billion%20people%20live%2
with,%2D%20and%20middle%2Dincome%20cou
ntries.
Zhang, Wen. (2017). Surround by Sound:
A Review of Spatial Audio Recording and
Reproduction. Applied Sciences. 7.
3390/app7050532.
https://www.researchgate.net/publication/31703652
_Surround_by_Sound_A_Review_of_Spatial_Au
dio_Recording_and_Reproduction
Kammoun, Slim & Jouffrais, Christophe
& Guerreiro, Tiago & Nicolau, Hugo & Jorge,
Joaquim. (2012). Guiding Blind People with Haptic
Feedback.
https://www.researchgate.net/publication/23500543
_Guiding_Blind_People_with_Haptic_Feedback
National Federation of the Blind
(Minnesota)(2017)Regarding the Alarming
Shortage of Qualified Teachers of Blind Students
and Orientation and Mobility Professionals.
https://www.nfbmn.org/about/resolutions/
A2017-04
An Introduction to Deep Reinforcement
Learning (2018, 3 December). Authors:Vincent
Francois-Lavet, Peter Henderson, Riashat Islam,
Marc G. Bellemare, Joelle Pineau
https://arxiv.org/abs/1811.12560
Ahmed Hussein, Mohamed Medhat
Gaber, Eyad Elyan, and Chrisina Jayne. 2017.
Imitation Learning: A Survey of Learning
Methods. ACM Comput. Surv. 50, 2, Article 21
(June 2017), 35 pages. DOI:
https://doi.org/10.1145/3054912
Arduino(2020)
Jafari N, Adams KD, Tavakoli M. Haptics
to improve task performance in people with
disabilities: A review of previous studies and a
guide to future research with children with
disabilities. Journal of Rehabilitation and Assistive
Technologies Engineering. January 2016.
doi:10.1177/2055668316668147
Unity Technologies(2020)
Ardity(Daniel Wilches)
Mikulcik, Simon D., "Application of
Neural Networks for Intelligent Video Game
Character Artificial Intelligences" (2016). Honors
Theses. 367.
https://encompass.eku.edu/honors_theses/367
Unity Documentation(2020) Scripting
API: Physics.Raycast
https://docs.unity3d.com/2020.2/Documen
tation/ScriptReference/Physics.Raycast.html
Proximal Policy Optimization (2017, 20
July) Authors:John Schulman, Oleg Klimov, Filip
Wolski, Prafulla Dhariwal, Alec Radford
https://openai.com/blog/openai-baselinesppo/
The Benefits of Playing Video
Games(2014). Authors: Isabela Granic, Adam
iJournals: International Journal of Software & Hardware Research in Engineering (IJSHRE)
ISSN-2347-4890
Volume 9 Issue 5 May 2021
© 2021, iJournals All Rights Reserved www.ijournals.in
© 2020, iJournals All Rights Reserved www.ijournals.in
Page 106
Lobel, and Rutger C. M. E. Engels-Radboud
University Nijmegen
https://www.apa.org/pubs/journals/release
s/amp-a0034857.pdf
Virtual Environmental Enrichment
through Video Games Improves HippocampalAssociated Memory. Authors: Gregory D.
Clemenson, Craig E.L. Stark. Journal of
Neuroscience 9 December 2015, 35 (49) 16116-
; DOI: 10.1523/JNEUROSCI.2580-15.2015
https://www.jneurosci.org/content/35/49/1
/tab-article-info
Fritzing(v 0.94)( 2019, 1 November)
Comparative Study of Touch Perception
in Normal and Blind People Dr.Aishwaryah
Ravisankar., Dr.M.P.Brundha (2016)
https://www.jpsr.pharmainfo.in/Document
s/Volumes/vol8Issue11/jpsr08111608.pdf
Brain Rewires Itself to Enhance Other
Senses in Blind People(2017, 22 March)
https://neurosciencenews.com/brain-rewiringsenses-blind-6276/Source: Massachusetts Eye and
Ear Infirmary