Use of a Haptic Glove-Gaming Interface to Stimulate Kinaesthetic and Auditory Coordination in Blind Children


  • Abhishek Pillai PACE Junior Science College, Andheri


Gaming Interface, Blind, Haptic Feedback Glove, Deep Reinforcement Learning, 3D-Sound System, Data analysis


Gaming develops coordination,
problem-solving skills, quick movement and
manipulation making the youth more alert, swift in
reaction, for real-time decision making skills.
These are skills to be honed by the visually
impaired as they need them for survival. With 1.4
million blind children in the world, accounting for
70 million „blind-years‟, this platform aims at
improving their Hand-Sound coordination along
with all other tactile decision-making reflexes. This
platform, “Beyond Vision”, is a fast-paced brain
training environment that demands coordination of
motor skills, through a haptic-feedback glove, with
the sound dynamics in the virtual environment, to
enable coordinated decision making, use of
strategies, thus effectively increasing their
sensitivity to sound and touch. The blind are
extremely sensitive to interaural differences and
this has been utilised to create a computersimulated environment that helps them to orient
themselves to their surroundings. The primary
aspects of this application are the gaming interface
with a 3D sound system (for skill development) ,
the training-analysis system ( that lays focus on the
user‟s sensory ability) and the haptic glove, that
communicates with the game software, thus
creating an intuitive experience through tactile
feedback. To further serve the purpose of seamless
interaction between the digital and real world, the
game implements a combination of Reinforcement
and Imitation Learning, along with
a simple data analyser that tracks the individual‟s
progress, guiding him through the „levels‟. Once
implemented on a larger scale, even real-life
locations can be virtually modelled to emulate
specific situations.


World Health Organization (2020, 8

October). Blindness and Vision Impairment

Bourne R, Steinmetz J, Flaxman S, et al.,

Trends in prevalence of blindness and distance and

near vision impairment over 30 years: an analysis

for the Global Burden of Disease Study. Lancet

Glob Health. 2020.



Zhang, Wen. (2017). Surround by Sound:

A Review of Spatial Audio Recording and

Reproduction. Applied Sciences. 7.




Kammoun, Slim & Jouffrais, Christophe

& Guerreiro, Tiago & Nicolau, Hugo & Jorge,

Joaquim. (2012). Guiding Blind People with Haptic



National Federation of the Blind

(Minnesota)(2017)Regarding the Alarming

Shortage of Qualified Teachers of Blind Students

and Orientation and Mobility Professionals.


An Introduction to Deep Reinforcement

Learning (2018, 3 December). Authors:Vincent

Francois-Lavet, Peter Henderson, Riashat Islam,

Marc G. Bellemare, Joelle Pineau

Ahmed Hussein, Mohamed Medhat

Gaber, Eyad Elyan, and Chrisina Jayne. 2017.

Imitation Learning: A Survey of Learning

Methods. ACM Comput. Surv. 50, 2, Article 21

(June 2017), 35 pages. DOI:


Jafari N, Adams KD, Tavakoli M. Haptics

to improve task performance in people with

disabilities: A review of previous studies and a

guide to future research with children with

disabilities. Journal of Rehabilitation and Assistive

Technologies Engineering. January 2016.


Unity Technologies(2020)

Ardity(Daniel Wilches)

Mikulcik, Simon D., "Application of

Neural Networks for Intelligent Video Game

Character Artificial Intelligences" (2016). Honors

Theses. 367.

Unity Documentation(2020) Scripting

API: Physics.Raycast


Proximal Policy Optimization (2017, 20

July) Authors:John Schulman, Oleg Klimov, Filip

Wolski, Prafulla Dhariwal, Alec Radford

The Benefits of Playing Video

Games(2014). Authors: Isabela Granic, Adam

iJournals: International Journal of Software & Hardware Research in Engineering (IJSHRE)


Volume 9 Issue 5 May 2021

© 2021, iJournals All Rights Reserved

© 2020, iJournals All Rights Reserved

Page 106

Lobel, and Rutger C. M. E. Engels-Radboud

University Nijmegen


Virtual Environmental Enrichment

through Video Games Improves HippocampalAssociated Memory. Authors: Gregory D.

Clemenson, Craig E.L. Stark. Journal of

Neuroscience 9 December 2015, 35 (49) 16116-

; DOI: 10.1523/JNEUROSCI.2580-15.2015


Fritzing(v 0.94)( 2019, 1 November)

Comparative Study of Touch Perception

in Normal and Blind People Dr.Aishwaryah

Ravisankar., Dr.M.P.Brundha (2016)


Brain Rewires Itself to Enhance Other

Senses in Blind People(2017, 22 March) Massachusetts Eye and

Ear Infirmary




How to Cite

Abhishek Pillai. (2021). Use of a Haptic Glove-Gaming Interface to Stimulate Kinaesthetic and Auditory Coordination in Blind Children. iJournals:International Journal of Software & Hardware Research in Engineering ISSN:2347-4890, 9(5). Retrieved from