Use of a Haptic Glove-Gaming Interface to Stimulate Kinaesthetic and Auditory Coordination in Blind Children

Authors

  • Abhishek Pillai PACE Junior Science College, Andheri

Keywords:

Gaming Interface, Blind, Haptic Feedback Glove, Deep Reinforcement Learning, 3D-Sound System, Data analysis

Abstract

Gaming develops coordination,
problem-solving skills, quick movement and
manipulation making the youth more alert, swift in
reaction, for real-time decision making skills.
These are skills to be honed by the visually
impaired as they need them for survival. With 1.4
million blind children in the world, accounting for
70 million „blind-years‟, this platform aims at
improving their Hand-Sound coordination along
with all other tactile decision-making reflexes. This
platform, “Beyond Vision”, is a fast-paced brain
training environment that demands coordination of
motor skills, through a haptic-feedback glove, with
the sound dynamics in the virtual environment, to
enable coordinated decision making, use of
strategies, thus effectively increasing their
sensitivity to sound and touch. The blind are
extremely sensitive to interaural differences and
this has been utilised to create a computersimulated environment that helps them to orient
themselves to their surroundings. The primary
aspects of this application are the gaming interface
with a 3D sound system (for skill development) ,
the training-analysis system ( that lays focus on the
user‟s sensory ability) and the haptic glove, that
communicates with the game software, thus
creating an intuitive experience through tactile
feedback. To further serve the purpose of seamless
interaction between the digital and real world, the
game implements a combination of Reinforcement
and Imitation Learning, along with
a simple data analyser that tracks the individual‟s
progress, guiding him through the „levels‟. Once
implemented on a larger scale, even real-life
locations can be virtually modelled to emulate
specific situations.

References

World Health Organization (2020, 8

October). Blindness and Vision Impairment

https://www.who.int/news-room/factsheets/detail/blindness-and-visual-impairment

Bourne R, Steinmetz J, Flaxman S, et al.,

Trends in prevalence of blindness and distance and

near vision impairment over 30 years: an analysis

for the Global Burden of Disease Study. Lancet

Glob Health. 2020.

https://www.iapb.org/learn/visionatlas/#:~:text=1.1%20billion%20people%20live%2

with,%2D%20and%20middle%2Dincome%20cou

ntries.

Zhang, Wen. (2017). Surround by Sound:

A Review of Spatial Audio Recording and

Reproduction. Applied Sciences. 7.

3390/app7050532.

https://www.researchgate.net/publication/31703652

_Surround_by_Sound_A_Review_of_Spatial_Au

dio_Recording_and_Reproduction

Kammoun, Slim & Jouffrais, Christophe

& Guerreiro, Tiago & Nicolau, Hugo & Jorge,

Joaquim. (2012). Guiding Blind People with Haptic

Feedback.

https://www.researchgate.net/publication/23500543

_Guiding_Blind_People_with_Haptic_Feedback

National Federation of the Blind

(Minnesota)(2017)Regarding the Alarming

Shortage of Qualified Teachers of Blind Students

and Orientation and Mobility Professionals.

https://www.nfbmn.org/about/resolutions/

A2017-04

An Introduction to Deep Reinforcement

Learning (2018, 3 December). Authors:Vincent

Francois-Lavet, Peter Henderson, Riashat Islam,

Marc G. Bellemare, Joelle Pineau

https://arxiv.org/abs/1811.12560

Ahmed Hussein, Mohamed Medhat

Gaber, Eyad Elyan, and Chrisina Jayne. 2017.

Imitation Learning: A Survey of Learning

Methods. ACM Comput. Surv. 50, 2, Article 21

(June 2017), 35 pages. DOI:

https://doi.org/10.1145/3054912

Arduino(2020)

https://www.arduino.cc/

Jafari N, Adams KD, Tavakoli M. Haptics

to improve task performance in people with

disabilities: A review of previous studies and a

guide to future research with children with

disabilities. Journal of Rehabilitation and Assistive

Technologies Engineering. January 2016.

doi:10.1177/2055668316668147

Unity Technologies(2020)

https://unity.com/

Ardity(Daniel Wilches)

https://ardity.dwilches.com/

Mikulcik, Simon D., "Application of

Neural Networks for Intelligent Video Game

Character Artificial Intelligences" (2016). Honors

Theses. 367.

https://encompass.eku.edu/honors_theses/367

Unity Documentation(2020) Scripting

API: Physics.Raycast

https://docs.unity3d.com/2020.2/Documen

tation/ScriptReference/Physics.Raycast.html

Proximal Policy Optimization (2017, 20

July) Authors:John Schulman, Oleg Klimov, Filip

Wolski, Prafulla Dhariwal, Alec Radford

https://openai.com/blog/openai-baselinesppo/

The Benefits of Playing Video

Games(2014). Authors: Isabela Granic, Adam

iJournals: International Journal of Software & Hardware Research in Engineering (IJSHRE)

ISSN-2347-4890

Volume 9 Issue 5 May 2021

© 2021, iJournals All Rights Reserved www.ijournals.in

© 2020, iJournals All Rights Reserved www.ijournals.in

Page 106

Lobel, and Rutger C. M. E. Engels-Radboud

University Nijmegen

https://www.apa.org/pubs/journals/release

s/amp-a0034857.pdf

Virtual Environmental Enrichment

through Video Games Improves HippocampalAssociated Memory. Authors: Gregory D.

Clemenson, Craig E.L. Stark. Journal of

Neuroscience 9 December 2015, 35 (49) 16116-

; DOI: 10.1523/JNEUROSCI.2580-15.2015

https://www.jneurosci.org/content/35/49/1

/tab-article-info

Fritzing(v 0.94)( 2019, 1 November)

https://fritzing.org/

Comparative Study of Touch Perception

in Normal and Blind People Dr.Aishwaryah

Ravisankar., Dr.M.P.Brundha (2016)

https://www.jpsr.pharmainfo.in/Document

s/Volumes/vol8Issue11/jpsr08111608.pdf

Brain Rewires Itself to Enhance Other

Senses in Blind People(2017, 22 March)

https://neurosciencenews.com/brain-rewiringsenses-blind-6276/Source: Massachusetts Eye and

Ear Infirmary

Downloads

Published

2021-06-01

How to Cite

Abhishek Pillai. (2021). Use of a Haptic Glove-Gaming Interface to Stimulate Kinaesthetic and Auditory Coordination in Blind Children. iJournals:International Journal of Software & Hardware Research in Engineering ISSN:2347-4890, 9(5). Retrieved from https://ijournals.in/journal/index.php/ijshre/article/view/22