A Hindi Virtual Keyboard Interface with Multimodal Feedback: A Case Study with a Dyslexic Child

Yogesh Kumar Meena, Anirban Chowdhury, Ujjwal Sharma, Hubert Cecotti, Braj Bhushan, Ashish Dutta, Girijesh Prasad

Research output: Contribution to conferencePaper

19 Downloads (Pure)

Abstract

Up to 15% of the Indian school-going children suffer from dyslexia. This paper aims to determine the extent to which existing knowledge about the eye-tracking based human-computer interface can be used to assist these children in their reading and writing activities. A virtual keyboard system with multimodal feedback is proposed and designed for a lexically and structurally complex language and optimized for multimodal feedback involving several portable, non-invasive, and low-cost input devices: a touch screen, an eye-tracker, and a soft-switch. The performance was evaluated in terms of text-entry rate, information transfer rate, and type of errors with three different experimental conditions: 1) touch-screen condition with auditory feedback 2) eye-tracking condition with auditory and visual feedback, and 3) eye-tracking and soft-switch condition with auditory and visual feedback. The proposed multimodal feedback has shown a significant improvement in text-entry rate with less error. This work represents the first virtual keyboard with multimodal feedback for dyslexic children in the Hindi language, which can be extended to other languages.

Original languageEnglish
Number of pages5
Publication statusPublished - 2 Jul 2018
Event32nd Human Computer Interaction Conference 02-06 JULY BELFAST, NORTHERN IRELAND 2018 - Belfast, United Kingdom
Duration: 2 Jul 20186 Jul 2018
http://hci2018.bcs.org/

Conference

Conference32nd Human Computer Interaction Conference 02-06 JULY BELFAST, NORTHERN IRELAND 2018
CountryUnited Kingdom
CityBelfast
Period2/07/186/07/18
Internet address

Keywords

  • Graphical user interface; eye-tracking; multimodal feedback; dyslexia.

Fingerprint Dive into the research topics of 'A Hindi Virtual Keyboard Interface with Multimodal Feedback: A Case Study with a Dyslexic Child'. Together they form a unique fingerprint.

  • Cite this

    Meena, Y. K., Chowdhury, A., Sharma, U., Cecotti, H., Bhushan, B., Dutta, A., & Prasad, G. (2018). A Hindi Virtual Keyboard Interface with Multimodal Feedback: A Case Study with a Dyslexic Child. Paper presented at 32nd Human Computer Interaction Conference 02-06 JULY BELFAST, NORTHERN IRELAND 2018, Belfast, United Kingdom.