A Hindi Virtual Keyboard Interface with Multimodal Feedback: A Case Study with a Dyslexic Child

Yogesh Kumar Meena, Anirban Chowdhury, Ujjwal Sharma, Hubert Cecotti, Braj Bhushan, Ashish Dutta, Girijesh Prasad

Research output: Contribution to conferencePaper

Abstract

Up to 15% of the Indian school-going children suffer from dyslexia. This paper aims to determine the extent to which existing knowledge about the eye-tracking based human-computer interface can be used to assist these children in their reading and writing activities. A virtual keyboard system with multimodal feedback is proposed and designed for a lexically and structurally complex language and optimized for multimodal feedback involving several portable, non-invasive, and low-cost input devices: a touch screen, an eye-tracker, and a soft-switch. The performance was evaluated in terms of text-entry rate, information transfer rate, and type of errors with three different experimental conditions: 1) touch-screen condition with auditory feedback 2) eye-tracking condition with auditory and visual feedback, and 3) eye-tracking and soft-switch condition with auditory and visual feedback. The proposed multimodal feedback has shown a significant improvement in text-entry rate with less error. This work represents the first virtual keyboard with multimodal feedback for dyslexic children in the Hindi language, which can be extended to other languages.

Conference

Conference32nd Human Computer Interaction Conference 02-06 JULY BELFAST, NORTHERN IRELAND 2018
CountryUnited Kingdom
CityBelfast
Period2/07/186/07/18
Internet address

Fingerprint

Feedback
Touch screens
Switches
Interfaces (computer)
Costs

Keywords

  • Graphical user interface; eye-tracking; multimodal feedback; dyslexia.

Cite this

Meena, Y. K., Chowdhury, A., Sharma, U., Cecotti, H., Bhushan, B., Dutta, A., & Prasad, G. (2018). A Hindi Virtual Keyboard Interface with Multimodal Feedback: A Case Study with a Dyslexic Child. Paper presented at 32nd Human Computer Interaction Conference 02-06 JULY BELFAST, NORTHERN IRELAND 2018, Belfast, United Kingdom.
Meena, Yogesh Kumar ; Chowdhury, Anirban ; Sharma, Ujjwal ; Cecotti, Hubert ; Bhushan, Braj ; Dutta, Ashish ; Prasad, Girijesh. / A Hindi Virtual Keyboard Interface with Multimodal Feedback: A Case Study with a Dyslexic Child. Paper presented at 32nd Human Computer Interaction Conference 02-06 JULY BELFAST, NORTHERN IRELAND 2018, Belfast, United Kingdom.5 p.
@conference{197dd15436204877a9a44ecf329d0364,
title = "A Hindi Virtual Keyboard Interface with Multimodal Feedback: A Case Study with a Dyslexic Child",
abstract = "Up to 15{\%} of the Indian school-going children suffer from dyslexia. This paper aims to determine the extent to which existing knowledge about the eye-tracking based human-computer interface can be used to assist these children in their reading and writing activities. A virtual keyboard system with multimodal feedback is proposed and designed for a lexically and structurally complex language and optimized for multimodal feedback involving several portable, non-invasive, and low-cost input devices: a touch screen, an eye-tracker, and a soft-switch. The performance was evaluated in terms of text-entry rate, information transfer rate, and type of errors with three different experimental conditions: 1) touch-screen condition with auditory feedback 2) eye-tracking condition with auditory and visual feedback, and 3) eye-tracking and soft-switch condition with auditory and visual feedback. The proposed multimodal feedback has shown a significant improvement in text-entry rate with less error. This work represents the first virtual keyboard with multimodal feedback for dyslexic children in the Hindi language, which can be extended to other languages.",
keywords = "Graphical user interface; eye-tracking; multimodal feedback; dyslexia.",
author = "Meena, {Yogesh Kumar} and Anirban Chowdhury and Ujjwal Sharma and Hubert Cecotti and Braj Bhushan and Ashish Dutta and Girijesh Prasad",
year = "2018",
month = "7",
day = "2",
language = "English",
note = "32nd Human Computer Interaction Conference 02-06 JULY BELFAST, NORTHERN IRELAND 2018 ; Conference date: 02-07-2018 Through 06-07-2018",
url = "http://hci2018.bcs.org/",

}

Meena, YK, Chowdhury, A, Sharma, U, Cecotti, H, Bhushan, B, Dutta, A & Prasad, G 2018, 'A Hindi Virtual Keyboard Interface with Multimodal Feedback: A Case Study with a Dyslexic Child' Paper presented at 32nd Human Computer Interaction Conference 02-06 JULY BELFAST, NORTHERN IRELAND 2018, Belfast, United Kingdom, 2/07/18 - 6/07/18, .

A Hindi Virtual Keyboard Interface with Multimodal Feedback: A Case Study with a Dyslexic Child. / Meena, Yogesh Kumar; Chowdhury, Anirban; Sharma, Ujjwal ; Cecotti, Hubert ; Bhushan, Braj; Dutta, Ashish; Prasad, Girijesh.

2018. Paper presented at 32nd Human Computer Interaction Conference 02-06 JULY BELFAST, NORTHERN IRELAND 2018, Belfast, United Kingdom.

Research output: Contribution to conferencePaper

TY - CONF

T1 - A Hindi Virtual Keyboard Interface with Multimodal Feedback: A Case Study with a Dyslexic Child

AU - Meena, Yogesh Kumar

AU - Chowdhury, Anirban

AU - Sharma, Ujjwal

AU - Cecotti, Hubert

AU - Bhushan, Braj

AU - Dutta, Ashish

AU - Prasad, Girijesh

PY - 2018/7/2

Y1 - 2018/7/2

N2 - Up to 15% of the Indian school-going children suffer from dyslexia. This paper aims to determine the extent to which existing knowledge about the eye-tracking based human-computer interface can be used to assist these children in their reading and writing activities. A virtual keyboard system with multimodal feedback is proposed and designed for a lexically and structurally complex language and optimized for multimodal feedback involving several portable, non-invasive, and low-cost input devices: a touch screen, an eye-tracker, and a soft-switch. The performance was evaluated in terms of text-entry rate, information transfer rate, and type of errors with three different experimental conditions: 1) touch-screen condition with auditory feedback 2) eye-tracking condition with auditory and visual feedback, and 3) eye-tracking and soft-switch condition with auditory and visual feedback. The proposed multimodal feedback has shown a significant improvement in text-entry rate with less error. This work represents the first virtual keyboard with multimodal feedback for dyslexic children in the Hindi language, which can be extended to other languages.

AB - Up to 15% of the Indian school-going children suffer from dyslexia. This paper aims to determine the extent to which existing knowledge about the eye-tracking based human-computer interface can be used to assist these children in their reading and writing activities. A virtual keyboard system with multimodal feedback is proposed and designed for a lexically and structurally complex language and optimized for multimodal feedback involving several portable, non-invasive, and low-cost input devices: a touch screen, an eye-tracker, and a soft-switch. The performance was evaluated in terms of text-entry rate, information transfer rate, and type of errors with three different experimental conditions: 1) touch-screen condition with auditory feedback 2) eye-tracking condition with auditory and visual feedback, and 3) eye-tracking and soft-switch condition with auditory and visual feedback. The proposed multimodal feedback has shown a significant improvement in text-entry rate with less error. This work represents the first virtual keyboard with multimodal feedback for dyslexic children in the Hindi language, which can be extended to other languages.

KW - Graphical user interface; eye-tracking; multimodal feedback; dyslexia.

UR - https://www.researchgate.net/publication/326462709_A_Hindi_Virtual_Keyboard_Interface_with_Multimodal_Feedback_A_Case_Study_with_a_Dyslexic_Child

M3 - Paper

ER -

Meena YK, Chowdhury A, Sharma U, Cecotti H, Bhushan B, Dutta A et al. A Hindi Virtual Keyboard Interface with Multimodal Feedback: A Case Study with a Dyslexic Child. 2018. Paper presented at 32nd Human Computer Interaction Conference 02-06 JULY BELFAST, NORTHERN IRELAND 2018, Belfast, United Kingdom.