A Spoken Dialogue System for Navigation in Non-Immersive Virtual Environments

MDJ McNeill, H Sayers, S Wilson, P McKevitt

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

Navigation is the process by which people control their movement in virtual environments and is a core functional requirement for all virtual environment (VE) applications. Users require the ability to move, controlling orientation, direction of movement and speed, in order to achieve a particular goal within a VE. Navigation is rarely the end point in itself (which is typically interaction with the visual representations of data) but applications often place a high demand on navigation skills, which in turn means that a high level of support for navigation is required from the application. On desktop systems navigation in non-immersive systems is usually supported through the usual hardware devices of mouse and keyboard. Previous work by the authors shows that many users experience frustration when trying to perform even simple navigation tasks — users complain about getting lost,becoming disorientated and finding the interface ‘difficult to use’. In this paper we report on work in progress in exploiting natural language processing (NLP) technology to support navigation in non-immersive virtual environments. A multi-modal system has been developed which supports a range of high-level (spoken) navigation commands and indications are that spoken dialogue interaction is an effective alternative to mouse and keyboard interaction for many tasks. We conclude that multi-modal interaction, combining technologies such as NLP with mouse and keyboard may offer the most effective interaction with VEs and identify a number of areas where further work is necessary.
LanguageEnglish
Pages713-722
JournalComputer Graphics Forum
Volume21
Issue number4
DOIs
Publication statusPublished - Dec 2002

Fingerprint

Virtual reality
Navigation
Processing
Navigation systems
Hardware

Cite this

McNeill, MDJ ; Sayers, H ; Wilson, S ; McKevitt, P. / A Spoken Dialogue System for Navigation in Non-Immersive Virtual Environments. In: Computer Graphics Forum. 2002 ; Vol. 21, No. 4. pp. 713-722.
@article{47df33e5788d43e7ade461ecdacba5a1,
title = "A Spoken Dialogue System for Navigation in Non-Immersive Virtual Environments",
abstract = "Navigation is the process by which people control their movement in virtual environments and is a core functional requirement for all virtual environment (VE) applications. Users require the ability to move, controlling orientation, direction of movement and speed, in order to achieve a particular goal within a VE. Navigation is rarely the end point in itself (which is typically interaction with the visual representations of data) but applications often place a high demand on navigation skills, which in turn means that a high level of support for navigation is required from the application. On desktop systems navigation in non-immersive systems is usually supported through the usual hardware devices of mouse and keyboard. Previous work by the authors shows that many users experience frustration when trying to perform even simple navigation tasks — users complain about getting lost,becoming disorientated and finding the interface ‘difficult to use’. In this paper we report on work in progress in exploiting natural language processing (NLP) technology to support navigation in non-immersive virtual environments. A multi-modal system has been developed which supports a range of high-level (spoken) navigation commands and indications are that spoken dialogue interaction is an effective alternative to mouse and keyboard interaction for many tasks. We conclude that multi-modal interaction, combining technologies such as NLP with mouse and keyboard may offer the most effective interaction with VEs and identify a number of areas where further work is necessary.",
author = "MDJ McNeill and H Sayers and S Wilson and P McKevitt",
year = "2002",
month = "12",
doi = "10.1111/1467-8659.00629",
language = "English",
volume = "21",
pages = "713--722",
journal = "Computer Graphics Forum",
issn = "0167-7055",
number = "4",

}

A Spoken Dialogue System for Navigation in Non-Immersive Virtual Environments. / McNeill, MDJ; Sayers, H; Wilson, S; McKevitt, P.

In: Computer Graphics Forum, Vol. 21, No. 4, 12.2002, p. 713-722.

Research output: Contribution to journalArticle

TY - JOUR

T1 - A Spoken Dialogue System for Navigation in Non-Immersive Virtual Environments

AU - McNeill, MDJ

AU - Sayers, H

AU - Wilson, S

AU - McKevitt, P

PY - 2002/12

Y1 - 2002/12

N2 - Navigation is the process by which people control their movement in virtual environments and is a core functional requirement for all virtual environment (VE) applications. Users require the ability to move, controlling orientation, direction of movement and speed, in order to achieve a particular goal within a VE. Navigation is rarely the end point in itself (which is typically interaction with the visual representations of data) but applications often place a high demand on navigation skills, which in turn means that a high level of support for navigation is required from the application. On desktop systems navigation in non-immersive systems is usually supported through the usual hardware devices of mouse and keyboard. Previous work by the authors shows that many users experience frustration when trying to perform even simple navigation tasks — users complain about getting lost,becoming disorientated and finding the interface ‘difficult to use’. In this paper we report on work in progress in exploiting natural language processing (NLP) technology to support navigation in non-immersive virtual environments. A multi-modal system has been developed which supports a range of high-level (spoken) navigation commands and indications are that spoken dialogue interaction is an effective alternative to mouse and keyboard interaction for many tasks. We conclude that multi-modal interaction, combining technologies such as NLP with mouse and keyboard may offer the most effective interaction with VEs and identify a number of areas where further work is necessary.

AB - Navigation is the process by which people control their movement in virtual environments and is a core functional requirement for all virtual environment (VE) applications. Users require the ability to move, controlling orientation, direction of movement and speed, in order to achieve a particular goal within a VE. Navigation is rarely the end point in itself (which is typically interaction with the visual representations of data) but applications often place a high demand on navigation skills, which in turn means that a high level of support for navigation is required from the application. On desktop systems navigation in non-immersive systems is usually supported through the usual hardware devices of mouse and keyboard. Previous work by the authors shows that many users experience frustration when trying to perform even simple navigation tasks — users complain about getting lost,becoming disorientated and finding the interface ‘difficult to use’. In this paper we report on work in progress in exploiting natural language processing (NLP) technology to support navigation in non-immersive virtual environments. A multi-modal system has been developed which supports a range of high-level (spoken) navigation commands and indications are that spoken dialogue interaction is an effective alternative to mouse and keyboard interaction for many tasks. We conclude that multi-modal interaction, combining technologies such as NLP with mouse and keyboard may offer the most effective interaction with VEs and identify a number of areas where further work is necessary.

U2 - 10.1111/1467-8659.00629

DO - 10.1111/1467-8659.00629

M3 - Article

VL - 21

SP - 713

EP - 722

JO - Computer Graphics Forum

T2 - Computer Graphics Forum

JF - Computer Graphics Forum

SN - 0167-7055

IS - 4

ER -