CHAMELEON meets spatial cognition

P McKevitt

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

Intelligent MultiMedia (IntelliMedia) focusses on the computer processing and understanding of input from at least speech, text and visual images in terms of semantic representations. We have developed a general suite of tools in the form of a software and hardware platform called CHAMELEON that can be tailored to conducting IntelliMedia in various application domains. CHAMELEON has an open distributed processing architecture and currently includes ten agent modules: blackboard, dialogue manager, domain model, gesture recogniser, laser system, microphone array, speech recogniser, speech synthesiser, natural language processor, and a distributed Topsy learner. Modules can communicate with each other and the blackboard which keeps a record of interactions over time via semantic representations in frames. Inputs to CHAMELEON can include synchronised spoken dialogue and images and outputs include synchronised laser pointing and spoken dialogue. An initial prototype application of CHAMELEON is an IntelliMedia WorkBench where a user can ask for information about things (e.g. 2D/3D models, pictures, objects, gadgets, people, or whatever) on a physical table. The current domain is a Campus Information System for 2D building plans which provides information about tenants, rooms and routes and can answer questions like ``Whose office is this?'' and ``Show me the route from Paul Mc Kevitt's office to Paul Dalsgaard's office.'' in real time. Projective spatial relations are expected to occur often with the IntelliMedia WorkBench and Campus Information System and we give here a worked example of how the query ``Who's in the office beside him?'' is processed by the frame semantics, showing all frames appearing on the blackboard. CHAMELEON and the IntelliMedia WorkBench are ideal for testing integrated signal and symbol processing of spatial cognition, language and vision for the future of SuperinformationhighwayS.
LanguageEnglish
Title of host publicationSpatial cognition: Foundations and Applications
EditorsS O Nuallain
Place of PublicationAmsterdam, The Netherlands
Pages149-170
Volume26
Publication statusPublished - Dec 2000

Fingerprint

Semantics
Information systems
Processing
Lasers
Microphones
Managers
Hardware
Testing

Cite this

McKevitt, P. (2000). CHAMELEON meets spatial cognition. In S. O Nuallain (Ed.), Spatial cognition: Foundations and Applications (Vol. 26, pp. 149-170). Amsterdam, The Netherlands.
McKevitt, P. / CHAMELEON meets spatial cognition. Spatial cognition: Foundations and Applications. editor / S O Nuallain. Vol. 26 Amsterdam, The Netherlands, 2000. pp. 149-170
@inbook{6c30346cca23415c9c82069a542cc378,
title = "CHAMELEON meets spatial cognition",
abstract = "Intelligent MultiMedia (IntelliMedia) focusses on the computer processing and understanding of input from at least speech, text and visual images in terms of semantic representations. We have developed a general suite of tools in the form of a software and hardware platform called CHAMELEON that can be tailored to conducting IntelliMedia in various application domains. CHAMELEON has an open distributed processing architecture and currently includes ten agent modules: blackboard, dialogue manager, domain model, gesture recogniser, laser system, microphone array, speech recogniser, speech synthesiser, natural language processor, and a distributed Topsy learner. Modules can communicate with each other and the blackboard which keeps a record of interactions over time via semantic representations in frames. Inputs to CHAMELEON can include synchronised spoken dialogue and images and outputs include synchronised laser pointing and spoken dialogue. An initial prototype application of CHAMELEON is an IntelliMedia WorkBench where a user can ask for information about things (e.g. 2D/3D models, pictures, objects, gadgets, people, or whatever) on a physical table. The current domain is a Campus Information System for 2D building plans which provides information about tenants, rooms and routes and can answer questions like ``Whose office is this?'' and ``Show me the route from Paul Mc Kevitt's office to Paul Dalsgaard's office.'' in real time. Projective spatial relations are expected to occur often with the IntelliMedia WorkBench and Campus Information System and we give here a worked example of how the query ``Who's in the office beside him?'' is processed by the frame semantics, showing all frames appearing on the blackboard. CHAMELEON and the IntelliMedia WorkBench are ideal for testing integrated signal and symbol processing of spatial cognition, language and vision for the future of SuperinformationhighwayS.",
author = "P McKevitt",
year = "2000",
month = "12",
language = "English",
isbn = "978-90-272-5146-6 (EUR)/ 978-1-55619-842-7 (US)",
volume = "26",
pages = "149--170",
editor = "{O Nuallain}, S",
booktitle = "Spatial cognition: Foundations and Applications",

}

McKevitt, P 2000, CHAMELEON meets spatial cognition. in S O Nuallain (ed.), Spatial cognition: Foundations and Applications. vol. 26, Amsterdam, The Netherlands, pp. 149-170.

CHAMELEON meets spatial cognition. / McKevitt, P.

Spatial cognition: Foundations and Applications. ed. / S O Nuallain. Vol. 26 Amsterdam, The Netherlands, 2000. p. 149-170.

Research output: Chapter in Book/Report/Conference proceedingChapter

TY - CHAP

T1 - CHAMELEON meets spatial cognition

AU - McKevitt, P

PY - 2000/12

Y1 - 2000/12

N2 - Intelligent MultiMedia (IntelliMedia) focusses on the computer processing and understanding of input from at least speech, text and visual images in terms of semantic representations. We have developed a general suite of tools in the form of a software and hardware platform called CHAMELEON that can be tailored to conducting IntelliMedia in various application domains. CHAMELEON has an open distributed processing architecture and currently includes ten agent modules: blackboard, dialogue manager, domain model, gesture recogniser, laser system, microphone array, speech recogniser, speech synthesiser, natural language processor, and a distributed Topsy learner. Modules can communicate with each other and the blackboard which keeps a record of interactions over time via semantic representations in frames. Inputs to CHAMELEON can include synchronised spoken dialogue and images and outputs include synchronised laser pointing and spoken dialogue. An initial prototype application of CHAMELEON is an IntelliMedia WorkBench where a user can ask for information about things (e.g. 2D/3D models, pictures, objects, gadgets, people, or whatever) on a physical table. The current domain is a Campus Information System for 2D building plans which provides information about tenants, rooms and routes and can answer questions like ``Whose office is this?'' and ``Show me the route from Paul Mc Kevitt's office to Paul Dalsgaard's office.'' in real time. Projective spatial relations are expected to occur often with the IntelliMedia WorkBench and Campus Information System and we give here a worked example of how the query ``Who's in the office beside him?'' is processed by the frame semantics, showing all frames appearing on the blackboard. CHAMELEON and the IntelliMedia WorkBench are ideal for testing integrated signal and symbol processing of spatial cognition, language and vision for the future of SuperinformationhighwayS.

AB - Intelligent MultiMedia (IntelliMedia) focusses on the computer processing and understanding of input from at least speech, text and visual images in terms of semantic representations. We have developed a general suite of tools in the form of a software and hardware platform called CHAMELEON that can be tailored to conducting IntelliMedia in various application domains. CHAMELEON has an open distributed processing architecture and currently includes ten agent modules: blackboard, dialogue manager, domain model, gesture recogniser, laser system, microphone array, speech recogniser, speech synthesiser, natural language processor, and a distributed Topsy learner. Modules can communicate with each other and the blackboard which keeps a record of interactions over time via semantic representations in frames. Inputs to CHAMELEON can include synchronised spoken dialogue and images and outputs include synchronised laser pointing and spoken dialogue. An initial prototype application of CHAMELEON is an IntelliMedia WorkBench where a user can ask for information about things (e.g. 2D/3D models, pictures, objects, gadgets, people, or whatever) on a physical table. The current domain is a Campus Information System for 2D building plans which provides information about tenants, rooms and routes and can answer questions like ``Whose office is this?'' and ``Show me the route from Paul Mc Kevitt's office to Paul Dalsgaard's office.'' in real time. Projective spatial relations are expected to occur often with the IntelliMedia WorkBench and Campus Information System and we give here a worked example of how the query ``Who's in the office beside him?'' is processed by the frame semantics, showing all frames appearing on the blackboard. CHAMELEON and the IntelliMedia WorkBench are ideal for testing integrated signal and symbol processing of spatial cognition, language and vision for the future of SuperinformationhighwayS.

M3 - Chapter

SN - 978-90-272-5146-6 (EUR)/ 978-1-55619-842-7 (US)

VL - 26

SP - 149

EP - 170

BT - Spatial cognition: Foundations and Applications

A2 - O Nuallain, S

CY - Amsterdam, The Netherlands

ER -

McKevitt P. CHAMELEON meets spatial cognition. In O Nuallain S, editor, Spatial cognition: Foundations and Applications. Vol. 26. Amsterdam, The Netherlands. 2000. p. 149-170