Abstract
Intelligent MultiMedia or MultiModal systems involve the computer processing, understanding and production of inputs and outputs from at least speech, text, and visual information in terms of semantic representations. One of the central questions for these systems is what form of semantic representation should be used. Here, we look at current trends in multimodal semantic representation which are mainly XML and frame- based, relate our experiences in the development of multimodal systems (CHAMELEON and CONFUCIUS) and conclude that producer/consumer, intention (speech acts), semantic-content, and timestamps are four important components of any multimodal semantic representation.
| Original language | English |
|---|---|
| Title of host publication | Unknown Host Publication |
| Editors | H Sakaki |
| Place of Publication | Meisei University (Hino Campus), Hino-shi, Tokyo, Japan |
| Publisher | Meisei University |
| Pages | 2-13 |
| Number of pages | 12 |
| Publication status | Published (in print/issue) - Aug 2005 |
| Event | Proc. of the Pacific Rim International Conference on Computational Linguistics (PACLING-05) - Meisei University (Hino Campus), Hino-shi, Tokyo, Japan Duration: 1 Aug 2005 → … |
Conference
| Conference | Proc. of the Pacific Rim International Conference on Computational Linguistics (PACLING-05) |
|---|---|
| Period | 1/08/05 → … |