SceneMaker: multimodal visualisation of natural language film scripts

E Hanser, P McKevitt, TF Lunney, J Condell, M Ma

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

4 Citations (Scopus)
261 Downloads (Pure)

Abstract

Producing plays, films or animations is a complex and expensive process involving various professionals and media. Our proposed software system, SceneMaker, aims to facilitate this creative process by automatically interpreting natural language film scripts and generating multimodal, animated scenes from them. During the generation of the story content, SceneMaker gives particular attention to emotional aspects and their reflection in fluency and manner of actions, body posture, facial expressions, speech, scene composition, timing, lighting, music and camera work. Related literature and software on Natural Language Processing, in particular textual affect sensing, affective embodied agents, visualisation of 3D scenes and digital cinematography are reviewed. In relation to other work, SceneMaker follows a genre-specific text-to-animation methodology which combines all relevant expressive modalities and is made accessible via web-based and mobile platforms. In conclusion, SceneMaker will enhance the communication of creative ideas providing quick pre-visualisations of scenes.
Original languageEnglish
Title of host publicationUnknown Host Publication
EditorsR Setchi, I Jordanov, RJ Howlett, LC Jain
Place of PublicationHeidelberg, Germany
PublisherSpringer
Pages430-439
Number of pages10
Volume6279
ISBN (Print)978-3-642-15383-9
DOIs
Publication statusPublished (in print/issue) - Sept 2010
EventProc. of the 14th International Conference on Knowledge-Based and Intelligent Information and Engineering Systems (KES-10) - Cardiff University, Cardiff, Wales
Duration: 1 Sept 2010 → …

Conference

ConferenceProc. of the 14th International Conference on Knowledge-Based and Intelligent Information and Engineering Systems (KES-10)
Period1/09/10 → …

Fingerprint

Dive into the research topics of 'SceneMaker: multimodal visualisation of natural language film scripts'. Together they form a unique fingerprint.

Cite this