SceneMaker: creative technology for digital StoryTelling

M Akser, B Bridges, G Campo, A Cheddad, KJ Curran, L Fitzpatrick, L Hamilton, J Harding, T Leath, TF Lunney, F Lyons, M Ma, J Macrae, T Maguire, A McCaughey, E McClory, V McCollum, P McKevitt, A Melvin, P Moore & 4 others E Mulholland, Karla Munoz, G O'Hanlon, L Roman

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

The School of Creative Arts & Technologies at Ulster University (Magee) has brought together the subject of computing with creative technologies, cinematic arts (film), drama, dance, music and design in terms of research and education. We propose here the development of a flagship computer software platform, SceneMaker, acting as a digital laboratory workbench for integrating and experimenting with the computer processing of new theories and methods in these multidisciplinary fields. We discuss the architecture of SceneMaker and relevant technologies for processing within its component modules. SceneMaker will enable the automated production of multimodal animated scenes from film and drama scripts or screenplays. SceneMaker will highlight affective or emotional content in digital storytelling with particular focus on character body posture, facial expressions, speech, non-speech audio, scene composition, timing, lighting, music and cinematography. Applications of SceneMaker include automated simulation of productions and education and training of actors, screenwriters and directors.
LanguageEnglish
Title of host publicationInteractivity, Game Creation, Design, Learning, and Innovation, Proc. of the 5th EAI International Conference on ArtsIT, Interactivity and Game Creation (ArtsIT-2016) and 1st EAI International Conference on Design, Learning and Innovation (DLI-2016)
EditorsA.L. Brooks, E. Brooks
Place of PublicationBerlin
Pages29-38
Volume196
DOIs
Publication statusPublished - 18 Mar 2017

Fingerprint

Digital Storytelling
Music
Drama
Education
Screenwriter
Screenplay
Dance
Facial Expression
Affective
Cinematography
Simulation
Module
Art Film
Software
Emotion
Creative Arts
Posture
Ulster

Keywords

  • SceneMaker
  • natural language processing
  • speech processing
  • artificial intelligence (AI)
  • affective computing
  • computer graphics
  • cinematography
  • 3D visualisation
  • digital storytelling
  • storyboards
  • film
  • drama
  • dance
  • music technology
  • design

Cite this

Akser, M., Bridges, B., Campo, G., Cheddad, A., Curran, KJ., Fitzpatrick, L., ... Roman, L. (2017). SceneMaker: creative technology for digital StoryTelling. In A. L. Brooks, & E. Brooks (Eds.), Interactivity, Game Creation, Design, Learning, and Innovation, Proc. of the 5th EAI International Conference on ArtsIT, Interactivity and Game Creation (ArtsIT-2016) and 1st EAI International Conference on Design, Learning and Innovation (DLI-2016) (Vol. 196, pp. 29-38). Berlin. https://doi.org/10.1007/978-3-319-55834-9_4
Akser, M ; Bridges, B ; Campo, G ; Cheddad, A ; Curran, KJ ; Fitzpatrick, L ; Hamilton, L ; Harding, J ; Leath, T ; Lunney, TF ; Lyons, F ; Ma, M ; Macrae, J ; Maguire, T ; McCaughey, A ; McClory, E ; McCollum, V ; McKevitt, P ; Melvin, A ; Moore, P ; Mulholland, E ; Munoz, Karla ; O'Hanlon, G ; Roman, L. / SceneMaker: creative technology for digital StoryTelling. Interactivity, Game Creation, Design, Learning, and Innovation, Proc. of the 5th EAI International Conference on ArtsIT, Interactivity and Game Creation (ArtsIT-2016) and 1st EAI International Conference on Design, Learning and Innovation (DLI-2016). editor / A.L. Brooks ; E. Brooks. Vol. 196 Berlin, 2017. pp. 29-38
@inbook{3455089b630e4736a474957e808d8cc0,
title = "SceneMaker: creative technology for digital StoryTelling",
abstract = "The School of Creative Arts & Technologies at Ulster University (Magee) has brought together the subject of computing with creative technologies, cinematic arts (film), drama, dance, music and design in terms of research and education. We propose here the development of a flagship computer software platform, SceneMaker, acting as a digital laboratory workbench for integrating and experimenting with the computer processing of new theories and methods in these multidisciplinary fields. We discuss the architecture of SceneMaker and relevant technologies for processing within its component modules. SceneMaker will enable the automated production of multimodal animated scenes from film and drama scripts or screenplays. SceneMaker will highlight affective or emotional content in digital storytelling with particular focus on character body posture, facial expressions, speech, non-speech audio, scene composition, timing, lighting, music and cinematography. Applications of SceneMaker include automated simulation of productions and education and training of actors, screenwriters and directors.",
keywords = "SceneMaker, natural language processing, speech processing, artificial intelligence (AI), affective computing, computer graphics, cinematography, 3D visualisation, digital storytelling, storyboards, film, drama, dance, music technology, design",
author = "M Akser and B Bridges and G Campo and A Cheddad and KJ Curran and L Fitzpatrick and L Hamilton and J Harding and T Leath and TF Lunney and F Lyons and M Ma and J Macrae and T Maguire and A McCaughey and E McClory and V McCollum and P McKevitt and A Melvin and P Moore and E Mulholland and Karla Munoz and G O'Hanlon and L Roman",
year = "2017",
month = "3",
day = "18",
doi = "10.1007/978-3-319-55834-9_4",
language = "English",
isbn = "978-3-319-55834-9",
volume = "196",
pages = "29--38",
editor = "A.L. Brooks and E. Brooks",
booktitle = "Interactivity, Game Creation, Design, Learning, and Innovation, Proc. of the 5th EAI International Conference on ArtsIT, Interactivity and Game Creation (ArtsIT-2016) and 1st EAI International Conference on Design, Learning and Innovation (DLI-2016)",

}

Akser, M, Bridges, B, Campo, G, Cheddad, A, Curran, KJ, Fitzpatrick, L, Hamilton, L, Harding, J, Leath, T, Lunney, TF, Lyons, F, Ma, M, Macrae, J, Maguire, T, McCaughey, A, McClory, E, McCollum, V, McKevitt, P, Melvin, A, Moore, P, Mulholland, E, Munoz, K, O'Hanlon, G & Roman, L 2017, SceneMaker: creative technology for digital StoryTelling. in AL Brooks & E Brooks (eds), Interactivity, Game Creation, Design, Learning, and Innovation, Proc. of the 5th EAI International Conference on ArtsIT, Interactivity and Game Creation (ArtsIT-2016) and 1st EAI International Conference on Design, Learning and Innovation (DLI-2016). vol. 196, Berlin, pp. 29-38. https://doi.org/10.1007/978-3-319-55834-9_4

SceneMaker: creative technology for digital StoryTelling. / Akser, M; Bridges, B; Campo, G; Cheddad, A; Curran, KJ; Fitzpatrick, L; Hamilton, L; Harding, J; Leath, T; Lunney, TF; Lyons, F; Ma, M; Macrae, J; Maguire, T; McCaughey, A; McClory, E; McCollum, V; McKevitt, P; Melvin, A; Moore, P; Mulholland, E; Munoz, Karla; O'Hanlon, G; Roman, L.

Interactivity, Game Creation, Design, Learning, and Innovation, Proc. of the 5th EAI International Conference on ArtsIT, Interactivity and Game Creation (ArtsIT-2016) and 1st EAI International Conference on Design, Learning and Innovation (DLI-2016). ed. / A.L. Brooks; E. Brooks. Vol. 196 Berlin, 2017. p. 29-38.

Research output: Chapter in Book/Report/Conference proceedingChapter

TY - CHAP

T1 - SceneMaker: creative technology for digital StoryTelling

AU - Akser, M

AU - Bridges, B

AU - Campo, G

AU - Cheddad, A

AU - Curran, KJ

AU - Fitzpatrick, L

AU - Hamilton, L

AU - Harding, J

AU - Leath, T

AU - Lunney, TF

AU - Lyons, F

AU - Ma, M

AU - Macrae, J

AU - Maguire, T

AU - McCaughey, A

AU - McClory, E

AU - McCollum, V

AU - McKevitt, P

AU - Melvin, A

AU - Moore, P

AU - Mulholland, E

AU - Munoz, Karla

AU - O'Hanlon, G

AU - Roman, L

PY - 2017/3/18

Y1 - 2017/3/18

N2 - The School of Creative Arts & Technologies at Ulster University (Magee) has brought together the subject of computing with creative technologies, cinematic arts (film), drama, dance, music and design in terms of research and education. We propose here the development of a flagship computer software platform, SceneMaker, acting as a digital laboratory workbench for integrating and experimenting with the computer processing of new theories and methods in these multidisciplinary fields. We discuss the architecture of SceneMaker and relevant technologies for processing within its component modules. SceneMaker will enable the automated production of multimodal animated scenes from film and drama scripts or screenplays. SceneMaker will highlight affective or emotional content in digital storytelling with particular focus on character body posture, facial expressions, speech, non-speech audio, scene composition, timing, lighting, music and cinematography. Applications of SceneMaker include automated simulation of productions and education and training of actors, screenwriters and directors.

AB - The School of Creative Arts & Technologies at Ulster University (Magee) has brought together the subject of computing with creative technologies, cinematic arts (film), drama, dance, music and design in terms of research and education. We propose here the development of a flagship computer software platform, SceneMaker, acting as a digital laboratory workbench for integrating and experimenting with the computer processing of new theories and methods in these multidisciplinary fields. We discuss the architecture of SceneMaker and relevant technologies for processing within its component modules. SceneMaker will enable the automated production of multimodal animated scenes from film and drama scripts or screenplays. SceneMaker will highlight affective or emotional content in digital storytelling with particular focus on character body posture, facial expressions, speech, non-speech audio, scene composition, timing, lighting, music and cinematography. Applications of SceneMaker include automated simulation of productions and education and training of actors, screenwriters and directors.

KW - SceneMaker

KW - natural language processing

KW - speech processing

KW - artificial intelligence (AI)

KW - affective computing

KW - computer graphics

KW - cinematography

KW - 3D visualisation

KW - digital storytelling

KW - storyboards

KW - film

KW - drama

KW - dance

KW - music technology

KW - design

U2 - 10.1007/978-3-319-55834-9_4

DO - 10.1007/978-3-319-55834-9_4

M3 - Chapter

SN - 978-3-319-55834-9

VL - 196

SP - 29

EP - 38

BT - Interactivity, Game Creation, Design, Learning, and Innovation, Proc. of the 5th EAI International Conference on ArtsIT, Interactivity and Game Creation (ArtsIT-2016) and 1st EAI International Conference on Design, Learning and Innovation (DLI-2016)

A2 - Brooks, A.L.

A2 - Brooks, E.

CY - Berlin

ER -

Akser M, Bridges B, Campo G, Cheddad A, Curran KJ, Fitzpatrick L et al. SceneMaker: creative technology for digital StoryTelling. In Brooks AL, Brooks E, editors, Interactivity, Game Creation, Design, Learning, and Innovation, Proc. of the 5th EAI International Conference on ArtsIT, Interactivity and Game Creation (ArtsIT-2016) and 1st EAI International Conference on Design, Learning and Innovation (DLI-2016). Vol. 196. Berlin. 2017. p. 29-38 https://doi.org/10.1007/978-3-319-55834-9_4