Gesture and Embodied Metaphor in Spatial Music Performance Systems Design

Ricky Graham, Brian Bridges

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper describes the theoretical underpinnings, design, and development of a hyper–instrumental performance system driven by gestural data obtained from an electric guitar. The system combines a multichannel audio feed from the guitar (which is parsed for its pitch, spectral content and note inter–onset time data to provide abstractions of sounded performance gestures) with motion tracking of the performer’s larger–scale bodily movements using a Microsoft Xbox Kinect sensor. These gestural materials are used to provide the basis for the structures of relational mappings, informed by the embodied image schema structures of Lakoff and Johnson. These theoretical perspectives are refined via larger–scale ecological–embodied structural relationships in electroacoustic music outlined in Smalley’s theory of spectromorphology, alongside the incorporation of an additional active–agential response structure through the use of the boids flocking algorithm by Reynolds to control the spatialization of outputs and other textural processes. The paper aims to advance a broadly–applicable ‘performance gesture ecology’, providing a shared spatial–relational mapping (a ‘basic gestural space’) which allows for creative (but still coherent) mappings from the performance gestures to the control of textural and spatial structures.
LanguageEnglish
Title of host publicationUnknown Host Publication
Pages581-584
Number of pages655
Publication statusPublished - 30 Jun 2014
EventNIME 2014 (New Interfaces for Musical Expression) - Goldsmiths, University of London
Duration: 30 Jun 2014 → …

Conference

ConferenceNIME 2014 (New Interfaces for Musical Expression)
Period30/06/14 → …

Fingerprint

Systems analysis
Ecology
Sensors

Keywords

  • Gesture
  • embodied
  • schemas
  • boids
  • flocking
  • spatialization
  • mapping

Cite this

Graham, R., & Bridges, B. (2014). Gesture and Embodied Metaphor in Spatial Music Performance Systems Design. In Unknown Host Publication (pp. 581-584)
Graham, Ricky ; Bridges, Brian. / Gesture and Embodied Metaphor in Spatial Music Performance Systems Design. Unknown Host Publication. 2014. pp. 581-584
@inproceedings{d2c9a19a0159413598af21c037078fab,
title = "Gesture and Embodied Metaphor in Spatial Music Performance Systems Design",
abstract = "This paper describes the theoretical underpinnings, design, and development of a hyper–instrumental performance system driven by gestural data obtained from an electric guitar. The system combines a multichannel audio feed from the guitar (which is parsed for its pitch, spectral content and note inter–onset time data to provide abstractions of sounded performance gestures) with motion tracking of the performer’s larger–scale bodily movements using a Microsoft Xbox Kinect sensor. These gestural materials are used to provide the basis for the structures of relational mappings, informed by the embodied image schema structures of Lakoff and Johnson. These theoretical perspectives are refined via larger–scale ecological–embodied structural relationships in electroacoustic music outlined in Smalley’s theory of spectromorphology, alongside the incorporation of an additional active–agential response structure through the use of the boids flocking algorithm by Reynolds to control the spatialization of outputs and other textural processes. The paper aims to advance a broadly–applicable ‘performance gesture ecology’, providing a shared spatial–relational mapping (a ‘basic gestural space’) which allows for creative (but still coherent) mappings from the performance gestures to the control of textural and spatial structures.",
keywords = "Gesture, embodied, schemas, boids, flocking, spatialization, mapping",
author = "Ricky Graham and Brian Bridges",
year = "2014",
month = "6",
day = "30",
language = "English",
isbn = "978-1-906897-29-­1",
pages = "581--584",
booktitle = "Unknown Host Publication",

}

Graham, R & Bridges, B 2014, Gesture and Embodied Metaphor in Spatial Music Performance Systems Design. in Unknown Host Publication. pp. 581-584, NIME 2014 (New Interfaces for Musical Expression), 30/06/14.

Gesture and Embodied Metaphor in Spatial Music Performance Systems Design. / Graham, Ricky; Bridges, Brian.

Unknown Host Publication. 2014. p. 581-584.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Gesture and Embodied Metaphor in Spatial Music Performance Systems Design

AU - Graham, Ricky

AU - Bridges, Brian

PY - 2014/6/30

Y1 - 2014/6/30

N2 - This paper describes the theoretical underpinnings, design, and development of a hyper–instrumental performance system driven by gestural data obtained from an electric guitar. The system combines a multichannel audio feed from the guitar (which is parsed for its pitch, spectral content and note inter–onset time data to provide abstractions of sounded performance gestures) with motion tracking of the performer’s larger–scale bodily movements using a Microsoft Xbox Kinect sensor. These gestural materials are used to provide the basis for the structures of relational mappings, informed by the embodied image schema structures of Lakoff and Johnson. These theoretical perspectives are refined via larger–scale ecological–embodied structural relationships in electroacoustic music outlined in Smalley’s theory of spectromorphology, alongside the incorporation of an additional active–agential response structure through the use of the boids flocking algorithm by Reynolds to control the spatialization of outputs and other textural processes. The paper aims to advance a broadly–applicable ‘performance gesture ecology’, providing a shared spatial–relational mapping (a ‘basic gestural space’) which allows for creative (but still coherent) mappings from the performance gestures to the control of textural and spatial structures.

AB - This paper describes the theoretical underpinnings, design, and development of a hyper–instrumental performance system driven by gestural data obtained from an electric guitar. The system combines a multichannel audio feed from the guitar (which is parsed for its pitch, spectral content and note inter–onset time data to provide abstractions of sounded performance gestures) with motion tracking of the performer’s larger–scale bodily movements using a Microsoft Xbox Kinect sensor. These gestural materials are used to provide the basis for the structures of relational mappings, informed by the embodied image schema structures of Lakoff and Johnson. These theoretical perspectives are refined via larger–scale ecological–embodied structural relationships in electroacoustic music outlined in Smalley’s theory of spectromorphology, alongside the incorporation of an additional active–agential response structure through the use of the boids flocking algorithm by Reynolds to control the spatialization of outputs and other textural processes. The paper aims to advance a broadly–applicable ‘performance gesture ecology’, providing a shared spatial–relational mapping (a ‘basic gestural space’) which allows for creative (but still coherent) mappings from the performance gestures to the control of textural and spatial structures.

KW - Gesture

KW - embodied

KW - schemas

KW - boids

KW - flocking

KW - spatialization

KW - mapping

UR - http://www.nime2014.org/technical-programme/proceedings/

UR - http://nime2014.org/proceedings/NIME2014-Proceedings.pdf

UR - http://nime2014.org/proceedings/papers/526_paper.pdf

UR - http://www.nime2014.org/technical-programme/proceedings/

UR - http://nime2014.org/proceedings/NIME2014-Proceedings.pdf

UR - http://nime2014.org/proceedings/papers/526_paper.pdf

M3 - Conference contribution

SN - 978-1-906897-29-­1

SP - 581

EP - 584

BT - Unknown Host Publication

ER -

Graham R, Bridges B. Gesture and Embodied Metaphor in Spatial Music Performance Systems Design. In Unknown Host Publication. 2014. p. 581-584