Exploring Pitch and Timbre through 3D Spaces: Embodied Models in Virtual Reality as a Basis for Performance Systems Design

Richard Graham, Brian Bridges, Christopher Manzione, William Brent

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Our paper builds on an ongoing collaboration between theorists and practitioners within the computer music community, with a specific focus on three-dimensional environments as an incubator for performance systems design. In particular, we are concerned with how to provide accessible means of controlling spatialization and timbral shaping in an integrated manner through the collection of performance data from various modalities from an electric guitar with a multichannel audio output. This paper will focus specifically on the combination of pitch data treated within tonal models and the detection of physical performance gestures using timbral feature extraction algorithms. We discuss how these tracked gestures may be connected to concepts and dynamic relationships from embodied cognition, expanding on performative models for pitch and timbre spaces. Finally, we explore how these ideas support connections between sonic, formal and performative dimensions. This includes instrumental technique detection scenes and mapping strategies aimed at bridging music performance gestures across physical and conceptual planes.
Original languageEnglish
Title of host publicationProceedings of the International Conference on New Interfaces for Musical Expression
PublisherAalborg University
Pages157-162
Number of pages6
Volumen/a
Editionn/a
DOIs
Publication statusPublished - 1 Jun 2017
EventInternational Conference on New Interfaces for Musical Expression (NIME) 2017 - Aalborg University, Copenhagen, Denmark
Duration: 15 May 201719 May 2017

Publication series

NameArchive of NIME Proceedings
ISSN (Print)2220-4806

Conference

ConferenceInternational Conference on New Interfaces for Musical Expression (NIME) 2017
CountryDenmark
CityCopenhagen
Period15/05/1719/05/17

Keywords

  • Gesture
  • embodied
  • schemas
  • mapping
  • metaphor
  • spatialization
  • timbre
  • feature
  • tracking

Fingerprint

Dive into the research topics of 'Exploring Pitch and Timbre through 3D Spaces: Embodied Models in Virtual Reality as a Basis for Performance Systems Design'. Together they form a unique fingerprint.

Cite this