Instrumented Bodies:
Digital Prostheses for Music and Dance Performance

Participants: Joseph Malloch,
Ian Hattwick
Marlon Schumacher
Marcelo M. Wanderley (supervisor)

Prototype of the Spine prosthetic instrument
Funding: • Programme d'appui à la recherche-création,
FRQ-SC (Ferguson)
• Centre for Interdisciplinary Research in Music
Media and Technology
• Dawson Chair in design strategies for new
digital musical instruments (Wanderley)
• Discovery Grant, NSERC (Wanderley)

Project Type: Research-creation project.

Time Period: Sept. 2011 - May. 2013. Status: ongoing.


Project Description

These instruments are the culmination of a three-year long project in which the designers worked closely with dancers, musicians, composers and a choreographer. The goal of the project was to develop instruments that are visually striking, utilize advanced sensing technologies, and are rugged enough for extensive use in performance.

The complex, transparent shapes are lit from within, and include articulated spines, curved visors and ribcages. Unlike most computer music control interfaces, they function both as hand-held, manipulable controllers and as wearable, movement-tracking extensions to the body. Further, since the performers can smoothly attach and detach the objects, these new instruments deliberately blur the line between the performers' bodies and the instrument being played.

The prosthetic instruments were designed and developed by Ph.D. researchers Joseph Malloch and Ian Hattwick under the supervision of IDMIL director Marcelo Wanderley. Starting with sketches and rough foam prototypes for exploring shape and movement, they progressed through many iterations of the design before arriving at the current versions. The researchers made heavy use of digital fabrication technologies such as laser-cutters and 3D printers, which they accessed through the McGill University School of Architecture and the Centre for Interdisciplinary Research in Music Media and Technology, also hosted by McGill.

Each of the nearly thirty working instruments produced for the project has embedded sensors, power supplies and wireless data transceivers, allowing a performer to control the parameters of music synthesis and processing in real time through touch, movement, and orientation. The signals produced by the instruments are routed through an open-source peer-to-peer software system the IDMIL team has developed for designing the connections between sensor signals and sound synthesis parameters.

Although evolution of the new instrument designs has not ceased, the current versions were featured in recent productions of the piece "Les Gestes" for two dancers and two musicians. The piece was developed in collaboration with the IDMIL researchers, and toured parts of Canada and Europe during the spring of 2013.


Photographs

High-resolution copies of these photographs are available here

The Ribs

Violinist Marjolaine Lambert and dancer Sophie Breton playing the Ribs; Instrument design © 2012 by Joseph Malloch and Ian Hattwick; Photo © 2013 by Michael Slobodian

The Spine

Dancer Soula Trougakos wearing the Spine; Instrument design © 2012 by Joseph Malloch and Ian Hattwick; Photo: © 2012 by Vanessa Yaremchuk

The Visor

Dancer Soula Trougakos wearing the Visor; Instrument design © 2012 by Joseph Malloch and Ian Hattwick.



Selected Press

Publications