loading1
loading2

Brahms, Bodies and Backpropagation: Artificial Neural Networks for Movement Classification in Musical Performance

category

author

John Sullivan

Download available

Authors:

Vanessa Yaremchuk, Marcelo M. Wanderley

Publication or Conference Title:

Proceedings of 1st International Conference on Movement Computing (MOCO'14)

Abstract:

Two types of artificial neural networks are used to determine a sufficient subset of data for reasonable classification of musical instrument based on performance data from motion capture. Feedforward and recurrent networks are trained on subsets of joint angles and centre of mass from performances by violists and clarinettists. A successfully learned mapping from the reduced set of input data to the correct instrument classification implies that the data subset carries sufficient information to identify an instrument. After training, cross- validation is performed by testing networks on previously unseen data. Finally, performance is compared with that of humans performing similar classification tasks based on the same data.
Feedforward and recurrent networks are found to perform similarly when classifying test data. Instrument recognition rates by networks are comparable with human recognition rates over the various data subset conditions. The methods demonstrated here could also be applied to other movement analysis domains (e.g. gait, posture, kinematics, clinical/rehabilitation work).


Publication Details:

Type:
Conference Paper
Date:
06/01/2014
Pages:
88-93
Location:
Paris, France
DOI:
10.1145/2617995.2618011