Download available

Authors:

Juliette Regimbal, Marcelo M. Wanderley

Publication or Conference Title:

Proceedings of the 2021 International Conference on New Interfaces for Musical Expression (NIME 2021)

Abstract:

Audio and haptic sensations have previously been linked in the development of NIMEs and in other domains like human-computer interaction. Most efforts to work with these modalities together tend to either treat haptics as secondary to audio, or conversely, audio as secondary to haptics, and design sensations in each modality separately. In this paper, we investigate the possibility of designing audio and vibrotactile effects simultaneously by interpolating audio-haptic control spaces. An inverse radial basis function method is used to dynamically create a mapping from a two-dimensional space to a many-dimensional control space for multimodal effects based on user-specified control points. Two proofs of concept were developed focusing on modifying the same structure across modalities and parallel structures.

Publication Details:

Type:	Conference Paper
Date:	06/14/2021
Location:	Shanghai, China

IDMIL Participants:

• Marcelo M. Wanderley