ofMapperSynth is an application developed by Bruno Angeles at the Input Devices and Musical Interaction Laboratory (IDMIL) at McGill University’s Schulich School of Music. It is meant as a multi-platform (Windows, Linux, Mac OS) example of combining OpenFrameworks, libmapper, the STK, and TUIO input.

TUIO is a protocol that describes blob position, mostly used in do-it-yourself (DIY) multi-touch software. ofMapperSynth accepts touch events through that protocol, and also works with mouse input.

The software interface consists of three stains that can be modified and displaced. They represent three instruments: a mandolin, a flute, and a drum kit.

By clicking on the ON button, the user starts the audio, and a rendition of Dr Dre’s Nuthin’ but a ‘G’ Thang g-funk classic is played using the three STK instruments.

By changing the positions and shape of the three stains, various parameters of the sound are modified:

Flute:

• Unordered List Item
• X position ? jet reflection
• Y position ? jet delay
• “Spikiness” ? end reflection
• Area ? amplitude

Mandolin

• X position ? body size
• Y position ? pluck position
• “Spikiness” ? sustain
• Area ? amplitude

Drum

• X position ? echo (for all instruments)
• Y position ? pitch shift (for all instruments)
• “Spikiness” ? rhythm (BPM)
• Area ? amplitude

• Libmapper: http://idmil.org/software/libmapper
• OpenFrameworks: http://www.openframeworks.cc/
• The Synthesis Toolkit (STK): https://ccrma.stanford.edu/software/stk/