PComp ICM Final Update – Plant-Water/You Duet

For my final project I’m building off of the midterm project light theremin, having it now trigger whale sounds in p5, with the theremin affecting the pitch.

The theremin will trigger sound in p5 whose audio output is routed to a waterproof speaker that will be in a clear plastic bowl. There will be a plant suspended in the middle of the bowl with the roots inside the water – the plant will be connected to MIDISprout which uses electrodes to read micro-electrical shifts in the plant and then translates it to MIDI data. This will be connected ultimately to Ableton Live.
Touching the plant is usually the trigger for Midisprout’s change in notes but I’m going to have the audio from the theremin trigger the shifts,  because the water in the bowl will make various vibrations according to the pitch played.
For my midterm the audio traveling through the water created cymatic patterns that corresponded to the frequency – the hope is that the patterns will still form around the plant as well, but is not essential for this concept at this point.
This will enable the user to trigger a range of sound from p5 that could be used to duet with the plant since the plant will be generating sound from the vibrations of the MIDIsprout.
MiDISprout connected to Ableton:

Whale sounds and pitch:




Whale Sound Example:


The 2 light theremins would control the pitch and delay – currently corresponding to the bubble images.

The background of the sketch will be whale video footage whose speed will correspond with the pitch, that I’d like to project overhead onto the water.

Final Project Proposal

I’d like to continue to work with sound and organic or “organic-like” material such as magnetic putty that moves in animated way. I’ve been exploring ways to expand on the Cymatics midterm. I’m interested in possibly incorporating wearables in some way and plant sensors to triggers sounds.



Ferrofluid and magnets


Magnetic Putty

Plant Triggers