← All research projects

Playing Water with the Mind: A State-of-Float Hydraulophone Driven by EEG and Motion

IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2027
2027 · Prepared for IEEE ICASSP 2027; not yet published

Player kneeling on a paddleboard on calm water, wearing a Muse headband, hands on a hydraulophone mounted on the board

Playing the hydraulophone from a paddleboard on Lake Ontario while a Muse headband reads brain state and head motion.

The hydraulophone is an instrument played by touching jets of water. Our State-of-Float studies found that floating changes the theta/beta ratio read by a consumer EEG headband; in Mind over Music the same index plays the instrument. The theta/beta ratio chooses major or minor harmony, an arousal index chooses the register, and the headband's accelerometer pumps the sound with every headbang, so the state of float becomes audible, in the spirit of Mersivity.

Three players used it over two days, on the water and in VR. The paper looks honestly at what the headband contributes to the music, and at how motion and electrode contact have to be treated as part of the instrument rather than as noise.

Dark dashboard with the live sound waveform, Muse band powers over two minutes, the brain-driven effect controls, and the chord voices currently added

The live dashboard: band powers from the headband become chord, register, reverb, chorus, echo and brightness, and headbanging pumps the sound.

This paper is not yet published, so this page gives only a short summary. The full write-up and a link to the paper will follow publication.

Authors

Alexander Vicol, Rhyzome Adkisson, Steve Mann and Mersivity members (full author list to follow)

Links

← All research projects