Nice movie showing Super Mario controlled via thermine
The sound from the theremin is split into its frequency and amplitude components in real time, which are then mapped to values in a linear scale representing the X and Y axis. Pitch becomes horizontal control, and Volume becomes vertical control.
The X and Y scales are then cut up into different zones. In this case, Left; Right and dead zones for the horizontal, and a single trigger and dead zone for the vertical.
The trigger zones are then mapped onto a virtual joystick hooked into an emulator.
Found this little crazy video the other day and I must say it is facinating how well the sync goes with the game. I am not sure it is possible to do this kind of automation on NES, but if it does I am sure it will open up doors for many nice chip tunes in the Nintendo world going forward. Enjoy – it is totally whacko and it goes on and on and on
So you want to have some fun with Flash based synths, apart from the one I have posted before here are two new ones, enjoy LOL
and of course Super Mario