Air Guitar prototype with Kinect

December 11, 2010 · Posted in Uncategorized · Comment 

British artist and designer Chris O’Shea created this Kinect Air Guitar prototype.

O’Shea explains how the Kinect Air Guitar works

Technical Details
Written in c++ using openFrameworks and openCV for image processing. Using the ofxKinect addon and the libfreenect driver on Mac. Thank you to the openframeworks and openkinect communities for enabling this to happen. A big thank you to Microsoft for bringing this technology to the mass market.

How it works
First it thresholds the scene to find a person, then uses a histogram to get the most likely depth of a person in the scene. Then any pixels closer than the person to the camera are possible hands. It also uses contour extremity finding on the person blob to look for hands in situations where your hand is at the same depth as your body. It only works if you are facing the camera front on. Then it uses one hand as the neck of the guitar, drawing a virtual line from the neck through the person centroid to create the guitar line. The other hand is tracked to see if it passes through this line, strumming the guitar. The neck hand position controls the chord.

Virtual Theremin for the Kinect controller.

November 30, 2010 · Posted in Uncategorized · Comment 

It defines two virtual antenna points, which allow controlling the pitch and volume of a simple oscillator. The distance to these points can be controlled by freely moving the hand in three dimensions or by reshaping the hand, which allows gestures that are quite similar to playing an actual Theremin.

This musical instrument has been developed by Martin Kaltenbrunner at the Interface Culture Lab at the University of Art and Industrial Design in Linz, Austria. The software has been developed using the Open Frameworks and OpenKinect libraries.

Kinect MIDI controller (KMIDIC)

November 27, 2010 · Posted in Uncategorized · Comment 

Microsoft’s Xbox 360 add-on Kinect has been a big hit in the videogame world, and its amazing technology has been exploited to create a movement-based MIDI controller by resourceful hacker Ben X Tan.

MIDI contoller using the Kinect.
Coded in C#.net using this: http://codelaboratories.com/nui

Very hacky ugly, yucky, alpha prototype, source code available here:
http://benxtan.com/temp/pmidickinect.zip

Next project is making a version of pmidic that uses Kinect. Then, you can control Ableton Live or any other MIDI software or hardware with you limbs. Isn’t that amazing!!!

If you are interested, you should also check out:
http://pmidic.sourceforge.net/
http://benxtan.com

If you are a musician or music business in Australia, check out and sign up to http://rockstarhookups.com.au

UPDATE:
Please watch the video for v0.2 here: http://www.youtube.com/watch?v=fCQwNL…

Source and binaries here: http://benxtan.com/temp/pmidickinect_…

MIDI via Microsoft Kinect

November 20, 2010 · Posted in Uncategorized · Comment 

Cool hacks for Microsoft’s Kinect 3D camera system for Xbox to perform MIDI control. Result: depth-sensing, gestural musical manipulations

MIDI contoller using the Kinect.
Coded in C#.net using this: http://codelaboratories.com/nui

Very hacky ugly, yucky, alpha prototype, source code available here:
http://benxtan.com/temp/pmidickinect.zip

Next project is making a version of pmidic that uses Kinect. Then, you can control Ableton Live or any other MIDI software or hardware with you limbs. Isn’t that amazing!!!

If you are interested, you should also check out:
http://pmidic.sourceforge.net/
http://benxtan.com

« Previous Page

Get Adobe Flash player