Air Guitar prototype with Kinect

December 11, 2010 · Posted in Uncategorized 

British artist and designer Chris O’Shea created this Kinect Air Guitar prototype.

O’Shea explains how the Kinect Air Guitar works

Technical Details
Written in c++ using openFrameworks and openCV for image processing. Using the ofxKinect addon and the libfreenect driver on Mac. Thank you to the openframeworks and openkinect communities for enabling this to happen. A big thank you to Microsoft for bringing this technology to the mass market.

How it works
First it thresholds the scene to find a person, then uses a histogram to get the most likely depth of a person in the scene. Then any pixels closer than the person to the camera are possible hands. It also uses contour extremity finding on the person blob to look for hands in situations where your hand is at the same depth as your body. It only works if you are facing the camera front on. Then it uses one hand as the neck of the guitar, drawing a virtual line from the neck through the person centroid to create the guitar line. The other hand is tracked to see if it passes through this line, strumming the guitar. The neck hand position controls the chord.

Comments

Leave a Reply




  • THE CAVE : Playlist

  • INSTAGRAM – ANALOG INDUSTRIAL ARTS

    • LAKE WINTER FORREST
    • DUBROVNIK CROATIA OCEAN NAUTICAL SUNSET
    • ANIMALS FARMING COW LIVESTOCK FORREST BLACK AND WHITE
    • alexanderplatz berlin fehrnsehturm
    • RADAR DUBROVNIK CROATIA ANTENNA INDUSTRIAL COMMUNICATION
    • GLASS ARCHITECTURE CLOUD SKYLINE
    • DUBROVNIK OLD TOWN
    • ROCKS PEBBLES LAKE GOLD COLORS
    • AUTOBAHN HIGHWAY TRAVEL CARS LANDSCAPES DRIVING
    • OCEAN BEACH SURFACE CRYSTAL ART
    • YELLOW MAGIC ORCHESTRA SHINAGAWA TOKYO TRAIN STATION YMO
    • LIGHT ART MALM LIVE INDUSTRIAL AMBIENT
    • FIRE COTTAGE FIREPLACE BLACK HEAT ART
    • FORREST WOOD SCULPTURE CONTRAST
    • ROSTOCK SCANDLINES FERRY TRAVEL SUNRISE
    • WALL ARCHITECTURE ART ABSTRACT INDUSTRIAL
    • SNOWSTORM WINTER UFO PATTERN
    • SHAPES CEILING SELFIE ART DISTORTED
Get Adobe Flash player