Experimental: Motion-driven Concatenative Synthesis of Cloth Sounds

September 27, 2012 · Posted in Uncategorized 

Clothing sounds synthesized using the approach from our SIGGRAPH 2012 paper, and PhD thesis work by Steven S. An.
http://www.cs.cornell.edu/projects/Sound/cloth/

Steven S. An , Doug L. James, and Steve Marschner, Motion-driven Concatenative Synthesis of Cloth Sounds, ACM Transactions on Graphics (SIGGRAPH 2012), August 2012.

Abstract: We present a practical data-driven method for automatically synthesizing plausible soundtracks for physics-based cloth animations running at graphics rates. Given a cloth animation, we analyze the deformations and use motion events to drive crumpling and friction sound models estimated from cloth measurements. We synthesize a low-quality sound signal, which is then used as a target signal for a concatenative sound synthesis (CSS) process. CSS selects a sequence of microsound units, very short segments, from a database of recorded cloth sounds, which best match the synthesized target sound in a low-dimensional feature-space after applying a hand-tuned warping function. The selected microsound units are con- catenated together to produce the final cloth sound with minimal filtering. Our approach avoids expensive physics-based synthesis of cloth sound, instead relying on cloth recordings and our motion-driven CSS approach for realism. We demonstrate its effectiveness on a variety of cloth animations involving various materials and character motions, including first-person virtual clothing with binaural sound.

Comments

Leave a Reply




  • THE CAVE : Playlist

  • INSTAGRAM – ANALOG INDUSTRIAL ARTS

    • YELLOW MAGIC ORCHESTRA SHINAGAWA TOKYO TRAIN STATION YMO
    • alexanderplatz berlin fehrnsehturm
    • ROCKS PEBBLES LAKE GOLD COLORS
    • LIGHT ART MALM LIVE INDUSTRIAL AMBIENT
    • RADAR DUBROVNIK CROATIA ANTENNA INDUSTRIAL COMMUNICATION
    • FIRE COTTAGE FIREPLACE BLACK HEAT ART
    • SHAPES CEILING SELFIE ART DISTORTED
    • ROSTOCK SCANDLINES FERRY TRAVEL SUNRISE
    • GLASS ARCHITECTURE CLOUD SKYLINE
    • AUTOBAHN HIGHWAY TRAVEL CARS LANDSCAPES DRIVING
    • ANIMALS FARMING COW LIVESTOCK FORREST BLACK AND WHITE
    • LAKE WINTER FORREST
    • FORREST WOOD SCULPTURE CONTRAST
    • SNOWSTORM WINTER UFO PATTERN
    • WALL ARCHITECTURE ART ABSTRACT INDUSTRIAL
    • OCEAN BEACH SURFACE CRYSTAL ART
    • DUBROVNIK OLD TOWN
    • DUBROVNIK CROATIA OCEAN NAUTICAL SUNSET
Get Adobe Flash player