2015

This Floating Tracker (interactive movement and dance analysis for generative graphics and sound) - pixel skeleton with control points

This Floating Tracker is an open source release of the software used in This Floating World. It includes algorithms to extract a pixel skeleton from the 3D silhouette returned by the Kinect (much more stable than the Kinect’s skeleton tracking algorithms when dealing with the diverse body dynamics of a dancer). It analyses for optical flow, tracks end points of the skeleton over time using a Kalman Filter and other features such as centroid and bounding box.

At the moment the software does not include the generative graphics code used in the show. I hope to release this down the line. It does include code to receive tablet commands from TouchOSC, to manage different graphical scenes and all the framework utilities used to manage the sound and graphics of the show.

It builds on Windows 8+ only using Visual Studio 2013. It depends on the Cinder framework and the Microsoft Kinect SDK v2.

Find the code on Github: This Floating Tracker

This Floating Tracker (interactive movement and dance analysis for generative graphics and sound) - screenshot of pixel skeleton with control point tracking and optical flow field
This Floating Tracker (interactive movement and dance analysis for generative graphics and sound) - screenshot of Staircase sketch with code

Licence

This Floating Tracker is released under the MIT licence. We request that you acknowledge its use in any project documentation with a link to http://thisfloatingworld.com where possible. More importantly, I’d love to hear how you use it.

Acknowledgements

This Floating Tracker was coded by Tim Murray-Browne and created by Tim Murray-Browne and Jan Lee using public funding by the National Lottery through Arts Council England. Thank you to Ali Nakipoglu of Marshmallow Laser Feast for help with the skeleton tracking.