Dance With Your Hands

For my ESE 350 "Microcontrollers and Embedded Systems" (University of Pennsylvania, Spring 2011) final project, I worked with my friend Eric Chen on modifying Beats so it would take input from an XBOX Kinect. The result is a Kinect hooked up to a Beagleboard-xM running Android and playing Beats. It was all proof-of-concept of course as everything ran with extreme lag, but it was pretty cool nevertheless and fun!

Proof-of-concept gameplay demo of Beats 1.5.5b with Microsoft XBOX Kinect support. The song used in this demo is "Chaoz Impact" by ParagonX9, stepfile by Lisek with permission for distribution with Beats. The person learning to "dance with his hands" in the demo is my lab partner, Eric Chen while I (Philip Peng) am recording the video.

– Blog
– Demo presentation
– Demo video
– Code (Mirror)
– Binaries (Mirror)
– Final report
– GitHub Project

For installation instructions, download all the files in the "install/" folder and skip down to "5. b)" in the report.

Demo Presentation

page-0

page-1

page-2

page-3

page-4

Photos

Kinect detection for up/down/left/right
Kinect detection for up/down/left/right
Me waving my hands around at the Kinect
Me waving my hands around at the Kinect
Eric waving his hands around at the Kinect
Eric waving his hands around at the Kinect
Beagleboard-xM running Ubuntu with Kinect
Beagleboard-xM running Ubuntu with Kinect
Beagleboard-xM
Beagleboard-xM
StepMania running
StepMania running
Lets install Android on the Beagleboard-xM
Lets install Android on the Beagleboard-xM
Beats 1.5.5b running on Beagleboard-xM
Beats 1.5.5b running on Beagleboard-xM
openFrameworks Sample running on Android running on Beagleboard-xM
openFrameworks Sample running on Android running on Beagleboard-xM
Demo station setup in the lab
Demo station setup in the lab
Hello Kitty cooling fan \o/
Hello Kitty cooling fan \o/
Eric shows off his mad skillz
Eric shows off his mad skillz
Mission accomplished!
Mission accomplished!

DanceWithYourHands: http://dancewithyourhands.blogspot.com
BeatsPortable: http://beatsportable.com/2011/05/beats-kinect-win/
BeatsPortable Forums: http://beatsportable.com/forum/viewtopic.php?f=4&t=1023

UPDATE: Full report and install instructions released! See http://beatsportable.com/forum/viewtopic.php?f=4&t=1023&p=1346#p1346 for more details!

"Beats, Advanced Rhythm Game" is a music rhythm game for Google Android phones/devices. Dance with arrows to the beat of music StepMania/DDR (Dance Dance Revolution) style or tap circles Osu! Tatakae! Ouendan/Elite Beat Agents style!

This is a proof-of-concept gameplay demo of Beats 1.5.5b with Microsoft XBOX Kinect support. The song used in this demo is "Chaoz Impact" by ParagonX9, stepfile by Lisek with permission for distribution with Beats. The person learning to "dance with his hands" in the demo is my lab partner, Eric Chen while I (Philip Peng) am recording the video. This was our final project for ESE350 (Microcontrollers & Embedded Systems) at University of Pennsylvania http://www.seas.upenn.edu/~ese350/

The Kinect is connected to a Beagleboard-xM running Android (Froyo 2.2 via the Rowboat project), which is running a modified version of Beats that includes Kinect support via OpenFramework. For details, see the forum post at http://beatsportable.com/forum/viewtopic.php?f=4&t=1023&p=1346#p1346 (includes a link to our blog and a full report with detailed steps on setting things up as well as the modified source code and apk for download).

For the latest official release (aka the normal phone version), download this app via the Android Market (search for "beats", "rhythm", or "stepmania") or visit http://beatsportable.com/downloads/

For more information, see http://beatsportable.com and leave your feedback on the forums at http://beatsportable.com/forum/

Enjoy!

~Keripo

Copyright Disclaimer Under Section 107 of the Copyright Act 1976, allowance is made for 'fair use' for purposes such as criticism, comment, news reporting, teaching, scholarship, and research. Fair use is a use permitted by copyright statute that might otherwise be infringing. Non-profit, educational or personal use tips the balance in favor of fair use.

Check Also

Beats 1.7.5b and Android Fragmentation

So even though I wasn’t planning on it, I just published yet another minor update …