Bachelor thesis / IDP: Skeleton Animation for an Augmented Reality Magic Mirror

Thesis by:
Advisor: Nassir Navab
Supervision by: Ma Meng
Due date: now

We have previously shown an augmented reality (AR) magic mirror. We create the illusion that a user standing in front of the system can look inside the own body. The video of this system received a lot of attention and has been seen over 200.000 time on Youtube. We now want to build a system for education of human anatomy using augmented reality visualization.

The system uses the Kinect which tracks a user and provides us with the skeleton joint. A CT dataset is augmented onto the user. One problem here is that the CT dataset is rigid. So if the user moves the arm, the overlay will not be correct. We want to use a polygonal model instead of the CT. The goal of this thesis is to animate a computer model based on the joint we receive from the Kinect, similar as can be seen in this video. We want to use this dataset for it. In order to do that, the polygonal model has to be processed such the an animation of the skeleton becomes possible. Furthermore a scene graph of the skeleton has to be build.

Good knowledge in C++ is required and previous experience in OpenGL is very helpful. Experience with modeling and animation programs like Blender or 3ds Max is beneficial but not mandatory.