Nowadays computer animation mostly did in 3D. However, we are still looking at 2D image on TV or computer screen. Even using a 3D capable monitor does not solve this problem completely, since the view point should change when the viewer moves. In this project we will build a 3D viewer that updates the view point according to user’s head location and direction of sight. We will track the person’s head using Kinect or TrackIR hardware and update the scene accordingly. This allows the viewer actually to see the other side of the object on the screen. Optionally, our viewer can support animated scenes and using 3D monitor with glasses.
In this project we will develop an algorithm to fuse data from several kinect sensors into one complete 3D model.