CGM Lab Engineer
Getting back to the original Iron Man movie and its awesome 3D holographic experience combined with one of the most famous gestural interfaces in sci-fi, in our 2014 we decided to show that what was just science-fiction 6 years ago is now becoming science!
We combined augmented and virtual reality experience into a single demo scene while giving to a user options to move intuitively in a virtual world with no tools or controllers, create or delete objects with simple gestures and naturally interact with created objects by moving and scaling them.
User stands in the middle of a room while Kinect sensor is placed in front of him. It'll track his movements in and provide skeleton tracking data to a system. LeapMotion sensor is placed on the Oculus Rift headset and provides hands tracking data. Oculis Rift provides user's gaze direction.
As a result of integration of various sensors for full user body position tracking with virtual reality headset we were able to demonstrate a possibility of creation of innovative human computer interaction interfaces with no traditional controllers like keyboard and mouse involved.