Hand Tracker

Video-based Tracking

Pointing with the fingertip is an easy and natural way to interact with virtual objects shown on a 3D display. Our hand tracker measures the 3D position of the user's fingertip at a rate of 50 Hz. Besides the pointing actions, some simple gestures signalling stop, start, left and right are recognized. In order to increase the tracking range, the basic pair of stereo cameras can be extended by additional cameras. Without using any markers the video-based object tracker computes the position and orientation of known, geometrically defined objects. These data are used to overlay 3D graphical objects and to annotate information about the scene on live video. The object tracker can also be used as a flexible interacting device to manipulate virtual objects with real tools.