Interactive Media - Human Factors Object Tracker

Video-based Object Tracking

Without using any markers the video-based object tracker computes the position and orientation of known, geometrically defined objects. These data are used to overlay 3D graphical objects and to annotate information about the scene on live video. The object tracker can also be used as a flexible interacting device to manipulate virtual objects with real tools.

Using sensor fusion techniques, the various tracking modules may be combined to set-up novel interaction tools allowing smart applications. For example, a new and very natural pointing tool is created by combining the head (pupil) tracker with the hand (finger tip) tracker; with such a tool the user can easily control the position of a marker on the screen by pointing in the desired direction. Tracking the users gaze vector allows a speech recognition engines to react more reliable and context sensitive.

These tracking modules are developed in the mixed3D project, which is funded by the Federal Republic of Germany, Ministry of Education and Research under Grant No. 01 BD 250.