Video-based Tracking

We believe that in the near future traditional computer input devices like the keyboard and the mouse are going to be supplemented or replaced by more natural interfaces. For many applications, vision-based trackers are suitable as interaction devices. We have developed a family of non-intrusive, markerless computer vision based modules for human computer interaction in indoor environments. The modules are designed to work with a variety of cameras ranging from low cost to high end devices allowing to find a best compromise between performance and price. All trackers may communicate via established protocols (e.g. Polhemus protocol on serial line) as well as via specially designed DCOM interfaces.

Our gaze tracking module applies a special cornea reflex method. It senses the user's current point of fixation (lines-of-sight of both eyes) at a rate of 50 Hz with a single stationary camera. Due to the wide-angle optics, the user may move in a range of 30x30x30cm.

Using sensor fusion techniques, the various tracking modules may be combined to set-up novel interaction tools allowing smart applications. For example, a new and very natural pointing tool is created by combining the head (pupil) tracker with the hand (finger tip) tracker; with such a tool the user can easily control the position of a marker on the screen by pointing in the desired direction. Tracking the users gaze vector allows a speech recognition engines to react more reliable and context sensitive.

Specifications