Research Topics of Interactive & Cognitive Systems

Pose and gesture analysis

We research and develop fast and reliable algorithms for detection and tracking of whole body movements as well as movements of specific body parts. Our solutions focus on body, head, eye, hand and finger tracking as well as posture, movement and gait analysis. Our algorithms are based on non-intrusive, marker less sensors which provide 2D and/or 3D video signals, e.g. colour, depth-from stereo, time of flight or structured light. These algorithms are designed to work with a variety of cameras from low cost, mobile to high-end devices finding a best compromise between performance and price, from offline behaviour analysis to real-time human-computer interaction.

Read more

Behaviour analysis for human-computer interaction

Based on our detection and tracking algorithms as well as additional novel input sources such as voice control, we create novel human computer interaction modules. This involves calibration, fusion and interpretation of various data in a specific context. These modules are used in various applications such as behaviour analysis for ambient assisted living solutions, interaction with applications and media content as well as novel video communication applications.

Read more

Contact-free human-computer interaction

We believe that in the near future traditional computer input devices like keyboard and mouse are going to be supplemented or replaced by more natural interfaces. Applying usability engineering methods and the user centred design approach, we develop novel concepts for contact-free human-computer interaction that allow users to control any application or system by using free-form hand, finger or whole body movements and gestures. If suitable and beneficial, we include additional input technologies such as voice control to improve user experiences in specific scenarios. Applying our interaction modules various solutions in the field of medical, automotive, digital signage, cultural heritage or education have been developed that prove the capability of these interaction concepts.

Read more

3D user interfaces

Regarding the enormous potential of virtual environments, the development of appropriate ready-to-use graphical components is the key to successfully make 3D multimedia contents accessible to a large public. We have a long experience in designing novel graphical interfaces and adding navigation metaphors. Furthermore, we propose techniques to display AR scenes onto stereoscopic, autostereoscopic and panoramic screens. Through our 3D framework, we develop sustained UI components and integrate them into awesome applications.

Image Quality Estimation

The ultimate receiver of digital media is the human. We use state-of-the art machine learning  model the human visual system and to estimate and predict visual quality as it is perceived by humans. Our methods find wide applications in multimedia communications.

Read more