Interactive Media - Human Factors Sensing People

Project description
Sensing People denotes the description and analysis of persons in digital images and from acoustical signals with respect to their state, their activity, their identity and many other aspects. The project aims at the development of concepts and solutions for universally applicable intelligent cameras and sensors. Intelligent cameras and sensors integrate sensing people functionalities for multimedia applications and industry electronics. They automatically extract personal data from sensor signals for almost as many applications as conceivable. For this purpose techniques are developed which allow the localization and the description of persons in video data from CCD-cameras, CMOS-cameras and microphone arrays. Microphone arrays yield information about the direction of acoustic sources. CMOS-cameras are used to capture the 3-d profiles of a scene. All the data are integrated and further analyzed within a sensor fusion module.

Objectives

  • Development of algorithms and solutions for the localization and description of persons in video data.
  • Development of algorithms and solutions for direction detection and tracking of speaking persons with microphone arrays.
  • Providing intelligent CMOS-cameras, which yield 3-d information of a scene.
  • Combining all data within a sensor fusion module to increase the recognition rate and quality.


Project Data
Supported by: Bundesministerium für Bildung und Forschung (BMBF)
Project period: 06/2001 - 12/2003


Project partners