Image Processing Projects

Current projects



Current projects



Current projects

inEvent - Accessing Dynamic Networked Multimedia Events



inEvent - Accessing Dynamic Networked Multimedia Events

inEvent - Accessing Dynamic Networked Multimedia Events



http://www.inevent-project.eu/

Co-funded by the European Commission's Seventh Framework Programme

Duration: November 2011 – October 2014

The main goal of inEvent is to develop new means to structure, retrieve, and share large archives of networked, and dynamically changing, multimedia recordings, mainly consisting here of meetings, video-conferences, and lectures. Exploiting, and going beyond, the current state-of-the-art in audio, video, and multimedia processing and indexing, the present project proposes research and development towards a system that addresses the above problem by breaking our multimedia recordings into interconnected "hyper-events" (as opposed to hypertext) consisting of a particular structure of simpler "facets" which are easier to search, retrieve and share. Building and adaptively linking such "hyper-events", as a means to search and link networked multimedia archives, will result in more efficient search system, in which information can be retrieved based on "insights" and "experiences" (in addition to the usual metadata).

3DTVS - 3DTV Content Search



3DTVS - 3DTV Content Search

3DTVS - 3DTV Content Search



http://www.3dtvs-project.eu/

Co-funded by the European Commission's Seventh Framework Programme

Duration: November 2011 – October 2014

The goal of the 3DTVS project is to devise scalable 3DTV AV content description, indexing, search and browsing methods across open platforms, by using mobile and desktop user interfaces and to incorporate such functionalities in 3D audiovisual content archives. The major novelty in 3DTV content indexing/retrieval research will be on how to exploit 3D (depth) information for stereo and multiview video indexing, retrieval and browsing that could address semantic queries of the form ‘find stereo videos with shallow depth’ or ‘find stereo videos, where actor X approaches actor Y’. 3D multichannel audio analysis will perform better audio source (e.g. musical instrument) separation and localization that will be used in 3D audio/cross-modal indexing and retrieval. Multimodal 3D audiovisual content analysis will built on the results of 3D video and audio analysis. 3DTV content description and search mechanisms will be developed to enable fast reply to semantic queries. User friendly mobile/desktop search interfaces will be built that could also permit adaptation to the user needs and profile.

SCENE - Novel Scene Representations for Richer Networked Media



SCENE - Novel Scene Representations for Richer Networked Media

SCENE - Novel Scene Representations for Richer Networked Media



http://3d-scene.eu/

Co-funded by the European Commission's Seventh Framework Programme

Duration: November 2011 – October 2014

As digital media technologies advance, audiences desire more engaging experiences, with a greater sense of actuality and presence – of being there, both inside and outside the cinema. Better networks and domestic media platforms have fuelled a desire for anytime and anywhere access, and the ability to personalize the view or content. Scene responds by developing novel scene representations for digital media to create and deliver richer media experiences. The scene representations go beyond the ability of either sample based (video) or model-based (CGI) methods. The scene representation and its associated tools will make it possible to capture 3D video, combine video seamlessly with CGI, manipulate and deliver it to either 2D or 3D platforms in either linear or interactive form. Scene will address the problem along the chain from 3D data capture and analysis, the extraction of scene information, construction and manipulation of the representation, through to its optimization for network delivery and rendering on different platforms and at different quality levels.

Fascinate - Format-Agnostic SCript-based INterAcTive Experience



Fascinate - Format-Agnostic SCript-based INterAcTive Experience

Fascinate



www.fascinate-project.eu

Co-funded by the European Commission's Seventh Framework Programme

Duration: February 2010 – July 2013

The FascinatE project will develop a system to allow end-users to interactively view and navigate around an ultra-high resolution video panorama showing a live event, with the accompanying audio automatically changing to match the selected view. The output will be adapted to their particular kind of device, covering anything from a mobile handset to an immersive panoramic display. At the production side, this requires the development of new audio and video capture systems, and scripting systems to control the shot framing options presented to the viewer. Intelligent networks with processing components will be needed to repurpose the content to suit different device types and framing selections, and user terminals supporting innovative interaction methods will be needed to allow viewers to control and display the content.

Muscade - Multimedia Scalable 3D for Europe



Muscade - Multimedia Scalable 3D for Europe

Muscade



www.muscade.eu

Co-funded by the European Commission's Seventh Framework Programme

Duration: January 2010 – December 2012

MUSCADE will create major innovations in the fields of production equipment and tools, production, transmission and coding formats allowing technology independent adaptation to any 3D display and transmission of multiview signals while not exceeding double the data rate of monoscopic TV, and robust transmission schemes for 3DTV over all existing and future broadcast channels.

20203DMedia - Spatial sound and vision



2020 3D Media - Spatial sound and vision

20203DMedia - Spatial sound and vision



www.20203dmedia.eu

Co-funded by the European Commission's Seventh Framework Programme

Duration: March 2008 – February 2012

2020 3D Media will research, develop and demonstrate novel forms of compelling entertainment experiences based on new technologies for the capture, production, networked distribution and display of three-dimensional sound and images.

AVATecH - Advancing Video Audio Technology in Humanities Research



AVATecH - Advancing Video Audio Technology in Humanities Research

avatech



www.mpi.nl/avatech

Joint Max-Planck/Fraunhofer project

Duration: June 2009 – May 2012

The goal of AVATecH is to investigate and develop technology for semi-automatic annotation of audio and video recordings used in humanities research. Detectors that will be available via interactive annotation tools and also via batch processing can help for example with chunking, tagging, annotation and search.

Past projects



Past projects

3D@Sat



3D@Sat

3D@Sat



http://telecom.esa.int/telecom/www/object/index.cfm?fobjectid=29981

Funded by the European Space Agency (ESA)

Duration: June 2009 – July 2011

3D@SAT will review and investigate the potential of future 3D Multiview (MVV) / Free viewpoint Video (FVV) technologies, build up a simulation system for 3D services over satellite and disseminate its findings to relevant fora (e.g. DVB 3D-SM, DVB TM–AVC, ITU-T/VCEG, ISO/MPEG, SMPTE, 3D@Home etc.).

3DPresence



3DPresence

3DPresence



www.3dpresence.eu

Co-funded by the European Commission's Seventh Framework Programme

Duration: January 2008 – June 2010

The 3DPresence project will implement a multi-party, high-end 3D videoconferencing concept that will tackle the problem of transmitting the feeling of physical presence in real-time to multiple remote locations in a transparent and natural way. More briefly, 3DPresence does research and implements one of the very first true 3D Telepresence systems. In order to realize this objective, 3D Presence will go beyond the current state of the art by emphasizing the transmission, efficient coding and accurate representation of physical presence cues such as multiple user (auto)stereopsis, multi-party eye contact and multi-party gesture-based interaction.

3D4YOU - Content generation and delivery for 3D television



3D4YOU - Content generation and delivery for 3D television

3D4YOU - Content generation and delivery for 3D television



www.3d4you.eu

Co-funded by the European Commission's Seventh Framework Programme

Duration: February 2008 – January 2011

The 3D4YOU project will develop the key elements of a practical 3D television system, particularly, the definition of a 3D delivery format and guidelines for a 3D content creation process. The project will develop 3D capture techniques, convert captured content for broadcasting and develop 3D coding for delivery via broadcast, i.e. suitable to transmit and make public.

PRIME - Produktions- und Projektionstechnologien für immersive Medien



PRIME - Produktions- und Projektionstechnologien für immersive Medien

PRIME - Produktions- und Projektionstechnologien für immersive Medien



www.prime3d.de

Co-funded by the German Federal Ministry for Economy and Technology (BMWi)

Duration: March 2008 – February 2011

Eight leading firms and research institutes have formed a consortium in order to develop trend-setting techniques and business-models for the implementation of 3D-media into cinema, TV and video games. Our project entitled "PRIME PRoduction- and Projection-Techniques for Immersive MEdia-" is state-aided by the German Federal Ministry for Economy and Technology (BMWi).

RUSHES - Retrieval of multimedia Semantic units for enhanced reusability



RUSHES - Retrieval of multimedia Semantic units for enhanced reusability

RUSHES - Retrieval of multimedia Semantic units for enhanced reusability



www.rushes-project.eu

Co-funded by the European Commission's Sixth Framework Programme

Duration: February 2007 – July 2009

The overall aim of the RUSHES project is to design, implement, and validate a system for indexing, accessing and delivering raw, unedited audio-visual footage known in broadcasting industry as "rushes". This system will have its viability tested by means of trials. The goal is to promote the reuse of such material, and especially its content in the production of new multimedia assets by offering semantic media search capabilities.