NAB Show 2018
7 - 12
Las Vegas, USA
The Fraunhofer Heinrich Hertz Institute HHI is a world leader in the development for mobile and optical communication networks and systems as well as processing and coding of video signals. Together with international partners from research and industry, Fraunhofer HHI works in the whole spectrum of digital infrastructure – from fundamental research to the development of prototypes and solutions.
At NAB Show 2018 Fraunhofer HHI presents the latest developments in Vision & Imaging Technologies and Video Coding & Analytics at Fraunhofer Booth SU4916 from April 7 to 12 in Las Vegas, USA.
Future Video Coding beyond HEVC
Compressed video data are growing at a faster rate than ever before. Already today, video data make up by far the highest percentage of bits on the Internet and in mobile traffic. This demonstrates the need for even more efficient compression which goes beyond the current state of the art High Efficiency Video Coding standard (HEVC). In order to master this demanding challenge, the ITU Video Coding Expert Group (VCEG) and the ISO/IEC Moving Pictures Expert Group (MPEG) have already started working together in the Joint Video Experts Team (JVET). Last October, JVET issued a call for proposals for video coding technology beyond HEVC. Fraunhofer HHI has responded to the call by submitting cutting edge coding technology to be included in the final standard by 2020.
At NAB 2018, Fraunhofer HHI will showcase its codec proposed to JVET for video coding technology beyond HEVC. The Fraunhofer HHI codec already shows significant coding efficiency improvements over HEVC for content ranging from standard High Definition (HD) to High Dynamic Range Ultra-HD content.
3D Human Body Reconstruction for Virtual and Augmented Reality
Fraunhofer Heinrich Hertz Institute is presenting a novel and uniquely integrated 360-degree multi-camera capture and lighting system for the creation of highly realistic Volumetric Video content of moving persons. A set of 16 stereo cameras create 3D information from all different viewpoints around the person. This 3D information is then fused and transformed into a consistent, natural and dynamic 3D representation of the person. The automatically computed sequence of meshes can be integrated in VR and AR applications. The capture system supports diffuse lighting from any direction, which offers best possible conditions for re-lighting of the dynamic 3D models, afterwards, at design stage of the virtual reality experience.
Live End to End Streaming of VR360 10K Video with MPEG-OMAF and HEVC Tiles
Streaming high-quality VR360 panoramic video with resolutions up to 10K x 4K consumes large amounts of bandwidth. Moreover, the encoded video requires decoding capabilities beyond 4K video at the receiving side, e.g. on VR glasses with a mobile phone. Fully standardized tile-based streaming solves these issues by spatially segmenting the panoramic video into tiles. Each tile is encoded with HEVC at the original high-definition and an additional low-definition resolution. The new MPEG-OMAF standard allows to package the HEVC tile streams in a way that the receiver, e.g. VR glasses or a TV screen, can request the high-definition tiles for the user's viewport and low-definition tiles for the areas out of sight. The tiles are aggregated into a single HEVC compliant video stream and decoded with a legacy hardware video decoder on the end device.
At NAB 2018, Fraunhofer HHI showcases the world's first standard-compliant end to end chain for live VR360 video streaming beyond 4K resolution. This includes high-resolution VR360 10K video capturing and live rendering from the Fraunhofer HHI Omnicam-360, tile-based live encoding with the Fraunhofer HHI HEVC encoder, packaging according to the MPEG-OMAF Viewport-Dependent Media Profile and high-quality playback on VR glasses and TV screens.
For further information please click here .