03 - 06
The Fraunhofer Heinrich Hertz Institute HHI is a world leader in the development for mobile and optical communication networks and systems as well as processing and coding of video signals. Together with international partners from research and industry, Fraunhofer HHI works in the whole spectrum of digital infrastructure – from fundamental research to the development of prototypes and solutions.
At IBC 2021, Fraunhofer HHI presents the latest developments in Video Coding & Analytics and Vision & Imaging Technologies at Fraunhofer booth 8B.80, Hall 8, from December 03 to 06, 2021, in Amsterdam, Netherlands.
Compressed video data are growing at a faster rate than ever before. Already today, video data make up by far the highest percentage of bits on the Internet and in mobile traffic. This demonstrates the need for even more efficient compression, which goes beyond the current state of the art High Efficiency Video Coding standard (HEVC/H.265). In order to master this demanding challenge, the ITU-T Video Coding Expert Group (VCEG) and the ISO/IEC Moving Pictures Expert Group (MPEG) have been working together to develop the Versatile Video Coding standard (VVC/H.266). VVC provides a 50% bit rate reduction over HEVC and was finalized in July 2020. Opposed to previous video coding standards, VVC includes specific coding tools and systems functionalities for a wide range of applications such as resolution-adaptive multi-rate video streaming services, 360-degree immersive video, ultra low-delay streaming, gaming and screen sharing.
At IBC 2021, Fraunhofer HHI will showcase its optimized open source VVC encoder software (VVenC). VVenC is perfectly suited for fast encoding on cloud-based platforms for adaptive multi-resolution streaming. There, it demonstrates significant bit-rate reductions over HEVC for content ranging from standard definition to high dynamic range (HDR) ultra high definition. Additionally, Fraunhofer HHI will be presenting live playback of VVC encoded video in a software player and in web browsers based on its optimized open source VVC decoder software (VVdeC).
Volumetric video has become increasingly popular in recent years and is considered as the emerging key technology for the representation of real persons as dynamic 3D objects enabling truly immersive applications for Mixed- and Virtual-Reality with 6 Degrees of Freedom.
Fraunhofer HHI presents advanced techniques for interactive volumetric video streaming at this year’s IBC. The range of applications as well as the level of immersion can be significantly increased by interactivity of the user with the volumetric assets of persons. This requires online and real-time manipulation of the mesh sequence. A good example is head rotation of the volumetric asset of the captured person according to the user’s position in space. This will allow eye contact and increase the immersive experience as the user feels being looked at. In order to avoid computationally complex real-time manipulation of the volumetric asset in the end-device, processing is performed in the edge cloud. In this context, the Fraunhofer HHI has developed a cloud rendering system for interactive streaming of volumetric videos that drastically reduces the problem of high processing requirements on the client side. The rendering of a complex scene with interactive objects is performed in the cloud and finally sent to the user as a simple 2D video and intergrated into a Mixed-Reality Scene on phone, tablet or Mixed-Reality glasses.