MPEG-OMAF

Better quality for 360-degree video

The MPEG-OMAF standard (officially ISO/IEC 23090-2) is the first international standard for storage and distribution of 360° Video [1], with significant contributions from Fraunhofer HHI’s Video Coding and Analytics department. OMAF specifies tile-based streaming of 360° Video which allows for significantly higher resolution at the end device.

Fraunhofer HHI researchers have developed a complete real time transmission chain  of the HEVC-based viewport-dependent OMAF video profile using HEVC Tiles, aka tile-based streaming.

The 360-degree video is recorded using HHIs OmniCam-360. The output of the camera is encoded using HHIs HEVC live encoder and transmitted via OMAF to head-mounted display glasses running HHIs OMAF Software player on an Android Smartphone Samsung S7/S8/S9.

Fraunhofer HHI researchers have also developed tools for MPEG-OMAF Viewport-Dependent Streaming from OMAF generator to OMAF player for usages in Apps and MSE capable browsers.

Freely available tools for HEVC-based viewport-dependent OMAF video profile:

OMAF Generator

Fraunhofer HHI has developed a generator for HEVC-based viewport-dependent OMAF video profile. It takes as input a raw 360° video, encodes it using the HEVC HM Reference software  and generates the required OMAF packaging and DASH metadata. The OMAF test vectors have been generated with this software.

The software can be freely provided for testing and evaluation. If you are interested, please send an Email here

OMAF Player App

Fraunhofer HHI has developed a standard compliant OMAF VR player for offline playback of HEVC-based viewport-dependent OMAF video profile as generated by the HHI OMAF Generator or the test vectors and test vectors. The player implements the full OMAF metadata and signaling. It allows playback of the output of the OMAF/DASH packager and the OMAF/DASH test vectors.

The software can be freely provided for testing and evaluation. If you are interested, please send an Email here.

OMAF MSE JS Player

  • HTML5 MSE Playback of OMAF remove Tile-based content
  • Javascript player of OMAF HEVC-based viewport-dependent OMAF video profile files with varying resolution for MSE playback on HEVC supported browsers

The software can be freely provided for testing and evaluation. If you are interested, please send an Email here.

OAMF testvectors for HEVC-based viewport-dependent OMAF video profile

Test vectors for the OMAF/DASH playback. The testvectors are generated with the HHI OMAF Generator.

The test vectors can be freely provided for testing and evaluation. If you are interested, please send an Email here.

Other components for Real-time transmission chain:

HHI HEVC Tile-based encoder

The latest version of the software-based live encoder from Fraunhofer HHI integrates HEVC tiles for efficient encoding and transmission of 360-degree video.

Read more

Omnicam-360

The OmniCam-360 comprises eleven cameras whose images can be put together to form a seamless, high-resolution VR360 video without artifacts. The camera signals are processed into a seamless panorama in real time with a latency of five frames.

Read more

Overview of Fraunhofer HHI’s MPEG-OMAF Solution


Related Scientific

[1]  Yago Sanchez, Robert Skupin, and Thomas Schierl:
Video processing for panoramic streaming using HEVC and its scalable extensions,
Multimedia Tools and Applications, special issue on "Interactive Media: Technology and Experience", pp. 1–29, December 2016,
doi:10.1007/s11042-016-4097-4.

[2] Robert Skupin, Yago Sanchez, Y.-K. Wang, M. M. Hannuksela, J. Boyce, and M. Wien:
Standardization Status of 360 degree Video Coding and Delivery,
Proceedings of IEEE Visual Communications and Image Processing (VCIP 2017), St. Petersburg, FL, USA, December 2017.
doi:10.1109/VCIP.2017.8305083

[3] Robert Skupin, Yago Sanchez, Dimitri Podborski, Cornelius Hellge, and Thomas Schierl:
Viewport-dependent 360 Degree Video Streaming Based on the Emerging Omnidirectional Media Format (OMAF) Standard,
Proceedings of IEEE International Conference on Image Processing (ICIP 2017), Beijing, China, September 2017.
doi:10.1109/ICIP.2017.8297155

[4] Yago Sanchez, Robert Skupin, Cornelius Hellge, and Thomas Schierl:
Random Access Point period optimization for viewport adaptive tile based streaming of 360° video,
Proceedings of IEEE International Conference on Image Processing (ICIP 2017), Beijing, China, September 2017.
doi:10.1109/ICIP.2017.8296615

[5] Robert Skupin, Yago Sanchez, Dimitri Podborski, Cornelius Hellge, and Thomas Schierl:
HEVC Tile Based Streaming to Head Mounted Displays,
Proceedings of the 14th Annual IEEE Consumer Communications & Networking Conference (CCNC 2017), Las Vegas, USA, January 2017.
doi:10.1109/CCNC.2017.7983191

[6] Robert Skupin, Yago Sanchez, Cornelius Hellge, and Thomas Schierl:
Tile Based HEVC Video for Head Mounted Displays,
Proceedings of the IEEE International Symposium on Multimedia (ISM), San Jose, CA, USA, December 2016.
doi:10.1109/ISM.2016.0089

[7] Yago Sanchez, Ralf Globisch, Thomas Schierl, and Thomas Wiegand:
Low Complexity Cloud-video-Mixing Using HEVC,
Proceedings of IEEE Consumer Communications and Networking Conference, Las Vegas, NV, USA, ISBN 978-1-4799-2356-4, pp. 213-218, January 2014.
doi:10.1109/CCNC.2014.6866573

References

[1] MPEG, ISO/IEC FDIS 23090-2, Information technology -- Coded representation of immersive media -- Part 2: Omnidirectional media format, San Diego, April 2018