OmniCam-360

OmniCam-360
OmniCam-360

2D acquisition of panoramic UHD video

In the past, Fraunhofer HHI has developed a set of scalable mirror-based multi-camera systems that can be used for capturing high-resolution 2D video panoramas for immersive applications. A new 360-degree version is the latest extension to this series. It is based on ten 36 degree mirror segments and can be equipped with HD cameras to provide panoramic UHD video with a total resolution of about 10,000 x 2,000 pel. With its special mechanical and optical features this new OmniCam-360 camera enables optimal arrangement of multiple HD cameras for parallax-free stitching of video panoramas in high quality.

Further key features of this new lightweight system, only 16 kg, are its robustness and compactness that allow for easy handling with minimum effort for adjustment and calibration. Its high performance, functionality and practicability have already been successfully proven in several commercial productions.

Further Information

3D OmniCam

3D OmniCam
3D OmniCam

3D acquisition of panoramic UHD video

2D acquisition of panoramic UHD video is much easier than generation of stereoscopic 3D video panoramas. Whereas stitching of each panorama for the left and the right eye requires parallax-free recording of all subimages, stereo representation itself needs a suitable amount of parallax for proper 3D reproduction. HHI provides an omni-directional camera system that solves this conflict in 3D panorama generation.

The 3D OmniCam is based on a scalable multi-camera rig consisting of 30 degree mirror segments with one stereo set of two HD cameras behind each mirror. The baseline of each stereo set can be adjusted in the range of 40 to 70 mm. A system consisting of six segments equipped with 12 HD cameras is available for 180 degree productions and can easily be extended to 360 degrees. The vertical fieldof- view is 60 degrees. Calibration of the whole camera system follows the theory of concentric mosaics. Thus; the left and right panoramic views can be stitched separately without parallax errors for arbitrary scenes ranging from 2 meters to infinity while the whole freedom and grammar of usual stereo productions is kept unchanged.


Further Information

Real-time Stitching Engine and Preview Monitoring

Live user navigation within panoramic content

For real-time processing of panoramic UHD video, Fraunhofer HHI has developed a software-based solution in the shape of the real-time stitching engine. Its supports all the processes needed for the generation of UHD panoramas from a given number of omni-directional camera images, such as color matching, warping, stitching and blending.

The real-time software runs on a single multi-core PC equipped with off-the-shelf graphic boards and is able to process a number of HD input streams in parallel. Furthermore, the real-time stitching engine also supports different output formats:

  • A down-sampled low-res panorama embedded in a regular HD frame that can be used for preview monitoring at the set, for viewing of dailies and editing of proxies in post-production;
  • An HD frame that can be panned and zoomed within the high-res panorama to watch details of the panoramic content e. g. to control critical regions like the stitched edges during live productions, to transmit partial HD frames out of the panoramic content in conventional broadcast environments or to allow user navigation in a wide range of interactive applications;
  • Multiple HD outputs by decomposing the full panorama into several overlapping HD tiles that can be encoded in parallel for live transmissions of entire high-res UHD content.

TiME Lab

Tomorrow's immersive Media Experience Lab - the HHI TiME Lab

Further Information